• Kirill Smelkov's avatar
    X neo1: localhost timings · f3fc4bdd
    Kirill Smelkov authored
    Similarly to deco there is some neo/go/sqlite speedup. Everything else
    is noise.
    
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
    
    $ benchstat -split node,cluster,dataset 20180308-neo1-ffixed-noc_C1\(3µs\)-zwrk1s.txt 20180318-neo1.txt
    
    name                                           old pystone/s            new pystone/s            delta
    node:neo1
    pystone                                                      105k ± 0%                106k ± 1%   +1.33%  (p=0.008 n=5+5)
    
    name                                           old time/op              new time/op              delta
    node:neo1
    crc32/py/4K                                                5.15µs ± 1%              5.14µs ± 1%     ~     (p=0.421 n=5+5)
    crc32/go/4K                                                2.79µs ± 0%              2.79µs ± 0%     ~     (p=0.206 n=4+5)
    sha1/py/4K                                                 13.5µs ± 3%              13.3µs ± 1%   -1.56%  (p=0.032 n=5+5)
    sha1/go/4K                                                 9.81µs ± 0%              9.81µs ± 0%     ~     (p=0.794 n=5+5)
    unzlib/py/wczdata                                          35.5µs ± 7%              36.1µs ± 2%     ~     (p=0.556 n=5+4)
    unzlib/go/wczdata                                          30.9µs ± 1%              31.1µs ± 2%     ~     (p=0.310 n=5+5)
    unzlib/py/prod1-avg                                        16.0µs ± 2%              16.1µs ± 2%     ~     (p=0.690 n=5+5)
    unzlib/go/prod1-avg                                        9.26µs ± 1%              9.27µs ± 1%     ~     (p=0.548 n=5+5)
    disk/randread/direct/4K-min                                 158µs ± 2%               162µs ± 0%   +2.01%  (p=0.016 n=5+4)
    disk/randread/direct/4K-avg                                 172µs ± 0%               172µs ± 0%     ~     (p=0.833 n=5+5)
    disk/randread/pagecache/4K-min                              392ns ± 2%               390ns ± 1%     ~     (p=0.381 n=5+5)
    disk/randread/pagecache/4K-avg                              904ns ± 1%               897ns ± 1%   -0.69%  (p=0.040 n=5+5)
    
    name                                           old time/object          new time/object          delta
    cluster:neo1 dataset:wczblk1-8
    fs1-zhash.py                                               34.7µs ± 2%              35.3µs ± 3%     ~     (p=0.175 n=5+5)
    fs1-zhash.go                                               5.90µs ± 0%              5.95µs ± 3%     ~     (p=1.000 n=4+4)
    fs1-zhash.go+prefetch128                                   6.32µs ± 3%              6.28µs ± 4%     ~     (p=0.873 n=5+5)
    zeo/py/fs1-zhash.py                                         459µs ± 0%               484µs ± 6%   +5.54%  (p=0.016 n=4+5)
    zeo/py/fs1-zhash.go                                         174µs ± 2%               175µs ± 1%     ~     (p=0.841 n=5+5)
    zeo/py/fs1-zhash.go+prefetch128                            98.5µs ± 2%             101.8µs ± 2%   +3.37%  (p=0.032 n=5+5)
    neo/py(!log)/sqlite-zhash.py                                390µs ± 1%               394µs ± 2%     ~     (p=0.421 n=5+5)
    neo/py(!log)/sqlite-zhash.go                                196µs ± 2%               204µs ± 8%   +4.40%  (p=0.032 n=5+5)
    neo/py(!log)/sqlite-zhash.go+prefetch128                    164µs ± 2%               168µs ± 2%   +2.78%  (p=0.032 n=5+5)
    neo/py(!log)/sql-zhash.py                                   459µs ± 1%               450µs ± 6%     ~     (p=0.686 n=4+4)
    neo/py(!log)/sql-zhash.go                                   249µs ± 3%               245µs ± 3%     ~     (p=0.333 n=5+5)
    neo/py(!log)/sql-zhash.go+prefetch128                       217µs ± 1%               215µs ± 3%     ~     (p=0.421 n=5+5)
    neo/go/fs1-zhash.py                                         274µs ± 1%               272µs ± 1%     ~     (p=0.206 n=5+4)
    neo/go/fs1-zhash.go                                        80.4µs ± 4%              80.0µs ± 4%     ~     (p=0.548 n=5+5)
    neo/go/fs1-zhash.go+prefetch128                            35.3µs ± 6%              34.4µs ± 4%     ~     (p=0.421 n=5+5)
    neo/go/fs1(!sha1)-zhash.go(!sha1)                          56.5µs ± 2%              55.3µs ± 2%     ~     (p=0.087 n=5+5)
    neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1)              23.2µs ± 7%              22.8µs ± 3%     ~     (p=0.722 n=5+5)
    neo/go/sqlite-zhash.py                                      322µs ± 1%               304µs ± 2%   -5.70%  (p=0.008 n=5+5)
    neo/go/sqlite-zhash.go                                      134µs ±12%               102µs ± 2%  -24.18%  (p=0.008 n=5+5)
    neo/go/sqlite-zhash.go+prefetch128                         49.4µs ± 9%              42.1µs ± 9%  -14.66%  (p=0.008 n=5+5)
    neo/go/sqlite-zhash.go(!sha1)                               114µs ± 2%                91µs ± 3%  -19.98%  (p=0.008 n=5+5)
    neo/go/sqlite-zhash.go+prefetch128(!sha1)                  46.3µs ± 5%              41.2µs ± 4%  -10.93%  (p=0.008 n=5+5)
    cluster:neo1 dataset:prod1-1024
    fs1-zhash.py                                               29.3µs ± 0%              29.1µs ± 2%     ~     (p=0.167 n=5+5)
    fs1-zhash.go                                               3.80µs ± 0%              3.70µs ± 0%     ~     (p=0.079 n=4+5)
    fs1-zhash.go+prefetch128                                   3.78µs ± 3%              3.78µs ± 6%     ~     (p=0.921 n=5+5)
    zeo/py/fs1-zhash.py                                         436µs ± 2%               440µs ± 2%     ~     (p=0.421 n=5+5)
    zeo/py/fs1-zhash.go                                         150µs ± 2%               150µs ± 2%     ~     (p=0.500 n=5+5)
    zeo/py/fs1-zhash.go+prefetch128                            88.0µs ± 1%              87.6µs ± 1%     ~     (p=0.532 n=5+5)
    neo/py(!log)/sqlite-zhash.py                                387µs ± 5%               383µs ± 2%     ~     (p=1.000 n=5+5)
    neo/py(!log)/sqlite-zhash.go                                185µs ± 4%               184µs ± 3%     ~     (p=0.421 n=5+5)
    neo/py(!log)/sqlite-zhash.go+prefetch128                    150µs ± 2%               152µs ± 1%     ~     (p=0.151 n=5+5)
    neo/py(!log)/sql-zhash.py                                   477µs ±40%               440µs ± 3%     ~     (p=0.730 n=5+4)
    neo/py(!log)/sql-zhash.go                                   236µs ± 2%               233µs ± 2%     ~     (p=0.421 n=5+5)
    neo/py(!log)/sql-zhash.go+prefetch128                       202µs ± 2%               205µs ± 1%     ~     (p=0.111 n=5+5)
    neo/go/fs1-zhash.py                                         267µs ±11%               265µs ±11%     ~     (p=0.548 n=5+5)
    neo/go/fs1-zhash.go                                        60.8µs ± 2%              60.8µs ± 1%     ~     (p=0.683 n=5+5)
    neo/go/fs1-zhash.go+prefetch128                            22.2µs ± 1%              22.3µs ± 4%     ~     (p=0.198 n=5+5)
    neo/go/fs1(!sha1)-zhash.go(!sha1)                          52.7µs ± 3%              52.2µs ± 4%     ~     (p=0.690 n=5+5)
    neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1)              18.4µs ± 5%              18.0µs ± 2%     ~     (p=0.294 n=5+5)
    neo/go/sqlite-zhash.py                                      312µs ± 1%               292µs ± 2%   -6.49%  (p=0.008 n=5+5)
    neo/go/sqlite-zhash.go                                      112µs ± 1%                91µs ± 1%  -18.39%  (p=0.008 n=5+5)
    neo/go/sqlite-zhash.go+prefetch128                         41.2µs ± 7%              38.8µs ± 3%     ~     (p=0.071 n=5+5)
    neo/go/sqlite-zhash.go(!sha1)                               107µs ± 2%                89µs ± 3%  -16.90%  (p=0.008 n=5+5)
    neo/go/sqlite-zhash.go+prefetch128(!sha1)                  41.5µs ± 4%              43.5µs ±16%     ~     (p=0.651 n=5+5)
    
    name                                           old req/s                new req/s                delta
    cluster:neo1 dataset:wczblk1-8
    fs1-zwrk.go·1                                                230k ± 0%                230k ± 0%     ~     (p=0.190 n=5+4)
    fs1-zwrk.go·2                                                425k ± 7%                431k ± 8%     ~     (p=0.690 n=5+5)
    fs1-zwrk.go·3                                                660k ± 1%                661k ± 0%     ~     (p=0.548 n=5+5)
    fs1-zwrk.go·4                                                869k ± 1%                861k ± 1%     ~     (p=0.063 n=4+5)
    fs1-zwrk.go·8                                               1.00M ± 0%               1.00M ± 1%     ~     (p=1.000 n=5+5)
    fs1-zwrk.go·12                                              1.01M ± 0%               1.02M ± 0%   +0.33%  (p=0.008 n=5+5)
    fs1-zwrk.go·16                                              1.02M ± 0%               1.02M ± 0%     ~     (p=0.556 n=5+4)
    zeo/py/fs1-zwrk.go·1                                        5.83k ± 1%               5.79k ± 1%     ~     (p=0.222 n=5+5)
    zeo/py/fs1-zwrk.go·2                                        7.21k ± 1%               7.09k ± 1%   -1.61%  (p=0.016 n=5+5)
    zeo/py/fs1-zwrk.go·3                                        7.80k ± 3%               7.78k ± 2%     ~     (p=0.548 n=5+5)
    zeo/py/fs1-zwrk.go·4                                        8.01k ± 1%               8.00k ± 1%     ~     (p=1.000 n=5+5)
    zeo/py/fs1-zwrk.go·8                                        8.46k ± 1%               8.30k ± 1%   -1.81%  (p=0.032 n=5+5)
    zeo/py/fs1-zwrk.go·12                                       8.52k ± 2%               8.28k ± 3%   -2.83%  (p=0.032 n=5+5)
    zeo/py/fs1-zwrk.go·16                                       8.51k ± 2%               8.43k ± 1%     ~     (p=0.310 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·1                               5.23k ± 2%               5.19k ± 1%     ~     (p=0.690 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·2                               6.30k ± 2%               6.27k ± 2%     ~     (p=0.548 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·3                               6.33k ± 1%               5.97k ± 3%   -5.61%  (p=0.008 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·4                               6.30k ± 3%               6.16k ± 3%     ~     (p=0.056 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·8                               6.27k ± 3%               6.27k ± 0%     ~     (p=0.730 n=5+4)
    neo/py(!log)/sqlite-zwrk.go·12                              6.36k ± 2%               6.05k ±10%     ~     (p=0.056 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·16                              6.33k ± 2%               6.31k ± 0%     ~     (p=0.190 n=5+4)
    neo/py(!log)/sql-zwrk.go·1                                  4.10k ± 5%               4.14k ± 3%     ~     (p=0.841 n=5+5)
    neo/py(!log)/sql-zwrk.go·2                                  4.85k ± 2%               4.75k ± 4%     ~     (p=0.421 n=5+5)
    neo/py(!log)/sql-zwrk.go·3                                  4.80k ± 4%               4.72k ± 5%     ~     (p=0.421 n=5+5)
    neo/py(!log)/sql-zwrk.go·4                                  4.78k ± 1%               4.67k ± 5%     ~     (p=0.151 n=5+5)
    neo/py(!log)/sql-zwrk.go·8                                  4.73k ± 7%               4.80k ± 2%     ~     (p=0.841 n=5+5)
    neo/py(!log)/sql-zwrk.go·12                                 4.67k ± 6%               4.87k ± 2%     ~     (p=0.056 n=5+5)
    neo/py(!log)/sql-zwrk.go·16                                 4.68k ± 9%               4.64k ±11%     ~     (p=1.000 n=5+5)
    neo/go/fs1-zwrk.go·1                                        13.0k ± 1%               13.0k ± 1%     ~     (p=0.690 n=5+5)
    neo/go/fs1-zwrk.go·2                                        25.0k ± 1%               25.0k ± 0%     ~     (p=1.000 n=5+5)
    neo/go/fs1-zwrk.go·3                                        32.4k ± 0%               32.5k ± 0%     ~     (p=0.151 n=5+5)
    neo/go/fs1-zwrk.go·4                                        40.9k ± 0%               41.0k ± 0%   +0.36%  (p=0.008 n=5+5)
    neo/go/fs1-zwrk.go·8                                        54.8k ± 1%               55.0k ± 0%     ~     (p=0.190 n=5+4)
    neo/go/fs1-zwrk.go·12                                       57.4k ± 1%               56.9k ± 1%   -0.81%  (p=0.032 n=5+5)
    neo/go/fs1-zwrk.go·16                                       55.8k ± 1%               55.7k ± 2%     ~     (p=0.690 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                          19.3k ± 1%               19.1k ± 2%     ~     (p=0.548 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                          38.0k ± 1%               38.0k ± 0%     ~     (p=0.286 n=5+4)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                          48.2k ± 0%               48.3k ± 0%     ~     (p=0.690 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                          59.3k ± 0%               59.5k ± 0%     ~     (p=0.056 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          78.4k ± 0%               78.4k ± 0%     ~     (p=1.000 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         82.7k ± 1%               82.5k ± 0%     ~     (p=0.421 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         81.3k ± 2%               80.8k ± 1%     ~     (p=0.413 n=5+4)
    neo/go/sqlite-zwrk.go·1                                     8.23k ± 1%               9.93k ± 0%  +20.66%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go·2                                     15.0k ± 0%               18.3k ± 0%  +22.40%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go·3                                     20.7k ± 0%               24.8k ± 0%  +19.63%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go·4                                     24.9k ± 0%               29.9k ± 0%  +20.32%  (p=0.016 n=5+4)
    neo/go/sqlite-zwrk.go·8                                     30.9k ± 8%               36.5k ± 1%  +18.18%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go·12                                    31.3k ± 1%               35.5k ± 2%  +13.29%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go·16                                    30.6k ± 3%               34.3k ± 2%  +12.38%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·1                              9.08k ± 0%              11.04k ± 3%  +21.65%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·2                              16.4k ± 0%               20.1k ± 0%  +22.36%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·3                              22.7k ± 0%               28.2k ± 0%  +24.10%  (p=0.016 n=4+5)
    neo/go/sqlite-zwrk.go(!sha1)·4                              27.8k ± 0%               33.7k ± 0%  +21.34%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·8                              34.6k ± 1%               38.7k ± 1%  +11.83%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·12                             33.5k ± 1%               38.0k ± 1%  +13.32%  (p=0.016 n=5+4)
    neo/go/sqlite-zwrk.go(!sha1)·16                             32.8k ± 2%               37.3k ± 1%  +13.55%  (p=0.008 n=5+5)
    cluster:neo1 dataset:prod1-1024
    fs1-zwrk.go·1                                                454k ± 0%                444k ±10%     ~     (p=1.000 n=4+5)
    fs1-zwrk.go·2                                                869k ± 6%                905k ± 0%   +4.14%  (p=0.016 n=5+4)
    fs1-zwrk.go·3                                               1.33M ± 1%               1.31M ± 6%     ~     (p=0.841 n=5+5)
    fs1-zwrk.go·4                                               1.73M ± 2%               1.75M ± 3%     ~     (p=0.421 n=5+5)
    fs1-zwrk.go·8                                               1.99M ± 2%               2.02M ± 0%     ~     (p=0.095 n=5+5)
    fs1-zwrk.go·12                                              2.03M ± 0%               2.03M ± 0%     ~     (p=0.905 n=4+5)
    fs1-zwrk.go·16                                              2.04M ± 0%               2.03M ± 1%     ~     (p=1.000 n=5+5)
    zeo/py/fs1-zwrk.go·1                                        6.83k ± 1%               6.81k ± 0%     ~     (p=0.905 n=5+4)
    zeo/py/fs1-zwrk.go·2                                        8.72k ± 3%               8.67k ± 1%     ~     (p=0.421 n=5+5)
    zeo/py/fs1-zwrk.go·3                                        9.26k ± 6%               9.41k ± 3%     ~     (p=0.310 n=5+5)
    zeo/py/fs1-zwrk.go·4                                        9.78k ± 3%               9.74k ± 3%     ~     (p=0.548 n=5+5)
    zeo/py/fs1-zwrk.go·8                                        10.4k ± 1%               10.3k ± 2%     ~     (p=0.310 n=5+5)
    zeo/py/fs1-zwrk.go·12                                       10.6k ± 1%               10.3k ± 4%     ~     (p=0.056 n=5+5)
    zeo/py/fs1-zwrk.go·16                                       10.5k ± 5%               10.5k ± 2%     ~     (p=0.841 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·1                               5.57k ± 3%               5.53k ± 3%     ~     (p=0.421 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·2                               6.51k ± 1%               6.42k ± 3%     ~     (p=0.151 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·3                               6.39k ± 6%               6.41k ± 1%     ~     (p=0.310 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·4                               6.43k ± 1%               6.36k ± 2%     ~     (p=0.310 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·8                               6.33k ± 2%               6.33k ± 3%     ~     (p=1.000 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·12                              6.30k ± 3%               6.29k ± 3%     ~     (p=0.841 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·16                              6.37k ± 3%               6.27k ± 5%     ~     (p=0.548 n=5+5)
    neo/py(!log)/sql-zwrk.go·1                                  4.34k ± 2%               4.32k ± 4%     ~     (p=1.000 n=5+5)
    neo/py(!log)/sql-zwrk.go·2                                  4.94k ± 4%               4.87k ± 6%     ~     (p=0.421 n=5+5)
    neo/py(!log)/sql-zwrk.go·3                                  4.69k ± 5%               4.78k ± 3%     ~     (p=0.222 n=5+5)
    neo/py(!log)/sql-zwrk.go·4                                  4.78k ± 4%               4.61k ± 8%     ~     (p=0.222 n=5+5)
    neo/py(!log)/sql-zwrk.go·8                                  4.92k ± 1%               4.76k ± 2%   -3.12%  (p=0.008 n=5+5)
    neo/py(!log)/sql-zwrk.go·12                                 4.76k ± 3%               4.76k ± 4%     ~     (p=1.000 n=5+5)
    neo/py(!log)/sql-zwrk.go·16                                 4.90k ± 3%               4.77k ± 3%     ~     (p=0.095 n=5+5)
    neo/go/fs1-zwrk.go·1                                        17.4k ± 1%               17.1k ± 6%     ~     (p=0.310 n=5+5)
    neo/go/fs1-zwrk.go·2                                        32.9k ± 1%               32.7k ± 1%     ~     (p=0.056 n=5+5)
    neo/go/fs1-zwrk.go·3                                        43.5k ± 0%               43.3k ± 0%   -0.44%  (p=0.016 n=4+5)
    neo/go/fs1-zwrk.go·4                                        53.2k ± 0%               53.1k ± 1%     ~     (p=0.095 n=5+5)
    neo/go/fs1-zwrk.go·8                                        67.0k ± 2%               65.2k ± 2%   -2.59%  (p=0.008 n=5+5)
    neo/go/fs1-zwrk.go·12                                       62.6k ± 3%               59.5k ± 5%   -4.89%  (p=0.016 n=5+5)
    neo/go/fs1-zwrk.go·16                                       54.3k ±11%               53.7k ± 2%     ~     (p=0.151 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                          20.2k ± 5%               20.1k ± 3%     ~     (p=1.000 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                          40.8k ± 1%               40.8k ± 1%     ~     (p=0.690 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                          51.9k ± 1%               51.7k ± 0%     ~     (p=0.190 n=5+4)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                          62.7k ± 0%               62.6k ± 0%     ~     (p=0.310 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          75.1k ± 4%               74.6k ± 3%     ~     (p=0.548 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         69.5k ± 1%               67.8k ± 4%     ~     (p=0.151 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         61.0k ± 2%               59.3k ± 2%     ~     (p=0.056 n=5+5)
    neo/go/sqlite-zwrk.go·1                                     9.16k ± 1%              11.15k ± 0%  +21.74%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go·2                                     16.0k ± 0%               20.0k ± 0%  +25.10%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go·3                                     22.1k ± 0%               27.2k ± 0%  +23.34%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go·4                                     26.7k ± 0%               31.8k ± 2%  +19.00%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go·8                                     30.9k ± 2%               32.8k ± 3%   +6.19%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go·12                                    29.5k ± 1%               32.1k ± 2%   +8.71%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go·16                                    29.6k ± 2%               32.8k ± 2%  +10.86%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·1                              9.51k ± 1%              11.74k ± 2%  +23.39%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·2                              16.5k ± 0%               21.1k ± 1%  +27.77%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·3                              22.7k ± 0%               28.9k ± 0%  +27.72%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·4                              27.4k ± 1%               34.3k ± 0%  +25.08%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·8                              31.2k ± 2%               35.5k ± 2%  +13.70%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·12                             29.5k ± 2%               34.2k ± 3%  +16.00%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·16                             28.8k ±10%               35.8k ± 1%  +24.19%  (p=0.008 n=5+5)
    
    name                                           old latency-time/object  new latency-time/object  delta
    cluster:neo1 dataset:wczblk1-8
    fs1-zwrk.go·1                                              4.36µs ± 0%              4.35µs ± 0%     ~     (p=0.206 n=5+4)
    fs1-zwrk.go·2                                              4.71µs ± 8%              4.65µs ± 8%     ~     (p=0.690 n=5+5)
    fs1-zwrk.go·3                                              4.55µs ± 1%              4.54µs ± 0%     ~     (p=0.524 n=5+5)
    fs1-zwrk.go·4                                              4.60µs ± 1%              4.65µs ± 1%   +0.99%  (p=0.048 n=4+5)
    fs1-zwrk.go·8                                              8.03µs ± 0%              8.04µs ± 1%     ~     (p=1.000 n=5+5)
    fs1-zwrk.go·12                                             11.8µs ± 0%              11.8µs ± 0%   -0.33%  (p=0.008 n=5+5)
    fs1-zwrk.go·16                                             15.7µs ± 0%              15.7µs ± 0%     ~     (p=0.556 n=5+4)
    zeo/py/fs1-zwrk.go·1                                        172µs ± 1%               173µs ± 1%     ~     (p=0.222 n=5+5)
    zeo/py/fs1-zwrk.go·2                                        277µs ± 1%               282µs ± 1%   +1.63%  (p=0.016 n=5+5)
    zeo/py/fs1-zwrk.go·3                                        384µs ± 3%               386µs ± 2%     ~     (p=0.548 n=5+5)
    zeo/py/fs1-zwrk.go·4                                        500µs ± 1%               500µs ± 1%     ~     (p=1.000 n=5+5)
    zeo/py/fs1-zwrk.go·8                                        946µs ± 1%               963µs ± 1%   +1.85%  (p=0.032 n=5+5)
    zeo/py/fs1-zwrk.go·12                                      1.41ms ± 2%              1.45ms ± 3%   +2.92%  (p=0.032 n=5+5)
    zeo/py/fs1-zwrk.go·16                                      1.88ms ± 2%              1.90ms ± 1%     ~     (p=0.310 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·1                               191µs ± 2%               193µs ± 1%     ~     (p=0.690 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·2                               317µs ± 2%               319µs ± 2%     ~     (p=0.548 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·3                               474µs ± 1%               503µs ± 3%   +5.98%  (p=0.008 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·4                               635µs ± 3%               650µs ± 3%     ~     (p=0.056 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·8                              1.28ms ± 3%              1.28ms ± 0%     ~     (p=0.730 n=5+4)
    neo/py(!log)/sqlite-zwrk.go·12                             1.89ms ± 2%              1.99ms ±11%     ~     (p=0.056 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·16                             2.53ms ± 2%              2.53ms ± 0%     ~     (p=0.190 n=5+4)
    neo/py(!log)/sql-zwrk.go·1                                  244µs ± 6%               242µs ± 3%     ~     (p=0.841 n=5+5)
    neo/py(!log)/sql-zwrk.go·2                                  412µs ± 3%               422µs ± 4%     ~     (p=0.421 n=5+5)
    neo/py(!log)/sql-zwrk.go·3                                  625µs ± 4%               637µs ± 5%     ~     (p=0.421 n=5+5)
    neo/py(!log)/sql-zwrk.go·4                                  837µs ± 1%               857µs ± 5%     ~     (p=0.151 n=5+5)
    neo/py(!log)/sql-zwrk.go·8                                 1.69ms ± 7%              1.67ms ± 2%     ~     (p=0.841 n=5+5)
    neo/py(!log)/sql-zwrk.go·12                                2.57ms ± 6%              2.47ms ± 2%     ~     (p=0.056 n=5+5)
    neo/py(!log)/sql-zwrk.go·16                                3.42ms ± 9%              3.46ms ±12%     ~     (p=1.000 n=5+5)
    neo/go/fs1-zwrk.go·1                                       76.7µs ± 1%              77.2µs ± 1%     ~     (p=0.690 n=5+5)
    neo/go/fs1-zwrk.go·2                                       79.9µs ± 1%              80.0µs ± 0%     ~     (p=1.000 n=5+5)
    neo/go/fs1-zwrk.go·3                                       92.5µs ± 0%              92.3µs ± 0%     ~     (p=0.151 n=5+5)
    neo/go/fs1-zwrk.go·4                                       97.9µs ± 0%              97.5µs ± 0%   -0.36%  (p=0.008 n=5+5)
    neo/go/fs1-zwrk.go·8                                        146µs ± 1%               145µs ± 0%     ~     (p=0.190 n=5+4)
    neo/go/fs1-zwrk.go·12                                       209µs ± 1%               211µs ± 1%   +0.82%  (p=0.032 n=5+5)
    neo/go/fs1-zwrk.go·16                                       287µs ± 1%               287µs ± 2%     ~     (p=0.690 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                         51.9µs ± 2%              52.3µs ± 2%     ~     (p=0.548 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                         52.7µs ± 1%              52.6µs ± 0%     ~     (p=0.286 n=5+4)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                         62.2µs ± 0%              62.1µs ± 0%     ~     (p=0.690 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                         67.4µs ± 0%              67.2µs ± 0%     ~     (p=0.056 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          102µs ± 0%               102µs ± 0%     ~     (p=1.000 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         145µs ± 1%               145µs ± 0%     ~     (p=0.421 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         197µs ± 2%               198µs ± 1%     ~     (p=0.413 n=5+4)
    neo/go/sqlite-zwrk.go·1                                     122µs ± 1%               101µs ± 0%  -17.13%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go·2                                     134µs ± 0%               109µs ± 0%  -18.30%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go·3                                     145µs ± 0%               121µs ± 0%  -16.41%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go·4                                     161µs ± 0%               134µs ± 0%  -16.89%  (p=0.016 n=5+4)
    neo/go/sqlite-zwrk.go·8                                     260µs ± 9%               219µs ± 1%  -15.53%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go·12                                    383µs ± 1%               338µs ± 2%  -11.73%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go·16                                    524µs ± 3%               466µs ± 2%  -11.01%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·1                              110µs ± 0%                91µs ± 3%  -17.78%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·2                              122µs ± 0%               100µs ± 0%  -18.28%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·3                              132µs ± 0%               106µs ± 0%  -19.42%  (p=0.016 n=4+5)
    neo/go/sqlite-zwrk.go(!sha1)·4                              144µs ± 0%               119µs ± 0%  -17.59%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·8                              231µs ± 1%               207µs ± 1%  -10.58%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·12                             358µs ± 1%               316µs ± 1%  -11.76%  (p=0.016 n=5+4)
    neo/go/sqlite-zwrk.go(!sha1)·16                             487µs ± 2%               429µs ± 1%  -11.95%  (p=0.008 n=5+5)
    cluster:neo1 dataset:prod1-1024
    fs1-zwrk.go·1                                              2.20µs ± 0%              2.26µs ±11%     ~     (p=1.000 n=4+5)
    fs1-zwrk.go·2                                              2.31µs ± 6%              2.21µs ± 0%   -4.17%  (p=0.000 n=5+4)
    fs1-zwrk.go·3                                              2.25µs ± 1%              2.29µs ± 7%     ~     (p=0.841 n=5+5)
    fs1-zwrk.go·4                                              2.31µs ± 2%              2.29µs ± 3%     ~     (p=0.421 n=5+5)
    fs1-zwrk.go·8                                              4.02µs ± 2%              3.96µs ± 0%     ~     (p=0.095 n=5+5)
    fs1-zwrk.go·12                                             5.91µs ± 0%              5.90µs ± 0%     ~     (p=0.841 n=4+5)
    fs1-zwrk.go·16                                             7.86µs ± 0%              7.86µs ± 1%     ~     (p=1.000 n=5+5)
    zeo/py/fs1-zwrk.go·1                                        146µs ± 1%               147µs ± 0%     ~     (p=0.905 n=5+4)
    zeo/py/fs1-zwrk.go·2                                        229µs ± 3%               231µs ± 1%     ~     (p=0.421 n=5+5)
    zeo/py/fs1-zwrk.go·3                                        324µs ± 6%               319µs ± 3%     ~     (p=0.310 n=5+5)
    zeo/py/fs1-zwrk.go·4                                        409µs ± 3%               411µs ± 3%     ~     (p=0.548 n=5+5)
    zeo/py/fs1-zwrk.go·8                                        766µs ± 1%               774µs ± 2%     ~     (p=0.310 n=5+5)
    zeo/py/fs1-zwrk.go·12                                      1.13ms ± 1%              1.16ms ± 4%     ~     (p=0.056 n=5+5)
    zeo/py/fs1-zwrk.go·16                                      1.53ms ± 5%              1.52ms ± 2%     ~     (p=0.841 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·1                               180µs ± 3%               181µs ± 3%     ~     (p=0.421 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·2                               307µs ± 1%               311µs ± 3%     ~     (p=0.151 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·3                               470µs ± 6%               468µs ± 1%     ~     (p=0.310 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·4                               622µs ± 1%               629µs ± 2%     ~     (p=0.310 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·8                              1.26ms ± 2%              1.26ms ± 3%     ~     (p=1.000 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·12                             1.91ms ± 3%              1.91ms ± 3%     ~     (p=0.841 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·16                             2.51ms ± 3%              2.55ms ± 5%     ~     (p=0.548 n=5+5)
    neo/py(!log)/sql-zwrk.go·1                                  230µs ± 2%               232µs ± 4%     ~     (p=1.000 n=5+5)
    neo/py(!log)/sql-zwrk.go·2                                  405µs ± 4%               411µs ± 7%     ~     (p=0.421 n=5+5)
    neo/py(!log)/sql-zwrk.go·3                                  640µs ± 5%               628µs ± 3%     ~     (p=0.222 n=5+5)
    neo/py(!log)/sql-zwrk.go·4                                  837µs ± 4%               870µs ± 9%     ~     (p=0.222 n=5+5)
    neo/py(!log)/sql-zwrk.go·8                                 1.63ms ± 1%              1.68ms ± 2%   +3.24%  (p=0.008 n=5+5)
    neo/py(!log)/sql-zwrk.go·12                                2.52ms ± 3%              2.52ms ± 4%     ~     (p=1.000 n=5+5)
    neo/py(!log)/sql-zwrk.go·16                                3.27ms ± 3%              3.35ms ± 3%     ~     (p=0.095 n=5+5)
    neo/go/fs1-zwrk.go·1                                       57.4µs ± 1%              58.5µs ± 6%     ~     (p=0.310 n=5+5)
    neo/go/fs1-zwrk.go·2                                       60.8µs ± 1%              61.2µs ± 1%     ~     (p=0.056 n=5+5)
    neo/go/fs1-zwrk.go·3                                       69.0µs ± 0%              69.3µs ± 0%   +0.44%  (p=0.016 n=4+5)
    neo/go/fs1-zwrk.go·4                                       75.1µs ± 0%              75.4µs ± 1%     ~     (p=0.103 n=5+5)
    neo/go/fs1-zwrk.go·8                                        119µs ± 2%               123µs ± 2%   +2.66%  (p=0.008 n=5+5)
    neo/go/fs1-zwrk.go·12                                       192µs ± 3%               202µs ± 5%   +5.20%  (p=0.016 n=5+5)
    neo/go/fs1-zwrk.go·16                                       296µs ±12%               298µs ± 2%     ~     (p=0.151 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                         49.5µs ± 5%              49.8µs ± 3%     ~     (p=1.000 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                         49.0µs ± 1%              49.0µs ± 1%     ~     (p=0.690 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                         57.8µs ± 1%              58.0µs ± 0%     ~     (p=0.190 n=5+4)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                         63.7µs ± 0%              63.9µs ± 0%     ~     (p=0.310 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          107µs ± 5%               107µs ± 4%     ~     (p=0.548 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         173µs ± 1%               177µs ± 4%     ~     (p=0.151 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         262µs ± 2%               270µs ± 2%     ~     (p=0.056 n=5+5)
    neo/go/sqlite-zwrk.go·1                                     109µs ± 1%                90µs ± 0%  -17.86%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go·2                                     125µs ± 0%               100µs ± 0%  -20.06%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go·3                                     136µs ± 0%               110µs ± 0%  -18.92%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go·4                                     150µs ± 0%               126µs ± 2%  -15.96%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go·8                                     259µs ± 2%               244µs ± 3%   -5.81%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go·12                                    407µs ± 1%               374µs ± 2%   -8.01%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go·16                                    541µs ± 2%               488µs ± 2%   -9.80%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·1                              105µs ± 1%                85µs ± 2%  -18.95%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·2                              121µs ± 0%                95µs ± 1%  -21.73%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·3                              132µs ± 0%               104µs ± 0%  -21.71%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·4                              146µs ± 1%               117µs ± 0%  -20.05%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·8                              256µs ± 2%               225µs ± 2%  -12.05%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·12                             407µs ± 2%               351µs ± 3%  -13.79%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·16                             557µs ±10%               447µs ± 1%  -19.70%  (p=0.008 n=5+5)
    f3fc4bdd
20180318-neo1.txt 128 KB