• Kirill Smelkov's avatar
    X rio: localhost timings · 6b816d6f
    Kirill Smelkov authored
    Similarly to deco and neo1, neo/go/sqlite is speed-up a bit. And
    everything else is within noise.
    
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
    
    $ benchstat -split node,cluster,dataset  20180308-rio-ffixed-noc_C1\(1µs\)-zwrk1s.txt 20180318-rio.txt
    
    name                                           old pystone/s            new pystone/s            delta
    node:rio
    pystone                                                      142k ± 3%                144k ± 2%     ~     (p=0.548 n=5+5)
    
    name                                           old time/op              new time/op              delta
    node:rio
    crc32/py/4K                                                4.77µs ± 1%              4.81µs ± 1%     ~     (p=0.056 n=5+5)
    crc32/go/4K                                                1.49µs ± 0%              1.49µs ± 0%   -0.21%  (p=0.032 n=5+5)
    sha1/py/4K                                                 8.07µs ± 4%              7.99µs ± 2%     ~     (p=0.246 n=5+5)
    sha1/go/4K                                                 8.93µs ± 0%              8.93µs ± 0%     ~     (p=0.667 n=4+5)
    unzlib/py/wczdata                                          25.1µs ± 1%              25.2µs ± 0%     ~     (p=0.548 n=5+5)
    unzlib/go/wczdata                                          22.9µs ± 0%              22.8µs ± 0%   -0.14%  (p=0.032 n=5+5)
    unzlib/py/prod1-avg                                        6.85µs ±25%              7.25µs ± 1%     ~     (p=0.905 n=5+4)
    unzlib/go/prod1-avg                                        5.02µs ± 1%              5.01µs ± 0%     ~     (p=0.349 n=5+5)
    disk/randread/direct/4K-min                                93.4µs ± 0%              92.0µs ± 0%   -1.48%  (p=0.016 n=5+4)
    disk/randread/direct/4K-avg                                 116µs ± 0%               115µs ± 0%   -0.81%  (p=0.008 n=5+5)
    disk/randread/pagecache/4K-min                              570ns ± 1%               567ns ± 1%     ~     (p=0.690 n=5+5)
    disk/randread/pagecache/4K-avg                             1.00µs ± 1%              1.00µs ± 1%     ~     (p=0.214 n=5+5)
    
    name                                           old time/object          new time/object          delta
    cluster:rio dataset:wczblk1-8
    fs1-zhash.py                                               29.0µs ± 2%              29.0µs ± 2%     ~     (p=0.905 n=5+4)
    fs1-zhash.go                                               4.60µs ± 0%              4.70µs ± 0%   +2.17%  (p=0.029 n=4+4)
    fs1-zhash.go+prefetch128                                   4.62µs ± 5%              4.44µs ± 4%     ~     (p=0.071 n=5+5)
    zeo/py/fs1-zhash.py                                         375µs ± 2%               377µs ± 4%     ~     (p=0.841 n=5+5)
    zeo/py/fs1-zhash.go                                         135µs ± 1%               137µs ± 2%     ~     (p=0.151 n=5+5)
    zeo/py/fs1-zhash.go+prefetch128                            73.6µs ± 3%              76.6µs ± 4%   +4.13%  (p=0.032 n=5+5)
    neo/py(!log)/sqlite-zhash.py                                315µs ± 6%               310µs ± 7%     ~     (p=0.690 n=5+5)
    neo/py(!log)/sqlite-zhash.go                                155µs ± 5%               149µs ± 4%     ~     (p=0.056 n=5+5)
    neo/py(!log)/sqlite-zhash.go+prefetch128                    126µs ± 1%               122µs ± 2%   -3.13%  (p=0.008 n=5+5)
    neo/py(!log)/sql-zhash.py                                   376µs ±41%               380µs ±55%     ~     (p=0.690 n=5+5)
    neo/py(!log)/sql-zhash.go                                   183µs ± 2%               179µs ± 7%     ~     (p=0.421 n=5+5)
    neo/py(!log)/sql-zhash.go+prefetch128                       161µs ± 3%               152µs ± 2%   -5.56%  (p=0.008 n=5+5)
    neo/go/fs1-zhash.py                                         216µs ± 1%               215µs ±12%     ~     (p=0.135 n=5+5)
    neo/go/fs1-zhash.go                                        67.9µs ± 1%              65.9µs ± 1%   -2.95%  (p=0.008 n=5+5)
    neo/go/fs1-zhash.go+prefetch128                            28.4µs ± 5%              28.3µs ± 2%     ~     (p=0.476 n=5+5)
    neo/go/fs1(!sha1)-zhash.go(!sha1)                          44.1µs ± 4%              41.3µs ± 3%   -6.26%  (p=0.016 n=5+5)
    neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1)              19.1µs ± 6%              18.4µs ± 4%     ~     (p=0.254 n=5+5)
    neo/go/sqlite-zhash.py                                      252µs ± 1%               234µs ± 4%   -6.95%  (p=0.008 n=5+5)
    neo/go/sqlite-zhash.go                                      103µs ± 3%                80µs ± 3%  -21.74%  (p=0.008 n=5+5)
    neo/go/sqlite-zhash.go+prefetch128                         38.0µs ± 9%              33.7µs ± 2%  -11.22%  (p=0.016 n=5+5)
    neo/go/sqlite-zhash.go(!sha1)                              93.0µs ± 2%              72.7µs ± 2%  -21.79%  (p=0.008 n=5+5)
    neo/go/sqlite-zhash.go+prefetch128(!sha1)                  33.4µs ± 3%              32.7µs ± 2%     ~     (p=0.111 n=5+5)
    cluster:rio dataset:prod1-1024
    fs1-zhash.py                                               23.8µs ± 2%              24.0µs ± 1%     ~     (p=0.381 n=5+4)
    fs1-zhash.go                                               3.40µs ± 0%              3.40µs ± 0%     ~     (all equal)
    fs1-zhash.go+prefetch128                                   3.16µs ± 8%              3.00µs ± 7%     ~     (p=0.159 n=5+5)
    zeo/py/fs1-zhash.py                                         346µs ± 2%               348µs ± 8%     ~     (p=0.690 n=5+5)
    zeo/py/fs1-zhash.go                                         114µs ± 1%               112µs ± 1%     ~     (p=0.063 n=5+5)
    zeo/py/fs1-zhash.go+prefetch128                            64.4µs ± 2%              64.3µs ± 1%     ~     (p=0.881 n=5+5)
    neo/py(!log)/sqlite-zhash.py                                291µs ± 0%               308µs ± 7%   +6.03%  (p=0.016 n=5+5)
    neo/py(!log)/sqlite-zhash.go                                142µs ± 2%               145µs ± 2%     ~     (p=0.167 n=5+5)
    neo/py(!log)/sqlite-zhash.go+prefetch128                    117µs ± 1%               117µs ± 2%     ~     (p=0.841 n=5+5)
    neo/py(!log)/sql-zhash.py                                   374µs ±41%               381µs ±49%     ~     (p=0.841 n=5+5)
    neo/py(!log)/sql-zhash.go                                   173µs ± 8%               165µs ± 1%   -4.65%  (p=0.016 n=5+5)
    neo/py(!log)/sql-zhash.go+prefetch128                       148µs ± 2%               147µs ± 2%     ~     (p=0.310 n=5+5)
    neo/go/fs1-zhash.py                                         210µs ± 3%               204µs ± 3%     ~     (p=0.151 n=5+5)
    neo/go/fs1-zhash.go                                        50.2µs ± 2%              46.9µs ± 1%   -6.61%  (p=0.008 n=5+5)
    neo/go/fs1-zhash.go+prefetch128                            19.4µs ± 2%              18.9µs ± 5%     ~     (p=0.246 n=5+5)
    neo/go/fs1(!sha1)-zhash.go(!sha1)                          40.6µs ± 2%              39.2µs ± 2%   -3.50%  (p=0.008 n=5+5)
    neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1)              15.8µs ± 2%              15.4µs ± 3%     ~     (p=0.095 n=5+5)
    neo/go/sqlite-zhash.py                                      262µs ± 4%               229µs ± 2%  -12.50%  (p=0.008 n=5+5)
    neo/go/sqlite-zhash.go                                     93.8µs ± 1%              70.7µs ± 1%  -24.57%  (p=0.008 n=5+5)
    neo/go/sqlite-zhash.go+prefetch128                         33.4µs ± 6%              30.3µs ± 2%   -9.29%  (p=0.008 n=5+5)
    neo/go/sqlite-zhash.go(!sha1)                              90.9µs ± 4%              67.9µs ± 1%  -25.30%  (p=0.008 n=5+5)
    neo/go/sqlite-zhash.go+prefetch128(!sha1)                  33.2µs ± 2%              30.8µs ± 2%   -7.41%  (p=0.008 n=5+5)
    
    name                                           old req/s                new req/s                delta
    cluster:rio dataset:wczblk1-8
    fs1-zwrk.go·1                                                301k ± 1%                303k ± 0%   +0.54%  (p=0.008 n=5+5)
    fs1-zwrk.go·2                                                551k ± 0%                552k ± 1%     ~     (p=1.000 n=5+5)
    fs1-zwrk.go·3                                                814k ± 0%                815k ± 0%     ~     (p=1.000 n=5+5)
    fs1-zwrk.go·4                                               1.08M ± 1%               1.08M ± 0%     ~     (p=0.421 n=5+5)
    fs1-zwrk.go·8                                               1.43M ± 0%               1.42M ± 0%     ~     (p=0.421 n=5+5)
    fs1-zwrk.go·12                                              1.55M ± 0%               1.55M ± 0%   +0.43%  (p=0.032 n=5+5)
    fs1-zwrk.go·16                                              1.54M ± 0%               1.55M ± 0%     ~     (p=0.421 n=5+5)
    zeo/py/fs1-zwrk.go·1                                        7.50k ± 1%               7.37k ± 1%   -1.70%  (p=0.008 n=5+5)
    zeo/py/fs1-zwrk.go·2                                        8.89k ± 2%               8.81k ± 2%     ~     (p=0.421 n=5+5)
    zeo/py/fs1-zwrk.go·3                                        9.61k ± 1%               9.62k ± 1%     ~     (p=1.000 n=5+5)
    zeo/py/fs1-zwrk.go·4                                        9.92k ± 1%               9.92k ± 1%     ~     (p=0.690 n=5+5)
    zeo/py/fs1-zwrk.go·8                                        10.2k ± 2%               10.2k ± 1%     ~     (p=1.000 n=5+5)
    zeo/py/fs1-zwrk.go·12                                       10.6k ± 1%               10.3k ± 0%   -2.66%  (p=0.008 n=5+5)
    zeo/py/fs1-zwrk.go·16                                       10.5k ± 1%               10.4k ± 2%     ~     (p=0.310 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·1                               6.70k ± 2%               6.83k ± 4%     ~     (p=0.151 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·2                               8.54k ± 0%               8.53k ± 4%     ~     (p=0.190 n=4+5)
    neo/py(!log)/sqlite-zwrk.go·3                               8.43k ± 1%               8.51k ± 2%     ~     (p=0.421 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·4                               8.37k ± 4%               8.50k ± 4%     ~     (p=0.222 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·8                               8.44k ± 0%               8.55k ± 2%     ~     (p=0.190 n=4+5)
    neo/py(!log)/sqlite-zwrk.go·12                              8.23k ± 5%               8.38k ± 9%     ~     (p=0.151 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·16                              8.46k ± 1%               8.42k ± 9%     ~     (p=0.151 n=5+5)
    neo/py(!log)/sql-zwrk.go·1                                  5.66k ± 2%               5.72k ± 3%     ~     (p=0.222 n=5+5)
    neo/py(!log)/sql-zwrk.go·2                                  6.75k ± 2%               6.86k ± 3%     ~     (p=0.222 n=5+5)
    neo/py(!log)/sql-zwrk.go·3                                  6.68k ± 2%               6.71k ± 4%     ~     (p=0.841 n=5+5)
    neo/py(!log)/sql-zwrk.go·4                                  6.70k ± 2%               6.80k ± 3%     ~     (p=0.310 n=5+5)
    neo/py(!log)/sql-zwrk.go·8                                  6.50k ± 5%               6.88k ± 1%   +5.87%  (p=0.008 n=5+5)
    neo/py(!log)/sql-zwrk.go·12                                 6.67k ± 2%               6.90k ± 2%   +3.41%  (p=0.008 n=5+5)
    neo/py(!log)/sql-zwrk.go·16                                 6.72k ± 3%               6.77k ± 2%     ~     (p=0.548 n=5+5)
    neo/go/fs1-zwrk.go·1                                        15.7k ± 0%               16.1k ± 0%   +2.89%  (p=0.008 n=5+5)
    neo/go/fs1-zwrk.go·2                                        30.2k ± 0%               31.0k ± 1%   +2.68%  (p=0.008 n=5+5)
    neo/go/fs1-zwrk.go·3                                        39.8k ± 0%               40.6k ± 0%   +2.02%  (p=0.008 n=5+5)
    neo/go/fs1-zwrk.go·4                                        49.7k ± 0%               51.0k ± 0%   +2.64%  (p=0.008 n=5+5)
    neo/go/fs1-zwrk.go·8                                        68.8k ± 0%               70.0k ± 0%   +1.84%  (p=0.008 n=5+5)
    neo/go/fs1-zwrk.go·12                                       73.0k ± 0%               74.1k ± 0%   +1.54%  (p=0.008 n=5+5)
    neo/go/fs1-zwrk.go·16                                       73.7k ± 0%               74.8k ± 0%   +1.44%  (p=0.008 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                          25.5k ± 3%               26.5k ± 1%   +4.12%  (p=0.016 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                          47.9k ± 0%               48.8k ± 0%   +1.85%  (p=0.008 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                          59.7k ± 0%               61.8k ± 0%   +3.48%  (p=0.008 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                          72.7k ± 0%               75.4k ± 0%   +3.76%  (p=0.008 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          97.0k ± 0%               99.4k ± 1%   +2.52%  (p=0.008 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                          110k ± 0%                113k ± 0%   +2.58%  (p=0.008 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                          113k ± 1%                115k ± 1%   +1.86%  (p=0.016 n=5+5)
    neo/go/sqlite-zwrk.go·1                                     10.0k ± 1%               12.7k ± 1%  +28.02%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go·2                                     18.4k ± 0%               23.9k ± 1%  +29.46%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go·3                                     25.5k ± 0%               31.6k ± 0%  +24.11%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go·4                                     30.4k ± 0%               38.2k ± 0%  +25.76%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go·8                                     39.4k ± 1%               47.1k ± 1%  +19.51%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go·12                                    40.7k ± 2%               47.1k ± 2%  +15.72%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go·16                                    40.8k ± 2%               46.7k ± 2%  +14.50%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·1                              11.1k ± 0%               14.6k ± 1%  +31.01%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·2                              20.1k ± 0%               26.3k ± 0%  +30.98%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·3                              27.9k ± 0%               37.0k ± 0%  +32.82%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·4                              34.2k ± 0%               43.7k ± 0%  +27.80%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·8                              44.0k ± 1%               51.2k ± 1%  +16.37%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·12                             43.4k ± 2%               49.4k ± 3%  +14.01%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·16                             41.4k ± 2%               46.6k ± 4%  +12.52%  (p=0.008 n=5+5)
    cluster:rio dataset:prod1-1024
    fs1-zwrk.go·1                                                461k ± 1%                464k ± 1%     ~     (p=0.222 n=5+5)
    fs1-zwrk.go·2                                                906k ± 1%                918k ± 1%     ~     (p=0.056 n=5+5)
    fs1-zwrk.go·3                                               1.35M ± 0%               1.36M ± 0%   +1.14%  (p=0.008 n=5+5)
    fs1-zwrk.go·4                                               1.78M ± 1%               1.80M ± 2%     ~     (p=0.222 n=5+5)
    fs1-zwrk.go·8                                               2.33M ± 1%               2.37M ± 1%   +1.78%  (p=0.016 n=5+5)
    fs1-zwrk.go·12                                              2.40M ± 0%               2.41M ± 0%     ~     (p=0.548 n=5+5)
    fs1-zwrk.go·16                                              2.40M ± 0%               2.41M ± 1%     ~     (p=0.056 n=5+5)
    zeo/py/fs1-zwrk.go·1                                        9.06k ± 1%               9.19k ± 1%     ~     (p=0.056 n=5+5)
    zeo/py/fs1-zwrk.go·2                                        11.7k ± 2%               11.7k ± 2%     ~     (p=1.000 n=5+5)
    zeo/py/fs1-zwrk.go·3                                        12.9k ± 1%               12.8k ± 2%     ~     (p=0.690 n=5+5)
    zeo/py/fs1-zwrk.go·4                                        13.4k ± 3%               13.4k ± 1%     ~     (p=0.690 n=5+5)
    zeo/py/fs1-zwrk.go·8                                        13.9k ± 2%               14.1k ± 2%     ~     (p=0.310 n=5+5)
    zeo/py/fs1-zwrk.go·12                                       14.2k ± 2%               14.3k ± 2%     ~     (p=0.421 n=5+5)
    zeo/py/fs1-zwrk.go·16                                       14.4k ± 1%               14.3k ± 3%     ~     (p=0.841 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·1                               7.28k ± 2%               7.19k ± 3%     ~     (p=0.690 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·2                               8.70k ± 3%               8.54k ± 1%     ~     (p=0.421 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·3                               8.73k ± 3%               8.54k ± 1%     ~     (p=0.151 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·4                               8.69k ± 1%               8.59k ± 1%     ~     (p=0.151 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·8                               8.77k ± 2%               8.51k ± 2%   -2.93%  (p=0.032 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·12                              8.59k ± 7%               8.51k ± 2%     ~     (p=0.310 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·16                              8.67k ± 1%               8.39k ± 5%   -3.20%  (p=0.032 n=5+5)
    neo/py(!log)/sql-zwrk.go·1                                  5.98k ± 1%               6.02k ± 4%     ~     (p=0.151 n=5+5)
    neo/py(!log)/sql-zwrk.go·2                                  6.86k ± 4%               6.91k ± 3%     ~     (p=0.841 n=5+5)
    neo/py(!log)/sql-zwrk.go·3                                  6.86k ± 3%               6.93k ± 2%     ~     (p=0.421 n=5+5)
    neo/py(!log)/sql-zwrk.go·4                                  6.90k ± 1%               6.88k ± 2%     ~     (p=1.000 n=5+5)
    neo/py(!log)/sql-zwrk.go·8                                  6.62k ± 6%               6.77k ± 6%     ~     (p=0.310 n=5+5)
    neo/py(!log)/sql-zwrk.go·12                                 6.78k ± 2%               6.75k ± 6%     ~     (p=1.000 n=5+5)
    neo/py(!log)/sql-zwrk.go·16                                 6.78k ± 3%               6.78k ± 7%     ~     (p=0.841 n=5+5)
    neo/go/fs1-zwrk.go·1                                        21.6k ± 0%               22.7k ± 0%   +5.46%  (p=0.008 n=5+5)
    neo/go/fs1-zwrk.go·2                                        39.0k ± 0%               40.5k ± 0%   +3.84%  (p=0.008 n=5+5)
    neo/go/fs1-zwrk.go·3                                        51.0k ± 1%               52.9k ± 0%   +3.74%  (p=0.008 n=5+5)
    neo/go/fs1-zwrk.go·4                                        62.3k ± 0%               64.7k ± 0%   +3.96%  (p=0.008 n=5+5)
    neo/go/fs1-zwrk.go·8                                        79.7k ± 1%               81.5k ± 1%   +2.27%  (p=0.008 n=5+5)
    neo/go/fs1-zwrk.go·12                                       81.8k ± 2%               80.3k ± 3%     ~     (p=0.421 n=5+5)
    neo/go/fs1-zwrk.go·16                                       80.8k ± 3%               77.8k ± 3%   -3.71%  (p=0.032 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                          26.9k ± 1%               26.9k ± 1%     ~     (p=0.690 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                          49.3k ± 0%               51.3k ± 0%   +4.00%  (p=0.008 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                          62.3k ± 0%               65.4k ± 1%   +4.82%  (p=0.008 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                          74.7k ± 0%               78.6k ± 0%   +5.26%  (p=0.008 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          93.5k ± 2%               96.7k ± 1%   +3.44%  (p=0.008 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         96.9k ± 2%               99.2k ± 4%     ~     (p=0.095 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         94.5k ± 3%               94.2k ± 3%     ~     (p=0.841 n=5+5)
    neo/go/sqlite-zwrk.go·1                                     11.0k ± 0%               14.7k ± 0%  +33.72%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go·2                                     19.3k ± 0%               25.2k ± 0%  +30.66%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go·3                                     26.4k ± 0%               34.6k ± 1%  +30.78%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go·4                                     31.8k ± 0%               40.3k ± 0%  +26.68%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go·8                                     38.6k ± 1%               41.4k ± 3%   +7.22%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go·12                                    36.5k ± 2%               38.7k ± 3%   +5.82%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go·16                                    36.0k ± 1%               37.9k ± 3%   +5.33%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·1                              11.4k ± 0%               15.7k ± 1%  +37.97%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·2                              19.9k ± 0%               26.9k ± 0%  +35.56%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·3                              27.4k ± 0%               37.6k ± 0%  +37.02%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·4                              33.3k ± 0%               43.6k ± 1%  +31.11%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·8                              38.8k ± 2%               45.2k ± 2%  +16.46%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·12                             36.0k ± 2%               41.5k ± 2%  +15.07%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·16                             35.4k ± 1%               40.5k ± 1%  +14.47%  (p=0.008 n=5+5)
    
    name                                           old latency-time/object  new latency-time/object  delta
    cluster:rio dataset:wczblk1-8
    fs1-zwrk.go·1                                              3.32µs ± 1%              3.30µs ± 0%   -0.55%  (p=0.008 n=5+5)
    fs1-zwrk.go·2                                              3.63µs ± 0%              3.63µs ± 1%     ~     (p=0.738 n=5+5)
    fs1-zwrk.go·3                                              3.69µs ± 0%              3.68µs ± 0%     ~     (p=0.952 n=5+5)
    fs1-zwrk.go·4                                              3.70µs ± 1%              3.70µs ± 0%     ~     (p=0.460 n=5+5)
    fs1-zwrk.go·8                                              5.61µs ± 0%              5.62µs ± 0%     ~     (p=0.421 n=5+5)
    fs1-zwrk.go·12                                             7.76µs ± 0%              7.73µs ± 0%   -0.43%  (p=0.032 n=5+5)
    fs1-zwrk.go·16                                             10.4µs ± 0%              10.3µs ± 0%     ~     (p=0.381 n=5+5)
    zeo/py/fs1-zwrk.go·1                                        133µs ± 1%               136µs ± 1%   +1.72%  (p=0.008 n=5+5)
    zeo/py/fs1-zwrk.go·2                                        225µs ± 2%               227µs ± 2%     ~     (p=0.421 n=5+5)
    zeo/py/fs1-zwrk.go·3                                        312µs ± 1%               312µs ± 1%     ~     (p=1.000 n=5+5)
    zeo/py/fs1-zwrk.go·4                                        403µs ± 1%               403µs ± 1%     ~     (p=0.690 n=5+5)
    zeo/py/fs1-zwrk.go·8                                        781µs ± 2%               785µs ± 1%     ~     (p=1.000 n=5+5)
    zeo/py/fs1-zwrk.go·12                                      1.13ms ± 1%              1.16ms ± 0%   +2.73%  (p=0.008 n=5+5)
    zeo/py/fs1-zwrk.go·16                                      1.52ms ± 1%              1.54ms ± 2%     ~     (p=0.310 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·1                               149µs ± 2%               146µs ± 4%     ~     (p=0.151 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·2                               234µs ± 0%               235µs ± 4%     ~     (p=0.190 n=4+5)
    neo/py(!log)/sqlite-zwrk.go·3                               356µs ± 1%               353µs ± 2%     ~     (p=0.421 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·4                               478µs ± 4%               471µs ± 4%     ~     (p=0.222 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·8                               948µs ± 0%               936µs ± 2%     ~     (p=0.190 n=4+5)
    neo/py(!log)/sqlite-zwrk.go·12                             1.46ms ± 5%              1.40ms ± 1%   -3.91%  (p=0.016 n=5+4)
    neo/py(!log)/sqlite-zwrk.go·16                             1.89ms ± 1%              1.86ms ± 1%   -1.63%  (p=0.016 n=5+4)
    neo/py(!log)/sql-zwrk.go·1                                  177µs ± 2%               175µs ± 3%     ~     (p=0.222 n=5+5)
    neo/py(!log)/sql-zwrk.go·2                                  297µs ± 2%               292µs ± 3%     ~     (p=0.222 n=5+5)
    neo/py(!log)/sql-zwrk.go·3                                  449µs ± 2%               447µs ± 4%     ~     (p=0.841 n=5+5)
    neo/py(!log)/sql-zwrk.go·4                                  597µs ± 2%               589µs ± 3%     ~     (p=0.310 n=5+5)
    neo/py(!log)/sql-zwrk.go·8                                 1.23ms ± 5%              1.16ms ± 1%   -5.61%  (p=0.008 n=5+5)
    neo/py(!log)/sql-zwrk.go·12                                1.80ms ± 2%              1.74ms ± 2%   -3.31%  (p=0.008 n=5+5)
    neo/py(!log)/sql-zwrk.go·16                                2.38ms ± 3%              2.36ms ± 2%     ~     (p=0.548 n=5+5)
    neo/go/fs1-zwrk.go·1                                       63.9µs ± 0%              62.1µs ± 0%   -2.81%  (p=0.008 n=5+5)
    neo/go/fs1-zwrk.go·2                                       66.2µs ± 0%              64.5µs ± 1%   -2.61%  (p=0.008 n=5+5)
    neo/go/fs1-zwrk.go·3                                       75.5µs ± 0%              74.0µs ± 0%   -1.98%  (p=0.008 n=5+5)
    neo/go/fs1-zwrk.go·4                                       80.6µs ± 0%              78.5µs ± 0%   -2.57%  (p=0.008 n=5+5)
    neo/go/fs1-zwrk.go·8                                        116µs ± 0%               114µs ± 0%   -1.81%  (p=0.008 n=5+5)
    neo/go/fs1-zwrk.go·12                                       164µs ± 0%               162µs ± 0%   -1.52%  (p=0.008 n=5+5)
    neo/go/fs1-zwrk.go·16                                       217µs ± 0%               214µs ± 0%   -1.42%  (p=0.008 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                         39.3µs ± 3%              37.7µs ± 1%   -3.99%  (p=0.016 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                         41.7µs ± 0%              41.0µs ± 0%   -1.82%  (p=0.008 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                         50.3µs ± 0%              48.6µs ± 0%   -3.36%  (p=0.008 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                         55.0µs ± 0%              53.0µs ± 0%   -3.63%  (p=0.008 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                         82.5µs ± 0%              80.5µs ± 1%   -2.46%  (p=0.008 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         109µs ± 0%               107µs ± 0%   -2.51%  (p=0.008 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         141µs ± 1%               139µs ± 1%   -1.83%  (p=0.016 n=5+5)
    neo/go/sqlite-zwrk.go·1                                     100µs ± 1%                78µs ± 1%  -21.89%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go·2                                     108µs ± 0%                84µs ± 1%  -22.76%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go·3                                     118µs ± 0%                95µs ± 0%  -19.43%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go·4                                     132µs ± 0%               105µs ± 0%  -20.48%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go·8                                     203µs ± 1%               170µs ± 1%  -16.32%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go·12                                    295µs ± 2%               255µs ± 2%  -13.58%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go·16                                    393µs ± 2%               343µs ± 3%  -12.65%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·1                             89.9µs ± 0%              68.7µs ± 1%  -23.67%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·2                              100µs ± 0%                76µs ± 0%  -23.65%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·3                              108µs ± 0%                81µs ± 0%  -24.71%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·4                              117µs ± 0%                92µs ± 0%  -21.75%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·8                              182µs ± 1%               156µs ± 1%  -14.07%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·12                             277µs ± 2%               243µs ± 3%  -12.27%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·16                             386µs ± 2%               343µs ± 4%  -11.10%  (p=0.008 n=5+5)
    cluster:rio dataset:prod1-1024
    fs1-zwrk.go·1                                              2.17µs ± 1%              2.16µs ± 1%     ~     (p=0.222 n=5+5)
    fs1-zwrk.go·2                                              2.21µs ± 1%              2.18µs ± 1%     ~     (p=0.063 n=5+5)
    fs1-zwrk.go·3                                              2.23µs ± 0%              2.20µs ± 0%   -1.12%  (p=0.008 n=5+5)
    fs1-zwrk.go·4                                              2.24µs ± 1%              2.23µs ± 2%     ~     (p=0.222 n=5+5)
    fs1-zwrk.go·8                                              3.43µs ± 1%              3.37µs ± 1%   -1.75%  (p=0.016 n=5+5)
    fs1-zwrk.go·12                                             4.99µs ± 0%              4.99µs ± 0%     ~     (p=0.548 n=5+5)
    fs1-zwrk.go·16                                             6.65µs ± 0%              6.63µs ± 1%     ~     (p=0.056 n=5+5)
    zeo/py/fs1-zwrk.go·1                                        110µs ± 1%               109µs ± 1%     ~     (p=0.056 n=5+5)
    zeo/py/fs1-zwrk.go·2                                        171µs ± 2%               171µs ± 2%     ~     (p=1.000 n=5+5)
    zeo/py/fs1-zwrk.go·3                                        233µs ± 1%               234µs ± 2%     ~     (p=0.690 n=5+5)
    zeo/py/fs1-zwrk.go·4                                        300µs ± 3%               300µs ± 1%     ~     (p=0.690 n=5+5)
    zeo/py/fs1-zwrk.go·8                                        574µs ± 2%               566µs ± 2%     ~     (p=0.310 n=5+5)
    zeo/py/fs1-zwrk.go·12                                       844µs ± 2%               840µs ± 2%     ~     (p=0.421 n=5+5)
    zeo/py/fs1-zwrk.go·16                                      1.11ms ± 1%              1.12ms ± 3%     ~     (p=0.841 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·1                               137µs ± 2%               139µs ± 3%     ~     (p=0.690 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·2                               230µs ± 3%               234µs ± 1%     ~     (p=0.421 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·3                               344µs ± 3%               351µs ± 1%     ~     (p=0.151 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·4                               461µs ± 1%               466µs ± 1%     ~     (p=0.151 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·8                               912µs ± 2%               940µs ± 2%   +3.02%  (p=0.032 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·12                             1.40ms ± 7%              1.41ms ± 2%     ~     (p=0.310 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·16                             1.85ms ± 1%              1.91ms ± 5%   +3.39%  (p=0.032 n=5+5)
    neo/py(!log)/sql-zwrk.go·1                                  167µs ± 1%               166µs ± 4%     ~     (p=0.151 n=5+5)
    neo/py(!log)/sql-zwrk.go·2                                  292µs ± 5%               289µs ± 3%     ~     (p=0.841 n=5+5)
    neo/py(!log)/sql-zwrk.go·3                                  437µs ± 3%               433µs ± 2%     ~     (p=0.421 n=5+5)
    neo/py(!log)/sql-zwrk.go·4                                  580µs ± 1%               581µs ± 2%     ~     (p=1.000 n=5+5)
    neo/py(!log)/sql-zwrk.go·8                                 1.21ms ± 6%              1.18ms ± 7%     ~     (p=0.310 n=5+5)
    neo/py(!log)/sql-zwrk.go·12                                1.77ms ± 2%              1.78ms ± 6%     ~     (p=1.000 n=5+5)
    neo/py(!log)/sql-zwrk.go·16                                2.36ms ± 3%              2.36ms ± 7%     ~     (p=0.841 n=5+5)
    neo/go/fs1-zwrk.go·1                                       46.4µs ± 0%              44.0µs ± 0%   -5.18%  (p=0.008 n=5+5)
    neo/go/fs1-zwrk.go·2                                       51.3µs ± 0%              49.4µs ± 0%   -3.70%  (p=0.008 n=5+5)
    neo/go/fs1-zwrk.go·3                                       58.8µs ± 1%              56.7µs ± 0%   -3.60%  (p=0.008 n=5+5)
    neo/go/fs1-zwrk.go·4                                       64.3µs ± 0%              61.8µs ± 0%   -3.81%  (p=0.008 n=5+5)
    neo/go/fs1-zwrk.go·8                                        100µs ± 1%                98µs ± 1%   -2.22%  (p=0.008 n=5+5)
    neo/go/fs1-zwrk.go·12                                       147µs ± 2%               149µs ± 3%     ~     (p=0.421 n=5+5)
    neo/go/fs1-zwrk.go·16                                       198µs ± 3%               206µs ± 3%   +3.86%  (p=0.032 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                         37.2µs ± 1%              37.1µs ± 1%     ~     (p=0.690 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                         40.6µs ± 0%              39.0µs ± 0%   -3.85%  (p=0.008 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                         48.1µs ± 0%              45.9µs ± 1%   -4.60%  (p=0.008 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                         53.6µs ± 0%              50.9µs ± 0%   -5.00%  (p=0.008 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                         85.6µs ± 2%              82.7µs ± 1%   -3.33%  (p=0.008 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         124µs ± 2%               121µs ± 4%     ~     (p=0.095 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         169µs ± 3%               170µs ± 3%     ~     (p=0.841 n=5+5)
    neo/go/sqlite-zwrk.go·1                                    91.0µs ± 0%              68.1µs ± 0%  -25.21%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go·2                                     104µs ± 0%                79µs ± 0%  -23.47%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go·3                                     114µs ± 0%                87µs ± 1%  -23.53%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go·4                                     126µs ± 0%                99µs ± 0%  -21.06%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go·8                                     207µs ± 1%               193µs ± 3%   -6.71%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go·12                                    329µs ± 2%               311µs ± 3%   -5.49%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go·16                                    445µs ± 1%               423µs ± 3%   -5.04%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·1                             87.8µs ± 0%              63.6µs ± 1%  -27.52%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·2                              101µs ± 0%                74µs ± 0%  -26.23%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·3                              109µs ± 0%                80µs ± 0%  -27.02%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·4                              120µs ± 0%                92µs ± 1%  -23.72%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·8                              206µs ± 2%               177µs ± 2%  -14.13%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·12                             333µs ± 3%               289µs ± 2%  -13.11%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·16                             452µs ± 1%               395µs ± 1%  -12.64%  (p=0.008 n=5+5)
    6b816d6f
20180318-rio.txt 128 KB