• Kirill Smelkov's avatar
    X rio: localhost timings, C > C1 disabled · 3695ff12
    Kirill Smelkov authored
    Disabling C-states on rio tendto help serial cases, like it was on neo1
    and z6001, but it is closer to noise.
    
    ---- 8< ----
    cluster:rio dataset:wczblk1-8
    zeo/py/fs1-zhash.py                                         400µs ± 0%               370µs ± 1%   -7.32%  (p=0.008 n=5+5)
    neo/py(!log)/sqlite-zhash.py                                318µs ± 7%               295µs ± 0%   -7.16%  (p=0.008 n=5+5)
    neo/py(!log)/sql-zhash.go+prefetch128                       158µs ± 3%               158µs ± 2%     ~     (p=1.000 n=5+5)
    neo/go/fs1-zhash.py                                         222µs ± 4%               214µs ± 2%   -3.73%  (p=0.040 n=5+5)
    neo/go/sqlite-zhash.py                                      273µs ± 3%               256µs ± 4%   -6.45%  (p=0.008 n=5+5)
    
    cluster:rio dataset:prod1-1024
    zeo/py/fs1-zhash.py                                         372µs ±10%               347µs ± 5%   -6.84%  (p=0.032 n=5+5)
    neo/py(!log)/sqlite-zhash.py                                321µs ±11%               298µs ± 5%   -7.13%  (p=0.048 n=5+5)
    ---- 8< ----
    
    the pystone/s change is nose as pystone/s for C-enabled case was 146k on
    prev-prev run (see 31dc070d).
    
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
    
    $ benchstat -split node,cluster,dataset 20180306-rio-ffixed-c.txt 20180306-rio-ffixed-noc_C1\(1µs\).txt
    
    name                                           old pystone/s            new pystone/s            delta
    node:rio
    pystone                                                      115k ±12%                144k ± 1%  +25.53%  (p=0.008 n=5+5)
    
    name                                           old time/op              new time/op              delta
    node:rio
    crc32/py/4K                                                4.77µs ± 0%              4.78µs ± 1%     ~     (p=0.825 n=4+5)
    crc32/go/4K                                                1.49µs ± 0%              1.49µs ± 0%     ~     (p=0.484 n=5+5)
    sha1/py/4K                                                 8.04µs ± 1%              8.00µs ± 1%     ~     (p=0.206 n=5+5)
    sha1/go/4K                                                 8.93µs ± 0%              8.93µs ± 0%     ~     (p=0.389 n=5+5)
    unzlib/py/wczdata                                          25.1µs ± 1%              25.1µs ± 1%     ~     (p=1.000 n=5+5)
    unzlib/go/wczdata                                          23.0µs ± 0%              22.9µs ± 0%   -0.45%  (p=0.016 n=5+5)
    unzlib/py/prod1-avg                                        7.16µs ± 1%              7.08µs ± 1%     ~     (p=0.056 n=5+5)
    unzlib/go/prod1-avg                                        5.08µs ± 1%              5.04µs ± 0%   -0.82%  (p=0.008 n=5+5)
    disk/randread/direct/4K-min                                92.4µs ± 0%              92.7µs ± 0%     ~     (p=0.198 n=5+5)
    disk/randread/direct/4K-avg                                 115µs ± 0%               115µs ± 0%   +0.37%  (p=0.008 n=5+5)
    disk/randread/pagecache/4K-min                              565ns ± 2%               562ns ± 1%     ~     (p=0.444 n=5+5)
    disk/randread/pagecache/4K-avg                              992ns ± 0%               992ns ± 0%     ~     (p=1.032 n=4+5)
    
    name                                           old time/object          new time/object          delta
    cluster:rio dataset:wczblk1-8
    fs1-zhash.py                                               29.2µs ± 1%              28.8µs ± 2%     ~     (p=0.111 n=4+5)
    fs1-zhash.go                                               4.68µs ± 5%              4.60µs ± 0%     ~     (p=0.444 n=5+5)
    fs1-zhash.go+prefetch128                                   4.78µs ± 5%              4.62µs ±15%     ~     (p=0.159 n=5+5)
    zeo/py/fs1-zhash.py                                         400µs ± 0%               370µs ± 1%   -7.32%  (p=0.008 n=5+5)
    zeo/py/fs1-zhash.go                                         138µs ± 1%               136µs ± 2%     ~     (p=0.087 n=5+5)
    zeo/py/fs1-zhash.go+prefetch128                            74.7µs ± 2%              74.9µs ± 2%     ~     (p=0.730 n=5+5)
    neo/py(!log)/sqlite-zhash.py                                318µs ± 7%               295µs ± 0%   -7.16%  (p=0.008 n=5+5)
    neo/py(!log)/sqlite-zhash.go                                154µs ± 4%               151µs ± 6%     ~     (p=1.000 n=5+5)
    neo/py(!log)/sqlite-zhash.go+prefetch128                    125µs ± 3%               126µs ± 2%     ~     (p=0.746 n=5+5)
    neo/py(!log)/sql-zhash.py                                   400µs ±57%               325µs ± 2%     ~     (p=0.063 n=5+4)
    neo/py(!log)/sql-zhash.go                                   183µs ±11%               178µs ± 2%     ~     (p=1.000 n=5+5)
    neo/py(!log)/sql-zhash.go+prefetch128                       158µs ± 3%               158µs ± 2%     ~     (p=1.000 n=5+5)
    neo/go/fs1-zhash.py                                         222µs ± 4%               214µs ± 2%   -3.73%  (p=0.040 n=5+5)
    neo/go/fs1-zhash.go                                        68.6µs ± 2%              68.9µs ± 3%     ~     (p=0.722 n=5+5)
    neo/go/fs1-zhash.go+prefetch128                            29.0µs ± 6%              28.3µs ± 4%     ~     (p=0.135 n=5+5)
    neo/go/fs1(!sha1)-zhash.go(!sha1)                          43.9µs ± 3%              43.7µs ± 2%     ~     (p=0.881 n=5+5)
    neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1)              18.8µs ± 5%              18.6µs ± 4%     ~     (p=0.516 n=5+5)
    neo/go/sqlite-zhash.py                                      273µs ± 3%               256µs ± 4%   -6.45%  (p=0.008 n=5+5)
    neo/go/sqlite-zhash.go                                      104µs ± 1%               104µs ± 2%     ~     (p=0.651 n=5+5)
    neo/go/sqlite-zhash.go+prefetch128                         36.3µs ± 3%              37.0µs ± 8%     ~     (p=0.595 n=5+5)
    neo/go/sqlite-zhash.go(!sha1)                              94.2µs ± 3%              93.1µs ± 3%     ~     (p=0.151 n=5+5)
    neo/go/sqlite-zhash.go+prefetch128(!sha1)                  35.1µs ± 6%              35.7µs ±13%     ~     (p=1.000 n=5+5)
    cluster:rio dataset:prod1-1024
    fs1-zhash.py                                               23.9µs ± 1%              24.0µs ± 2%     ~     (p=0.937 n=4+5)
    fs1-zhash.go                                               3.40µs ± 0%              3.40µs ± 0%     ~     (all equal)
    fs1-zhash.go+prefetch128                                   3.02µs ± 9%              3.04µs ± 2%     ~     (p=0.397 n=5+5)
    zeo/py/fs1-zhash.py                                         372µs ±10%               347µs ± 5%   -6.84%  (p=0.032 n=5+5)
    zeo/py/fs1-zhash.go                                         114µs ± 1%               114µs ± 2%     ~     (p=0.548 n=5+5)
    zeo/py/fs1-zhash.go+prefetch128                            64.6µs ± 1%              66.6µs ± 1%   +3.07%  (p=0.008 n=5+5)
    neo/py(!log)/sqlite-zhash.py                                321µs ±11%               298µs ± 5%   -7.13%  (p=0.048 n=5+5)
    neo/py(!log)/sqlite-zhash.go                                142µs ± 3%               142µs ± 3%     ~     (p=1.000 n=5+5)
    neo/py(!log)/sqlite-zhash.go+prefetch128                    117µs ± 1%               115µs ± 1%     ~     (p=0.087 n=5+5)
    neo/py(!log)/sql-zhash.py                                   330µs ± 1%               380µs ±34%  +15.42%  (p=0.016 n=4+5)
    neo/py(!log)/sql-zhash.go                                   172µs ± 1%               170µs ± 2%     ~     (p=0.310 n=5+5)
    neo/py(!log)/sql-zhash.go+prefetch128                       149µs ± 2%               148µs ± 1%     ~     (p=0.222 n=5+5)
    neo/go/fs1-zhash.py                                         217µs ± 1%               214µs ± 5%     ~     (p=0.643 n=5+5)
    neo/go/fs1-zhash.go                                        49.8µs ± 2%              49.5µs ± 1%     ~     (p=0.246 n=5+5)
    neo/go/fs1-zhash.go+prefetch128                            18.8µs ± 1%              19.1µs ± 2%   +2.03%  (p=0.048 n=5+5)
    neo/go/fs1(!sha1)-zhash.go(!sha1)                          40.4µs ± 3%              40.5µs ± 2%     ~     (p=0.587 n=5+5)
    neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1)              16.1µs ± 2%              15.8µs ± 3%     ~     (p=0.238 n=5+5)
    neo/go/sqlite-zhash.py                                      263µs ± 4%               253µs ± 3%   -3.90%  (p=0.024 n=5+5)
    neo/go/sqlite-zhash.go                                     93.1µs ± 1%              92.7µs ± 1%     ~     (p=0.595 n=5+5)
    neo/go/sqlite-zhash.go+prefetch128                         32.7µs ± 2%              32.6µs ± 4%     ~     (p=0.659 n=5+5)
    neo/go/sqlite-zhash.go(!sha1)                              89.6µs ± 1%              91.2µs ± 1%   +1.79%  (p=0.024 n=5+5)
    neo/go/sqlite-zhash.go+prefetch128(!sha1)                  34.0µs ± 2%              32.7µs ± 2%   -3.82%  (p=0.008 n=5+5)
    
    name                                           old req/s                new req/s                delta
    cluster:rio dataset:wczblk1-8
    fs1-zwrk.go·1                                                300k ± 0%                299k ± 1%     ~     (p=0.310 n=5+5)
    fs1-zwrk.go·2                                                546k ± 0%                547k ± 1%     ~     (p=0.690 n=5+5)
    fs1-zwrk.go·3                                                810k ± 0%                812k ± 0%     ~     (p=0.310 n=5+5)
    fs1-zwrk.go·4                                               1.08M ± 0%               1.08M ± 0%     ~     (p=0.841 n=5+5)
    fs1-zwrk.go·8                                               1.42M ± 0%               1.42M ± 0%     ~     (p=1.000 n=5+5)
    fs1-zwrk.go·12                                              1.55M ± 0%               1.55M ± 0%     ~     (p=1.000 n=5+5)
    fs1-zwrk.go·16                                              1.55M ± 0%               1.54M ± 0%   -0.34%  (p=0.016 n=5+5)
    zeo/py/fs1-zwrk.go·1                                        7.41k ± 1%               7.42k ± 1%     ~     (p=0.690 n=5+5)
    zeo/py/fs1-zwrk.go·2                                        9.03k ± 1%               8.95k ± 1%     ~     (p=0.310 n=5+5)
    zeo/py/fs1-zwrk.go·3                                        9.77k ± 1%               9.86k ± 1%     ~     (p=0.151 n=5+5)
    zeo/py/fs1-zwrk.go·4                                        10.1k ± 3%               10.1k ± 2%     ~     (p=1.000 n=5+5)
    zeo/py/fs1-zwrk.go·8                                        10.5k ± 0%               10.4k ± 2%   -1.37%  (p=0.032 n=5+5)
    zeo/py/fs1-zwrk.go·12                                       10.6k ± 1%               10.6k ± 2%     ~     (p=1.000 n=5+5)
    zeo/py/fs1-zwrk.go·16                                       10.6k ± 1%               10.6k ± 1%     ~     (p=0.222 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·1                               6.80k ± 2%               6.78k ± 1%     ~     (p=0.841 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·2                               8.31k ± 7%               8.25k ± 8%     ~     (p=0.690 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·3                               8.60k ± 1%               8.48k ± 1%     ~     (p=0.056 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·4                               8.60k ± 1%               8.52k ± 0%     ~     (p=0.114 n=4+4)
    neo/py(!log)/sqlite-zwrk.go·8                               8.61k ± 1%               8.51k ± 1%     ~     (p=0.095 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·12                              8.56k ± 1%               8.46k ± 2%     ~     (p=0.151 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·16                              8.49k ± 3%               8.51k ± 1%     ~     (p=1.000 n=5+5)
    neo/py(!log)/sql-zwrk.go·1                                  5.62k ± 6%               5.59k ± 2%     ~     (p=0.310 n=5+5)
    neo/py(!log)/sql-zwrk.go·2                                  6.75k ± 4%               6.83k ± 1%     ~     (p=0.190 n=5+4)
    neo/py(!log)/sql-zwrk.go·3                                  6.77k ± 2%               6.71k ± 2%     ~     (p=0.548 n=5+5)
    neo/py(!log)/sql-zwrk.go·4                                  6.51k ± 7%               6.56k ± 4%     ~     (p=1.000 n=5+5)
    neo/py(!log)/sql-zwrk.go·8                                  6.56k ± 4%               6.68k ± 4%     ~     (p=0.310 n=5+5)
    neo/py(!log)/sql-zwrk.go·12                                 6.84k ± 1%               6.73k ± 6%     ~     (p=0.730 n=4+5)
    neo/py(!log)/sql-zwrk.go·16                                 6.73k ± 3%               6.71k ± 3%     ~     (p=0.841 n=5+5)
    neo/go/fs1-zwrk.go·1                                        15.5k ± 0%               15.6k ± 0%     ~     (p=0.095 n=5+5)
    neo/go/fs1-zwrk.go·2                                        29.9k ± 1%               30.2k ± 1%   +0.84%  (p=0.032 n=5+5)
    neo/go/fs1-zwrk.go·3                                        39.4k ± 0%               39.7k ± 0%   +0.70%  (p=0.008 n=5+5)
    neo/go/fs1-zwrk.go·4                                        49.4k ± 0%               49.6k ± 0%   +0.54%  (p=0.008 n=5+5)
    neo/go/fs1-zwrk.go·8                                        68.4k ± 0%               68.8k ± 0%   +0.62%  (p=0.008 n=5+5)
    neo/go/fs1-zwrk.go·12                                       72.5k ± 0%               73.0k ± 0%   +0.66%  (p=0.016 n=5+5)
    neo/go/fs1-zwrk.go·16                                       73.2k ± 0%               73.7k ± 1%   +0.79%  (p=0.008 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                          26.2k ± 1%               25.3k ± 2%   -3.17%  (p=0.008 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                          47.6k ± 0%               47.8k ± 0%   +0.46%  (p=0.032 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                          59.4k ± 0%               59.6k ± 0%     ~     (p=0.095 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                          72.2k ± 0%               72.4k ± 0%     ~     (p=0.056 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          96.7k ± 0%               96.8k ± 0%     ~     (p=0.841 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                          109k ± 0%                110k ± 0%     ~     (p=0.841 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                          113k ± 1%                113k ± 1%     ~     (p=0.548 n=5+5)
    neo/go/sqlite-zwrk.go·1                                     9.82k ± 0%               9.91k ± 0%   +0.88%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go·2                                     18.3k ± 0%               18.4k ± 0%   +0.56%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go·3                                     25.3k ± 0%               25.5k ± 0%   +0.91%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go·4                                     30.3k ± 0%               30.6k ± 0%   +0.80%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go·8                                     39.5k ± 0%               40.1k ± 0%   +1.54%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go·12                                    40.8k ± 2%               41.8k ± 1%   +2.31%  (p=0.016 n=5+5)
    neo/go/sqlite-zwrk.go·16                                    40.5k ± 2%               41.8k ± 2%   +3.20%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·1                              11.0k ± 1%               11.1k ± 1%     ~     (p=0.222 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·2                              20.0k ± 0%               20.1k ± 0%   +0.35%  (p=0.016 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·3                              27.9k ± 0%               28.0k ± 0%   +0.27%  (p=0.016 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·4                              34.1k ± 0%               34.3k ± 0%   +0.62%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·8                              44.1k ± 1%               44.7k ± 1%   +1.53%  (p=0.016 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·12                             43.1k ± 1%               44.5k ± 1%   +3.33%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·16                             41.2k ± 2%               43.0k ± 2%   +4.21%  (p=0.008 n=5+5)
    cluster:rio dataset:prod1-1024
    fs1-zwrk.go·1                                                465k ± 1%                461k ± 1%     ~     (p=0.056 n=5+5)
    fs1-zwrk.go·2                                                920k ± 0%                918k ± 0%     ~     (p=0.730 n=4+5)
    fs1-zwrk.go·3                                               1.36M ± 1%               1.37M ± 1%     ~     (p=0.548 n=5+5)
    fs1-zwrk.go·4                                               1.81M ± 0%               1.80M ± 3%     ~     (p=0.310 n=5+5)
    fs1-zwrk.go·8                                               2.37M ± 1%               2.38M ± 2%     ~     (p=0.690 n=5+5)
    fs1-zwrk.go·12                                              2.41M ± 0%               2.42M ± 0%     ~     (p=0.690 n=5+5)
    fs1-zwrk.go·16                                              2.42M ± 0%               2.41M ± 0%     ~     (p=0.056 n=5+5)
    zeo/py/fs1-zwrk.go·1                                        8.98k ± 1%               8.88k ± 1%   -1.08%  (p=0.032 n=5+5)
    zeo/py/fs1-zwrk.go·2                                        11.7k ± 1%               11.6k ± 2%     ~     (p=0.310 n=5+5)
    zeo/py/fs1-zwrk.go·3                                        12.9k ± 2%               12.5k ± 2%   -2.84%  (p=0.008 n=5+5)
    zeo/py/fs1-zwrk.go·4                                        13.4k ± 4%               13.1k ± 2%     ~     (p=0.095 n=5+5)
    zeo/py/fs1-zwrk.go·8                                        14.0k ± 2%               13.6k ± 1%   -2.77%  (p=0.008 n=5+5)
    zeo/py/fs1-zwrk.go·12                                       14.2k ± 2%               13.9k ± 1%   -2.05%  (p=0.032 n=5+5)
    zeo/py/fs1-zwrk.go·16                                       14.2k ± 3%               13.8k ± 1%   -2.84%  (p=0.032 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·1                               7.16k ± 4%               7.12k ± 3%     ~     (p=0.548 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·2                               8.75k ± 1%               8.64k ± 7%     ~     (p=1.000 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·3                               8.65k ± 4%               8.79k ± 1%     ~     (p=0.548 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·4                               8.53k ± 6%               8.73k ± 2%     ~     (p=0.310 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·8                               8.61k ± 3%               8.60k ± 2%     ~     (p=1.000 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·12                              8.64k ± 0%               8.78k ± 1%   +1.63%  (p=0.016 n=4+5)
    neo/py(!log)/sqlite-zwrk.go·16                              8.64k ± 1%               8.58k ± 3%     ~     (p=1.000 n=5+5)
    neo/py(!log)/sql-zwrk.go·1                                  5.88k ± 1%               5.91k ± 1%     ~     (p=0.548 n=5+5)
    neo/py(!log)/sql-zwrk.go·2                                  6.79k ± 2%               6.71k ± 9%     ~     (p=0.841 n=5+5)
    neo/py(!log)/sql-zwrk.go·3                                  6.58k ± 4%               6.85k ± 2%     ~     (p=0.056 n=5+5)
    neo/py(!log)/sql-zwrk.go·4                                  6.68k ± 4%               6.82k ± 1%     ~     (p=0.730 n=5+4)
    neo/py(!log)/sql-zwrk.go·8                                  6.83k ± 1%               6.80k ± 6%     ~     (p=0.421 n=5+5)
    neo/py(!log)/sql-zwrk.go·12                                 6.66k ± 4%               6.87k ± 2%   +3.10%  (p=0.016 n=5+5)
    neo/py(!log)/sql-zwrk.go·16                                 6.65k ± 5%               6.90k ± 2%     ~     (p=0.151 n=5+5)
    neo/go/fs1-zwrk.go·1                                        21.8k ± 1%               21.9k ± 2%     ~     (p=0.222 n=5+5)
    neo/go/fs1-zwrk.go·2                                        39.2k ± 1%               39.6k ± 1%   +0.94%  (p=0.016 n=5+5)
    neo/go/fs1-zwrk.go·3                                        51.4k ± 0%               51.5k ± 0%     ~     (p=0.421 n=5+5)
    neo/go/fs1-zwrk.go·4                                        62.8k ± 0%               62.8k ± 0%     ~     (p=0.841 n=5+5)
    neo/go/fs1-zwrk.go·8                                        80.7k ± 1%               80.2k ± 1%     ~     (p=0.421 n=5+5)
    neo/go/fs1-zwrk.go·12                                       80.0k ± 2%               79.6k ± 3%     ~     (p=0.841 n=5+5)
    neo/go/fs1-zwrk.go·16                                       78.3k ± 2%               77.1k ± 5%     ~     (p=0.421 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                          26.5k ± 1%               26.9k ± 1%   +1.52%  (p=0.008 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                          48.8k ± 0%               49.2k ± 0%   +0.89%  (p=0.008 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                          61.8k ± 0%               62.1k ± 0%     ~     (p=0.056 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                          74.0k ± 0%               74.2k ± 0%     ~     (p=0.151 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          91.3k ± 0%               91.9k ± 2%     ~     (p=0.190 n=4+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         93.1k ± 2%               92.9k ± 2%     ~     (p=0.841 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         89.7k ± 2%               90.1k ± 2%     ~     (p=0.841 n=5+5)
    neo/go/sqlite-zwrk.go·1                                     11.0k ± 1%               11.1k ± 0%     ~     (p=0.151 n=5+5)
    neo/go/sqlite-zwrk.go·2                                     19.4k ± 1%               19.4k ± 0%     ~     (p=0.841 n=5+5)
    neo/go/sqlite-zwrk.go·3                                     26.6k ± 0%               26.5k ± 0%     ~     (p=0.095 n=5+5)
    neo/go/sqlite-zwrk.go·4                                     31.9k ± 0%               31.7k ± 0%   -0.47%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go·8                                     37.4k ± 2%               37.3k ± 2%     ~     (p=0.841 n=5+5)
    neo/go/sqlite-zwrk.go·12                                    35.2k ± 3%               35.4k ± 2%     ~     (p=0.421 n=5+5)
    neo/go/sqlite-zwrk.go·16                                    34.6k ± 2%               34.8k ± 2%     ~     (p=0.151 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·1                              11.5k ± 1%               11.4k ± 1%   -1.34%  (p=0.032 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·2                              20.1k ± 0%               19.8k ± 0%   -1.52%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·3                              27.6k ± 0%               27.3k ± 1%   -0.93%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·4                              33.4k ± 0%               33.1k ± 1%   -0.81%  (p=0.016 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·8                              38.8k ± 2%               38.8k ± 1%     ~     (p=0.690 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·12                             36.4k ± 1%               36.0k ± 2%     ~     (p=0.222 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·16                             35.2k ± 2%               35.1k ± 2%     ~     (p=0.690 n=5+5)
    
    name                                           old latency-time/object  new latency-time/object  delta
    cluster:rio dataset:wczblk1-8
    fs1-zwrk.go·1                                              3.33µs ± 0%              3.34µs ± 1%     ~     (p=0.286 n=5+5)
    fs1-zwrk.go·2                                              3.67µs ± 0%              3.65µs ± 1%     ~     (p=0.667 n=5+5)
    fs1-zwrk.go·3                                              3.70µs ± 0%              3.69µs ± 0%     ~     (p=0.310 n=5+5)
    fs1-zwrk.go·4                                              3.72µs ± 0%              3.72µs ± 0%     ~     (p=0.984 n=5+5)
    fs1-zwrk.go·8                                              5.62µs ± 0%              5.62µs ± 0%     ~     (p=0.889 n=5+5)
    fs1-zwrk.go·12                                             7.76µs ± 0%              7.76µs ± 0%     ~     (p=1.000 n=5+5)
    fs1-zwrk.go·16                                             10.3µs ± 0%              10.4µs ± 0%   +0.34%  (p=0.016 n=5+5)
    zeo/py/fs1-zwrk.go·1                                        135µs ± 1%               135µs ± 1%     ~     (p=0.690 n=5+5)
    zeo/py/fs1-zwrk.go·2                                        222µs ± 1%               223µs ± 1%     ~     (p=0.310 n=5+5)
    zeo/py/fs1-zwrk.go·3                                        307µs ± 1%               304µs ± 1%     ~     (p=0.151 n=5+5)
    zeo/py/fs1-zwrk.go·4                                        398µs ± 3%               397µs ± 2%     ~     (p=1.000 n=5+5)
    zeo/py/fs1-zwrk.go·8                                        759µs ± 0%               770µs ± 2%   +1.41%  (p=0.032 n=5+5)
    zeo/py/fs1-zwrk.go·12                                      1.13ms ± 1%              1.14ms ± 2%     ~     (p=1.000 n=5+5)
    zeo/py/fs1-zwrk.go·16                                      1.50ms ± 1%              1.51ms ± 1%     ~     (p=0.222 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·1                               147µs ± 2%               147µs ± 1%     ~     (p=0.841 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·2                               241µs ± 8%               243µs ± 8%     ~     (p=0.690 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·3                               349µs ± 1%               354µs ± 1%     ~     (p=0.056 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·4                               465µs ± 1%               470µs ± 0%     ~     (p=0.114 n=4+4)
    neo/py(!log)/sqlite-zwrk.go·8                               930µs ± 1%               940µs ± 1%     ~     (p=0.095 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·12                             1.40ms ± 1%              1.42ms ± 2%     ~     (p=0.151 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·16                             1.88ms ± 3%              1.88ms ± 1%     ~     (p=1.000 n=5+5)
    neo/py(!log)/sql-zwrk.go·1                                  178µs ± 6%               179µs ± 2%     ~     (p=0.310 n=5+5)
    neo/py(!log)/sql-zwrk.go·2                                  297µs ± 4%               293µs ± 1%     ~     (p=0.190 n=5+4)
    neo/py(!log)/sql-zwrk.go·3                                  443µs ± 2%               447µs ± 2%     ~     (p=0.548 n=5+5)
    neo/py(!log)/sql-zwrk.go·4                                  616µs ± 8%               610µs ± 4%     ~     (p=1.000 n=5+5)
    neo/py(!log)/sql-zwrk.go·8                                 1.22ms ± 5%              1.20ms ± 4%     ~     (p=0.310 n=5+5)
    neo/py(!log)/sql-zwrk.go·12                                1.75ms ± 1%              1.79ms ± 6%     ~     (p=0.730 n=4+5)
    neo/py(!log)/sql-zwrk.go·16                                2.38ms ± 3%              2.38ms ± 3%     ~     (p=0.841 n=5+5)
    neo/go/fs1-zwrk.go·1                                       64.4µs ± 0%              64.1µs ± 0%     ~     (p=0.095 n=5+5)
    neo/go/fs1-zwrk.go·2                                       66.8µs ± 1%              66.3µs ± 1%   -0.83%  (p=0.032 n=5+5)
    neo/go/fs1-zwrk.go·3                                       76.1µs ± 0%              75.5µs ± 0%   -0.69%  (p=0.008 n=5+5)
    neo/go/fs1-zwrk.go·4                                       81.0µs ± 0%              80.6µs ± 0%   -0.53%  (p=0.008 n=5+5)
    neo/go/fs1-zwrk.go·8                                        117µs ± 0%               116µs ± 0%   -0.62%  (p=0.008 n=5+5)
    neo/go/fs1-zwrk.go·12                                       165µs ± 0%               164µs ± 0%   -0.65%  (p=0.016 n=5+5)
    neo/go/fs1-zwrk.go·16                                       219µs ± 0%               217µs ± 1%   -0.78%  (p=0.008 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                         38.2µs ± 1%              39.5µs ± 2%   +3.29%  (p=0.008 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                         42.0µs ± 0%              41.8µs ± 0%   -0.45%  (p=0.032 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                         50.5µs ± 0%              50.4µs ± 0%     ~     (p=0.095 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                         55.4µs ± 0%              55.3µs ± 0%     ~     (p=0.063 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                         82.8µs ± 0%              82.7µs ± 0%     ~     (p=0.841 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         110µs ± 0%               110µs ± 0%     ~     (p=0.841 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         142µs ± 1%               142µs ± 1%     ~     (p=0.548 n=5+5)
    neo/go/sqlite-zwrk.go·1                                     102µs ± 0%               101µs ± 0%   -0.87%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go·2                                     110µs ± 0%               109µs ± 0%   -0.55%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go·3                                     119µs ± 0%               117µs ± 0%   -0.90%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go·4                                     132µs ± 0%               131µs ± 0%   -0.79%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go·8                                     203µs ± 0%               200µs ± 0%   -1.52%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go·12                                    294µs ± 2%               287µs ± 1%   -2.26%  (p=0.016 n=5+5)
    neo/go/sqlite-zwrk.go·16                                    395µs ± 2%               383µs ± 2%   -3.11%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·1                             91.1µs ± 1%              90.4µs ± 1%     ~     (p=0.222 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·2                              100µs ± 0%               100µs ± 0%   -0.35%  (p=0.016 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·3                              108µs ± 0%               107µs ± 0%   -0.27%  (p=0.016 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·4                              117µs ± 0%               117µs ± 0%   -0.62%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·8                              182µs ± 1%               179µs ± 1%   -1.51%  (p=0.016 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·12                             279µs ± 1%               270µs ± 1%   -3.22%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·16                             388µs ± 2%               372µs ± 2%   -4.03%  (p=0.008 n=5+5)
    cluster:rio dataset:prod1-1024
    fs1-zwrk.go·1                                              2.15µs ± 1%              2.17µs ± 1%     ~     (p=0.056 n=5+5)
    fs1-zwrk.go·2                                              2.17µs ± 0%              2.18µs ± 0%     ~     (p=0.603 n=4+5)
    fs1-zwrk.go·3                                              2.20µs ± 1%              2.20µs ± 1%     ~     (p=0.460 n=5+5)
    fs1-zwrk.go·4                                              2.21µs ± 0%              2.23µs ± 3%     ~     (p=0.278 n=5+5)
    fs1-zwrk.go·8                                              3.37µs ± 1%              3.36µs ± 2%     ~     (p=0.690 n=5+5)
    fs1-zwrk.go·12                                             4.97µs ± 0%              4.97µs ± 0%     ~     (p=0.675 n=5+5)
    fs1-zwrk.go·16                                             6.61µs ± 0%              6.63µs ± 0%     ~     (p=0.063 n=5+5)
    zeo/py/fs1-zwrk.go·1                                        111µs ± 1%               113µs ± 1%   +1.09%  (p=0.032 n=5+5)
    zeo/py/fs1-zwrk.go·2                                        171µs ± 1%               173µs ± 2%     ~     (p=0.310 n=5+5)
    zeo/py/fs1-zwrk.go·3                                        233µs ± 2%               240µs ± 2%   +2.94%  (p=0.008 n=5+5)
    zeo/py/fs1-zwrk.go·4                                        298µs ± 4%               306µs ± 2%     ~     (p=0.095 n=5+5)
    zeo/py/fs1-zwrk.go·8                                        572µs ± 2%               588µs ± 1%   +2.84%  (p=0.008 n=5+5)
    zeo/py/fs1-zwrk.go·12                                       844µs ± 2%               861µs ± 1%   +2.07%  (p=0.032 n=5+5)
    zeo/py/fs1-zwrk.go·16                                      1.12ms ± 3%              1.16ms ± 1%   +2.90%  (p=0.032 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·1                               140µs ± 4%               140µs ± 3%     ~     (p=0.548 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·2                               229µs ± 1%               232µs ± 7%     ~     (p=1.000 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·3                               347µs ± 5%               341µs ± 1%     ~     (p=0.548 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·4                               470µs ± 7%               458µs ± 2%     ~     (p=0.310 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·8                               929µs ± 3%               930µs ± 2%     ~     (p=1.000 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·12                             1.39ms ± 0%              1.37ms ± 1%   -1.60%  (p=0.016 n=4+5)
    neo/py(!log)/sqlite-zwrk.go·16                             1.85ms ± 1%              1.86ms ± 3%     ~     (p=1.000 n=5+5)
    neo/py(!log)/sql-zwrk.go·1                                  170µs ± 1%               169µs ± 1%     ~     (p=0.548 n=5+5)
    neo/py(!log)/sql-zwrk.go·2                                  294µs ± 2%               299µs ±10%     ~     (p=0.841 n=5+5)
    neo/py(!log)/sql-zwrk.go·3                                  456µs ± 4%               438µs ± 1%     ~     (p=0.056 n=5+5)
    neo/py(!log)/sql-zwrk.go·4                                  599µs ± 4%               587µs ± 1%     ~     (p=0.730 n=5+4)
    neo/py(!log)/sql-zwrk.go·8                                 1.17ms ± 1%              1.18ms ± 6%     ~     (p=0.421 n=5+5)
    neo/py(!log)/sql-zwrk.go·12                                1.80ms ± 4%              1.75ms ± 2%   -3.05%  (p=0.016 n=5+5)
    neo/py(!log)/sql-zwrk.go·16                                2.41ms ± 5%              2.32ms ± 2%     ~     (p=0.151 n=5+5)
    neo/go/fs1-zwrk.go·1                                       45.9µs ± 1%              45.6µs ± 2%     ~     (p=0.167 n=5+5)
    neo/go/fs1-zwrk.go·2                                       51.0µs ± 1%              50.6µs ± 1%   -0.94%  (p=0.016 n=5+5)
    neo/go/fs1-zwrk.go·3                                       58.3µs ± 0%              58.3µs ± 0%     ~     (p=0.421 n=5+5)
    neo/go/fs1-zwrk.go·4                                       63.7µs ± 0%              63.7µs ± 0%     ~     (p=0.841 n=5+5)
    neo/go/fs1-zwrk.go·8                                       99.2µs ± 1%              99.8µs ± 1%     ~     (p=0.421 n=5+5)
    neo/go/fs1-zwrk.go·12                                       150µs ± 2%               151µs ± 3%     ~     (p=0.841 n=5+5)
    neo/go/fs1-zwrk.go·16                                       204µs ± 3%               208µs ± 5%     ~     (p=0.421 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                         37.7µs ± 1%              37.2µs ± 1%   -1.50%  (p=0.008 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                         41.0µs ± 0%              40.6µs ± 0%   -0.88%  (p=0.008 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                         48.5µs ± 0%              48.3µs ± 0%     ~     (p=0.056 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                         54.0µs ± 0%              53.9µs ± 0%     ~     (p=0.151 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                         87.6µs ± 0%              87.1µs ± 2%     ~     (p=0.190 n=4+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         129µs ± 2%               129µs ± 2%     ~     (p=0.841 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         178µs ± 2%               178µs ± 2%     ~     (p=0.841 n=5+5)
    neo/go/sqlite-zwrk.go·1                                    90.7µs ± 1%              90.4µs ± 0%     ~     (p=0.151 n=5+5)
    neo/go/sqlite-zwrk.go·2                                     103µs ± 1%               103µs ± 0%     ~     (p=0.841 n=5+5)
    neo/go/sqlite-zwrk.go·3                                     113µs ± 0%               113µs ± 0%     ~     (p=0.095 n=5+5)
    neo/go/sqlite-zwrk.go·4                                     125µs ± 0%               126µs ± 0%   +0.47%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go·8                                     214µs ± 2%               215µs ± 2%     ~     (p=0.841 n=5+5)
    neo/go/sqlite-zwrk.go·12                                    341µs ± 3%               339µs ± 2%     ~     (p=0.421 n=5+5)
    neo/go/sqlite-zwrk.go·16                                    462µs ± 2%               460µs ± 2%     ~     (p=0.151 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·1                             86.7µs ± 1%              87.9µs ± 1%   +1.36%  (p=0.032 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·2                              100µs ± 0%               101µs ± 0%   +1.54%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·3                              109µs ± 0%               110µs ± 1%   +0.94%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·4                              120µs ± 0%               121µs ± 1%   +0.82%  (p=0.016 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·8                              206µs ± 2%               206µs ± 1%     ~     (p=0.690 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·12                             330µs ± 1%               333µs ± 2%     ~     (p=0.222 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·16                             455µs ± 2%               456µs ± 2%     ~     (p=0.690 n=5+5)
    3695ff12
20180306-rio-ffixed-noc_C1(1µs).txt 128 KB