• Kirill Smelkov's avatar
    X neo1: localhost timings, C > C1 disabled, zwrk@1s · 23f8d82e
    Kirill Smelkov authored
    Comparing to Cenalbled run, even when there each zwrk was run for 10s,
    similarly to previous measure with Cstates disabled (f40c8b4b) it shows
    clear improvement:
    
    ---- 8< ----
    cluster:neo1 dataset:wczblk1-8
    zeo/py/fs1-zwrk.go·1                                        195µs ± 1%               172µs ± 1%  -11.98%  (p=0.008 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·1                               230µs ± 1%               191µs ± 2%  -16.86%  (p=0.008 n=5+5)
    neo/py(!log)/sql-zwrk.go·1                                  305µs ± 7%               244µs ± 6%  -19.90%  (p=0.008 n=5+5)
    neo/py(!log)/sql-zwrk.go·2                                  491µs ± 2%               412µs ± 3%  -15.94%  (p=0.008 n=5+5)
    neo/py(!log)/sql-zwrk.go·3                                  740µs ± 2%               625µs ± 4%  -15.61%  (p=0.008 n=5+5)
    neo/py(!log)/sql-zwrk.go·4                                  976µs ± 2%               837µs ± 1%  -14.28%  (p=0.008 n=5+5)
    neo/py(!log)/sql-zwrk.go·8                                 1.98ms ± 2%              1.69ms ± 7%  -14.60%  (p=0.008 n=5+5)
    neo/py(!log)/sql-zwrk.go·12                                2.98ms ± 2%              2.57ms ± 6%  -13.56%  (p=0.008 n=5+5)
    neo/py(!log)/sql-zwrk.go·16                                4.03ms ± 3%              3.42ms ± 9%  -14.95%  (p=0.008 n=5+5)
    
    cluster:neo1 dataset:prod1-1024
    zeo/py/fs1-zwrk.go·1                                        170µs ± 1%               146µs ± 1%  -13.66%  (p=0.008 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·1                               209µs ± 3%               180µs ± 3%  -14.26%  (p=0.008 n=5+5)
    neo/py(!log)/sql-zwrk.go·1                                  294µs ± 4%               230µs ± 2%  -21.61%  (p=0.008 n=5+5)
    neo/py(!log)/sql-zwrk.go·2                                  483µs ± 2%               405µs ± 4%  -16.22%  (p=0.008 n=5+5)
    neo/py(!log)/sql-zwrk.go·3                                  728µs ± 1%               640µs ± 5%  -11.98%  (p=0.008 n=5+5)
    neo/py(!log)/sql-zwrk.go·4                                  978µs ± 3%               837µs ± 4%  -14.42%  (p=0.008 n=5+5)
    neo/py(!log)/sql-zwrk.go·8                                 1.92ms ± 2%              1.63ms ± 1%  -15.10%  (p=0.008 n=5+5)
    neo/py(!log)/sql-zwrk.go·12                                2.94ms ± 2%              2.52ms ± 3%  -14.18%  (p=0.008 n=5+5)
    neo/py(!log)/sql-zwrk.go·16                                3.87ms ± 3%              3.27ms ± 3%  -15.56%  (p=0.008 n=5+5)
    ---- 8< ----
    
    not to mention that zhash.{py,go}, for which runtime was not changed,
    are also improved like it was in f40c8b4b, thus confirming timings from
    there:
    
    ---- 8< ----
    cluster:neo1 dataset:wczblk1-8
    zeo/py/fs1-zhash.py                                         516µs ± 8%               459µs ± 0%  -11.00%  (p=0.016 n=5+4)
    zeo/py/fs1-zhash.go                                         200µs ± 4%               174µs ± 2%  -12.99%  (p=0.008 n=5+5)
    neo/py(!log)/sqlite-zhash.py                                692µs ± 5%               390µs ± 1%  -43.67%  (p=0.008 n=5+5)
    neo/py(!log)/sqlite-zhash.go                                230µs ± 4%               196µs ± 2%  -14.72%  (p=0.008 n=5+5)
    neo/py(!log)/sql-zhash.py                                   938µs ±50%               459µs ± 1%  -51.03%  (p=0.016 n=5+4)
    neo/py(!log)/sql-zhash.go                                   310µs ±10%               249µs ± 3%  -19.61%  (p=0.008 n=5+5)
    neo/py(!log)/sql-zhash.go+prefetch128                       244µs ± 8%               217µs ± 1%  -10.95%  (p=0.008 n=5+5)
    neo/go/fs1-zhash.py                                         368µs ±27%               274µs ± 1%  -25.36%  (p=0.008 n=5+5)
    neo/go/sqlite-zhash.py                                      406µs ± 8%               322µs ± 1%  -20.74%  (p=0.008 n=5+5)
    
    cluster:neo1 dataset:prod1-1024
    zeo/py/fs1-zhash.py                                         499µs ± 2%               436µs ± 2%  -12.61%  (p=0.008 n=5+5)
    zeo/py/fs1-zhash.go                                         171µs ± 4%               150µs ± 2%  -12.19%  (p=0.008 n=5+5)
    neo/py(!log)/sqlite-zhash.py                                678µs ± 3%               387µs ± 5%  -42.91%  (p=0.008 n=5+5)
    neo/py(!log)/sqlite-zhash.go                                211µs ± 6%               185µs ± 4%  -12.53%  (p=0.008 n=5+5)
    neo/py(!log)/sql-zhash.py                                   922µs ±53%               477µs ±40%  -48.31%  (p=0.008 n=5+5)
    neo/py(!log)/sql-zhash.go                                   289µs ± 5%               236µs ± 2%  -18.35%  (p=0.008 n=5+5)
    neo/py(!log)/sql-zhash.go+prefetch128                       228µs ± 4%               202µs ± 2%  -11.68%  (p=0.008 n=5+5)
    neo/go/fs1-zhash.py                                         359µs ±15%               267µs ±11%  -25.72%  (p=0.008 n=5+5)
    neo/go/sqlite-zhash.py                                      396µs ± 4%               312µs ± 1%  -21.16%  (p=0.008 n=5+5)
    ---- 8< ----
    
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
    
    $ benchstat -split node,cluster,dataset  20180308-neo1-ffixed-c-zwrk10s.txt 20180308-neo1-ffixed-noc_C1\(3µs\)-zwrk1s.txt
    
    name                                           old pystone/s            new pystone/s            delta
    node:neo1
    pystone                                                      106k ± 1%                105k ± 0%   -1.36%  (p=0.008 n=5+5)
    
    name                                           old time/op              new time/op              delta
    node:neo1
    crc32/py/4K                                                5.16µs ± 1%              5.15µs ± 1%     ~     (p=0.690 n=5+5)
    crc32/go/4K                                                2.79µs ± 0%              2.79µs ± 0%   -0.12%  (p=0.029 n=4+4)
    sha1/py/4K                                                 13.5µs ± 1%              13.5µs ± 3%     ~     (p=0.421 n=5+5)
    sha1/go/4K                                                 9.82µs ± 0%              9.81µs ± 0%     ~     (p=0.516 n=5+5)
    unzlib/py/wczdata                                          36.1µs ± 1%              35.5µs ± 7%     ~     (p=0.690 n=5+5)
    unzlib/go/wczdata                                          31.3µs ± 0%              30.9µs ± 1%   -1.22%  (p=0.008 n=5+5)
    unzlib/py/prod1-avg                                        16.4µs ± 1%              16.0µs ± 2%     ~     (p=0.095 n=5+5)
    unzlib/go/prod1-avg                                        9.41µs ± 1%              9.26µs ± 1%   -1.58%  (p=0.008 n=5+5)
    disk/randread/direct/4K-min                                 162µs ± 0%               158µs ± 2%   -1.99%  (p=0.008 n=5+5)
    disk/randread/direct/4K-avg                                 187µs ± 0%               172µs ± 0%   -7.92%  (p=0.008 n=5+5)
    disk/randread/pagecache/4K-min                              386ns ± 1%               392ns ± 2%     ~     (p=0.190 n=4+5)
    disk/randread/pagecache/4K-avg                              804ns ± 0%               904ns ± 1%  +12.46%  (p=0.016 n=4+5)
    
    name                                           old time/object          new time/object          delta
    cluster:neo1 dataset:wczblk1-8
    fs1-zhash.py                                               34.9µs ± 1%              34.7µs ± 2%     ~     (p=0.476 n=5+5)
    fs1-zhash.go                                               6.00µs ± 0%              5.90µs ± 0%   -1.67%  (p=0.029 n=4+4)
    fs1-zhash.go+prefetch128                                   6.58µs ± 2%              6.32µs ± 3%   -3.95%  (p=0.032 n=5+5)
    zeo/py/fs1-zhash.py                                         516µs ± 8%               459µs ± 0%  -11.00%  (p=0.016 n=5+4)
    zeo/py/fs1-zhash.go                                         200µs ± 4%               174µs ± 2%  -12.99%  (p=0.008 n=5+5)
    zeo/py/fs1-zhash.go+prefetch128                            98.5µs ± 2%              98.5µs ± 2%     ~     (p=1.000 n=5+5)
    neo/py(!log)/sqlite-zhash.py                                692µs ± 5%               390µs ± 1%  -43.67%  (p=0.008 n=5+5)
    neo/py(!log)/sqlite-zhash.go                                230µs ± 4%               196µs ± 2%  -14.72%  (p=0.008 n=5+5)
    neo/py(!log)/sqlite-zhash.go+prefetch128                    165µs ± 3%               164µs ± 2%     ~     (p=0.690 n=5+5)
    neo/py(!log)/sql-zhash.py                                   938µs ±50%               459µs ± 1%  -51.03%  (p=0.016 n=5+4)
    neo/py(!log)/sql-zhash.go                                   310µs ±10%               249µs ± 3%  -19.61%  (p=0.008 n=5+5)
    neo/py(!log)/sql-zhash.go+prefetch128                       244µs ± 8%               217µs ± 1%  -10.95%  (p=0.008 n=5+5)
    neo/go/fs1-zhash.py                                         368µs ±27%               274µs ± 1%  -25.36%  (p=0.008 n=5+5)
    neo/go/fs1-zhash.go                                        80.2µs ± 2%              80.4µs ± 4%     ~     (p=1.000 n=5+5)
    neo/go/fs1-zhash.go+prefetch128                            34.8µs ± 5%              35.3µs ± 6%     ~     (p=0.690 n=5+5)
    neo/go/fs1(!sha1)-zhash.go(!sha1)                          56.7µs ± 3%              56.5µs ± 2%     ~     (p=1.000 n=5+5)
    neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1)              22.7µs ± 3%              23.2µs ± 7%     ~     (p=0.413 n=5+5)
    neo/go/sqlite-zhash.py                                      406µs ± 8%               322µs ± 1%  -20.74%  (p=0.008 n=5+5)
    neo/go/sqlite-zhash.go                                      125µs ± 2%               134µs ±12%     ~     (p=0.548 n=5+5)
    neo/go/sqlite-zhash.go+prefetch128                         47.9µs ± 5%              49.4µs ± 9%     ~     (p=0.548 n=5+5)
    neo/go/sqlite-zhash.go(!sha1)                               115µs ± 1%               114µs ± 2%     ~     (p=0.421 n=5+5)
    neo/go/sqlite-zhash.go+prefetch128(!sha1)                  47.2µs ±13%              46.3µs ± 5%     ~     (p=0.841 n=5+5)
    cluster:neo1 dataset:prod1-1024
    fs1-zhash.py                                               29.1µs ± 2%              29.3µs ± 0%     ~     (p=0.413 n=5+5)
    fs1-zhash.go                                               3.74µs ± 2%              3.80µs ± 0%     ~     (p=0.238 n=5+4)
    fs1-zhash.go+prefetch128                                   3.88µs ± 3%              3.78µs ± 3%     ~     (p=0.190 n=5+5)
    zeo/py/fs1-zhash.py                                         499µs ± 2%               436µs ± 2%  -12.61%  (p=0.008 n=5+5)
    zeo/py/fs1-zhash.go                                         171µs ± 4%               150µs ± 2%  -12.19%  (p=0.008 n=5+5)
    zeo/py/fs1-zhash.go+prefetch128                            87.9µs ± 1%              88.0µs ± 1%     ~     (p=1.000 n=5+5)
    neo/py(!log)/sqlite-zhash.py                                678µs ± 3%               387µs ± 5%  -42.91%  (p=0.008 n=5+5)
    neo/py(!log)/sqlite-zhash.go                                211µs ± 6%               185µs ± 4%  -12.53%  (p=0.008 n=5+5)
    neo/py(!log)/sqlite-zhash.go+prefetch128                    150µs ± 1%               150µs ± 2%     ~     (p=0.881 n=5+5)
    neo/py(!log)/sql-zhash.py                                   922µs ±53%               477µs ±40%  -48.31%  (p=0.008 n=5+5)
    neo/py(!log)/sql-zhash.go                                   289µs ± 5%               236µs ± 2%  -18.35%  (p=0.008 n=5+5)
    neo/py(!log)/sql-zhash.go+prefetch128                       228µs ± 4%               202µs ± 2%  -11.68%  (p=0.008 n=5+5)
    neo/go/fs1-zhash.py                                         359µs ±15%               267µs ±11%  -25.72%  (p=0.008 n=5+5)
    neo/go/fs1-zhash.go                                        62.1µs ± 0%              60.8µs ± 2%   -2.12%  (p=0.024 n=5+5)
    neo/go/fs1-zhash.go+prefetch128                            22.5µs ± 1%              22.2µs ± 1%     ~     (p=0.087 n=5+5)
    neo/go/fs1(!sha1)-zhash.go(!sha1)                          51.4µs ± 4%              52.7µs ± 3%     ~     (p=0.056 n=5+5)
    neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1)              18.6µs ± 3%              18.4µs ± 5%     ~     (p=0.683 n=5+5)
    neo/go/sqlite-zhash.py                                      396µs ± 4%               312µs ± 1%  -21.16%  (p=0.008 n=5+5)
    neo/go/sqlite-zhash.go                                      114µs ± 1%               112µs ± 1%   -1.48%  (p=0.016 n=5+5)
    neo/go/sqlite-zhash.go+prefetch128                         41.5µs ± 6%              41.2µs ± 7%     ~     (p=0.802 n=5+5)
    neo/go/sqlite-zhash.go(!sha1)                               109µs ± 1%               107µs ± 2%   -1.58%  (p=0.016 n=5+5)
    neo/go/sqlite-zhash.go+prefetch128(!sha1)                  41.4µs ± 3%              41.5µs ± 4%     ~     (p=0.984 n=5+5)
    
    name                                           old req/s                new req/s                delta
    cluster:neo1 dataset:wczblk1-8
    fs1-zwrk.go·1                                                229k ± 1%                230k ± 0%     ~     (p=0.548 n=5+5)
    fs1-zwrk.go·2                                                446k ± 1%                425k ± 7%   -4.73%  (p=0.008 n=5+5)
    fs1-zwrk.go·3                                                665k ± 1%                660k ± 1%     ~     (p=0.056 n=5+5)
    fs1-zwrk.go·4                                                868k ± 1%                869k ± 1%     ~     (p=0.730 n=5+4)
    fs1-zwrk.go·8                                                988k ± 1%                996k ± 0%   +0.76%  (p=0.016 n=5+5)
    fs1-zwrk.go·12                                              1.01M ± 1%               1.01M ± 0%     ~     (p=1.000 n=5+5)
    fs1-zwrk.go·16                                              1.01M ± 1%               1.02M ± 0%     ~     (p=0.222 n=5+5)
    zeo/py/fs1-zwrk.go·1                                        5.13k ± 1%               5.83k ± 1%  +13.62%  (p=0.008 n=5+5)
    zeo/py/fs1-zwrk.go·2                                        6.93k ± 1%               7.21k ± 1%   +4.08%  (p=0.008 n=5+5)
    zeo/py/fs1-zwrk.go·3                                        7.54k ± 1%               7.80k ± 3%   +3.49%  (p=0.008 n=5+5)
    zeo/py/fs1-zwrk.go·4                                        7.75k ± 1%               8.01k ± 1%   +3.29%  (p=0.008 n=5+5)
    zeo/py/fs1-zwrk.go·8                                        8.09k ± 0%               8.46k ± 1%   +4.57%  (p=0.008 n=5+5)
    zeo/py/fs1-zwrk.go·12                                       8.46k ± 0%               8.52k ± 2%     ~     (p=0.151 n=5+5)
    zeo/py/fs1-zwrk.go·16                                       8.52k ± 0%               8.51k ± 2%     ~     (p=0.841 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·1                               4.35k ± 1%               5.23k ± 2%  +20.31%  (p=0.008 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·2                               6.33k ± 2%               6.30k ± 2%     ~     (p=0.421 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·3                               6.22k ± 4%               6.33k ± 1%     ~     (p=0.056 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·4                               6.25k ± 1%               6.30k ± 3%     ~     (p=0.222 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·8                               6.25k ± 2%               6.27k ± 3%     ~     (p=0.548 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·12                              6.26k ± 2%               6.36k ± 2%     ~     (p=0.056 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·16                              6.24k ± 1%               6.33k ± 2%     ~     (p=0.095 n=5+5)
    neo/py(!log)/sql-zwrk.go·1                                  3.29k ± 7%               4.10k ± 5%  +24.73%  (p=0.008 n=5+5)
    neo/py(!log)/sql-zwrk.go·2                                  4.08k ± 2%               4.85k ± 2%  +18.97%  (p=0.008 n=5+5)
    neo/py(!log)/sql-zwrk.go·3                                  4.05k ± 2%               4.80k ± 4%  +18.54%  (p=0.008 n=5+5)
    neo/py(!log)/sql-zwrk.go·4                                  4.10k ± 2%               4.78k ± 1%  +16.65%  (p=0.008 n=5+5)
    neo/py(!log)/sql-zwrk.go·8                                  4.04k ± 2%               4.73k ± 7%  +17.24%  (p=0.008 n=5+5)
    neo/py(!log)/sql-zwrk.go·12                                 4.03k ± 2%               4.67k ± 6%  +15.80%  (p=0.008 n=5+5)
    neo/py(!log)/sql-zwrk.go·16                                 3.97k ± 3%               4.68k ± 9%  +17.82%  (p=0.008 n=5+5)
    neo/go/fs1-zwrk.go·1                                        12.9k ± 0%               13.0k ± 1%   +1.38%  (p=0.008 n=5+5)
    neo/go/fs1-zwrk.go·2                                        24.8k ± 1%               25.0k ± 1%   +1.00%  (p=0.008 n=5+5)
    neo/go/fs1-zwrk.go·3                                        32.3k ± 1%               32.4k ± 0%   +0.51%  (p=0.016 n=5+5)
    neo/go/fs1-zwrk.go·4                                        40.7k ± 1%               40.9k ± 0%     ~     (p=0.087 n=5+5)
    neo/go/fs1-zwrk.go·8                                        54.5k ± 1%               54.8k ± 1%     ~     (p=0.310 n=5+5)
    neo/go/fs1-zwrk.go·12                                       57.2k ± 1%               57.4k ± 1%     ~     (p=0.841 n=5+5)
    neo/go/fs1-zwrk.go·16                                       58.3k ± 1%               55.8k ± 1%   -4.22%  (p=0.008 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                          19.1k ± 1%               19.3k ± 1%     ~     (p=0.310 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                          37.7k ± 1%               38.0k ± 1%     ~     (p=0.056 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                          47.7k ± 1%               48.2k ± 0%   +1.00%  (p=0.016 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                          58.6k ± 1%               59.3k ± 0%   +1.29%  (p=0.008 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          77.6k ± 1%               78.4k ± 0%   +1.04%  (p=0.008 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         83.1k ± 1%               82.7k ± 1%     ~     (p=0.222 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         84.9k ± 2%               81.3k ± 2%   -4.30%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go·1                                     8.06k ± 0%               8.23k ± 1%   +2.09%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go·2                                     14.7k ± 1%               15.0k ± 0%   +1.78%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go·3                                     20.3k ± 1%               20.7k ± 0%   +1.91%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go·4                                     24.1k ± 1%               24.9k ± 0%   +3.24%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go·8                                     30.4k ± 1%               30.9k ± 8%     ~     (p=0.151 n=5+5)
    neo/go/sqlite-zwrk.go·12                                    30.8k ± 3%               31.3k ± 1%     ~     (p=0.095 n=5+5)
    neo/go/sqlite-zwrk.go·16                                    30.1k ± 2%               30.6k ± 3%     ~     (p=0.095 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·1                              8.84k ± 0%               9.08k ± 0%   +2.62%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·2                              16.1k ± 1%               16.4k ± 0%   +2.16%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·3                              22.1k ± 1%               22.7k ± 0%   +2.80%  (p=0.016 n=5+4)
    neo/go/sqlite-zwrk.go(!sha1)·4                              26.8k ± 1%               27.8k ± 0%   +3.66%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·8                              33.1k ± 2%               34.6k ± 1%   +4.43%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·12                             32.9k ± 2%               33.5k ± 1%   +1.90%  (p=0.032 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·16                             32.1k ± 2%               32.8k ± 2%     ~     (p=0.095 n=5+5)
    cluster:neo1 dataset:prod1-1024
    fs1-zwrk.go·1                                                453k ± 0%                454k ± 0%     ~     (p=0.063 n=5+4)
    fs1-zwrk.go·2                                                891k ± 0%                869k ± 6%     ~     (p=0.690 n=5+5)
    fs1-zwrk.go·3                                               1.32M ± 3%               1.33M ± 1%     ~     (p=0.548 n=5+5)
    fs1-zwrk.go·4                                               1.77M ± 1%               1.73M ± 2%     ~     (p=0.222 n=5+5)
    fs1-zwrk.go·8                                               2.00M ± 2%               1.99M ± 2%     ~     (p=0.421 n=5+5)
    fs1-zwrk.go·12                                              2.04M ± 0%               2.03M ± 0%   -0.47%  (p=0.029 n=4+4)
    fs1-zwrk.go·16                                              2.03M ± 2%               2.04M ± 0%     ~     (p=0.421 n=5+5)
    zeo/py/fs1-zwrk.go·1                                        5.90k ± 1%               6.83k ± 1%  +15.81%  (p=0.008 n=5+5)
    zeo/py/fs1-zwrk.go·2                                        8.50k ± 0%               8.72k ± 3%     ~     (p=0.151 n=5+5)
    zeo/py/fs1-zwrk.go·3                                        9.32k ± 1%               9.26k ± 6%     ~     (p=0.690 n=5+5)
    zeo/py/fs1-zwrk.go·4                                        9.70k ± 1%               9.78k ± 3%     ~     (p=0.151 n=5+5)
    zeo/py/fs1-zwrk.go·8                                        10.2k ± 2%               10.4k ± 1%   +2.11%  (p=0.032 n=5+5)
    zeo/py/fs1-zwrk.go·12                                       10.4k ± 0%               10.6k ± 1%   +1.42%  (p=0.008 n=5+5)
    zeo/py/fs1-zwrk.go·16                                       10.5k ± 1%               10.5k ± 5%     ~     (p=0.421 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·1                               4.78k ± 3%               5.57k ± 3%  +16.64%  (p=0.008 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·2                               6.42k ± 2%               6.51k ± 1%   +1.40%  (p=0.032 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·3                               6.40k ± 2%               6.39k ± 6%     ~     (p=0.421 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·4                               6.40k ± 1%               6.43k ± 1%     ~     (p=0.310 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·8                               6.39k ± 1%               6.33k ± 2%     ~     (p=0.421 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·12                              6.44k ± 1%               6.30k ± 3%     ~     (p=0.151 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·16                              6.38k ± 1%               6.37k ± 3%     ~     (p=1.000 n=5+5)
    neo/py(!log)/sql-zwrk.go·1                                  3.41k ± 4%               4.34k ± 2%  +27.52%  (p=0.008 n=5+5)
    neo/py(!log)/sql-zwrk.go·2                                  4.14k ± 2%               4.94k ± 4%  +19.38%  (p=0.008 n=5+5)
    neo/py(!log)/sql-zwrk.go·3                                  4.12k ± 1%               4.69k ± 5%  +13.72%  (p=0.008 n=5+5)
    neo/py(!log)/sql-zwrk.go·4                                  4.09k ± 3%               4.78k ± 4%  +16.85%  (p=0.008 n=5+5)
    neo/py(!log)/sql-zwrk.go·8                                  4.18k ± 2%               4.92k ± 1%  +17.77%  (p=0.008 n=5+5)
    neo/py(!log)/sql-zwrk.go·12                                 4.09k ± 2%               4.76k ± 3%  +16.56%  (p=0.008 n=5+5)
    neo/py(!log)/sql-zwrk.go·16                                 4.14k ± 3%               4.90k ± 3%  +18.44%  (p=0.008 n=5+5)
    neo/go/fs1-zwrk.go·1                                        17.2k ± 1%               17.4k ± 1%   +1.23%  (p=0.032 n=5+5)
    neo/go/fs1-zwrk.go·2                                        32.5k ± 1%               32.9k ± 1%   +1.14%  (p=0.008 n=5+5)
    neo/go/fs1-zwrk.go·3                                        43.0k ± 1%               43.5k ± 0%   +0.98%  (p=0.016 n=5+4)
    neo/go/fs1-zwrk.go·4                                        52.7k ± 1%               53.2k ± 0%   +0.94%  (p=0.008 n=5+5)
    neo/go/fs1-zwrk.go·8                                        67.3k ± 1%               67.0k ± 2%     ~     (p=0.421 n=5+5)
    neo/go/fs1-zwrk.go·12                                       64.9k ± 2%               62.6k ± 3%   -3.51%  (p=0.016 n=5+5)
    neo/go/fs1-zwrk.go·16                                       57.3k ± 4%               54.3k ±11%     ~     (p=0.056 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                          20.3k ± 2%               20.2k ± 5%     ~     (p=0.421 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                          40.4k ± 1%               40.8k ± 1%     ~     (p=0.056 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                          51.5k ± 1%               51.9k ± 1%   +0.79%  (p=0.008 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                          62.0k ± 1%               62.7k ± 0%   +1.15%  (p=0.008 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          77.1k ± 2%               75.1k ± 4%     ~     (p=0.151 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         75.3k ± 3%               69.5k ± 1%   -7.81%  (p=0.008 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         63.9k ± 2%               61.0k ± 2%   -4.52%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go·1                                     8.99k ± 0%               9.16k ± 1%   +1.81%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go·2                                     15.8k ± 1%               16.0k ± 0%   +1.04%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go·3                                     21.5k ± 1%               22.1k ± 0%   +2.67%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go·4                                     25.7k ± 1%               26.7k ± 0%   +4.05%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go·8                                     28.7k ± 2%               30.9k ± 2%   +7.45%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go·12                                    27.3k ± 3%               29.5k ± 1%   +8.03%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go·16                                    27.1k ± 2%               29.6k ± 2%   +9.24%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·1                              9.31k ± 0%               9.51k ± 1%   +2.23%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·2                              16.3k ± 0%               16.5k ± 0%   +0.90%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·3                              22.3k ± 1%               22.7k ± 0%   +1.41%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·4                              26.8k ± 1%               27.4k ± 1%   +2.07%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·8                              30.1k ± 0%               31.2k ± 2%   +3.80%  (p=0.016 n=4+5)
    neo/go/sqlite-zwrk.go(!sha1)·12                             28.4k ± 2%               29.5k ± 2%   +3.78%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·16                             27.9k ± 3%               28.8k ±10%     ~     (p=0.151 n=5+5)
    
    name                                           old latency-time/object  new latency-time/object  delta
    cluster:neo1 dataset:wczblk1-8
    fs1-zwrk.go·1                                              4.37µs ± 1%              4.36µs ± 0%     ~     (p=0.548 n=5+5)
    fs1-zwrk.go·2                                              4.48µs ± 1%              4.71µs ± 8%   +5.18%  (p=0.008 n=5+5)
    fs1-zwrk.go·3                                              4.51µs ± 1%              4.55µs ± 1%     ~     (p=0.056 n=5+5)
    fs1-zwrk.go·4                                              4.61µs ± 1%              4.60µs ± 1%     ~     (p=0.603 n=5+4)
    fs1-zwrk.go·8                                              8.10µs ± 1%              8.03µs ± 0%   -0.75%  (p=0.016 n=5+5)
    fs1-zwrk.go·12                                             11.9µs ± 1%              11.8µs ± 0%     ~     (p=1.000 n=5+5)
    fs1-zwrk.go·16                                             15.8µs ± 1%              15.7µs ± 0%     ~     (p=0.206 n=5+5)
    zeo/py/fs1-zwrk.go·1                                        195µs ± 1%               172µs ± 1%  -11.98%  (p=0.008 n=5+5)
    zeo/py/fs1-zwrk.go·2                                        289µs ± 1%               277µs ± 1%   -3.92%  (p=0.008 n=5+5)
    zeo/py/fs1-zwrk.go·3                                        398µs ± 1%               384µs ± 3%   -3.36%  (p=0.008 n=5+5)
    zeo/py/fs1-zwrk.go·4                                        516µs ± 1%               500µs ± 1%   -3.18%  (p=0.008 n=5+5)
    zeo/py/fs1-zwrk.go·8                                        989µs ± 0%               946µs ± 1%   -4.37%  (p=0.008 n=5+5)
    zeo/py/fs1-zwrk.go·12                                      1.42ms ± 0%              1.41ms ± 2%     ~     (p=0.151 n=5+5)
    zeo/py/fs1-zwrk.go·16                                      1.88ms ± 0%              1.88ms ± 2%     ~     (p=0.841 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·1                               230µs ± 1%               191µs ± 2%  -16.86%  (p=0.008 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·2                               316µs ± 2%               317µs ± 2%     ~     (p=0.421 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·3                               483µs ± 4%               474µs ± 1%     ~     (p=0.056 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·4                               640µs ± 1%               635µs ± 3%     ~     (p=0.222 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·8                              1.28ms ± 2%              1.28ms ± 3%     ~     (p=0.548 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·12                             1.92ms ± 2%              1.89ms ± 2%     ~     (p=0.056 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·16                             2.57ms ± 1%              2.53ms ± 2%     ~     (p=0.095 n=5+5)
    neo/py(!log)/sql-zwrk.go·1                                  305µs ± 7%               244µs ± 6%  -19.90%  (p=0.008 n=5+5)
    neo/py(!log)/sql-zwrk.go·2                                  491µs ± 2%               412µs ± 3%  -15.94%  (p=0.008 n=5+5)
    neo/py(!log)/sql-zwrk.go·3                                  740µs ± 2%               625µs ± 4%  -15.61%  (p=0.008 n=5+5)
    neo/py(!log)/sql-zwrk.go·4                                  976µs ± 2%               837µs ± 1%  -14.28%  (p=0.008 n=5+5)
    neo/py(!log)/sql-zwrk.go·8                                 1.98ms ± 2%              1.69ms ± 7%  -14.60%  (p=0.008 n=5+5)
    neo/py(!log)/sql-zwrk.go·12                                2.98ms ± 2%              2.57ms ± 6%  -13.56%  (p=0.008 n=5+5)
    neo/py(!log)/sql-zwrk.go·16                                4.03ms ± 3%              3.42ms ± 9%  -14.95%  (p=0.008 n=5+5)
    neo/go/fs1-zwrk.go·1                                       77.8µs ± 0%              76.7µs ± 1%   -1.36%  (p=0.008 n=5+5)
    neo/go/fs1-zwrk.go·2                                       80.7µs ± 1%              79.9µs ± 1%   -0.99%  (p=0.008 n=5+5)
    neo/go/fs1-zwrk.go·3                                       93.0µs ± 1%              92.5µs ± 0%   -0.51%  (p=0.016 n=5+5)
    neo/go/fs1-zwrk.go·4                                       98.4µs ± 1%              97.9µs ± 0%     ~     (p=0.087 n=5+5)
    neo/go/fs1-zwrk.go·8                                        147µs ± 1%               146µs ± 1%     ~     (p=0.310 n=5+5)
    neo/go/fs1-zwrk.go·12                                       210µs ± 1%               209µs ± 1%     ~     (p=0.841 n=5+5)
    neo/go/fs1-zwrk.go·16                                       274µs ± 1%               287µs ± 1%   +4.40%  (p=0.008 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                         52.3µs ± 1%              51.9µs ± 2%     ~     (p=0.310 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                         53.1µs ± 1%              52.7µs ± 1%     ~     (p=0.056 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                         62.8µs ± 1%              62.2µs ± 0%   -0.99%  (p=0.016 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                         68.3µs ± 1%              67.4µs ± 0%   -1.27%  (p=0.008 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          103µs ± 1%               102µs ± 0%   -1.03%  (p=0.008 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         144µs ± 1%               145µs ± 1%     ~     (p=0.222 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         188µs ± 2%               197µs ± 2%   +4.49%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go·1                                     124µs ± 0%               122µs ± 1%   -2.04%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go·2                                     136µs ± 1%               134µs ± 0%   -1.75%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go·3                                     148µs ± 1%               145µs ± 0%   -1.87%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go·4                                     166µs ± 1%               161µs ± 0%   -3.14%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go·8                                     263µs ± 1%               260µs ± 9%     ~     (p=0.151 n=5+5)
    neo/go/sqlite-zwrk.go·12                                    390µs ± 3%               383µs ± 1%     ~     (p=0.095 n=5+5)
    neo/go/sqlite-zwrk.go·16                                    532µs ± 2%               524µs ± 3%     ~     (p=0.095 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·1                              113µs ± 0%               110µs ± 0%   -2.56%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·2                              125µs ± 1%               122µs ± 0%   -2.11%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·3                              136µs ± 1%               132µs ± 0%   -2.73%  (p=0.016 n=5+4)
    neo/go/sqlite-zwrk.go(!sha1)·4                              149µs ± 1%               144µs ± 0%   -3.53%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·8                              242µs ± 2%               231µs ± 1%   -4.25%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·12                             365µs ± 2%               358µs ± 1%   -1.87%  (p=0.032 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·16                             499µs ± 2%               487µs ± 2%     ~     (p=0.095 n=5+5)
    cluster:neo1 dataset:prod1-1024
    fs1-zwrk.go·1                                              2.21µs ± 0%              2.20µs ± 0%     ~     (p=0.063 n=5+4)
    fs1-zwrk.go·2                                              2.24µs ± 0%              2.31µs ± 6%     ~     (p=0.635 n=5+5)
    fs1-zwrk.go·3                                              2.27µs ± 3%              2.25µs ± 1%     ~     (p=0.476 n=5+5)
    fs1-zwrk.go·4                                              2.27µs ± 1%              2.31µs ± 2%     ~     (p=0.167 n=5+5)
    fs1-zwrk.go·8                                              4.00µs ± 2%              4.02µs ± 2%     ~     (p=0.421 n=5+5)
    fs1-zwrk.go·12                                             5.88µs ± 0%              5.91µs ± 0%   +0.47%  (p=0.029 n=4+4)
    fs1-zwrk.go·16                                             7.83µs ± 0%              7.86µs ± 0%     ~     (p=0.127 n=4+5)
    zeo/py/fs1-zwrk.go·1                                        170µs ± 1%               146µs ± 1%  -13.66%  (p=0.008 n=5+5)
    zeo/py/fs1-zwrk.go·2                                        235µs ± 0%               229µs ± 3%     ~     (p=0.151 n=5+5)
    zeo/py/fs1-zwrk.go·3                                        322µs ± 1%               324µs ± 6%     ~     (p=0.690 n=5+5)
    zeo/py/fs1-zwrk.go·4                                        412µs ± 1%               409µs ± 3%     ~     (p=0.151 n=5+5)
    zeo/py/fs1-zwrk.go·8                                        782µs ± 2%               766µs ± 1%   -2.08%  (p=0.032 n=5+5)
    zeo/py/fs1-zwrk.go·12                                      1.15ms ± 0%              1.13ms ± 1%   -1.39%  (p=0.008 n=5+5)
    zeo/py/fs1-zwrk.go·16                                      1.52ms ± 1%              1.53ms ± 5%     ~     (p=0.421 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·1                               209µs ± 3%               180µs ± 3%  -14.26%  (p=0.008 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·2                               312µs ± 2%               307µs ± 1%   -1.39%  (p=0.032 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·3                               469µs ± 2%               470µs ± 6%     ~     (p=0.421 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·4                               625µs ± 1%               622µs ± 1%     ~     (p=0.310 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·8                              1.25ms ± 1%              1.26ms ± 2%     ~     (p=0.421 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·12                             1.86ms ± 1%              1.91ms ± 3%     ~     (p=0.151 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·16                             2.51ms ± 1%              2.51ms ± 3%     ~     (p=1.000 n=5+5)
    neo/py(!log)/sql-zwrk.go·1                                  294µs ± 4%               230µs ± 2%  -21.61%  (p=0.008 n=5+5)
    neo/py(!log)/sql-zwrk.go·2                                  483µs ± 2%               405µs ± 4%  -16.22%  (p=0.008 n=5+5)
    neo/py(!log)/sql-zwrk.go·3                                  728µs ± 1%               640µs ± 5%  -11.98%  (p=0.008 n=5+5)
    neo/py(!log)/sql-zwrk.go·4                                  978µs ± 3%               837µs ± 4%  -14.42%  (p=0.008 n=5+5)
    neo/py(!log)/sql-zwrk.go·8                                 1.92ms ± 2%              1.63ms ± 1%  -15.10%  (p=0.008 n=5+5)
    neo/py(!log)/sql-zwrk.go·12                                2.94ms ± 2%              2.52ms ± 3%  -14.18%  (p=0.008 n=5+5)
    neo/py(!log)/sql-zwrk.go·16                                3.87ms ± 3%              3.27ms ± 3%  -15.56%  (p=0.008 n=5+5)
    neo/go/fs1-zwrk.go·1                                       58.1µs ± 1%              57.4µs ± 1%   -1.21%  (p=0.032 n=5+5)
    neo/go/fs1-zwrk.go·2                                       61.5µs ± 1%              60.8µs ± 1%   -1.13%  (p=0.008 n=5+5)
    neo/go/fs1-zwrk.go·3                                       69.7µs ± 1%              69.0µs ± 0%   -0.97%  (p=0.016 n=5+4)
    neo/go/fs1-zwrk.go·4                                       75.8µs ± 1%              75.1µs ± 0%   -0.94%  (p=0.008 n=5+5)
    neo/go/fs1-zwrk.go·8                                        119µs ± 2%               119µs ± 2%     ~     (p=0.421 n=5+5)
    neo/go/fs1-zwrk.go·12                                       185µs ± 2%               192µs ± 3%   +3.65%  (p=0.016 n=5+5)
    neo/go/fs1-zwrk.go·16                                       280µs ± 4%               296µs ±12%     ~     (p=0.056 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                         49.4µs ± 2%              49.5µs ± 5%     ~     (p=0.421 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                         49.5µs ± 1%              49.0µs ± 1%     ~     (p=0.056 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                         58.2µs ± 1%              57.8µs ± 1%   -0.78%  (p=0.008 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                         64.5µs ± 1%              63.7µs ± 0%   -1.14%  (p=0.008 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          104µs ± 2%               107µs ± 5%     ~     (p=0.151 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         159µs ± 3%               173µs ± 1%   +8.44%  (p=0.008 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         250µs ± 2%               262µs ± 2%   +4.74%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go·1                                     111µs ± 0%               109µs ± 1%   -1.78%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go·2                                     127µs ± 1%               125µs ± 0%   -1.03%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go·3                                     140µs ± 1%               136µs ± 0%   -2.60%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go·4                                     156µs ± 1%               150µs ± 0%   -3.89%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go·8                                     279µs ± 2%               259µs ± 2%   -6.95%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go·12                                    440µs ± 3%               407µs ± 1%   -7.45%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go·16                                    591µs ± 2%               541µs ± 2%   -8.47%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·1                              107µs ± 0%               105µs ± 1%   -2.18%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·2                              122µs ± 0%               121µs ± 0%   -0.89%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·3                              134µs ± 1%               132µs ± 0%   -1.39%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·4                              149µs ± 1%               146µs ± 1%   -2.03%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·8                              266µs ± 0%               256µs ± 2%   -3.65%  (p=0.016 n=4+5)
    neo/go/sqlite-zwrk.go(!sha1)·12                             423µs ± 2%               407µs ± 2%   -3.65%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·16                             574µs ± 3%               557µs ±10%     ~     (p=0.151 n=5+5)
    23f8d82e
20180308-neo1-ffixed-noc_C1(3µs)-zwrk1s.txt 129 KB