1. 26 Mar, 2018 2 commits
    • Kirill Smelkov's avatar
      X deco: ZEO4 & ZEO5 timings · aa443365
      Kirill Smelkov authored
      aa443365
    • Kirill Smelkov's avatar
      X go/zodb/zeo: Add support for protocols preceding ZEO5 · 60c4ddbe
      Kirill Smelkov authored
      In particular try to support ZEO4:
      
      - during handshake we now first wait for remote server to announce its
        preferred protocol, and only then send the version we select to use.
        This is the procedure original ZEO server-client do.
      
      - teach rpc.call to decode exceptions not only for how ZEO5 encodes them
        (marking via 2 flag in "async" field), but also on how ZEO4 and
        earlier encode them: via replying with (exc_type, exc_inst) and
        expecting client to dynamically check exc_type is a subtype of
        Exception.
      
      - handle other protocol differences - e.g. ZEO5 returns last_tid on
        register(), while earlier versions return nothing there.
      60c4ddbe
  2. 21 Mar, 2018 4 commits
  3. 19 Mar, 2018 1 commit
    • Kirill Smelkov's avatar
      X z6001: localhost timings · 70c63882
      Kirill Smelkov authored
      Similarly to deco, neo1 and rio, neo/go/sqlite is speed-up a bit. And
      everything else close to noise.
      
      ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
      
      $ benchstat -split node,cluster,dataset 20180308-z6001-ffixed-noc_C1\(3µs\)-zwrk1s.txt 20180319-z6001.txt
      
      name                                           old pystone/s            new pystone/s            delta
      node:z6001
      pystone                                                      115k ± 1%                113k ± 1%   -1.35%  (p=0.016 n=5+5)
      
      name                                           old time/op              new time/op              delta
      node:z6001
      crc32/py/4K                                                5.12µs ± 2%              5.13µs ± 3%     ~     (p=1.000 n=5+5)
      crc32/go/4K                                                1.72µs ± 0%              1.76µs ± 5%     ~     (p=0.794 n=4+5)
      sha1/py/4K                                                 14.7µs ± 1%              14.7µs ± 1%     ~     (p=0.841 n=5+5)
      sha1/go/4K                                                 10.3µs ± 0%              12.7µs ±30%     ~     (p=0.079 n=4+5)
      unzlib/py/wczdata                                          36.5µs ± 1%              39.3µs ± 9%     ~     (p=0.548 n=5+5)
      unzlib/go/wczdata                                          31.2µs ± 0%              31.2µs ± 0%     ~     (p=0.222 n=5+5)
      unzlib/py/prod1-avg                                        18.6µs ± 1%              19.6µs ±11%     ~     (p=0.730 n=4+5)
      unzlib/go/prod1-avg                                        9.87µs ± 1%              9.88µs ± 1%     ~     (p=1.000 n=5+5)
      disk/randread/direct/4K-min                                 127µs ± 1%               126µs ± 1%     ~     (p=0.270 n=5+5)
      disk/randread/direct/4K-avg                                 168µs ± 0%               168µs ± 1%     ~     (p=0.151 n=5+5)
      disk/randread/pagecache/4K-min                              788ns ± 1%               784ns ± 1%     ~     (p=0.270 n=5+5)
      disk/randread/pagecache/4K-avg                             1.50µs ± 3%              1.47µs ±10%     ~     (p=0.635 n=5+5)
      
      name                                           old time/object          new time/object          delta
      cluster:z6001 dataset:wczblk1-8
      fs1-zhash.py                                               37.6µs ± 1%              38.1µs ± 2%     ~     (p=0.111 n=5+4)
      fs1-zhash.go                                               5.98µs ± 2%              6.28µs ±19%     ~     (p=0.794 n=5+5)
      fs1-zhash.go+prefetch128                                   7.34µs ± 5%              7.20µs ± 4%     ~     (p=0.603 n=5+5)
      zeo/py/fs1-zhash.py                                         590µs ± 4%               591µs ± 8%     ~     (p=0.421 n=5+5)
      zeo/py/fs1-zhash.go                                         201µs ± 3%               201µs ± 2%     ~     (p=0.841 n=5+5)
      zeo/py/fs1-zhash.go+prefetch128                             102µs ± 2%               102µs ± 1%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                482µs ± 4%               475µs ± 2%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                222µs ± 1%               228µs ± 1%   +2.67%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zhash.go+prefetch128                    179µs ± 2%               180µs ± 2%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zhash.py                                   529µs ± 4%               526µs ± 4%     ~     (p=0.886 n=4+4)
      neo/py(!log)/sql-zhash.go                                   275µs ± 1%               281µs ± 3%     ~     (p=0.087 n=5+5)
      neo/py(!log)/sql-zhash.go+prefetch128                       237µs ± 5%               241µs ± 4%     ~     (p=0.222 n=5+5)
      neo/go/fs1-zhash.py                                         342µs ± 2%               337µs ±12%     ~     (p=0.595 n=5+5)
      neo/go/fs1-zhash.go                                        91.2µs ± 2%              96.1µs ± 9%     ~     (p=0.151 n=5+5)
      neo/go/fs1-zhash.go+prefetch128                            36.6µs ± 2%              35.9µs ± 6%     ~     (p=0.127 n=5+5)
      neo/go/fs1(!sha1)-zhash.go(!sha1)                          68.8µs ± 3%              68.6µs ± 5%     ~     (p=0.841 n=5+5)
      neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1)              26.5µs ± 3%              26.6µs ± 5%     ~     (p=0.897 n=5+5)
      neo/go/sqlite-zhash.py                                      373µs ± 7%               350µs ± 7%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zhash.go                                      143µs ± 3%               117µs ± 2%  -18.18%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128                         39.0µs ± 5%              39.4µs ± 4%     ~     (p=0.635 n=5+5)
      neo/go/sqlite-zhash.go(!sha1)                               133µs ± 5%               107µs ± 1%  -19.65%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128(!sha1)                  36.6µs ± 5%              37.2µs ± 5%     ~     (p=0.452 n=5+5)
      cluster:z6001 dataset:prod1-1024
      fs1-zhash.py                                               30.5µs ± 2%              30.6µs ± 2%     ~     (p=0.794 n=5+4)
      fs1-zhash.go                                               4.60µs ± 0%              4.56µs ± 1%     ~     (p=0.333 n=4+5)
      fs1-zhash.go+prefetch128                                   5.44µs ± 3%              5.24µs ± 5%     ~     (p=0.143 n=5+5)
      zeo/py/fs1-zhash.py                                         555µs ± 2%               545µs ±10%     ~     (p=0.841 n=5+5)
      zeo/py/fs1-zhash.go                                         169µs ± 1%               173µs ± 1%   +2.54%  (p=0.008 n=5+5)
      zeo/py/fs1-zhash.go+prefetch128                            88.4µs ± 2%              88.5µs ± 1%     ~     (p=0.952 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                467µs ± 4%               472µs ± 7%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                205µs ± 0%               209µs ± 0%   +2.27%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zhash.go+prefetch128                    161µs ± 1%               163µs ± 0%   +1.09%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zhash.py                                   518µs ± 2%               581µs ±40%     ~     (p=0.556 n=4+5)
      neo/py(!log)/sql-zhash.go                                   267µs ± 1%               266µs ± 1%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zhash.go+prefetch128                       226µs ± 9%               226µs ± 9%     ~     (p=0.690 n=5+5)
      neo/go/fs1-zhash.py                                         320µs ±11%               311µs ±10%     ~     (p=0.841 n=5+5)
      neo/go/fs1-zhash.go                                        76.3µs ± 3%              75.5µs ± 4%     ~     (p=0.738 n=5+5)
      neo/go/fs1-zhash.go+prefetch128                            23.6µs ± 2%              24.0µs ± 2%     ~     (p=0.151 n=5+5)
      neo/go/fs1(!sha1)-zhash.go(!sha1)                          64.8µs ± 2%              64.9µs ± 3%     ~     (p=0.841 n=5+5)
      neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1)              20.5µs ± 3%              20.9µs ± 2%     ~     (p=0.222 n=5+5)
      neo/go/sqlite-zhash.py                                      378µs ± 4%               325µs ± 8%  -14.16%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.go                                      129µs ± 3%               104µs ± 1%  -18.91%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128                         34.8µs ± 2%              34.4µs ± 3%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zhash.go(!sha1)                               125µs ± 5%               101µs ± 6%  -19.41%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128(!sha1)                  34.5µs ± 1%              34.8µs ± 1%   +1.04%  (p=0.040 n=5+5)
      
      name                                           old req/s                new req/s                delta
      cluster:z6001 dataset:wczblk1-8
      fs1-zwrk.go·1                                                231k ± 1%                228k ± 6%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·2                                                446k ± 2%                446k ± 1%     ~     (p=0.841 n=5+5)
      fs1-zwrk.go·3                                                659k ± 2%                661k ± 2%     ~     (p=0.690 n=5+5)
      fs1-zwrk.go·4                                                876k ± 2%                877k ± 1%     ~     (p=0.841 n=5+5)
      fs1-zwrk.go·8                                               1.75M ± 1%               1.78M ± 1%     ~     (p=0.056 n=5+5)
      fs1-zwrk.go·12                                              2.53M ± 2%               2.55M ± 3%     ~     (p=0.548 n=5+5)
      fs1-zwrk.go·16                                              2.91M ± 1%               2.92M ± 1%     ~     (p=0.841 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        5.14k ± 1%               5.09k ± 1%     ~     (p=0.056 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        6.35k ± 0%               6.38k ± 2%     ~     (p=0.905 n=4+5)
      zeo/py/fs1-zwrk.go·3                                        7.08k ± 0%               6.88k ± 0%   -2.84%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        7.19k ± 2%               7.12k ± 1%     ~     (p=0.095 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        7.54k ± 2%               7.45k ± 2%     ~     (p=0.095 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       7.57k ± 2%               7.65k ± 2%     ~     (p=0.310 n=5+5)
      zeo/py/fs1-zwrk.go·16                                       7.66k ± 2%               7.64k ± 2%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               4.54k ± 1%               4.51k ± 2%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               5.68k ± 2%               5.54k ± 0%   -2.48%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               5.70k ± 2%               5.52k ± 1%   -3.16%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               5.65k ± 1%               5.49k ± 0%   -2.87%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               5.64k ± 1%               5.59k ± 2%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                              5.60k ± 6%               5.39k ± 7%     ~     (p=0.095 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                              5.55k ± 4%               5.56k ± 0%     ~     (p=0.190 n=5+4)
      neo/py(!log)/sql-zwrk.go·1                                  3.62k ± 3%               3.58k ± 3%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  4.26k ± 4%               4.25k ± 1%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  4.29k ± 0%               4.09k ± 5%   -4.61%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  4.21k ± 4%               4.26k ± 1%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                  4.20k ± 1%               4.22k ± 1%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                 4.19k ± 3%               4.18k ± 4%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                 4.21k ± 1%               4.03k ± 4%     ~     (p=0.056 n=5+5)
      neo/go/fs1-zwrk.go·1                                        11.1k ± 3%               11.1k ± 5%     ~     (p=0.690 n=5+5)
      neo/go/fs1-zwrk.go·2                                        23.0k ± 1%               23.0k ± 1%     ~     (p=0.548 n=5+5)
      neo/go/fs1-zwrk.go·3                                        32.2k ± 0%               32.2k ± 1%     ~     (p=1.000 n=5+5)
      neo/go/fs1-zwrk.go·4                                        43.5k ± 0%               43.4k ± 0%     ~     (p=0.548 n=5+5)
      neo/go/fs1-zwrk.go·8                                        78.3k ± 0%               77.9k ± 0%   -0.48%  (p=0.016 n=5+5)
      neo/go/fs1-zwrk.go·12                                       92.5k ± 0%               92.2k ± 0%     ~     (p=0.095 n=5+5)
      neo/go/fs1-zwrk.go·16                                        102k ± 0%                102k ± 0%     ~     (p=0.056 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                          15.0k ± 6%               15.3k ± 7%     ~     (p=0.310 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                          31.8k ± 1%               31.9k ± 0%     ~     (p=0.841 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                          44.1k ± 0%               44.1k ± 0%     ~     (p=0.222 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                          57.9k ± 1%               57.9k ± 0%     ~     (p=0.841 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                           100k ± 0%                100k ± 0%     ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                          116k ± 0%                116k ± 0%     ~     (p=0.841 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                          126k ± 0%                126k ± 0%     ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     7.20k ± 1%               8.71k ± 2%  +20.95%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     13.7k ± 0%               17.0k ± 0%  +24.20%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     20.0k ± 1%               24.7k ± 1%  +23.18%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     25.7k ± 0%               31.5k ± 0%  +22.87%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     45.3k ± 0%               54.1k ± 1%  +19.59%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    56.4k ± 0%               63.1k ± 0%  +11.78%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    58.2k ± 1%               63.7k ± 1%   +9.42%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              7.73k ± 1%               9.66k ± 2%  +24.99%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              14.7k ± 1%               18.7k ± 1%  +27.48%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              21.7k ± 0%               27.7k ± 0%  +27.80%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              28.2k ± 0%               35.3k ± 1%  +25.02%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              49.0k ± 0%               57.4k ± 0%  +17.18%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             60.5k ± 0%               67.6k ± 1%  +11.77%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             61.9k ± 0%               66.9k ± 1%   +8.09%  (p=0.008 n=5+5)
      cluster:z6001 dataset:prod1-1024
      fs1-zwrk.go·1                                                349k ± 1%                353k ± 0%   +1.37%  (p=0.016 n=5+4)
      fs1-zwrk.go·2                                                672k ± 1%                672k ± 3%     ~     (p=0.841 n=5+5)
      fs1-zwrk.go·3                                                982k ± 2%               1000k ± 3%     ~     (p=0.310 n=5+5)
      fs1-zwrk.go·4                                               1.29M ± 7%               1.31M ± 3%     ~     (p=0.548 n=5+5)
      fs1-zwrk.go·8                                               2.53M ± 3%               2.57M ± 2%     ~     (p=0.310 n=5+5)
      fs1-zwrk.go·12                                              3.05M ± 1%               3.07M ± 1%     ~     (p=0.310 n=5+5)
      fs1-zwrk.go·16                                              3.06M ± 1%               3.08M ± 1%     ~     (p=0.310 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        6.13k ± 1%               6.06k ± 3%     ~     (p=0.151 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        8.21k ± 2%               8.11k ± 2%     ~     (p=0.095 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        9.03k ± 2%               8.85k ± 0%   -1.92%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        9.37k ± 2%               9.21k ± 1%   -1.75%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        9.85k ± 5%               9.72k ± 3%     ~     (p=0.548 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       9.57k ± 9%               9.98k ± 0%     ~     (p=0.730 n=5+4)
      zeo/py/fs1-zwrk.go·16                                       10.3k ± 1%               10.0k ± 7%     ~     (p=0.095 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               4.90k ± 1%               4.83k ± 1%     ~     (p=0.056 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               5.90k ± 0%               5.77k ± 0%   -2.16%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               5.86k ± 1%               5.75k ± 0%   -1.78%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               5.75k ± 0%               5.50k ± 8%     ~     (p=0.190 n=4+5)
      neo/py(!log)/sqlite-zwrk.go·8                               5.84k ± 1%               5.74k ± 0%   -1.67%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                              5.51k ± 6%               5.72k ± 1%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                              5.71k ± 1%               5.66k ± 7%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  3.64k ± 7%               3.79k ± 2%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  4.35k ± 0%               4.38k ± 0%   +0.65%  (p=0.029 n=4+4)
      neo/py(!log)/sql-zwrk.go·3                                  4.36k ± 2%               4.36k ± 0%     ~     (p=0.286 n=5+4)
      neo/py(!log)/sql-zwrk.go·4                                  4.32k ± 0%               4.36k ± 0%   +0.93%  (p=0.029 n=4+4)
      neo/py(!log)/sql-zwrk.go·8                                  4.37k ± 1%               4.32k ± 1%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                 4.40k ± 1%               4.32k ± 1%   -1.77%  (p=0.032 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                 4.34k ± 1%               4.28k ± 2%     ~     (p=0.151 n=5+5)
      neo/go/fs1-zwrk.go·1                                        14.2k ± 1%               14.0k ± 3%     ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·2                                        28.5k ± 1%               28.3k ± 1%     ~     (p=0.151 n=5+5)
      neo/go/fs1-zwrk.go·3                                        40.6k ± 0%               40.6k ± 0%     ~     (p=0.310 n=5+5)
      neo/go/fs1-zwrk.go·4                                        53.2k ± 1%               53.0k ± 0%     ~     (p=0.222 n=5+5)
      neo/go/fs1-zwrk.go·8                                        90.1k ± 1%               90.4k ± 1%     ~     (p=0.310 n=5+5)
      neo/go/fs1-zwrk.go·12                                       96.0k ± 1%               95.3k ± 1%     ~     (p=0.310 n=5+5)
      neo/go/fs1-zwrk.go·16                                       91.4k ± 1%               89.7k ± 2%   -1.86%  (p=0.016 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                          16.4k ± 1%               16.5k ± 4%     ~     (p=0.421 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                          33.4k ± 1%               33.3k ± 1%     ~     (p=0.222 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                          46.7k ± 0%               46.5k ± 1%   -0.48%  (p=0.032 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                          60.4k ± 0%               60.3k ± 0%     ~     (p=0.310 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          98.9k ± 1%               99.0k ± 1%     ~     (p=0.841 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                          103k ± 1%                103k ± 1%     ~     (p=0.690 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         97.2k ± 1%               97.0k ± 1%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     7.92k ± 2%               9.85k ± 1%  +24.42%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     14.7k ± 1%               18.9k ± 1%  +28.67%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     21.3k ± 0%               27.4k ± 2%  +28.93%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     27.5k ± 1%               34.7k ± 1%  +26.17%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     44.9k ± 1%               51.8k ± 1%  +15.20%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    52.3k ± 0%               55.7k ± 1%   +6.46%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    48.4k ± 1%               50.8k ± 1%   +4.92%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              8.17k ± 2%              10.11k ± 1%  +23.70%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              15.2k ± 1%               19.6k ± 0%  +29.40%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              22.0k ± 0%               28.5k ± 0%  +29.64%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              28.2k ± 0%               36.1k ± 0%  +27.93%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              45.3k ± 0%               52.9k ± 1%  +16.77%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             52.0k ± 1%               57.1k ± 1%   +9.93%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             48.4k ± 1%               51.5k ± 1%   +6.45%  (p=0.008 n=5+5)
      
      name                                           old latency-time/object  new latency-time/object  delta
      cluster:z6001 dataset:wczblk1-8
      fs1-zwrk.go·1                                              4.33µs ± 1%              4.39µs ± 6%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·2                                              4.49µs ± 2%              4.49µs ± 1%     ~     (p=0.841 n=5+5)
      fs1-zwrk.go·3                                              4.56µs ± 2%              4.54µs ± 2%     ~     (p=0.690 n=5+5)
      fs1-zwrk.go·4                                              4.57µs ± 2%              4.56µs ± 1%     ~     (p=0.841 n=5+5)
      fs1-zwrk.go·8                                              4.56µs ± 1%              4.50µs ± 1%     ~     (p=0.056 n=5+5)
      fs1-zwrk.go·12                                             4.75µs ± 2%              4.70µs ± 3%     ~     (p=0.548 n=5+5)
      fs1-zwrk.go·16                                             5.49µs ± 1%              5.48µs ± 1%     ~     (p=0.841 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        195µs ± 1%               196µs ± 1%     ~     (p=0.056 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        315µs ± 0%               313µs ± 2%     ~     (p=0.905 n=4+5)
      zeo/py/fs1-zwrk.go·3                                        424µs ± 0%               436µs ± 0%   +2.93%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        556µs ± 2%               562µs ± 1%     ~     (p=0.095 n=5+5)
      zeo/py/fs1-zwrk.go·8                                       1.06ms ± 2%              1.07ms ± 2%     ~     (p=0.095 n=5+5)
      zeo/py/fs1-zwrk.go·12                                      1.58ms ± 2%              1.57ms ± 2%     ~     (p=0.310 n=5+5)
      zeo/py/fs1-zwrk.go·16                                      2.09ms ± 2%              2.10ms ± 2%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               220µs ± 1%               222µs ± 2%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               352µs ± 2%               361µs ± 0%   +2.53%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               526µs ± 2%               543µs ± 1%   +3.26%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               708µs ± 1%               729µs ± 0%   +2.94%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                              1.42ms ± 1%              1.43ms ± 2%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                             2.15ms ± 6%              2.23ms ± 8%     ~     (p=0.095 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                             2.89ms ± 4%              2.88ms ± 0%     ~     (p=0.190 n=5+4)
      neo/py(!log)/sql-zwrk.go·1                                  276µs ± 3%               279µs ± 3%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  470µs ± 4%               470µs ± 1%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  699µs ± 0%               734µs ± 5%   +4.97%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  950µs ± 5%               938µs ± 1%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                 1.91ms ± 1%              1.89ms ± 1%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                2.87ms ± 3%              2.87ms ± 4%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                3.80ms ± 1%              3.97ms ± 5%     ~     (p=0.056 n=5+5)
      neo/go/fs1-zwrk.go·1                                       90.5µs ± 3%              90.5µs ± 5%     ~     (p=0.690 n=5+5)
      neo/go/fs1-zwrk.go·2                                       86.9µs ± 1%              87.1µs ± 1%     ~     (p=0.548 n=5+5)
      neo/go/fs1-zwrk.go·3                                       93.2µs ± 0%              93.2µs ± 1%     ~     (p=1.000 n=5+5)
      neo/go/fs1-zwrk.go·4                                       91.9µs ± 0%              92.1µs ± 0%     ~     (p=0.548 n=5+5)
      neo/go/fs1-zwrk.go·8                                        102µs ± 0%               103µs ± 0%   +0.48%  (p=0.016 n=5+5)
      neo/go/fs1-zwrk.go·12                                       130µs ± 0%               130µs ± 0%     ~     (p=0.095 n=5+5)
      neo/go/fs1-zwrk.go·16                                       156µs ± 0%               157µs ± 0%     ~     (p=0.056 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                         66.6µs ± 6%              65.3µs ± 8%     ~     (p=0.310 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                         62.9µs ± 1%              62.8µs ± 0%     ~     (p=0.841 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                         68.0µs ± 0%              68.1µs ± 0%     ~     (p=0.222 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                         69.0µs ± 1%              69.1µs ± 0%     ~     (p=0.841 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                         79.8µs ± 0%              79.8µs ± 0%     ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         103µs ± 0%               103µs ± 0%     ~     (p=0.841 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         127µs ± 0%               127µs ± 0%     ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     139µs ± 1%               115µs ± 2%  -17.32%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     147µs ± 0%               118µs ± 0%  -19.49%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     150µs ± 1%               122µs ± 1%  -18.81%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     156µs ± 0%               127µs ± 0%  -18.61%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     177µs ± 0%               148µs ± 1%  -16.38%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    213µs ± 0%               190µs ± 0%  -10.54%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    275µs ± 1%               251µs ± 1%   -8.61%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              129µs ± 1%               103µs ± 2%  -19.99%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              136µs ± 1%               107µs ± 0%  -21.56%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              138µs ± 0%               108µs ± 0%  -21.75%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              142µs ± 0%               113µs ± 1%  -20.01%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              163µs ± 0%               139µs ± 0%  -14.66%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             198µs ± 0%               178µs ± 1%  -10.53%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             259µs ± 0%               239µs ± 1%   -7.48%  (p=0.008 n=5+5)
      cluster:z6001 dataset:prod1-1024
      fs1-zwrk.go·1                                              2.87µs ± 1%              2.83µs ± 0%   -1.35%  (p=0.016 n=5+4)
      fs1-zwrk.go·2                                              2.98µs ± 1%              2.98µs ± 3%     ~     (p=0.841 n=5+5)
      fs1-zwrk.go·3                                              3.05µs ± 2%              3.00µs ± 3%     ~     (p=0.310 n=5+5)
      fs1-zwrk.go·4                                              3.10µs ± 7%              3.05µs ± 3%     ~     (p=0.500 n=5+5)
      fs1-zwrk.go·8                                              3.16µs ± 3%              3.11µs ± 2%     ~     (p=0.310 n=5+5)
      fs1-zwrk.go·12                                             3.94µs ± 1%              3.91µs ± 1%     ~     (p=0.310 n=5+5)
      fs1-zwrk.go·16                                             5.23µs ± 1%              5.20µs ± 1%     ~     (p=0.310 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        163µs ± 1%               165µs ± 3%     ~     (p=0.151 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        244µs ± 2%               246µs ± 2%     ~     (p=0.095 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        332µs ± 2%               339µs ± 0%   +1.94%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        427µs ± 2%               434µs ± 1%   +1.78%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        813µs ± 5%               823µs ± 3%     ~     (p=0.548 n=5+5)
      zeo/py/fs1-zwrk.go·12                                      1.26ms ± 9%              1.20ms ± 0%     ~     (p=0.730 n=5+4)
      zeo/py/fs1-zwrk.go·16                                      1.55ms ± 1%              1.60ms ± 8%     ~     (p=0.095 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               204µs ± 1%               207µs ± 1%     ~     (p=0.056 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               339µs ± 0%               347µs ± 0%   +2.21%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               512µs ± 1%               522µs ± 0%   +1.80%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               695µs ± 0%               730µs ± 9%     ~     (p=0.190 n=4+5)
      neo/py(!log)/sqlite-zwrk.go·8                              1.37ms ± 1%              1.39ms ± 0%   +1.68%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                             2.18ms ± 6%              2.10ms ± 1%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                             2.80ms ± 1%              2.83ms ± 8%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  275µs ± 7%               264µs ± 2%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  460µs ± 0%               457µs ± 0%   -0.64%  (p=0.029 n=4+4)
      neo/py(!log)/sql-zwrk.go·3                                  689µs ± 1%               688µs ± 0%     ~     (p=0.286 n=5+4)
      neo/py(!log)/sql-zwrk.go·4                                  927µs ± 0%               918µs ± 0%   -0.92%  (p=0.029 n=4+4)
      neo/py(!log)/sql-zwrk.go·8                                 1.83ms ± 1%              1.85ms ± 1%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                2.73ms ± 1%              2.78ms ± 1%   +1.81%  (p=0.032 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                3.69ms ± 1%              3.74ms ± 2%     ~     (p=0.151 n=5+5)
      neo/go/fs1-zwrk.go·1                                       70.2µs ± 1%              71.4µs ± 3%     ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·2                                       70.3µs ± 1%              70.8µs ± 1%     ~     (p=0.151 n=5+5)
      neo/go/fs1-zwrk.go·3                                       73.8µs ± 0%              74.0µs ± 0%     ~     (p=0.310 n=5+5)
      neo/go/fs1-zwrk.go·4                                       75.2µs ± 1%              75.4µs ± 0%     ~     (p=0.222 n=5+5)
      neo/go/fs1-zwrk.go·8                                       88.8µs ± 1%              88.5µs ± 1%     ~     (p=0.310 n=5+5)
      neo/go/fs1-zwrk.go·12                                       125µs ± 1%               126µs ± 1%     ~     (p=0.310 n=5+5)
      neo/go/fs1-zwrk.go·16                                       175µs ± 1%               178µs ± 2%   +1.89%  (p=0.016 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                         61.1µs ± 1%              60.8µs ± 4%     ~     (p=0.421 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                         59.8µs ± 1%              60.1µs ± 1%     ~     (p=0.222 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                         64.2µs ± 0%              64.5µs ± 1%   +0.49%  (p=0.032 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                         66.2µs ± 0%              66.3µs ± 0%     ~     (p=0.310 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                         80.9µs ± 1%              80.8µs ± 1%     ~     (p=0.841 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         117µs ± 1%               116µs ± 1%     ~     (p=0.690 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         165µs ± 1%               165µs ± 1%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     126µs ± 2%               102µs ± 1%  -19.63%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     136µs ± 1%               106µs ± 1%  -22.28%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     141µs ± 0%               109µs ± 1%  -22.43%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     145µs ± 1%               115µs ± 1%  -20.75%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     178µs ± 1%               155µs ± 1%  -13.19%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    229µs ± 0%               215µs ± 1%   -6.06%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    331µs ± 1%               315µs ± 1%   -4.68%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              122µs ± 2%                99µs ± 1%  -19.17%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              132µs ± 1%               102µs ± 0%  -22.72%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              136µs ± 0%               105µs ± 0%  -22.86%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              142µs ± 0%               111µs ± 0%  -21.83%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              177µs ± 0%               151µs ± 1%  -14.36%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             231µs ± 1%               210µs ± 1%   -9.03%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             331µs ± 1%               311µs ± 1%   -6.06%  (p=0.008 n=5+5)
      70c63882
  4. 18 Mar, 2018 6 commits
    • Kirill Smelkov's avatar
      . · 41c7bf5d
      Kirill Smelkov authored
      41c7bf5d
    • Kirill Smelkov's avatar
      X rio: localhost timings · 6b816d6f
      Kirill Smelkov authored
      Similarly to deco and neo1, neo/go/sqlite is speed-up a bit. And
      everything else is within noise.
      
      ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
      
      $ benchstat -split node,cluster,dataset  20180308-rio-ffixed-noc_C1\(1µs\)-zwrk1s.txt 20180318-rio.txt
      
      name                                           old pystone/s            new pystone/s            delta
      node:rio
      pystone                                                      142k ± 3%                144k ± 2%     ~     (p=0.548 n=5+5)
      
      name                                           old time/op              new time/op              delta
      node:rio
      crc32/py/4K                                                4.77µs ± 1%              4.81µs ± 1%     ~     (p=0.056 n=5+5)
      crc32/go/4K                                                1.49µs ± 0%              1.49µs ± 0%   -0.21%  (p=0.032 n=5+5)
      sha1/py/4K                                                 8.07µs ± 4%              7.99µs ± 2%     ~     (p=0.246 n=5+5)
      sha1/go/4K                                                 8.93µs ± 0%              8.93µs ± 0%     ~     (p=0.667 n=4+5)
      unzlib/py/wczdata                                          25.1µs ± 1%              25.2µs ± 0%     ~     (p=0.548 n=5+5)
      unzlib/go/wczdata                                          22.9µs ± 0%              22.8µs ± 0%   -0.14%  (p=0.032 n=5+5)
      unzlib/py/prod1-avg                                        6.85µs ±25%              7.25µs ± 1%     ~     (p=0.905 n=5+4)
      unzlib/go/prod1-avg                                        5.02µs ± 1%              5.01µs ± 0%     ~     (p=0.349 n=5+5)
      disk/randread/direct/4K-min                                93.4µs ± 0%              92.0µs ± 0%   -1.48%  (p=0.016 n=5+4)
      disk/randread/direct/4K-avg                                 116µs ± 0%               115µs ± 0%   -0.81%  (p=0.008 n=5+5)
      disk/randread/pagecache/4K-min                              570ns ± 1%               567ns ± 1%     ~     (p=0.690 n=5+5)
      disk/randread/pagecache/4K-avg                             1.00µs ± 1%              1.00µs ± 1%     ~     (p=0.214 n=5+5)
      
      name                                           old time/object          new time/object          delta
      cluster:rio dataset:wczblk1-8
      fs1-zhash.py                                               29.0µs ± 2%              29.0µs ± 2%     ~     (p=0.905 n=5+4)
      fs1-zhash.go                                               4.60µs ± 0%              4.70µs ± 0%   +2.17%  (p=0.029 n=4+4)
      fs1-zhash.go+prefetch128                                   4.62µs ± 5%              4.44µs ± 4%     ~     (p=0.071 n=5+5)
      zeo/py/fs1-zhash.py                                         375µs ± 2%               377µs ± 4%     ~     (p=0.841 n=5+5)
      zeo/py/fs1-zhash.go                                         135µs ± 1%               137µs ± 2%     ~     (p=0.151 n=5+5)
      zeo/py/fs1-zhash.go+prefetch128                            73.6µs ± 3%              76.6µs ± 4%   +4.13%  (p=0.032 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                315µs ± 6%               310µs ± 7%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                155µs ± 5%               149µs ± 4%     ~     (p=0.056 n=5+5)
      neo/py(!log)/sqlite-zhash.go+prefetch128                    126µs ± 1%               122µs ± 2%   -3.13%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zhash.py                                   376µs ±41%               380µs ±55%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sql-zhash.go                                   183µs ± 2%               179µs ± 7%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zhash.go+prefetch128                       161µs ± 3%               152µs ± 2%   -5.56%  (p=0.008 n=5+5)
      neo/go/fs1-zhash.py                                         216µs ± 1%               215µs ±12%     ~     (p=0.135 n=5+5)
      neo/go/fs1-zhash.go                                        67.9µs ± 1%              65.9µs ± 1%   -2.95%  (p=0.008 n=5+5)
      neo/go/fs1-zhash.go+prefetch128                            28.4µs ± 5%              28.3µs ± 2%     ~     (p=0.476 n=5+5)
      neo/go/fs1(!sha1)-zhash.go(!sha1)                          44.1µs ± 4%              41.3µs ± 3%   -6.26%  (p=0.016 n=5+5)
      neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1)              19.1µs ± 6%              18.4µs ± 4%     ~     (p=0.254 n=5+5)
      neo/go/sqlite-zhash.py                                      252µs ± 1%               234µs ± 4%   -6.95%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.go                                      103µs ± 3%                80µs ± 3%  -21.74%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128                         38.0µs ± 9%              33.7µs ± 2%  -11.22%  (p=0.016 n=5+5)
      neo/go/sqlite-zhash.go(!sha1)                              93.0µs ± 2%              72.7µs ± 2%  -21.79%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128(!sha1)                  33.4µs ± 3%              32.7µs ± 2%     ~     (p=0.111 n=5+5)
      cluster:rio dataset:prod1-1024
      fs1-zhash.py                                               23.8µs ± 2%              24.0µs ± 1%     ~     (p=0.381 n=5+4)
      fs1-zhash.go                                               3.40µs ± 0%              3.40µs ± 0%     ~     (all equal)
      fs1-zhash.go+prefetch128                                   3.16µs ± 8%              3.00µs ± 7%     ~     (p=0.159 n=5+5)
      zeo/py/fs1-zhash.py                                         346µs ± 2%               348µs ± 8%     ~     (p=0.690 n=5+5)
      zeo/py/fs1-zhash.go                                         114µs ± 1%               112µs ± 1%     ~     (p=0.063 n=5+5)
      zeo/py/fs1-zhash.go+prefetch128                            64.4µs ± 2%              64.3µs ± 1%     ~     (p=0.881 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                291µs ± 0%               308µs ± 7%   +6.03%  (p=0.016 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                142µs ± 2%               145µs ± 2%     ~     (p=0.167 n=5+5)
      neo/py(!log)/sqlite-zhash.go+prefetch128                    117µs ± 1%               117µs ± 2%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zhash.py                                   374µs ±41%               381µs ±49%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zhash.go                                   173µs ± 8%               165µs ± 1%   -4.65%  (p=0.016 n=5+5)
      neo/py(!log)/sql-zhash.go+prefetch128                       148µs ± 2%               147µs ± 2%     ~     (p=0.310 n=5+5)
      neo/go/fs1-zhash.py                                         210µs ± 3%               204µs ± 3%     ~     (p=0.151 n=5+5)
      neo/go/fs1-zhash.go                                        50.2µs ± 2%              46.9µs ± 1%   -6.61%  (p=0.008 n=5+5)
      neo/go/fs1-zhash.go+prefetch128                            19.4µs ± 2%              18.9µs ± 5%     ~     (p=0.246 n=5+5)
      neo/go/fs1(!sha1)-zhash.go(!sha1)                          40.6µs ± 2%              39.2µs ± 2%   -3.50%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1)              15.8µs ± 2%              15.4µs ± 3%     ~     (p=0.095 n=5+5)
      neo/go/sqlite-zhash.py                                      262µs ± 4%               229µs ± 2%  -12.50%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.go                                     93.8µs ± 1%              70.7µs ± 1%  -24.57%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128                         33.4µs ± 6%              30.3µs ± 2%   -9.29%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.go(!sha1)                              90.9µs ± 4%              67.9µs ± 1%  -25.30%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128(!sha1)                  33.2µs ± 2%              30.8µs ± 2%   -7.41%  (p=0.008 n=5+5)
      
      name                                           old req/s                new req/s                delta
      cluster:rio dataset:wczblk1-8
      fs1-zwrk.go·1                                                301k ± 1%                303k ± 0%   +0.54%  (p=0.008 n=5+5)
      fs1-zwrk.go·2                                                551k ± 0%                552k ± 1%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·3                                                814k ± 0%                815k ± 0%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·4                                               1.08M ± 1%               1.08M ± 0%     ~     (p=0.421 n=5+5)
      fs1-zwrk.go·8                                               1.43M ± 0%               1.42M ± 0%     ~     (p=0.421 n=5+5)
      fs1-zwrk.go·12                                              1.55M ± 0%               1.55M ± 0%   +0.43%  (p=0.032 n=5+5)
      fs1-zwrk.go·16                                              1.54M ± 0%               1.55M ± 0%     ~     (p=0.421 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        7.50k ± 1%               7.37k ± 1%   -1.70%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        8.89k ± 2%               8.81k ± 2%     ~     (p=0.421 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        9.61k ± 1%               9.62k ± 1%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        9.92k ± 1%               9.92k ± 1%     ~     (p=0.690 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        10.2k ± 2%               10.2k ± 1%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       10.6k ± 1%               10.3k ± 0%   -2.66%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·16                                       10.5k ± 1%               10.4k ± 2%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               6.70k ± 2%               6.83k ± 4%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               8.54k ± 0%               8.53k ± 4%     ~     (p=0.190 n=4+5)
      neo/py(!log)/sqlite-zwrk.go·3                               8.43k ± 1%               8.51k ± 2%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               8.37k ± 4%               8.50k ± 4%     ~     (p=0.222 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               8.44k ± 0%               8.55k ± 2%     ~     (p=0.190 n=4+5)
      neo/py(!log)/sqlite-zwrk.go·12                              8.23k ± 5%               8.38k ± 9%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                              8.46k ± 1%               8.42k ± 9%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  5.66k ± 2%               5.72k ± 3%     ~     (p=0.222 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  6.75k ± 2%               6.86k ± 3%     ~     (p=0.222 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  6.68k ± 2%               6.71k ± 4%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  6.70k ± 2%               6.80k ± 3%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                  6.50k ± 5%               6.88k ± 1%   +5.87%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                 6.67k ± 2%               6.90k ± 2%   +3.41%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                 6.72k ± 3%               6.77k ± 2%     ~     (p=0.548 n=5+5)
      neo/go/fs1-zwrk.go·1                                        15.7k ± 0%               16.1k ± 0%   +2.89%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·2                                        30.2k ± 0%               31.0k ± 1%   +2.68%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·3                                        39.8k ± 0%               40.6k ± 0%   +2.02%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·4                                        49.7k ± 0%               51.0k ± 0%   +2.64%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·8                                        68.8k ± 0%               70.0k ± 0%   +1.84%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·12                                       73.0k ± 0%               74.1k ± 0%   +1.54%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·16                                       73.7k ± 0%               74.8k ± 0%   +1.44%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                          25.5k ± 3%               26.5k ± 1%   +4.12%  (p=0.016 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                          47.9k ± 0%               48.8k ± 0%   +1.85%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                          59.7k ± 0%               61.8k ± 0%   +3.48%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                          72.7k ± 0%               75.4k ± 0%   +3.76%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          97.0k ± 0%               99.4k ± 1%   +2.52%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                          110k ± 0%                113k ± 0%   +2.58%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                          113k ± 1%                115k ± 1%   +1.86%  (p=0.016 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     10.0k ± 1%               12.7k ± 1%  +28.02%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     18.4k ± 0%               23.9k ± 1%  +29.46%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     25.5k ± 0%               31.6k ± 0%  +24.11%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     30.4k ± 0%               38.2k ± 0%  +25.76%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     39.4k ± 1%               47.1k ± 1%  +19.51%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    40.7k ± 2%               47.1k ± 2%  +15.72%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    40.8k ± 2%               46.7k ± 2%  +14.50%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              11.1k ± 0%               14.6k ± 1%  +31.01%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              20.1k ± 0%               26.3k ± 0%  +30.98%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              27.9k ± 0%               37.0k ± 0%  +32.82%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              34.2k ± 0%               43.7k ± 0%  +27.80%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              44.0k ± 1%               51.2k ± 1%  +16.37%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             43.4k ± 2%               49.4k ± 3%  +14.01%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             41.4k ± 2%               46.6k ± 4%  +12.52%  (p=0.008 n=5+5)
      cluster:rio dataset:prod1-1024
      fs1-zwrk.go·1                                                461k ± 1%                464k ± 1%     ~     (p=0.222 n=5+5)
      fs1-zwrk.go·2                                                906k ± 1%                918k ± 1%     ~     (p=0.056 n=5+5)
      fs1-zwrk.go·3                                               1.35M ± 0%               1.36M ± 0%   +1.14%  (p=0.008 n=5+5)
      fs1-zwrk.go·4                                               1.78M ± 1%               1.80M ± 2%     ~     (p=0.222 n=5+5)
      fs1-zwrk.go·8                                               2.33M ± 1%               2.37M ± 1%   +1.78%  (p=0.016 n=5+5)
      fs1-zwrk.go·12                                              2.40M ± 0%               2.41M ± 0%     ~     (p=0.548 n=5+5)
      fs1-zwrk.go·16                                              2.40M ± 0%               2.41M ± 1%     ~     (p=0.056 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        9.06k ± 1%               9.19k ± 1%     ~     (p=0.056 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        11.7k ± 2%               11.7k ± 2%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        12.9k ± 1%               12.8k ± 2%     ~     (p=0.690 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        13.4k ± 3%               13.4k ± 1%     ~     (p=0.690 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        13.9k ± 2%               14.1k ± 2%     ~     (p=0.310 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       14.2k ± 2%               14.3k ± 2%     ~     (p=0.421 n=5+5)
      zeo/py/fs1-zwrk.go·16                                       14.4k ± 1%               14.3k ± 3%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               7.28k ± 2%               7.19k ± 3%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               8.70k ± 3%               8.54k ± 1%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               8.73k ± 3%               8.54k ± 1%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               8.69k ± 1%               8.59k ± 1%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               8.77k ± 2%               8.51k ± 2%   -2.93%  (p=0.032 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                              8.59k ± 7%               8.51k ± 2%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                              8.67k ± 1%               8.39k ± 5%   -3.20%  (p=0.032 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  5.98k ± 1%               6.02k ± 4%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  6.86k ± 4%               6.91k ± 3%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  6.86k ± 3%               6.93k ± 2%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  6.90k ± 1%               6.88k ± 2%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                  6.62k ± 6%               6.77k ± 6%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                 6.78k ± 2%               6.75k ± 6%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                 6.78k ± 3%               6.78k ± 7%     ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·1                                        21.6k ± 0%               22.7k ± 0%   +5.46%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·2                                        39.0k ± 0%               40.5k ± 0%   +3.84%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·3                                        51.0k ± 1%               52.9k ± 0%   +3.74%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·4                                        62.3k ± 0%               64.7k ± 0%   +3.96%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·8                                        79.7k ± 1%               81.5k ± 1%   +2.27%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·12                                       81.8k ± 2%               80.3k ± 3%     ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·16                                       80.8k ± 3%               77.8k ± 3%   -3.71%  (p=0.032 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                          26.9k ± 1%               26.9k ± 1%     ~     (p=0.690 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                          49.3k ± 0%               51.3k ± 0%   +4.00%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                          62.3k ± 0%               65.4k ± 1%   +4.82%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                          74.7k ± 0%               78.6k ± 0%   +5.26%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          93.5k ± 2%               96.7k ± 1%   +3.44%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         96.9k ± 2%               99.2k ± 4%     ~     (p=0.095 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         94.5k ± 3%               94.2k ± 3%     ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     11.0k ± 0%               14.7k ± 0%  +33.72%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     19.3k ± 0%               25.2k ± 0%  +30.66%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     26.4k ± 0%               34.6k ± 1%  +30.78%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     31.8k ± 0%               40.3k ± 0%  +26.68%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     38.6k ± 1%               41.4k ± 3%   +7.22%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    36.5k ± 2%               38.7k ± 3%   +5.82%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    36.0k ± 1%               37.9k ± 3%   +5.33%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              11.4k ± 0%               15.7k ± 1%  +37.97%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              19.9k ± 0%               26.9k ± 0%  +35.56%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              27.4k ± 0%               37.6k ± 0%  +37.02%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              33.3k ± 0%               43.6k ± 1%  +31.11%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              38.8k ± 2%               45.2k ± 2%  +16.46%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             36.0k ± 2%               41.5k ± 2%  +15.07%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             35.4k ± 1%               40.5k ± 1%  +14.47%  (p=0.008 n=5+5)
      
      name                                           old latency-time/object  new latency-time/object  delta
      cluster:rio dataset:wczblk1-8
      fs1-zwrk.go·1                                              3.32µs ± 1%              3.30µs ± 0%   -0.55%  (p=0.008 n=5+5)
      fs1-zwrk.go·2                                              3.63µs ± 0%              3.63µs ± 1%     ~     (p=0.738 n=5+5)
      fs1-zwrk.go·3                                              3.69µs ± 0%              3.68µs ± 0%     ~     (p=0.952 n=5+5)
      fs1-zwrk.go·4                                              3.70µs ± 1%              3.70µs ± 0%     ~     (p=0.460 n=5+5)
      fs1-zwrk.go·8                                              5.61µs ± 0%              5.62µs ± 0%     ~     (p=0.421 n=5+5)
      fs1-zwrk.go·12                                             7.76µs ± 0%              7.73µs ± 0%   -0.43%  (p=0.032 n=5+5)
      fs1-zwrk.go·16                                             10.4µs ± 0%              10.3µs ± 0%     ~     (p=0.381 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        133µs ± 1%               136µs ± 1%   +1.72%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        225µs ± 2%               227µs ± 2%     ~     (p=0.421 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        312µs ± 1%               312µs ± 1%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        403µs ± 1%               403µs ± 1%     ~     (p=0.690 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        781µs ± 2%               785µs ± 1%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zwrk.go·12                                      1.13ms ± 1%              1.16ms ± 0%   +2.73%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·16                                      1.52ms ± 1%              1.54ms ± 2%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               149µs ± 2%               146µs ± 4%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               234µs ± 0%               235µs ± 4%     ~     (p=0.190 n=4+5)
      neo/py(!log)/sqlite-zwrk.go·3                               356µs ± 1%               353µs ± 2%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               478µs ± 4%               471µs ± 4%     ~     (p=0.222 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               948µs ± 0%               936µs ± 2%     ~     (p=0.190 n=4+5)
      neo/py(!log)/sqlite-zwrk.go·12                             1.46ms ± 5%              1.40ms ± 1%   -3.91%  (p=0.016 n=5+4)
      neo/py(!log)/sqlite-zwrk.go·16                             1.89ms ± 1%              1.86ms ± 1%   -1.63%  (p=0.016 n=5+4)
      neo/py(!log)/sql-zwrk.go·1                                  177µs ± 2%               175µs ± 3%     ~     (p=0.222 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  297µs ± 2%               292µs ± 3%     ~     (p=0.222 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  449µs ± 2%               447µs ± 4%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  597µs ± 2%               589µs ± 3%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                 1.23ms ± 5%              1.16ms ± 1%   -5.61%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                1.80ms ± 2%              1.74ms ± 2%   -3.31%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                2.38ms ± 3%              2.36ms ± 2%     ~     (p=0.548 n=5+5)
      neo/go/fs1-zwrk.go·1                                       63.9µs ± 0%              62.1µs ± 0%   -2.81%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·2                                       66.2µs ± 0%              64.5µs ± 1%   -2.61%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·3                                       75.5µs ± 0%              74.0µs ± 0%   -1.98%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·4                                       80.6µs ± 0%              78.5µs ± 0%   -2.57%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·8                                        116µs ± 0%               114µs ± 0%   -1.81%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·12                                       164µs ± 0%               162µs ± 0%   -1.52%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·16                                       217µs ± 0%               214µs ± 0%   -1.42%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                         39.3µs ± 3%              37.7µs ± 1%   -3.99%  (p=0.016 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                         41.7µs ± 0%              41.0µs ± 0%   -1.82%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                         50.3µs ± 0%              48.6µs ± 0%   -3.36%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                         55.0µs ± 0%              53.0µs ± 0%   -3.63%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                         82.5µs ± 0%              80.5µs ± 1%   -2.46%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         109µs ± 0%               107µs ± 0%   -2.51%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         141µs ± 1%               139µs ± 1%   -1.83%  (p=0.016 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     100µs ± 1%                78µs ± 1%  -21.89%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     108µs ± 0%                84µs ± 1%  -22.76%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     118µs ± 0%                95µs ± 0%  -19.43%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     132µs ± 0%               105µs ± 0%  -20.48%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     203µs ± 1%               170µs ± 1%  -16.32%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    295µs ± 2%               255µs ± 2%  -13.58%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    393µs ± 2%               343µs ± 3%  -12.65%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                             89.9µs ± 0%              68.7µs ± 1%  -23.67%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              100µs ± 0%                76µs ± 0%  -23.65%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              108µs ± 0%                81µs ± 0%  -24.71%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              117µs ± 0%                92µs ± 0%  -21.75%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              182µs ± 1%               156µs ± 1%  -14.07%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             277µs ± 2%               243µs ± 3%  -12.27%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             386µs ± 2%               343µs ± 4%  -11.10%  (p=0.008 n=5+5)
      cluster:rio dataset:prod1-1024
      fs1-zwrk.go·1                                              2.17µs ± 1%              2.16µs ± 1%     ~     (p=0.222 n=5+5)
      fs1-zwrk.go·2                                              2.21µs ± 1%              2.18µs ± 1%     ~     (p=0.063 n=5+5)
      fs1-zwrk.go·3                                              2.23µs ± 0%              2.20µs ± 0%   -1.12%  (p=0.008 n=5+5)
      fs1-zwrk.go·4                                              2.24µs ± 1%              2.23µs ± 2%     ~     (p=0.222 n=5+5)
      fs1-zwrk.go·8                                              3.43µs ± 1%              3.37µs ± 1%   -1.75%  (p=0.016 n=5+5)
      fs1-zwrk.go·12                                             4.99µs ± 0%              4.99µs ± 0%     ~     (p=0.548 n=5+5)
      fs1-zwrk.go·16                                             6.65µs ± 0%              6.63µs ± 1%     ~     (p=0.056 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        110µs ± 1%               109µs ± 1%     ~     (p=0.056 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        171µs ± 2%               171µs ± 2%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        233µs ± 1%               234µs ± 2%     ~     (p=0.690 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        300µs ± 3%               300µs ± 1%     ~     (p=0.690 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        574µs ± 2%               566µs ± 2%     ~     (p=0.310 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       844µs ± 2%               840µs ± 2%     ~     (p=0.421 n=5+5)
      zeo/py/fs1-zwrk.go·16                                      1.11ms ± 1%              1.12ms ± 3%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               137µs ± 2%               139µs ± 3%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               230µs ± 3%               234µs ± 1%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               344µs ± 3%               351µs ± 1%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               461µs ± 1%               466µs ± 1%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               912µs ± 2%               940µs ± 2%   +3.02%  (p=0.032 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                             1.40ms ± 7%              1.41ms ± 2%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                             1.85ms ± 1%              1.91ms ± 5%   +3.39%  (p=0.032 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  167µs ± 1%               166µs ± 4%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  292µs ± 5%               289µs ± 3%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  437µs ± 3%               433µs ± 2%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  580µs ± 1%               581µs ± 2%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                 1.21ms ± 6%              1.18ms ± 7%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                1.77ms ± 2%              1.78ms ± 6%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                2.36ms ± 3%              2.36ms ± 7%     ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·1                                       46.4µs ± 0%              44.0µs ± 0%   -5.18%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·2                                       51.3µs ± 0%              49.4µs ± 0%   -3.70%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·3                                       58.8µs ± 1%              56.7µs ± 0%   -3.60%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·4                                       64.3µs ± 0%              61.8µs ± 0%   -3.81%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·8                                        100µs ± 1%                98µs ± 1%   -2.22%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·12                                       147µs ± 2%               149µs ± 3%     ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·16                                       198µs ± 3%               206µs ± 3%   +3.86%  (p=0.032 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                         37.2µs ± 1%              37.1µs ± 1%     ~     (p=0.690 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                         40.6µs ± 0%              39.0µs ± 0%   -3.85%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                         48.1µs ± 0%              45.9µs ± 1%   -4.60%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                         53.6µs ± 0%              50.9µs ± 0%   -5.00%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                         85.6µs ± 2%              82.7µs ± 1%   -3.33%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         124µs ± 2%               121µs ± 4%     ~     (p=0.095 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         169µs ± 3%               170µs ± 3%     ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go·1                                    91.0µs ± 0%              68.1µs ± 0%  -25.21%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     104µs ± 0%                79µs ± 0%  -23.47%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     114µs ± 0%                87µs ± 1%  -23.53%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     126µs ± 0%                99µs ± 0%  -21.06%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     207µs ± 1%               193µs ± 3%   -6.71%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    329µs ± 2%               311µs ± 3%   -5.49%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    445µs ± 1%               423µs ± 3%   -5.04%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                             87.8µs ± 0%              63.6µs ± 1%  -27.52%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              101µs ± 0%                74µs ± 0%  -26.23%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              109µs ± 0%                80µs ± 0%  -27.02%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              120µs ± 0%                92µs ± 1%  -23.72%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              206µs ± 2%               177µs ± 2%  -14.13%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             333µs ± 3%               289µs ± 2%  -13.11%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             452µs ± 1%               395µs ± 1%  -12.64%  (p=0.008 n=5+5)
      6b816d6f
    • Kirill Smelkov's avatar
      X neo1: localhost timings · f3fc4bdd
      Kirill Smelkov authored
      Similarly to deco there is some neo/go/sqlite speedup. Everything else
      is noise.
      
      ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
      
      $ benchstat -split node,cluster,dataset 20180308-neo1-ffixed-noc_C1\(3µs\)-zwrk1s.txt 20180318-neo1.txt
      
      name                                           old pystone/s            new pystone/s            delta
      node:neo1
      pystone                                                      105k ± 0%                106k ± 1%   +1.33%  (p=0.008 n=5+5)
      
      name                                           old time/op              new time/op              delta
      node:neo1
      crc32/py/4K                                                5.15µs ± 1%              5.14µs ± 1%     ~     (p=0.421 n=5+5)
      crc32/go/4K                                                2.79µs ± 0%              2.79µs ± 0%     ~     (p=0.206 n=4+5)
      sha1/py/4K                                                 13.5µs ± 3%              13.3µs ± 1%   -1.56%  (p=0.032 n=5+5)
      sha1/go/4K                                                 9.81µs ± 0%              9.81µs ± 0%     ~     (p=0.794 n=5+5)
      unzlib/py/wczdata                                          35.5µs ± 7%              36.1µs ± 2%     ~     (p=0.556 n=5+4)
      unzlib/go/wczdata                                          30.9µs ± 1%              31.1µs ± 2%     ~     (p=0.310 n=5+5)
      unzlib/py/prod1-avg                                        16.0µs ± 2%              16.1µs ± 2%     ~     (p=0.690 n=5+5)
      unzlib/go/prod1-avg                                        9.26µs ± 1%              9.27µs ± 1%     ~     (p=0.548 n=5+5)
      disk/randread/direct/4K-min                                 158µs ± 2%               162µs ± 0%   +2.01%  (p=0.016 n=5+4)
      disk/randread/direct/4K-avg                                 172µs ± 0%               172µs ± 0%     ~     (p=0.833 n=5+5)
      disk/randread/pagecache/4K-min                              392ns ± 2%               390ns ± 1%     ~     (p=0.381 n=5+5)
      disk/randread/pagecache/4K-avg                              904ns ± 1%               897ns ± 1%   -0.69%  (p=0.040 n=5+5)
      
      name                                           old time/object          new time/object          delta
      cluster:neo1 dataset:wczblk1-8
      fs1-zhash.py                                               34.7µs ± 2%              35.3µs ± 3%     ~     (p=0.175 n=5+5)
      fs1-zhash.go                                               5.90µs ± 0%              5.95µs ± 3%     ~     (p=1.000 n=4+4)
      fs1-zhash.go+prefetch128                                   6.32µs ± 3%              6.28µs ± 4%     ~     (p=0.873 n=5+5)
      zeo/py/fs1-zhash.py                                         459µs ± 0%               484µs ± 6%   +5.54%  (p=0.016 n=4+5)
      zeo/py/fs1-zhash.go                                         174µs ± 2%               175µs ± 1%     ~     (p=0.841 n=5+5)
      zeo/py/fs1-zhash.go+prefetch128                            98.5µs ± 2%             101.8µs ± 2%   +3.37%  (p=0.032 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                390µs ± 1%               394µs ± 2%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                196µs ± 2%               204µs ± 8%   +4.40%  (p=0.032 n=5+5)
      neo/py(!log)/sqlite-zhash.go+prefetch128                    164µs ± 2%               168µs ± 2%   +2.78%  (p=0.032 n=5+5)
      neo/py(!log)/sql-zhash.py                                   459µs ± 1%               450µs ± 6%     ~     (p=0.686 n=4+4)
      neo/py(!log)/sql-zhash.go                                   249µs ± 3%               245µs ± 3%     ~     (p=0.333 n=5+5)
      neo/py(!log)/sql-zhash.go+prefetch128                       217µs ± 1%               215µs ± 3%     ~     (p=0.421 n=5+5)
      neo/go/fs1-zhash.py                                         274µs ± 1%               272µs ± 1%     ~     (p=0.206 n=5+4)
      neo/go/fs1-zhash.go                                        80.4µs ± 4%              80.0µs ± 4%     ~     (p=0.548 n=5+5)
      neo/go/fs1-zhash.go+prefetch128                            35.3µs ± 6%              34.4µs ± 4%     ~     (p=0.421 n=5+5)
      neo/go/fs1(!sha1)-zhash.go(!sha1)                          56.5µs ± 2%              55.3µs ± 2%     ~     (p=0.087 n=5+5)
      neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1)              23.2µs ± 7%              22.8µs ± 3%     ~     (p=0.722 n=5+5)
      neo/go/sqlite-zhash.py                                      322µs ± 1%               304µs ± 2%   -5.70%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.go                                      134µs ±12%               102µs ± 2%  -24.18%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128                         49.4µs ± 9%              42.1µs ± 9%  -14.66%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.go(!sha1)                               114µs ± 2%                91µs ± 3%  -19.98%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128(!sha1)                  46.3µs ± 5%              41.2µs ± 4%  -10.93%  (p=0.008 n=5+5)
      cluster:neo1 dataset:prod1-1024
      fs1-zhash.py                                               29.3µs ± 0%              29.1µs ± 2%     ~     (p=0.167 n=5+5)
      fs1-zhash.go                                               3.80µs ± 0%              3.70µs ± 0%     ~     (p=0.079 n=4+5)
      fs1-zhash.go+prefetch128                                   3.78µs ± 3%              3.78µs ± 6%     ~     (p=0.921 n=5+5)
      zeo/py/fs1-zhash.py                                         436µs ± 2%               440µs ± 2%     ~     (p=0.421 n=5+5)
      zeo/py/fs1-zhash.go                                         150µs ± 2%               150µs ± 2%     ~     (p=0.500 n=5+5)
      zeo/py/fs1-zhash.go+prefetch128                            88.0µs ± 1%              87.6µs ± 1%     ~     (p=0.532 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                387µs ± 5%               383µs ± 2%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                185µs ± 4%               184µs ± 3%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zhash.go+prefetch128                    150µs ± 2%               152µs ± 1%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sql-zhash.py                                   477µs ±40%               440µs ± 3%     ~     (p=0.730 n=5+4)
      neo/py(!log)/sql-zhash.go                                   236µs ± 2%               233µs ± 2%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zhash.go+prefetch128                       202µs ± 2%               205µs ± 1%     ~     (p=0.111 n=5+5)
      neo/go/fs1-zhash.py                                         267µs ±11%               265µs ±11%     ~     (p=0.548 n=5+5)
      neo/go/fs1-zhash.go                                        60.8µs ± 2%              60.8µs ± 1%     ~     (p=0.683 n=5+5)
      neo/go/fs1-zhash.go+prefetch128                            22.2µs ± 1%              22.3µs ± 4%     ~     (p=0.198 n=5+5)
      neo/go/fs1(!sha1)-zhash.go(!sha1)                          52.7µs ± 3%              52.2µs ± 4%     ~     (p=0.690 n=5+5)
      neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1)              18.4µs ± 5%              18.0µs ± 2%     ~     (p=0.294 n=5+5)
      neo/go/sqlite-zhash.py                                      312µs ± 1%               292µs ± 2%   -6.49%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.go                                      112µs ± 1%                91µs ± 1%  -18.39%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128                         41.2µs ± 7%              38.8µs ± 3%     ~     (p=0.071 n=5+5)
      neo/go/sqlite-zhash.go(!sha1)                               107µs ± 2%                89µs ± 3%  -16.90%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128(!sha1)                  41.5µs ± 4%              43.5µs ±16%     ~     (p=0.651 n=5+5)
      
      name                                           old req/s                new req/s                delta
      cluster:neo1 dataset:wczblk1-8
      fs1-zwrk.go·1                                                230k ± 0%                230k ± 0%     ~     (p=0.190 n=5+4)
      fs1-zwrk.go·2                                                425k ± 7%                431k ± 8%     ~     (p=0.690 n=5+5)
      fs1-zwrk.go·3                                                660k ± 1%                661k ± 0%     ~     (p=0.548 n=5+5)
      fs1-zwrk.go·4                                                869k ± 1%                861k ± 1%     ~     (p=0.063 n=4+5)
      fs1-zwrk.go·8                                               1.00M ± 0%               1.00M ± 1%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·12                                              1.01M ± 0%               1.02M ± 0%   +0.33%  (p=0.008 n=5+5)
      fs1-zwrk.go·16                                              1.02M ± 0%               1.02M ± 0%     ~     (p=0.556 n=5+4)
      zeo/py/fs1-zwrk.go·1                                        5.83k ± 1%               5.79k ± 1%     ~     (p=0.222 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        7.21k ± 1%               7.09k ± 1%   -1.61%  (p=0.016 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        7.80k ± 3%               7.78k ± 2%     ~     (p=0.548 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        8.01k ± 1%               8.00k ± 1%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        8.46k ± 1%               8.30k ± 1%   -1.81%  (p=0.032 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       8.52k ± 2%               8.28k ± 3%   -2.83%  (p=0.032 n=5+5)
      zeo/py/fs1-zwrk.go·16                                       8.51k ± 2%               8.43k ± 1%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               5.23k ± 2%               5.19k ± 1%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               6.30k ± 2%               6.27k ± 2%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               6.33k ± 1%               5.97k ± 3%   -5.61%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               6.30k ± 3%               6.16k ± 3%     ~     (p=0.056 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               6.27k ± 3%               6.27k ± 0%     ~     (p=0.730 n=5+4)
      neo/py(!log)/sqlite-zwrk.go·12                              6.36k ± 2%               6.05k ±10%     ~     (p=0.056 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                              6.33k ± 2%               6.31k ± 0%     ~     (p=0.190 n=5+4)
      neo/py(!log)/sql-zwrk.go·1                                  4.10k ± 5%               4.14k ± 3%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  4.85k ± 2%               4.75k ± 4%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  4.80k ± 4%               4.72k ± 5%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  4.78k ± 1%               4.67k ± 5%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                  4.73k ± 7%               4.80k ± 2%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                 4.67k ± 6%               4.87k ± 2%     ~     (p=0.056 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                 4.68k ± 9%               4.64k ±11%     ~     (p=1.000 n=5+5)
      neo/go/fs1-zwrk.go·1                                        13.0k ± 1%               13.0k ± 1%     ~     (p=0.690 n=5+5)
      neo/go/fs1-zwrk.go·2                                        25.0k ± 1%               25.0k ± 0%     ~     (p=1.000 n=5+5)
      neo/go/fs1-zwrk.go·3                                        32.4k ± 0%               32.5k ± 0%     ~     (p=0.151 n=5+5)
      neo/go/fs1-zwrk.go·4                                        40.9k ± 0%               41.0k ± 0%   +0.36%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·8                                        54.8k ± 1%               55.0k ± 0%     ~     (p=0.190 n=5+4)
      neo/go/fs1-zwrk.go·12                                       57.4k ± 1%               56.9k ± 1%   -0.81%  (p=0.032 n=5+5)
      neo/go/fs1-zwrk.go·16                                       55.8k ± 1%               55.7k ± 2%     ~     (p=0.690 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                          19.3k ± 1%               19.1k ± 2%     ~     (p=0.548 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                          38.0k ± 1%               38.0k ± 0%     ~     (p=0.286 n=5+4)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                          48.2k ± 0%               48.3k ± 0%     ~     (p=0.690 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                          59.3k ± 0%               59.5k ± 0%     ~     (p=0.056 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          78.4k ± 0%               78.4k ± 0%     ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         82.7k ± 1%               82.5k ± 0%     ~     (p=0.421 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         81.3k ± 2%               80.8k ± 1%     ~     (p=0.413 n=5+4)
      neo/go/sqlite-zwrk.go·1                                     8.23k ± 1%               9.93k ± 0%  +20.66%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     15.0k ± 0%               18.3k ± 0%  +22.40%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     20.7k ± 0%               24.8k ± 0%  +19.63%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     24.9k ± 0%               29.9k ± 0%  +20.32%  (p=0.016 n=5+4)
      neo/go/sqlite-zwrk.go·8                                     30.9k ± 8%               36.5k ± 1%  +18.18%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    31.3k ± 1%               35.5k ± 2%  +13.29%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    30.6k ± 3%               34.3k ± 2%  +12.38%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              9.08k ± 0%              11.04k ± 3%  +21.65%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              16.4k ± 0%               20.1k ± 0%  +22.36%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              22.7k ± 0%               28.2k ± 0%  +24.10%  (p=0.016 n=4+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              27.8k ± 0%               33.7k ± 0%  +21.34%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              34.6k ± 1%               38.7k ± 1%  +11.83%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             33.5k ± 1%               38.0k ± 1%  +13.32%  (p=0.016 n=5+4)
      neo/go/sqlite-zwrk.go(!sha1)·16                             32.8k ± 2%               37.3k ± 1%  +13.55%  (p=0.008 n=5+5)
      cluster:neo1 dataset:prod1-1024
      fs1-zwrk.go·1                                                454k ± 0%                444k ±10%     ~     (p=1.000 n=4+5)
      fs1-zwrk.go·2                                                869k ± 6%                905k ± 0%   +4.14%  (p=0.016 n=5+4)
      fs1-zwrk.go·3                                               1.33M ± 1%               1.31M ± 6%     ~     (p=0.841 n=5+5)
      fs1-zwrk.go·4                                               1.73M ± 2%               1.75M ± 3%     ~     (p=0.421 n=5+5)
      fs1-zwrk.go·8                                               1.99M ± 2%               2.02M ± 0%     ~     (p=0.095 n=5+5)
      fs1-zwrk.go·12                                              2.03M ± 0%               2.03M ± 0%     ~     (p=0.905 n=4+5)
      fs1-zwrk.go·16                                              2.04M ± 0%               2.03M ± 1%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        6.83k ± 1%               6.81k ± 0%     ~     (p=0.905 n=5+4)
      zeo/py/fs1-zwrk.go·2                                        8.72k ± 3%               8.67k ± 1%     ~     (p=0.421 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        9.26k ± 6%               9.41k ± 3%     ~     (p=0.310 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        9.78k ± 3%               9.74k ± 3%     ~     (p=0.548 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        10.4k ± 1%               10.3k ± 2%     ~     (p=0.310 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       10.6k ± 1%               10.3k ± 4%     ~     (p=0.056 n=5+5)
      zeo/py/fs1-zwrk.go·16                                       10.5k ± 5%               10.5k ± 2%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               5.57k ± 3%               5.53k ± 3%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               6.51k ± 1%               6.42k ± 3%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               6.39k ± 6%               6.41k ± 1%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               6.43k ± 1%               6.36k ± 2%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               6.33k ± 2%               6.33k ± 3%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                              6.30k ± 3%               6.29k ± 3%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                              6.37k ± 3%               6.27k ± 5%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  4.34k ± 2%               4.32k ± 4%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  4.94k ± 4%               4.87k ± 6%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  4.69k ± 5%               4.78k ± 3%     ~     (p=0.222 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  4.78k ± 4%               4.61k ± 8%     ~     (p=0.222 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                  4.92k ± 1%               4.76k ± 2%   -3.12%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                 4.76k ± 3%               4.76k ± 4%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                 4.90k ± 3%               4.77k ± 3%     ~     (p=0.095 n=5+5)
      neo/go/fs1-zwrk.go·1                                        17.4k ± 1%               17.1k ± 6%     ~     (p=0.310 n=5+5)
      neo/go/fs1-zwrk.go·2                                        32.9k ± 1%               32.7k ± 1%     ~     (p=0.056 n=5+5)
      neo/go/fs1-zwrk.go·3                                        43.5k ± 0%               43.3k ± 0%   -0.44%  (p=0.016 n=4+5)
      neo/go/fs1-zwrk.go·4                                        53.2k ± 0%               53.1k ± 1%     ~     (p=0.095 n=5+5)
      neo/go/fs1-zwrk.go·8                                        67.0k ± 2%               65.2k ± 2%   -2.59%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·12                                       62.6k ± 3%               59.5k ± 5%   -4.89%  (p=0.016 n=5+5)
      neo/go/fs1-zwrk.go·16                                       54.3k ±11%               53.7k ± 2%     ~     (p=0.151 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                          20.2k ± 5%               20.1k ± 3%     ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                          40.8k ± 1%               40.8k ± 1%     ~     (p=0.690 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                          51.9k ± 1%               51.7k ± 0%     ~     (p=0.190 n=5+4)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                          62.7k ± 0%               62.6k ± 0%     ~     (p=0.310 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          75.1k ± 4%               74.6k ± 3%     ~     (p=0.548 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         69.5k ± 1%               67.8k ± 4%     ~     (p=0.151 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         61.0k ± 2%               59.3k ± 2%     ~     (p=0.056 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     9.16k ± 1%              11.15k ± 0%  +21.74%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     16.0k ± 0%               20.0k ± 0%  +25.10%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     22.1k ± 0%               27.2k ± 0%  +23.34%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     26.7k ± 0%               31.8k ± 2%  +19.00%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     30.9k ± 2%               32.8k ± 3%   +6.19%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    29.5k ± 1%               32.1k ± 2%   +8.71%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    29.6k ± 2%               32.8k ± 2%  +10.86%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              9.51k ± 1%              11.74k ± 2%  +23.39%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              16.5k ± 0%               21.1k ± 1%  +27.77%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              22.7k ± 0%               28.9k ± 0%  +27.72%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              27.4k ± 1%               34.3k ± 0%  +25.08%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              31.2k ± 2%               35.5k ± 2%  +13.70%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             29.5k ± 2%               34.2k ± 3%  +16.00%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             28.8k ±10%               35.8k ± 1%  +24.19%  (p=0.008 n=5+5)
      
      name                                           old latency-time/object  new latency-time/object  delta
      cluster:neo1 dataset:wczblk1-8
      fs1-zwrk.go·1                                              4.36µs ± 0%              4.35µs ± 0%     ~     (p=0.206 n=5+4)
      fs1-zwrk.go·2                                              4.71µs ± 8%              4.65µs ± 8%     ~     (p=0.690 n=5+5)
      fs1-zwrk.go·3                                              4.55µs ± 1%              4.54µs ± 0%     ~     (p=0.524 n=5+5)
      fs1-zwrk.go·4                                              4.60µs ± 1%              4.65µs ± 1%   +0.99%  (p=0.048 n=4+5)
      fs1-zwrk.go·8                                              8.03µs ± 0%              8.04µs ± 1%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·12                                             11.8µs ± 0%              11.8µs ± 0%   -0.33%  (p=0.008 n=5+5)
      fs1-zwrk.go·16                                             15.7µs ± 0%              15.7µs ± 0%     ~     (p=0.556 n=5+4)
      zeo/py/fs1-zwrk.go·1                                        172µs ± 1%               173µs ± 1%     ~     (p=0.222 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        277µs ± 1%               282µs ± 1%   +1.63%  (p=0.016 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        384µs ± 3%               386µs ± 2%     ~     (p=0.548 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        500µs ± 1%               500µs ± 1%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        946µs ± 1%               963µs ± 1%   +1.85%  (p=0.032 n=5+5)
      zeo/py/fs1-zwrk.go·12                                      1.41ms ± 2%              1.45ms ± 3%   +2.92%  (p=0.032 n=5+5)
      zeo/py/fs1-zwrk.go·16                                      1.88ms ± 2%              1.90ms ± 1%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               191µs ± 2%               193µs ± 1%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               317µs ± 2%               319µs ± 2%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               474µs ± 1%               503µs ± 3%   +5.98%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               635µs ± 3%               650µs ± 3%     ~     (p=0.056 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                              1.28ms ± 3%              1.28ms ± 0%     ~     (p=0.730 n=5+4)
      neo/py(!log)/sqlite-zwrk.go·12                             1.89ms ± 2%              1.99ms ±11%     ~     (p=0.056 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                             2.53ms ± 2%              2.53ms ± 0%     ~     (p=0.190 n=5+4)
      neo/py(!log)/sql-zwrk.go·1                                  244µs ± 6%               242µs ± 3%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  412µs ± 3%               422µs ± 4%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  625µs ± 4%               637µs ± 5%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  837µs ± 1%               857µs ± 5%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                 1.69ms ± 7%              1.67ms ± 2%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                2.57ms ± 6%              2.47ms ± 2%     ~     (p=0.056 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                3.42ms ± 9%              3.46ms ±12%     ~     (p=1.000 n=5+5)
      neo/go/fs1-zwrk.go·1                                       76.7µs ± 1%              77.2µs ± 1%     ~     (p=0.690 n=5+5)
      neo/go/fs1-zwrk.go·2                                       79.9µs ± 1%              80.0µs ± 0%     ~     (p=1.000 n=5+5)
      neo/go/fs1-zwrk.go·3                                       92.5µs ± 0%              92.3µs ± 0%     ~     (p=0.151 n=5+5)
      neo/go/fs1-zwrk.go·4                                       97.9µs ± 0%              97.5µs ± 0%   -0.36%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·8                                        146µs ± 1%               145µs ± 0%     ~     (p=0.190 n=5+4)
      neo/go/fs1-zwrk.go·12                                       209µs ± 1%               211µs ± 1%   +0.82%  (p=0.032 n=5+5)
      neo/go/fs1-zwrk.go·16                                       287µs ± 1%               287µs ± 2%     ~     (p=0.690 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                         51.9µs ± 2%              52.3µs ± 2%     ~     (p=0.548 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                         52.7µs ± 1%              52.6µs ± 0%     ~     (p=0.286 n=5+4)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                         62.2µs ± 0%              62.1µs ± 0%     ~     (p=0.690 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                         67.4µs ± 0%              67.2µs ± 0%     ~     (p=0.056 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          102µs ± 0%               102µs ± 0%     ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         145µs ± 1%               145µs ± 0%     ~     (p=0.421 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         197µs ± 2%               198µs ± 1%     ~     (p=0.413 n=5+4)
      neo/go/sqlite-zwrk.go·1                                     122µs ± 1%               101µs ± 0%  -17.13%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     134µs ± 0%               109µs ± 0%  -18.30%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     145µs ± 0%               121µs ± 0%  -16.41%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     161µs ± 0%               134µs ± 0%  -16.89%  (p=0.016 n=5+4)
      neo/go/sqlite-zwrk.go·8                                     260µs ± 9%               219µs ± 1%  -15.53%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    383µs ± 1%               338µs ± 2%  -11.73%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    524µs ± 3%               466µs ± 2%  -11.01%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              110µs ± 0%                91µs ± 3%  -17.78%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              122µs ± 0%               100µs ± 0%  -18.28%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              132µs ± 0%               106µs ± 0%  -19.42%  (p=0.016 n=4+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              144µs ± 0%               119µs ± 0%  -17.59%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              231µs ± 1%               207µs ± 1%  -10.58%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             358µs ± 1%               316µs ± 1%  -11.76%  (p=0.016 n=5+4)
      neo/go/sqlite-zwrk.go(!sha1)·16                             487µs ± 2%               429µs ± 1%  -11.95%  (p=0.008 n=5+5)
      cluster:neo1 dataset:prod1-1024
      fs1-zwrk.go·1                                              2.20µs ± 0%              2.26µs ±11%     ~     (p=1.000 n=4+5)
      fs1-zwrk.go·2                                              2.31µs ± 6%              2.21µs ± 0%   -4.17%  (p=0.000 n=5+4)
      fs1-zwrk.go·3                                              2.25µs ± 1%              2.29µs ± 7%     ~     (p=0.841 n=5+5)
      fs1-zwrk.go·4                                              2.31µs ± 2%              2.29µs ± 3%     ~     (p=0.421 n=5+5)
      fs1-zwrk.go·8                                              4.02µs ± 2%              3.96µs ± 0%     ~     (p=0.095 n=5+5)
      fs1-zwrk.go·12                                             5.91µs ± 0%              5.90µs ± 0%     ~     (p=0.841 n=4+5)
      fs1-zwrk.go·16                                             7.86µs ± 0%              7.86µs ± 1%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        146µs ± 1%               147µs ± 0%     ~     (p=0.905 n=5+4)
      zeo/py/fs1-zwrk.go·2                                        229µs ± 3%               231µs ± 1%     ~     (p=0.421 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        324µs ± 6%               319µs ± 3%     ~     (p=0.310 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        409µs ± 3%               411µs ± 3%     ~     (p=0.548 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        766µs ± 1%               774µs ± 2%     ~     (p=0.310 n=5+5)
      zeo/py/fs1-zwrk.go·12                                      1.13ms ± 1%              1.16ms ± 4%     ~     (p=0.056 n=5+5)
      zeo/py/fs1-zwrk.go·16                                      1.53ms ± 5%              1.52ms ± 2%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               180µs ± 3%               181µs ± 3%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               307µs ± 1%               311µs ± 3%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               470µs ± 6%               468µs ± 1%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               622µs ± 1%               629µs ± 2%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                              1.26ms ± 2%              1.26ms ± 3%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                             1.91ms ± 3%              1.91ms ± 3%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                             2.51ms ± 3%              2.55ms ± 5%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  230µs ± 2%               232µs ± 4%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  405µs ± 4%               411µs ± 7%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  640µs ± 5%               628µs ± 3%     ~     (p=0.222 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  837µs ± 4%               870µs ± 9%     ~     (p=0.222 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                 1.63ms ± 1%              1.68ms ± 2%   +3.24%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                2.52ms ± 3%              2.52ms ± 4%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                3.27ms ± 3%              3.35ms ± 3%     ~     (p=0.095 n=5+5)
      neo/go/fs1-zwrk.go·1                                       57.4µs ± 1%              58.5µs ± 6%     ~     (p=0.310 n=5+5)
      neo/go/fs1-zwrk.go·2                                       60.8µs ± 1%              61.2µs ± 1%     ~     (p=0.056 n=5+5)
      neo/go/fs1-zwrk.go·3                                       69.0µs ± 0%              69.3µs ± 0%   +0.44%  (p=0.016 n=4+5)
      neo/go/fs1-zwrk.go·4                                       75.1µs ± 0%              75.4µs ± 1%     ~     (p=0.103 n=5+5)
      neo/go/fs1-zwrk.go·8                                        119µs ± 2%               123µs ± 2%   +2.66%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·12                                       192µs ± 3%               202µs ± 5%   +5.20%  (p=0.016 n=5+5)
      neo/go/fs1-zwrk.go·16                                       296µs ±12%               298µs ± 2%     ~     (p=0.151 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                         49.5µs ± 5%              49.8µs ± 3%     ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                         49.0µs ± 1%              49.0µs ± 1%     ~     (p=0.690 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                         57.8µs ± 1%              58.0µs ± 0%     ~     (p=0.190 n=5+4)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                         63.7µs ± 0%              63.9µs ± 0%     ~     (p=0.310 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          107µs ± 5%               107µs ± 4%     ~     (p=0.548 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         173µs ± 1%               177µs ± 4%     ~     (p=0.151 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         262µs ± 2%               270µs ± 2%     ~     (p=0.056 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     109µs ± 1%                90µs ± 0%  -17.86%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     125µs ± 0%               100µs ± 0%  -20.06%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     136µs ± 0%               110µs ± 0%  -18.92%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     150µs ± 0%               126µs ± 2%  -15.96%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     259µs ± 2%               244µs ± 3%   -5.81%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    407µs ± 1%               374µs ± 2%   -8.01%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    541µs ± 2%               488µs ± 2%   -9.80%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              105µs ± 1%                85µs ± 2%  -18.95%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              121µs ± 0%                95µs ± 1%  -21.73%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              132µs ± 0%               104µs ± 0%  -21.71%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              146µs ± 1%               117µs ± 0%  -20.05%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              256µs ± 2%               225µs ± 2%  -12.05%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             407µs ± 2%               351µs ± 3%  -13.79%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             557µs ±10%               447µs ± 1%  -19.70%  (p=0.008 n=5+5)
      f3fc4bdd
    • Kirill Smelkov's avatar
      X deco: localhost timings · fcb32916
      Kirill Smelkov authored
      neo/go/sqlite is speed-up a bit, because we are now not retaking
      database file lock on every query which is expensive to do (see 57fa0d99
      for details). E.g.
      
      ---- 8< ----
      cluster:deco dataset:wczblk1-8
      neo/go/sqlite-zhash.go                                     93.7µs ± 1%              72.8µs ± 1%  -22.30%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.go(!sha1)                              86.4µs ± 3%              66.2µs ± 2%  -23.37%  (p=0.008 n=5+5)
      
      neo/go/sqlite-zwrk.go·1                                    91.2µs ± 0%              71.1µs ± 0%  -22.02%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     109µs ± 1%                81µs ± 1%  -25.66%  (p=0.016 n=4+5)
      neo/go/sqlite-zwrk.go·3                                     124µs ± 0%                96µs ± 1%  -22.71%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     149µs ± 1%               122µs ± 1%  -18.25%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     270µs ± 2%               229µs ± 2%  -15.27%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    410µs ± 2%               351µs ± 3%  -14.41%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    560µs ± 1%               479µs ± 2%  -14.47%  (p=0.008 n=5+5)
      
      cluster:deco dataset:prod1-1024
      neo/go/sqlite-zhash.go                                     86.3µs ± 0%              65.9µs ± 1%  -23.65%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.go(!sha1)                              83.8µs ± 2%              63.3µs ± 1%  -24.49%  (p=0.008 n=5+5)
      
      neo/go/sqlite-zwrk.go·1                                    85.5µs ± 1%              64.3µs ± 0%  -24.84%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     106µs ± 1%                78µs ± 1%  -25.95%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     123µs ± 2%                95µs ± 1%  -23.01%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     154µs ± 3%               123µs ± 1%  -19.85%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     325µs ± 5%               271µs ± 3%  -16.50%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    507µs ± 3%               424µs ± 2%  -16.39%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    665µs ± 3%               549µs ± 1%  -17.44%  (p=0.008 n=5+5)
      ---- 8< ----
      
      Everything else is probably within noise except
      
      ---- 8< ----
      zeo/py/fs1-zhash.go                                         112µs ± 1%               130µs ± 1%  +15.41%  (p=0.008 n=5+5)
      ---- 8< ----
      
      which has no explanation, but probably it was due to e.g. other
      short-lived program also running on my machine.
      
      ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
      
      $ benchstat -split node,cluster,dataset 20180306-deco-ffixed-noc_C1\(2µs\).txt 20180318-deco.txt
      
      name                                           old pystone/s            new pystone/s            delta
      node:deco
      pystone                                                      218k ± 2%                218k ± 2%     ~     (p=0.690 n=5+5)
      
      name                                           old time/op              new time/op              delta
      node:deco
      crc32/py/4K                                                5.72µs ± 0%              5.72µs ± 0%     ~     (p=0.460 n=5+5)
      crc32/go/4K                                                 280ns ± 1%               279ns ± 0%     ~     (p=0.444 n=5+5)
      sha1/py/4K                                                 6.72µs ± 1%              6.70µs ± 0%     ~     (p=0.381 n=5+5)
      sha1/go/4K                                                 5.59µs ± 0%              5.59µs ± 0%     ~     (p=0.603 n=4+5)
      unzlib/py/wczdata                                          27.2µs ± 1%              27.1µs ± 1%     ~     (p=0.151 n=5+5)
      unzlib/go/wczdata                                          26.8µs ± 0%              26.7µs ± 0%   -0.54%  (p=0.008 n=5+5)
      unzlib/py/prod1-avg                                        5.08µs ± 1%              5.12µs ± 2%     ~     (p=0.310 n=5+5)
      unzlib/go/prod1-avg                                        5.29µs ± 1%              5.25µs ± 0%   -0.71%  (p=0.008 n=5+5)
      disk/randread/direct/4K-min                                 105µs ± 0%               123µs ± 1%  +17.41%  (p=0.008 n=5+5)
      disk/randread/direct/4K-avg                                 142µs ± 0%               141µs ± 0%   -0.40%  (p=0.016 n=5+4)
      disk/randread/pagecache/4K-min                              582ns ± 0%               581ns ± 1%     ~     (p=0.540 n=5+5)
      disk/randread/pagecache/4K-avg                              987ns ± 0%               975ns ± 0%   -1.28%  (p=0.008 n=5+5)
      
      name                                           old time/object          new time/object          delta
      cluster:deco dataset:wczblk1-8
      fs1-zhash.py                                               20.2µs ± 1%              20.1µs ± 1%     ~     (p=0.206 n=5+4)
      fs1-zhash.go                                               3.20µs ± 0%              3.20µs ± 0%     ~     (all equal)
      fs1-zhash.go+prefetch128                                   4.14µs ± 1%              3.98µs ±10%     ~     (p=0.206 n=5+5)
      zeo/py/fs1-zhash.py                                         361µs ± 3%               376µs ± 3%   +3.88%  (p=0.032 n=5+5)
      zeo/py/fs1-zhash.go                                         112µs ± 1%               130µs ± 1%  +15.41%  (p=0.008 n=5+5)
      zeo/py/fs1-zhash.go+prefetch128                            63.9µs ± 1%              64.0µs ± 3%     ~     (p=0.738 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                321µs ± 8%               329µs ± 6%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                141µs ± 3%               147µs ± 3%   +4.26%  (p=0.016 n=5+5)
      neo/py(!log)/sqlite-zhash.go+prefetch128                    119µs ± 1%               124µs ± 1%   +4.53%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zhash.py                                   376µs ± 2%               375µs ± 3%     ~     (p=0.971 n=4+4)
      neo/py(!log)/sql-zhash.go                                   187µs ± 5%               183µs ± 3%     ~     (p=0.206 n=5+5)
      neo/py(!log)/sql-zhash.go+prefetch128                       164µs ± 2%               163µs ± 1%     ~     (p=0.881 n=5+5)
      neo/go/fs1-zhash.py                                         226µs ± 2%               226µs ± 3%     ~     (p=1.000 n=5+5)
      neo/go/fs1-zhash.go                                        57.1µs ± 1%              55.9µs ± 1%   -2.17%  (p=0.008 n=5+5)
      neo/go/fs1-zhash.go+prefetch128                            24.0µs ± 4%              24.2µs ± 5%     ~     (p=0.841 n=5+5)
      neo/go/fs1(!sha1)-zhash.go(!sha1)                          40.3µs ± 1%              39.3µs ± 1%   -2.48%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1)              17.2µs ± 4%              16.9µs ± 8%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zhash.py                                      253µs ± 1%               249µs ± 2%     ~     (p=0.056 n=5+5)
      neo/go/sqlite-zhash.go                                     93.7µs ± 1%              72.8µs ± 1%  -22.30%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128                         39.5µs ± 6%              34.3µs ±12%  -13.18%  (p=0.032 n=5+5)
      neo/go/sqlite-zhash.go(!sha1)                              86.4µs ± 3%              66.2µs ± 2%  -23.37%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128(!sha1)                  39.4µs ± 7%              31.5µs ±12%  -20.01%  (p=0.008 n=5+5)
      cluster:deco dataset:prod1-1024
      fs1-zhash.py                                               15.9µs ± 2%              15.9µs ± 1%     ~     (p=1.032 n=5+4)
      fs1-zhash.go                                               2.80µs ± 0%              2.70µs ± 0%   -3.57%  (p=0.029 n=4+4)
      fs1-zhash.go+prefetch128                                   3.34µs ± 2%              3.30µs ± 0%     ~     (p=0.333 n=5+4)
      zeo/py/fs1-zhash.py                                         347µs ± 3%               345µs ± 3%     ~     (p=0.841 n=5+5)
      zeo/py/fs1-zhash.go                                         105µs ± 0%               105µs ± 1%     ~     (p=0.659 n=5+5)
      zeo/py/fs1-zhash.go+prefetch128                            58.9µs ± 1%              58.9µs ± 1%     ~     (p=0.984 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                317µs ± 5%               328µs ± 6%     ~     (p=0.222 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                138µs ± 1%               140µs ± 1%   +1.64%  (p=0.024 n=5+5)
      neo/py(!log)/sqlite-zhash.go+prefetch128                    112µs ± 1%               117µs ± 1%   +4.25%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zhash.py                                   377µs ± 2%               373µs ± 3%     ~     (p=0.686 n=4+4)
      neo/py(!log)/sql-zhash.go                                   184µs ± 2%               181µs ± 1%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sql-zhash.go+prefetch128                       160µs ± 2%               153µs ± 1%   -3.91%  (p=0.008 n=5+5)
      neo/go/fs1-zhash.py                                         225µs ± 1%               229µs ± 1%   +1.86%  (p=0.024 n=5+5)
      neo/go/fs1-zhash.go                                        44.6µs ± 0%              43.5µs ± 0%   -2.42%  (p=0.000 n=5+4)
      neo/go/fs1-zhash.go+prefetch128                            17.2µs ± 3%              16.8µs ± 3%     ~     (p=0.127 n=5+5)
      neo/go/fs1(!sha1)-zhash.go(!sha1)                          39.1µs ± 3%              38.1µs ± 1%   -2.46%  (p=0.016 n=5+5)
      neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1)              15.2µs ± 3%              14.3µs ± 3%   -5.79%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.py                                      254µs ± 1%               257µs ± 1%     ~     (p=0.063 n=5+5)
      neo/go/sqlite-zhash.go                                     86.3µs ± 0%              65.9µs ± 1%  -23.65%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128                         36.6µs ± 5%              29.8µs ± 2%  -18.52%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.go(!sha1)                              83.8µs ± 2%              63.3µs ± 1%  -24.49%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128(!sha1)                  36.9µs ± 8%              29.3µs ± 3%  -20.63%  (p=0.008 n=5+5)
      
      name                                           old req/s                new req/s                delta
      cluster:deco dataset:wczblk1-8
      fs1-zwrk.go·1                                                431k ± 1%                452k ± 1%   +4.99%  (p=0.008 n=5+5)
      fs1-zwrk.go·2                                                760k ± 3%                790k ± 4%   +3.92%  (p=0.032 n=5+5)
      fs1-zwrk.go·3                                               1.08M ± 2%               1.09M ± 0%   +1.52%  (p=0.008 n=5+5)
      fs1-zwrk.go·4                                               1.16M ± 1%               1.20M ± 1%   +3.40%  (p=0.008 n=5+5)
      fs1-zwrk.go·8                                               1.27M ± 1%               1.28M ± 1%   +0.83%  (p=0.016 n=5+5)
      fs1-zwrk.go·12                                              1.28M ± 1%               1.29M ± 1%   +1.01%  (p=0.032 n=5+5)
      fs1-zwrk.go·16                                              1.28M ± 1%               1.29M ± 0%     ~     (p=0.095 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        8.04k ± 4%               8.14k ± 3%     ~     (p=0.222 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        9.54k ± 1%               9.64k ± 0%   +1.03%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        10.5k ± 0%               10.5k ± 1%     ~     (p=0.548 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        11.0k ± 1%               11.0k ± 1%     ~     (p=0.841 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        11.4k ± 1%               11.4k ± 0%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       11.7k ± 0%               11.6k ± 1%     ~     (p=0.690 n=5+5)
      zeo/py/fs1-zwrk.go·16                                       11.8k ± 2%               11.8k ± 0%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               7.04k ± 1%               6.90k ± 1%   -2.00%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               8.52k ± 1%               8.25k ± 1%   -3.15%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               8.51k ± 1%               8.28k ± 1%   -2.68%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               8.50k ± 1%               8.27k ± 1%   -2.75%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               8.53k ± 1%               8.26k ± 1%   -3.12%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                              8.48k ± 2%               8.28k ± 1%   -2.42%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                              8.48k ± 1%               8.25k ± 1%   -2.62%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  5.37k ± 3%               5.41k ± 2%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  6.34k ± 0%               6.39k ± 1%   +0.80%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  6.28k ± 1%               6.33k ± 1%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  6.29k ± 1%               6.32k ± 1%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                  6.29k ± 1%               6.36k ± 1%     ~     (p=0.095 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                 6.25k ± 1%               6.33k ± 1%   +1.38%  (p=0.016 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                 6.23k ± 2%               6.29k ± 1%     ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·1                                        18.4k ± 0%               18.8k ± 0%   +2.52%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·2                                        38.3k ± 1%               39.2k ± 0%   +2.26%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·3                                        45.9k ± 0%               46.5k ± 3%     ~     (p=0.151 n=5+5)
      neo/go/fs1-zwrk.go·4                                        50.0k ± 0%               51.2k ± 0%   +2.40%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·8                                        60.3k ± 1%               61.5k ± 0%   +1.95%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·12                                       62.1k ± 1%               62.9k ± 1%     ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·16                                       61.6k ± 1%               63.0k ± 1%   +2.18%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                          26.3k ± 0%               27.0k ± 0%   +2.53%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                          55.7k ± 1%               56.9k ± 0%   +2.14%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                          62.8k ± 1%               64.2k ± 1%   +2.16%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                          69.4k ± 1%               70.7k ± 1%   +1.89%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          88.3k ± 1%               90.1k ± 0%   +2.01%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         93.5k ± 1%               94.9k ± 0%   +1.45%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         93.8k ± 0%               95.3k ± 0%   +1.61%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     11.0k ± 0%               14.1k ± 0%  +28.25%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     18.3k ± 1%               24.7k ± 1%  +34.52%  (p=0.016 n=4+5)
      neo/go/sqlite-zwrk.go·3                                     24.2k ± 0%               31.3k ± 1%  +29.39%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     26.8k ± 1%               32.8k ± 1%  +22.33%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     29.6k ± 2%               34.9k ± 2%  +18.02%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    29.3k ± 2%               34.2k ± 3%  +16.85%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    28.6k ± 1%               33.4k ± 2%  +16.93%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              11.9k ± 1%               15.6k ± 0%  +31.16%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              19.6k ± 1%               25.9k ± 0%  +32.17%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              26.4k ± 0%               35.3k ± 1%  +33.49%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              30.0k ± 0%               38.8k ± 1%  +29.36%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              31.2k ± 2%               37.4k ± 2%  +19.86%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             28.8k ± 3%               36.5k ± 2%  +26.88%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             28.4k ± 1%               39.4k ± 2%  +38.81%  (p=0.008 n=5+5)
      cluster:deco dataset:prod1-1024
      fs1-zwrk.go·1                                                556k ± 0%                566k ± 1%   +1.85%  (p=0.008 n=5+5)
      fs1-zwrk.go·2                                                994k ± 6%               1047k ± 5%     ~     (p=0.056 n=5+5)
      fs1-zwrk.go·3                                               1.33M ± 2%               1.34M ± 1%     ~     (p=0.151 n=5+5)
      fs1-zwrk.go·4                                               1.53M ± 0%               1.55M ± 2%     ~     (p=0.151 n=5+5)
      fs1-zwrk.go·8                                               1.59M ± 1%               1.61M ± 0%   +1.50%  (p=0.008 n=5+5)
      fs1-zwrk.go·12                                              1.60M ± 1%               1.62M ± 0%   +1.45%  (p=0.008 n=5+5)
      fs1-zwrk.go·16                                              1.59M ± 0%               1.62M ± 0%   +1.46%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        9.75k ± 1%               9.77k ± 0%     ~     (p=0.841 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        12.4k ± 1%               12.3k ± 1%     ~     (p=0.095 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        14.2k ± 1%               14.3k ± 1%   +0.91%  (p=0.016 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        14.9k ± 1%               14.9k ± 1%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        15.6k ± 1%               15.7k ± 0%   +0.45%  (p=0.032 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       16.0k ± 1%               16.0k ± 0%     ~     (p=0.190 n=5+4)
      zeo/py/fs1-zwrk.go·16                                       16.0k ± 6%               16.3k ± 0%     ~     (p=0.222 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               7.45k ± 2%               7.20k ± 1%   -3.34%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               8.71k ± 1%               8.32k ± 0%   -4.47%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               8.69k ± 1%               8.27k ± 1%   -4.82%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               8.61k ± 1%               8.25k ± 1%   -4.22%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               8.61k ± 1%               8.37k ± 1%   -2.80%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                              8.59k ± 1%               8.35k ± 1%   -2.86%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                              8.60k ± 1%               8.39k ± 1%   -2.42%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  5.45k ± 2%               5.55k ± 1%   +1.89%  (p=0.016 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  6.25k ± 1%               6.46k ± 1%   +3.27%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  6.24k ± 1%               6.41k ± 1%   +2.66%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  6.27k ± 1%               6.41k ± 1%   +2.20%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                  6.28k ± 1%               6.41k ± 0%   +2.12%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                 6.33k ± 0%               6.43k ± 1%   +1.51%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                 6.30k ± 1%               6.41k ± 1%   +1.84%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·1                                        23.9k ± 0%               24.4k ± 0%   +2.37%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·2                                        45.5k ± 1%               46.4k ± 1%   +2.10%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·3                                        55.1k ± 0%               56.7k ± 1%   +2.90%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·4                                        60.4k ± 0%               61.9k ± 1%   +2.45%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·8                                        69.2k ± 2%               70.5k ± 2%     ~     (p=0.095 n=5+5)
      neo/go/fs1-zwrk.go·12                                       68.0k ± 5%               70.4k ± 4%     ~     (p=0.222 n=5+5)
      neo/go/fs1-zwrk.go·16                                       68.1k ± 3%               70.9k ± 6%     ~     (p=0.056 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                          27.2k ± 1%               28.0k ± 1%   +3.05%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                          55.5k ± 1%               57.5k ± 0%   +3.45%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                          64.0k ± 1%               65.4k ± 0%   +2.13%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                          69.1k ± 1%               71.4k ± 1%   +3.28%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          81.1k ± 4%               82.8k ± 2%     ~     (p=0.222 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         77.8k ± 8%               83.4k ± 5%     ~     (p=0.056 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         76.8k ± 5%               79.9k ± 3%     ~     (p=0.056 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     11.7k ± 1%               15.6k ± 0%  +33.04%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     18.9k ± 1%               25.6k ± 1%  +35.04%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     24.4k ± 2%               31.6k ± 1%  +29.89%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     26.0k ± 3%               32.5k ± 1%  +24.74%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     24.6k ± 5%               29.5k ± 3%  +19.67%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    23.7k ± 3%               28.3k ± 2%  +19.59%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    24.1k ± 3%               29.2k ± 1%  +21.07%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              12.2k ± 1%               16.2k ± 0%  +33.34%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              19.6k ± 1%               26.2k ± 1%  +33.41%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              25.5k ± 1%               33.2k ± 1%  +30.52%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              27.5k ± 2%               34.3k ± 2%  +24.53%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              25.6k ± 2%               29.4k ± 3%  +14.78%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             24.0k ± 2%               29.6k ± 2%  +23.18%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             24.2k ± 1%               33.1k ± 1%  +37.12%  (p=0.008 n=5+5)
      
      name                                           old latency-time/object  new latency-time/object  delta
      cluster:deco dataset:wczblk1-8
      fs1-zwrk.go·1                                              2.32µs ± 1%              2.21µs ± 1%   -4.76%  (p=0.008 n=5+5)
      fs1-zwrk.go·2                                              2.63µs ± 3%              2.53µs ± 3%   -3.76%  (p=0.032 n=5+5)
      fs1-zwrk.go·3                                              2.78µs ± 2%              2.74µs ± 0%   -1.51%  (p=0.008 n=5+5)
      fs1-zwrk.go·4                                              3.44µs ± 1%              3.33µs ± 1%   -3.29%  (p=0.008 n=5+5)
      fs1-zwrk.go·8                                              6.28µs ± 1%              6.23µs ± 1%   -0.82%  (p=0.016 n=5+5)
      fs1-zwrk.go·12                                             9.40µs ± 1%              9.31µs ± 1%   -1.00%  (p=0.032 n=5+5)
      fs1-zwrk.go·16                                             12.5µs ± 1%              12.4µs ± 0%     ~     (p=0.095 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        125µs ± 4%               123µs ± 3%     ~     (p=0.222 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        210µs ± 1%               208µs ± 0%   -1.02%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        286µs ± 0%               285µs ± 1%     ~     (p=0.548 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        365µs ± 1%               365µs ± 1%     ~     (p=0.841 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        699µs ± 1%               700µs ± 0%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zwrk.go·12                                      1.03ms ± 0%              1.03ms ± 1%     ~     (p=0.690 n=5+5)
      zeo/py/fs1-zwrk.go·16                                      1.36ms ± 2%              1.36ms ± 0%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               142µs ± 1%               145µs ± 1%   +2.03%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               235µs ± 1%               242µs ± 1%   +3.25%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               353µs ± 1%               362µs ± 1%   +2.74%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               470µs ± 1%               484µs ± 1%   +2.82%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               938µs ± 1%               968µs ± 1%   +3.22%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                             1.41ms ± 2%              1.45ms ± 1%   +2.47%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                             1.89ms ± 1%              1.94ms ± 1%   +2.69%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  186µs ± 3%               185µs ± 2%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  315µs ± 0%               313µs ± 1%   -0.79%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  478µs ± 1%               474µs ± 1%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  636µs ± 1%               633µs ± 1%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                 1.27ms ± 1%              1.26ms ± 1%     ~     (p=0.095 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                1.92ms ± 1%              1.90ms ± 1%   -1.36%  (p=0.016 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                2.57ms ± 2%              2.55ms ± 1%     ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·1                                       54.4µs ± 0%              53.1µs ± 0%   -2.46%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·2                                       52.2µs ± 1%              51.1µs ± 0%   -2.21%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·3                                       65.3µs ± 0%              64.6µs ± 3%     ~     (p=0.151 n=5+5)
      neo/go/fs1-zwrk.go·4                                       80.0µs ± 0%              78.1µs ± 0%   -2.34%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·8                                        133µs ± 1%               130µs ± 0%   -1.92%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·12                                       193µs ± 1%               191µs ± 1%     ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·16                                       260µs ± 1%               254µs ± 1%   -2.14%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                         38.0µs ± 0%              37.0µs ± 0%   -2.47%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                         35.9µs ± 1%              35.1µs ± 0%   -2.10%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                         47.7µs ± 1%              46.7µs ± 1%   -2.11%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                         57.7µs ± 1%              56.6µs ± 1%   -1.85%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                         90.6µs ± 1%              88.8µs ± 0%   -1.97%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         128µs ± 1%               126µs ± 0%   -1.43%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         171µs ± 0%               168µs ± 0%   -1.58%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·1                                    91.2µs ± 0%              71.1µs ± 0%  -22.02%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     109µs ± 1%                81µs ± 1%  -25.66%  (p=0.016 n=4+5)
      neo/go/sqlite-zwrk.go·3                                     124µs ± 0%                96µs ± 1%  -22.71%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     149µs ± 1%               122µs ± 1%  -18.25%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     270µs ± 2%               229µs ± 2%  -15.27%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    410µs ± 2%               351µs ± 3%  -14.41%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    560µs ± 1%               479µs ± 2%  -14.47%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                             84.0µs ± 1%              64.0µs ± 0%  -23.76%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              102µs ± 1%                77µs ± 0%  -24.34%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              113µs ± 0%                85µs ± 1%  -25.08%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              133µs ± 0%               103µs ± 1%  -22.69%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              257µs ± 2%               214µs ± 2%  -16.57%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             417µs ± 3%               328µs ± 2%  -21.20%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             563µs ± 1%               406µs ± 2%  -27.95%  (p=0.008 n=5+5)
      cluster:deco dataset:prod1-1024
      fs1-zwrk.go·1                                              1.80µs ± 0%              1.77µs ± 1%   -1.83%  (p=0.008 n=5+5)
      fs1-zwrk.go·2                                              2.01µs ± 6%              1.91µs ± 5%     ~     (p=0.056 n=5+5)
      fs1-zwrk.go·3                                              2.26µs ± 2%              2.23µs ± 1%     ~     (p=0.135 n=5+5)
      fs1-zwrk.go·4                                              2.61µs ± 0%              2.59µs ± 2%     ~     (p=0.135 n=5+5)
      fs1-zwrk.go·8                                              5.04µs ± 1%              4.96µs ± 0%   -1.48%  (p=0.016 n=5+5)
      fs1-zwrk.go·12                                             7.52µs ± 1%              7.42µs ± 0%   -1.42%  (p=0.008 n=5+5)
      fs1-zwrk.go·16                                             10.0µs ± 0%               9.9µs ± 0%   -1.44%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        103µs ± 1%               102µs ± 0%     ~     (p=0.841 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        161µs ± 1%               162µs ± 1%     ~     (p=0.095 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        212µs ± 1%               210µs ± 1%   -0.90%  (p=0.016 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        268µs ± 1%               269µs ± 1%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        512µs ± 1%               509µs ± 0%   -0.45%  (p=0.032 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       752µs ± 1%               750µs ± 0%     ~     (p=0.190 n=5+4)
      zeo/py/fs1-zwrk.go·16                                      1.00ms ± 6%              0.98ms ± 0%     ~     (p=0.222 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               134µs ± 1%               139µs ± 1%   +3.45%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               230µs ± 1%               240µs ± 0%   +4.68%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               345µs ± 1%               363µs ± 1%   +5.06%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               465µs ± 1%               485µs ± 1%   +4.41%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               929µs ± 1%               956µs ± 1%   +2.89%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                             1.40ms ± 1%              1.44ms ± 1%   +2.94%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                             1.86ms ± 1%              1.91ms ± 1%   +2.47%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  184µs ± 2%               180µs ± 1%   -1.86%  (p=0.016 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  320µs ± 1%               310µs ± 1%   -3.17%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  481µs ± 1%               468µs ± 1%   -2.59%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  638µs ± 1%               624µs ± 1%   -2.15%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                 1.27ms ± 1%              1.25ms ± 0%   -2.09%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                1.89ms ± 0%              1.87ms ± 1%   -1.49%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                2.54ms ± 1%              2.49ms ± 1%   -1.80%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·1                                       41.9µs ± 0%              40.9µs ± 0%   -2.31%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·2                                       44.0µs ± 1%              43.1µs ± 1%   -2.06%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·3                                       54.5µs ± 0%              52.9µs ± 1%   -2.82%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·4                                       66.2µs ± 0%              64.6µs ± 1%   -2.39%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·8                                        116µs ± 2%               113µs ± 2%     ~     (p=0.095 n=5+5)
      neo/go/fs1-zwrk.go·12                                       177µs ± 5%               171µs ± 5%     ~     (p=0.222 n=5+5)
      neo/go/fs1-zwrk.go·16                                       235µs ± 3%               226µs ± 5%     ~     (p=0.056 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                         36.8µs ± 1%              35.7µs ± 1%   -2.95%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                         36.0µs ± 1%              34.8µs ± 0%   -3.34%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                         46.9µs ± 1%              45.9µs ± 0%   -2.09%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                         57.9µs ± 1%              56.0µs ± 1%   -3.18%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                         98.6µs ± 4%              96.7µs ± 2%     ~     (p=0.222 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         155µs ± 8%               144µs ± 5%     ~     (p=0.056 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         208µs ± 5%               200µs ± 3%     ~     (p=0.056 n=5+5)
      neo/go/sqlite-zwrk.go·1                                    85.5µs ± 1%              64.3µs ± 0%  -24.84%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     106µs ± 1%                78µs ± 1%  -25.95%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     123µs ± 2%                95µs ± 1%  -23.01%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     154µs ± 3%               123µs ± 1%  -19.85%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     325µs ± 5%               271µs ± 3%  -16.50%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    507µs ± 3%               424µs ± 2%  -16.39%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    665µs ± 3%               549µs ± 1%  -17.44%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                             82.3µs ± 1%              61.7µs ± 0%  -25.01%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              102µs ± 1%                76µs ± 1%  -25.04%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              118µs ± 1%                90µs ± 1%  -23.38%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              145µs ± 2%               117µs ± 2%  -19.71%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              312µs ± 2%               272µs ± 3%  -12.87%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             500µs ± 2%               406µs ± 2%  -18.82%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             662µs ± 1%               483µs ± 1%  -27.07%  (p=0.008 n=5+5)
      fcb32916
    • Kirill Smelkov's avatar
      . · a407d9dd
      Kirill Smelkov authored
      a407d9dd
    • Kirill Smelkov's avatar
      X on generating own sqlite query wrappers · b66bd11f
      Kirill Smelkov authored
      b66bd11f
  5. 14 Mar, 2018 2 commits
  6. 13 Mar, 2018 1 commit
  7. 12 Mar, 2018 4 commits
  8. 09 Mar, 2018 12 commits
    • Kirill Smelkov's avatar
      X tcpenalty: My draft program to show C-state related penalty · b190e483
      Kirill Smelkov authored
      The penalty turned out to be actually depending on the predictor logic
      inside OS kernel, so this program was canceled. Saving anyway as this
      in some form might become useful in the future.
      b190e483
    • Kirill Smelkov's avatar
      . · 115b25d2
      Kirill Smelkov authored
      115b25d2
    • Kirill Smelkov's avatar
      X rio: localhost timings, C > C1 disabled, zwrk@1s · 26ad577f
      Kirill Smelkov authored
      Compared to C-states enabled it is not clear what is going on - it helps
      a bit to serial cases, but that is close to noise:
      
      ---- 8< ----
      cluster:rio dataset:wczblk1-8
      zeo/py/fs1-zhash.py                                         398µs ± 1%               375µs ± 2%   -5.82%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.py                                      264µs ± 1%               252µs ± 1%   -4.51%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128(!sha1)                  36.9µs ± 6%              33.4µs ± 3%   -9.47%  (p=0.008 n=5+5)
      
      cluster:rio dataset:prod1-1024
      neo/py(!log)/sqlite-zhash.py                                326µs ± 8%               291µs ± 0%  -10.77%  (p=0.008 n=5+5)
      ---- 8< ----
      
      and neo/py/sql timing is _not_ denoised:
      
      ---- 8< ----
      cluster:rio dataset:wczblk1-8
      neo/py(!log)/sql-zhash.py                                   406µs ±39%               376µs ±41%     ~     (p=0.246 n=5+5)
      
      cluster:rio dataset:prod1-1024
      neo/py(!log)/sql-zhash.py                                   342µs ± 4%               374µs ±41%     ~     (p=0.905 n=4+5)
      ---- 8< ----
      
      ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
      
      $ benchstat -split node,cluster,dataset  20180308-rio-ffixed-c-zwrk10s.txt 20180308-rio-ffixed-noc_C1\(1µs\)-zwrk1s.txt
      
      name                                           old pystone/s            new pystone/s            delta
      node:rio
      pystone                                                      140k ±12%                142k ± 3%     ~     (p=1.000 n=5+5)
      
      name                                           old time/op              new time/op              delta
      node:rio
      crc32/py/4K                                                4.79µs ± 1%              4.77µs ± 1%     ~     (p=0.341 n=5+5)
      crc32/go/4K                                                1.49µs ± 0%              1.49µs ± 0%     ~     (p=1.000 n=4+5)
      sha1/py/4K                                                 8.02µs ± 2%              8.07µs ± 4%     ~     (p=1.000 n=5+5)
      sha1/go/4K                                                 8.93µs ± 0%              8.93µs ± 0%     ~     (p=0.400 n=4+4)
      unzlib/py/wczdata                                          25.2µs ± 1%              25.1µs ± 1%     ~     (p=0.421 n=5+5)
      unzlib/go/wczdata                                          23.0µs ± 0%              22.9µs ± 0%   -0.58%  (p=0.008 n=5+5)
      unzlib/py/prod1-avg                                        7.27µs ± 1%              6.85µs ±25%     ~     (p=0.690 n=5+5)
      unzlib/go/prod1-avg                                        5.07µs ± 2%              5.02µs ± 1%     ~     (p=0.095 n=5+5)
      disk/randread/direct/4K-min                                93.1µs ± 1%              93.4µs ± 0%     ~     (p=0.460 n=5+5)
      disk/randread/direct/4K-avg                                 116µs ± 0%               116µs ± 0%     ~     (p=0.238 n=5+5)
      disk/randread/pagecache/4K-min                              570ns ± 1%               570ns ± 1%     ~     (p=0.984 n=5+5)
      disk/randread/pagecache/4K-avg                             1.00µs ± 1%              1.00µs ± 1%     ~     (p=0.357 n=5+5)
      
      name                                           old time/object          new time/object          delta
      cluster:rio dataset:wczblk1-8
      fs1-zhash.py                                               29.0µs ± 5%              29.0µs ± 2%     ~     (p=0.730 n=5+5)
      fs1-zhash.go                                               4.60µs ± 0%              4.60µs ± 0%     ~     (all equal)
      fs1-zhash.go+prefetch128                                   4.74µs ± 3%              4.62µs ± 5%     ~     (p=0.111 n=5+5)
      zeo/py/fs1-zhash.py                                         398µs ± 1%               375µs ± 2%   -5.82%  (p=0.008 n=5+5)
      zeo/py/fs1-zhash.go                                         138µs ± 1%               135µs ± 1%   -2.25%  (p=0.024 n=5+5)
      zeo/py/fs1-zhash.go+prefetch128                            74.5µs ± 2%              73.6µs ± 3%     ~     (p=0.238 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                321µs ± 4%               315µs ± 6%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                155µs ± 2%               155µs ± 5%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zhash.go+prefetch128                    122µs ± 1%               126µs ± 1%   +3.38%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zhash.py                                   406µs ±39%               376µs ±41%     ~     (p=0.246 n=5+5)
      neo/py(!log)/sql-zhash.go                                   181µs ± 6%               183µs ± 2%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sql-zhash.go+prefetch128                       160µs ± 2%               161µs ± 3%     ~     (p=0.841 n=5+5)
      neo/go/fs1-zhash.py                                         223µs ± 6%               216µs ± 1%     ~     (p=0.087 n=5+5)
      neo/go/fs1-zhash.go                                        67.2µs ± 1%              67.9µs ± 1%   +1.04%  (p=0.032 n=5+5)
      neo/go/fs1-zhash.go+prefetch128                            28.8µs ± 3%              28.4µs ± 5%     ~     (p=0.651 n=5+5)
      neo/go/fs1(!sha1)-zhash.go(!sha1)                          43.9µs ± 2%              44.1µs ± 4%     ~     (p=0.627 n=5+5)
      neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1)              18.7µs ± 4%              19.1µs ± 6%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zhash.py                                      264µs ± 1%               252µs ± 1%   -4.51%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.go                                      105µs ± 1%               103µs ± 3%     ~     (p=0.159 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128                         37.9µs ± 9%              38.0µs ± 9%     ~     (p=0.897 n=5+5)
      neo/go/sqlite-zhash.go(!sha1)                              94.4µs ± 3%              93.0µs ± 2%     ~     (p=0.206 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128(!sha1)                  36.9µs ± 6%              33.4µs ± 3%   -9.47%  (p=0.008 n=5+5)
      cluster:rio dataset:prod1-1024
      fs1-zhash.py                                               24.1µs ± 1%              23.8µs ± 2%     ~     (p=0.325 n=5+5)
      fs1-zhash.go                                               3.40µs ± 0%              3.40µs ± 0%     ~     (all equal)
      fs1-zhash.go+prefetch128                                   3.00µs ± 0%              3.16µs ± 8%     ~     (p=0.556 n=4+5)
      zeo/py/fs1-zhash.py                                         352µs ± 1%               346µs ± 2%     ~     (p=0.056 n=5+5)
      zeo/py/fs1-zhash.go                                         116µs ± 2%               114µs ± 1%     ~     (p=0.063 n=5+5)
      zeo/py/fs1-zhash.go+prefetch128                            65.9µs ± 1%              64.4µs ± 2%   -2.34%  (p=0.024 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                326µs ± 8%               291µs ± 0%  -10.77%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                142µs ± 2%               142µs ± 2%     ~     (p=0.952 n=5+5)
      neo/py(!log)/sqlite-zhash.go+prefetch128                    116µs ± 1%               117µs ± 1%     ~     (p=0.357 n=5+5)
      neo/py(!log)/sql-zhash.py                                   342µs ± 4%               374µs ±41%     ~     (p=0.905 n=4+5)
      neo/py(!log)/sql-zhash.go                                   173µs ± 3%               173µs ± 8%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zhash.go+prefetch128                       148µs ± 2%               148µs ± 2%     ~     (p=0.841 n=5+5)
      neo/go/fs1-zhash.py                                         220µs ± 4%               210µs ± 3%     ~     (p=0.095 n=5+5)
      neo/go/fs1-zhash.go                                        49.7µs ± 1%              50.2µs ± 2%     ~     (p=0.286 n=5+5)
      neo/go/fs1-zhash.go+prefetch128                            18.9µs ± 3%              19.4µs ± 2%     ~     (p=0.103 n=5+5)
      neo/go/fs1(!sha1)-zhash.go(!sha1)                          40.7µs ± 1%              40.6µs ± 2%     ~     (p=0.746 n=5+5)
      neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1)              16.2µs ± 2%              15.8µs ± 2%     ~     (p=0.079 n=5+5)
      neo/go/sqlite-zhash.py                                      261µs ± 2%               262µs ± 4%     ~     (p=1.000 n=5+5)
      neo/go/sqlite-zhash.go                                     93.3µs ± 1%              93.8µs ± 1%     ~     (p=0.357 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128                         33.3µs ± 3%              33.4µs ± 6%     ~     (p=0.500 n=5+5)
      neo/go/sqlite-zhash.go(!sha1)                              89.9µs ± 1%              90.9µs ± 4%     ~     (p=0.341 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128(!sha1)                  33.0µs ± 1%              33.2µs ± 2%     ~     (p=0.952 n=5+5)
      
      name                                           old req/s                new req/s                delta
      cluster:rio dataset:wczblk1-8
      fs1-zwrk.go·1                                                300k ± 0%                301k ± 1%     ~     (p=0.151 n=5+5)
      fs1-zwrk.go·2                                                550k ± 0%                551k ± 0%     ~     (p=0.548 n=5+5)
      fs1-zwrk.go·3                                                816k ± 0%                814k ± 0%     ~     (p=0.222 n=5+5)
      fs1-zwrk.go·4                                               1.08M ± 0%               1.08M ± 1%     ~     (p=0.690 n=5+5)
      fs1-zwrk.go·8                                               1.43M ± 0%               1.43M ± 0%     ~     (p=0.548 n=5+5)
      fs1-zwrk.go·12                                              1.55M ± 0%               1.55M ± 0%     ~     (p=0.310 n=5+5)
      fs1-zwrk.go·16                                              1.55M ± 1%               1.54M ± 0%     ~     (p=0.222 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        7.40k ± 0%               7.50k ± 1%   +1.32%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        8.89k ± 0%               8.89k ± 2%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        9.62k ± 1%               9.61k ± 1%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        9.91k ± 0%               9.92k ± 1%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        10.3k ± 0%               10.2k ± 2%     ~     (p=0.690 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       10.4k ± 1%               10.6k ± 1%   +1.95%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·16                                       10.5k ± 1%               10.5k ± 1%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               6.82k ± 1%               6.70k ± 2%     ~     (p=0.095 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               8.63k ± 1%               8.54k ± 0%     ~     (p=0.111 n=5+4)
      neo/py(!log)/sqlite-zwrk.go·3                               8.56k ± 2%               8.43k ± 1%     ~     (p=0.095 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               8.54k ± 1%               8.37k ± 4%     ~     (p=0.056 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               8.53k ± 1%               8.44k ± 0%   -1.04%  (p=0.016 n=5+4)
      neo/py(!log)/sqlite-zwrk.go·12                              8.56k ± 0%               8.23k ± 5%   -3.82%  (p=0.016 n=4+5)
      neo/py(!log)/sqlite-zwrk.go·16                              8.53k ± 1%               8.46k ± 1%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  5.57k ± 2%               5.66k ± 2%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  6.64k ± 2%               6.75k ± 2%     ~     (p=0.095 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  6.60k ± 1%               6.68k ± 2%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  6.54k ± 2%               6.70k ± 2%   +2.49%  (p=0.032 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                  6.64k ± 1%               6.50k ± 5%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                 6.64k ± 2%               6.67k ± 2%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                 6.62k ± 2%               6.72k ± 3%     ~     (p=0.310 n=5+5)
      neo/go/fs1-zwrk.go·1                                        15.6k ± 0%               15.7k ± 0%     ~     (p=0.095 n=5+5)
      neo/go/fs1-zwrk.go·2                                        30.0k ± 0%               30.2k ± 0%   +0.78%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·3                                        39.6k ± 0%               39.8k ± 0%   +0.47%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·4                                        49.5k ± 0%               49.7k ± 0%   +0.30%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·8                                        69.0k ± 0%               68.8k ± 0%     ~     (p=0.056 n=5+5)
      neo/go/fs1-zwrk.go·12                                       73.3k ± 0%               73.0k ± 0%   -0.44%  (p=0.032 n=5+5)
      neo/go/fs1-zwrk.go·16                                       74.2k ± 0%               73.7k ± 0%   -0.61%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                          25.6k ± 1%               25.5k ± 3%     ~     (p=0.690 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                          47.3k ± 0%               47.9k ± 0%   +1.21%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                          59.5k ± 0%               59.7k ± 0%   +0.36%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                          72.2k ± 0%               72.7k ± 0%   +0.66%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          96.6k ± 0%               97.0k ± 0%   +0.37%  (p=0.016 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                          110k ± 0%                110k ± 0%     ~     (p=0.690 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                          114k ± 0%                113k ± 1%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     9.89k ± 0%               9.95k ± 1%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     18.1k ± 0%               18.4k ± 0%   +1.93%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     25.0k ± 0%               25.5k ± 0%   +1.90%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     29.7k ± 0%               30.4k ± 0%   +2.23%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     38.1k ± 0%               39.4k ± 1%   +3.56%  (p=0.016 n=4+5)
      neo/go/sqlite-zwrk.go·12                                    40.5k ± 2%               40.7k ± 2%     ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    41.3k ± 1%               40.8k ± 2%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              11.0k ± 0%               11.1k ± 0%   +1.11%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              19.6k ± 0%               20.1k ± 0%   +2.36%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              27.2k ± 0%               27.9k ± 0%   +2.43%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              33.1k ± 0%               34.2k ± 0%   +3.31%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              42.4k ± 2%               44.0k ± 1%   +3.60%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             42.8k ± 1%               43.4k ± 2%     ~     (p=0.095 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             42.8k ± 3%               41.4k ± 2%   -3.25%  (p=0.016 n=5+5)
      cluster:rio dataset:prod1-1024
      fs1-zwrk.go·1                                                460k ± 1%                461k ± 1%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·2                                                901k ± 2%                906k ± 1%     ~     (p=0.421 n=5+5)
      fs1-zwrk.go·3                                               1.34M ± 1%               1.35M ± 0%     ~     (p=0.151 n=5+5)
      fs1-zwrk.go·4                                               1.78M ± 0%               1.78M ± 1%     ~     (p=0.690 n=5+5)
      fs1-zwrk.go·8                                               2.37M ± 1%               2.33M ± 1%   -1.46%  (p=0.032 n=5+5)
      fs1-zwrk.go·12                                              2.40M ± 0%               2.40M ± 0%     ~     (p=0.222 n=5+5)
      fs1-zwrk.go·16                                              2.40M ± 0%               2.40M ± 0%     ~     (p=0.310 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        8.87k ± 0%               9.06k ± 1%   +2.15%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        11.4k ± 1%               11.7k ± 2%   +2.18%  (p=0.016 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        12.6k ± 1%               12.9k ± 1%   +2.32%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        13.1k ± 1%               13.4k ± 3%     ~     (p=0.095 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        13.7k ± 0%               13.9k ± 2%   +1.50%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       13.8k ± 1%               14.2k ± 2%   +2.85%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·16                                       13.9k ± 1%               14.4k ± 1%   +3.31%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               7.23k ± 0%               7.28k ± 2%     ~     (p=0.222 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               8.71k ± 1%               8.70k ± 3%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               8.71k ± 1%               8.73k ± 3%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               8.69k ± 1%               8.69k ± 1%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               8.75k ± 1%               8.77k ± 2%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                              8.66k ± 2%               8.59k ± 7%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                              8.67k ± 2%               8.67k ± 1%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  5.83k ± 1%               5.98k ± 1%   +2.55%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  6.83k ± 1%               6.86k ± 4%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  6.80k ± 1%               6.86k ± 3%     ~     (p=0.222 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  6.76k ± 2%               6.90k ± 1%   +2.02%  (p=0.016 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                  6.68k ± 2%               6.62k ± 6%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                 6.84k ± 2%               6.78k ± 2%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                 6.81k ± 1%               6.78k ± 3%     ~     (p=0.222 n=5+5)
      neo/go/fs1-zwrk.go·1                                        21.8k ± 0%               21.6k ± 0%   -1.08%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·2                                        39.2k ± 0%               39.0k ± 0%   -0.42%  (p=0.016 n=5+5)
      neo/go/fs1-zwrk.go·3                                        51.4k ± 0%               51.0k ± 1%   -0.66%  (p=0.016 n=5+5)
      neo/go/fs1-zwrk.go·4                                        62.9k ± 0%               62.3k ± 0%   -0.97%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·8                                        82.9k ± 2%               79.7k ± 1%   -3.87%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·12                                       88.0k ± 2%               81.8k ± 2%   -7.00%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·16                                       89.6k ± 3%               80.8k ± 3%   -9.89%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                          26.6k ± 0%               26.9k ± 1%   +1.27%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                          48.7k ± 0%               49.3k ± 0%   +1.10%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                          62.0k ± 0%               62.3k ± 0%   +0.53%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                          74.4k ± 0%               74.7k ± 0%   +0.39%  (p=0.016 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          94.2k ± 0%               93.5k ± 2%   -0.76%  (p=0.016 n=4+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                          104k ± 5%                 97k ± 2%   -6.48%  (p=0.016 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                          107k ± 2%                 95k ± 3%  -11.82%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     11.1k ± 1%               11.0k ± 0%   -0.58%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     19.4k ± 0%               19.3k ± 0%   -0.84%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     26.7k ± 0%               26.4k ± 0%   -0.93%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     32.1k ± 0%               31.8k ± 0%   -1.04%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     37.4k ± 2%               38.6k ± 1%   +3.25%  (p=0.016 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    35.8k ± 3%               36.5k ± 2%     ~     (p=0.056 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    35.0k ± 3%               36.0k ± 1%   +2.79%  (p=0.032 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              11.5k ± 0%               11.4k ± 0%   -1.34%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              19.9k ± 1%               19.9k ± 0%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              27.3k ± 1%               27.4k ± 0%     ~     (p=0.310 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              33.1k ± 0%               33.3k ± 0%   +0.70%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              37.6k ± 2%               38.8k ± 2%   +3.32%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             36.3k ± 4%               36.0k ± 2%     ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             35.2k ± 3%               35.4k ± 1%     ~     (p=1.000 n=5+5)
      
      name                                           old latency-time/object  new latency-time/object  delta
      cluster:rio dataset:wczblk1-8
      fs1-zwrk.go·1                                              3.33µs ± 0%              3.32µs ± 1%     ~     (p=0.151 n=5+5)
      fs1-zwrk.go·2                                              3.63µs ± 0%              3.63µs ± 0%     ~     (p=0.500 n=5+5)
      fs1-zwrk.go·3                                              3.68µs ± 0%              3.69µs ± 0%     ~     (p=0.230 n=5+5)
      fs1-zwrk.go·4                                              3.70µs ± 0%              3.70µs ± 1%     ~     (p=0.643 n=5+5)
      fs1-zwrk.go·8                                              5.60µs ± 0%              5.61µs ± 0%     ~     (p=0.595 n=5+5)
      fs1-zwrk.go·12                                             7.75µs ± 0%              7.76µs ± 0%     ~     (p=0.286 n=5+5)
      fs1-zwrk.go·16                                             10.3µs ± 1%              10.4µs ± 0%     ~     (p=0.222 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        135µs ± 0%               133µs ± 1%   -1.30%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        225µs ± 0%               225µs ± 2%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        312µs ± 1%               312µs ± 1%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        403µs ± 0%               403µs ± 1%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        778µs ± 0%               781µs ± 2%     ~     (p=0.690 n=5+5)
      zeo/py/fs1-zwrk.go·12                                      1.15ms ± 1%              1.13ms ± 1%   -1.91%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·16                                      1.53ms ± 1%              1.52ms ± 1%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               147µs ± 1%               149µs ± 2%     ~     (p=0.095 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               232µs ± 1%               234µs ± 0%     ~     (p=0.111 n=5+4)
      neo/py(!log)/sqlite-zwrk.go·3                               350µs ± 2%               356µs ± 1%     ~     (p=0.095 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               469µs ± 1%               478µs ± 4%     ~     (p=0.056 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               938µs ± 1%               948µs ± 0%   +1.06%  (p=0.016 n=5+4)
      neo/py(!log)/sqlite-zwrk.go·12                             1.40ms ± 0%              1.46ms ± 5%   +4.10%  (p=0.016 n=4+5)
      neo/py(!log)/sqlite-zwrk.go·16                             1.88ms ± 1%              1.89ms ± 1%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  180µs ± 2%               177µs ± 2%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  301µs ± 2%               297µs ± 2%     ~     (p=0.095 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  454µs ± 1%               449µs ± 2%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  612µs ± 2%               597µs ± 2%   -2.43%  (p=0.032 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                 1.20ms ± 1%              1.23ms ± 5%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                1.81ms ± 2%              1.80ms ± 2%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                2.42ms ± 2%              2.38ms ± 3%     ~     (p=0.310 n=5+5)
      neo/go/fs1-zwrk.go·1                                       64.1µs ± 0%              63.9µs ± 0%     ~     (p=0.095 n=5+5)
      neo/go/fs1-zwrk.go·2                                       66.7µs ± 0%              66.2µs ± 0%   -0.77%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·3                                       75.8µs ± 0%              75.5µs ± 0%   -0.47%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·4                                       80.8µs ± 0%              80.6µs ± 0%   -0.30%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·8                                        116µs ± 0%               116µs ± 0%     ~     (p=0.056 n=5+5)
      neo/go/fs1-zwrk.go·12                                       164µs ± 0%               164µs ± 0%   +0.45%  (p=0.032 n=5+5)
      neo/go/fs1-zwrk.go·16                                       216µs ± 0%               217µs ± 0%   +0.62%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                         39.1µs ± 1%              39.3µs ± 3%     ~     (p=0.690 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                         42.2µs ± 0%              41.7µs ± 0%   -1.20%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                         50.4µs ± 0%              50.3µs ± 0%   -0.36%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                         55.4µs ± 0%              55.0µs ± 0%   -0.65%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                         82.8µs ± 0%              82.5µs ± 0%   -0.36%  (p=0.016 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         109µs ± 0%               109µs ± 0%     ~     (p=0.690 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         141µs ± 0%               141µs ± 1%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     101µs ± 0%               100µs ± 1%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     110µs ± 0%               108µs ± 0%   -1.89%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     120µs ± 0%               118µs ± 0%   -1.86%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     135µs ± 0%               132µs ± 0%   -2.19%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     210µs ± 0%               203µs ± 1%   -3.44%  (p=0.016 n=4+5)
      neo/go/sqlite-zwrk.go·12                                    297µs ± 2%               295µs ± 2%     ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    388µs ± 1%               393µs ± 2%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                             90.9µs ± 0%              89.9µs ± 0%   -1.10%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              102µs ± 0%               100µs ± 0%   -2.31%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              110µs ± 0%               108µs ± 0%   -2.38%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              121µs ± 0%               117µs ± 0%   -3.20%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              188µs ± 2%               182µs ± 1%   -3.48%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             280µs ± 2%               277µs ± 2%     ~     (p=0.095 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             374µs ± 3%               386µs ± 2%   +3.35%  (p=0.016 n=5+5)
      cluster:rio dataset:prod1-1024
      fs1-zwrk.go·1                                              2.17µs ± 1%              2.17µs ± 1%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·2                                              2.22µs ± 1%              2.21µs ± 1%     ~     (p=0.421 n=5+5)
      fs1-zwrk.go·3                                              2.24µs ± 1%              2.23µs ± 0%     ~     (p=0.135 n=5+5)
      fs1-zwrk.go·4                                              2.25µs ± 0%              2.24µs ± 1%     ~     (p=0.690 n=5+5)
      fs1-zwrk.go·8                                              3.38µs ± 1%              3.43µs ± 1%   +1.48%  (p=0.032 n=5+5)
      fs1-zwrk.go·12                                             5.00µs ± 0%              4.99µs ± 0%     ~     (p=0.270 n=5+5)
      fs1-zwrk.go·16                                             6.67µs ± 0%              6.65µs ± 0%     ~     (p=0.286 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        113µs ± 0%               110µs ± 1%   -2.10%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        175µs ± 1%               171µs ± 2%   -2.13%  (p=0.016 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        238µs ± 1%               233µs ± 1%   -2.26%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        306µs ± 1%               300µs ± 3%     ~     (p=0.095 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        582µs ± 0%               574µs ± 2%   -1.47%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       868µs ± 1%               844µs ± 2%   -2.77%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·16                                      1.15ms ± 1%              1.11ms ± 1%   -3.20%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               138µs ± 0%               137µs ± 2%     ~     (p=0.222 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               230µs ± 1%               230µs ± 3%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               344µs ± 1%               344µs ± 3%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               461µs ± 1%               461µs ± 1%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               914µs ± 1%               912µs ± 2%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                             1.39ms ± 2%              1.40ms ± 7%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                             1.85ms ± 2%              1.85ms ± 1%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  172µs ± 1%               167µs ± 1%   -2.49%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  293µs ± 1%               292µs ± 5%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  441µs ± 1%               437µs ± 3%     ~     (p=0.222 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  592µs ± 2%               580µs ± 1%   -1.99%  (p=0.016 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                 1.20ms ± 3%              1.21ms ± 6%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                1.75ms ± 2%              1.77ms ± 2%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                2.35ms ± 1%              2.36ms ± 3%     ~     (p=0.222 n=5+5)
      neo/go/fs1-zwrk.go·1                                       45.9µs ± 0%              46.4µs ± 0%   +1.09%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·2                                       51.0µs ± 0%              51.3µs ± 0%   +0.43%  (p=0.016 n=5+5)
      neo/go/fs1-zwrk.go·3                                       58.4µs ± 0%              58.8µs ± 1%   +0.67%  (p=0.016 n=5+5)
      neo/go/fs1-zwrk.go·4                                       63.6µs ± 0%              64.3µs ± 0%   +0.98%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·8                                       96.5µs ± 2%             100.4µs ± 1%   +4.03%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·12                                       136µs ± 2%               147µs ± 2%   +7.53%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·16                                       179µs ± 3%               198µs ± 3%  +10.98%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                         37.6µs ± 0%              37.2µs ± 1%   -1.25%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                         41.0µs ± 0%              40.6µs ± 0%   -1.09%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                         48.4µs ± 0%              48.1µs ± 0%   -0.53%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                         53.8µs ± 0%              53.6µs ± 0%   -0.39%  (p=0.016 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                         84.9µs ± 0%              85.6µs ± 2%   +0.78%  (p=0.016 n=4+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         116µs ± 5%               124µs ± 2%   +6.87%  (p=0.016 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         149µs ± 2%               169µs ± 3%  +13.44%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·1                                    90.5µs ± 1%              91.0µs ± 0%   +0.58%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     103µs ± 0%               104µs ± 0%   +0.85%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     112µs ± 0%               114µs ± 0%   +0.94%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     124µs ± 0%               126µs ± 0%   +1.05%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     214µs ± 3%               207µs ± 1%   -3.16%  (p=0.016 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    336µs ± 3%               329µs ± 2%     ~     (p=0.056 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    458µs ± 3%               445µs ± 1%   -2.73%  (p=0.032 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                             86.6µs ± 0%              87.8µs ± 0%   +1.36%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              100µs ± 1%               101µs ± 0%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              110µs ± 1%               109µs ± 0%     ~     (p=0.310 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              121µs ± 0%               120µs ± 0%   -0.69%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              213µs ± 2%               206µs ± 2%   -3.22%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             331µs ± 4%               333µs ± 3%     ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             454µs ± 3%               452µs ± 1%     ~     (p=1.000 n=5+5)
      26ad577f
    • Kirill Smelkov's avatar
      X rio: localhost timings, Cenabled, zwrk@10s · 9282fca1
      Kirill Smelkov authored
      Compared to zwrk@1s it helps but only a very tiny tiny bit: Besides
      everything else that might be noise the improvements are:
      
      ---- 8< ----
      cluster:rio dataset:prod1-1024
      neo/go/fs1-zwrk.go·16                                       200µs ± 3%               179µs ± 3%  -10.62%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         128µs ± 2%               116µs ± 5%   -9.16%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         178µs ± 3%               149µs ± 2%  -16.06%  (p=0.008 n=5+5)
      ---- 8< ----
      
      and noise on neo/py/sql is back:
      
      ---- 8< ----
      cluster:rio dataset:wczblk1-8
      neo/py(!log)/sql-zhash.py                                   342µs ± 2%               406µs ±39%     ~     (p=0.063 n=4+5)
      ---- 8< ----
      
      The next commit will add measurements with C-states disabled.
      
      ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
      
      $ benchstat -split node,cluster,dataset  20180308-rio-ffixed-c-zwrk1s.txt 20180308-rio-ffixed-c-zwrk10s.txt
      
      name                                           old pystone/s            new pystone/s            delta
      node:rio
      pystone                                                      144k ± 3%                140k ±12%     ~     (p=0.690 n=5+5)
      
      name                                           old time/op              new time/op              delta
      node:rio
      crc32/py/4K                                                4.79µs ± 1%              4.79µs ± 1%     ~     (p=0.889 n=5+5)
      crc32/go/4K                                                1.49µs ± 0%              1.49µs ± 0%     ~     (p=0.873 n=5+4)
      sha1/py/4K                                                 7.98µs ± 1%              8.02µs ± 2%     ~     (p=0.548 n=5+5)
      sha1/go/4K                                                 9.29µs ±12%              8.93µs ± 0%     ~     (p=0.111 n=5+4)
      unzlib/py/wczdata                                          25.2µs ± 1%              25.2µs ± 1%     ~     (p=0.690 n=5+5)
      unzlib/go/wczdata                                          23.0µs ± 0%              23.0µs ± 0%   +0.17%  (p=0.016 n=5+5)
      unzlib/py/prod1-avg                                        7.26µs ± 3%              7.27µs ± 1%     ~     (p=1.000 n=5+5)
      unzlib/go/prod1-avg                                        5.06µs ± 1%              5.07µs ± 2%     ~     (p=0.690 n=5+5)
      disk/randread/direct/4K-min                                93.0µs ± 0%              93.1µs ± 1%     ~     (p=0.690 n=5+5)
      disk/randread/direct/4K-avg                                 116µs ± 1%               116µs ± 0%     ~     (p=0.373 n=5+5)
      disk/randread/pagecache/4K-min                              570ns ± 1%               570ns ± 1%     ~     (p=1.000 n=5+5)
      disk/randread/pagecache/4K-avg                              995ns ± 0%               999ns ± 1%     ~     (p=0.135 n=5+5)
      
      name                                           old time/object          new time/object          delta
      cluster:rio dataset:wczblk1-8
      fs1-zhash.py                                               28.9µs ± 1%              29.0µs ± 5%     ~     (p=0.730 n=4+5)
      fs1-zhash.go                                               4.60µs ± 0%              4.60µs ± 0%     ~     (all equal)
      fs1-zhash.go+prefetch128                                   4.62µs ± 3%              4.74µs ± 3%     ~     (p=0.119 n=5+5)
      zeo/py/fs1-zhash.py                                         412µs ± 4%               398µs ± 1%     ~     (p=0.095 n=5+5)
      zeo/py/fs1-zhash.go                                         139µs ± 3%               138µs ± 1%     ~     (p=0.889 n=5+5)
      zeo/py/fs1-zhash.go+prefetch128                            75.2µs ± 5%              74.5µs ± 2%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                315µs ± 3%               321µs ± 4%     ~     (p=0.246 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                156µs ± 6%               155µs ± 2%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sqlite-zhash.go+prefetch128                    125µs ± 2%               122µs ± 1%   -2.28%  (p=0.032 n=5+5)
      neo/py(!log)/sql-zhash.py                                   342µs ± 2%               406µs ±39%     ~     (p=0.063 n=4+5)
      neo/py(!log)/sql-zhash.go                                   178µs ± 2%               181µs ± 6%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zhash.go+prefetch128                       159µs ± 2%               160µs ± 2%     ~     (p=1.000 n=5+5)
      neo/go/fs1-zhash.py                                         224µs ± 4%               223µs ± 6%     ~     (p=0.548 n=5+5)
      neo/go/fs1-zhash.go                                        67.0µs ± 1%              67.2µs ± 1%     ~     (p=0.810 n=5+5)
      neo/go/fs1-zhash.go+prefetch128                            28.3µs ± 1%              28.8µs ± 3%     ~     (p=0.175 n=5+5)
      neo/go/fs1(!sha1)-zhash.go(!sha1)                          45.0µs ± 6%              43.9µs ± 2%     ~     (p=0.516 n=5+5)
      neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1)              19.0µs ± 3%              18.7µs ± 4%     ~     (p=0.365 n=5+5)
      neo/go/sqlite-zhash.py                                      266µs ± 2%               264µs ± 1%     ~     (p=1.000 n=5+5)
      neo/go/sqlite-zhash.go                                      103µs ± 2%               105µs ± 1%     ~     (p=0.143 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128                         37.6µs ± 2%              37.9µs ± 9%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zhash.go(!sha1)                              94.7µs ± 1%              94.4µs ± 3%     ~     (p=0.500 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128(!sha1)                  35.1µs ± 6%              36.9µs ± 6%     ~     (p=0.230 n=5+5)
      cluster:rio dataset:prod1-1024
      fs1-zhash.py                                               24.2µs ± 1%              24.1µs ± 1%     ~     (p=0.540 n=4+5)
      fs1-zhash.go                                               3.40µs ± 0%              3.40µs ± 0%     ~     (all equal)
      fs1-zhash.go+prefetch128                                   3.06µs ± 2%              3.00µs ± 0%     ~     (p=0.095 n=5+4)
      zeo/py/fs1-zhash.py                                         368µs ± 1%               352µs ± 1%   -4.55%  (p=0.008 n=5+5)
      zeo/py/fs1-zhash.go                                         115µs ± 2%               116µs ± 2%     ~     (p=0.730 n=5+5)
      zeo/py/fs1-zhash.go+prefetch128                            65.6µs ± 1%              65.9µs ± 1%     ~     (p=0.508 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                316µs ± 6%               326µs ± 8%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                142µs ± 5%               142µs ± 2%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sqlite-zhash.go+prefetch128                    116µs ± 1%               116µs ± 1%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sql-zhash.py                                   339µs ± 5%               342µs ± 4%     ~     (p=1.000 n=4+4)
      neo/py(!log)/sql-zhash.go                                   172µs ± 1%               173µs ± 3%     ~     (p=0.579 n=5+5)
      neo/py(!log)/sql-zhash.go+prefetch128                       150µs ± 1%               148µs ± 2%     ~     (p=0.151 n=5+5)
      neo/go/fs1-zhash.py                                         219µs ± 2%               220µs ± 4%     ~     (p=1.000 n=5+5)
      neo/go/fs1-zhash.go                                        49.9µs ± 1%              49.7µs ± 1%     ~     (p=0.421 n=5+5)
      neo/go/fs1-zhash.go+prefetch128                            19.1µs ± 3%              18.9µs ± 3%     ~     (p=0.540 n=5+5)
      neo/go/fs1(!sha1)-zhash.go(!sha1)                          41.1µs ± 2%              40.7µs ± 1%     ~     (p=0.333 n=5+5)
      neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1)              16.2µs ± 5%              16.2µs ± 2%     ~     (p=0.873 n=5+5)
      neo/go/sqlite-zhash.py                                      261µs ± 5%               261µs ± 2%     ~     (p=1.000 n=5+5)
      neo/go/sqlite-zhash.go                                     94.3µs ± 1%              93.3µs ± 1%     ~     (p=0.087 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128                         33.6µs ± 5%              33.3µs ± 3%     ~     (p=0.810 n=5+5)
      neo/go/sqlite-zhash.go(!sha1)                              90.3µs ± 2%              89.9µs ± 1%     ~     (p=0.738 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128(!sha1)                  33.0µs ± 4%              33.0µs ± 1%     ~     (p=0.952 n=5+5)
      
      name                                           old req/s                new req/s                delta
      cluster:rio dataset:wczblk1-8
      fs1-zwrk.go·1                                                301k ± 0%                300k ± 0%     ~     (p=0.056 n=5+5)
      fs1-zwrk.go·2                                                550k ± 3%                550k ± 0%     ~     (p=0.548 n=5+5)
      fs1-zwrk.go·3                                                817k ± 1%                816k ± 0%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·4                                               1.08M ± 0%               1.08M ± 0%     ~     (p=0.310 n=5+5)
      fs1-zwrk.go·8                                               1.42M ± 0%               1.43M ± 0%     ~     (p=0.056 n=5+5)
      fs1-zwrk.go·12                                              1.55M ± 0%               1.55M ± 0%     ~     (p=0.548 n=5+5)
      fs1-zwrk.go·16                                              1.55M ± 0%               1.55M ± 1%     ~     (p=0.841 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        7.38k ± 1%               7.40k ± 0%     ~     (p=0.222 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        8.96k ± 2%               8.89k ± 0%     ~     (p=0.690 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        9.66k ± 3%               9.62k ± 1%     ~     (p=0.690 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        9.87k ± 1%               9.91k ± 0%     ~     (p=0.222 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        10.3k ± 1%               10.3k ± 0%     ~     (p=0.222 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       10.4k ± 1%               10.4k ± 1%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zwrk.go·16                                       10.5k ± 1%               10.5k ± 1%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               6.88k ± 2%               6.82k ± 1%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               8.63k ± 3%               8.63k ± 1%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               8.66k ± 0%               8.56k ± 2%     ~     (p=0.111 n=4+5)
      neo/py(!log)/sqlite-zwrk.go·4                               8.71k ± 1%               8.54k ± 1%   -1.95%  (p=0.016 n=4+5)
      neo/py(!log)/sqlite-zwrk.go·8                               8.60k ± 2%               8.53k ± 1%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                              8.63k ± 2%               8.56k ± 0%     ~     (p=0.190 n=5+4)
      neo/py(!log)/sqlite-zwrk.go·16                              8.54k ± 3%               8.53k ± 1%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  5.69k ± 1%               5.57k ± 2%   -2.20%  (p=0.032 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  6.73k ± 5%               6.64k ± 2%     ~     (p=0.222 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  6.69k ± 2%               6.60k ± 1%     ~     (p=0.222 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  6.60k ±11%               6.54k ± 2%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                  6.65k ± 2%               6.64k ± 1%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                 6.58k ±11%               6.64k ± 2%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                 6.70k ± 1%               6.62k ± 2%     ~     (p=0.413 n=4+5)
      neo/go/fs1-zwrk.go·1                                        15.7k ± 0%               15.6k ± 0%     ~     (p=0.095 n=5+5)
      neo/go/fs1-zwrk.go·2                                        30.3k ± 0%               30.0k ± 0%   -1.12%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·3                                        39.8k ± 0%               39.6k ± 0%   -0.49%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·4                                        49.7k ± 0%               49.5k ± 0%   -0.41%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·8                                        68.7k ± 1%               69.0k ± 0%     ~     (p=0.222 n=5+5)
      neo/go/fs1-zwrk.go·12                                       73.0k ± 0%               73.3k ± 0%     ~     (p=0.095 n=5+5)
      neo/go/fs1-zwrk.go·16                                       73.9k ± 0%               74.2k ± 0%   +0.38%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                          25.6k ± 3%               25.6k ± 1%     ~     (p=0.690 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                          47.8k ± 0%               47.3k ± 0%   -1.02%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                          59.6k ± 0%               59.5k ± 0%     ~     (p=0.056 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                          72.7k ± 0%               72.2k ± 0%   -0.66%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          97.0k ± 0%               96.6k ± 0%     ~     (p=0.056 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                          109k ± 1%                110k ± 0%     ~     (p=0.222 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                          113k ± 1%                114k ± 0%     ~     (p=0.056 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     9.88k ± 1%               9.89k ± 0%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     18.4k ± 0%               18.1k ± 0%   -1.38%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     25.5k ± 0%               25.0k ± 0%   -2.00%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     30.4k ± 0%               29.7k ± 0%   -2.24%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     39.5k ± 0%               38.1k ± 0%   -3.72%  (p=0.016 n=5+4)
      neo/go/sqlite-zwrk.go·12                                    40.9k ± 1%               40.5k ± 2%     ~     (p=0.095 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    40.4k ± 2%               41.3k ± 1%   +2.15%  (p=0.032 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              11.0k ± 1%               11.0k ± 0%     ~     (p=0.310 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              19.9k ± 0%               19.6k ± 0%   -1.25%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              27.7k ± 0%               27.2k ± 0%   -1.89%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              34.0k ± 1%               33.1k ± 0%   -2.60%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              43.8k ± 1%               42.4k ± 2%   -3.00%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             42.8k ± 2%               42.8k ± 1%     ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             40.9k ± 2%               42.8k ± 3%   +4.65%  (p=0.008 n=5+5)
      cluster:rio dataset:prod1-1024
      fs1-zwrk.go·1                                                462k ± 1%                460k ± 1%     ~     (p=0.690 n=5+5)
      fs1-zwrk.go·2                                                910k ± 1%                901k ± 2%     ~     (p=0.095 n=5+5)
      fs1-zwrk.go·3                                               1.35M ± 0%               1.34M ± 1%   -1.12%  (p=0.032 n=5+5)
      fs1-zwrk.go·4                                               1.79M ± 1%               1.78M ± 0%   -0.73%  (p=0.016 n=5+5)
      fs1-zwrk.go·8                                               2.38M ± 1%               2.37M ± 1%     ~     (p=0.548 n=5+5)
      fs1-zwrk.go·12                                              2.40M ± 1%               2.40M ± 0%     ~     (p=0.421 n=5+5)
      fs1-zwrk.go·16                                              2.40M ± 0%               2.40M ± 0%     ~     (p=0.841 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        8.91k ± 2%               8.87k ± 0%     ~     (p=0.310 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        11.7k ± 1%               11.4k ± 1%   -2.04%  (p=0.016 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        13.0k ± 1%               12.6k ± 1%   -3.20%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        13.4k ± 2%               13.1k ± 1%     ~     (p=0.056 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        14.2k ± 2%               13.7k ± 0%   -3.44%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       14.1k ± 2%               13.8k ± 1%   -1.88%  (p=0.032 n=5+5)
      zeo/py/fs1-zwrk.go·16                                       14.4k ± 2%               13.9k ± 1%   -3.29%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               7.12k ± 2%               7.23k ± 0%     ~     (p=0.095 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               8.37k ± 6%               8.71k ± 1%   +4.06%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               8.60k ± 1%               8.71k ± 1%   +1.25%  (p=0.032 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               8.40k ± 8%               8.69k ± 1%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               8.61k ± 3%               8.75k ± 1%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                              8.56k ± 2%               8.66k ± 2%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                              8.46k ± 5%               8.67k ± 2%     ~     (p=0.222 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  5.78k ± 5%               5.83k ± 1%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  6.77k ± 4%               6.83k ± 1%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  6.85k ± 1%               6.80k ± 1%     ~     (p=0.095 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  6.79k ± 2%               6.76k ± 2%     ~     (p=0.794 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                  6.80k ± 5%               6.68k ± 2%     ~     (p=0.222 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                 6.50k ± 5%               6.84k ± 2%     ~     (p=0.095 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                 6.81k ± 1%               6.81k ± 1%     ~     (p=1.000 n=5+5)
      neo/go/fs1-zwrk.go·1                                        21.6k ± 1%               21.8k ± 0%     ~     (p=0.095 n=5+5)
      neo/go/fs1-zwrk.go·2                                        39.2k ± 1%               39.2k ± 0%     ~     (p=0.690 n=5+5)
      neo/go/fs1-zwrk.go·3                                        51.3k ± 0%               51.4k ± 0%     ~     (p=0.310 n=5+5)
      neo/go/fs1-zwrk.go·4                                        62.7k ± 0%               62.9k ± 0%   +0.30%  (p=0.016 n=5+5)
      neo/go/fs1-zwrk.go·8                                        81.7k ± 1%               82.9k ± 2%   +1.50%  (p=0.032 n=5+5)
      neo/go/fs1-zwrk.go·12                                       82.1k ± 3%               88.0k ± 2%   +7.14%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·16                                       80.1k ± 3%               89.6k ± 3%  +11.90%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                          26.5k ± 1%               26.6k ± 0%     ~     (p=0.690 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                          49.1k ± 0%               48.7k ± 0%   -0.65%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                          62.2k ± 0%               62.0k ± 0%     ~     (p=0.151 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                          74.2k ± 0%               74.4k ± 0%     ~     (p=0.421 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          92.4k ± 1%               94.2k ± 0%   +2.01%  (p=0.016 n=5+4)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         94.1k ± 2%              103.6k ± 5%  +10.13%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         90.0k ± 3%              107.2k ± 2%  +19.10%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     10.9k ± 1%               11.1k ± 1%   +1.37%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     19.3k ± 0%               19.4k ± 0%   +0.80%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     26.4k ± 1%               26.7k ± 0%   +0.86%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     31.8k ± 0%               32.1k ± 0%   +1.02%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     38.1k ± 3%               37.4k ± 2%     ~     (p=0.310 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    37.1k ± 2%               35.8k ± 3%   -3.52%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    36.3k ± 2%               35.0k ± 3%   -3.60%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              11.5k ± 1%               11.5k ± 0%     ~     (p=0.056 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              20.1k ± 0%               19.9k ± 1%   -0.77%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              27.6k ± 0%               27.3k ± 1%   -1.08%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              33.5k ± 2%               33.1k ± 0%   -1.32%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              40.0k ± 1%               37.6k ± 2%   -5.99%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             37.9k ± 0%               36.3k ± 4%   -4.29%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             36.7k ± 1%               35.2k ± 3%   -3.99%  (p=0.008 n=5+5)
      
      name                                           old latency-time/object  new latency-time/object  delta
      cluster:rio dataset:wczblk1-8
      fs1-zwrk.go·1                                              3.32µs ± 0%              3.33µs ± 0%   +0.42%  (p=0.048 n=5+5)
      fs1-zwrk.go·2                                              3.64µs ± 3%              3.63µs ± 0%     ~     (p=0.500 n=5+5)
      fs1-zwrk.go·3                                              3.67µs ± 1%              3.68µs ± 0%     ~     (p=0.937 n=5+5)
      fs1-zwrk.go·4                                              3.70µs ± 0%              3.70µs ± 0%     ~     (p=0.381 n=5+5)
      fs1-zwrk.go·8                                              5.62µs ± 0%              5.60µs ± 0%     ~     (p=0.056 n=5+5)
      fs1-zwrk.go·12                                             7.76µs ± 0%              7.75µs ± 0%     ~     (p=0.516 n=5+5)
      fs1-zwrk.go·16                                             10.3µs ± 0%              10.3µs ± 1%     ~     (p=0.746 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        136µs ± 1%               135µs ± 0%     ~     (p=0.222 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        223µs ± 2%               225µs ± 0%     ~     (p=0.690 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        311µs ± 3%               312µs ± 1%     ~     (p=0.690 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        405µs ± 1%               403µs ± 0%     ~     (p=0.222 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        774µs ± 1%               778µs ± 0%     ~     (p=0.222 n=5+5)
      zeo/py/fs1-zwrk.go·12                                      1.15ms ± 1%              1.15ms ± 1%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zwrk.go·16                                      1.52ms ± 1%              1.53ms ± 1%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               145µs ± 2%               147µs ± 1%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               232µs ± 3%               232µs ± 1%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               347µs ± 0%               350µs ± 2%     ~     (p=0.111 n=4+5)
      neo/py(!log)/sqlite-zwrk.go·4                               459µs ± 1%               469µs ± 1%   +1.99%  (p=0.016 n=4+5)
      neo/py(!log)/sqlite-zwrk.go·8                               930µs ± 2%               938µs ± 1%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                             1.39ms ± 2%              1.40ms ± 0%     ~     (p=0.190 n=5+4)
      neo/py(!log)/sqlite-zwrk.go·16                             1.87ms ± 3%              1.88ms ± 1%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  176µs ± 1%               180µs ± 2%   +2.26%  (p=0.032 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  298µs ± 5%               301µs ± 2%     ~     (p=0.222 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  449µs ± 2%               454µs ± 1%     ~     (p=0.222 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  589µs ± 1%               612µs ± 2%   +3.90%  (p=0.016 n=4+5)
      neo/py(!log)/sql-zwrk.go·8                                 1.20ms ± 2%              1.20ms ± 1%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                1.83ms ±12%              1.81ms ± 2%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                2.39ms ± 1%              2.42ms ± 2%     ~     (p=0.413 n=4+5)
      neo/go/fs1-zwrk.go·1                                       63.9µs ± 0%              64.1µs ± 0%     ~     (p=0.095 n=5+5)
      neo/go/fs1-zwrk.go·2                                       66.0µs ± 0%              66.7µs ± 0%   +1.14%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·3                                       75.4µs ± 0%              75.8µs ± 0%   +0.50%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·4                                       80.5µs ± 0%              80.8µs ± 0%   +0.41%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·8                                        116µs ± 1%               116µs ± 0%     ~     (p=0.222 n=5+5)
      neo/go/fs1-zwrk.go·12                                       164µs ± 0%               164µs ± 0%     ~     (p=0.095 n=5+5)
      neo/go/fs1-zwrk.go·16                                       217µs ± 0%               216µs ± 0%   -0.37%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                         39.0µs ± 3%              39.1µs ± 1%     ~     (p=0.690 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                         41.8µs ± 0%              42.2µs ± 0%   +1.03%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                         50.3µs ± 0%              50.4µs ± 0%     ~     (p=0.056 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                         55.0µs ± 0%              55.4µs ± 0%   +0.66%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                         82.5µs ± 0%              82.8µs ± 0%     ~     (p=0.056 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         110µs ± 1%               109µs ± 0%     ~     (p=0.222 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         142µs ± 1%               141µs ± 0%     ~     (p=0.056 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     101µs ± 1%               101µs ± 0%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     109µs ± 0%               110µs ± 0%   +1.40%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     118µs ± 0%               120µs ± 0%   +2.04%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     132µs ± 0%               135µs ± 0%   +2.29%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     202µs ± 0%               210µs ± 0%   +3.86%  (p=0.016 n=5+4)
      neo/go/sqlite-zwrk.go·12                                    294µs ± 1%               297µs ± 2%     ~     (p=0.095 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    396µs ± 3%               388µs ± 1%   -2.11%  (p=0.032 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                             91.1µs ± 1%              90.9µs ± 0%     ~     (p=0.310 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              101µs ± 0%               102µs ± 0%   +1.26%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              108µs ± 0%               110µs ± 0%   +1.92%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              118µs ± 1%               121µs ± 0%   +2.67%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              183µs ± 1%               188µs ± 2%   +3.10%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             280µs ± 2%               280µs ± 2%     ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             391µs ± 2%               374µs ± 3%   -4.44%  (p=0.008 n=5+5)
      cluster:rio dataset:prod1-1024
      fs1-zwrk.go·1                                              2.17µs ± 1%              2.17µs ± 1%     ~     (p=0.738 n=5+5)
      fs1-zwrk.go·2                                              2.20µs ± 0%              2.22µs ± 1%     ~     (p=0.103 n=5+5)
      fs1-zwrk.go·3                                              2.21µs ± 0%              2.24µs ± 1%   +1.15%  (p=0.024 n=5+5)
      fs1-zwrk.go·4                                              2.23µs ± 1%              2.25µs ± 0%   +0.73%  (p=0.024 n=5+5)
      fs1-zwrk.go·8                                              3.37µs ± 1%              3.38µs ± 1%     ~     (p=0.548 n=5+5)
      fs1-zwrk.go·12                                             5.00µs ± 1%              5.00µs ± 0%     ~     (p=0.310 n=5+5)
      fs1-zwrk.go·16                                             6.67µs ± 0%              6.67µs ± 0%     ~     (p=0.841 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        112µs ± 2%               113µs ± 0%     ~     (p=0.310 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        171µs ± 1%               175µs ± 1%   +2.08%  (p=0.016 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        230µs ± 1%               238µs ± 1%   +3.31%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        298µs ± 2%               306µs ± 1%     ~     (p=0.056 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        562µs ± 2%               582µs ± 0%   +3.55%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       852µs ± 2%               868µs ± 1%   +1.91%  (p=0.032 n=5+5)
      zeo/py/fs1-zwrk.go·16                                      1.11ms ± 2%              1.15ms ± 1%   +3.39%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               141µs ± 2%               138µs ± 0%     ~     (p=0.095 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               239µs ± 6%               230µs ± 1%   -3.99%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               349µs ± 1%               344µs ± 1%   -1.24%  (p=0.032 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               477µs ± 9%               461µs ± 1%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               929µs ± 3%               914µs ± 1%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                             1.40ms ± 2%              1.39ms ± 2%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                             1.89ms ± 5%              1.85ms ± 2%     ~     (p=0.222 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  173µs ± 6%               172µs ± 1%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  295µs ± 4%               293µs ± 1%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  438µs ± 1%               441µs ± 1%     ~     (p=0.095 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  589µs ± 2%               592µs ± 2%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                 1.18ms ± 6%              1.20ms ± 3%     ~     (p=0.222 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                1.85ms ± 5%              1.75ms ± 2%     ~     (p=0.095 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                2.35ms ± 1%              2.35ms ± 1%     ~     (p=1.000 n=5+5)
      neo/go/fs1-zwrk.go·1                                       46.3µs ± 1%              45.9µs ± 0%     ~     (p=0.095 n=5+5)
      neo/go/fs1-zwrk.go·2                                       51.0µs ± 1%              51.0µs ± 0%     ~     (p=0.690 n=5+5)
      neo/go/fs1-zwrk.go·3                                       58.4µs ± 0%              58.4µs ± 0%     ~     (p=0.310 n=5+5)
      neo/go/fs1-zwrk.go·4                                       63.8µs ± 0%              63.6µs ± 0%   -0.30%  (p=0.016 n=5+5)
      neo/go/fs1-zwrk.go·8                                       97.9µs ± 1%              96.5µs ± 2%   -1.48%  (p=0.032 n=5+5)
      neo/go/fs1-zwrk.go·12                                       146µs ± 3%               136µs ± 2%   -6.67%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·16                                       200µs ± 3%               179µs ± 3%  -10.62%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                         37.7µs ± 1%              37.6µs ± 0%     ~     (p=0.690 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                         40.8µs ± 0%              41.0µs ± 0%   +0.66%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                         48.3µs ± 0%              48.4µs ± 0%     ~     (p=0.151 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                         53.9µs ± 0%              53.8µs ± 0%     ~     (p=0.421 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                         86.6µs ± 1%              84.9µs ± 0%   -1.98%  (p=0.016 n=5+4)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         128µs ± 2%               116µs ± 5%   -9.16%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         178µs ± 3%               149µs ± 2%  -16.06%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·1                                    91.7µs ± 1%              90.5µs ± 1%   -1.35%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     104µs ± 0%               103µs ± 0%   -0.80%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     113µs ± 1%               112µs ± 0%   -0.86%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     126µs ± 0%               124µs ± 0%   -1.01%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     210µs ± 3%               214µs ± 3%     ~     (p=0.310 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    324µs ± 2%               336µs ± 3%   +3.66%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    441µs ± 2%               458µs ± 3%   +3.75%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                             87.2µs ± 1%              86.6µs ± 0%     ~     (p=0.056 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              100µs ± 0%               100µs ± 1%   +0.77%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              109µs ± 0%               110µs ± 1%   +1.09%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              119µs ± 2%               121µs ± 0%   +1.33%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              200µs ± 1%               213µs ± 2%   +6.39%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             316µs ± 0%               331µs ± 4%   +4.54%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             436µs ± 1%               454µs ± 3%   +4.17%  (p=0.008 n=5+5)
      9282fca1
    • Kirill Smelkov's avatar
      X rio: localhost timings, Cenabled, zwrk@1s · 31d87ace
      Kirill Smelkov authored
      Remeasure with the same sattings as previous rio localhost with C-enabled (31dc070d):
      
      Like on neo1 & z6001 data is moreorless the same.
      
      the pystone/s change is nose as pystone/s for C-enabled case was 146k on
      prev-prev run (see 31dc070d).
      
      ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
      
      $ benchstat -split node,cluster,dataset  20180306-rio-ffixed-c.txt 20180308-rio-ffixed-c-zwrk1s.txt
      
      name                                           old pystone/s            new pystone/s            delta
      node:rio
      pystone                                                      115k ±12%                144k ± 3%  +24.95%  (p=0.008 n=5+5)
      
      name                                           old time/op              new time/op              delta
      node:rio
      crc32/py/4K                                                4.77µs ± 0%              4.79µs ± 1%     ~     (p=0.730 n=4+5)
      crc32/go/4K                                                1.49µs ± 0%              1.49µs ± 0%   -0.21%  (p=0.016 n=5+5)
      sha1/py/4K                                                 8.04µs ± 1%              7.98µs ± 1%     ~     (p=0.206 n=5+5)
      sha1/go/4K                                                 8.93µs ± 0%              9.29µs ±12%     ~     (p=0.167 n=5+5)
      unzlib/py/wczdata                                          25.1µs ± 1%              25.2µs ± 1%     ~     (p=0.421 n=5+5)
      unzlib/go/wczdata                                          23.0µs ± 0%              23.0µs ± 0%   -0.20%  (p=0.016 n=5+5)
      unzlib/py/prod1-avg                                        7.16µs ± 1%              7.26µs ± 3%     ~     (p=0.222 n=5+5)
      unzlib/go/prod1-avg                                        5.08µs ± 1%              5.06µs ± 1%     ~     (p=0.095 n=5+5)
      disk/randread/direct/4K-min                                92.4µs ± 0%              93.0µs ± 0%   +0.67%  (p=0.024 n=5+5)
      disk/randread/direct/4K-avg                                 115µs ± 0%               116µs ± 1%   +0.99%  (p=0.008 n=5+5)
      disk/randread/pagecache/4K-min                              565ns ± 2%               570ns ± 1%     ~     (p=0.167 n=5+5)
      disk/randread/pagecache/4K-avg                              992ns ± 0%               995ns ± 0%   +0.26%  (p=0.016 n=4+5)
      
      name                                           old time/object          new time/object          delta
      cluster:rio dataset:wczblk1-8
      fs1-zhash.py                                               29.2µs ± 1%              28.9µs ± 1%     ~     (p=0.086 n=4+4)
      fs1-zhash.go                                               4.68µs ± 5%              4.60µs ± 0%     ~     (p=0.333 n=5+4)
      fs1-zhash.go+prefetch128                                   4.78µs ± 5%              4.62µs ± 3%     ~     (p=0.111 n=5+5)
      zeo/py/fs1-zhash.py                                         400µs ± 0%               412µs ± 4%     ~     (p=0.151 n=5+5)
      zeo/py/fs1-zhash.go                                         138µs ± 1%               139µs ± 3%     ~     (p=0.548 n=5+5)
      zeo/py/fs1-zhash.go+prefetch128                            74.7µs ± 2%              75.2µs ± 5%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                318µs ± 7%               315µs ± 3%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                154µs ± 4%               156µs ± 6%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zhash.go+prefetch128                    125µs ± 3%               125µs ± 2%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zhash.py                                   400µs ±57%               342µs ± 2%     ~     (p=0.730 n=5+4)
      neo/py(!log)/sql-zhash.go                                   183µs ±11%               178µs ± 2%     ~     (p=0.889 n=5+5)
      neo/py(!log)/sql-zhash.go+prefetch128                       158µs ± 3%               159µs ± 2%     ~     (p=0.968 n=5+5)
      neo/go/fs1-zhash.py                                         222µs ± 4%               224µs ± 4%     ~     (p=1.000 n=5+5)
      neo/go/fs1-zhash.go                                        68.6µs ± 2%              67.0µs ± 1%   -2.30%  (p=0.008 n=5+5)
      neo/go/fs1-zhash.go+prefetch128                            29.0µs ± 6%              28.3µs ± 1%     ~     (p=0.143 n=5+5)
      neo/go/fs1(!sha1)-zhash.go(!sha1)                          43.9µs ± 3%              45.0µs ± 6%     ~     (p=0.500 n=5+5)
      neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1)              18.8µs ± 5%              19.0µs ± 3%     ~     (p=0.810 n=5+5)
      neo/go/sqlite-zhash.py                                      273µs ± 3%               266µs ± 2%     ~     (p=0.095 n=5+5)
      neo/go/sqlite-zhash.go                                      104µs ± 1%               103µs ± 2%     ~     (p=0.294 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128                         36.3µs ± 3%              37.6µs ± 2%   +3.75%  (p=0.016 n=5+5)
      neo/go/sqlite-zhash.go(!sha1)                              94.2µs ± 3%              94.7µs ± 1%     ~     (p=0.413 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128(!sha1)                  35.1µs ± 6%              35.1µs ± 6%     ~     (p=1.000 n=5+5)
      cluster:rio dataset:prod1-1024
      fs1-zhash.py                                               23.9µs ± 1%              24.2µs ± 1%     ~     (p=0.143 n=4+4)
      fs1-zhash.go                                               3.40µs ± 0%              3.40µs ± 0%     ~     (all equal)
      fs1-zhash.go+prefetch128                                   3.02µs ± 9%              3.06µs ± 2%     ~     (p=0.238 n=5+5)
      zeo/py/fs1-zhash.py                                         372µs ±10%               368µs ± 1%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zhash.go                                         114µs ± 1%               115µs ± 2%     ~     (p=0.222 n=5+5)
      zeo/py/fs1-zhash.go+prefetch128                            64.6µs ± 1%              65.6µs ± 1%   +1.55%  (p=0.040 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                321µs ±11%               316µs ± 6%     ~     (p=0.952 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                142µs ± 3%               142µs ± 5%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sqlite-zhash.go+prefetch128                    117µs ± 1%               116µs ± 1%     ~     (p=0.111 n=5+5)
      neo/py(!log)/sql-zhash.py                                   330µs ± 1%               339µs ± 5%     ~     (p=0.486 n=4+4)
      neo/py(!log)/sql-zhash.go                                   172µs ± 1%               172µs ± 1%     ~     (p=0.889 n=5+5)
      neo/py(!log)/sql-zhash.go+prefetch128                       149µs ± 2%               150µs ± 1%     ~     (p=0.421 n=5+5)
      neo/go/fs1-zhash.py                                         217µs ± 1%               219µs ± 2%     ~     (p=0.389 n=5+5)
      neo/go/fs1-zhash.go                                        49.8µs ± 2%              49.9µs ± 1%     ~     (p=0.786 n=5+5)
      neo/go/fs1-zhash.go+prefetch128                            18.8µs ± 1%              19.1µs ± 3%     ~     (p=0.167 n=5+5)
      neo/go/fs1(!sha1)-zhash.go(!sha1)                          40.4µs ± 3%              41.1µs ± 2%     ~     (p=0.103 n=5+5)
      neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1)              16.1µs ± 2%              16.2µs ± 5%     ~     (p=1.000 n=5+5)
      neo/go/sqlite-zhash.py                                      263µs ± 4%               261µs ± 5%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zhash.go                                     93.1µs ± 1%              94.3µs ± 1%   +1.29%  (p=0.024 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128                         32.7µs ± 2%              33.6µs ± 5%     ~     (p=0.381 n=5+5)
      neo/go/sqlite-zhash.go(!sha1)                              89.6µs ± 1%              90.3µs ± 2%     ~     (p=0.175 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128(!sha1)                  34.0µs ± 2%              33.0µs ± 4%     ~     (p=0.238 n=5+5)
      
      name                                           old req/s                new req/s                delta
      cluster:rio dataset:wczblk1-8
      fs1-zwrk.go·1                                                300k ± 0%                301k ± 0%     ~     (p=0.056 n=5+5)
      fs1-zwrk.go·2                                                546k ± 0%                550k ± 3%     ~     (p=0.151 n=5+5)
      fs1-zwrk.go·3                                                810k ± 0%                817k ± 1%   +0.82%  (p=0.008 n=5+5)
      fs1-zwrk.go·4                                               1.08M ± 0%               1.08M ± 0%   +0.58%  (p=0.008 n=5+5)
      fs1-zwrk.go·8                                               1.42M ± 0%               1.42M ± 0%     ~     (p=0.222 n=5+5)
      fs1-zwrk.go·12                                              1.55M ± 0%               1.55M ± 0%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·16                                              1.55M ± 0%               1.55M ± 0%     ~     (p=0.222 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        7.41k ± 1%               7.38k ± 1%     ~     (p=0.421 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        9.03k ± 1%               8.96k ± 2%     ~     (p=0.421 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        9.77k ± 1%               9.66k ± 3%     ~     (p=0.421 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        10.1k ± 3%                9.9k ± 1%     ~     (p=0.222 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        10.5k ± 0%               10.3k ± 1%   -1.89%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       10.6k ± 1%               10.4k ± 1%   -1.61%  (p=0.016 n=5+5)
      zeo/py/fs1-zwrk.go·16                                       10.6k ± 1%               10.5k ± 1%     ~     (p=0.056 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               6.80k ± 2%               6.88k ± 2%     ~     (p=0.222 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               8.31k ± 7%               8.63k ± 3%     ~     (p=0.095 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               8.60k ± 1%               8.66k ± 0%     ~     (p=0.190 n=5+4)
      neo/py(!log)/sqlite-zwrk.go·4                               8.60k ± 1%               8.71k ± 1%   +1.17%  (p=0.029 n=4+4)
      neo/py(!log)/sqlite-zwrk.go·8                               8.61k ± 1%               8.60k ± 2%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                              8.56k ± 1%               8.63k ± 2%     ~     (p=0.095 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                              8.49k ± 3%               8.54k ± 3%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  5.62k ± 6%               5.69k ± 1%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  6.75k ± 4%               6.73k ± 5%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  6.77k ± 2%               6.69k ± 2%     ~     (p=0.222 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  6.51k ± 7%               6.60k ±11%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                  6.56k ± 4%               6.65k ± 2%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                 6.84k ± 1%               6.58k ±11%     ~     (p=0.063 n=4+5)
      neo/py(!log)/sql-zwrk.go·16                                 6.73k ± 3%               6.70k ± 1%     ~     (p=0.413 n=5+4)
      neo/go/fs1-zwrk.go·1                                        15.5k ± 0%               15.7k ± 0%   +0.83%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·2                                        29.9k ± 1%               30.3k ± 0%   +1.32%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·3                                        39.4k ± 0%               39.8k ± 0%   +0.83%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·4                                        49.4k ± 0%               49.7k ± 0%   +0.72%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·8                                        68.4k ± 0%               68.7k ± 1%     ~     (p=0.151 n=5+5)
      neo/go/fs1-zwrk.go·12                                       72.5k ± 0%               73.0k ± 0%   +0.68%  (p=0.032 n=5+5)
      neo/go/fs1-zwrk.go·16                                       73.2k ± 0%               73.9k ± 0%   +0.99%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                          26.2k ± 1%               25.6k ± 3%     ~     (p=0.095 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                          47.6k ± 0%               47.8k ± 0%   +0.49%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                          59.4k ± 0%               59.6k ± 0%   +0.37%  (p=0.016 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                          72.2k ± 0%               72.7k ± 0%   +0.68%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          96.7k ± 0%               97.0k ± 0%     ~     (p=0.095 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                          109k ± 0%                109k ± 1%     ~     (p=0.690 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                          113k ± 1%                113k ± 1%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     9.82k ± 0%               9.88k ± 1%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     18.3k ± 0%               18.4k ± 0%   +0.51%  (p=0.016 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     25.3k ± 0%               25.5k ± 0%   +0.67%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     30.3k ± 0%               30.4k ± 0%     ~     (p=0.310 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     39.5k ± 0%               39.5k ± 0%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    40.8k ± 2%               40.9k ± 1%     ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    40.5k ± 2%               40.4k ± 2%     ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              11.0k ± 1%               11.0k ± 1%     ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              20.0k ± 0%               19.9k ± 0%   -0.65%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              27.9k ± 0%               27.7k ± 0%   -0.55%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              34.1k ± 0%               34.0k ± 1%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              44.1k ± 1%               43.8k ± 1%     ~     (p=0.095 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             43.1k ± 1%               42.8k ± 2%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             41.2k ± 2%               40.9k ± 2%     ~     (p=0.421 n=5+5)
      cluster:rio dataset:prod1-1024
      fs1-zwrk.go·1                                                465k ± 1%                462k ± 1%     ~     (p=0.095 n=5+5)
      fs1-zwrk.go·2                                                920k ± 0%                910k ± 1%   -1.07%  (p=0.016 n=4+5)
      fs1-zwrk.go·3                                               1.36M ± 1%               1.35M ± 0%     ~     (p=0.056 n=5+5)
      fs1-zwrk.go·4                                               1.81M ± 0%               1.79M ± 1%   -1.07%  (p=0.008 n=5+5)
      fs1-zwrk.go·8                                               2.37M ± 1%               2.38M ± 1%     ~     (p=0.841 n=5+5)
      fs1-zwrk.go·12                                              2.41M ± 0%               2.40M ± 1%   -0.61%  (p=0.008 n=5+5)
      fs1-zwrk.go·16                                              2.42M ± 0%               2.40M ± 0%   -1.00%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        8.98k ± 1%               8.91k ± 2%     ~     (p=0.310 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        11.7k ± 1%               11.7k ± 1%     ~     (p=0.690 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        12.9k ± 2%               13.0k ± 1%     ~     (p=0.151 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        13.4k ± 4%               13.4k ± 2%     ~     (p=0.690 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        14.0k ± 2%               14.2k ± 2%     ~     (p=0.095 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       14.2k ± 2%               14.1k ± 2%     ~     (p=0.548 n=5+5)
      zeo/py/fs1-zwrk.go·16                                       14.2k ± 3%               14.4k ± 2%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               7.16k ± 4%               7.12k ± 2%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               8.75k ± 1%               8.37k ± 6%   -4.30%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               8.65k ± 4%               8.60k ± 1%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               8.53k ± 6%               8.40k ± 8%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               8.61k ± 3%               8.61k ± 3%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                              8.64k ± 0%               8.56k ± 2%     ~     (p=0.556 n=4+5)
      neo/py(!log)/sqlite-zwrk.go·16                              8.64k ± 1%               8.46k ± 5%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  5.88k ± 1%               5.78k ± 5%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  6.79k ± 2%               6.77k ± 4%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  6.58k ± 4%               6.85k ± 1%   +4.08%  (p=0.016 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  6.68k ± 4%               6.79k ± 2%     ~     (p=0.643 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                  6.83k ± 1%               6.80k ± 5%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                 6.66k ± 4%               6.50k ± 5%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                 6.65k ± 5%               6.81k ± 1%     ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·1                                        21.8k ± 1%               21.6k ± 1%     ~     (p=0.151 n=5+5)
      neo/go/fs1-zwrk.go·2                                        39.2k ± 1%               39.2k ± 1%     ~     (p=0.548 n=5+5)
      neo/go/fs1-zwrk.go·3                                        51.4k ± 0%               51.3k ± 0%   -0.22%  (p=0.032 n=5+5)
      neo/go/fs1-zwrk.go·4                                        62.8k ± 0%               62.7k ± 0%     ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·8                                        80.7k ± 1%               81.7k ± 1%     ~     (p=0.095 n=5+5)
      neo/go/fs1-zwrk.go·12                                       80.0k ± 2%               82.1k ± 3%     ~     (p=0.056 n=5+5)
      neo/go/fs1-zwrk.go·16                                       78.3k ± 2%               80.1k ± 3%     ~     (p=0.095 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                          26.5k ± 1%               26.5k ± 1%     ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                          48.8k ± 0%               49.1k ± 0%   +0.55%  (p=0.032 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                          61.8k ± 0%               62.2k ± 0%   +0.57%  (p=0.016 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                          74.0k ± 0%               74.2k ± 0%     ~     (p=0.151 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          91.3k ± 0%               92.4k ± 1%     ~     (p=0.111 n=4+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         93.1k ± 2%               94.1k ± 2%     ~     (p=0.421 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         89.7k ± 2%               90.0k ± 3%     ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     11.0k ± 1%               10.9k ± 1%   -1.12%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     19.4k ± 1%               19.3k ± 0%   -0.67%  (p=0.016 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     26.6k ± 0%               26.4k ± 1%     ~     (p=0.056 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     31.9k ± 0%               31.8k ± 0%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     37.4k ± 2%               38.1k ± 3%     ~     (p=0.310 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    35.2k ± 3%               37.1k ± 2%   +5.41%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    34.6k ± 2%               36.3k ± 2%   +4.86%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              11.5k ± 1%               11.5k ± 1%     ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              20.1k ± 0%               20.1k ± 0%     ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              27.6k ± 0%               27.6k ± 0%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              33.4k ± 0%               33.5k ± 2%     ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              38.8k ± 2%               40.0k ± 1%   +2.97%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             36.4k ± 1%               37.9k ± 0%   +4.32%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             35.2k ± 2%               36.7k ± 1%   +4.28%  (p=0.008 n=5+5)
      
      name                                           old latency-time/object  new latency-time/object  delta
      cluster:rio dataset:wczblk1-8
      fs1-zwrk.go·1                                              3.33µs ± 0%              3.32µs ± 0%   -0.44%  (p=0.048 n=5+5)
      fs1-zwrk.go·2                                              3.67µs ± 0%              3.64µs ± 3%     ~     (p=0.143 n=5+5)
      fs1-zwrk.go·3                                              3.70µs ± 0%              3.67µs ± 1%   -0.80%  (p=0.008 n=5+5)
      fs1-zwrk.go·4                                              3.72µs ± 0%              3.70µs ± 0%   -0.58%  (p=0.008 n=5+5)
      fs1-zwrk.go·8                                              5.62µs ± 0%              5.62µs ± 0%     ~     (p=0.206 n=5+5)
      fs1-zwrk.go·12                                             7.76µs ± 0%              7.76µs ± 0%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·16                                             10.3µs ± 0%              10.3µs ± 0%     ~     (p=0.222 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        135µs ± 1%               136µs ± 1%     ~     (p=0.421 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        222µs ± 1%               223µs ± 2%     ~     (p=0.421 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        307µs ± 1%               311µs ± 3%     ~     (p=0.421 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        398µs ± 3%               405µs ± 1%     ~     (p=0.222 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        759µs ± 0%               774µs ± 1%   +1.93%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·12                                      1.13ms ± 1%              1.15ms ± 1%   +1.64%  (p=0.016 n=5+5)
      zeo/py/fs1-zwrk.go·16                                      1.50ms ± 1%              1.52ms ± 1%     ~     (p=0.056 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               147µs ± 2%               145µs ± 2%     ~     (p=0.222 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               241µs ± 8%               232µs ± 3%     ~     (p=0.095 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               349µs ± 1%               347µs ± 0%     ~     (p=0.190 n=5+4)
      neo/py(!log)/sqlite-zwrk.go·4                               465µs ± 1%               459µs ± 1%   -1.16%  (p=0.029 n=4+4)
      neo/py(!log)/sqlite-zwrk.go·8                               930µs ± 1%               930µs ± 2%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                             1.40ms ± 1%              1.39ms ± 2%     ~     (p=0.095 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                             1.88ms ± 3%              1.87ms ± 3%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  178µs ± 6%               176µs ± 1%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  297µs ± 4%               298µs ± 5%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  443µs ± 2%               449µs ± 2%     ~     (p=0.222 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  616µs ± 8%               589µs ± 1%     ~     (p=0.063 n=5+4)
      neo/py(!log)/sql-zwrk.go·8                                 1.22ms ± 5%              1.20ms ± 2%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                1.75ms ± 1%              1.83ms ±12%     ~     (p=0.063 n=4+5)
      neo/py(!log)/sql-zwrk.go·16                                2.38ms ± 3%              2.39ms ± 1%     ~     (p=0.413 n=5+4)
      neo/go/fs1-zwrk.go·1                                       64.4µs ± 0%              63.9µs ± 0%   -0.82%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·2                                       66.8µs ± 1%              66.0µs ± 0%   -1.30%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·3                                       76.1µs ± 0%              75.4µs ± 0%   -0.82%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·4                                       81.0µs ± 0%              80.5µs ± 0%   -0.72%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·8                                        117µs ± 0%               116µs ± 1%     ~     (p=0.151 n=5+5)
      neo/go/fs1-zwrk.go·12                                       165µs ± 0%               164µs ± 0%   -0.68%  (p=0.032 n=5+5)
      neo/go/fs1-zwrk.go·16                                       219µs ± 0%               217µs ± 0%   -0.98%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                         38.2µs ± 1%              39.0µs ± 3%     ~     (p=0.095 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                         42.0µs ± 0%              41.8µs ± 0%   -0.49%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                         50.5µs ± 0%              50.3µs ± 0%   -0.37%  (p=0.016 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                         55.4µs ± 0%              55.0µs ± 0%   -0.67%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                         82.8µs ± 0%              82.5µs ± 0%     ~     (p=0.095 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         110µs ± 0%               110µs ± 1%     ~     (p=0.690 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         142µs ± 1%               142µs ± 1%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     102µs ± 0%               101µs ± 1%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     110µs ± 0%               109µs ± 0%   -0.50%  (p=0.016 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     119µs ± 0%               118µs ± 0%   -0.66%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     132µs ± 0%               132µs ± 0%     ~     (p=0.310 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     203µs ± 0%               202µs ± 0%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    294µs ± 2%               294µs ± 1%     ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    395µs ± 2%               396µs ± 3%     ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                             91.1µs ± 1%              91.1µs ± 1%     ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              100µs ± 0%               101µs ± 0%   +0.66%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              108µs ± 0%               108µs ± 0%   +0.56%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              117µs ± 0%               118µs ± 1%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              182µs ± 1%               183µs ± 1%     ~     (p=0.095 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             279µs ± 1%               280µs ± 2%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             388µs ± 2%               391µs ± 2%     ~     (p=0.421 n=5+5)
      cluster:rio dataset:prod1-1024
      fs1-zwrk.go·1                                              2.15µs ± 1%              2.17µs ± 1%     ~     (p=0.079 n=5+5)
      fs1-zwrk.go·2                                              2.17µs ± 0%              2.20µs ± 0%   +1.09%  (p=0.016 n=4+5)
      fs1-zwrk.go·3                                              2.20µs ± 1%              2.21µs ± 0%     ~     (p=0.063 n=5+5)
      fs1-zwrk.go·4                                              2.21µs ± 0%              2.23µs ± 1%   +1.09%  (p=0.008 n=5+5)
      fs1-zwrk.go·8                                              3.37µs ± 1%              3.37µs ± 1%     ~     (p=0.841 n=5+5)
      fs1-zwrk.go·12                                             4.97µs ± 0%              5.00µs ± 1%   +0.62%  (p=0.008 n=5+5)
      fs1-zwrk.go·16                                             6.61µs ± 0%              6.67µs ± 0%   +1.01%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        111µs ± 1%               112µs ± 2%     ~     (p=0.310 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        171µs ± 1%               171µs ± 1%     ~     (p=0.690 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        233µs ± 2%               230µs ± 1%     ~     (p=0.151 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        298µs ± 4%               298µs ± 2%     ~     (p=0.690 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        572µs ± 2%               562µs ± 2%     ~     (p=0.095 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       844µs ± 2%               852µs ± 2%     ~     (p=0.548 n=5+5)
      zeo/py/fs1-zwrk.go·16                                      1.12ms ± 3%              1.11ms ± 2%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               140µs ± 4%               141µs ± 2%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               229µs ± 1%               239µs ± 6%   +4.59%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               347µs ± 5%               349µs ± 1%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               470µs ± 7%               477µs ± 9%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               929µs ± 3%               929µs ± 3%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                             1.39ms ± 0%              1.40ms ± 2%     ~     (p=0.556 n=4+5)
      neo/py(!log)/sqlite-zwrk.go·16                             1.85ms ± 1%              1.89ms ± 5%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  170µs ± 1%               173µs ± 6%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  294µs ± 2%               295µs ± 4%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  456µs ± 4%               438µs ± 1%   -3.97%  (p=0.016 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  599µs ± 4%               589µs ± 2%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                 1.17ms ± 1%              1.18ms ± 6%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                1.80ms ± 4%              1.85ms ± 5%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                2.41ms ± 5%              2.35ms ± 1%     ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·1                                       45.9µs ± 1%              46.3µs ± 1%     ~     (p=0.151 n=5+5)
      neo/go/fs1-zwrk.go·2                                       51.0µs ± 1%              51.0µs ± 1%     ~     (p=0.548 n=5+5)
      neo/go/fs1-zwrk.go·3                                       58.3µs ± 0%              58.4µs ± 0%   +0.22%  (p=0.032 n=5+5)
      neo/go/fs1-zwrk.go·4                                       63.7µs ± 0%              63.8µs ± 0%     ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·8                                       99.2µs ± 1%              97.9µs ± 1%     ~     (p=0.095 n=5+5)
      neo/go/fs1-zwrk.go·12                                       150µs ± 2%               146µs ± 3%     ~     (p=0.056 n=5+5)
      neo/go/fs1-zwrk.go·16                                       204µs ± 3%               200µs ± 3%     ~     (p=0.095 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                         37.7µs ± 1%              37.7µs ± 1%     ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                         41.0µs ± 0%              40.8µs ± 0%   -0.55%  (p=0.032 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                         48.5µs ± 0%              48.3µs ± 0%   -0.56%  (p=0.016 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                         54.0µs ± 0%              53.9µs ± 0%     ~     (p=0.151 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                         87.6µs ± 0%              86.6µs ± 1%     ~     (p=0.111 n=4+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         129µs ± 2%               128µs ± 2%     ~     (p=0.421 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         178µs ± 2%               178µs ± 3%     ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go·1                                    90.7µs ± 1%              91.7µs ± 1%   +1.13%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     103µs ± 1%               104µs ± 0%   +0.68%  (p=0.016 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     113µs ± 0%               113µs ± 1%     ~     (p=0.056 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     125µs ± 0%               126µs ± 0%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     214µs ± 2%               210µs ± 3%     ~     (p=0.310 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    341µs ± 3%               324µs ± 2%   -5.15%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    462µs ± 2%               441µs ± 2%   -4.63%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                             86.7µs ± 1%              87.2µs ± 1%     ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              100µs ± 0%               100µs ± 0%     ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              109µs ± 0%               109µs ± 0%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              120µs ± 0%               119µs ± 2%     ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              206µs ± 2%               200µs ± 1%   -2.89%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             330µs ± 1%               316µs ± 0%   -4.15%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             455µs ± 2%               436µs ± 1%   -4.11%  (p=0.008 n=5+5)
      31d87ace
    • Kirill Smelkov's avatar
      X z6001: localhost timings, C > C1 disabled, zwrk@1s · 5685f384
      Kirill Smelkov authored
      Like on neo1, comparing to Cenabled run, even when there each zwrk was
      run for 10s, similarly to previous measure with Cstates disabled
      (65de70b8) it shows clear improvment:
      
      ---- 8< ----
      cluster:z6001 dataset:wczblk1-8
      zeo/py/fs1-zwrk.go·1                                        217µs ± 3%               195µs ± 1%  -10.29%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               306µs ± 6%               220µs ± 1%  -27.99%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  395µs ±11%               276µs ± 3%  -30.18%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  514µs ± 5%               470µs ± 4%   -8.50%  (p=0.016 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  741µs ± 3%               699µs ± 0%   -5.64%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                 1.02ms ± 7%              0.95ms ± 5%   -6.66%  (p=0.032 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                 2.00ms ± 7%              1.91ms ± 1%   -4.52%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                2.94ms ± 3%              2.87ms ± 3%     ~     (p=0.056 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                4.04ms ±11%              3.80ms ± 1%   -5.78%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     203µs ± 3%               139µs ± 1%  -31.68%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     167µs ± 0%               147µs ± 0%  -12.19%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     158µs ± 0%               150µs ± 1%   -5.38%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     163µs ± 0%               156µs ± 0%   -4.11%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              178µs ± 1%               129µs ± 1%  -27.30%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              153µs ± 1%               136µs ± 1%  -11.08%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              149µs ± 0%               138µs ± 0%   -6.78%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              149µs ± 0%               142µs ± 0%   -4.85%  (p=0.008 n=5+5)
      
      cluster:z6001 dataset:prod1-1024
      zeo/py/fs1-zwrk.go·1                                        186µs ± 4%               163µs ± 1%  -12.16%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               273µs ± 4%               204µs ± 1%  -25.07%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  365µs ±11%               275µs ± 7%  -24.47%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  524µs ± 5%               460µs ± 0%  -12.15%  (p=0.016 n=5+4)
      neo/py(!log)/sql-zwrk.go·3                                  754µs ±10%               689µs ± 1%   -8.64%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  975µs ±11%               927µs ± 0%   -4.98%  (p=0.016 n=5+4)
      neo/py(!log)/sql-zwrk.go·8                                 1.92ms ± 2%              1.83ms ± 1%   -4.53%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                2.95ms ± 9%              2.73ms ± 1%   -7.65%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                4.12ms ± 8%              3.69ms ± 1%  -10.36%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     174µs ± 3%               126µs ± 2%  -27.44%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     149µs ± 0%               136µs ± 1%   -9.09%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     147µs ± 0%               141µs ± 0%   -4.28%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              169µs ± 3%               122µs ± 2%  -27.64%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              147µs ± 0%               132µs ± 1%  -10.22%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              144µs ± 1%               136µs ± 0%   -5.05%  (p=0.008 n=5+5)
      ---- 8< ----
      
      not to mention that zhash.{py,go}, for which runtime was not changed,
      are also improved/denoised like it was in 65de70b8, thus confirming
      timings from there:
      
      ---- 8< ----
      cluster:z6001 dataset:wczblk1-8
      fs1-zhash.go+prefetch128                                   8.35µs ± 2%              7.34µs ± 5%  -12.10%  (p=0.016 n=4+5)
      zeo/py/fs1-zhash.py                                         675µs ± 5%               590µs ± 4%  -12.51%  (p=0.008 n=5+5)
      zeo/py/fs1-zhash.go                                         267µs ± 7%               201µs ± 3%  -24.73%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                673µs ± 8%               482µs ± 4%  -28.32%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                291µs ±11%               222µs ± 1%  -23.78%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zhash.py                                   958µs ±28%               529µs ± 4%  -44.74%  (p=0.016 n=5+4)
      neo/py(!log)/sql-zhash.go                                   441µs ± 6%               275µs ± 1%  -37.68%  (p=0.008 n=5+5)
      neo/go/fs1-zhash.py                                         509µs ±15%               342µs ± 2%  -32.79%  (p=0.008 n=5+5)
      neo/go/fs1-zhash.go                                         106µs ± 8%                91µs ± 2%  -14.00%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zhash.go(!sha1)                          76.2µs ± 8%              68.8µs ± 3%   -9.79%  (p=0.016 n=5+5)
      neo/go/sqlite-zhash.py                                      531µs ± 9%               373µs ± 7%  -29.80%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.go                                      200µs ±13%               143µs ± 3%  -28.59%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.go(!sha1)                               185µs ±14%               133µs ± 5%  -28.19%  (p=0.008 n=5+5)
      
      cluster:z6001 dataset:prod1-1024
      zeo/py/fs1-zhash.py                                         646µs ± 3%               555µs ± 2%  -14.12%  (p=0.008 n=5+5)
      zeo/py/fs1-zhash.go                                         233µs ± 3%               169µs ± 1%  -27.63%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                653µs ± 7%               467µs ± 4%  -28.50%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                261µs ± 6%               205µs ± 0%  -21.60%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zhash.py                                   961µs ±38%               518µs ± 2%  -46.11%  (p=0.016 n=5+4)
      neo/py(!log)/sql-zhash.go                                   363µs ±12%               267µs ± 1%  -26.59%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zhash.go+prefetch128                       262µs ±11%               226µs ± 9%  -13.79%  (p=0.016 n=5+5)
      neo/go/fs1-zhash.py                                         490µs ± 8%               320µs ±11%  -34.68%  (p=0.008 n=5+5)
      neo/go/fs1-zhash.go                                        81.4µs ± 5%              76.3µs ± 3%   -6.34%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zhash.go(!sha1)                          70.5µs ± 6%              64.8µs ± 2%   -8.03%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1)              21.0µs ± 2%              20.5µs ± 3%   -2.38%  (p=0.048 n=5+5)
      neo/go/sqlite-zhash.py                                      521µs ± 6%               378µs ± 4%  -27.44%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.go                                      168µs ±10%               129µs ± 3%  -23.43%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.go(!sha1)                               167µs ±14%               125µs ± 5%  -25.50%  (p=0.008 n=5+5)
      ---- 8< ----
      
      ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
      
      $ benchstat -split node,cluster,dataset  20180308-z6001-ffixed-c-zwrk10s.txt 20180308-z6001-ffixed-noc_C1\(3µs\)-zwrk1s.txt
      
      name                                           old pystone/s            new pystone/s            delta
      node:z6001
      pystone                                                      114k ± 1%                115k ± 1%     ~     (p=0.310 n=5+5)
      
      name                                           old time/op              new time/op              delta
      node:z6001
      crc32/py/4K                                                5.10µs ± 0%              5.12µs ± 2%     ~     (p=0.690 n=5+5)
      crc32/go/4K                                                1.77µs ± 8%              1.72µs ± 0%     ~     (p=0.651 n=5+4)
      sha1/py/4K                                                 14.6µs ± 0%              14.7µs ± 1%   +0.38%  (p=0.016 n=4+5)
      sha1/go/4K                                                 10.3µs ± 0%              10.3µs ± 0%     ~     (p=0.143 n=4+4)
      unzlib/py/wczdata                                          36.4µs ± 1%              36.5µs ± 1%     ~     (p=0.310 n=5+5)
      unzlib/go/wczdata                                          31.5µs ± 0%              31.2µs ± 0%   -0.95%  (p=0.008 n=5+5)
      unzlib/py/prod1-avg                                        18.4µs ± 3%              18.6µs ± 1%     ~     (p=0.413 n=5+4)
      unzlib/go/prod1-avg                                        10.0µs ± 1%               9.9µs ± 1%     ~     (p=0.151 n=5+5)
      disk/randread/direct/4K-min                                 133µs ± 6%               127µs ± 1%     ~     (p=0.460 n=5+5)
      disk/randread/direct/4K-avg                                 201µs ± 6%               168µs ± 0%  -16.39%  (p=0.008 n=5+5)
      disk/randread/pagecache/4K-min                              797ns ± 2%               788ns ± 1%     ~     (p=0.333 n=5+5)
      disk/randread/pagecache/4K-avg                             1.40µs ± 7%              1.50µs ± 3%     ~     (p=0.063 n=5+5)
      
      name                                           old time/object          new time/object          delta
      cluster:z6001 dataset:wczblk1-8
      fs1-zhash.py                                               37.4µs ± 2%              37.6µs ± 1%     ~     (p=0.389 n=5+5)
      fs1-zhash.go                                               6.04µs ± 1%              5.98µs ± 2%     ~     (p=0.397 n=5+5)
      fs1-zhash.go+prefetch128                                   8.35µs ± 2%              7.34µs ± 5%  -12.10%  (p=0.016 n=4+5)
      zeo/py/fs1-zhash.py                                         675µs ± 5%               590µs ± 4%  -12.51%  (p=0.008 n=5+5)
      zeo/py/fs1-zhash.go                                         267µs ± 7%               201µs ± 3%  -24.73%  (p=0.008 n=5+5)
      zeo/py/fs1-zhash.go+prefetch128                             101µs ± 2%               102µs ± 2%     ~     (p=0.444 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                673µs ± 8%               482µs ± 4%  -28.32%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                291µs ±11%               222µs ± 1%  -23.78%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zhash.go+prefetch128                    176µs ± 1%               179µs ± 2%     ~     (p=0.222 n=5+5)
      neo/py(!log)/sql-zhash.py                                   958µs ±28%               529µs ± 4%  -44.74%  (p=0.016 n=5+4)
      neo/py(!log)/sql-zhash.go                                   441µs ± 6%               275µs ± 1%  -37.68%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zhash.go+prefetch128                       269µs ±15%               237µs ± 5%     ~     (p=0.222 n=5+5)
      neo/go/fs1-zhash.py                                         509µs ±15%               342µs ± 2%  -32.79%  (p=0.008 n=5+5)
      neo/go/fs1-zhash.go                                         106µs ± 8%                91µs ± 2%  -14.00%  (p=0.008 n=5+5)
      neo/go/fs1-zhash.go+prefetch128                            37.1µs ± 6%              36.6µs ± 2%     ~     (p=0.651 n=5+5)
      neo/go/fs1(!sha1)-zhash.go(!sha1)                          76.2µs ± 8%              68.8µs ± 3%   -9.79%  (p=0.016 n=5+5)
      neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1)              26.0µs ± 2%              26.5µs ± 3%     ~     (p=0.135 n=5+5)
      neo/go/sqlite-zhash.py                                      531µs ± 9%               373µs ± 7%  -29.80%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.go                                      200µs ±13%               143µs ± 3%  -28.59%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128                         39.9µs ± 2%              39.0µs ± 5%     ~     (p=0.381 n=5+5)
      neo/go/sqlite-zhash.go(!sha1)                               185µs ±14%               133µs ± 5%  -28.19%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128(!sha1)                  37.2µs ± 6%              36.6µs ± 5%     ~     (p=0.548 n=5+5)
      cluster:z6001 dataset:prod1-1024
      fs1-zhash.py                                               30.2µs ± 2%              30.5µs ± 2%     ~     (p=0.349 n=5+5)
      fs1-zhash.go                                               4.60µs ± 0%              4.60µs ± 0%     ~     (all equal)
      fs1-zhash.go+prefetch128                                   5.70µs ± 7%              5.44µs ± 3%     ~     (p=0.119 n=5+5)
      zeo/py/fs1-zhash.py                                         646µs ± 3%               555µs ± 2%  -14.12%  (p=0.008 n=5+5)
      zeo/py/fs1-zhash.go                                         233µs ± 3%               169µs ± 1%  -27.63%  (p=0.008 n=5+5)
      zeo/py/fs1-zhash.go+prefetch128                            87.5µs ± 3%              88.4µs ± 2%     ~     (p=0.651 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                653µs ± 7%               467µs ± 4%  -28.50%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                261µs ± 6%               205µs ± 0%  -21.60%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zhash.go+prefetch128                    161µs ± 2%               161µs ± 1%     ~     (p=0.952 n=5+5)
      neo/py(!log)/sql-zhash.py                                   961µs ±38%               518µs ± 2%  -46.11%  (p=0.016 n=5+4)
      neo/py(!log)/sql-zhash.go                                   363µs ±12%               267µs ± 1%  -26.59%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zhash.go+prefetch128                       262µs ±11%               226µs ± 9%  -13.79%  (p=0.016 n=5+5)
      neo/go/fs1-zhash.py                                         490µs ± 8%               320µs ±11%  -34.68%  (p=0.008 n=5+5)
      neo/go/fs1-zhash.go                                        81.4µs ± 5%              76.3µs ± 3%   -6.34%  (p=0.008 n=5+5)
      neo/go/fs1-zhash.go+prefetch128                            23.9µs ± 2%              23.6µs ± 2%     ~     (p=0.230 n=5+5)
      neo/go/fs1(!sha1)-zhash.go(!sha1)                          70.5µs ± 6%              64.8µs ± 2%   -8.03%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1)              21.0µs ± 2%              20.5µs ± 3%   -2.38%  (p=0.048 n=5+5)
      neo/go/sqlite-zhash.py                                      521µs ± 6%               378µs ± 4%  -27.44%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.go                                      168µs ±10%               129µs ± 3%  -23.43%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128                         35.1µs ± 3%              34.8µs ± 2%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zhash.go(!sha1)                               167µs ±14%               125µs ± 5%  -25.50%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128(!sha1)                  35.0µs ± 2%              34.5µs ± 1%     ~     (p=0.214 n=5+5)
      
      name                                           old req/s                new req/s                delta
      cluster:z6001 dataset:wczblk1-8
      fs1-zwrk.go·1                                                229k ± 2%                231k ± 1%     ~     (p=0.421 n=5+5)
      fs1-zwrk.go·2                                                438k ± 0%                446k ± 2%     ~     (p=0.056 n=5+5)
      fs1-zwrk.go·3                                                665k ± 1%                659k ± 2%     ~     (p=0.548 n=5+5)
      fs1-zwrk.go·4                                                868k ± 1%                876k ± 2%     ~     (p=0.222 n=5+5)
      fs1-zwrk.go·8                                               1.75M ± 1%               1.75M ± 1%     ~     (p=0.841 n=5+5)
      fs1-zwrk.go·12                                              2.57M ± 1%               2.53M ± 2%     ~     (p=0.095 n=5+5)
      fs1-zwrk.go·16                                              2.90M ± 1%               2.91M ± 1%     ~     (p=0.095 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        4.61k ± 3%               5.14k ± 1%  +11.45%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        6.31k ± 2%               6.35k ± 0%     ~     (p=0.730 n=5+4)
      zeo/py/fs1-zwrk.go·3                                        6.98k ± 2%               7.08k ± 0%     ~     (p=0.222 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        7.11k ± 3%               7.19k ± 2%     ~     (p=0.548 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        7.41k ± 4%               7.54k ± 2%     ~     (p=0.222 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       7.63k ± 1%               7.57k ± 2%     ~     (p=0.222 n=5+5)
      zeo/py/fs1-zwrk.go·16                                       7.65k ± 3%               7.66k ± 2%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               3.27k ± 6%               4.54k ± 1%  +38.70%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               5.64k ± 2%               5.68k ± 2%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               5.57k ± 3%               5.70k ± 2%     ~     (p=0.056 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               5.59k ± 3%               5.65k ± 1%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               5.63k ± 2%               5.64k ± 1%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                              5.57k ± 3%               5.60k ± 6%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                              5.63k ± 2%               5.55k ± 4%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  2.55k ±11%               3.62k ± 3%  +42.42%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  3.89k ± 5%               4.26k ± 4%   +9.26%  (p=0.016 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  4.05k ± 3%               4.29k ± 0%   +5.95%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  3.93k ± 6%               4.21k ± 4%   +7.06%  (p=0.032 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                  4.02k ± 7%               4.20k ± 1%   +4.56%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                 4.08k ± 3%               4.19k ± 3%     ~     (p=0.056 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                 3.98k ±10%               4.21k ± 1%   +5.85%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·1                                        10.6k ± 2%               11.1k ± 3%   +4.24%  (p=0.032 n=5+5)
      neo/go/fs1-zwrk.go·2                                        22.4k ± 0%               23.0k ± 1%   +2.86%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·3                                        31.8k ± 0%               32.2k ± 0%   +1.23%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·4                                        43.1k ± 0%               43.5k ± 0%   +0.86%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·8                                        78.1k ± 0%               78.3k ± 0%     ~     (p=0.095 n=5+5)
      neo/go/fs1-zwrk.go·12                                       92.4k ± 0%               92.5k ± 0%     ~     (p=0.310 n=5+5)
      neo/go/fs1-zwrk.go·16                                        102k ± 0%                102k ± 0%     ~     (p=0.421 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                          15.2k ± 1%               15.0k ± 6%     ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                          31.4k ± 0%               31.8k ± 1%   +1.20%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                          43.8k ± 0%               44.1k ± 0%   +0.81%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                          57.6k ± 0%               57.9k ± 1%   +0.56%  (p=0.032 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                           100k ± 0%                100k ± 0%     ~     (p=0.151 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                          116k ± 0%                116k ± 0%   +0.43%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                          126k ± 0%                126k ± 0%     ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     4.92k ± 3%               7.20k ± 1%  +46.31%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     12.0k ± 0%               13.7k ± 0%  +13.89%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     18.9k ± 0%               20.0k ± 1%   +5.69%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     24.6k ± 0%               25.7k ± 0%   +4.29%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     44.3k ± 1%               45.3k ± 0%   +2.21%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    55.5k ± 1%               56.4k ± 0%   +1.60%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    58.0k ± 0%               58.2k ± 1%     ~     (p=0.095 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              5.62k ± 1%               7.73k ± 1%  +37.54%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              13.1k ± 1%               14.7k ± 1%  +12.47%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              20.2k ± 0%               21.7k ± 0%   +7.27%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              26.9k ± 0%               28.2k ± 0%   +5.09%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              47.7k ± 1%               49.0k ± 0%   +2.68%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             59.7k ± 1%               60.5k ± 0%   +1.26%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             62.8k ± 0%               61.9k ± 0%   -1.48%  (p=0.008 n=5+5)
      cluster:z6001 dataset:prod1-1024
      fs1-zwrk.go·1                                                349k ± 0%                349k ± 1%     ~     (p=0.690 n=5+5)
      fs1-zwrk.go·2                                                659k ± 2%                672k ± 1%     ~     (p=0.095 n=5+5)
      fs1-zwrk.go·3                                                990k ± 3%                982k ± 2%     ~     (p=0.310 n=5+5)
      fs1-zwrk.go·4                                               1.31M ± 1%               1.29M ± 7%     ~     (p=0.690 n=5+5)
      fs1-zwrk.go·8                                               2.52M ± 1%               2.53M ± 3%     ~     (p=0.690 n=5+5)
      fs1-zwrk.go·12                                              2.81M ± 1%               3.05M ± 1%   +8.30%  (p=0.008 n=5+5)
      fs1-zwrk.go·16                                              2.86M ± 0%               3.06M ± 1%   +6.87%  (p=0.016 n=4+5)
      zeo/py/fs1-zwrk.go·1                                        5.39k ± 4%               6.13k ± 1%  +13.78%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        8.20k ± 1%               8.21k ± 2%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        8.93k ± 2%               9.03k ± 2%     ~     (p=0.421 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        9.34k ± 4%               9.37k ± 2%     ~     (p=0.841 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        9.93k ± 3%               9.85k ± 5%     ~     (p=0.841 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       9.43k ±16%               9.57k ± 9%     ~     (p=0.690 n=5+5)
      zeo/py/fs1-zwrk.go·16                                       10.1k ± 4%               10.3k ± 1%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               3.67k ± 4%               4.90k ± 1%  +33.35%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               5.82k ± 0%               5.90k ± 0%   +1.38%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               5.78k ± 0%               5.86k ± 1%     ~     (p=0.056 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               5.67k ± 3%               5.75k ± 0%     ~     (p=0.190 n=5+4)
      neo/py(!log)/sqlite-zwrk.go·8                               5.80k ± 2%               5.84k ± 1%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                              5.85k ± 2%               5.51k ± 6%   -5.93%  (p=0.024 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                              5.78k ± 3%               5.71k ± 1%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  2.75k ±10%               3.64k ± 7%  +32.25%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  3.83k ± 5%               4.35k ± 0%  +13.62%  (p=0.016 n=5+4)
      neo/py(!log)/sql-zwrk.go·3                                  3.99k ± 9%               4.36k ± 2%   +9.20%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  4.11k ±10%               4.32k ± 0%   +4.92%  (p=0.016 n=5+4)
      neo/py(!log)/sql-zwrk.go·8                                  4.18k ± 2%               4.37k ± 1%   +4.73%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                 4.07k ± 9%               4.40k ± 1%   +7.95%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                 3.90k ± 8%               4.34k ± 1%  +11.34%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·1                                        13.7k ± 0%               14.2k ± 1%   +3.69%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·2                                        28.0k ± 0%               28.5k ± 1%   +1.73%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·3                                        40.3k ± 0%               40.6k ± 0%   +0.85%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·4                                        52.8k ± 0%               53.2k ± 1%   +0.77%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·8                                        91.0k ± 0%               90.1k ± 1%   -1.06%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·12                                       98.3k ± 1%               96.0k ± 1%   -2.30%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·16                                        101k ± 3%                 91k ± 1%   -9.91%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                          16.1k ± 1%               16.4k ± 1%   +1.47%  (p=0.016 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                          32.9k ± 0%               33.4k ± 1%   +1.65%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                          46.2k ± 0%               46.7k ± 0%   +1.11%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                          60.1k ± 0%               60.4k ± 0%   +0.60%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                           100k ± 0%                 99k ± 1%   -0.70%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                          106k ± 1%                103k ± 1%   -3.32%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                          110k ± 1%                 97k ± 1%  -11.30%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     5.74k ± 3%               7.92k ± 2%  +37.81%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     13.4k ± 0%               14.7k ± 1%  +10.00%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     20.4k ± 0%               21.3k ± 0%   +4.48%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     26.8k ± 1%               27.5k ± 1%   +2.60%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     45.6k ± 1%               44.9k ± 1%   -1.38%  (p=0.032 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    53.9k ± 1%               52.3k ± 0%   -2.91%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    50.5k ± 1%               48.4k ± 1%   -4.22%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              5.92k ± 3%               8.17k ± 2%  +38.16%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              13.6k ± 0%               15.2k ± 1%  +11.39%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              20.9k ± 1%               22.0k ± 0%   +5.32%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              27.6k ± 0%               28.2k ± 0%   +2.12%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              46.7k ± 2%               45.3k ± 0%   -2.97%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             55.2k ± 1%               52.0k ± 1%   -5.91%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             51.5k ± 2%               48.4k ± 1%   -5.99%  (p=0.008 n=5+5)
      
      name                                           old latency-time/object  new latency-time/object  delta
      cluster:z6001 dataset:wczblk1-8
      fs1-zwrk.go·1                                              4.38µs ± 2%              4.33µs ± 1%     ~     (p=0.421 n=5+5)
      fs1-zwrk.go·2                                              4.56µs ± 0%              4.49µs ± 2%     ~     (p=0.056 n=5+5)
      fs1-zwrk.go·3                                              4.51µs ± 1%              4.56µs ± 2%     ~     (p=0.548 n=5+5)
      fs1-zwrk.go·4                                              4.61µs ± 1%              4.57µs ± 2%     ~     (p=0.222 n=5+5)
      fs1-zwrk.go·8                                              4.56µs ± 1%              4.56µs ± 1%     ~     (p=0.841 n=5+5)
      fs1-zwrk.go·12                                             4.67µs ± 1%              4.75µs ± 2%     ~     (p=0.095 n=5+5)
      fs1-zwrk.go·16                                             5.52µs ± 1%              5.49µs ± 1%     ~     (p=0.095 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        217µs ± 3%               195µs ± 1%  -10.29%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        317µs ± 2%               315µs ± 0%     ~     (p=0.730 n=5+4)
      zeo/py/fs1-zwrk.go·3                                        430µs ± 2%               424µs ± 0%     ~     (p=0.222 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        563µs ± 3%               556µs ± 2%     ~     (p=0.548 n=5+5)
      zeo/py/fs1-zwrk.go·8                                       1.08ms ± 4%              1.06ms ± 2%     ~     (p=0.222 n=5+5)
      zeo/py/fs1-zwrk.go·12                                      1.57ms ± 1%              1.58ms ± 2%     ~     (p=0.222 n=5+5)
      zeo/py/fs1-zwrk.go·16                                      2.09ms ± 3%              2.09ms ± 2%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               306µs ± 6%               220µs ± 1%  -27.99%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               355µs ± 2%               352µs ± 2%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               539µs ± 4%               526µs ± 2%     ~     (p=0.056 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               715µs ± 3%               708µs ± 1%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                              1.42ms ± 2%              1.42ms ± 1%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                             2.16ms ± 3%              2.15ms ± 6%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                             2.84ms ± 2%              2.89ms ± 4%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  395µs ±11%               276µs ± 3%  -30.18%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  514µs ± 5%               470µs ± 4%   -8.50%  (p=0.016 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  741µs ± 3%               699µs ± 0%   -5.64%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                 1.02ms ± 7%              0.95ms ± 5%   -6.66%  (p=0.032 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                 2.00ms ± 7%              1.91ms ± 1%   -4.52%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                2.94ms ± 3%              2.87ms ± 3%     ~     (p=0.056 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                4.04ms ±11%              3.80ms ± 1%   -5.78%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·1                                       94.3µs ± 2%              90.5µs ± 3%   -4.03%  (p=0.032 n=5+5)
      neo/go/fs1-zwrk.go·2                                       89.4µs ± 0%              86.9µs ± 1%   -2.78%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·3                                       94.4µs ± 0%              93.2µs ± 0%   -1.21%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·4                                       92.7µs ± 0%              91.9µs ± 0%   -0.85%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·8                                        102µs ± 0%               102µs ± 0%     ~     (p=0.095 n=5+5)
      neo/go/fs1-zwrk.go·12                                       130µs ± 0%               130µs ± 0%     ~     (p=0.310 n=5+5)
      neo/go/fs1-zwrk.go·16                                       156µs ± 0%               156µs ± 0%     ~     (p=0.452 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                         65.9µs ± 1%              66.6µs ± 6%     ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                         63.6µs ± 0%              62.9µs ± 1%   -1.19%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                         68.5µs ± 0%              68.0µs ± 0%   -0.80%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                         69.4µs ± 0%              69.0µs ± 1%   -0.55%  (p=0.032 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                         80.1µs ± 0%              79.8µs ± 0%     ~     (p=0.151 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         104µs ± 0%               103µs ± 0%   -0.42%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         127µs ± 0%               127µs ± 0%     ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     203µs ± 3%               139µs ± 1%  -31.68%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     167µs ± 0%               147µs ± 0%  -12.19%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     158µs ± 0%               150µs ± 1%   -5.38%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     163µs ± 0%               156µs ± 0%   -4.11%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     181µs ± 1%               177µs ± 0%   -2.17%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    216µs ± 1%               213µs ± 0%   -1.57%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    276µs ± 0%               275µs ± 1%     ~     (p=0.095 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              178µs ± 1%               129µs ± 1%  -27.30%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              153µs ± 1%               136µs ± 1%  -11.08%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              149µs ± 0%               138µs ± 0%   -6.78%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              149µs ± 0%               142µs ± 0%   -4.85%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              168µs ± 1%               163µs ± 0%   -2.61%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             201µs ± 1%               198µs ± 0%   -1.25%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             255µs ± 0%               259µs ± 0%   +1.51%  (p=0.008 n=5+5)
      cluster:z6001 dataset:prod1-1024
      fs1-zwrk.go·1                                              2.87µs ± 0%              2.87µs ± 1%     ~     (p=0.683 n=5+5)
      fs1-zwrk.go·2                                              3.04µs ± 2%              2.98µs ± 1%     ~     (p=0.095 n=5+5)
      fs1-zwrk.go·3                                              3.03µs ± 3%              3.05µs ± 2%     ~     (p=0.310 n=5+5)
      fs1-zwrk.go·4                                              3.06µs ± 1%              3.10µs ± 7%     ~     (p=0.651 n=5+5)
      fs1-zwrk.go·8                                              3.18µs ± 1%              3.16µs ± 3%     ~     (p=0.690 n=5+5)
      fs1-zwrk.go·12                                             4.26µs ± 1%              3.94µs ± 1%   -7.65%  (p=0.008 n=5+5)
      fs1-zwrk.go·16                                             5.59µs ± 0%              5.23µs ± 1%   -6.43%  (p=0.016 n=4+5)
      zeo/py/fs1-zwrk.go·1                                        186µs ± 4%               163µs ± 1%  -12.16%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        244µs ± 1%               244µs ± 2%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        336µs ± 2%               332µs ± 2%     ~     (p=0.421 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        428µs ± 4%               427µs ± 2%     ~     (p=0.841 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        806µs ± 3%               813µs ± 5%     ~     (p=0.841 n=5+5)
      zeo/py/fs1-zwrk.go·12                                      1.29ms ±17%              1.26ms ± 9%     ~     (p=0.690 n=5+5)
      zeo/py/fs1-zwrk.go·16                                      1.59ms ± 4%              1.55ms ± 1%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               273µs ± 4%               204µs ± 1%  -25.07%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               344µs ± 0%               339µs ± 0%   -1.36%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               519µs ± 0%               512µs ± 1%     ~     (p=0.056 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               705µs ± 3%               695µs ± 0%     ~     (p=0.190 n=5+4)
      neo/py(!log)/sqlite-zwrk.go·8                              1.38ms ± 2%              1.37ms ± 1%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                             2.05ms ± 2%              2.18ms ± 6%   +6.50%  (p=0.032 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                             2.77ms ± 3%              2.80ms ± 1%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  365µs ±11%               275µs ± 7%  -24.47%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  524µs ± 5%               460µs ± 0%  -12.15%  (p=0.016 n=5+4)
      neo/py(!log)/sql-zwrk.go·3                                  754µs ±10%               689µs ± 1%   -8.64%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  975µs ±11%               927µs ± 0%   -4.98%  (p=0.016 n=5+4)
      neo/py(!log)/sql-zwrk.go·8                                 1.92ms ± 2%              1.83ms ± 1%   -4.53%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                2.95ms ± 9%              2.73ms ± 1%   -7.65%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                4.12ms ± 8%              3.69ms ± 1%  -10.36%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·1                                       72.8µs ± 0%              70.2µs ± 1%   -3.56%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·2                                       71.5µs ± 0%              70.3µs ± 1%   -1.70%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·3                                       74.4µs ± 0%              73.8µs ± 0%   -0.85%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·4                                       75.8µs ± 0%              75.2µs ± 1%   -0.76%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·8                                       87.9µs ± 0%              88.8µs ± 1%   +1.07%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·12                                       122µs ± 1%               125µs ± 1%   +2.36%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·16                                       158µs ± 3%               175µs ± 1%  +10.97%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                         62.0µs ± 1%              61.1µs ± 1%   -1.45%  (p=0.016 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                         60.8µs ± 0%              59.8µs ± 1%   -1.62%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                         64.9µs ± 0%              64.2µs ± 0%   -1.10%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                         66.6µs ± 0%              66.2µs ± 0%   -0.60%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                         80.3µs ± 0%              80.9µs ± 1%   +0.71%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         113µs ± 1%               117µs ± 1%   +3.44%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         146µs ± 1%               165µs ± 1%  +12.74%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     174µs ± 3%               126µs ± 2%  -27.44%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     149µs ± 0%               136µs ± 1%   -9.09%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     147µs ± 0%               141µs ± 0%   -4.28%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     149µs ± 1%               145µs ± 1%   -2.53%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     176µs ± 1%               178µs ± 1%   +1.40%  (p=0.032 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    223µs ± 1%               229µs ± 0%   +3.00%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    317µs ± 1%               331µs ± 1%   +4.40%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              169µs ± 3%               122µs ± 2%  -27.64%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              147µs ± 0%               132µs ± 1%  -10.22%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              144µs ± 1%               136µs ± 0%   -5.05%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              145µs ± 0%               142µs ± 0%   -2.07%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              171µs ± 2%               177µs ± 0%   +3.05%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             217µs ± 1%               231µs ± 1%   +6.28%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             311µs ± 2%               331µs ± 1%   +6.37%  (p=0.008 n=5+5)
      5685f384
    • Kirill Smelkov's avatar
      X z6001: localhost timings, Cenabled, zwrk@10s · 20788052
      Kirill Smelkov authored
      Compared to zwrk@1 it helps, but only a tiny bit, and the timings are
      still noisy:
      
      ---- 8< ----
      cluster:z6001 dataset:wczblk1-8
      neo/py(!log)/sql-zwrk.go·8                                 2.21ms ±11%              2.00ms ± 7%   -9.61%  (p=0.032 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                3.31ms ± 6%              2.94ms ± 3%  -11.20%  (p=0.008 n=5+5)
      
      cluster:z6001 dataset:prod1-1024
      zeo/py/fs1-zwrk.go·1                                        204µs ± 6%               186µs ± 4%   -9.09%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  818µs ± 8%               754µs ±10%   -7.83%  (p=0.032 n=5+5)
      neo/go/fs1-zwrk.go·16                                       178µs ± 1%               158µs ± 3%  -11.35%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         164µs ± 2%               146µs ± 1%  -11.22%  (p=0.008 n=5+5)
      ---- 8< ----
      
      The help is much less compared to the signidican speedup with Cstates
      disabled (65de70b8).
      
      The next commit will add remeasurements with C-states disabled.
      
      ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
      
      $ benchstat -split node,cluster,dataset  20180308-z6001-ffixed-c-zwrk1s.txt 20180308-z6001-ffixed-c-zwrk10s.txt
      
      name                                           old pystone/s            new pystone/s            delta
      node:z6001
      pystone                                                      114k ± 1%                114k ± 1%     ~     (p=0.690 n=5+5)
      
      name                                           old time/op              new time/op              delta
      node:z6001
      crc32/py/4K                                                5.10µs ± 0%              5.10µs ± 0%     ~     (p=0.587 n=5+5)
      crc32/go/4K                                                1.72µs ± 0%              1.77µs ± 8%     ~     (p=0.381 n=4+5)
      sha1/py/4K                                                 14.6µs ± 0%              14.6µs ± 0%     ~     (p=0.556 n=5+4)
      sha1/go/4K                                                 10.3µs ± 0%              10.3µs ± 0%     ~     (p=0.714 n=5+4)
      unzlib/py/wczdata                                          36.2µs ± 1%              36.4µs ± 1%     ~     (p=0.548 n=5+5)
      unzlib/go/wczdata                                          31.5µs ± 0%              31.5µs ± 0%     ~     (p=0.310 n=5+5)
      unzlib/py/prod1-avg                                        18.2µs ± 1%              18.4µs ± 3%     ~     (p=0.222 n=5+5)
      unzlib/go/prod1-avg                                        10.0µs ± 2%              10.0µs ± 1%     ~     (p=0.548 n=5+5)
      disk/randread/direct/4K-min                                 129µs ± 4%               133µs ± 6%     ~     (p=0.841 n=5+5)
      disk/randread/direct/4K-avg                                 201µs ± 7%               201µs ± 6%     ~     (p=0.794 n=5+5)
      disk/randread/pagecache/4K-min                              793ns ± 2%               797ns ± 2%     ~     (p=0.548 n=5+5)
      disk/randread/pagecache/4K-avg                             1.41µs ± 4%              1.40µs ± 7%     ~     (p=0.881 n=5+5)
      
      name                                           old time/object          new time/object          delta
      cluster:z6001 dataset:wczblk1-8
      fs1-zhash.py                                               37.5µs ± 1%              37.4µs ± 2%     ~     (p=0.897 n=5+5)
      fs1-zhash.go                                               5.90µs ± 0%              6.04µs ± 1%   +2.37%  (p=0.008 n=5+5)
      fs1-zhash.go+prefetch128                                   8.10µs ± 5%              8.35µs ± 2%     ~     (p=0.286 n=5+4)
      zeo/py/fs1-zhash.py                                         661µs ± 8%               675µs ± 5%     ~     (p=0.841 n=5+5)
      zeo/py/fs1-zhash.go                                         267µs ± 8%               267µs ± 7%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zhash.go+prefetch128                             102µs ± 1%               101µs ± 2%     ~     (p=0.397 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                692µs ± 4%               673µs ± 8%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                309µs ±15%               291µs ±11%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sqlite-zhash.go+prefetch128                    176µs ± 1%               176µs ± 1%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sql-zhash.py                                   992µs ±31%               958µs ±28%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zhash.go                                   377µs ±16%               441µs ± 6%  +16.96%  (p=0.016 n=5+5)
      neo/py(!log)/sql-zhash.go+prefetch128                       268µs ±12%               269µs ±15%     ~     (p=1.000 n=5+5)
      neo/go/fs1-zhash.py                                         482µs ±20%               509µs ±15%     ~     (p=0.548 n=5+5)
      neo/go/fs1-zhash.go                                         102µs ± 9%               106µs ± 8%     ~     (p=0.310 n=5+5)
      neo/go/fs1-zhash.go+prefetch128                            37.2µs ± 2%              37.1µs ± 6%     ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zhash.go(!sha1)                          73.1µs ±12%              76.2µs ± 8%     ~     (p=0.421 n=5+5)
      neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1)              26.9µs ± 7%              26.0µs ± 2%     ~     (p=0.198 n=5+5)
      neo/go/sqlite-zhash.py                                      525µs ±10%               531µs ± 9%     ~     (p=1.000 n=5+5)
      neo/go/sqlite-zhash.go                                      193µs ±16%               200µs ±13%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128                         39.6µs ± 4%              39.9µs ± 2%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zhash.go(!sha1)                               195µs ±25%               185µs ±14%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128(!sha1)                  36.7µs ± 3%              37.2µs ± 6%     ~     (p=0.452 n=5+5)
      cluster:z6001 dataset:prod1-1024
      fs1-zhash.py                                               30.3µs ± 2%              30.2µs ± 2%     ~     (p=0.738 n=5+5)
      fs1-zhash.go                                               4.56µs ± 1%              4.60µs ± 0%     ~     (p=0.444 n=5+5)
      fs1-zhash.go+prefetch128                                   5.96µs ± 9%              5.70µs ± 7%     ~     (p=0.397 n=5+5)
      zeo/py/fs1-zhash.py                                         615µs ±13%               646µs ± 3%     ~     (p=0.222 n=5+5)
      zeo/py/fs1-zhash.go                                         235µs ± 6%               233µs ± 3%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zhash.go+prefetch128                            87.6µs ± 1%              87.5µs ± 3%     ~     (p=0.802 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                658µs ± 5%               653µs ± 7%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                256µs ± 8%               261µs ± 6%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zhash.go+prefetch128                    161µs ± 0%               161µs ± 2%     ~     (p=0.659 n=5+5)
      neo/py(!log)/sql-zhash.py                                  1.02ms ±33%              0.96ms ±38%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sql-zhash.go                                   385µs ± 8%               363µs ±12%     ~     (p=0.222 n=5+5)
      neo/py(!log)/sql-zhash.go+prefetch128                       263µs ±11%               262µs ±11%     ~     (p=0.690 n=5+5)
      neo/go/fs1-zhash.py                                         461µs ±16%               490µs ± 8%     ~     (p=0.421 n=5+5)
      neo/go/fs1-zhash.go                                        82.9µs ± 5%              81.4µs ± 5%     ~     (p=0.341 n=5+5)
      neo/go/fs1-zhash.go+prefetch128                            23.9µs ± 3%              23.9µs ± 2%     ~     (p=0.810 n=5+5)
      neo/go/fs1(!sha1)-zhash.go(!sha1)                          69.7µs ±11%              70.5µs ± 6%     ~     (p=0.548 n=5+5)
      neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1)              21.0µs ± 2%              21.0µs ± 2%     ~     (p=0.762 n=5+5)
      neo/go/sqlite-zhash.py                                      541µs ± 9%               521µs ± 6%     ~     (p=0.310 n=5+5)
      neo/go/sqlite-zhash.go                                      181µs ±13%               168µs ±10%     ~     (p=0.310 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128                         35.5µs ± 2%              35.1µs ± 3%     ~     (p=0.452 n=5+5)
      neo/go/sqlite-zhash.go(!sha1)                               162µs ±14%               167µs ±14%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128(!sha1)                  35.3µs ± 1%              35.0µs ± 2%     ~     (p=0.794 n=5+5)
      
      name                                           old req/s                new req/s                delta
      cluster:z6001 dataset:wczblk1-8
      fs1-zwrk.go·1                                                228k ± 3%                229k ± 2%     ~     (p=0.841 n=5+5)
      fs1-zwrk.go·2                                                444k ± 1%                438k ± 0%   -1.35%  (p=0.016 n=5+5)
      fs1-zwrk.go·3                                                660k ± 3%                665k ± 1%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·4                                                882k ± 1%                868k ± 1%   -1.54%  (p=0.016 n=5+5)
      fs1-zwrk.go·8                                               1.75M ± 2%               1.75M ± 1%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·12                                              2.50M ± 3%               2.57M ± 1%   +2.64%  (p=0.032 n=5+5)
      fs1-zwrk.go·16                                              2.88M ± 1%               2.90M ± 1%     ~     (p=0.151 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        4.44k ± 6%               4.61k ± 3%     ~     (p=0.095 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        6.32k ± 0%               6.31k ± 2%     ~     (p=0.690 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        6.89k ± 0%               6.98k ± 2%     ~     (p=0.135 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        7.15k ± 1%               7.11k ± 3%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        7.46k ± 2%               7.41k ± 4%     ~     (p=0.690 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       7.55k ± 1%               7.63k ± 1%     ~     (p=0.063 n=5+5)
      zeo/py/fs1-zwrk.go·16                                       7.55k ± 1%               7.65k ± 3%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               3.74k ±12%               3.27k ± 6%     ~     (p=0.056 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               5.59k ± 1%               5.64k ± 2%     ~     (p=0.222 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               5.58k ± 1%               5.57k ± 3%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               5.54k ± 1%               5.59k ± 3%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               5.65k ± 0%               5.63k ± 2%     ~     (p=0.222 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                              5.59k ± 0%               5.57k ± 3%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                              5.58k ± 1%               5.63k ± 2%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  2.61k ± 5%               2.55k ±11%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  3.88k ±11%               3.89k ± 5%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  3.80k ±12%               4.05k ± 3%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  3.85k ± 5%               3.93k ± 6%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                  3.64k ±12%               4.02k ± 7%  +10.28%  (p=0.032 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                 3.62k ± 6%               4.08k ± 3%  +12.51%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                 3.92k ±13%               3.98k ±10%     ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·1                                        10.6k ± 5%               10.6k ± 2%     ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·2                                        22.4k ± 1%               22.4k ± 0%     ~     (p=0.310 n=5+5)
      neo/go/fs1-zwrk.go·3                                        31.9k ± 1%               31.8k ± 0%     ~     (p=0.095 n=5+5)
      neo/go/fs1-zwrk.go·4                                        43.2k ± 0%               43.1k ± 0%     ~     (p=0.310 n=5+5)
      neo/go/fs1-zwrk.go·8                                        78.2k ± 0%               78.1k ± 0%     ~     (p=0.548 n=5+5)
      neo/go/fs1-zwrk.go·12                                       92.3k ± 0%               92.4k ± 0%     ~     (p=0.151 n=5+5)
      neo/go/fs1-zwrk.go·16                                        102k ± 1%                102k ± 0%     ~     (p=0.690 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                          15.0k ± 4%               15.2k ± 1%     ~     (p=0.310 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                          31.4k ± 1%               31.4k ± 0%     ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                          43.9k ± 0%               43.8k ± 0%     ~     (p=0.421 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                          57.6k ± 0%               57.6k ± 0%     ~     (p=0.635 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                           100k ± 0%                100k ± 0%   -0.33%  (p=0.032 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                          116k ± 0%                116k ± 0%   -0.44%  (p=0.032 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                          126k ± 0%                126k ± 0%   -0.28%  (p=0.032 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     5.06k ± 8%               4.92k ± 3%     ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     11.9k ± 2%               12.0k ± 0%     ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     19.0k ± 1%               18.9k ± 0%     ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     24.6k ± 1%               24.6k ± 0%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     44.8k ± 0%               44.3k ± 1%   -1.06%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    56.3k ± 0%               55.5k ± 1%   -1.29%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    58.2k ± 0%               58.0k ± 0%     ~     (p=0.056 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              5.71k ± 8%               5.62k ± 1%     ~     (p=0.794 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              13.2k ± 3%               13.1k ± 1%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              20.4k ± 1%               20.2k ± 0%   -0.96%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              27.1k ± 1%               26.9k ± 0%   -1.07%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              48.3k ± 0%               47.7k ± 1%   -1.13%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             60.2k ± 0%               59.7k ± 1%   -0.85%  (p=0.032 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             61.7k ± 0%               62.8k ± 0%   +1.77%  (p=0.008 n=5+5)
      cluster:z6001 dataset:prod1-1024
      fs1-zwrk.go·1                                                347k ± 2%                349k ± 0%     ~     (p=0.690 n=5+5)
      fs1-zwrk.go·2                                                662k ± 1%                659k ± 2%     ~     (p=0.841 n=5+5)
      fs1-zwrk.go·3                                                982k ± 1%                990k ± 3%     ~     (p=0.548 n=5+5)
      fs1-zwrk.go·4                                               1.30M ± 2%               1.31M ± 1%     ~     (p=0.310 n=5+5)
      fs1-zwrk.go·8                                               2.56M ± 2%               2.52M ± 1%   -1.81%  (p=0.032 n=5+5)
      fs1-zwrk.go·12                                              2.83M ± 1%               2.81M ± 1%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·16                                              2.82M ± 1%               2.86M ± 0%   +1.58%  (p=0.016 n=5+4)
      zeo/py/fs1-zwrk.go·1                                        4.90k ± 6%               5.39k ± 4%   +9.97%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        8.11k ± 0%               8.20k ± 1%   +1.11%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        9.07k ± 2%               8.93k ± 2%     ~     (p=0.310 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        9.36k ± 0%               9.34k ± 4%     ~     (p=0.690 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        10.0k ± 2%                9.9k ± 3%     ~     (p=0.548 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       10.2k ± 2%                9.4k ±16%     ~     (p=1.000 n=4+5)
      zeo/py/fs1-zwrk.go·16                                       10.3k ± 2%               10.1k ± 4%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               3.80k ±13%               3.67k ± 4%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               5.80k ± 0%               5.82k ± 0%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               5.57k ± 8%               5.78k ± 0%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               5.80k ± 0%               5.67k ± 3%   -2.26%  (p=0.016 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               5.78k ± 2%               5.80k ± 2%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                              5.77k ± 0%               5.85k ± 2%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                              5.80k ± 0%               5.78k ± 3%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  2.74k ±24%               2.75k ±10%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  3.69k ± 8%               3.83k ± 5%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  3.68k ± 8%               3.99k ± 9%   +8.34%  (p=0.032 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  3.80k ±10%               4.11k ±10%     ~     (p=0.095 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                  3.94k ±12%               4.18k ± 2%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                 4.04k ±12%               4.07k ± 9%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                 3.82k ±10%               3.90k ± 8%     ~     (p=0.690 n=5+5)
      neo/go/fs1-zwrk.go·1                                        13.7k ± 4%               13.7k ± 0%     ~     (p=0.690 n=5+5)
      neo/go/fs1-zwrk.go·2                                        28.0k ± 0%               28.0k ± 0%     ~     (p=0.151 n=5+5)
      neo/go/fs1-zwrk.go·3                                        40.2k ± 0%               40.3k ± 0%     ~     (p=0.548 n=5+5)
      neo/go/fs1-zwrk.go·4                                        52.8k ± 0%               52.8k ± 0%     ~     (p=1.000 n=5+5)
      neo/go/fs1-zwrk.go·8                                        90.5k ± 0%               91.0k ± 0%   +0.61%  (p=0.016 n=5+5)
      neo/go/fs1-zwrk.go·12                                       95.9k ± 1%               98.3k ± 1%   +2.47%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·16                                       89.9k ± 1%              101.4k ± 3%  +12.84%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                          16.2k ± 3%               16.1k ± 1%     ~     (p=0.151 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                          33.0k ± 0%               32.9k ± 0%   -0.47%  (p=0.032 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                          46.1k ± 1%               46.2k ± 0%     ~     (p=0.151 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                          60.2k ± 0%               60.1k ± 0%     ~     (p=0.690 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          99.2k ± 1%               99.6k ± 0%     ~     (p=0.095 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                          103k ± 0%                106k ± 1%   +3.11%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         97.3k ± 2%              109.6k ± 1%  +12.63%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     5.79k ± 8%               5.74k ± 3%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     13.3k ± 1%               13.4k ± 0%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     20.3k ± 1%               20.4k ± 0%     ~     (p=0.056 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     26.4k ± 1%               26.8k ± 1%   +1.42%  (p=0.016 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     44.7k ± 0%               45.6k ± 1%   +2.04%  (p=0.016 n=4+5)
      neo/go/sqlite-zwrk.go·12                                    52.6k ± 0%               53.9k ± 1%   +2.38%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    48.6k ± 1%               50.5k ± 1%   +3.98%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              5.81k ±12%               5.92k ± 3%     ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              13.1k ± 3%               13.6k ± 0%   +3.75%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              20.5k ± 1%               20.9k ± 1%   +1.84%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              27.2k ± 2%               27.6k ± 0%   +1.50%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              45.3k ± 0%               46.7k ± 2%   +3.11%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             53.3k ± 1%               55.2k ± 1%   +3.56%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             49.9k ± 1%               51.5k ± 2%   +3.18%  (p=0.008 n=5+5)
      
      name                                           old latency-time/object  new latency-time/object  delta
      cluster:z6001 dataset:wczblk1-8
      fs1-zwrk.go·1                                              4.39µs ± 4%              4.38µs ± 2%     ~     (p=0.841 n=5+5)
      fs1-zwrk.go·2                                              4.50µs ± 1%              4.56µs ± 0%   +1.36%  (p=0.016 n=5+5)
      fs1-zwrk.go·3                                              4.55µs ± 3%              4.51µs ± 1%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·4                                              4.54µs ± 1%              4.61µs ± 1%   +1.56%  (p=0.016 n=5+5)
      fs1-zwrk.go·8                                              4.57µs ± 2%              4.56µs ± 1%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·12                                             4.80µs ± 3%              4.67µs ± 1%   -2.60%  (p=0.024 n=5+5)
      fs1-zwrk.go·16                                             5.56µs ± 1%              5.52µs ± 1%     ~     (p=0.135 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        225µs ± 6%               217µs ± 3%     ~     (p=0.095 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        317µs ± 0%               317µs ± 2%     ~     (p=0.690 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        435µs ± 0%               430µs ± 2%     ~     (p=0.151 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        559µs ± 1%               563µs ± 3%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zwrk.go·8                                       1.07ms ± 2%              1.08ms ± 4%     ~     (p=0.690 n=5+5)
      zeo/py/fs1-zwrk.go·12                                      1.59ms ± 1%              1.57ms ± 1%     ~     (p=0.056 n=5+5)
      zeo/py/fs1-zwrk.go·16                                      2.12ms ± 1%              2.09ms ± 3%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               269µs ±12%               306µs ± 6%     ~     (p=0.056 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               358µs ± 1%               355µs ± 2%     ~     (p=0.222 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               537µs ± 1%               539µs ± 4%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               721µs ± 1%               715µs ± 3%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                              1.42ms ± 0%              1.42ms ± 2%     ~     (p=0.222 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                             2.15ms ± 0%              2.16ms ± 3%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                             2.87ms ± 1%              2.84ms ± 2%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  384µs ± 5%               395µs ±11%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  518µs ±11%               514µs ± 5%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  795µs ±13%               741µs ± 3%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                 1.04ms ± 5%              1.02ms ± 7%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                 2.21ms ±11%              2.00ms ± 7%   -9.61%  (p=0.032 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                3.31ms ± 6%              2.94ms ± 3%  -11.20%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                4.10ms ±15%              4.04ms ±11%     ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·1                                       94.0µs ± 5%              94.3µs ± 2%     ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·2                                       89.1µs ± 1%              89.4µs ± 0%     ~     (p=0.310 n=5+5)
      neo/go/fs1-zwrk.go·3                                       94.0µs ± 1%              94.4µs ± 0%     ~     (p=0.095 n=5+5)
      neo/go/fs1-zwrk.go·4                                       92.7µs ± 0%              92.7µs ± 0%     ~     (p=0.310 n=5+5)
      neo/go/fs1-zwrk.go·8                                        102µs ± 0%               102µs ± 0%     ~     (p=0.548 n=5+5)
      neo/go/fs1-zwrk.go·12                                       130µs ± 0%               130µs ± 0%     ~     (p=0.151 n=5+5)
      neo/go/fs1-zwrk.go·16                                       156µs ± 1%               156µs ± 0%     ~     (p=0.690 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                         66.5µs ± 4%              65.9µs ± 1%     ~     (p=0.310 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                         63.6µs ± 1%              63.6µs ± 0%     ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                         68.4µs ± 0%              68.5µs ± 0%     ~     (p=0.421 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                         69.4µs ± 0%              69.4µs ± 0%     ~     (p=0.635 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                         79.8µs ± 0%              80.1µs ± 0%   +0.33%  (p=0.032 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         103µs ± 0%               104µs ± 0%   +0.45%  (p=0.032 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         127µs ± 0%               127µs ± 0%   +0.28%  (p=0.032 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     198µs ± 8%               203µs ± 3%     ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     169µs ± 2%               167µs ± 0%     ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     158µs ± 1%               158µs ± 0%     ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     162µs ± 1%               163µs ± 0%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     179µs ± 0%               181µs ± 1%   +1.07%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    213µs ± 0%               216µs ± 1%   +1.31%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    275µs ± 0%               276µs ± 0%     ~     (p=0.056 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              175µs ± 8%               178µs ± 1%     ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              152µs ± 3%               153µs ± 1%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              147µs ± 1%               149µs ± 0%   +0.96%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              147µs ± 1%               149µs ± 0%   +1.08%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              166µs ± 0%               168µs ± 1%   +1.14%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             199µs ± 0%               201µs ± 1%   +0.86%  (p=0.032 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             259µs ± 0%               255µs ± 0%   -1.74%  (p=0.008 n=5+5)
      cluster:z6001 dataset:prod1-1024
      fs1-zwrk.go·1                                              2.88µs ± 2%              2.87µs ± 0%     ~     (p=0.651 n=5+5)
      fs1-zwrk.go·2                                              3.02µs ± 1%              3.04µs ± 2%     ~     (p=0.794 n=5+5)
      fs1-zwrk.go·3                                              3.05µs ± 1%              3.03µs ± 3%     ~     (p=0.548 n=5+5)
      fs1-zwrk.go·4                                              3.08µs ± 2%              3.06µs ± 1%     ~     (p=0.310 n=5+5)
      fs1-zwrk.go·8                                              3.12µs ± 2%              3.18µs ± 1%   +1.83%  (p=0.032 n=5+5)
      fs1-zwrk.go·12                                             4.25µs ± 1%              4.26µs ± 1%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·16                                             5.68µs ± 1%              5.59µs ± 0%   -1.57%  (p=0.016 n=5+4)
      zeo/py/fs1-zwrk.go·1                                        204µs ± 6%               186µs ± 4%   -9.09%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        247µs ± 0%               244µs ± 1%   -1.09%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        331µs ± 2%               336µs ± 2%     ~     (p=0.310 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        427µs ± 0%               428µs ± 4%     ~     (p=0.690 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        801µs ± 2%               806µs ± 3%     ~     (p=0.548 n=5+5)
      zeo/py/fs1-zwrk.go·12                                      1.17ms ± 2%              1.29ms ±17%     ~     (p=1.000 n=4+5)
      zeo/py/fs1-zwrk.go·16                                      1.55ms ± 2%              1.59ms ± 4%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               265µs ±12%               273µs ± 4%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               345µs ± 0%               344µs ± 0%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               540µs ± 8%               519µs ± 0%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               689µs ± 0%               705µs ± 3%   +2.35%  (p=0.016 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                              1.38ms ± 2%              1.38ms ± 2%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                             2.08ms ± 0%              2.05ms ± 2%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                             2.76ms ± 0%              2.77ms ± 3%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  372µs ±21%               365µs ±11%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  543µs ± 8%               524µs ± 5%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  818µs ± 8%               754µs ±10%   -7.83%  (p=0.032 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                 1.06ms ±10%              0.98ms ±11%     ~     (p=0.095 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                 2.05ms ±13%              1.92ms ± 2%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                2.98ms ±13%              2.95ms ± 9%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                4.20ms ±10%              4.12ms ± 8%     ~     (p=0.690 n=5+5)
      neo/go/fs1-zwrk.go·1                                       73.3µs ± 4%              72.8µs ± 0%     ~     (p=0.690 n=5+5)
      neo/go/fs1-zwrk.go·2                                       71.3µs ± 0%              71.5µs ± 0%     ~     (p=0.151 n=5+5)
      neo/go/fs1-zwrk.go·3                                       74.5µs ± 0%              74.4µs ± 0%     ~     (p=0.548 n=5+5)
      neo/go/fs1-zwrk.go·4                                       75.8µs ± 0%              75.8µs ± 0%     ~     (p=1.000 n=5+5)
      neo/go/fs1-zwrk.go·8                                       88.4µs ± 0%              87.9µs ± 0%   -0.60%  (p=0.016 n=5+5)
      neo/go/fs1-zwrk.go·12                                       125µs ± 1%               122µs ± 1%   -2.41%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·16                                       178µs ± 1%               158µs ± 3%  -11.35%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                         61.6µs ± 3%              62.0µs ± 1%     ~     (p=0.151 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                         60.5µs ± 0%              60.8µs ± 0%   +0.47%  (p=0.032 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                         65.1µs ± 1%              64.9µs ± 0%     ~     (p=0.151 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                         66.5µs ± 0%              66.6µs ± 0%     ~     (p=0.690 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                         80.7µs ± 1%              80.3µs ± 0%     ~     (p=0.095 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         116µs ± 0%               113µs ± 1%   -3.01%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         164µs ± 2%               146µs ± 1%  -11.22%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     173µs ± 8%               174µs ± 3%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     151µs ± 1%               149µs ± 0%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     148µs ± 1%               147µs ± 0%     ~     (p=0.056 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     151µs ± 1%               149µs ± 1%   -1.41%  (p=0.016 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     179µs ± 0%               176µs ± 1%   -1.99%  (p=0.016 n=4+5)
      neo/go/sqlite-zwrk.go·12                                    228µs ± 0%               223µs ± 1%   -2.33%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    329µs ± 1%               317µs ± 1%   -3.83%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              173µs ±13%               169µs ± 3%     ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              153µs ± 3%               147µs ± 0%   -3.67%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              146µs ± 1%               144µs ± 1%   -1.81%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              147µs ± 2%               145µs ± 0%   -1.49%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              177µs ± 0%               171µs ± 2%   -3.01%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             225µs ± 1%               217µs ± 1%   -3.44%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             321µs ± 1%               311µs ± 2%   -3.07%  (p=0.008 n=5+5)
      20788052
    • Kirill Smelkov's avatar
      X z6001: localhost timings, Cenabled, zwrk@1s · 7f785235
      Kirill Smelkov authored
      Remeasure with the same sattings as previous z6001 localhost with C-enabled (850bfb9d):
      
      Like on neo1 the data is more or less the same and in particular timings
      for either sql backend or python client or even neo/go vs go client are noisy.
      
      ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
      
      $ benchstat -split node,cluster,dataset  20180306-z6001-ffixed-c.txt 20180308-z6001-ffixed-c-zwrk1s.txt
      
      name                                           old pystone/s            new pystone/s            delta
      node:z6001
      pystone                                                      109k ± 9%                114k ± 1%     ~     (p=0.421 n=5+5)
      
      name                                           old time/op              new time/op              delta
      node:z6001
      crc32/py/4K                                                5.11µs ± 1%              5.10µs ± 0%     ~     (p=0.968 n=5+5)
      crc32/go/4K                                                1.72µs ± 0%              1.72µs ± 0%     ~     (p=1.000 n=4+4)
      sha1/py/4K                                                 14.7µs ± 1%              14.6µs ± 0%   -0.55%  (p=0.032 n=5+5)
      sha1/go/4K                                                 10.3µs ± 0%              10.3µs ± 0%     ~     (p=0.103 n=5+5)
      unzlib/py/wczdata                                          37.1µs ± 8%              36.2µs ± 1%     ~     (p=0.421 n=5+5)
      unzlib/go/wczdata                                          31.5µs ± 0%              31.5µs ± 0%     ~     (p=0.889 n=5+5)
      unzlib/py/prod1-avg                                        18.5µs ± 3%              18.2µs ± 1%     ~     (p=0.222 n=5+5)
      unzlib/go/prod1-avg                                        10.0µs ± 1%              10.0µs ± 2%     ~     (p=0.690 n=5+5)
      disk/randread/direct/4K-min                                 126µs ± 1%               129µs ± 4%   +2.33%  (p=0.048 n=4+5)
      disk/randread/direct/4K-avg                                 199µs ± 9%               201µs ± 7%     ~     (p=1.000 n=5+5)
      disk/randread/pagecache/4K-min                              806ns ± 3%               793ns ± 2%     ~     (p=0.310 n=5+5)
      disk/randread/pagecache/4K-avg                             1.44µs ± 7%              1.41µs ± 4%     ~     (p=0.635 n=5+5)
      
      name                                           old time/object          new time/object          delta
      cluster:z6001 dataset:wczblk1-8
      fs1-zhash.py                                               37.6µs ± 2%              37.5µs ± 1%     ~     (p=0.738 n=5+5)
      fs1-zhash.go                                               6.00µs ± 2%              5.90µs ± 0%   -1.67%  (p=0.048 n=5+5)
      fs1-zhash.go+prefetch128                                   8.00µs ± 5%              8.10µs ± 5%     ~     (p=0.659 n=5+5)
      zeo/py/fs1-zhash.py                                         650µs ± 7%               661µs ± 8%     ~     (p=0.421 n=5+5)
      zeo/py/fs1-zhash.go                                         274µs ±13%               267µs ± 8%     ~     (p=0.841 n=5+5)
      zeo/py/fs1-zhash.go+prefetch128                             101µs ± 2%               102µs ± 1%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                696µs ± 1%               692µs ± 4%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                338µs ± 7%               309µs ±15%     ~     (p=0.095 n=5+5)
      neo/py(!log)/sqlite-zhash.go+prefetch128                    177µs ± 1%               176µs ± 1%     ~     (p=0.056 n=5+5)
      neo/py(!log)/sql-zhash.py                                  1.00ms ±38%              0.99ms ±31%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zhash.go                                   434µs ± 6%               377µs ±16%  -13.15%  (p=0.032 n=5+5)
      neo/py(!log)/sql-zhash.go+prefetch128                       277µs ± 9%               268µs ±12%     ~     (p=0.690 n=5+5)
      neo/go/fs1-zhash.py                                         526µs ± 8%               482µs ±20%     ~     (p=0.222 n=5+5)
      neo/go/fs1-zhash.go                                         102µs ± 8%               102µs ± 9%     ~     (p=0.841 n=5+5)
      neo/go/fs1-zhash.go+prefetch128                            36.6µs ± 4%              37.2µs ± 2%     ~     (p=0.238 n=5+5)
      neo/go/fs1(!sha1)-zhash.go(!sha1)                          76.4µs ± 5%              73.1µs ±12%     ~     (p=0.151 n=5+5)
      neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1)              26.5µs ± 2%              26.9µs ± 7%     ~     (p=0.730 n=5+5)
      neo/go/sqlite-zhash.py                                      528µs ±15%               525µs ±10%     ~     (p=1.000 n=5+5)
      neo/go/sqlite-zhash.go                                      204µs ±22%               193µs ±16%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128                         39.9µs ± 4%              39.6µs ± 4%     ~     (p=0.817 n=5+5)
      neo/go/sqlite-zhash.go(!sha1)                               194µs ± 9%               195µs ±25%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128(!sha1)                  38.2µs ± 7%              36.7µs ± 3%     ~     (p=0.151 n=5+5)
      cluster:z6001 dataset:prod1-1024
      fs1-zhash.py                                               30.3µs ± 1%              30.3µs ± 2%     ~     (p=1.000 n=5+5)
      fs1-zhash.go                                               4.62µs ± 3%              4.56µs ± 1%     ~     (p=0.397 n=5+5)
      fs1-zhash.go+prefetch128                                   5.76µs ± 8%              5.96µs ± 9%     ~     (p=0.413 n=5+5)
      zeo/py/fs1-zhash.py                                         632µs ±15%               615µs ±13%     ~     (p=0.421 n=5+5)
      zeo/py/fs1-zhash.go                                         235µs ± 7%               235µs ± 6%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zhash.go+prefetch128                            87.2µs ± 1%              87.6µs ± 1%     ~     (p=0.270 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                664µs ± 2%               658µs ± 5%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                269µs ± 7%               256µs ± 8%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sqlite-zhash.go+prefetch128                    162µs ± 0%               161µs ± 0%   -0.74%  (p=0.016 n=4+5)
      neo/py(!log)/sql-zhash.py                                  1.03ms ±29%              1.02ms ±33%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sql-zhash.go                                   406µs ± 2%               385µs ± 8%     ~     (p=0.095 n=5+5)
      neo/py(!log)/sql-zhash.go+prefetch128                       268µs ± 5%               263µs ±11%     ~     (p=0.690 n=5+5)
      neo/go/fs1-zhash.py                                         520µs ± 9%               461µs ±16%     ~     (p=0.222 n=5+5)
      neo/go/fs1-zhash.go                                        83.2µs ± 7%              82.9µs ± 5%     ~     (p=1.000 n=5+5)
      neo/go/fs1-zhash.go+prefetch128                            24.0µs ± 5%              23.9µs ± 3%     ~     (p=0.968 n=5+5)
      neo/go/fs1(!sha1)-zhash.go(!sha1)                          67.0µs ± 3%              69.7µs ±11%     ~     (p=0.548 n=5+5)
      neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1)              21.2µs ± 4%              21.0µs ± 2%     ~     (p=0.619 n=5+5)
      neo/go/sqlite-zhash.py                                      539µs ±11%               541µs ± 9%     ~     (p=1.000 n=5+5)
      neo/go/sqlite-zhash.go                                      196µs ± 9%               181µs ±13%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128                         35.0µs ± 3%              35.5µs ± 2%     ~     (p=0.238 n=5+5)
      neo/go/sqlite-zhash.go(!sha1)                               168µs ± 8%               162µs ±14%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128(!sha1)                  35.1µs ± 4%              35.3µs ± 1%     ~     (p=0.500 n=5+5)
      
      name                                           old req/s                new req/s                delta
      cluster:z6001 dataset:wczblk1-8
      fs1-zwrk.go·1                                                230k ± 1%                228k ± 3%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·2                                                437k ± 5%                444k ± 1%     ~     (p=0.310 n=5+5)
      fs1-zwrk.go·3                                                663k ± 4%                660k ± 3%     ~     (p=0.548 n=5+5)
      fs1-zwrk.go·4                                                880k ± 1%                882k ± 1%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·8                                               1.75M ± 2%               1.75M ± 2%     ~     (p=0.841 n=5+5)
      fs1-zwrk.go·12                                              2.56M ± 0%               2.50M ± 3%   -2.26%  (p=0.016 n=4+5)
      fs1-zwrk.go·16                                              2.89M ± 1%               2.88M ± 1%     ~     (p=0.222 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        4.30k ± 8%               4.44k ± 6%     ~     (p=0.421 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        6.33k ± 0%               6.32k ± 0%     ~     (p=0.063 n=4+5)
      zeo/py/fs1-zwrk.go·3                                        6.90k ± 0%               6.89k ± 0%     ~     (p=0.365 n=4+5)
      zeo/py/fs1-zwrk.go·4                                        7.14k ± 1%               7.15k ± 1%     ~     (p=1.000 n=4+5)
      zeo/py/fs1-zwrk.go·8                                        7.53k ± 2%               7.46k ± 2%     ~     (p=0.690 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       7.65k ± 0%               7.55k ± 1%     ~     (p=0.063 n=4+5)
      zeo/py/fs1-zwrk.go·16                                       7.57k ± 0%               7.55k ± 1%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               3.50k ±15%               3.74k ±12%     ~     (p=0.222 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               5.58k ± 0%               5.59k ± 1%     ~     (p=1.000 n=4+5)
      neo/py(!log)/sqlite-zwrk.go·3                               5.63k ± 2%               5.58k ± 1%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               5.56k ± 1%               5.54k ± 1%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               5.61k ± 2%               5.65k ± 0%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                              5.62k ± 1%               5.59k ± 0%     ~     (p=0.222 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                              5.62k ± 1%               5.58k ± 1%     ~     (p=0.413 n=4+5)
      neo/py(!log)/sql-zwrk.go·1                                  2.53k ±17%               2.61k ± 5%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  3.57k ± 9%               3.88k ±11%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  3.65k ±14%               3.80k ±12%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  3.56k ±16%               3.85k ± 5%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                  3.78k ±12%               3.64k ±12%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                 3.73k ±13%               3.62k ± 6%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                 3.47k ± 9%               3.92k ±13%     ~     (p=0.056 n=5+5)
      neo/go/fs1-zwrk.go·1                                        10.7k ± 5%               10.6k ± 5%     ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·2                                        22.3k ± 1%               22.4k ± 1%     ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·3                                        31.7k ± 1%               31.9k ± 1%     ~     (p=0.151 n=5+5)
      neo/go/fs1-zwrk.go·4                                        43.2k ± 1%               43.2k ± 0%     ~     (p=1.000 n=5+5)
      neo/go/fs1-zwrk.go·8                                        78.3k ± 0%               78.2k ± 0%     ~     (p=0.151 n=5+5)
      neo/go/fs1-zwrk.go·12                                       92.5k ± 0%               92.3k ± 0%     ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·16                                        103k ± 1%                102k ± 1%     ~     (p=0.421 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                          15.0k ± 5%               15.0k ± 4%     ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                          31.5k ± 1%               31.4k ± 1%     ~     (p=0.421 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                          43.8k ± 0%               43.9k ± 0%     ~     (p=0.548 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                          57.4k ± 0%               57.6k ± 0%     ~     (p=0.087 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                           100k ± 0%                100k ± 0%     ~     (p=0.690 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                          116k ± 0%                116k ± 0%     ~     (p=0.310 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                          126k ± 1%                126k ± 0%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     4.85k ±15%               5.06k ± 8%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     12.0k ± 2%               11.9k ± 2%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     19.0k ± 1%               19.0k ± 1%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     24.7k ± 0%               24.6k ± 1%     ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     44.8k ± 0%               44.8k ± 0%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    56.3k ± 0%               56.3k ± 0%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    58.0k ± 0%               58.2k ± 0%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              5.41k ± 4%               5.71k ± 8%     ~     (p=0.095 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              12.8k ± 1%               13.2k ± 3%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              20.2k ± 1%               20.4k ± 1%   +1.19%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              26.8k ± 1%               27.1k ± 1%   +1.11%  (p=0.016 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              48.1k ± 1%               48.3k ± 0%     ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             60.3k ± 0%               60.2k ± 0%     ~     (p=0.095 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             61.7k ± 1%               61.7k ± 0%     ~     (p=0.548 n=5+5)
      cluster:z6001 dataset:prod1-1024
      fs1-zwrk.go·1                                                347k ± 2%                347k ± 2%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·2                                                660k ± 3%                662k ± 1%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·3                                                985k ± 4%                982k ± 1%     ~     (p=0.310 n=5+5)
      fs1-zwrk.go·4                                               1.31M ± 2%               1.30M ± 2%     ~     (p=0.151 n=5+5)
      fs1-zwrk.go·8                                               2.55M ± 4%               2.56M ± 2%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·12                                              2.81M ± 1%               2.83M ± 1%     ~     (p=0.690 n=5+5)
      fs1-zwrk.go·16                                              2.85M ± 2%               2.82M ± 1%     ~     (p=0.310 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        4.80k ± 5%               4.90k ± 6%     ~     (p=0.421 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        8.18k ± 1%               8.11k ± 0%     ~     (p=0.310 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        8.96k ± 1%               9.07k ± 2%     ~     (p=0.222 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        8.88k ± 9%               9.36k ± 0%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        10.0k ± 2%               10.0k ± 2%     ~     (p=0.286 n=4+5)
      zeo/py/fs1-zwrk.go·12                                       9.80k ± 6%              10.22k ± 2%     ~     (p=0.063 n=5+4)
      zeo/py/fs1-zwrk.go·16                                       10.1k ± 6%               10.3k ± 2%     ~     (p=0.095 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               3.70k ± 6%               3.80k ±13%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               5.77k ± 0%               5.80k ± 0%   +0.52%  (p=0.016 n=4+5)
      neo/py(!log)/sqlite-zwrk.go·3                               5.77k ± 0%               5.57k ± 8%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               5.77k ± 0%               5.80k ± 0%   +0.67%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               5.84k ± 1%               5.78k ± 2%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                              5.78k ± 2%               5.77k ± 0%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                              5.80k ± 1%               5.80k ± 0%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  2.51k ±12%               2.74k ±24%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  3.62k ± 8%               3.69k ± 8%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  3.86k ±11%               3.68k ± 8%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  3.82k ±11%               3.80k ±10%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                  3.89k ±10%               3.94k ±12%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                 3.98k ± 7%               4.04k ±12%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                 3.72k ±13%               3.82k ±10%     ~     (p=0.690 n=5+5)
      neo/go/fs1-zwrk.go·1                                        13.8k ± 3%               13.7k ± 4%     ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·2                                        28.1k ± 0%               28.0k ± 0%     ~     (p=0.690 n=5+5)
      neo/go/fs1-zwrk.go·3                                        40.2k ± 0%               40.2k ± 0%     ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·4                                        52.8k ± 1%               52.8k ± 0%     ~     (p=1.000 n=5+5)
      neo/go/fs1-zwrk.go·8                                        90.6k ± 0%               90.5k ± 0%     ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·12                                       95.8k ± 1%               95.9k ± 1%     ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·16                                       90.9k ± 1%               89.9k ± 1%     ~     (p=0.151 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                          16.2k ± 2%               16.2k ± 3%     ~     (p=0.548 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                          32.9k ± 1%               33.0k ± 0%     ~     (p=0.151 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                          46.2k ± 0%               46.1k ± 1%     ~     (p=0.151 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                          59.8k ± 1%               60.2k ± 0%     ~     (p=0.095 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          98.1k ± 0%               99.2k ± 1%   +1.06%  (p=0.016 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                          102k ± 1%                103k ± 0%   +1.27%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         97.0k ± 2%               97.3k ± 2%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     5.67k ± 8%               5.79k ± 8%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     13.3k ± 2%               13.3k ± 1%     ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     20.3k ± 1%               20.3k ± 1%     ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     26.5k ± 0%               26.4k ± 1%     ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     44.5k ± 1%               44.7k ± 0%     ~     (p=0.111 n=5+4)
      neo/go/sqlite-zwrk.go·12                                    52.3k ± 1%               52.6k ± 0%     ~     (p=0.095 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    48.9k ± 1%               48.6k ± 1%     ~     (p=0.310 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              5.69k ± 4%               5.81k ±12%     ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              13.2k ± 3%               13.1k ± 3%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              20.5k ± 1%               20.5k ± 1%     ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              27.1k ± 2%               27.2k ± 2%     ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              45.4k ± 1%               45.3k ± 0%     ~     (p=0.222 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             53.3k ± 1%               53.3k ± 1%     ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             49.8k ± 1%               49.9k ± 1%     ~     (p=0.690 n=5+5)
      
      name                                           old latency-time/object  new latency-time/object  delta
      cluster:z6001 dataset:wczblk1-8
      fs1-zwrk.go·1                                              4.34µs ± 1%              4.39µs ± 4%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·2                                              4.58µs ± 5%              4.50µs ± 1%     ~     (p=0.310 n=5+5)
      fs1-zwrk.go·3                                              4.52µs ± 4%              4.55µs ± 3%     ~     (p=0.444 n=5+5)
      fs1-zwrk.go·4                                              4.55µs ± 1%              4.54µs ± 1%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·8                                              4.58µs ± 2%              4.57µs ± 2%     ~     (p=0.841 n=5+5)
      fs1-zwrk.go·12                                             4.69µs ± 0%              4.80µs ± 3%   +2.35%  (p=0.016 n=4+5)
      fs1-zwrk.go·16                                             5.53µs ± 1%              5.56µs ± 1%     ~     (p=0.214 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        233µs ± 8%               225µs ± 6%     ~     (p=0.421 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        315µs ± 2%               317µs ± 0%   +0.55%  (p=0.032 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        435µs ± 0%               435µs ± 0%     ~     (p=0.413 n=4+5)
      zeo/py/fs1-zwrk.go·4                                        560µs ± 1%               559µs ± 1%     ~     (p=1.000 n=4+5)
      zeo/py/fs1-zwrk.go·8                                       1.06ms ± 2%              1.07ms ± 2%     ~     (p=0.690 n=5+5)
      zeo/py/fs1-zwrk.go·12                                      1.57ms ± 0%              1.59ms ± 1%     ~     (p=0.063 n=4+5)
      zeo/py/fs1-zwrk.go·16                                      2.11ms ± 0%              2.12ms ± 1%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               288µs ±14%               269µs ±12%     ~     (p=0.222 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               358µs ± 0%               358µs ± 1%     ~     (p=1.000 n=4+5)
      neo/py(!log)/sqlite-zwrk.go·3                               533µs ± 2%               537µs ± 1%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               720µs ± 1%               721µs ± 1%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                              1.43ms ± 2%              1.42ms ± 0%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                             2.14ms ± 1%              2.15ms ± 0%     ~     (p=0.222 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                             2.85ms ± 1%              2.87ms ± 1%     ~     (p=0.413 n=4+5)
      neo/py(!log)/sql-zwrk.go·1                                  400µs ±16%               384µs ± 5%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  562µs ± 8%               518µs ±11%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  827µs ±13%               795µs ±13%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                 1.13ms ±14%              1.04ms ± 5%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                 2.13ms ±13%              2.21ms ±11%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                3.24ms ±12%              3.31ms ± 6%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                4.62ms ± 8%              4.10ms ±15%     ~     (p=0.056 n=5+5)
      neo/go/fs1-zwrk.go·1                                       93.9µs ± 4%              94.0µs ± 5%     ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·2                                       89.6µs ± 1%              89.1µs ± 1%     ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·3                                       94.6µs ± 1%              94.0µs ± 1%     ~     (p=0.151 n=5+5)
      neo/go/fs1-zwrk.go·4                                       92.6µs ± 1%              92.7µs ± 0%     ~     (p=1.000 n=5+5)
      neo/go/fs1-zwrk.go·8                                        102µs ± 0%               102µs ± 0%     ~     (p=0.151 n=5+5)
      neo/go/fs1-zwrk.go·12                                       130µs ± 0%               130µs ± 0%     ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·16                                       156µs ± 1%               156µs ± 1%     ~     (p=0.421 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                         66.8µs ± 5%              66.5µs ± 4%     ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                         63.5µs ± 1%              63.6µs ± 1%     ~     (p=0.421 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                         68.5µs ± 0%              68.4µs ± 0%     ~     (p=0.548 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                         69.7µs ± 0%              69.4µs ± 0%     ~     (p=0.087 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                         79.7µs ± 0%              79.8µs ± 0%     ~     (p=0.690 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         103µs ± 0%               103µs ± 0%     ~     (p=0.310 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         127µs ± 1%               127µs ± 0%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     208µs ±14%               198µs ± 8%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     166µs ± 2%               169µs ± 2%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     158µs ± 1%               158µs ± 1%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     162µs ± 0%               162µs ± 1%     ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     178µs ± 0%               179µs ± 0%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    213µs ± 0%               213µs ± 0%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    276µs ± 0%               275µs ± 0%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              185µs ± 4%               175µs ± 8%     ~     (p=0.095 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              156µs ± 1%               152µs ± 3%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              149µs ± 1%               147µs ± 1%   -1.17%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              149µs ± 1%               147µs ± 1%   -1.10%  (p=0.016 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              166µs ± 1%               166µs ± 0%     ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             199µs ± 0%               199µs ± 0%     ~     (p=0.095 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             259µs ± 1%               259µs ± 0%     ~     (p=0.548 n=5+5)
      cluster:z6001 dataset:prod1-1024
      fs1-zwrk.go·1                                              2.88µs ± 2%              2.88µs ± 2%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·2                                              3.03µs ± 3%              3.02µs ± 1%     ~     (p=0.952 n=5+5)
      fs1-zwrk.go·3                                              3.05µs ± 4%              3.05µs ± 1%     ~     (p=0.310 n=5+5)
      fs1-zwrk.go·4                                              3.05µs ± 2%              3.08µs ± 2%     ~     (p=0.167 n=5+5)
      fs1-zwrk.go·8                                              3.14µs ± 4%              3.12µs ± 2%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·12                                             4.28µs ± 1%              4.25µs ± 1%     ~     (p=0.690 n=5+5)
      fs1-zwrk.go·16                                             5.63µs ± 2%              5.68µs ± 1%     ~     (p=0.310 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        208µs ± 5%               204µs ± 6%     ~     (p=0.421 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        245µs ± 1%               247µs ± 0%     ~     (p=0.310 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        335µs ± 1%               331µs ± 2%     ~     (p=0.222 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        453µs ±10%               427µs ± 0%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        803µs ± 2%               801µs ± 2%     ~     (p=0.286 n=4+5)
      zeo/py/fs1-zwrk.go·12                                      1.23ms ± 6%              1.17ms ± 2%     ~     (p=0.063 n=5+4)
      zeo/py/fs1-zwrk.go·16                                      1.59ms ± 6%              1.55ms ± 2%     ~     (p=0.095 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               271µs ± 7%               265µs ±12%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               346µs ± 0%               345µs ± 0%   -0.51%  (p=0.016 n=4+5)
      neo/py(!log)/sqlite-zwrk.go·3                               520µs ± 0%               540µs ± 8%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               694µs ± 0%               689µs ± 0%   -0.67%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                              1.37ms ± 1%              1.38ms ± 2%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                             2.07ms ± 2%              2.08ms ± 0%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                             2.76ms ± 1%              2.76ms ± 0%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  400µs ±11%               372µs ±21%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  554µs ± 7%               543µs ± 8%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  783µs ±11%               818µs ± 8%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                 1.06ms ±11%              1.06ms ±10%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                 2.07ms ± 9%              2.05ms ±13%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                3.02ms ± 7%              2.98ms ±13%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                4.32ms ±12%              4.20ms ±10%     ~     (p=0.690 n=5+5)
      neo/go/fs1-zwrk.go·1                                       72.6µs ± 3%              73.3µs ± 4%     ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·2                                       71.2µs ± 0%              71.3µs ± 0%     ~     (p=0.690 n=5+5)
      neo/go/fs1-zwrk.go·3                                       74.6µs ± 0%              74.5µs ± 0%     ~     (p=0.881 n=5+5)
      neo/go/fs1-zwrk.go·4                                       75.7µs ± 1%              75.8µs ± 0%     ~     (p=1.000 n=5+5)
      neo/go/fs1-zwrk.go·8                                       88.3µs ± 0%              88.4µs ± 0%     ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·12                                       125µs ± 1%               125µs ± 1%     ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·16                                       176µs ± 1%               178µs ± 1%     ~     (p=0.151 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                         61.7µs ± 2%              61.6µs ± 3%     ~     (p=0.548 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                         60.7µs ± 1%              60.5µs ± 0%     ~     (p=0.151 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                         64.9µs ± 0%              65.1µs ± 1%     ~     (p=0.151 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                         66.9µs ± 1%              66.5µs ± 0%     ~     (p=0.095 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                         81.5µs ± 0%              80.7µs ± 1%   -1.05%  (p=0.016 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         118µs ± 1%               116µs ± 0%   -1.26%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         165µs ± 2%               164µs ± 2%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     177µs ± 8%               173µs ± 8%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     151µs ± 2%               151µs ± 1%     ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     148µs ± 1%               148µs ± 1%     ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     151µs ± 0%               151µs ± 1%     ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     180µs ± 1%               179µs ± 0%     ~     (p=0.111 n=5+4)
      neo/go/sqlite-zwrk.go·12                                    229µs ± 1%               228µs ± 0%     ~     (p=0.095 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    327µs ± 1%               329µs ± 1%     ~     (p=0.310 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              176µs ± 4%               173µs ±13%     ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              152µs ± 3%               153µs ± 3%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              147µs ± 1%               146µs ± 1%     ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              148µs ± 2%               147µs ± 2%     ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              176µs ± 1%               177µs ± 0%     ~     (p=0.222 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             225µs ± 1%               225µs ± 1%     ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             321µs ± 1%               321µs ± 1%     ~     (p=0.690 n=5+5)
      7f785235
    • Kirill Smelkov's avatar
      X neo1: localhost timings, C > C1 disabled, zwrk@1s · 23f8d82e
      Kirill Smelkov authored
      Comparing to Cenalbled run, even when there each zwrk was run for 10s,
      similarly to previous measure with Cstates disabled (f40c8b4b) it shows
      clear improvement:
      
      ---- 8< ----
      cluster:neo1 dataset:wczblk1-8
      zeo/py/fs1-zwrk.go·1                                        195µs ± 1%               172µs ± 1%  -11.98%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               230µs ± 1%               191µs ± 2%  -16.86%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  305µs ± 7%               244µs ± 6%  -19.90%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  491µs ± 2%               412µs ± 3%  -15.94%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  740µs ± 2%               625µs ± 4%  -15.61%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  976µs ± 2%               837µs ± 1%  -14.28%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                 1.98ms ± 2%              1.69ms ± 7%  -14.60%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                2.98ms ± 2%              2.57ms ± 6%  -13.56%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                4.03ms ± 3%              3.42ms ± 9%  -14.95%  (p=0.008 n=5+5)
      
      cluster:neo1 dataset:prod1-1024
      zeo/py/fs1-zwrk.go·1                                        170µs ± 1%               146µs ± 1%  -13.66%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               209µs ± 3%               180µs ± 3%  -14.26%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  294µs ± 4%               230µs ± 2%  -21.61%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  483µs ± 2%               405µs ± 4%  -16.22%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  728µs ± 1%               640µs ± 5%  -11.98%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  978µs ± 3%               837µs ± 4%  -14.42%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                 1.92ms ± 2%              1.63ms ± 1%  -15.10%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                2.94ms ± 2%              2.52ms ± 3%  -14.18%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                3.87ms ± 3%              3.27ms ± 3%  -15.56%  (p=0.008 n=5+5)
      ---- 8< ----
      
      not to mention that zhash.{py,go}, for which runtime was not changed,
      are also improved like it was in f40c8b4b, thus confirming timings from
      there:
      
      ---- 8< ----
      cluster:neo1 dataset:wczblk1-8
      zeo/py/fs1-zhash.py                                         516µs ± 8%               459µs ± 0%  -11.00%  (p=0.016 n=5+4)
      zeo/py/fs1-zhash.go                                         200µs ± 4%               174µs ± 2%  -12.99%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                692µs ± 5%               390µs ± 1%  -43.67%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                230µs ± 4%               196µs ± 2%  -14.72%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zhash.py                                   938µs ±50%               459µs ± 1%  -51.03%  (p=0.016 n=5+4)
      neo/py(!log)/sql-zhash.go                                   310µs ±10%               249µs ± 3%  -19.61%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zhash.go+prefetch128                       244µs ± 8%               217µs ± 1%  -10.95%  (p=0.008 n=5+5)
      neo/go/fs1-zhash.py                                         368µs ±27%               274µs ± 1%  -25.36%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.py                                      406µs ± 8%               322µs ± 1%  -20.74%  (p=0.008 n=5+5)
      
      cluster:neo1 dataset:prod1-1024
      zeo/py/fs1-zhash.py                                         499µs ± 2%               436µs ± 2%  -12.61%  (p=0.008 n=5+5)
      zeo/py/fs1-zhash.go                                         171µs ± 4%               150µs ± 2%  -12.19%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                678µs ± 3%               387µs ± 5%  -42.91%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                211µs ± 6%               185µs ± 4%  -12.53%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zhash.py                                   922µs ±53%               477µs ±40%  -48.31%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zhash.go                                   289µs ± 5%               236µs ± 2%  -18.35%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zhash.go+prefetch128                       228µs ± 4%               202µs ± 2%  -11.68%  (p=0.008 n=5+5)
      neo/go/fs1-zhash.py                                         359µs ±15%               267µs ±11%  -25.72%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.py                                      396µs ± 4%               312µs ± 1%  -21.16%  (p=0.008 n=5+5)
      ---- 8< ----
      
      ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
      
      $ benchstat -split node,cluster,dataset  20180308-neo1-ffixed-c-zwrk10s.txt 20180308-neo1-ffixed-noc_C1\(3µs\)-zwrk1s.txt
      
      name                                           old pystone/s            new pystone/s            delta
      node:neo1
      pystone                                                      106k ± 1%                105k ± 0%   -1.36%  (p=0.008 n=5+5)
      
      name                                           old time/op              new time/op              delta
      node:neo1
      crc32/py/4K                                                5.16µs ± 1%              5.15µs ± 1%     ~     (p=0.690 n=5+5)
      crc32/go/4K                                                2.79µs ± 0%              2.79µs ± 0%   -0.12%  (p=0.029 n=4+4)
      sha1/py/4K                                                 13.5µs ± 1%              13.5µs ± 3%     ~     (p=0.421 n=5+5)
      sha1/go/4K                                                 9.82µs ± 0%              9.81µs ± 0%     ~     (p=0.516 n=5+5)
      unzlib/py/wczdata                                          36.1µs ± 1%              35.5µs ± 7%     ~     (p=0.690 n=5+5)
      unzlib/go/wczdata                                          31.3µs ± 0%              30.9µs ± 1%   -1.22%  (p=0.008 n=5+5)
      unzlib/py/prod1-avg                                        16.4µs ± 1%              16.0µs ± 2%     ~     (p=0.095 n=5+5)
      unzlib/go/prod1-avg                                        9.41µs ± 1%              9.26µs ± 1%   -1.58%  (p=0.008 n=5+5)
      disk/randread/direct/4K-min                                 162µs ± 0%               158µs ± 2%   -1.99%  (p=0.008 n=5+5)
      disk/randread/direct/4K-avg                                 187µs ± 0%               172µs ± 0%   -7.92%  (p=0.008 n=5+5)
      disk/randread/pagecache/4K-min                              386ns ± 1%               392ns ± 2%     ~     (p=0.190 n=4+5)
      disk/randread/pagecache/4K-avg                              804ns ± 0%               904ns ± 1%  +12.46%  (p=0.016 n=4+5)
      
      name                                           old time/object          new time/object          delta
      cluster:neo1 dataset:wczblk1-8
      fs1-zhash.py                                               34.9µs ± 1%              34.7µs ± 2%     ~     (p=0.476 n=5+5)
      fs1-zhash.go                                               6.00µs ± 0%              5.90µs ± 0%   -1.67%  (p=0.029 n=4+4)
      fs1-zhash.go+prefetch128                                   6.58µs ± 2%              6.32µs ± 3%   -3.95%  (p=0.032 n=5+5)
      zeo/py/fs1-zhash.py                                         516µs ± 8%               459µs ± 0%  -11.00%  (p=0.016 n=5+4)
      zeo/py/fs1-zhash.go                                         200µs ± 4%               174µs ± 2%  -12.99%  (p=0.008 n=5+5)
      zeo/py/fs1-zhash.go+prefetch128                            98.5µs ± 2%              98.5µs ± 2%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                692µs ± 5%               390µs ± 1%  -43.67%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                230µs ± 4%               196µs ± 2%  -14.72%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zhash.go+prefetch128                    165µs ± 3%               164µs ± 2%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sql-zhash.py                                   938µs ±50%               459µs ± 1%  -51.03%  (p=0.016 n=5+4)
      neo/py(!log)/sql-zhash.go                                   310µs ±10%               249µs ± 3%  -19.61%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zhash.go+prefetch128                       244µs ± 8%               217µs ± 1%  -10.95%  (p=0.008 n=5+5)
      neo/go/fs1-zhash.py                                         368µs ±27%               274µs ± 1%  -25.36%  (p=0.008 n=5+5)
      neo/go/fs1-zhash.go                                        80.2µs ± 2%              80.4µs ± 4%     ~     (p=1.000 n=5+5)
      neo/go/fs1-zhash.go+prefetch128                            34.8µs ± 5%              35.3µs ± 6%     ~     (p=0.690 n=5+5)
      neo/go/fs1(!sha1)-zhash.go(!sha1)                          56.7µs ± 3%              56.5µs ± 2%     ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1)              22.7µs ± 3%              23.2µs ± 7%     ~     (p=0.413 n=5+5)
      neo/go/sqlite-zhash.py                                      406µs ± 8%               322µs ± 1%  -20.74%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.go                                      125µs ± 2%               134µs ±12%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128                         47.9µs ± 5%              49.4µs ± 9%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zhash.go(!sha1)                               115µs ± 1%               114µs ± 2%     ~     (p=0.421 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128(!sha1)                  47.2µs ±13%              46.3µs ± 5%     ~     (p=0.841 n=5+5)
      cluster:neo1 dataset:prod1-1024
      fs1-zhash.py                                               29.1µs ± 2%              29.3µs ± 0%     ~     (p=0.413 n=5+5)
      fs1-zhash.go                                               3.74µs ± 2%              3.80µs ± 0%     ~     (p=0.238 n=5+4)
      fs1-zhash.go+prefetch128                                   3.88µs ± 3%              3.78µs ± 3%     ~     (p=0.190 n=5+5)
      zeo/py/fs1-zhash.py                                         499µs ± 2%               436µs ± 2%  -12.61%  (p=0.008 n=5+5)
      zeo/py/fs1-zhash.go                                         171µs ± 4%               150µs ± 2%  -12.19%  (p=0.008 n=5+5)
      zeo/py/fs1-zhash.go+prefetch128                            87.9µs ± 1%              88.0µs ± 1%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                678µs ± 3%               387µs ± 5%  -42.91%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                211µs ± 6%               185µs ± 4%  -12.53%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zhash.go+prefetch128                    150µs ± 1%               150µs ± 2%     ~     (p=0.881 n=5+5)
      neo/py(!log)/sql-zhash.py                                   922µs ±53%               477µs ±40%  -48.31%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zhash.go                                   289µs ± 5%               236µs ± 2%  -18.35%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zhash.go+prefetch128                       228µs ± 4%               202µs ± 2%  -11.68%  (p=0.008 n=5+5)
      neo/go/fs1-zhash.py                                         359µs ±15%               267µs ±11%  -25.72%  (p=0.008 n=5+5)
      neo/go/fs1-zhash.go                                        62.1µs ± 0%              60.8µs ± 2%   -2.12%  (p=0.024 n=5+5)
      neo/go/fs1-zhash.go+prefetch128                            22.5µs ± 1%              22.2µs ± 1%     ~     (p=0.087 n=5+5)
      neo/go/fs1(!sha1)-zhash.go(!sha1)                          51.4µs ± 4%              52.7µs ± 3%     ~     (p=0.056 n=5+5)
      neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1)              18.6µs ± 3%              18.4µs ± 5%     ~     (p=0.683 n=5+5)
      neo/go/sqlite-zhash.py                                      396µs ± 4%               312µs ± 1%  -21.16%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.go                                      114µs ± 1%               112µs ± 1%   -1.48%  (p=0.016 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128                         41.5µs ± 6%              41.2µs ± 7%     ~     (p=0.802 n=5+5)
      neo/go/sqlite-zhash.go(!sha1)                               109µs ± 1%               107µs ± 2%   -1.58%  (p=0.016 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128(!sha1)                  41.4µs ± 3%              41.5µs ± 4%     ~     (p=0.984 n=5+5)
      
      name                                           old req/s                new req/s                delta
      cluster:neo1 dataset:wczblk1-8
      fs1-zwrk.go·1                                                229k ± 1%                230k ± 0%     ~     (p=0.548 n=5+5)
      fs1-zwrk.go·2                                                446k ± 1%                425k ± 7%   -4.73%  (p=0.008 n=5+5)
      fs1-zwrk.go·3                                                665k ± 1%                660k ± 1%     ~     (p=0.056 n=5+5)
      fs1-zwrk.go·4                                                868k ± 1%                869k ± 1%     ~     (p=0.730 n=5+4)
      fs1-zwrk.go·8                                                988k ± 1%                996k ± 0%   +0.76%  (p=0.016 n=5+5)
      fs1-zwrk.go·12                                              1.01M ± 1%               1.01M ± 0%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·16                                              1.01M ± 1%               1.02M ± 0%     ~     (p=0.222 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        5.13k ± 1%               5.83k ± 1%  +13.62%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        6.93k ± 1%               7.21k ± 1%   +4.08%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        7.54k ± 1%               7.80k ± 3%   +3.49%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        7.75k ± 1%               8.01k ± 1%   +3.29%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        8.09k ± 0%               8.46k ± 1%   +4.57%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       8.46k ± 0%               8.52k ± 2%     ~     (p=0.151 n=5+5)
      zeo/py/fs1-zwrk.go·16                                       8.52k ± 0%               8.51k ± 2%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               4.35k ± 1%               5.23k ± 2%  +20.31%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               6.33k ± 2%               6.30k ± 2%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               6.22k ± 4%               6.33k ± 1%     ~     (p=0.056 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               6.25k ± 1%               6.30k ± 3%     ~     (p=0.222 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               6.25k ± 2%               6.27k ± 3%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                              6.26k ± 2%               6.36k ± 2%     ~     (p=0.056 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                              6.24k ± 1%               6.33k ± 2%     ~     (p=0.095 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  3.29k ± 7%               4.10k ± 5%  +24.73%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  4.08k ± 2%               4.85k ± 2%  +18.97%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  4.05k ± 2%               4.80k ± 4%  +18.54%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  4.10k ± 2%               4.78k ± 1%  +16.65%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                  4.04k ± 2%               4.73k ± 7%  +17.24%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                 4.03k ± 2%               4.67k ± 6%  +15.80%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                 3.97k ± 3%               4.68k ± 9%  +17.82%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·1                                        12.9k ± 0%               13.0k ± 1%   +1.38%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·2                                        24.8k ± 1%               25.0k ± 1%   +1.00%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·3                                        32.3k ± 1%               32.4k ± 0%   +0.51%  (p=0.016 n=5+5)
      neo/go/fs1-zwrk.go·4                                        40.7k ± 1%               40.9k ± 0%     ~     (p=0.087 n=5+5)
      neo/go/fs1-zwrk.go·8                                        54.5k ± 1%               54.8k ± 1%     ~     (p=0.310 n=5+5)
      neo/go/fs1-zwrk.go·12                                       57.2k ± 1%               57.4k ± 1%     ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·16                                       58.3k ± 1%               55.8k ± 1%   -4.22%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                          19.1k ± 1%               19.3k ± 1%     ~     (p=0.310 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                          37.7k ± 1%               38.0k ± 1%     ~     (p=0.056 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                          47.7k ± 1%               48.2k ± 0%   +1.00%  (p=0.016 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                          58.6k ± 1%               59.3k ± 0%   +1.29%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          77.6k ± 1%               78.4k ± 0%   +1.04%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         83.1k ± 1%               82.7k ± 1%     ~     (p=0.222 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         84.9k ± 2%               81.3k ± 2%   -4.30%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     8.06k ± 0%               8.23k ± 1%   +2.09%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     14.7k ± 1%               15.0k ± 0%   +1.78%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     20.3k ± 1%               20.7k ± 0%   +1.91%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     24.1k ± 1%               24.9k ± 0%   +3.24%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     30.4k ± 1%               30.9k ± 8%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    30.8k ± 3%               31.3k ± 1%     ~     (p=0.095 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    30.1k ± 2%               30.6k ± 3%     ~     (p=0.095 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              8.84k ± 0%               9.08k ± 0%   +2.62%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              16.1k ± 1%               16.4k ± 0%   +2.16%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              22.1k ± 1%               22.7k ± 0%   +2.80%  (p=0.016 n=5+4)
      neo/go/sqlite-zwrk.go(!sha1)·4                              26.8k ± 1%               27.8k ± 0%   +3.66%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              33.1k ± 2%               34.6k ± 1%   +4.43%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             32.9k ± 2%               33.5k ± 1%   +1.90%  (p=0.032 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             32.1k ± 2%               32.8k ± 2%     ~     (p=0.095 n=5+5)
      cluster:neo1 dataset:prod1-1024
      fs1-zwrk.go·1                                                453k ± 0%                454k ± 0%     ~     (p=0.063 n=5+4)
      fs1-zwrk.go·2                                                891k ± 0%                869k ± 6%     ~     (p=0.690 n=5+5)
      fs1-zwrk.go·3                                               1.32M ± 3%               1.33M ± 1%     ~     (p=0.548 n=5+5)
      fs1-zwrk.go·4                                               1.77M ± 1%               1.73M ± 2%     ~     (p=0.222 n=5+5)
      fs1-zwrk.go·8                                               2.00M ± 2%               1.99M ± 2%     ~     (p=0.421 n=5+5)
      fs1-zwrk.go·12                                              2.04M ± 0%               2.03M ± 0%   -0.47%  (p=0.029 n=4+4)
      fs1-zwrk.go·16                                              2.03M ± 2%               2.04M ± 0%     ~     (p=0.421 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        5.90k ± 1%               6.83k ± 1%  +15.81%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        8.50k ± 0%               8.72k ± 3%     ~     (p=0.151 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        9.32k ± 1%               9.26k ± 6%     ~     (p=0.690 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        9.70k ± 1%               9.78k ± 3%     ~     (p=0.151 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        10.2k ± 2%               10.4k ± 1%   +2.11%  (p=0.032 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       10.4k ± 0%               10.6k ± 1%   +1.42%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·16                                       10.5k ± 1%               10.5k ± 5%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               4.78k ± 3%               5.57k ± 3%  +16.64%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               6.42k ± 2%               6.51k ± 1%   +1.40%  (p=0.032 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               6.40k ± 2%               6.39k ± 6%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               6.40k ± 1%               6.43k ± 1%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               6.39k ± 1%               6.33k ± 2%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                              6.44k ± 1%               6.30k ± 3%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                              6.38k ± 1%               6.37k ± 3%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  3.41k ± 4%               4.34k ± 2%  +27.52%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  4.14k ± 2%               4.94k ± 4%  +19.38%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  4.12k ± 1%               4.69k ± 5%  +13.72%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  4.09k ± 3%               4.78k ± 4%  +16.85%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                  4.18k ± 2%               4.92k ± 1%  +17.77%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                 4.09k ± 2%               4.76k ± 3%  +16.56%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                 4.14k ± 3%               4.90k ± 3%  +18.44%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·1                                        17.2k ± 1%               17.4k ± 1%   +1.23%  (p=0.032 n=5+5)
      neo/go/fs1-zwrk.go·2                                        32.5k ± 1%               32.9k ± 1%   +1.14%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·3                                        43.0k ± 1%               43.5k ± 0%   +0.98%  (p=0.016 n=5+4)
      neo/go/fs1-zwrk.go·4                                        52.7k ± 1%               53.2k ± 0%   +0.94%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·8                                        67.3k ± 1%               67.0k ± 2%     ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·12                                       64.9k ± 2%               62.6k ± 3%   -3.51%  (p=0.016 n=5+5)
      neo/go/fs1-zwrk.go·16                                       57.3k ± 4%               54.3k ±11%     ~     (p=0.056 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                          20.3k ± 2%               20.2k ± 5%     ~     (p=0.421 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                          40.4k ± 1%               40.8k ± 1%     ~     (p=0.056 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                          51.5k ± 1%               51.9k ± 1%   +0.79%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                          62.0k ± 1%               62.7k ± 0%   +1.15%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          77.1k ± 2%               75.1k ± 4%     ~     (p=0.151 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         75.3k ± 3%               69.5k ± 1%   -7.81%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         63.9k ± 2%               61.0k ± 2%   -4.52%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     8.99k ± 0%               9.16k ± 1%   +1.81%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     15.8k ± 1%               16.0k ± 0%   +1.04%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     21.5k ± 1%               22.1k ± 0%   +2.67%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     25.7k ± 1%               26.7k ± 0%   +4.05%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     28.7k ± 2%               30.9k ± 2%   +7.45%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    27.3k ± 3%               29.5k ± 1%   +8.03%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    27.1k ± 2%               29.6k ± 2%   +9.24%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              9.31k ± 0%               9.51k ± 1%   +2.23%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              16.3k ± 0%               16.5k ± 0%   +0.90%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              22.3k ± 1%               22.7k ± 0%   +1.41%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              26.8k ± 1%               27.4k ± 1%   +2.07%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              30.1k ± 0%               31.2k ± 2%   +3.80%  (p=0.016 n=4+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             28.4k ± 2%               29.5k ± 2%   +3.78%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             27.9k ± 3%               28.8k ±10%     ~     (p=0.151 n=5+5)
      
      name                                           old latency-time/object  new latency-time/object  delta
      cluster:neo1 dataset:wczblk1-8
      fs1-zwrk.go·1                                              4.37µs ± 1%              4.36µs ± 0%     ~     (p=0.548 n=5+5)
      fs1-zwrk.go·2                                              4.48µs ± 1%              4.71µs ± 8%   +5.18%  (p=0.008 n=5+5)
      fs1-zwrk.go·3                                              4.51µs ± 1%              4.55µs ± 1%     ~     (p=0.056 n=5+5)
      fs1-zwrk.go·4                                              4.61µs ± 1%              4.60µs ± 1%     ~     (p=0.603 n=5+4)
      fs1-zwrk.go·8                                              8.10µs ± 1%              8.03µs ± 0%   -0.75%  (p=0.016 n=5+5)
      fs1-zwrk.go·12                                             11.9µs ± 1%              11.8µs ± 0%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·16                                             15.8µs ± 1%              15.7µs ± 0%     ~     (p=0.206 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        195µs ± 1%               172µs ± 1%  -11.98%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        289µs ± 1%               277µs ± 1%   -3.92%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        398µs ± 1%               384µs ± 3%   -3.36%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        516µs ± 1%               500µs ± 1%   -3.18%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        989µs ± 0%               946µs ± 1%   -4.37%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·12                                      1.42ms ± 0%              1.41ms ± 2%     ~     (p=0.151 n=5+5)
      zeo/py/fs1-zwrk.go·16                                      1.88ms ± 0%              1.88ms ± 2%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               230µs ± 1%               191µs ± 2%  -16.86%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               316µs ± 2%               317µs ± 2%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               483µs ± 4%               474µs ± 1%     ~     (p=0.056 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               640µs ± 1%               635µs ± 3%     ~     (p=0.222 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                              1.28ms ± 2%              1.28ms ± 3%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                             1.92ms ± 2%              1.89ms ± 2%     ~     (p=0.056 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                             2.57ms ± 1%              2.53ms ± 2%     ~     (p=0.095 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  305µs ± 7%               244µs ± 6%  -19.90%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  491µs ± 2%               412µs ± 3%  -15.94%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  740µs ± 2%               625µs ± 4%  -15.61%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  976µs ± 2%               837µs ± 1%  -14.28%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                 1.98ms ± 2%              1.69ms ± 7%  -14.60%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                2.98ms ± 2%              2.57ms ± 6%  -13.56%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                4.03ms ± 3%              3.42ms ± 9%  -14.95%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·1                                       77.8µs ± 0%              76.7µs ± 1%   -1.36%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·2                                       80.7µs ± 1%              79.9µs ± 1%   -0.99%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·3                                       93.0µs ± 1%              92.5µs ± 0%   -0.51%  (p=0.016 n=5+5)
      neo/go/fs1-zwrk.go·4                                       98.4µs ± 1%              97.9µs ± 0%     ~     (p=0.087 n=5+5)
      neo/go/fs1-zwrk.go·8                                        147µs ± 1%               146µs ± 1%     ~     (p=0.310 n=5+5)
      neo/go/fs1-zwrk.go·12                                       210µs ± 1%               209µs ± 1%     ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·16                                       274µs ± 1%               287µs ± 1%   +4.40%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                         52.3µs ± 1%              51.9µs ± 2%     ~     (p=0.310 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                         53.1µs ± 1%              52.7µs ± 1%     ~     (p=0.056 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                         62.8µs ± 1%              62.2µs ± 0%   -0.99%  (p=0.016 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                         68.3µs ± 1%              67.4µs ± 0%   -1.27%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          103µs ± 1%               102µs ± 0%   -1.03%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         144µs ± 1%               145µs ± 1%     ~     (p=0.222 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         188µs ± 2%               197µs ± 2%   +4.49%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     124µs ± 0%               122µs ± 1%   -2.04%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     136µs ± 1%               134µs ± 0%   -1.75%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     148µs ± 1%               145µs ± 0%   -1.87%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     166µs ± 1%               161µs ± 0%   -3.14%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     263µs ± 1%               260µs ± 9%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    390µs ± 3%               383µs ± 1%     ~     (p=0.095 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    532µs ± 2%               524µs ± 3%     ~     (p=0.095 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              113µs ± 0%               110µs ± 0%   -2.56%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              125µs ± 1%               122µs ± 0%   -2.11%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              136µs ± 1%               132µs ± 0%   -2.73%  (p=0.016 n=5+4)
      neo/go/sqlite-zwrk.go(!sha1)·4                              149µs ± 1%               144µs ± 0%   -3.53%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              242µs ± 2%               231µs ± 1%   -4.25%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             365µs ± 2%               358µs ± 1%   -1.87%  (p=0.032 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             499µs ± 2%               487µs ± 2%     ~     (p=0.095 n=5+5)
      cluster:neo1 dataset:prod1-1024
      fs1-zwrk.go·1                                              2.21µs ± 0%              2.20µs ± 0%     ~     (p=0.063 n=5+4)
      fs1-zwrk.go·2                                              2.24µs ± 0%              2.31µs ± 6%     ~     (p=0.635 n=5+5)
      fs1-zwrk.go·3                                              2.27µs ± 3%              2.25µs ± 1%     ~     (p=0.476 n=5+5)
      fs1-zwrk.go·4                                              2.27µs ± 1%              2.31µs ± 2%     ~     (p=0.167 n=5+5)
      fs1-zwrk.go·8                                              4.00µs ± 2%              4.02µs ± 2%     ~     (p=0.421 n=5+5)
      fs1-zwrk.go·12                                             5.88µs ± 0%              5.91µs ± 0%   +0.47%  (p=0.029 n=4+4)
      fs1-zwrk.go·16                                             7.83µs ± 0%              7.86µs ± 0%     ~     (p=0.127 n=4+5)
      zeo/py/fs1-zwrk.go·1                                        170µs ± 1%               146µs ± 1%  -13.66%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        235µs ± 0%               229µs ± 3%     ~     (p=0.151 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        322µs ± 1%               324µs ± 6%     ~     (p=0.690 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        412µs ± 1%               409µs ± 3%     ~     (p=0.151 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        782µs ± 2%               766µs ± 1%   -2.08%  (p=0.032 n=5+5)
      zeo/py/fs1-zwrk.go·12                                      1.15ms ± 0%              1.13ms ± 1%   -1.39%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·16                                      1.52ms ± 1%              1.53ms ± 5%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               209µs ± 3%               180µs ± 3%  -14.26%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               312µs ± 2%               307µs ± 1%   -1.39%  (p=0.032 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               469µs ± 2%               470µs ± 6%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               625µs ± 1%               622µs ± 1%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                              1.25ms ± 1%              1.26ms ± 2%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                             1.86ms ± 1%              1.91ms ± 3%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                             2.51ms ± 1%              2.51ms ± 3%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  294µs ± 4%               230µs ± 2%  -21.61%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  483µs ± 2%               405µs ± 4%  -16.22%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  728µs ± 1%               640µs ± 5%  -11.98%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  978µs ± 3%               837µs ± 4%  -14.42%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                 1.92ms ± 2%              1.63ms ± 1%  -15.10%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                2.94ms ± 2%              2.52ms ± 3%  -14.18%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                3.87ms ± 3%              3.27ms ± 3%  -15.56%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·1                                       58.1µs ± 1%              57.4µs ± 1%   -1.21%  (p=0.032 n=5+5)
      neo/go/fs1-zwrk.go·2                                       61.5µs ± 1%              60.8µs ± 1%   -1.13%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·3                                       69.7µs ± 1%              69.0µs ± 0%   -0.97%  (p=0.016 n=5+4)
      neo/go/fs1-zwrk.go·4                                       75.8µs ± 1%              75.1µs ± 0%   -0.94%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·8                                        119µs ± 2%               119µs ± 2%     ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·12                                       185µs ± 2%               192µs ± 3%   +3.65%  (p=0.016 n=5+5)
      neo/go/fs1-zwrk.go·16                                       280µs ± 4%               296µs ±12%     ~     (p=0.056 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                         49.4µs ± 2%              49.5µs ± 5%     ~     (p=0.421 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                         49.5µs ± 1%              49.0µs ± 1%     ~     (p=0.056 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                         58.2µs ± 1%              57.8µs ± 1%   -0.78%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                         64.5µs ± 1%              63.7µs ± 0%   -1.14%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          104µs ± 2%               107µs ± 5%     ~     (p=0.151 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         159µs ± 3%               173µs ± 1%   +8.44%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         250µs ± 2%               262µs ± 2%   +4.74%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     111µs ± 0%               109µs ± 1%   -1.78%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     127µs ± 1%               125µs ± 0%   -1.03%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     140µs ± 1%               136µs ± 0%   -2.60%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     156µs ± 1%               150µs ± 0%   -3.89%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     279µs ± 2%               259µs ± 2%   -6.95%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    440µs ± 3%               407µs ± 1%   -7.45%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    591µs ± 2%               541µs ± 2%   -8.47%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              107µs ± 0%               105µs ± 1%   -2.18%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              122µs ± 0%               121µs ± 0%   -0.89%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              134µs ± 1%               132µs ± 0%   -1.39%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              149µs ± 1%               146µs ± 1%   -2.03%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              266µs ± 0%               256µs ± 2%   -3.65%  (p=0.016 n=4+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             423µs ± 2%               407µs ± 2%   -3.65%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             574µs ± 3%               557µs ±10%     ~     (p=0.151 n=5+5)
      23f8d82e
    • Kirill Smelkov's avatar
      X neo1: localhost timings, Cenabled, zwrk was running for 10s at each iteration · 5db60f7e
      Kirill Smelkov authored
      Compared to zwrk@1s (previous commit) the changes are in within, or
      close to be in within, noise and in particular it does not help for
      -zwrk.go timings like it did with Cstates disabled (f40c8b4b).
      
      ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
      
      $ benchstat -split node,cluster,dataset  20180308-neo1-ffixed-c-zwrk1s.txt 20180308-neo1-ffixed-c-zwrk10s.txt
      
      name                                           old pystone/s            new pystone/s            delta
      node:neo1
      pystone                                                      106k ± 1%                106k ± 1%     ~     (p=1.000 n=5+5)
      
      name                                           old time/op              new time/op              delta
      node:neo1
      crc32/py/4K                                                5.13µs ± 1%              5.16µs ± 1%     ~     (p=0.310 n=5+5)
      crc32/go/4K                                                2.79µs ± 0%              2.79µs ± 0%     ~     (p=0.238 n=5+4)
      sha1/py/4K                                                 13.5µs ± 1%              13.5µs ± 1%     ~     (p=0.905 n=4+5)
      sha1/go/4K                                                 9.82µs ± 0%              9.82µs ± 0%     ~     (p=0.444 n=5+5)
      unzlib/py/wczdata                                          35.9µs ± 1%              36.1µs ± 1%     ~     (p=0.548 n=5+5)
      unzlib/go/wczdata                                          31.2µs ± 0%              31.3µs ± 0%     ~     (p=0.548 n=5+5)
      unzlib/py/prod1-avg                                        16.1µs ± 3%              16.4µs ± 1%     ~     (p=0.095 n=5+5)
      unzlib/go/prod1-avg                                        9.38µs ± 1%              9.41µs ± 1%     ~     (p=0.548 n=5+5)
      disk/randread/direct/4K-min                                 162µs ± 0%               162µs ± 0%     ~     (p=0.460 n=4+5)
      disk/randread/direct/4K-avg                                 187µs ± 1%               187µs ± 0%     ~     (p=1.000 n=5+5)
      disk/randread/pagecache/4K-min                              392ns ± 1%               386ns ± 1%   -1.35%  (p=0.032 n=5+4)
      disk/randread/pagecache/4K-avg                              808ns ± 0%               804ns ± 0%   -0.56%  (p=0.016 n=5+4)
      
      name                                           old time/object          new time/object          delta
      cluster:neo1 dataset:wczblk1-8
      fs1-zhash.py                                               34.8µs ± 1%              34.9µs ± 1%     ~     (p=0.762 n=5+5)
      fs1-zhash.go                                               5.96µs ± 1%              6.00µs ± 0%     ~     (p=0.556 n=5+4)
      fs1-zhash.go+prefetch128                                   6.60µs ± 0%              6.58µs ± 2%     ~     (p=0.762 n=4+5)
      zeo/py/fs1-zhash.py                                         524µs ± 2%               516µs ± 8%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zhash.go                                         197µs ± 6%               200µs ± 4%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zhash.go+prefetch128                             100µs ± 2%                98µs ± 2%     ~     (p=0.135 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                625µs ±20%               692µs ± 5%  +10.75%  (p=0.032 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                231µs ± 5%               230µs ± 4%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zhash.go+prefetch128                    164µs ± 1%               165µs ± 3%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zhash.py                                   992µs ±44%               938µs ±50%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zhash.go                                   329µs ±14%               310µs ±10%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sql-zhash.go+prefetch128                       242µs ± 5%               244µs ± 8%     ~     (p=0.548 n=5+5)
      neo/go/fs1-zhash.py                                         373µs ±19%               368µs ±27%     ~     (p=0.802 n=5+5)
      neo/go/fs1-zhash.go                                        80.0µs ± 2%              80.2µs ± 2%     ~     (p=1.000 n=5+5)
      neo/go/fs1-zhash.go+prefetch128                            34.8µs ± 5%              34.8µs ± 5%     ~     (p=0.889 n=5+5)
      neo/go/fs1(!sha1)-zhash.go(!sha1)                          57.5µs ± 3%              56.7µs ± 3%     ~     (p=0.421 n=5+5)
      neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1)              23.8µs ± 7%              22.7µs ± 3%     ~     (p=0.063 n=5+5)
      neo/go/sqlite-zhash.py                                      415µs ± 3%               406µs ± 8%     ~     (p=0.222 n=5+5)
      neo/go/sqlite-zhash.go                                      126µs ± 1%               125µs ± 2%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128                         45.6µs ± 6%              47.9µs ± 5%     ~     (p=0.310 n=5+5)
      neo/go/sqlite-zhash.go(!sha1)                               117µs ± 3%               115µs ± 1%     ~     (p=0.135 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128(!sha1)                  45.8µs ± 4%              47.2µs ±13%     ~     (p=0.841 n=5+5)
      cluster:neo1 dataset:prod1-1024
      fs1-zhash.py                                               29.1µs ± 1%              29.1µs ± 2%     ~     (p=1.000 n=5+5)
      fs1-zhash.go                                               3.76µs ± 2%              3.74µs ± 2%     ~     (p=1.000 n=5+5)
      fs1-zhash.go+prefetch128                                   3.82µs ± 3%              3.88µs ± 3%     ~     (p=0.484 n=5+5)
      zeo/py/fs1-zhash.py                                         490µs ± 1%               499µs ± 2%     ~     (p=0.095 n=5+5)
      zeo/py/fs1-zhash.go                                         173µs ±12%               171µs ± 4%     ~     (p=0.548 n=5+5)
      zeo/py/fs1-zhash.go+prefetch128                            86.6µs ± 1%              87.9µs ± 1%   +1.50%  (p=0.032 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                639µs ±23%               678µs ± 3%     ~     (p=0.651 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                216µs ± 3%               211µs ± 6%     ~     (p=0.500 n=5+5)
      neo/py(!log)/sqlite-zhash.go+prefetch128                    150µs ± 2%               150µs ± 1%     ~     (p=0.984 n=5+5)
      neo/py(!log)/sql-zhash.py                                   912µs ±50%               922µs ±53%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sql-zhash.go                                   307µs ±10%               289µs ± 5%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sql-zhash.go+prefetch128                       227µs ± 3%               228µs ± 4%     ~     (p=0.841 n=5+5)
      neo/go/fs1-zhash.py                                         336µs ±11%               359µs ±15%     ~     (p=0.786 n=5+5)
      neo/go/fs1-zhash.go                                        61.5µs ± 3%              62.1µs ± 0%     ~     (p=0.389 n=5+5)
      neo/go/fs1-zhash.go+prefetch128                            22.6µs ± 3%              22.5µs ± 1%     ~     (p=0.556 n=5+5)
      neo/go/fs1(!sha1)-zhash.go(!sha1)                          52.5µs ± 4%              51.4µs ± 4%     ~     (p=0.175 n=5+5)
      neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1)              18.2µs ± 4%              18.6µs ± 3%     ~     (p=0.206 n=5+5)
      neo/go/sqlite-zhash.py                                      387µs ± 4%               396µs ± 4%     ~     (p=0.310 n=5+5)
      neo/go/sqlite-zhash.go                                      113µs ± 1%               114µs ± 1%     ~     (p=0.722 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128                         41.7µs ± 3%              41.5µs ± 6%     ~     (p=0.889 n=5+5)
      neo/go/sqlite-zhash.go(!sha1)                               110µs ± 2%               109µs ± 1%     ~     (p=0.222 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128(!sha1)                  40.9µs ± 5%              41.4µs ± 3%     ~     (p=0.595 n=5+5)
      
      name                                           old req/s                new req/s                delta
      cluster:neo1 dataset:wczblk1-8
      fs1-zwrk.go·1                                                230k ± 0%                229k ± 1%     ~     (p=0.151 n=5+5)
      fs1-zwrk.go·2                                                447k ± 1%                446k ± 1%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·3                                                666k ± 0%                665k ± 1%     ~     (p=0.690 n=5+5)
      fs1-zwrk.go·4                                                870k ± 0%                868k ± 1%     ~     (p=0.730 n=4+5)
      fs1-zwrk.go·8                                                991k ± 0%                988k ± 1%     ~     (p=0.690 n=5+5)
      fs1-zwrk.go·12                                              1.02M ± 0%               1.01M ± 1%     ~     (p=0.310 n=5+5)
      fs1-zwrk.go·16                                              1.02M ± 0%               1.01M ± 1%     ~     (p=0.548 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        5.06k ± 1%               5.13k ± 1%   +1.45%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        6.93k ± 2%               6.93k ± 1%     ~     (p=0.841 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        7.48k ± 1%               7.54k ± 1%   +0.84%  (p=0.032 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        7.69k ± 2%               7.75k ± 1%     ~     (p=0.151 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        8.02k ± 1%               8.09k ± 0%   +0.83%  (p=0.032 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       8.40k ± 2%               8.46k ± 0%     ~     (p=0.222 n=5+5)
      zeo/py/fs1-zwrk.go·16                                       8.46k ± 1%               8.52k ± 0%     ~     (p=0.095 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               4.22k ± 2%               4.35k ± 1%   +2.92%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               6.29k ± 3%               6.33k ± 2%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               6.29k ± 2%               6.22k ± 4%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               6.26k ± 3%               6.25k ± 1%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               6.18k ± 3%               6.25k ± 2%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                              6.04k ± 5%               6.26k ± 2%     ~     (p=0.222 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                              6.21k ± 5%               6.24k ± 1%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  3.27k ±13%               3.29k ± 7%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  3.98k ± 3%               4.08k ± 2%     ~     (p=0.095 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  3.97k ± 4%               4.05k ± 2%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  3.95k ± 5%               4.10k ± 2%     ~     (p=0.095 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                  4.07k ± 4%               4.04k ± 2%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                 4.11k ± 6%               4.03k ± 2%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                 4.03k ± 9%               3.97k ± 3%     ~     (p=1.000 n=5+5)
      neo/go/fs1-zwrk.go·1                                        12.9k ± 1%               12.9k ± 0%     ~     (p=0.548 n=5+5)
      neo/go/fs1-zwrk.go·2                                        24.9k ± 0%               24.8k ± 1%     ~     (p=0.548 n=5+5)
      neo/go/fs1-zwrk.go·3                                        32.3k ± 0%               32.3k ± 1%     ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·4                                        40.9k ± 0%               40.7k ± 1%   -0.55%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·8                                        54.7k ± 1%               54.5k ± 1%     ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·12                                       56.5k ± 1%               57.2k ± 1%   +1.18%  (p=0.016 n=5+5)
      neo/go/fs1-zwrk.go·16                                       54.5k ± 1%               58.3k ± 1%   +6.99%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                          19.0k ± 2%               19.1k ± 1%     ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                          37.5k ± 2%               37.7k ± 1%     ~     (p=0.548 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                          48.0k ± 0%               47.7k ± 1%     ~     (p=0.056 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                          59.0k ± 0%               58.6k ± 1%     ~     (p=0.095 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          78.1k ± 0%               77.6k ± 1%     ~     (p=0.056 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         80.7k ± 7%               83.1k ± 1%   +3.04%  (p=0.032 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         80.7k ± 1%               84.9k ± 2%   +5.23%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     8.12k ± 0%               8.06k ± 0%   -0.75%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     14.9k ± 0%               14.7k ± 1%   -1.31%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     20.9k ± 0%               20.3k ± 1%   -2.48%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     25.0k ± 0%               24.1k ± 1%   -3.69%  (p=0.016 n=4+5)
      neo/go/sqlite-zwrk.go·8                                     32.1k ± 1%               30.4k ± 1%   -5.40%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    32.3k ± 1%               30.8k ± 3%   -4.56%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    30.6k ±10%               30.1k ± 2%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              8.84k ± 1%               8.84k ± 0%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              16.2k ± 0%               16.1k ± 1%   -0.67%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              22.5k ± 0%               22.1k ± 1%   -1.73%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              27.5k ± 0%               26.8k ± 1%   -2.68%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              34.2k ± 1%               33.1k ± 2%   -3.21%  (p=0.016 n=4+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             33.4k ± 2%               32.9k ± 2%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             32.8k ± 2%               32.1k ± 2%     ~     (p=0.056 n=5+5)
      cluster:neo1 dataset:prod1-1024
      fs1-zwrk.go·1                                                454k ± 0%                453k ± 0%     ~     (p=0.310 n=5+5)
      fs1-zwrk.go·2                                                899k ± 0%                891k ± 0%   -0.83%  (p=0.008 n=5+5)
      fs1-zwrk.go·3                                               1.31M ± 8%               1.32M ± 3%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·4                                               1.77M ± 1%               1.77M ± 1%     ~     (p=0.841 n=5+5)
      fs1-zwrk.go·8                                               2.02M ± 2%               2.00M ± 2%     ~     (p=0.421 n=5+5)
      fs1-zwrk.go·12                                              2.04M ± 0%               2.04M ± 0%     ~     (p=0.063 n=5+4)
      fs1-zwrk.go·16                                              2.04M ± 0%               2.03M ± 2%     ~     (p=0.421 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        5.84k ± 4%               5.90k ± 1%     ~     (p=0.548 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        8.59k ± 2%               8.50k ± 0%     ~     (p=0.151 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        9.37k ± 2%               9.32k ± 1%     ~     (p=0.548 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        9.75k ± 3%               9.70k ± 1%     ~     (p=0.690 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        10.2k ± 3%               10.2k ± 2%     ~     (p=0.690 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       10.5k ± 1%               10.4k ± 0%     ~     (p=0.095 n=5+5)
      zeo/py/fs1-zwrk.go·16                                       10.5k ± 1%               10.5k ± 1%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               4.79k ± 5%               4.78k ± 3%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               6.49k ± 0%               6.42k ± 2%     ~     (p=0.063 n=4+5)
      neo/py(!log)/sqlite-zwrk.go·3                               6.37k ± 6%               6.40k ± 2%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               6.41k ± 1%               6.40k ± 1%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               6.36k ± 5%               6.39k ± 1%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                              6.43k ± 0%               6.44k ± 1%     ~     (p=0.556 n=4+5)
      neo/py(!log)/sqlite-zwrk.go·16                              6.37k ± 1%               6.38k ± 1%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  3.32k ±13%               3.41k ± 4%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  4.08k ± 7%               4.14k ± 2%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  4.11k ± 3%               4.12k ± 1%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  4.08k ± 4%               4.09k ± 3%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                  3.98k ± 3%               4.18k ± 2%   +4.87%  (p=0.016 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                 4.11k ± 5%               4.09k ± 2%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                 4.22k ± 4%               4.14k ± 3%     ~     (p=0.310 n=5+5)
      neo/go/fs1-zwrk.go·1                                        17.3k ± 1%               17.2k ± 1%     ~     (p=0.222 n=5+5)
      neo/go/fs1-zwrk.go·2                                        32.8k ± 1%               32.5k ± 1%     ~     (p=0.111 n=4+5)
      neo/go/fs1-zwrk.go·3                                        43.3k ± 0%               43.0k ± 1%   -0.61%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·4                                        53.0k ± 0%               52.7k ± 1%     ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·8                                        66.5k ± 1%               67.3k ± 1%     ~     (p=0.095 n=5+5)
      neo/go/fs1-zwrk.go·12                                       60.7k ± 2%               64.9k ± 2%   +6.81%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·16                                       55.5k ± 2%               57.3k ± 4%   +3.28%  (p=0.032 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                          20.1k ± 2%               20.3k ± 2%     ~     (p=0.310 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                          40.2k ± 1%               40.4k ± 1%     ~     (p=0.151 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                          51.5k ± 0%               51.5k ± 1%     ~     (p=0.690 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                          62.1k ± 0%               62.0k ± 1%     ~     (p=0.690 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          74.3k ± 2%               77.1k ± 2%   +3.66%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         67.1k ± 3%               75.3k ± 3%  +12.21%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         59.5k ± 2%               63.9k ± 2%   +7.44%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     8.89k ± 4%               8.99k ± 0%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     15.9k ± 0%               15.8k ± 1%     ~     (p=0.222 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     21.8k ± 1%               21.5k ± 1%   -1.24%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     26.2k ± 0%               25.7k ± 1%   -2.11%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     29.9k ± 1%               28.7k ± 2%   -4.03%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    28.7k ± 0%               27.3k ± 3%   -4.85%  (p=0.016 n=4+5)
      neo/go/sqlite-zwrk.go·16                                    28.8k ± 1%               27.1k ± 2%   -5.85%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              9.33k ± 1%               9.31k ± 0%     ~     (p=0.310 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              16.4k ± 0%               16.3k ± 0%     ~     (p=0.190 n=4+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              22.7k ± 0%               22.3k ± 1%   -1.53%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              27.4k ± 0%               26.8k ± 1%   -2.06%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              31.4k ± 1%               30.1k ± 0%   -4.24%  (p=0.016 n=5+4)
      neo/go/sqlite-zwrk.go(!sha1)·12                             29.8k ± 1%               28.4k ± 2%   -4.78%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             29.6k ± 2%               27.9k ± 3%   -5.82%  (p=0.008 n=5+5)
      
      name                                           old latency-time/object  new latency-time/object  delta
      cluster:neo1 dataset:wczblk1-8
      fs1-zwrk.go·1                                              4.35µs ± 0%              4.37µs ± 1%     ~     (p=0.135 n=5+5)
      fs1-zwrk.go·2                                              4.47µs ± 1%              4.48µs ± 1%     ~     (p=0.968 n=5+5)
      fs1-zwrk.go·3                                              4.51µs ± 0%              4.51µs ± 1%     ~     (p=0.651 n=5+5)
      fs1-zwrk.go·4                                              4.60µs ± 0%              4.61µs ± 1%     ~     (p=0.730 n=4+5)
      fs1-zwrk.go·8                                              8.07µs ± 0%              8.10µs ± 1%     ~     (p=0.571 n=5+5)
      fs1-zwrk.go·12                                             11.8µs ± 0%              11.9µs ± 1%     ~     (p=0.341 n=5+5)
      fs1-zwrk.go·16                                             15.7µs ± 0%              15.8µs ± 1%     ~     (p=0.516 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        198µs ± 1%               195µs ± 1%   -1.43%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        289µs ± 2%               289µs ± 1%     ~     (p=0.841 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        401µs ± 1%               398µs ± 1%   -0.84%  (p=0.032 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        520µs ± 2%               516µs ± 1%     ~     (p=0.151 n=5+5)
      zeo/py/fs1-zwrk.go·8                                       1.00ms ± 1%              0.99ms ± 0%   -0.82%  (p=0.032 n=5+5)
      zeo/py/fs1-zwrk.go·12                                      1.43ms ± 2%              1.42ms ± 0%     ~     (p=0.222 n=5+5)
      zeo/py/fs1-zwrk.go·16                                      1.89ms ± 1%              1.88ms ± 0%     ~     (p=0.095 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               237µs ± 2%               230µs ± 1%   -2.86%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               318µs ± 3%               316µs ± 2%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               477µs ± 2%               483µs ± 4%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               639µs ± 3%               640µs ± 1%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                              1.30ms ± 3%              1.28ms ± 2%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                             1.99ms ± 5%              1.92ms ± 2%     ~     (p=0.222 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                             2.58ms ± 5%              2.57ms ± 1%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  308µs ±13%               305µs ± 7%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  503µs ± 3%               491µs ± 2%     ~     (p=0.095 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  756µs ± 4%               740µs ± 2%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                 1.01ms ± 5%              0.98ms ± 2%     ~     (p=0.095 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                 1.97ms ± 4%              1.98ms ± 2%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                2.92ms ± 6%              2.98ms ± 2%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                3.98ms ± 8%              4.03ms ± 3%     ~     (p=1.000 n=5+5)
      neo/go/fs1-zwrk.go·1                                       77.3µs ± 1%              77.8µs ± 0%     ~     (p=0.548 n=5+5)
      neo/go/fs1-zwrk.go·2                                       80.4µs ± 0%              80.7µs ± 1%     ~     (p=0.548 n=5+5)
      neo/go/fs1-zwrk.go·3                                       92.8µs ± 0%              93.0µs ± 1%     ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·4                                       97.8µs ± 0%              98.4µs ± 1%   +0.56%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·8                                        146µs ± 1%               147µs ± 1%     ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·12                                       212µs ± 1%               210µs ± 1%   -1.16%  (p=0.016 n=5+5)
      neo/go/fs1-zwrk.go·16                                       294µs ± 1%               274µs ± 1%   -6.53%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                         52.6µs ± 2%              52.3µs ± 1%     ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                         53.3µs ± 2%              53.1µs ± 1%     ~     (p=0.548 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                         62.5µs ± 0%              62.8µs ± 1%     ~     (p=0.056 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                         67.8µs ± 0%              68.3µs ± 1%     ~     (p=0.095 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          102µs ± 0%               103µs ± 1%     ~     (p=0.056 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         149µs ± 7%               144µs ± 1%   -3.07%  (p=0.032 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         198µs ± 1%               188µs ± 2%   -4.97%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     123µs ± 0%               124µs ± 0%   +0.76%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     134µs ± 0%               136µs ± 1%   +1.33%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     144µs ± 0%               148µs ± 1%   +2.55%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     160µs ± 0%               166µs ± 1%   +3.84%  (p=0.016 n=4+5)
      neo/go/sqlite-zwrk.go·8                                     249µs ± 1%               263µs ± 1%   +5.71%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    372µs ± 1%               390µs ± 3%   +4.80%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    524µs ±11%               532µs ± 2%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              113µs ± 1%               113µs ± 0%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              124µs ± 0%               125µs ± 1%   +0.67%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              133µs ± 0%               136µs ± 1%   +1.76%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              145µs ± 0%               149µs ± 1%   +2.75%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              234µs ± 1%               242µs ± 2%   +3.33%  (p=0.016 n=4+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             360µs ± 2%               365µs ± 2%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             487µs ± 2%               499µs ± 2%     ~     (p=0.056 n=5+5)
      cluster:neo1 dataset:prod1-1024
      fs1-zwrk.go·1                                              2.21µs ± 0%              2.21µs ± 0%     ~     (p=0.286 n=5+5)
      fs1-zwrk.go·2                                              2.23µs ± 0%              2.24µs ± 0%   +0.84%  (p=0.008 n=5+5)
      fs1-zwrk.go·3                                              2.30µs ± 9%              2.27µs ± 3%     ~     (p=0.849 n=5+5)
      fs1-zwrk.go·4                                              2.26µs ± 1%              2.27µs ± 1%     ~     (p=0.794 n=5+5)
      fs1-zwrk.go·8                                              3.97µs ± 2%              4.00µs ± 2%     ~     (p=0.421 n=5+5)
      fs1-zwrk.go·12                                             5.90µs ± 0%              5.88µs ± 0%   -0.28%  (p=0.032 n=5+4)
      fs1-zwrk.go·16                                             7.86µs ± 0%              7.83µs ± 0%     ~     (p=0.111 n=5+4)
      zeo/py/fs1-zwrk.go·1                                        171µs ± 4%               170µs ± 1%     ~     (p=0.548 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        233µs ± 2%               235µs ± 0%     ~     (p=0.151 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        320µs ± 2%               322µs ± 1%     ~     (p=0.548 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        410µs ± 3%               412µs ± 1%     ~     (p=0.690 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        783µs ± 3%               782µs ± 2%     ~     (p=0.690 n=5+5)
      zeo/py/fs1-zwrk.go·12                                      1.14ms ± 1%              1.15ms ± 0%     ~     (p=0.095 n=5+5)
      zeo/py/fs1-zwrk.go·16                                      1.53ms ± 1%              1.52ms ± 1%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               209µs ± 5%               209µs ± 3%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               308µs ± 0%               312µs ± 2%     ~     (p=0.063 n=4+5)
      neo/py(!log)/sqlite-zwrk.go·3                               472µs ± 6%               469µs ± 2%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               624µs ± 1%               625µs ± 1%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                              1.26ms ± 6%              1.25ms ± 1%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                             1.87ms ± 0%              1.86ms ± 1%     ~     (p=0.556 n=4+5)
      neo/py(!log)/sqlite-zwrk.go·16                             2.51ms ± 1%              2.51ms ± 1%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  304µs ±13%               294µs ± 4%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  491µs ± 7%               483µs ± 2%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  730µs ± 3%               728µs ± 1%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  982µs ± 4%               978µs ± 3%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                 2.01ms ± 3%              1.92ms ± 2%   -4.68%  (p=0.016 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                2.92ms ± 5%              2.94ms ± 2%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                3.79ms ± 4%              3.87ms ± 3%     ~     (p=0.310 n=5+5)
      neo/go/fs1-zwrk.go·1                                       57.8µs ± 1%              58.1µs ± 1%     ~     (p=0.222 n=5+5)
      neo/go/fs1-zwrk.go·2                                       61.1µs ± 1%              61.5µs ± 1%     ~     (p=0.111 n=4+5)
      neo/go/fs1-zwrk.go·3                                       69.3µs ± 0%              69.7µs ± 1%   +0.62%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·4                                       75.5µs ± 0%              75.8µs ± 1%     ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·8                                        120µs ± 1%               119µs ± 2%     ~     (p=0.095 n=5+5)
      neo/go/fs1-zwrk.go·12                                       198µs ± 2%               185µs ± 2%   -6.38%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·16                                       289µs ± 2%               280µs ± 4%   -3.14%  (p=0.032 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                         49.9µs ± 2%              49.4µs ± 2%     ~     (p=0.310 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                         49.8µs ± 1%              49.5µs ± 1%     ~     (p=0.151 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                         58.3µs ± 0%              58.2µs ± 1%     ~     (p=0.690 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                         64.4µs ± 0%              64.5µs ± 1%     ~     (p=0.690 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          108µs ± 2%               104µs ± 2%   -3.52%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         179µs ± 3%               159µs ± 3%  -10.88%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         269µs ± 2%               250µs ± 2%   -6.92%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     113µs ± 4%               111µs ± 0%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     126µs ± 0%               127µs ± 1%     ~     (p=0.222 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     138µs ± 1%               140µs ± 1%   +1.26%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     152µs ± 0%               156µs ± 1%   +2.16%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     267µs ± 1%               279µs ± 2%   +4.21%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    418µs ± 0%               440µs ± 3%   +5.13%  (p=0.016 n=4+5)
      neo/go/sqlite-zwrk.go·16                                    556µs ± 1%               591µs ± 2%   +6.23%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              107µs ± 1%               107µs ± 0%     ~     (p=0.310 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              122µs ± 0%               122µs ± 0%     ~     (p=0.190 n=4+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              132µs ± 0%               134µs ± 1%   +1.56%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              146µs ± 0%               149µs ± 1%   +2.10%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              255µs ± 1%               266µs ± 0%   +4.43%  (p=0.016 n=5+4)
      neo/go/sqlite-zwrk.go(!sha1)·12                             403µs ± 1%               423µs ± 2%   +5.03%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             541µs ± 2%               574µs ± 3%   +6.20%  (p=0.008 n=5+5)
      5db60f7e
    • Kirill Smelkov's avatar
      X neo1: localhost timings, Cenabled, zwrk was running for 1s at each iteration · 4cbd62f7
      Kirill Smelkov authored
      Remeasure with same settings as previous neo1 localhost with C-enabled (9644774a):
      
      The data is more or less the same and in particular timings for either
      sql backend or python client are noisy.
      
      ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
      
      $ benchstat -split node,cluster,dataset 20180306-neo1-ffixed-c.txt 20180308-neo1-ffixed-c-zwrk1s.txt
      
      name                                           old pystone/s            new pystone/s            delta
      node:neo1
      pystone                                                      106k ± 1%                106k ± 1%    ~     (p=0.690 n=5+5)
      
      name                                           old time/op              new time/op              delta
      node:neo1
      crc32/py/4K                                                5.13µs ± 1%              5.13µs ± 1%    ~     (p=1.000 n=5+5)
      crc32/go/4K                                                2.79µs ± 0%              2.79µs ± 0%    ~     (p=1.000 n=5+5)
      sha1/py/4K                                                 13.4µs ± 1%              13.5µs ± 1%    ~     (p=0.730 n=5+4)
      sha1/go/4K                                                 9.83µs ± 0%              9.82µs ± 0%    ~     (p=0.810 n=5+5)
      unzlib/py/wczdata                                          36.1µs ± 0%              35.9µs ± 1%    ~     (p=0.421 n=5+5)
      unzlib/go/wczdata                                          31.1µs ± 1%              31.2µs ± 0%    ~     (p=0.421 n=5+5)
      unzlib/py/prod1-avg                                        16.3µs ± 2%              16.1µs ± 3%    ~     (p=0.310 n=5+5)
      unzlib/go/prod1-avg                                        9.42µs ± 0%              9.38µs ± 1%    ~     (p=0.222 n=5+5)
      disk/randread/direct/4K-min                                 162µs ± 0%               162µs ± 0%    ~     (p=0.619 n=5+4)
      disk/randread/direct/4K-avg                                 187µs ± 2%               187µs ± 1%    ~     (p=0.952 n=5+5)
      disk/randread/pagecache/4K-min                              389ns ± 1%               392ns ± 1%    ~     (p=0.167 n=5+5)
      disk/randread/pagecache/4K-avg                              804ns ± 0%               808ns ± 0%  +0.53%  (p=0.016 n=4+5)
      
      name                                           old time/object          new time/object          delta
      cluster:neo1 dataset:wczblk1-8
      fs1-zhash.py                                               34.7µs ± 2%              34.8µs ± 1%    ~     (p=0.770 n=5+5)
      fs1-zhash.go                                               6.00µs ± 2%              5.96µs ± 1%    ~     (p=0.683 n=5+5)
      fs1-zhash.go+prefetch128                                   6.52µs ± 4%              6.60µs ± 0%    ~     (p=0.397 n=5+4)
      zeo/py/fs1-zhash.py                                         523µs ± 1%               524µs ± 2%    ~     (p=0.841 n=5+5)
      zeo/py/fs1-zhash.go                                         194µs ± 4%               197µs ± 6%    ~     (p=0.421 n=5+5)
      zeo/py/fs1-zhash.go+prefetch128                            98.6µs ± 3%             100.1µs ± 2%    ~     (p=0.135 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                684µs ± 3%               625µs ±20%    ~     (p=0.056 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                236µs ± 2%               231µs ± 5%    ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zhash.go+prefetch128                    162µs ± 2%               164µs ± 1%    ~     (p=0.095 n=5+5)
      neo/py(!log)/sql-zhash.py                                   942µs ±47%               992µs ±44%    ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zhash.go                                   300µs ±17%               329µs ±14%    ~     (p=0.548 n=5+5)
      neo/py(!log)/sql-zhash.go+prefetch128                       240µs ± 6%               242µs ± 5%    ~     (p=1.000 n=5+5)
      neo/go/fs1-zhash.py                                         383µs ±20%               373µs ±19%    ~     (p=0.802 n=5+5)
      neo/go/fs1-zhash.go                                        81.3µs ± 1%              80.0µs ± 2%  -1.62%  (p=0.040 n=5+5)
      neo/go/fs1-zhash.go+prefetch128                            33.8µs ± 5%              34.8µs ± 5%    ~     (p=0.389 n=5+5)
      neo/go/fs1(!sha1)-zhash.go(!sha1)                          57.6µs ± 3%              57.5µs ± 3%    ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1)              22.9µs ± 6%              23.8µs ± 7%    ~     (p=0.103 n=5+5)
      neo/go/sqlite-zhash.py                                      402µs ± 6%               415µs ± 3%    ~     (p=0.421 n=5+5)
      neo/go/sqlite-zhash.go                                      125µs ± 1%               126µs ± 1%    ~     (p=0.421 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128                         48.4µs ± 8%              45.6µs ± 6%    ~     (p=0.310 n=5+5)
      neo/go/sqlite-zhash.go(!sha1)                               116µs ± 2%               117µs ± 3%    ~     (p=0.413 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128(!sha1)                  45.9µs ± 5%              45.8µs ± 4%    ~     (p=0.841 n=5+5)
      cluster:neo1 dataset:prod1-1024
      fs1-zhash.py                                               28.9µs ± 1%              29.1µs ± 1%    ~     (p=0.167 n=5+5)
      fs1-zhash.go                                               3.76µs ± 4%              3.76µs ± 2%    ~     (p=1.000 n=5+5)
      fs1-zhash.go+prefetch128                                   3.86µs ± 2%              3.82µs ± 3%    ~     (p=0.683 n=5+5)
      zeo/py/fs1-zhash.py                                         474µs ± 2%               490µs ± 1%  +3.34%  (p=0.008 n=5+5)
      zeo/py/fs1-zhash.go                                         170µs ± 3%               173µs ±12%    ~     (p=0.690 n=5+5)
      zeo/py/fs1-zhash.go+prefetch128                            87.8µs ± 1%              86.6µs ± 1%  -1.32%  (p=0.032 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                665µs ± 2%               639µs ±23%    ~     (p=0.651 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                219µs ± 2%               216µs ± 3%    ~     (p=0.206 n=5+5)
      neo/py(!log)/sqlite-zhash.go+prefetch128                    151µs ± 1%               150µs ± 2%    ~     (p=0.611 n=5+5)
      neo/py(!log)/sql-zhash.py                                   886µs ±56%               912µs ±50%    ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zhash.go                                   298µs ± 9%               307µs ±10%    ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zhash.go+prefetch128                       230µs ± 3%               227µs ± 3%    ~     (p=0.421 n=5+5)
      neo/go/fs1-zhash.py                                         319µs ±11%               336µs ±11%    ~     (p=0.389 n=5+5)
      neo/go/fs1-zhash.go                                        61.3µs ± 3%              61.5µs ± 3%    ~     (p=0.968 n=5+5)
      neo/go/fs1-zhash.go+prefetch128                            22.5µs ± 3%              22.6µs ± 3%    ~     (p=0.857 n=5+5)
      neo/go/fs1(!sha1)-zhash.go(!sha1)                          52.0µs ± 3%              52.5µs ± 4%    ~     (p=0.841 n=5+5)
      neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1)              18.3µs ± 2%              18.2µs ± 4%    ~     (p=0.968 n=5+5)
      neo/go/sqlite-zhash.py                                      382µs ± 6%               387µs ± 4%    ~     (p=0.690 n=5+5)
      neo/go/sqlite-zhash.go                                      113µs ± 1%               113µs ± 1%    ~     (p=0.524 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128                         40.9µs ± 4%              41.7µs ± 3%    ~     (p=0.341 n=5+5)
      neo/go/sqlite-zhash.go(!sha1)                               108µs ± 1%               110µs ± 2%    ~     (p=0.063 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128(!sha1)                  41.1µs ± 5%              40.9µs ± 5%    ~     (p=0.841 n=5+5)
      
      name                                           old req/s                new req/s                delta
      cluster:neo1 dataset:wczblk1-8
      fs1-zwrk.go·1                                                229k ± 0%                230k ± 0%  +0.37%  (p=0.016 n=5+5)
      fs1-zwrk.go·2                                                443k ± 1%                447k ± 1%  +1.08%  (p=0.032 n=5+5)
      fs1-zwrk.go·3                                                662k ± 1%                666k ± 0%  +0.61%  (p=0.032 n=5+5)
      fs1-zwrk.go·4                                                867k ± 1%                870k ± 0%    ~     (p=0.413 n=5+4)
      fs1-zwrk.go·8                                                988k ± 0%                991k ± 0%    ~     (p=0.095 n=5+5)
      fs1-zwrk.go·12                                              1.02M ± 0%               1.02M ± 0%    ~     (p=0.841 n=5+5)
      fs1-zwrk.go·16                                               976k ±12%               1016k ± 0%    ~     (p=0.421 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        5.15k ± 1%               5.06k ± 1%  -1.78%  (p=0.032 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        7.08k ± 1%               6.93k ± 2%  -2.23%  (p=0.032 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        7.73k ± 1%               7.48k ± 1%  -3.20%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        7.97k ± 4%               7.69k ± 2%    ~     (p=0.095 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        8.30k ± 2%               8.02k ± 1%  -3.33%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       8.15k ± 1%               8.40k ± 2%  +3.06%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·16                                       8.25k ± 1%               8.46k ± 1%  +2.60%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               4.31k ± 4%               4.22k ± 2%    ~     (p=0.222 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               6.28k ± 5%               6.29k ± 3%    ~     (p=0.548 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               6.38k ± 0%               6.29k ± 2%  -1.48%  (p=0.016 n=4+5)
      neo/py(!log)/sqlite-zwrk.go·4                               6.15k ± 5%               6.26k ± 3%    ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               6.27k ± 4%               6.18k ± 3%    ~     (p=0.222 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                              6.33k ± 2%               6.04k ± 5%  -4.50%  (p=0.032 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                              6.25k ± 4%               6.21k ± 5%    ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  3.10k ± 6%               3.27k ±13%    ~     (p=0.548 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  3.98k ± 1%               3.98k ± 3%    ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  4.04k ± 3%               3.97k ± 4%    ~     (p=0.690 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  4.06k ± 4%               3.95k ± 5%    ~     (p=0.222 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                  3.79k ± 7%               4.07k ± 4%  +7.21%  (p=0.032 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                 3.98k ± 3%               4.11k ± 6%    ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                 3.94k ± 1%               4.03k ± 9%    ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·1                                        12.8k ± 0%               12.9k ± 1%    ~     (p=0.548 n=5+5)
      neo/go/fs1-zwrk.go·2                                        24.8k ± 0%               24.9k ± 0%    ~     (p=0.556 n=4+5)
      neo/go/fs1-zwrk.go·3                                        32.3k ± 0%               32.3k ± 0%    ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·4                                        40.7k ± 0%               40.9k ± 0%  +0.37%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·8                                        54.5k ± 1%               54.7k ± 1%    ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·12                                       56.5k ± 1%               56.5k ± 1%    ~     (p=1.000 n=5+5)
      neo/go/fs1-zwrk.go·16                                       53.2k ±10%               54.5k ± 1%    ~     (p=0.548 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                          19.0k ± 2%               19.0k ± 2%    ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                          37.8k ± 0%               37.5k ± 2%    ~     (p=0.222 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                          48.0k ± 1%               48.0k ± 0%    ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                          59.0k ± 0%               59.0k ± 0%    ~     (p=0.548 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          78.0k ± 1%               78.1k ± 0%    ~     (p=0.690 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         82.2k ± 2%               80.7k ± 7%    ~     (p=0.421 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         80.4k ± 1%               80.7k ± 1%    ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     8.06k ± 4%               8.12k ± 0%    ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     14.9k ± 0%               14.9k ± 0%    ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     20.7k ± 0%               20.9k ± 0%  +0.59%  (p=0.016 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     24.8k ± 0%               25.0k ± 0%  +0.78%  (p=0.016 n=5+4)
      neo/go/sqlite-zwrk.go·8                                     31.7k ± 1%               32.1k ± 1%  +1.34%  (p=0.016 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    30.8k ± 5%               32.3k ± 1%  +4.85%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    30.4k ± 2%               30.6k ±10%    ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              8.95k ± 1%               8.84k ± 1%  -1.25%  (p=0.032 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              16.2k ± 1%               16.2k ± 0%    ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              22.6k ± 0%               22.5k ± 0%  -0.34%  (p=0.016 n=4+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              27.9k ± 0%               27.5k ± 0%  -1.27%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              35.0k ± 1%               34.2k ± 1%  -2.32%  (p=0.016 n=5+4)
      neo/go/sqlite-zwrk.go(!sha1)·12                             34.7k ± 1%               33.4k ± 2%  -3.75%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             33.0k ±11%               32.8k ± 2%    ~     (p=0.222 n=5+5)
      cluster:neo1 dataset:prod1-1024
      fs1-zwrk.go·1                                                451k ± 0%                454k ± 0%    ~     (p=0.056 n=5+5)
      fs1-zwrk.go·2                                                893k ± 0%                899k ± 0%  +0.68%  (p=0.008 n=5+5)
      fs1-zwrk.go·3                                               1.34M ± 1%               1.31M ± 8%    ~     (p=0.841 n=5+5)
      fs1-zwrk.go·4                                               1.77M ± 0%               1.77M ± 1%    ~     (p=0.841 n=5+5)
      fs1-zwrk.go·8                                               1.99M ± 1%               2.02M ± 2%    ~     (p=0.151 n=5+5)
      fs1-zwrk.go·12                                              2.03M ± 1%               2.04M ± 0%    ~     (p=0.190 n=4+5)
      fs1-zwrk.go·16                                              2.03M ± 0%               2.04M ± 0%    ~     (p=0.841 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        5.79k ± 3%               5.84k ± 4%    ~     (p=0.548 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        8.55k ± 1%               8.59k ± 2%    ~     (p=0.310 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        9.28k ± 7%               9.37k ± 2%    ~     (p=1.000 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        9.72k ± 1%               9.75k ± 3%    ~     (p=0.841 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        10.4k ± 1%               10.2k ± 3%  -1.89%  (p=0.032 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       10.5k ± 1%               10.5k ± 1%    ~     (p=0.841 n=5+5)
      zeo/py/fs1-zwrk.go·16                                       10.4k ± 4%               10.5k ± 1%    ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               4.90k ± 7%               4.79k ± 5%    ~     (p=0.548 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               6.28k ± 4%               6.49k ± 0%    ~     (p=0.190 n=5+4)
      neo/py(!log)/sqlite-zwrk.go·3                               6.32k ± 5%               6.37k ± 6%    ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               6.45k ± 2%               6.41k ± 1%    ~     (p=0.548 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               6.45k ± 2%               6.36k ± 5%    ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                              6.31k ± 3%               6.43k ± 0%    ~     (p=0.556 n=5+4)
      neo/py(!log)/sqlite-zwrk.go·16                              6.36k ± 5%               6.37k ± 1%    ~     (p=0.310 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  3.50k ± 9%               3.32k ±13%    ~     (p=0.310 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  4.05k ± 6%               4.08k ± 7%    ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  4.06k ± 7%               4.11k ± 3%    ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  3.98k ± 4%               4.08k ± 4%    ~     (p=0.548 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                  4.15k ± 3%               3.98k ± 3%    ~     (p=0.056 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                 4.00k ± 5%               4.11k ± 5%    ~     (p=0.310 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                 3.96k ±11%               4.22k ± 4%    ~     (p=0.151 n=5+5)
      neo/go/fs1-zwrk.go·1                                        17.1k ± 1%               17.3k ± 1%  +1.36%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·2                                        32.6k ± 0%               32.8k ± 1%    ~     (p=0.111 n=5+4)
      neo/go/fs1-zwrk.go·3                                        43.3k ± 0%               43.3k ± 0%    ~     (p=0.690 n=5+5)
      neo/go/fs1-zwrk.go·4                                        52.9k ± 0%               53.0k ± 0%    ~     (p=0.690 n=5+5)
      neo/go/fs1-zwrk.go·8                                        66.3k ± 1%               66.5k ± 1%    ~     (p=0.905 n=4+5)
      neo/go/fs1-zwrk.go·12                                       61.6k ± 1%               60.7k ± 2%    ~     (p=0.310 n=5+5)
      neo/go/fs1-zwrk.go·16                                       55.6k ± 4%               55.5k ± 2%    ~     (p=0.841 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                          19.6k ± 5%               20.1k ± 2%    ~     (p=0.151 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                          40.3k ± 0%               40.2k ± 1%    ~     (p=0.548 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                          51.6k ± 0%               51.5k ± 0%    ~     (p=0.548 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                          62.0k ± 0%               62.1k ± 0%    ~     (p=0.548 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          74.2k ± 4%               74.3k ± 2%    ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         64.8k ± 7%               67.1k ± 3%    ~     (p=0.222 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         59.5k ± 4%               59.5k ± 2%    ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     9.02k ± 1%               8.89k ± 4%    ~     (p=0.310 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     16.0k ± 0%               15.9k ± 0%  -0.66%  (p=0.016 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     21.8k ± 1%               21.8k ± 1%    ~     (p=0.286 n=4+5)
      neo/go/sqlite-zwrk.go·4                                     26.2k ± 0%               26.2k ± 0%    ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     30.0k ± 2%               29.9k ± 1%    ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    28.6k ± 2%               28.7k ± 0%    ~     (p=0.556 n=5+4)
      neo/go/sqlite-zwrk.go·16                                    28.7k ± 1%               28.8k ± 1%    ~     (p=0.905 n=4+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              9.45k ± 1%               9.33k ± 1%  -1.20%  (p=0.032 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              16.6k ± 1%               16.4k ± 0%  -1.24%  (p=0.016 n=5+4)
      neo/go/sqlite-zwrk.go(!sha1)·3                              23.0k ± 0%               22.7k ± 0%  -1.44%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              28.0k ± 1%               27.4k ± 0%  -2.10%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              32.3k ± 0%               31.4k ± 1%  -2.83%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             30.6k ± 2%               29.8k ± 1%  -2.48%  (p=0.016 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             30.3k ± 2%               29.6k ± 2%  -2.37%  (p=0.032 n=5+5)
      
      name                                           old latency-time/object  new latency-time/object  delta
      cluster:neo1 dataset:wczblk1-8
      fs1-zwrk.go·1                                              4.36µs ± 0%              4.35µs ± 0%  -0.37%  (p=0.016 n=5+5)
      fs1-zwrk.go·2                                              4.52µs ± 1%              4.47µs ± 1%  -1.07%  (p=0.032 n=5+5)
      fs1-zwrk.go·3                                              4.53µs ± 1%              4.51µs ± 0%  -0.61%  (p=0.040 n=5+5)
      fs1-zwrk.go·4                                              4.61µs ± 1%              4.60µs ± 0%    ~     (p=0.413 n=5+4)
      fs1-zwrk.go·8                                              8.10µs ± 0%              8.07µs ± 0%    ~     (p=0.095 n=5+5)
      fs1-zwrk.go·12                                             11.8µs ± 0%              11.8µs ± 0%    ~     (p=0.841 n=5+5)
      fs1-zwrk.go·16                                             16.5µs ±13%              15.7µs ± 0%    ~     (p=0.421 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        194µs ± 1%               198µs ± 1%  +1.81%  (p=0.032 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        282µs ± 1%               289µs ± 2%  +2.29%  (p=0.032 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        388µs ± 1%               401µs ± 1%  +3.30%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        502µs ± 5%               520µs ± 2%    ~     (p=0.095 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        964µs ± 2%               997µs ± 1%  +3.43%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·12                                      1.47ms ± 1%              1.43ms ± 2%  -2.97%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·16                                      1.94ms ± 1%              1.89ms ± 1%  -2.54%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               232µs ± 4%               237µs ± 2%    ~     (p=0.222 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               319µs ± 5%               318µs ± 3%    ~     (p=0.548 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               470µs ± 0%               477µs ± 2%  +1.52%  (p=0.016 n=4+5)
      neo/py(!log)/sqlite-zwrk.go·4                               651µs ± 5%               639µs ± 3%    ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                              1.28ms ± 4%              1.30ms ± 3%    ~     (p=0.222 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                             1.90ms ± 2%              1.99ms ± 5%  +4.85%  (p=0.032 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                             2.56ms ± 4%              2.58ms ± 5%    ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  323µs ± 6%               308µs ±13%    ~     (p=0.548 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  503µs ± 2%               503µs ± 3%    ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  742µs ± 3%               756µs ± 4%    ~     (p=0.690 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  986µs ± 4%              1014µs ± 5%    ~     (p=0.222 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                 2.11ms ± 8%              1.97ms ± 4%  -6.85%  (p=0.032 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                3.02ms ± 3%              2.92ms ± 6%    ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                4.06ms ± 1%              3.98ms ± 8%    ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·1                                       77.8µs ± 0%              77.3µs ± 1%    ~     (p=0.548 n=5+5)
      neo/go/fs1-zwrk.go·2                                       80.6µs ± 0%              80.4µs ± 0%    ~     (p=0.556 n=4+5)
      neo/go/fs1-zwrk.go·3                                       92.8µs ± 0%              92.8µs ± 0%    ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·4                                       98.2µs ± 0%              97.8µs ± 0%  -0.36%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·8                                        147µs ± 1%               146µs ± 1%    ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·12                                       212µs ± 1%               212µs ± 1%    ~     (p=1.000 n=5+5)
      neo/go/fs1-zwrk.go·16                                       293µs ± 1%               294µs ± 1%    ~     (p=0.905 n=4+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                         52.7µs ± 2%              52.6µs ± 2%    ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                         53.0µs ± 0%              53.3µs ± 2%    ~     (p=0.222 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                         62.5µs ± 1%              62.5µs ± 0%    ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                         67.8µs ± 0%              67.8µs ± 0%    ~     (p=0.548 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          103µs ± 1%               102µs ± 0%    ~     (p=0.690 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         146µs ± 2%               149µs ± 7%    ~     (p=0.421 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         199µs ± 1%               198µs ± 1%    ~     (p=0.802 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     124µs ± 4%               123µs ± 0%    ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     134µs ± 0%               134µs ± 0%    ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     145µs ± 0%               144µs ± 0%  -0.59%  (p=0.016 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     161µs ± 0%               160µs ± 0%  -0.77%  (p=0.016 n=5+4)
      neo/go/sqlite-zwrk.go·8                                     252µs ± 1%               249µs ± 1%  -1.32%  (p=0.016 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    390µs ± 5%               372µs ± 1%  -4.68%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    526µs ± 2%               524µs ±11%    ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              112µs ± 1%               113µs ± 1%  +1.26%  (p=0.032 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              124µs ± 1%               124µs ± 0%    ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              133µs ± 0%               133µs ± 0%  +0.34%  (p=0.016 n=4+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              143µs ± 0%               145µs ± 0%  +1.29%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              228µs ± 1%               234µs ± 1%  +2.37%  (p=0.016 n=5+4)
      neo/go/sqlite-zwrk.go(!sha1)·12                             346µs ± 1%               360µs ± 2%  +3.91%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             486µs ±11%               487µs ± 2%    ~     (p=0.222 n=5+5)
      cluster:neo1 dataset:prod1-1024
      fs1-zwrk.go·1                                              2.22µs ± 1%              2.21µs ± 0%    ~     (p=0.056 n=5+5)
      fs1-zwrk.go·2                                              2.24µs ± 0%              2.23µs ± 0%  -0.69%  (p=0.008 n=5+5)
      fs1-zwrk.go·3                                              2.25µs ± 1%              2.30µs ± 9%    ~     (p=0.841 n=5+5)
      fs1-zwrk.go·4                                              2.26µs ± 0%              2.26µs ± 1%    ~     (p=0.714 n=5+5)
      fs1-zwrk.go·8                                              4.02µs ± 1%              3.97µs ± 2%    ~     (p=0.111 n=5+5)
      fs1-zwrk.go·12                                             5.92µs ± 1%              5.90µs ± 0%    ~     (p=0.190 n=4+5)
      fs1-zwrk.go·16                                             7.87µs ± 0%              7.86µs ± 0%    ~     (p=0.738 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        173µs ± 3%               171µs ± 4%    ~     (p=0.548 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        234µs ± 1%               233µs ± 2%    ~     (p=0.310 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        324µs ± 7%               320µs ± 2%    ~     (p=1.000 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        412µs ± 1%               410µs ± 3%    ~     (p=0.841 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        768µs ± 1%               783µs ± 3%  +1.95%  (p=0.032 n=5+5)
      zeo/py/fs1-zwrk.go·12                                      1.14ms ± 1%              1.14ms ± 1%    ~     (p=0.841 n=5+5)
      zeo/py/fs1-zwrk.go·16                                      1.54ms ± 4%              1.53ms ± 1%    ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               204µs ± 8%               209µs ± 5%    ~     (p=0.548 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               319µs ± 4%               308µs ± 0%    ~     (p=0.190 n=5+4)
      neo/py(!log)/sqlite-zwrk.go·3                               475µs ± 5%               472µs ± 6%    ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               620µs ± 2%               624µs ± 1%    ~     (p=0.548 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                              1.24ms ± 2%              1.26ms ± 6%    ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                             1.90ms ± 3%              1.87ms ± 0%    ~     (p=0.556 n=5+4)
      neo/py(!log)/sqlite-zwrk.go·16                             2.52ms ± 5%              2.51ms ± 1%    ~     (p=0.310 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  287µs ± 8%               304µs ±13%    ~     (p=0.310 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  495µs ± 6%               491µs ± 7%    ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  740µs ± 8%               730µs ± 3%    ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                 1.01ms ± 4%              0.98ms ± 4%    ~     (p=0.548 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                 1.93ms ± 3%              2.01ms ± 3%    ~     (p=0.056 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                3.01ms ± 4%              2.92ms ± 5%    ~     (p=0.310 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                4.05ms ±10%              3.79ms ± 4%    ~     (p=0.151 n=5+5)
      neo/go/fs1-zwrk.go·1                                       58.5µs ± 1%              57.8µs ± 1%  -1.34%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·2                                       61.4µs ± 0%              61.1µs ± 1%    ~     (p=0.111 n=5+4)
      neo/go/fs1-zwrk.go·3                                       69.3µs ± 0%              69.3µs ± 0%    ~     (p=0.651 n=5+5)
      neo/go/fs1-zwrk.go·4                                       75.6µs ± 0%              75.5µs ± 0%    ~     (p=0.690 n=5+5)
      neo/go/fs1-zwrk.go·8                                        121µs ± 1%               120µs ± 1%    ~     (p=0.905 n=4+5)
      neo/go/fs1-zwrk.go·12                                       195µs ± 1%               198µs ± 2%    ~     (p=0.310 n=5+5)
      neo/go/fs1-zwrk.go·16                                       288µs ± 4%               289µs ± 2%    ~     (p=0.841 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                         50.9µs ± 5%              49.9µs ± 2%    ~     (p=0.151 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                         49.7µs ± 0%              49.8µs ± 1%    ~     (p=0.548 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                         58.2µs ± 0%              58.3µs ± 0%    ~     (p=0.548 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                         64.5µs ± 0%              64.4µs ± 0%    ~     (p=0.548 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          108µs ± 4%               108µs ± 2%    ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         185µs ± 8%               179µs ± 3%    ~     (p=0.222 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         269µs ± 4%               269µs ± 2%    ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     111µs ± 1%               113µs ± 4%    ~     (p=0.310 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     125µs ± 0%               126µs ± 0%  +0.66%  (p=0.016 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     137µs ± 1%               138µs ± 1%    ~     (p=0.286 n=4+5)
      neo/go/sqlite-zwrk.go·4                                     153µs ± 0%               152µs ± 0%    ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     267µs ± 1%               267µs ± 1%    ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    420µs ± 2%               418µs ± 0%    ~     (p=0.556 n=5+4)
      neo/go/sqlite-zwrk.go·16                                    558µs ± 1%               556µs ± 1%    ~     (p=0.905 n=4+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              106µs ± 1%               107µs ± 1%  +1.21%  (p=0.032 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              121µs ± 1%               122µs ± 0%  +1.25%  (p=0.016 n=5+4)
      neo/go/sqlite-zwrk.go(!sha1)·3                              130µs ± 0%               132µs ± 0%  +1.47%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              143µs ± 1%               146µs ± 0%  +2.14%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              248µs ± 0%               255µs ± 1%  +2.92%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             393µs ± 2%               403µs ± 1%  +2.53%  (p=0.016 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             528µs ± 2%               541µs ± 2%  +2.42%  (p=0.032 n=5+5)
      4cbd62f7
    • Kirill Smelkov's avatar
      1e438610
  9. 08 Mar, 2018 3 commits
  10. 06 Mar, 2018 5 commits
    • Kirill Smelkov's avatar
      X deco: localhost timings, C > C1 disabled (remeasure) · 620b723c
      Kirill Smelkov authored
      As it was promised in 0867c981 here comes remeasurement of deco timings
      with C-states disabled. And the results are the same, thus confirming
      zeo/py/fs-<go-client> both speedup and slowdown:
      
      ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
      
      $ benchstat -split node,cluster,dataset "20180306-deco-ffixed-c.txt" "20180306-deco-ffixed-noc_C1(2µs).txt.2"
      
      name                                           old pystone/s            new pystone/s            delta
      node:deco
      pystone                                                      217k ± 4%                217k ± 2%     ~     (p=1.000 n=5+5)
      
      name                                           old time/op              new time/op              delta
      node:deco
      crc32/py/4K                                                5.73µs ± 0%              5.73µs ± 0%     ~     (p=0.841 n=5+5)
      crc32/go/4K                                                 279ns ± 0%               279ns ± 0%     ~     (all equal)
      sha1/py/4K                                                 6.74µs ± 1%              6.71µs ± 1%     ~     (p=0.310 n=5+5)
      sha1/go/4K                                                 5.60µs ± 0%              5.59µs ± 0%   -0.18%  (p=0.024 n=5+5)
      unzlib/py/wczdata                                          27.2µs ± 1%              27.1µs ± 1%     ~     (p=0.452 n=5+5)
      unzlib/go/wczdata                                          27.0µs ± 0%              26.8µs ± 0%   -0.62%  (p=0.008 n=5+5)
      unzlib/py/prod1-avg                                        5.14µs ± 3%              5.13µs ± 1%     ~     (p=1.000 n=5+5)
      unzlib/go/prod1-avg                                        5.30µs ± 1%              5.28µs ± 0%   -0.47%  (p=0.016 n=5+5)
      disk/randread/direct/4K-min                                 104µs ± 2%               105µs ± 0%   +1.48%  (p=0.016 n=5+4)
      disk/randread/direct/4K-avg                                 141µs ± 0%               142µs ± 0%   +0.95%  (p=0.008 n=5+5)
      disk/randread/pagecache/4K-min                              579ns ± 2%               584ns ± 2%     ~     (p=0.310 n=5+5)
      disk/randread/pagecache/4K-avg                              993ns ± 0%               986ns ± 0%   -0.70%  (p=0.008 n=5+5)
      
      name                                           old time/object          new time/object          delta
      cluster:deco dataset:wczblk1-8
      fs1-zhash.py                                               20.3µs ± 1%              20.3µs ± 2%     ~     (p=0.524 n=4+5)
      fs1-zhash.go                                               3.26µs ± 4%              3.20µs ± 0%     ~     (p=0.333 n=5+4)
      fs1-zhash.go+prefetch128                                   4.04µs ± 1%              4.00µs ± 7%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zhash.py                                         383µs ± 5%               364µs ± 5%     ~     (p=0.095 n=5+5)
      zeo/py/fs1-zhash.go                                         126µs ± 1%               113µs ± 1%  -10.03%  (p=0.008 n=5+5)
      zeo/py/fs1-zhash.go+prefetch128                            63.1µs ± 1%              64.0µs ± 2%     ~     (p=0.254 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                344µs ± 6%               318µs ± 2%   -7.43%  (p=0.016 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                140µs ± 1%               142µs ± 3%     ~     (p=0.286 n=5+5)
      neo/py(!log)/sqlite-zhash.go+prefetch128                    119µs ± 2%               119µs ± 2%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zhash.py                                   386µs ± 1%               382µs ± 3%     ~     (p=0.686 n=4+4)
      neo/py(!log)/sql-zhash.go                                   183µs ± 3%               189µs ± 4%     ~     (p=0.222 n=5+5)
      neo/py(!log)/sql-zhash.go+prefetch128                       164µs ± 3%               164µs ± 2%     ~     (p=0.841 n=5+5)
      neo/go/fs1-zhash.py                                         226µs ± 3%               222µs ± 2%     ~     (p=0.167 n=5+5)
      neo/go/fs1-zhash.go                                        57.1µs ± 0%              56.7µs ± 0%   -0.84%  (p=0.008 n=5+5)
      neo/go/fs1-zhash.go+prefetch128                            24.7µs ± 5%              24.5µs ± 5%     ~     (p=0.643 n=5+5)
      neo/go/fs1(!sha1)-zhash.go(!sha1)                          40.2µs ± 1%              40.3µs ± 2%     ~     (p=0.849 n=5+5)
      neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1)              17.1µs ± 6%              17.3µs ± 7%     ~     (p=0.881 n=5+5)
      neo/go/sqlite-zhash.py                                      272µs ± 3%               254µs ± 2%   -6.63%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.go                                     92.8µs ± 0%              94.8µs ± 0%   +2.20%  (p=0.016 n=4+5)
      neo/go/sqlite-zhash.go+prefetch128                         40.5µs ± 5%              41.6µs ±13%     ~     (p=0.421 n=5+5)
      neo/go/sqlite-zhash.go(!sha1)                              86.5µs ± 2%              87.0µs ± 2%     ~     (p=0.175 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128(!sha1)                  38.8µs ± 9%              37.9µs ± 9%     ~     (p=0.421 n=5+5)
      cluster:deco dataset:prod1-1024
      fs1-zhash.py                                               15.8µs ± 3%              15.8µs ± 1%     ~     (p=0.619 n=4+5)
      fs1-zhash.go                                               2.80µs ± 0%              2.80µs ± 0%     ~     (all equal)
      fs1-zhash.go+prefetch128                                   3.42µs ± 8%              3.50µs ±17%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zhash.py                                         361µs ± 5%               355µs ± 4%     ~     (p=0.421 n=5+5)
      zeo/py/fs1-zhash.go                                         105µs ± 0%               105µs ± 1%     ~     (p=0.595 n=5+5)
      zeo/py/fs1-zhash.go+prefetch128                            58.9µs ± 1%              58.5µs ± 2%     ~     (p=0.302 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                344µs ± 7%               315µs ± 5%   -8.63%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                137µs ± 2%               135µs ± 1%     ~     (p=0.103 n=5+5)
      neo/py(!log)/sqlite-zhash.go+prefetch128                    114µs ± 1%               112µs ± 0%   -1.67%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zhash.py                                   380µs ± 4%               376µs ± 2%     ~     (p=0.886 n=4+4)
      neo/py(!log)/sql-zhash.go                                   180µs ± 1%               183µs ± 2%   +2.06%  (p=0.016 n=5+5)
      neo/py(!log)/sql-zhash.go+prefetch128                       159µs ± 1%               158µs ± 1%   -0.79%  (p=0.048 n=5+5)
      neo/go/fs1-zhash.py                                         221µs ± 1%               223µs ± 2%     ~     (p=0.524 n=5+5)
      neo/go/fs1-zhash.go                                        45.2µs ± 2%              44.3µs ± 1%   -1.99%  (p=0.008 n=5+5)
      neo/go/fs1-zhash.go+prefetch128                            17.6µs ± 2%              17.4µs ± 6%     ~     (p=0.246 n=5+5)
      neo/go/fs1(!sha1)-zhash.go(!sha1)                          39.1µs ± 2%              39.0µs ± 1%     ~     (p=0.643 n=5+5)
      neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1)              14.6µs ± 4%              14.5µs ± 3%     ~     (p=1.000 n=5+5)
      neo/go/sqlite-zhash.py                                      271µs ± 2%               252µs ± 1%   -7.10%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.go                                     86.4µs ± 0%              86.6µs ± 1%     ~     (p=0.444 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128                         35.8µs ± 2%              37.6µs ± 2%   +5.02%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.go(!sha1)                              84.0µs ± 1%              83.5µs ± 1%     ~     (p=0.230 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128(!sha1)                  36.5µs ± 5%              35.7µs ± 7%     ~     (p=0.381 n=5+5)
      
      name                                           old req/s                new req/s                delta
      cluster:deco dataset:wczblk1-8
      fs1-zwrk.go·1                                                436k ± 0%                437k ± 1%     ~     (p=0.222 n=5+5)
      fs1-zwrk.go·2                                                744k ± 1%                750k ± 3%     ~     (p=0.690 n=5+5)
      fs1-zwrk.go·3                                               1.09M ± 0%               1.08M ± 0%   -0.42%  (p=0.016 n=5+5)
      fs1-zwrk.go·4                                               1.16M ± 1%               1.16M ± 1%     ~     (p=0.841 n=5+5)
      fs1-zwrk.go·8                                               1.27M ± 1%               1.27M ± 1%     ~     (p=0.421 n=5+5)
      fs1-zwrk.go·12                                              1.27M ± 1%               1.28M ± 0%     ~     (p=0.190 n=5+4)
      fs1-zwrk.go·16                                              1.27M ± 1%               1.28M ± 1%     ~     (p=0.151 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        9.12k ± 0%               8.14k ± 0%  -10.75%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        11.6k ± 1%                9.5k ± 1%  -17.53%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        13.4k ± 1%               10.5k ± 1%  -21.27%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        14.0k ± 1%               10.9k ± 1%  -22.08%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        14.7k ± 1%               11.5k ± 1%  -21.84%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       15.0k ± 1%               11.6k ± 2%  -22.49%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·16                                       15.1k ± 0%               11.8k ± 1%  -22.02%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               7.09k ± 1%               7.08k ± 1%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               8.48k ± 1%               8.52k ± 0%     ~     (p=0.095 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               8.48k ± 1%               8.48k ± 1%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               8.47k ± 1%               8.45k ± 1%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               8.43k ± 1%               8.52k ± 1%     ~     (p=0.095 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                              8.46k ± 1%               8.57k ± 1%     ~     (p=0.056 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                              8.46k ± 1%               8.57k ± 0%   +1.32%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  5.51k ± 1%               5.36k ± 2%   -2.78%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  6.32k ± 1%               6.21k ± 1%   -1.66%  (p=0.016 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  6.29k ± 1%               6.24k ± 0%     ~     (p=0.190 n=5+4)
      neo/py(!log)/sql-zwrk.go·4                                  6.27k ± 1%               6.17k ± 2%   -1.63%  (p=0.032 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                  6.27k ± 1%               6.12k ± 0%   -2.39%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                 6.29k ± 0%               6.15k ± 1%   -2.22%  (p=0.016 n=5+4)
      neo/py(!log)/sql-zwrk.go·16                                 6.22k ± 1%               6.14k ± 3%     ~     (p=0.151 n=5+5)
      neo/go/fs1-zwrk.go·1                                        18.4k ± 1%               18.4k ± 0%     ~     (p=0.548 n=5+5)
      neo/go/fs1-zwrk.go·2                                        38.1k ± 1%               38.3k ± 0%     ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·3                                        46.0k ± 1%               46.1k ± 1%     ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·4                                        50.2k ± 1%               50.3k ± 1%     ~     (p=0.690 n=5+5)
      neo/go/fs1-zwrk.go·8                                        61.0k ± 0%               60.8k ± 1%     ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·12                                       62.1k ± 1%               62.5k ± 1%     ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·16                                       62.5k ± 1%               62.1k ± 2%     ~     (p=0.310 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                          26.3k ± 1%               26.3k ± 0%     ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                          55.3k ± 1%               55.1k ± 0%     ~     (p=0.421 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                          62.7k ± 1%               62.6k ± 1%     ~     (p=0.421 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                          69.3k ± 1%               69.0k ± 1%     ~     (p=0.310 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          88.2k ± 0%               87.7k ± 0%   -0.47%  (p=0.016 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         93.4k ± 0%               92.4k ± 1%   -1.02%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         93.5k ± 2%               93.5k ± 1%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     11.0k ± 1%               10.9k ± 0%   -1.25%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     18.4k ± 1%               18.2k ± 0%     ~     (p=0.056 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     24.4k ± 1%               24.2k ± 1%     ~     (p=0.095 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     26.8k ± 0%               26.8k ± 1%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     30.4k ± 2%               30.0k ± 2%     ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    30.5k ± 1%               29.5k ± 1%   -3.47%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    29.9k ± 2%               28.5k ± 1%   -4.81%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              11.9k ± 1%               11.9k ± 0%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              19.7k ± 0%               19.6k ± 1%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              26.5k ± 1%               26.7k ± 0%   +0.84%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              30.0k ± 0%               30.4k ± 1%   +1.43%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              31.2k ± 2%               32.1k ± 0%   +2.82%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             28.9k ± 1%               30.2k ± 2%   +4.46%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             28.4k ± 2%               29.7k ± 2%   +4.60%  (p=0.008 n=5+5)
      cluster:deco dataset:prod1-1024
      fs1-zwrk.go·1                                                555k ± 0%                558k ± 1%     ~     (p=0.222 n=5+5)
      fs1-zwrk.go·2                                               1.01M ± 3%               1.01M ± 8%     ~     (p=0.548 n=5+5)
      fs1-zwrk.go·3                                               1.32M ± 1%               1.33M ± 0%   +0.69%  (p=0.032 n=5+5)
      fs1-zwrk.go·4                                               1.55M ± 2%               1.54M ± 3%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·8                                               1.59M ± 0%               1.59M ± 0%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·12                                              1.59M ± 0%               1.59M ± 0%     ~     (p=0.095 n=5+5)
      fs1-zwrk.go·16                                              1.59M ± 0%               1.59M ± 0%     ~     (p=0.690 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        9.70k ± 0%               9.66k ± 0%     ~     (p=0.095 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        12.4k ± 1%               12.3k ± 1%     ~     (p=0.548 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        14.2k ± 1%               14.2k ± 1%     ~     (p=0.310 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        14.9k ± 0%               14.9k ± 1%     ~     (p=0.421 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        15.6k ± 0%               15.7k ± 1%     ~     (p=0.151 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       15.2k ±11%               16.0k ± 1%   +5.04%  (p=0.032 n=5+4)
      zeo/py/fs1-zwrk.go·16                                       16.1k ± 1%               16.1k ± 1%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               7.44k ± 1%               7.46k ± 1%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               8.59k ± 1%               8.67k ± 1%   +0.91%  (p=0.016 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               8.61k ± 1%               8.71k ± 1%   +1.16%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               8.57k ± 1%               8.68k ± 0%   +1.33%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               8.56k ± 1%               8.73k ± 1%   +2.01%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                              8.51k ± 1%               8.66k ± 1%   +1.69%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                              8.54k ± 1%               8.62k ± 1%     ~     (p=0.222 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  5.55k ± 2%               5.47k ± 2%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  6.36k ± 1%               6.37k ± 0%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  6.31k ± 0%               6.30k ± 1%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  6.28k ± 0%               6.33k ± 0%   +0.78%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                  6.34k ± 1%               6.36k ± 1%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                 6.35k ± 1%               6.36k ± 1%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                 6.36k ± 0%               6.35k ± 0%     ~     (p=0.690 n=5+5)
      neo/go/fs1-zwrk.go·1                                        23.7k ± 0%               24.0k ± 0%   +1.23%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·2                                        45.4k ± 0%               45.6k ± 1%     ~     (p=0.056 n=5+5)
      neo/go/fs1-zwrk.go·3                                        55.2k ± 1%               55.5k ± 1%     ~     (p=0.056 n=5+5)
      neo/go/fs1-zwrk.go·4                                        60.7k ± 2%               60.7k ± 0%     ~     (p=1.000 n=5+5)
      neo/go/fs1-zwrk.go·8                                        70.9k ± 2%               69.3k ± 3%     ~     (p=0.095 n=5+5)
      neo/go/fs1-zwrk.go·12                                       71.1k ± 3%               69.5k ± 7%     ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·16                                       71.0k ± 3%               67.8k ± 2%   -4.43%  (p=0.016 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                          27.3k ± 0%               27.1k ± 0%   -0.92%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                          55.4k ± 1%               55.4k ± 1%     ~     (p=0.841 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                          64.0k ± 1%               62.9k ± 1%   -1.62%  (p=0.016 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                          69.0k ± 1%               68.4k ± 1%   -0.87%  (p=0.032 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          80.9k ± 2%               79.9k ± 3%     ~     (p=0.310 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         78.3k ± 5%               77.6k ± 4%     ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         75.4k ± 3%               77.7k ± 7%     ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     11.7k ± 1%               11.7k ± 0%     ~     (p=0.310 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     19.0k ± 0%               19.1k ± 0%     ~     (p=0.056 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     24.5k ± 1%               24.3k ± 1%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     26.3k ± 1%               26.3k ± 1%     ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     24.9k ± 3%               24.8k ± 3%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    24.0k ± 5%               23.6k ± 2%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    25.4k ± 1%               24.3k ± 1%   -4.16%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              12.2k ± 0%               12.2k ± 0%     ~     (p=0.095 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              19.8k ± 0%               19.6k ± 0%   -0.97%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              26.2k ± 1%               26.2k ± 2%     ~     (p=0.222 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              28.7k ± 1%               29.1k ± 1%   +1.21%  (p=0.032 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              27.2k ± 3%               27.3k ± 2%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             25.3k ± 2%               25.5k ± 1%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             25.3k ± 1%               25.5k ± 1%     ~     (p=0.095 n=5+5)
      
      name                                           old latency-time/object  new latency-time/object  delta
      cluster:deco dataset:wczblk1-8
      fs1-zwrk.go·1                                              2.29µs ± 0%              2.29µs ± 1%     ~     (p=0.198 n=5+5)
      fs1-zwrk.go·2                                              2.69µs ± 1%              2.67µs ± 3%     ~     (p=0.738 n=5+5)
      fs1-zwrk.go·3                                              2.76µs ± 0%              2.77µs ± 0%   +0.42%  (p=0.016 n=5+5)
      fs1-zwrk.go·4                                              3.44µs ± 1%              3.44µs ± 1%     ~     (p=0.730 n=5+5)
      fs1-zwrk.go·8                                              6.28µs ± 1%              6.29µs ± 1%     ~     (p=0.421 n=5+5)
      fs1-zwrk.go·12                                             9.46µs ± 1%              9.35µs ± 0%     ~     (p=0.159 n=5+4)
      fs1-zwrk.go·16                                             12.6µs ± 1%              12.5µs ± 1%     ~     (p=0.151 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        110µs ± 0%               123µs ± 0%  +12.04%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        173µs ± 1%               210µs ± 1%  +21.26%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        224µs ± 1%               285µs ± 1%  +27.02%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        286µs ± 1%               366µs ± 1%  +28.34%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        545µs ± 1%               698µs ± 1%  +27.94%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       802µs ± 1%              1034µs ± 2%  +29.03%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·16                                      1.06ms ± 0%              1.36ms ± 1%  +28.25%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               141µs ± 1%               141µs ± 1%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               236µs ± 1%               235µs ± 0%     ~     (p=0.095 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               354µs ± 1%               354µs ± 1%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               472µs ± 1%               474µs ± 1%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               949µs ± 1%               939µs ± 1%     ~     (p=0.095 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                             1.42ms ± 1%              1.40ms ± 1%     ~     (p=0.056 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                             1.89ms ± 1%              1.87ms ± 0%   -1.30%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  181µs ± 1%               187µs ± 2%   +2.87%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  317µs ± 1%               322µs ± 1%   +1.68%  (p=0.016 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  477µs ± 1%               481µs ± 0%     ~     (p=0.190 n=5+4)
      neo/py(!log)/sql-zwrk.go·4                                  638µs ± 1%               648µs ± 2%   +1.66%  (p=0.032 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                 1.28ms ± 1%              1.31ms ± 0%   +2.44%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                1.91ms ± 0%              1.95ms ± 1%   +2.28%  (p=0.016 n=5+4)
      neo/py(!log)/sql-zwrk.go·16                                2.57ms ± 1%              2.61ms ± 3%     ~     (p=0.151 n=5+5)
      neo/go/fs1-zwrk.go·1                                       54.2µs ± 1%              54.2µs ± 0%     ~     (p=0.548 n=5+5)
      neo/go/fs1-zwrk.go·2                                       52.5µs ± 1%              52.2µs ± 0%     ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·3                                       65.3µs ± 1%              65.1µs ± 1%     ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·4                                       79.6µs ± 1%              79.5µs ± 1%     ~     (p=0.690 n=5+5)
      neo/go/fs1-zwrk.go·8                                        131µs ± 0%               132µs ± 1%     ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·12                                       193µs ± 1%               192µs ± 1%     ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·16                                       256µs ± 1%               258µs ± 2%     ~     (p=0.310 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                         38.0µs ± 1%              38.0µs ± 0%     ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                         36.1µs ± 1%              36.3µs ± 0%     ~     (p=0.421 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                         47.8µs ± 1%              47.9µs ± 1%     ~     (p=0.421 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                         57.7µs ± 1%              58.0µs ± 1%     ~     (p=0.310 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                         90.7µs ± 0%              91.2µs ± 0%   +0.47%  (p=0.016 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         129µs ± 0%               130µs ± 1%   +1.04%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         171µs ± 2%               171µs ± 1%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go·1                                    90.7µs ± 1%              91.8µs ± 0%   +1.26%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     109µs ± 1%               110µs ± 0%     ~     (p=0.056 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     123µs ± 1%               124µs ± 1%     ~     (p=0.095 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     149µs ± 0%               149µs ± 1%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     263µs ± 2%               267µs ± 2%     ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    393µs ± 1%               407µs ± 1%   +3.60%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    534µs ± 2%               561µs ± 1%   +5.04%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                             84.0µs ± 1%              84.1µs ± 0%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              102µs ± 0%               102µs ± 1%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              113µs ± 1%               112µs ± 0%   -0.83%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              133µs ± 0%               132µs ± 1%   -1.41%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              257µs ± 2%               250µs ± 0%   -2.76%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             415µs ± 1%               397µs ± 2%   -4.26%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             563µs ± 2%               538µs ± 2%   -4.40%  (p=0.008 n=5+5)
      cluster:deco dataset:prod1-1024
      fs1-zwrk.go·1                                              1.80µs ± 0%              1.79µs ± 1%     ~     (p=0.222 n=5+5)
      fs1-zwrk.go·2                                              1.98µs ± 3%              1.98µs ± 8%     ~     (p=0.548 n=5+5)
      fs1-zwrk.go·3                                              2.27µs ± 1%              2.25µs ± 0%   -0.68%  (p=0.032 n=5+5)
      fs1-zwrk.go·4                                              2.58µs ± 2%              2.59µs ± 3%     ~     (p=0.952 n=5+5)
      fs1-zwrk.go·8                                              5.04µs ± 0%              5.04µs ± 0%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·12                                             7.55µs ± 0%              7.53µs ± 0%     ~     (p=0.095 n=5+5)
      fs1-zwrk.go·16                                             10.0µs ± 0%              10.0µs ± 0%     ~     (p=0.690 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        103µs ± 0%               104µs ± 0%     ~     (p=0.095 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        162µs ± 1%               162µs ± 1%     ~     (p=0.548 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        212µs ± 1%               211µs ± 1%     ~     (p=0.310 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        269µs ± 0%               268µs ± 1%     ~     (p=0.421 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        512µs ± 0%               510µs ± 1%     ~     (p=0.151 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       793µs ±12%               752µs ± 1%   -5.18%  (p=0.032 n=5+4)
      zeo/py/fs1-zwrk.go·16                                       991µs ± 1%               992µs ± 1%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               134µs ± 1%               134µs ± 1%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               233µs ± 1%               231µs ± 1%   -0.91%  (p=0.016 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               348µs ± 1%               344µs ± 1%   -1.15%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               467µs ± 1%               461µs ± 0%   -1.32%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               935µs ± 1%               916µs ± 1%   -1.97%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                             1.41ms ± 1%              1.39ms ± 1%   -1.66%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                             1.87ms ± 1%              1.86ms ± 1%     ~     (p=0.222 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  180µs ± 2%               183µs ± 2%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  315µs ± 1%               314µs ± 0%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  475µs ± 0%               476µs ± 1%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  637µs ± 0%               632µs ± 0%   -0.78%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                 1.26ms ± 1%              1.26ms ± 1%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                1.89ms ± 1%              1.89ms ± 1%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                2.52ms ± 0%              2.52ms ± 0%     ~     (p=0.690 n=5+5)
      neo/go/fs1-zwrk.go·1                                       42.2µs ± 0%              41.7µs ± 0%   -1.21%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·2                                       44.1µs ± 0%              43.8µs ± 1%     ~     (p=0.056 n=5+5)
      neo/go/fs1-zwrk.go·3                                       54.4µs ± 1%              54.1µs ± 1%     ~     (p=0.056 n=5+5)
      neo/go/fs1-zwrk.go·4                                       65.9µs ± 2%              65.9µs ± 0%     ~     (p=1.000 n=5+5)
      neo/go/fs1-zwrk.go·8                                        113µs ± 2%               115µs ± 3%     ~     (p=0.095 n=5+5)
      neo/go/fs1-zwrk.go·12                                       169µs ± 4%               173µs ± 7%     ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·16                                       225µs ± 3%               236µs ± 2%   +4.62%  (p=0.016 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                         36.6µs ± 0%              36.9µs ± 0%   +0.93%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                         36.1µs ± 1%              36.1µs ± 1%     ~     (p=0.841 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                         46.9µs ± 1%              47.7µs ± 1%   +1.64%  (p=0.016 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                         57.9µs ± 1%              58.4µs ± 1%   +0.88%  (p=0.032 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                         98.9µs ± 2%             100.2µs ± 3%     ~     (p=0.310 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         153µs ± 5%               155µs ± 4%     ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         212µs ± 3%               206µs ± 7%     ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go·1                                    85.1µs ± 1%              85.3µs ± 0%     ~     (p=0.310 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     105µs ± 0%               105µs ± 0%     ~     (p=0.056 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     123µs ± 1%               123µs ± 1%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     152µs ± 1%               152µs ± 1%     ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     321µs ± 3%               323µs ± 3%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    500µs ± 5%               508µs ± 2%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    630µs ± 1%               657µs ± 1%   +4.34%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                             82.0µs ± 0%              82.3µs ± 0%     ~     (p=0.095 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              101µs ± 0%               102µs ± 0%   +0.98%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              115µs ± 1%               115µs ± 3%     ~     (p=0.222 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              139µs ± 1%               138µs ± 1%   -1.19%  (p=0.032 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              295µs ± 3%               293µs ± 2%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             474µs ± 2%               470µs ± 1%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             632µs ± 1%               627µs ± 1%     ~     (p=0.095 n=5+5)
      
      ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
      
      $ benchstat -split node,cluster,dataset "20180306-deco-ffixed-noc_C1(2µs).txt" "20180306-deco-ffixed-noc_C1(2µs).txt.2"
      
      name                                           old pystone/s            new pystone/s            delta
      node:deco
      pystone                                                      218k ± 2%                217k ± 2%    ~     (p=1.000 n=5+5)
      
      name                                           old time/op              new time/op              delta
      node:deco
      crc32/py/4K                                                5.72µs ± 0%              5.73µs ± 0%    ~     (p=0.151 n=5+5)
      crc32/go/4K                                                 280ns ± 1%               279ns ± 0%    ~     (p=0.333 n=5+4)
      sha1/py/4K                                                 6.72µs ± 1%              6.71µs ± 1%    ~     (p=1.000 n=5+5)
      sha1/go/4K                                                 5.59µs ± 0%              5.59µs ± 0%    ~     (p=1.000 n=4+5)
      unzlib/py/wczdata                                          27.2µs ± 1%              27.1µs ± 1%    ~     (p=0.421 n=5+5)
      unzlib/go/wczdata                                          26.8µs ± 0%              26.8µs ± 0%    ~     (p=0.548 n=5+5)
      unzlib/py/prod1-avg                                        5.08µs ± 1%              5.13µs ± 1%    ~     (p=0.095 n=5+5)
      unzlib/go/prod1-avg                                        5.29µs ± 1%              5.28µs ± 0%    ~     (p=0.333 n=5+5)
      disk/randread/direct/4K-min                                 105µs ± 0%               105µs ± 0%    ~     (p=0.111 n=5+4)
      disk/randread/direct/4K-avg                                 142µs ± 0%               142µs ± 0%  +0.35%  (p=0.040 n=5+5)
      disk/randread/pagecache/4K-min                              582ns ± 0%               584ns ± 2%    ~     (p=0.286 n=5+5)
      disk/randread/pagecache/4K-avg                              987ns ± 0%               986ns ± 0%    ~     (p=0.460 n=5+5)
      
      name                                           old time/object          new time/object          delta
      cluster:deco dataset:wczblk1-8
      fs1-zhash.py                                               20.2µs ± 1%              20.3µs ± 2%    ~     (p=1.000 n=5+5)
      fs1-zhash.go                                               3.20µs ± 0%              3.20µs ± 0%    ~     (all equal)
      fs1-zhash.go+prefetch128                                   4.14µs ± 1%              4.00µs ± 7%    ~     (p=0.159 n=5+5)
      zeo/py/fs1-zhash.py                                         361µs ± 3%               364µs ± 5%    ~     (p=0.841 n=5+5)
      zeo/py/fs1-zhash.go                                         112µs ± 1%               113µs ± 1%  +0.93%  (p=0.024 n=5+5)
      zeo/py/fs1-zhash.go+prefetch128                            63.9µs ± 1%              64.0µs ± 2%    ~     (p=0.952 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                321µs ± 8%               318µs ± 2%    ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                141µs ± 3%               142µs ± 3%    ~     (p=0.595 n=5+5)
      neo/py(!log)/sqlite-zhash.go+prefetch128                    119µs ± 1%               119µs ± 2%    ~     (p=0.794 n=5+5)
      neo/py(!log)/sql-zhash.py                                   376µs ± 2%               382µs ± 3%    ~     (p=0.486 n=4+4)
      neo/py(!log)/sql-zhash.go                                   187µs ± 5%               189µs ± 4%    ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zhash.go+prefetch128                       164µs ± 2%               164µs ± 2%    ~     (p=0.841 n=5+5)
      neo/go/fs1-zhash.py                                         226µs ± 2%               222µs ± 2%    ~     (p=0.222 n=5+5)
      neo/go/fs1-zhash.go                                        57.1µs ± 1%              56.7µs ± 0%  -0.81%  (p=0.016 n=5+5)
      neo/go/fs1-zhash.go+prefetch128                            24.0µs ± 4%              24.5µs ± 5%    ~     (p=0.460 n=5+5)
      neo/go/fs1(!sha1)-zhash.go(!sha1)                          40.3µs ± 1%              40.3µs ± 2%    ~     (p=0.833 n=5+5)
      neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1)              17.2µs ± 4%              17.3µs ± 7%    ~     (p=0.730 n=5+5)
      neo/go/sqlite-zhash.py                                      253µs ± 1%               254µs ± 2%    ~     (p=0.952 n=5+5)
      neo/go/sqlite-zhash.go                                     93.7µs ± 1%              94.8µs ± 0%  +1.20%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128                         39.5µs ± 6%              41.6µs ±13%    ~     (p=0.310 n=5+5)
      neo/go/sqlite-zhash.go(!sha1)                              86.4µs ± 3%              87.0µs ± 2%    ~     (p=0.079 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128(!sha1)                  39.4µs ± 7%              37.9µs ± 9%    ~     (p=0.690 n=5+5)
      cluster:deco dataset:prod1-1024
      fs1-zhash.py                                               15.9µs ± 2%              15.8µs ± 1%    ~     (p=0.571 n=5+5)
      fs1-zhash.go                                               2.80µs ± 0%              2.80µs ± 0%    ~     (all equal)
      fs1-zhash.go+prefetch128                                   3.34µs ± 2%              3.50µs ±17%    ~     (p=0.683 n=5+5)
      zeo/py/fs1-zhash.py                                         347µs ± 3%               355µs ± 4%    ~     (p=0.222 n=5+5)
      zeo/py/fs1-zhash.go                                         105µs ± 0%               105µs ± 1%  +0.52%  (p=0.040 n=5+5)
      zeo/py/fs1-zhash.go+prefetch128                            58.9µs ± 1%              58.5µs ± 2%    ~     (p=0.198 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                317µs ± 5%               315µs ± 5%    ~     (p=0.841 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                138µs ± 1%               135µs ± 1%  -1.86%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zhash.go+prefetch128                    112µs ± 1%               112µs ± 0%    ~     (p=0.508 n=5+5)
      neo/py(!log)/sql-zhash.py                                   377µs ± 2%               376µs ± 2%    ~     (p=0.686 n=4+4)
      neo/py(!log)/sql-zhash.go                                   184µs ± 2%               183µs ± 2%    ~     (p=0.690 n=5+5)
      neo/py(!log)/sql-zhash.go+prefetch128                       160µs ± 2%               158µs ± 1%  -1.18%  (p=0.024 n=5+5)
      neo/go/fs1-zhash.py                                         225µs ± 1%               223µs ± 2%    ~     (p=0.278 n=5+5)
      neo/go/fs1-zhash.go                                        44.6µs ± 0%              44.3µs ± 1%  -0.63%  (p=0.048 n=5+5)
      neo/go/fs1-zhash.go+prefetch128                            17.2µs ± 3%              17.4µs ± 6%    ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zhash.go(!sha1)                          39.1µs ± 3%              39.0µs ± 1%    ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1)              15.2µs ± 3%              14.5µs ± 3%  -4.47%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.py                                      254µs ± 1%               252µs ± 1%    ~     (p=0.111 n=5+5)
      neo/go/sqlite-zhash.go                                     86.3µs ± 0%              86.6µs ± 1%  +0.42%  (p=0.040 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128                         36.6µs ± 5%              37.6µs ± 2%    ~     (p=0.310 n=5+5)
      neo/go/sqlite-zhash.go(!sha1)                              83.8µs ± 2%              83.5µs ± 1%    ~     (p=0.548 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128(!sha1)                  36.9µs ± 8%              35.7µs ± 7%    ~     (p=0.310 n=5+5)
      
      name                                           old req/s                new req/s                delta
      cluster:deco dataset:wczblk1-8
      fs1-zwrk.go·1                                                431k ± 1%                437k ± 1%  +1.51%  (p=0.008 n=5+5)
      fs1-zwrk.go·2                                                760k ± 3%                750k ± 3%    ~     (p=0.310 n=5+5)
      fs1-zwrk.go·3                                               1.08M ± 2%               1.08M ± 0%    ~     (p=0.841 n=5+5)
      fs1-zwrk.go·4                                               1.16M ± 1%               1.16M ± 1%    ~     (p=1.000 n=5+5)
      fs1-zwrk.go·8                                               1.27M ± 1%               1.27M ± 1%    ~     (p=0.548 n=5+5)
      fs1-zwrk.go·12                                              1.28M ± 1%               1.28M ± 0%    ~     (p=0.190 n=5+4)
      fs1-zwrk.go·16                                              1.28M ± 1%               1.28M ± 1%    ~     (p=0.841 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        8.04k ± 4%               8.14k ± 0%    ~     (p=0.690 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        9.54k ± 1%               9.54k ± 1%    ~     (p=0.841 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        10.5k ± 0%               10.5k ± 1%    ~     (p=0.548 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        11.0k ± 1%               10.9k ± 1%    ~     (p=0.222 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        11.4k ± 1%               11.5k ± 1%    ~     (p=0.548 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       11.7k ± 0%               11.6k ± 2%    ~     (p=0.310 n=5+5)
      zeo/py/fs1-zwrk.go·16                                       11.8k ± 2%               11.8k ± 1%    ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               7.04k ± 1%               7.08k ± 1%    ~     (p=0.222 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               8.52k ± 1%               8.52k ± 0%    ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               8.51k ± 1%               8.48k ± 1%    ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               8.50k ± 1%               8.45k ± 1%    ~     (p=0.310 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               8.53k ± 1%               8.52k ± 1%    ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                              8.48k ± 2%               8.57k ± 1%    ~     (p=0.151 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                              8.48k ± 1%               8.57k ± 0%  +1.08%  (p=0.016 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  5.37k ± 3%               5.36k ± 2%    ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  6.34k ± 0%               6.21k ± 1%  -2.02%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  6.28k ± 1%               6.24k ± 0%    ~     (p=0.190 n=5+4)
      neo/py(!log)/sql-zwrk.go·4                                  6.29k ± 1%               6.17k ± 2%  -1.87%  (p=0.016 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                  6.29k ± 1%               6.12k ± 0%  -2.68%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                 6.25k ± 1%               6.15k ± 1%  -1.54%  (p=0.016 n=5+4)
      neo/py(!log)/sql-zwrk.go·16                                 6.23k ± 2%               6.14k ± 3%    ~     (p=0.222 n=5+5)
      neo/go/fs1-zwrk.go·1                                        18.4k ± 0%               18.4k ± 0%    ~     (p=0.095 n=5+5)
      neo/go/fs1-zwrk.go·2                                        38.3k ± 1%               38.3k ± 0%    ~     (p=1.000 n=5+5)
      neo/go/fs1-zwrk.go·3                                        45.9k ± 0%               46.1k ± 1%    ~     (p=0.151 n=5+5)
      neo/go/fs1-zwrk.go·4                                        50.0k ± 0%               50.3k ± 1%    ~     (p=0.056 n=5+5)
      neo/go/fs1-zwrk.go·8                                        60.3k ± 1%               60.8k ± 1%    ~     (p=0.151 n=5+5)
      neo/go/fs1-zwrk.go·12                                       62.1k ± 1%               62.5k ± 1%  +0.67%  (p=0.032 n=5+5)
      neo/go/fs1-zwrk.go·16                                       61.6k ± 1%               62.1k ± 2%    ~     (p=0.151 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                          26.3k ± 0%               26.3k ± 0%    ~     (p=0.690 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                          55.7k ± 1%               55.1k ± 0%  -1.12%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                          62.8k ± 1%               62.6k ± 1%    ~     (p=0.222 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                          69.4k ± 1%               69.0k ± 1%    ~     (p=0.056 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          88.3k ± 1%               87.7k ± 0%    ~     (p=0.095 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         93.5k ± 1%               92.4k ± 1%  -1.17%  (p=0.032 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         93.8k ± 0%               93.5k ± 1%    ~     (p=0.056 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     11.0k ± 0%               10.9k ± 0%  -0.70%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     18.3k ± 1%               18.2k ± 0%    ~     (p=0.111 n=4+5)
      neo/go/sqlite-zwrk.go·3                                     24.2k ± 0%               24.2k ± 1%    ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     26.8k ± 1%               26.8k ± 1%    ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     29.6k ± 2%               30.0k ± 2%    ~     (p=0.222 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    29.3k ± 2%               29.5k ± 1%    ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    28.6k ± 1%               28.5k ± 1%    ~     (p=0.222 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              11.9k ± 1%               11.9k ± 0%    ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              19.6k ± 1%               19.6k ± 1%    ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              26.4k ± 0%               26.7k ± 0%  +1.08%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              30.0k ± 0%               30.4k ± 1%  +1.43%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              31.2k ± 2%               32.1k ± 0%  +2.86%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             28.8k ± 3%               30.2k ± 2%  +4.93%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             28.4k ± 1%               29.7k ± 2%  +4.69%  (p=0.008 n=5+5)
      cluster:deco dataset:prod1-1024
      fs1-zwrk.go·1                                                556k ± 0%                558k ± 1%    ~     (p=0.690 n=5+5)
      fs1-zwrk.go·2                                                994k ± 6%               1011k ± 8%    ~     (p=0.310 n=5+5)
      fs1-zwrk.go·3                                               1.33M ± 2%               1.33M ± 0%    ~     (p=0.690 n=5+5)
      fs1-zwrk.go·4                                               1.53M ± 0%               1.54M ± 3%    ~     (p=0.222 n=5+5)
      fs1-zwrk.go·8                                               1.59M ± 1%               1.59M ± 0%    ~     (p=0.548 n=5+5)
      fs1-zwrk.go·12                                              1.60M ± 1%               1.59M ± 0%    ~     (p=1.000 n=5+5)
      fs1-zwrk.go·16                                              1.59M ± 0%               1.59M ± 0%    ~     (p=0.841 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        9.75k ± 1%               9.66k ± 0%  -0.94%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        12.4k ± 1%               12.3k ± 1%    ~     (p=0.310 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        14.2k ± 1%               14.2k ± 1%    ~     (p=0.222 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        14.9k ± 1%               14.9k ± 1%    ~     (p=1.000 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        15.6k ± 1%               15.7k ± 1%    ~     (p=0.548 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       16.0k ± 1%               16.0k ± 1%    ~     (p=1.000 n=5+4)
      zeo/py/fs1-zwrk.go·16                                       16.0k ± 6%               16.1k ± 1%    ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               7.45k ± 2%               7.46k ± 1%    ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               8.71k ± 1%               8.67k ± 1%    ~     (p=0.310 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               8.69k ± 1%               8.71k ± 1%    ~     (p=0.802 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               8.61k ± 1%               8.68k ± 0%  +0.88%  (p=0.016 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               8.61k ± 1%               8.73k ± 1%  +1.42%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                              8.59k ± 1%               8.66k ± 1%    ~     (p=0.222 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                              8.60k ± 1%               8.62k ± 1%    ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  5.45k ± 2%               5.47k ± 2%    ~     (p=0.690 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  6.25k ± 1%               6.37k ± 0%  +1.89%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  6.24k ± 1%               6.30k ± 1%  +0.96%  (p=0.032 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  6.27k ± 1%               6.33k ± 0%  +0.97%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                  6.28k ± 1%               6.36k ± 1%    ~     (p=0.056 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                 6.33k ± 0%               6.36k ± 1%    ~     (p=0.222 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                 6.30k ± 1%               6.35k ± 0%  +0.81%  (p=0.016 n=5+5)
      neo/go/fs1-zwrk.go·1                                        23.9k ± 0%               24.0k ± 0%  +0.52%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·2                                        45.5k ± 1%               45.6k ± 1%    ~     (p=0.222 n=5+5)
      neo/go/fs1-zwrk.go·3                                        55.1k ± 0%               55.5k ± 1%  +0.75%  (p=0.016 n=5+5)
      neo/go/fs1-zwrk.go·4                                        60.4k ± 0%               60.7k ± 0%    ~     (p=0.056 n=5+5)
      neo/go/fs1-zwrk.go·8                                        69.2k ± 2%               69.3k ± 3%    ~     (p=0.548 n=5+5)
      neo/go/fs1-zwrk.go·12                                       68.0k ± 5%               69.5k ± 7%    ~     (p=0.548 n=5+5)
      neo/go/fs1-zwrk.go·16                                       68.1k ± 3%               67.8k ± 2%    ~     (p=0.841 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                          27.2k ± 1%               27.1k ± 0%    ~     (p=0.690 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                          55.5k ± 1%               55.4k ± 1%    ~     (p=0.841 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                          64.0k ± 1%               62.9k ± 1%  -1.69%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                          69.1k ± 1%               68.4k ± 1%    ~     (p=0.056 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          81.1k ± 4%               79.9k ± 3%    ~     (p=0.151 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         77.8k ± 8%               77.6k ± 4%    ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         76.8k ± 5%               77.7k ± 7%    ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     11.7k ± 1%               11.7k ± 0%    ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     18.9k ± 1%               19.1k ± 0%    ~     (p=0.056 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     24.4k ± 2%               24.3k ± 1%    ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     26.0k ± 3%               26.3k ± 1%    ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     24.6k ± 5%               24.8k ± 3%    ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    23.7k ± 3%               23.6k ± 2%    ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    24.1k ± 3%               24.3k ± 1%    ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              12.2k ± 1%               12.2k ± 0%    ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              19.6k ± 1%               19.6k ± 0%    ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              25.5k ± 1%               26.2k ± 2%  +2.75%  (p=0.032 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              27.5k ± 2%               29.1k ± 1%  +5.64%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              25.6k ± 2%               27.3k ± 2%  +6.33%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             24.0k ± 2%               25.5k ± 1%  +6.19%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             24.2k ± 1%               25.5k ± 1%  +5.65%  (p=0.008 n=5+5)
      
      name                                           old latency-time/object  new latency-time/object  delta
      cluster:deco dataset:wczblk1-8
      fs1-zwrk.go·1                                              2.32µs ± 1%              2.29µs ± 1%  -1.48%  (p=0.016 n=5+5)
      fs1-zwrk.go·2                                              2.63µs ± 3%              2.67µs ± 3%    ~     (p=0.310 n=5+5)
      fs1-zwrk.go·3                                              2.78µs ± 2%              2.77µs ± 0%    ~     (p=0.841 n=5+5)
      fs1-zwrk.go·4                                              3.44µs ± 1%              3.44µs ± 1%    ~     (p=1.000 n=5+5)
      fs1-zwrk.go·8                                              6.28µs ± 1%              6.29µs ± 1%    ~     (p=0.548 n=5+5)
      fs1-zwrk.go·12                                             9.40µs ± 1%              9.35µs ± 0%    ~     (p=0.159 n=5+4)
      fs1-zwrk.go·16                                             12.5µs ± 1%              12.5µs ± 1%    ~     (p=0.841 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        125µs ± 4%               123µs ± 0%    ~     (p=0.690 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        210µs ± 1%               210µs ± 1%    ~     (p=0.841 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        286µs ± 0%               285µs ± 1%    ~     (p=0.548 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        365µs ± 1%               366µs ± 1%    ~     (p=0.222 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        699µs ± 1%               698µs ± 1%    ~     (p=0.548 n=5+5)
      zeo/py/fs1-zwrk.go·12                                      1.03ms ± 0%              1.03ms ± 2%    ~     (p=0.310 n=5+5)
      zeo/py/fs1-zwrk.go·16                                      1.36ms ± 2%              1.36ms ± 1%    ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               142µs ± 1%               141µs ± 1%    ~     (p=0.222 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               235µs ± 1%               235µs ± 0%    ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               353µs ± 1%               354µs ± 1%    ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               470µs ± 1%               474µs ± 1%    ~     (p=0.310 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               938µs ± 1%               939µs ± 1%    ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                             1.41ms ± 2%              1.40ms ± 1%    ~     (p=0.151 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                             1.89ms ± 1%              1.87ms ± 0%  -1.07%  (p=0.016 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  186µs ± 3%               187µs ± 2%    ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  315µs ± 0%               322µs ± 1%  +2.07%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  478µs ± 1%               481µs ± 0%    ~     (p=0.190 n=5+4)
      neo/py(!log)/sql-zwrk.go·4                                  636µs ± 1%               648µs ± 2%  +1.91%  (p=0.016 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                 1.27ms ± 1%              1.31ms ± 0%  +2.75%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                1.92ms ± 1%              1.95ms ± 1%  +1.57%  (p=0.016 n=5+4)
      neo/py(!log)/sql-zwrk.go·16                                2.57ms ± 2%              2.61ms ± 3%    ~     (p=0.222 n=5+5)
      neo/go/fs1-zwrk.go·1                                       54.4µs ± 0%              54.2µs ± 0%    ~     (p=0.095 n=5+5)
      neo/go/fs1-zwrk.go·2                                       52.2µs ± 1%              52.2µs ± 0%    ~     (p=1.000 n=5+5)
      neo/go/fs1-zwrk.go·3                                       65.3µs ± 0%              65.1µs ± 1%    ~     (p=0.151 n=5+5)
      neo/go/fs1-zwrk.go·4                                       80.0µs ± 0%              79.5µs ± 1%    ~     (p=0.056 n=5+5)
      neo/go/fs1-zwrk.go·8                                        133µs ± 1%               132µs ± 1%    ~     (p=0.151 n=5+5)
      neo/go/fs1-zwrk.go·12                                       193µs ± 1%               192µs ± 1%  -0.67%  (p=0.032 n=5+5)
      neo/go/fs1-zwrk.go·16                                       260µs ± 1%               258µs ± 2%    ~     (p=0.151 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                         38.0µs ± 0%              38.0µs ± 0%    ~     (p=0.690 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                         35.9µs ± 1%              36.3µs ± 0%  +1.13%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                         47.7µs ± 1%              47.9µs ± 1%    ~     (p=0.222 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                         57.7µs ± 1%              58.0µs ± 1%    ~     (p=0.056 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                         90.6µs ± 1%              91.2µs ± 0%    ~     (p=0.095 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         128µs ± 1%               130µs ± 1%  +1.18%  (p=0.032 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         171µs ± 0%               171µs ± 1%    ~     (p=0.056 n=5+5)
      neo/go/sqlite-zwrk.go·1                                    91.2µs ± 0%              91.8µs ± 0%  +0.71%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     109µs ± 1%               110µs ± 0%    ~     (p=0.111 n=4+5)
      neo/go/sqlite-zwrk.go·3                                     124µs ± 0%               124µs ± 1%    ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     149µs ± 1%               149µs ± 1%    ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     270µs ± 2%               267µs ± 2%    ~     (p=0.222 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    410µs ± 2%               407µs ± 1%    ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    560µs ± 1%               561µs ± 1%    ~     (p=0.222 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                             84.0µs ± 1%              84.1µs ± 0%    ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              102µs ± 1%               102µs ± 1%    ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              113µs ± 0%               112µs ± 0%  -1.07%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              133µs ± 0%               132µs ± 1%  -1.41%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              257µs ± 2%               250µs ± 0%  -2.80%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             417µs ± 3%               397µs ± 2%  -4.72%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             563µs ± 1%               538µs ± 2%  -4.47%  (p=0.008 n=5+5)
      cluster:deco dataset:prod1-1024
      fs1-zwrk.go·1                                              1.80µs ± 0%              1.79µs ± 1%    ~     (p=0.524 n=5+5)
      fs1-zwrk.go·2                                              2.01µs ± 6%              1.98µs ± 8%    ~     (p=0.310 n=5+5)
      fs1-zwrk.go·3                                              2.26µs ± 2%              2.25µs ± 0%    ~     (p=0.690 n=5+5)
      fs1-zwrk.go·4                                              2.61µs ± 0%              2.59µs ± 3%    ~     (p=0.198 n=5+5)
      fs1-zwrk.go·8                                              5.04µs ± 1%              5.04µs ± 0%    ~     (p=0.548 n=5+5)
      fs1-zwrk.go·12                                             7.52µs ± 1%              7.53µs ± 0%    ~     (p=1.000 n=5+5)
      fs1-zwrk.go·16                                             10.0µs ± 0%              10.0µs ± 0%    ~     (p=0.841 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        103µs ± 1%               104µs ± 0%  +0.95%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        161µs ± 1%               162µs ± 1%    ~     (p=0.310 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        212µs ± 1%               211µs ± 1%    ~     (p=0.222 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        268µs ± 1%               268µs ± 1%    ~     (p=1.000 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        512µs ± 1%               510µs ± 1%    ~     (p=0.548 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       752µs ± 1%               752µs ± 1%    ~     (p=1.000 n=5+4)
      zeo/py/fs1-zwrk.go·16                                      1.00ms ± 6%              0.99ms ± 1%    ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               134µs ± 1%               134µs ± 1%    ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               230µs ± 1%               231µs ± 1%    ~     (p=0.310 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               345µs ± 1%               344µs ± 1%    ~     (p=0.841 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               465µs ± 1%               461µs ± 0%  -0.88%  (p=0.016 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               929µs ± 1%               916µs ± 1%  -1.41%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                             1.40ms ± 1%              1.39ms ± 1%    ~     (p=0.222 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                             1.86ms ± 1%              1.86ms ± 1%    ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  184µs ± 2%               183µs ± 2%    ~     (p=0.690 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  320µs ± 1%               314µs ± 0%  -1.86%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  481µs ± 1%               476µs ± 1%  -0.95%  (p=0.032 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  638µs ± 1%               632µs ± 0%  -0.96%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                 1.27ms ± 1%              1.26ms ± 1%    ~     (p=0.056 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                1.89ms ± 0%              1.89ms ± 1%    ~     (p=0.222 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                2.54ms ± 1%              2.52ms ± 0%  -0.80%  (p=0.016 n=5+5)
      neo/go/fs1-zwrk.go·1                                       41.9µs ± 0%              41.7µs ± 0%  -0.51%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·2                                       44.0µs ± 1%              43.8µs ± 1%    ~     (p=0.222 n=5+5)
      neo/go/fs1-zwrk.go·3                                       54.5µs ± 0%              54.1µs ± 1%  -0.74%  (p=0.016 n=5+5)
      neo/go/fs1-zwrk.go·4                                       66.2µs ± 0%              65.9µs ± 0%    ~     (p=0.056 n=5+5)
      neo/go/fs1-zwrk.go·8                                        116µs ± 2%               115µs ± 3%    ~     (p=0.548 n=5+5)
      neo/go/fs1-zwrk.go·12                                       177µs ± 5%               173µs ± 7%    ~     (p=0.548 n=5+5)
      neo/go/fs1-zwrk.go·16                                       235µs ± 3%               236µs ± 2%    ~     (p=0.841 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                         36.8µs ± 1%              36.9µs ± 0%    ~     (p=0.690 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                         36.0µs ± 1%              36.1µs ± 1%    ~     (p=0.841 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                         46.9µs ± 1%              47.7µs ± 1%  +1.72%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                         57.9µs ± 1%              58.4µs ± 1%    ~     (p=0.056 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                         98.6µs ± 4%             100.2µs ± 3%    ~     (p=0.151 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         155µs ± 8%               155µs ± 4%    ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         208µs ± 5%               206µs ± 7%    ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go·1                                    85.5µs ± 1%              85.3µs ± 0%    ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     106µs ± 1%               105µs ± 0%    ~     (p=0.063 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     123µs ± 2%               123µs ± 1%    ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     154µs ± 3%               152µs ± 1%    ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     325µs ± 5%               323µs ± 3%    ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    507µs ± 3%               508µs ± 2%    ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    665µs ± 3%               657µs ± 1%    ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                             82.3µs ± 1%              82.3µs ± 0%    ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              102µs ± 1%               102µs ± 0%    ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              118µs ± 1%               115µs ± 3%  -2.66%  (p=0.032 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              145µs ± 2%               138µs ± 1%  -5.36%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              312µs ± 2%               293µs ± 2%  -5.95%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             500µs ± 2%               470µs ± 1%  -5.84%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             662µs ± 1%               627µs ± 1%  -5.35%  (p=0.008 n=5+5)
      620b723c
    • Kirill Smelkov's avatar
      X rio: localhost timings, C > C1 disabled · 3695ff12
      Kirill Smelkov authored
      Disabling C-states on rio tendto help serial cases, like it was on neo1
      and z6001, but it is closer to noise.
      
      ---- 8< ----
      cluster:rio dataset:wczblk1-8
      zeo/py/fs1-zhash.py                                         400µs ± 0%               370µs ± 1%   -7.32%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                318µs ± 7%               295µs ± 0%   -7.16%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zhash.go+prefetch128                       158µs ± 3%               158µs ± 2%     ~     (p=1.000 n=5+5)
      neo/go/fs1-zhash.py                                         222µs ± 4%               214µs ± 2%   -3.73%  (p=0.040 n=5+5)
      neo/go/sqlite-zhash.py                                      273µs ± 3%               256µs ± 4%   -6.45%  (p=0.008 n=5+5)
      
      cluster:rio dataset:prod1-1024
      zeo/py/fs1-zhash.py                                         372µs ±10%               347µs ± 5%   -6.84%  (p=0.032 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                321µs ±11%               298µs ± 5%   -7.13%  (p=0.048 n=5+5)
      ---- 8< ----
      
      the pystone/s change is nose as pystone/s for C-enabled case was 146k on
      prev-prev run (see 31dc070d).
      
      ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
      
      $ benchstat -split node,cluster,dataset 20180306-rio-ffixed-c.txt 20180306-rio-ffixed-noc_C1\(1µs\).txt
      
      name                                           old pystone/s            new pystone/s            delta
      node:rio
      pystone                                                      115k ±12%                144k ± 1%  +25.53%  (p=0.008 n=5+5)
      
      name                                           old time/op              new time/op              delta
      node:rio
      crc32/py/4K                                                4.77µs ± 0%              4.78µs ± 1%     ~     (p=0.825 n=4+5)
      crc32/go/4K                                                1.49µs ± 0%              1.49µs ± 0%     ~     (p=0.484 n=5+5)
      sha1/py/4K                                                 8.04µs ± 1%              8.00µs ± 1%     ~     (p=0.206 n=5+5)
      sha1/go/4K                                                 8.93µs ± 0%              8.93µs ± 0%     ~     (p=0.389 n=5+5)
      unzlib/py/wczdata                                          25.1µs ± 1%              25.1µs ± 1%     ~     (p=1.000 n=5+5)
      unzlib/go/wczdata                                          23.0µs ± 0%              22.9µs ± 0%   -0.45%  (p=0.016 n=5+5)
      unzlib/py/prod1-avg                                        7.16µs ± 1%              7.08µs ± 1%     ~     (p=0.056 n=5+5)
      unzlib/go/prod1-avg                                        5.08µs ± 1%              5.04µs ± 0%   -0.82%  (p=0.008 n=5+5)
      disk/randread/direct/4K-min                                92.4µs ± 0%              92.7µs ± 0%     ~     (p=0.198 n=5+5)
      disk/randread/direct/4K-avg                                 115µs ± 0%               115µs ± 0%   +0.37%  (p=0.008 n=5+5)
      disk/randread/pagecache/4K-min                              565ns ± 2%               562ns ± 1%     ~     (p=0.444 n=5+5)
      disk/randread/pagecache/4K-avg                              992ns ± 0%               992ns ± 0%     ~     (p=1.032 n=4+5)
      
      name                                           old time/object          new time/object          delta
      cluster:rio dataset:wczblk1-8
      fs1-zhash.py                                               29.2µs ± 1%              28.8µs ± 2%     ~     (p=0.111 n=4+5)
      fs1-zhash.go                                               4.68µs ± 5%              4.60µs ± 0%     ~     (p=0.444 n=5+5)
      fs1-zhash.go+prefetch128                                   4.78µs ± 5%              4.62µs ±15%     ~     (p=0.159 n=5+5)
      zeo/py/fs1-zhash.py                                         400µs ± 0%               370µs ± 1%   -7.32%  (p=0.008 n=5+5)
      zeo/py/fs1-zhash.go                                         138µs ± 1%               136µs ± 2%     ~     (p=0.087 n=5+5)
      zeo/py/fs1-zhash.go+prefetch128                            74.7µs ± 2%              74.9µs ± 2%     ~     (p=0.730 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                318µs ± 7%               295µs ± 0%   -7.16%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                154µs ± 4%               151µs ± 6%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zhash.go+prefetch128                    125µs ± 3%               126µs ± 2%     ~     (p=0.746 n=5+5)
      neo/py(!log)/sql-zhash.py                                   400µs ±57%               325µs ± 2%     ~     (p=0.063 n=5+4)
      neo/py(!log)/sql-zhash.go                                   183µs ±11%               178µs ± 2%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zhash.go+prefetch128                       158µs ± 3%               158µs ± 2%     ~     (p=1.000 n=5+5)
      neo/go/fs1-zhash.py                                         222µs ± 4%               214µs ± 2%   -3.73%  (p=0.040 n=5+5)
      neo/go/fs1-zhash.go                                        68.6µs ± 2%              68.9µs ± 3%     ~     (p=0.722 n=5+5)
      neo/go/fs1-zhash.go+prefetch128                            29.0µs ± 6%              28.3µs ± 4%     ~     (p=0.135 n=5+5)
      neo/go/fs1(!sha1)-zhash.go(!sha1)                          43.9µs ± 3%              43.7µs ± 2%     ~     (p=0.881 n=5+5)
      neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1)              18.8µs ± 5%              18.6µs ± 4%     ~     (p=0.516 n=5+5)
      neo/go/sqlite-zhash.py                                      273µs ± 3%               256µs ± 4%   -6.45%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.go                                      104µs ± 1%               104µs ± 2%     ~     (p=0.651 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128                         36.3µs ± 3%              37.0µs ± 8%     ~     (p=0.595 n=5+5)
      neo/go/sqlite-zhash.go(!sha1)                              94.2µs ± 3%              93.1µs ± 3%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128(!sha1)                  35.1µs ± 6%              35.7µs ±13%     ~     (p=1.000 n=5+5)
      cluster:rio dataset:prod1-1024
      fs1-zhash.py                                               23.9µs ± 1%              24.0µs ± 2%     ~     (p=0.937 n=4+5)
      fs1-zhash.go                                               3.40µs ± 0%              3.40µs ± 0%     ~     (all equal)
      fs1-zhash.go+prefetch128                                   3.02µs ± 9%              3.04µs ± 2%     ~     (p=0.397 n=5+5)
      zeo/py/fs1-zhash.py                                         372µs ±10%               347µs ± 5%   -6.84%  (p=0.032 n=5+5)
      zeo/py/fs1-zhash.go                                         114µs ± 1%               114µs ± 2%     ~     (p=0.548 n=5+5)
      zeo/py/fs1-zhash.go+prefetch128                            64.6µs ± 1%              66.6µs ± 1%   +3.07%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                321µs ±11%               298µs ± 5%   -7.13%  (p=0.048 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                142µs ± 3%               142µs ± 3%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zhash.go+prefetch128                    117µs ± 1%               115µs ± 1%     ~     (p=0.087 n=5+5)
      neo/py(!log)/sql-zhash.py                                   330µs ± 1%               380µs ±34%  +15.42%  (p=0.016 n=4+5)
      neo/py(!log)/sql-zhash.go                                   172µs ± 1%               170µs ± 2%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sql-zhash.go+prefetch128                       149µs ± 2%               148µs ± 1%     ~     (p=0.222 n=5+5)
      neo/go/fs1-zhash.py                                         217µs ± 1%               214µs ± 5%     ~     (p=0.643 n=5+5)
      neo/go/fs1-zhash.go                                        49.8µs ± 2%              49.5µs ± 1%     ~     (p=0.246 n=5+5)
      neo/go/fs1-zhash.go+prefetch128                            18.8µs ± 1%              19.1µs ± 2%   +2.03%  (p=0.048 n=5+5)
      neo/go/fs1(!sha1)-zhash.go(!sha1)                          40.4µs ± 3%              40.5µs ± 2%     ~     (p=0.587 n=5+5)
      neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1)              16.1µs ± 2%              15.8µs ± 3%     ~     (p=0.238 n=5+5)
      neo/go/sqlite-zhash.py                                      263µs ± 4%               253µs ± 3%   -3.90%  (p=0.024 n=5+5)
      neo/go/sqlite-zhash.go                                     93.1µs ± 1%              92.7µs ± 1%     ~     (p=0.595 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128                         32.7µs ± 2%              32.6µs ± 4%     ~     (p=0.659 n=5+5)
      neo/go/sqlite-zhash.go(!sha1)                              89.6µs ± 1%              91.2µs ± 1%   +1.79%  (p=0.024 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128(!sha1)                  34.0µs ± 2%              32.7µs ± 2%   -3.82%  (p=0.008 n=5+5)
      
      name                                           old req/s                new req/s                delta
      cluster:rio dataset:wczblk1-8
      fs1-zwrk.go·1                                                300k ± 0%                299k ± 1%     ~     (p=0.310 n=5+5)
      fs1-zwrk.go·2                                                546k ± 0%                547k ± 1%     ~     (p=0.690 n=5+5)
      fs1-zwrk.go·3                                                810k ± 0%                812k ± 0%     ~     (p=0.310 n=5+5)
      fs1-zwrk.go·4                                               1.08M ± 0%               1.08M ± 0%     ~     (p=0.841 n=5+5)
      fs1-zwrk.go·8                                               1.42M ± 0%               1.42M ± 0%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·12                                              1.55M ± 0%               1.55M ± 0%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·16                                              1.55M ± 0%               1.54M ± 0%   -0.34%  (p=0.016 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        7.41k ± 1%               7.42k ± 1%     ~     (p=0.690 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        9.03k ± 1%               8.95k ± 1%     ~     (p=0.310 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        9.77k ± 1%               9.86k ± 1%     ~     (p=0.151 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        10.1k ± 3%               10.1k ± 2%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        10.5k ± 0%               10.4k ± 2%   -1.37%  (p=0.032 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       10.6k ± 1%               10.6k ± 2%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zwrk.go·16                                       10.6k ± 1%               10.6k ± 1%     ~     (p=0.222 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               6.80k ± 2%               6.78k ± 1%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               8.31k ± 7%               8.25k ± 8%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               8.60k ± 1%               8.48k ± 1%     ~     (p=0.056 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               8.60k ± 1%               8.52k ± 0%     ~     (p=0.114 n=4+4)
      neo/py(!log)/sqlite-zwrk.go·8                               8.61k ± 1%               8.51k ± 1%     ~     (p=0.095 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                              8.56k ± 1%               8.46k ± 2%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                              8.49k ± 3%               8.51k ± 1%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  5.62k ± 6%               5.59k ± 2%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  6.75k ± 4%               6.83k ± 1%     ~     (p=0.190 n=5+4)
      neo/py(!log)/sql-zwrk.go·3                                  6.77k ± 2%               6.71k ± 2%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  6.51k ± 7%               6.56k ± 4%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                  6.56k ± 4%               6.68k ± 4%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                 6.84k ± 1%               6.73k ± 6%     ~     (p=0.730 n=4+5)
      neo/py(!log)/sql-zwrk.go·16                                 6.73k ± 3%               6.71k ± 3%     ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·1                                        15.5k ± 0%               15.6k ± 0%     ~     (p=0.095 n=5+5)
      neo/go/fs1-zwrk.go·2                                        29.9k ± 1%               30.2k ± 1%   +0.84%  (p=0.032 n=5+5)
      neo/go/fs1-zwrk.go·3                                        39.4k ± 0%               39.7k ± 0%   +0.70%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·4                                        49.4k ± 0%               49.6k ± 0%   +0.54%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·8                                        68.4k ± 0%               68.8k ± 0%   +0.62%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·12                                       72.5k ± 0%               73.0k ± 0%   +0.66%  (p=0.016 n=5+5)
      neo/go/fs1-zwrk.go·16                                       73.2k ± 0%               73.7k ± 1%   +0.79%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                          26.2k ± 1%               25.3k ± 2%   -3.17%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                          47.6k ± 0%               47.8k ± 0%   +0.46%  (p=0.032 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                          59.4k ± 0%               59.6k ± 0%     ~     (p=0.095 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                          72.2k ± 0%               72.4k ± 0%     ~     (p=0.056 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          96.7k ± 0%               96.8k ± 0%     ~     (p=0.841 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                          109k ± 0%                110k ± 0%     ~     (p=0.841 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                          113k ± 1%                113k ± 1%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     9.82k ± 0%               9.91k ± 0%   +0.88%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     18.3k ± 0%               18.4k ± 0%   +0.56%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     25.3k ± 0%               25.5k ± 0%   +0.91%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     30.3k ± 0%               30.6k ± 0%   +0.80%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     39.5k ± 0%               40.1k ± 0%   +1.54%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    40.8k ± 2%               41.8k ± 1%   +2.31%  (p=0.016 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    40.5k ± 2%               41.8k ± 2%   +3.20%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              11.0k ± 1%               11.1k ± 1%     ~     (p=0.222 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              20.0k ± 0%               20.1k ± 0%   +0.35%  (p=0.016 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              27.9k ± 0%               28.0k ± 0%   +0.27%  (p=0.016 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              34.1k ± 0%               34.3k ± 0%   +0.62%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              44.1k ± 1%               44.7k ± 1%   +1.53%  (p=0.016 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             43.1k ± 1%               44.5k ± 1%   +3.33%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             41.2k ± 2%               43.0k ± 2%   +4.21%  (p=0.008 n=5+5)
      cluster:rio dataset:prod1-1024
      fs1-zwrk.go·1                                                465k ± 1%                461k ± 1%     ~     (p=0.056 n=5+5)
      fs1-zwrk.go·2                                                920k ± 0%                918k ± 0%     ~     (p=0.730 n=4+5)
      fs1-zwrk.go·3                                               1.36M ± 1%               1.37M ± 1%     ~     (p=0.548 n=5+5)
      fs1-zwrk.go·4                                               1.81M ± 0%               1.80M ± 3%     ~     (p=0.310 n=5+5)
      fs1-zwrk.go·8                                               2.37M ± 1%               2.38M ± 2%     ~     (p=0.690 n=5+5)
      fs1-zwrk.go·12                                              2.41M ± 0%               2.42M ± 0%     ~     (p=0.690 n=5+5)
      fs1-zwrk.go·16                                              2.42M ± 0%               2.41M ± 0%     ~     (p=0.056 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        8.98k ± 1%               8.88k ± 1%   -1.08%  (p=0.032 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        11.7k ± 1%               11.6k ± 2%     ~     (p=0.310 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        12.9k ± 2%               12.5k ± 2%   -2.84%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        13.4k ± 4%               13.1k ± 2%     ~     (p=0.095 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        14.0k ± 2%               13.6k ± 1%   -2.77%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       14.2k ± 2%               13.9k ± 1%   -2.05%  (p=0.032 n=5+5)
      zeo/py/fs1-zwrk.go·16                                       14.2k ± 3%               13.8k ± 1%   -2.84%  (p=0.032 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               7.16k ± 4%               7.12k ± 3%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               8.75k ± 1%               8.64k ± 7%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               8.65k ± 4%               8.79k ± 1%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               8.53k ± 6%               8.73k ± 2%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               8.61k ± 3%               8.60k ± 2%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                              8.64k ± 0%               8.78k ± 1%   +1.63%  (p=0.016 n=4+5)
      neo/py(!log)/sqlite-zwrk.go·16                              8.64k ± 1%               8.58k ± 3%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  5.88k ± 1%               5.91k ± 1%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  6.79k ± 2%               6.71k ± 9%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  6.58k ± 4%               6.85k ± 2%     ~     (p=0.056 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  6.68k ± 4%               6.82k ± 1%     ~     (p=0.730 n=5+4)
      neo/py(!log)/sql-zwrk.go·8                                  6.83k ± 1%               6.80k ± 6%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                 6.66k ± 4%               6.87k ± 2%   +3.10%  (p=0.016 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                 6.65k ± 5%               6.90k ± 2%     ~     (p=0.151 n=5+5)
      neo/go/fs1-zwrk.go·1                                        21.8k ± 1%               21.9k ± 2%     ~     (p=0.222 n=5+5)
      neo/go/fs1-zwrk.go·2                                        39.2k ± 1%               39.6k ± 1%   +0.94%  (p=0.016 n=5+5)
      neo/go/fs1-zwrk.go·3                                        51.4k ± 0%               51.5k ± 0%     ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·4                                        62.8k ± 0%               62.8k ± 0%     ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·8                                        80.7k ± 1%               80.2k ± 1%     ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·12                                       80.0k ± 2%               79.6k ± 3%     ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·16                                       78.3k ± 2%               77.1k ± 5%     ~     (p=0.421 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                          26.5k ± 1%               26.9k ± 1%   +1.52%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                          48.8k ± 0%               49.2k ± 0%   +0.89%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                          61.8k ± 0%               62.1k ± 0%     ~     (p=0.056 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                          74.0k ± 0%               74.2k ± 0%     ~     (p=0.151 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          91.3k ± 0%               91.9k ± 2%     ~     (p=0.190 n=4+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         93.1k ± 2%               92.9k ± 2%     ~     (p=0.841 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         89.7k ± 2%               90.1k ± 2%     ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     11.0k ± 1%               11.1k ± 0%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     19.4k ± 1%               19.4k ± 0%     ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     26.6k ± 0%               26.5k ± 0%     ~     (p=0.095 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     31.9k ± 0%               31.7k ± 0%   -0.47%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     37.4k ± 2%               37.3k ± 2%     ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    35.2k ± 3%               35.4k ± 2%     ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    34.6k ± 2%               34.8k ± 2%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              11.5k ± 1%               11.4k ± 1%   -1.34%  (p=0.032 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              20.1k ± 0%               19.8k ± 0%   -1.52%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              27.6k ± 0%               27.3k ± 1%   -0.93%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              33.4k ± 0%               33.1k ± 1%   -0.81%  (p=0.016 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              38.8k ± 2%               38.8k ± 1%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             36.4k ± 1%               36.0k ± 2%     ~     (p=0.222 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             35.2k ± 2%               35.1k ± 2%     ~     (p=0.690 n=5+5)
      
      name                                           old latency-time/object  new latency-time/object  delta
      cluster:rio dataset:wczblk1-8
      fs1-zwrk.go·1                                              3.33µs ± 0%              3.34µs ± 1%     ~     (p=0.286 n=5+5)
      fs1-zwrk.go·2                                              3.67µs ± 0%              3.65µs ± 1%     ~     (p=0.667 n=5+5)
      fs1-zwrk.go·3                                              3.70µs ± 0%              3.69µs ± 0%     ~     (p=0.310 n=5+5)
      fs1-zwrk.go·4                                              3.72µs ± 0%              3.72µs ± 0%     ~     (p=0.984 n=5+5)
      fs1-zwrk.go·8                                              5.62µs ± 0%              5.62µs ± 0%     ~     (p=0.889 n=5+5)
      fs1-zwrk.go·12                                             7.76µs ± 0%              7.76µs ± 0%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·16                                             10.3µs ± 0%              10.4µs ± 0%   +0.34%  (p=0.016 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        135µs ± 1%               135µs ± 1%     ~     (p=0.690 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        222µs ± 1%               223µs ± 1%     ~     (p=0.310 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        307µs ± 1%               304µs ± 1%     ~     (p=0.151 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        398µs ± 3%               397µs ± 2%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        759µs ± 0%               770µs ± 2%   +1.41%  (p=0.032 n=5+5)
      zeo/py/fs1-zwrk.go·12                                      1.13ms ± 1%              1.14ms ± 2%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zwrk.go·16                                      1.50ms ± 1%              1.51ms ± 1%     ~     (p=0.222 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               147µs ± 2%               147µs ± 1%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               241µs ± 8%               243µs ± 8%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               349µs ± 1%               354µs ± 1%     ~     (p=0.056 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               465µs ± 1%               470µs ± 0%     ~     (p=0.114 n=4+4)
      neo/py(!log)/sqlite-zwrk.go·8                               930µs ± 1%               940µs ± 1%     ~     (p=0.095 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                             1.40ms ± 1%              1.42ms ± 2%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                             1.88ms ± 3%              1.88ms ± 1%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  178µs ± 6%               179µs ± 2%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  297µs ± 4%               293µs ± 1%     ~     (p=0.190 n=5+4)
      neo/py(!log)/sql-zwrk.go·3                                  443µs ± 2%               447µs ± 2%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  616µs ± 8%               610µs ± 4%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                 1.22ms ± 5%              1.20ms ± 4%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                1.75ms ± 1%              1.79ms ± 6%     ~     (p=0.730 n=4+5)
      neo/py(!log)/sql-zwrk.go·16                                2.38ms ± 3%              2.38ms ± 3%     ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·1                                       64.4µs ± 0%              64.1µs ± 0%     ~     (p=0.095 n=5+5)
      neo/go/fs1-zwrk.go·2                                       66.8µs ± 1%              66.3µs ± 1%   -0.83%  (p=0.032 n=5+5)
      neo/go/fs1-zwrk.go·3                                       76.1µs ± 0%              75.5µs ± 0%   -0.69%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·4                                       81.0µs ± 0%              80.6µs ± 0%   -0.53%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·8                                        117µs ± 0%               116µs ± 0%   -0.62%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·12                                       165µs ± 0%               164µs ± 0%   -0.65%  (p=0.016 n=5+5)
      neo/go/fs1-zwrk.go·16                                       219µs ± 0%               217µs ± 1%   -0.78%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                         38.2µs ± 1%              39.5µs ± 2%   +3.29%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                         42.0µs ± 0%              41.8µs ± 0%   -0.45%  (p=0.032 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                         50.5µs ± 0%              50.4µs ± 0%     ~     (p=0.095 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                         55.4µs ± 0%              55.3µs ± 0%     ~     (p=0.063 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                         82.8µs ± 0%              82.7µs ± 0%     ~     (p=0.841 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         110µs ± 0%               110µs ± 0%     ~     (p=0.841 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         142µs ± 1%               142µs ± 1%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     102µs ± 0%               101µs ± 0%   -0.87%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     110µs ± 0%               109µs ± 0%   -0.55%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     119µs ± 0%               117µs ± 0%   -0.90%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     132µs ± 0%               131µs ± 0%   -0.79%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     203µs ± 0%               200µs ± 0%   -1.52%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    294µs ± 2%               287µs ± 1%   -2.26%  (p=0.016 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    395µs ± 2%               383µs ± 2%   -3.11%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                             91.1µs ± 1%              90.4µs ± 1%     ~     (p=0.222 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              100µs ± 0%               100µs ± 0%   -0.35%  (p=0.016 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              108µs ± 0%               107µs ± 0%   -0.27%  (p=0.016 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              117µs ± 0%               117µs ± 0%   -0.62%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              182µs ± 1%               179µs ± 1%   -1.51%  (p=0.016 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             279µs ± 1%               270µs ± 1%   -3.22%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             388µs ± 2%               372µs ± 2%   -4.03%  (p=0.008 n=5+5)
      cluster:rio dataset:prod1-1024
      fs1-zwrk.go·1                                              2.15µs ± 1%              2.17µs ± 1%     ~     (p=0.056 n=5+5)
      fs1-zwrk.go·2                                              2.17µs ± 0%              2.18µs ± 0%     ~     (p=0.603 n=4+5)
      fs1-zwrk.go·3                                              2.20µs ± 1%              2.20µs ± 1%     ~     (p=0.460 n=5+5)
      fs1-zwrk.go·4                                              2.21µs ± 0%              2.23µs ± 3%     ~     (p=0.278 n=5+5)
      fs1-zwrk.go·8                                              3.37µs ± 1%              3.36µs ± 2%     ~     (p=0.690 n=5+5)
      fs1-zwrk.go·12                                             4.97µs ± 0%              4.97µs ± 0%     ~     (p=0.675 n=5+5)
      fs1-zwrk.go·16                                             6.61µs ± 0%              6.63µs ± 0%     ~     (p=0.063 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        111µs ± 1%               113µs ± 1%   +1.09%  (p=0.032 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        171µs ± 1%               173µs ± 2%     ~     (p=0.310 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        233µs ± 2%               240µs ± 2%   +2.94%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        298µs ± 4%               306µs ± 2%     ~     (p=0.095 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        572µs ± 2%               588µs ± 1%   +2.84%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       844µs ± 2%               861µs ± 1%   +2.07%  (p=0.032 n=5+5)
      zeo/py/fs1-zwrk.go·16                                      1.12ms ± 3%              1.16ms ± 1%   +2.90%  (p=0.032 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               140µs ± 4%               140µs ± 3%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               229µs ± 1%               232µs ± 7%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               347µs ± 5%               341µs ± 1%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               470µs ± 7%               458µs ± 2%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               929µs ± 3%               930µs ± 2%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                             1.39ms ± 0%              1.37ms ± 1%   -1.60%  (p=0.016 n=4+5)
      neo/py(!log)/sqlite-zwrk.go·16                             1.85ms ± 1%              1.86ms ± 3%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  170µs ± 1%               169µs ± 1%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  294µs ± 2%               299µs ±10%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  456µs ± 4%               438µs ± 1%     ~     (p=0.056 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  599µs ± 4%               587µs ± 1%     ~     (p=0.730 n=5+4)
      neo/py(!log)/sql-zwrk.go·8                                 1.17ms ± 1%              1.18ms ± 6%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                1.80ms ± 4%              1.75ms ± 2%   -3.05%  (p=0.016 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                2.41ms ± 5%              2.32ms ± 2%     ~     (p=0.151 n=5+5)
      neo/go/fs1-zwrk.go·1                                       45.9µs ± 1%              45.6µs ± 2%     ~     (p=0.167 n=5+5)
      neo/go/fs1-zwrk.go·2                                       51.0µs ± 1%              50.6µs ± 1%   -0.94%  (p=0.016 n=5+5)
      neo/go/fs1-zwrk.go·3                                       58.3µs ± 0%              58.3µs ± 0%     ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·4                                       63.7µs ± 0%              63.7µs ± 0%     ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·8                                       99.2µs ± 1%              99.8µs ± 1%     ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·12                                       150µs ± 2%               151µs ± 3%     ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·16                                       204µs ± 3%               208µs ± 5%     ~     (p=0.421 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                         37.7µs ± 1%              37.2µs ± 1%   -1.50%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                         41.0µs ± 0%              40.6µs ± 0%   -0.88%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                         48.5µs ± 0%              48.3µs ± 0%     ~     (p=0.056 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                         54.0µs ± 0%              53.9µs ± 0%     ~     (p=0.151 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                         87.6µs ± 0%              87.1µs ± 2%     ~     (p=0.190 n=4+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         129µs ± 2%               129µs ± 2%     ~     (p=0.841 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         178µs ± 2%               178µs ± 2%     ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go·1                                    90.7µs ± 1%              90.4µs ± 0%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     103µs ± 1%               103µs ± 0%     ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     113µs ± 0%               113µs ± 0%     ~     (p=0.095 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     125µs ± 0%               126µs ± 0%   +0.47%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     214µs ± 2%               215µs ± 2%     ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    341µs ± 3%               339µs ± 2%     ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    462µs ± 2%               460µs ± 2%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                             86.7µs ± 1%              87.9µs ± 1%   +1.36%  (p=0.032 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              100µs ± 0%               101µs ± 0%   +1.54%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              109µs ± 0%               110µs ± 1%   +0.94%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              120µs ± 0%               121µs ± 1%   +0.82%  (p=0.016 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              206µs ± 2%               206µs ± 1%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             330µs ± 1%               333µs ± 2%     ~     (p=0.222 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             455µs ± 2%               456µs ± 2%     ~     (p=0.690 n=5+5)
      3695ff12
    • Kirill Smelkov's avatar
      X z6001: localhost timings, C > C1 disabled · 65de70b8
      Kirill Smelkov authored
      Like for neo1 disabling C-states helps serial cases for zeo/py and
      neo/py/sqlite and serial and parallel cases for neo/py/sql. For
      neo/py/sql it also tends to make timings less noisy:
      
      ---- 8< ----
      cluster:z6001 dataset:wczblk1-8
      zeo/py/fs1-zhash.py                                         650µs ± 7%               583µs ± 9%  -10.33%  (p=0.032 n=5+5)
      zeo/py/fs1-zhash.go                                         274µs ±13%               202µs ± 1%  -26.34%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                696µs ± 1%               476µs ± 4%  -31.64%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                338µs ± 7%               225µs ± 6%  -33.47%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zhash.py                                  1.00ms ±38%              0.59ms ±36%  -41.17%  (p=0.016 n=5+5)
      neo/py(!log)/sql-zhash.go                                   434µs ± 6%               282µs ± 3%  -35.10%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zhash.go+prefetch128                       277µs ± 9%               237µs ± 2%  -14.37%  (p=0.008 n=5+5)
      
      zeo/py/fs1-zwrk.go·1                                        233µs ± 8%               195µs ± 2%  -16.41%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               288µs ±14%               220µs ± 2%  -23.74%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  400µs ±16%               278µs ± 1%  -30.47%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  562µs ± 8%               470µs ± 0%  -16.47%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  827µs ±13%               699µs ± 1%  -15.44%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                 1.13ms ±14%              0.96ms ±10%  -15.10%  (p=0.016 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                 2.13ms ±13%              1.90ms ± 1%  -10.78%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                3.24ms ±12%              2.82ms ± 2%  -12.82%  (p=0.032 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                4.62ms ± 8%              3.76ms ± 1%  -18.69%  (p=0.016 n=5+4)
      
      cluster:z6001 dataset:prod1-1024
      zeo/py/fs1-zhash.go                                         235µs ± 7%               167µs ± 1%  -28.85%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                664µs ± 2%               452µs ±10%  -31.89%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                269µs ± 7%               208µs ± 1%  -22.79%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zhash.py                                  1.03ms ±29%              0.57ms ±38%  -44.81%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zhash.go                                   406µs ± 2%               267µs ± 3%  -34.15%  (p=0.008 n=5+5)
      
      zeo/py/fs1-zwrk.go·1                                        208µs ± 5%               163µs ± 1%  -21.69%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               271µs ± 7%               210µs ± 6%  -22.43%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  400µs ±11%               261µs ± 1%  -34.78%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  554µs ± 7%               463µs ± 1%  -16.42%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  783µs ±11%               692µs ± 0%  -11.57%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                 1.06ms ±11%              0.92ms ± 1%  -12.52%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                 2.07ms ± 9%              1.83ms ± 2%  -11.28%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                3.02ms ± 7%              2.80ms ± 3%   -7.52%  (p=0.032 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                4.32ms ±12%              3.67ms ± 2%  -15.10%  (p=0.008 n=5+5)
      ---- 8< ----
      
      Like on neo1 it also seems to be helping neo/go/* with slower python
      client, but for neo/go/sqlite with go client too:
      
      ---- 8< ----
      cluster:z6001 dataset:wczblk1-8
      neo/go/fs1-zhash.py                                         526µs ± 8%               333µs ±10%  -36.81%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.py                                      528µs ±15%               385µs ± 6%  -27.15%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.go                                      204µs ±22%               142µs ± 1%  -30.26%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.go(!sha1)                               194µs ± 9%               132µs ± 3%  -31.76%  (p=0.008 n=5+5)
      
      neo/go/sqlite-zwrk.go·1                                     208µs ±14%               139µs ± 1%  -32.89%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     166µs ± 2%               147µs ± 1%  -11.70%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     158µs ± 1%               150µs ± 0%   -4.60%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     162µs ± 0%               157µs ± 0%   -3.12%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              185µs ± 4%               130µs ± 1%  -29.53%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              156µs ± 1%               136µs ± 1%  -12.98%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              149µs ± 1%               139µs ± 0%   -6.76%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              149µs ± 1%               142µs ± 0%   -4.81%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              166µs ± 1%               163µs ± 0%   -2.04%  (p=0.008 n=5+5)
      
      cluster:z6001 dataset:prod1-1024
      neo/go/fs1-zhash.py                                         520µs ± 9%               321µs ±11%  -38.25%  (p=0.008 n=5+5)
      neo/go/fs1-zhash.go                                        83.2µs ± 7%              74.8µs ± 3%  -10.14%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.py                                      539µs ±11%               361µs ± 6%  -32.97%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.go                                      196µs ± 9%               128µs ± 2%  -34.66%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.go(!sha1)                               168µs ± 8%               125µs ± 4%  -25.63%  (p=0.008 n=5+5)
      
      neo/go/sqlite-zwrk.go·1                                     177µs ± 8%               126µs ± 1%  -29.04%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     151µs ± 2%               136µs ± 1%   -9.65%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     148µs ± 1%               140µs ± 0%   -5.57%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     151µs ± 0%               145µs ± 0%   -3.78%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     180µs ± 1%               177µs ± 1%   -1.31%  (p=0.016 n=5+5)
      
      neo/go/sqlite-zwrk.go(!sha1)·1                              176µs ± 4%               120µs ± 2%  -31.54%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              152µs ± 3%               131µs ± 1%  -13.38%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              147µs ± 1%               135µs ± 0%   -7.68%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              148µs ± 2%               140µs ± 1%   -5.20%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              176µs ± 1%               173µs ± 1%   -1.65%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             225µs ± 1%               224µs ± 0%     ~     (p=0.222 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             321µs ± 1%               321µs ± 1%     ~     (p=1.000 n=5+5)
      ---- 8< ----
      
      ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
      
      $ benchstat -split node,cluster,dataset 20180306-z6001-ffixed-c.txt 20180306-z6001-ffixed-noc_C1\(3µs\).txt
      
      name                                           old pystone/s            new pystone/s            delta
      node:z6001
      pystone                                                      109k ± 9%                114k ± 1%     ~     (p=0.421 n=5+5)
      
      name                                           old time/op              new time/op              delta
      node:z6001
      crc32/py/4K                                                5.11µs ± 1%              5.15µs ± 4%     ~     (p=0.738 n=5+5)
      crc32/go/4K                                                1.72µs ± 0%              1.72µs ± 0%     ~     (p=1.000 n=4+4)
      sha1/py/4K                                                 14.7µs ± 1%              14.7µs ± 1%     ~     (p=0.841 n=5+5)
      sha1/go/4K                                                 10.3µs ± 0%              10.3µs ± 0%     ~     (p=0.103 n=5+5)
      unzlib/py/wczdata                                          37.1µs ± 8%              36.3µs ± 1%     ~     (p=0.310 n=5+5)
      unzlib/go/wczdata                                          31.5µs ± 0%              31.2µs ± 0%   -1.12%  (p=0.008 n=5+5)
      unzlib/py/prod1-avg                                        18.5µs ± 3%              18.6µs ± 3%     ~     (p=0.841 n=5+5)
      unzlib/go/prod1-avg                                        10.0µs ± 1%               9.9µs ± 1%     ~     (p=0.095 n=5+5)
      disk/randread/direct/4K-min                                 126µs ± 1%               127µs ± 1%     ~     (p=1.000 n=4+5)
      disk/randread/direct/4K-avg                                 199µs ± 9%               168µs ± 0%  -15.84%  (p=0.008 n=5+5)
      disk/randread/pagecache/4K-min                              806ns ± 3%               799ns ± 1%     ~     (p=0.746 n=5+5)
      disk/randread/pagecache/4K-avg                             1.44µs ± 7%              1.52µs ± 3%     ~     (p=0.079 n=5+5)
      
      name                                           old time/object          new time/object          delta
      cluster:z6001 dataset:wczblk1-8
      fs1-zhash.py                                               37.6µs ± 2%              37.4µs ± 2%     ~     (p=0.571 n=5+5)
      fs1-zhash.go                                               6.00µs ± 2%              5.96µs ± 1%     ~     (p=0.643 n=5+5)
      fs1-zhash.go+prefetch128                                   8.00µs ± 5%              7.24µs ± 6%   -9.50%  (p=0.016 n=5+5)
      zeo/py/fs1-zhash.py                                         650µs ± 7%               583µs ± 9%  -10.33%  (p=0.032 n=5+5)
      zeo/py/fs1-zhash.go                                         274µs ±13%               202µs ± 1%  -26.34%  (p=0.008 n=5+5)
      zeo/py/fs1-zhash.go+prefetch128                             101µs ± 2%               102µs ± 2%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                696µs ± 1%               476µs ± 4%  -31.64%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                338µs ± 7%               225µs ± 6%  -33.47%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zhash.go+prefetch128                    177µs ± 1%               179µs ± 1%     ~     (p=0.143 n=5+5)
      neo/py(!log)/sql-zhash.py                                  1.00ms ±38%              0.59ms ±36%  -41.17%  (p=0.016 n=5+5)
      neo/py(!log)/sql-zhash.go                                   434µs ± 6%               282µs ± 3%  -35.10%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zhash.go+prefetch128                       277µs ± 9%               237µs ± 2%  -14.37%  (p=0.008 n=5+5)
      neo/go/fs1-zhash.py                                         526µs ± 8%               333µs ±10%  -36.81%  (p=0.008 n=5+5)
      neo/go/fs1-zhash.go                                         102µs ± 8%                94µs ± 6%   -8.17%  (p=0.032 n=5+5)
      neo/go/fs1-zhash.go+prefetch128                            36.6µs ± 4%              36.6µs ± 3%     ~     (p=0.841 n=5+5)
      neo/go/fs1(!sha1)-zhash.go(!sha1)                          76.4µs ± 5%              69.7µs ± 8%   -8.75%  (p=0.032 n=5+5)
      neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1)              26.5µs ± 2%              26.4µs ± 5%     ~     (p=0.730 n=5+5)
      neo/go/sqlite-zhash.py                                      528µs ±15%               385µs ± 6%  -27.15%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.go                                      204µs ±22%               142µs ± 1%  -30.26%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128                         39.9µs ± 4%              41.4µs ± 5%     ~     (p=0.111 n=5+5)
      neo/go/sqlite-zhash.go(!sha1)                               194µs ± 9%               132µs ± 3%  -31.76%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128(!sha1)                  38.2µs ± 7%              36.7µs ± 5%     ~     (p=0.151 n=5+5)
      cluster:z6001 dataset:prod1-1024
      fs1-zhash.py                                               30.3µs ± 1%              30.0µs ± 1%     ~     (p=0.373 n=5+5)
      fs1-zhash.go                                               4.62µs ± 3%              4.60µs ± 0%     ~     (p=0.968 n=5+4)
      fs1-zhash.go+prefetch128                                   5.76µs ± 8%              5.48µs ± 4%     ~     (p=0.056 n=5+5)
      zeo/py/fs1-zhash.py                                         632µs ±15%               560µs ± 3%     ~     (p=0.151 n=5+5)
      zeo/py/fs1-zhash.go                                         235µs ± 7%               167µs ± 1%  -28.85%  (p=0.008 n=5+5)
      zeo/py/fs1-zhash.go+prefetch128                            87.2µs ± 1%              88.5µs ± 1%   +1.49%  (p=0.048 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                664µs ± 2%               452µs ±10%  -31.89%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                269µs ± 7%               208µs ± 1%  -22.79%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zhash.go+prefetch128                    162µs ± 0%               163µs ± 0%     ~     (p=0.397 n=4+5)
      neo/py(!log)/sql-zhash.py                                  1.03ms ±29%              0.57ms ±38%  -44.81%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zhash.go                                   406µs ± 2%               267µs ± 3%  -34.15%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zhash.go+prefetch128                       268µs ± 5%               228µs ±10%  -14.87%  (p=0.008 n=5+5)
      neo/go/fs1-zhash.py                                         520µs ± 9%               321µs ±11%  -38.25%  (p=0.008 n=5+5)
      neo/go/fs1-zhash.go                                        83.2µs ± 7%              74.8µs ± 3%  -10.14%  (p=0.008 n=5+5)
      neo/go/fs1-zhash.go+prefetch128                            24.0µs ± 5%              24.1µs ± 1%     ~     (p=0.548 n=5+5)
      neo/go/fs1(!sha1)-zhash.go(!sha1)                          67.0µs ± 3%              65.2µs ± 5%     ~     (p=0.095 n=5+5)
      neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1)              21.2µs ± 4%              21.1µs ± 2%     ~     (p=0.952 n=5+5)
      neo/go/sqlite-zhash.py                                      539µs ±11%               361µs ± 6%  -32.97%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.go                                      196µs ± 9%               128µs ± 2%  -34.66%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128                         35.0µs ± 3%              34.6µs ± 2%     ~     (p=0.302 n=5+5)
      neo/go/sqlite-zhash.go(!sha1)                               168µs ± 8%               125µs ± 4%  -25.63%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128(!sha1)                  35.1µs ± 4%              34.9µs ± 2%     ~     (p=1.000 n=5+5)
      
      name                                           old req/s                new req/s                delta
      cluster:z6001 dataset:wczblk1-8
      fs1-zwrk.go·1                                                230k ± 1%                231k ± 1%     ~     (p=0.548 n=5+5)
      fs1-zwrk.go·2                                                437k ± 5%                444k ± 1%     ~     (p=0.421 n=5+5)
      fs1-zwrk.go·3                                                663k ± 4%                661k ± 4%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·4                                                880k ± 1%                878k ± 3%     ~     (p=0.841 n=5+5)
      fs1-zwrk.go·8                                               1.75M ± 2%               1.76M ± 2%     ~     (p=0.548 n=5+5)
      fs1-zwrk.go·12                                              2.56M ± 0%               2.51M ± 3%     ~     (p=0.063 n=4+5)
      fs1-zwrk.go·16                                              2.89M ± 1%               2.90M ± 1%     ~     (p=0.310 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        4.30k ± 8%               5.14k ± 2%  +19.34%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        6.33k ± 0%               6.38k ± 2%   +0.85%  (p=0.016 n=4+5)
      zeo/py/fs1-zwrk.go·3                                        6.90k ± 0%               7.05k ± 1%   +2.13%  (p=0.016 n=4+5)
      zeo/py/fs1-zwrk.go·4                                        7.14k ± 1%               7.22k ± 2%     ~     (p=0.111 n=4+5)
      zeo/py/fs1-zwrk.go·8                                        7.53k ± 2%               7.50k ± 1%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       7.65k ± 0%               7.53k ± 0%   -1.59%  (p=0.016 n=4+5)
      zeo/py/fs1-zwrk.go·16                                       7.57k ± 0%               7.66k ± 1%   +1.17%  (p=0.032 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               3.50k ±15%               4.55k ± 2%  +30.01%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               5.58k ± 0%               5.59k ± 1%     ~     (p=0.730 n=4+5)
      neo/py(!log)/sqlite-zwrk.go·3                               5.63k ± 2%               5.56k ± 0%     ~     (p=0.190 n=5+4)
      neo/py(!log)/sqlite-zwrk.go·4                               5.56k ± 1%               5.54k ± 0%     ~     (p=0.095 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               5.61k ± 2%               5.59k ± 2%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                              5.62k ± 1%               5.57k ± 0%   -0.82%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                              5.62k ± 1%               5.58k ± 0%     ~     (p=0.413 n=4+5)
      neo/py(!log)/sql-zwrk.go·1                                  2.53k ±17%               3.59k ± 1%  +41.99%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  3.57k ± 9%               4.26k ± 0%  +19.25%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  3.65k ±14%               4.29k ± 1%  +17.53%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  3.56k ±16%               4.17k ± 9%  +17.25%  (p=0.016 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                  3.78k ±12%               4.20k ± 1%  +11.12%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                 3.73k ±13%               4.25k ± 2%  +13.97%  (p=0.032 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                 3.47k ± 9%               4.26k ± 1%  +22.71%  (p=0.016 n=5+4)
      neo/go/fs1-zwrk.go·1                                        10.7k ± 5%               11.1k ± 7%     ~     (p=0.310 n=5+5)
      neo/go/fs1-zwrk.go·2                                        22.3k ± 1%               23.1k ± 2%   +3.68%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·3                                        31.7k ± 1%               32.1k ± 1%   +1.34%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·4                                        43.2k ± 1%               43.5k ± 0%   +0.72%  (p=0.032 n=5+5)
      neo/go/fs1-zwrk.go·8                                        78.3k ± 0%               78.1k ± 0%     ~     (p=0.222 n=5+5)
      neo/go/fs1-zwrk.go·12                                       92.5k ± 0%               92.4k ± 0%     ~     (p=0.690 n=5+5)
      neo/go/fs1-zwrk.go·16                                        103k ± 1%                102k ± 0%     ~     (p=0.310 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                          15.0k ± 5%               15.1k ± 3%     ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                          31.5k ± 1%               31.8k ± 1%   +0.91%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                          43.8k ± 0%               44.1k ± 0%   +0.82%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                          57.4k ± 0%               57.9k ± 0%   +0.92%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                           100k ± 0%                100k ± 0%     ~     (p=0.222 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                          116k ± 0%                116k ± 0%     ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                          126k ± 1%                126k ± 0%     ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     4.85k ±15%               7.17k ± 1%  +47.73%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     12.0k ± 2%               13.6k ± 1%  +13.23%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     19.0k ± 1%               19.9k ± 0%   +4.82%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     24.7k ± 0%               25.5k ± 0%   +3.22%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     44.8k ± 0%               44.9k ± 0%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    56.3k ± 0%               55.7k ± 0%   -0.92%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    58.0k ± 0%               57.4k ± 1%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              5.41k ± 4%               7.67k ± 1%  +41.83%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              12.8k ± 1%               14.7k ± 1%  +14.92%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              20.2k ± 1%               21.6k ± 0%   +7.25%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              26.8k ± 1%               28.2k ± 0%   +5.05%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              48.1k ± 1%               49.1k ± 0%   +2.08%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             60.3k ± 0%               60.4k ± 0%     ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             61.7k ± 1%               61.9k ± 1%     ~     (p=0.690 n=5+5)
      cluster:z6001 dataset:prod1-1024
      fs1-zwrk.go·1                                                347k ± 2%                347k ± 2%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·2                                                660k ± 3%                659k ± 2%     ~     (p=0.841 n=5+5)
      fs1-zwrk.go·3                                                985k ± 4%                978k ± 4%     ~     (p=0.421 n=5+5)
      fs1-zwrk.go·4                                               1.31M ± 2%               1.30M ± 4%     ~     (p=0.421 n=5+5)
      fs1-zwrk.go·8                                               2.55M ± 4%               2.52M ± 6%     ~     (p=0.690 n=5+5)
      fs1-zwrk.go·12                                              2.81M ± 1%               3.02M ± 1%   +7.78%  (p=0.008 n=5+5)
      fs1-zwrk.go·16                                              2.85M ± 2%               3.06M ± 1%   +7.51%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        4.80k ± 5%               6.13k ± 1%  +27.58%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        8.18k ± 1%               8.16k ± 2%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        8.96k ± 1%               8.99k ± 2%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        8.88k ± 9%               9.37k ± 1%     ~     (p=0.548 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        10.0k ± 2%                9.8k ± 5%     ~     (p=0.905 n=4+5)
      zeo/py/fs1-zwrk.go·12                                       9.80k ± 6%               9.19k ± 8%     ~     (p=0.056 n=5+5)
      zeo/py/fs1-zwrk.go·16                                       10.1k ± 6%                8.9k ±15%     ~     (p=0.095 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               3.70k ± 6%               4.77k ± 6%  +29.01%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               5.77k ± 0%               5.92k ± 0%   +2.58%  (p=0.029 n=4+4)
      neo/py(!log)/sqlite-zwrk.go·3                               5.77k ± 0%               5.76k ± 0%   -0.25%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               5.77k ± 0%               5.82k ± 2%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               5.84k ± 1%               5.75k ± 0%   -1.67%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                              5.78k ± 2%               5.71k ± 0%   -1.27%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                              5.80k ± 1%               5.71k ± 0%   -1.63%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  2.51k ±12%               3.83k ± 1%  +52.68%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  3.62k ± 8%               4.32k ± 1%  +19.32%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  3.86k ±11%               4.33k ± 0%  +12.15%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  3.82k ±11%               4.33k ± 1%  +13.35%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                  3.89k ±10%               4.36k ± 2%  +12.29%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                 3.98k ± 7%               4.29k ± 3%   +7.85%  (p=0.032 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                 3.72k ±13%               4.36k ± 2%  +17.09%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·1                                        13.8k ± 3%               14.0k ± 3%     ~     (p=0.310 n=5+5)
      neo/go/fs1-zwrk.go·2                                        28.1k ± 0%               28.4k ± 1%   +1.29%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·3                                        40.2k ± 0%               40.5k ± 0%   +0.60%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·4                                        52.8k ± 1%               53.1k ± 0%   +0.54%  (p=0.032 n=5+5)
      neo/go/fs1-zwrk.go·8                                        90.6k ± 0%               90.2k ± 0%   -0.48%  (p=0.032 n=5+5)
      neo/go/fs1-zwrk.go·12                                       95.8k ± 1%               95.0k ± 2%     ~     (p=0.151 n=5+5)
      neo/go/fs1-zwrk.go·16                                       90.9k ± 1%               90.4k ± 2%     ~     (p=0.841 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                          16.2k ± 2%               16.3k ± 2%     ~     (p=0.690 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                          32.9k ± 1%               33.4k ± 0%   +1.52%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                          46.2k ± 0%               46.5k ± 0%   +0.68%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                          59.8k ± 1%               60.4k ± 0%   +0.91%  (p=0.016 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          98.1k ± 0%               98.7k ± 1%     ~     (p=0.056 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                          102k ± 1%                103k ± 1%     ~     (p=0.095 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         97.0k ± 2%               98.4k ± 2%     ~     (p=0.095 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     5.67k ± 8%               7.97k ± 1%  +40.55%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     13.3k ± 2%               14.7k ± 1%  +10.67%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     20.3k ± 1%               21.5k ± 0%   +5.90%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     26.5k ± 0%               27.6k ± 0%   +3.93%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     44.5k ± 1%               45.1k ± 1%   +1.33%  (p=0.016 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    52.3k ± 1%               52.6k ± 0%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    48.9k ± 1%               48.8k ± 1%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              5.69k ± 4%               8.31k ± 2%  +45.99%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              13.2k ± 3%               15.2k ± 1%  +15.42%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              20.5k ± 1%               22.2k ± 0%   +8.31%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              27.1k ± 2%               28.6k ± 1%   +5.47%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              45.4k ± 1%               46.2k ± 1%   +1.67%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             53.3k ± 1%               53.5k ± 0%     ~     (p=0.222 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             49.8k ± 1%               49.8k ± 1%     ~     (p=1.000 n=5+5)
      
      name                                           old latency-time/object  new latency-time/object  delta
      cluster:z6001 dataset:wczblk1-8
      fs1-zwrk.go·1                                              4.34µs ± 1%              4.33µs ± 1%     ~     (p=0.540 n=5+5)
      fs1-zwrk.go·2                                              4.58µs ± 5%              4.51µs ± 1%     ~     (p=0.381 n=5+5)
      fs1-zwrk.go·3                                              4.52µs ± 4%              4.54µs ± 4%     ~     (p=0.952 n=5+5)
      fs1-zwrk.go·4                                              4.55µs ± 1%              4.56µs ± 3%     ~     (p=0.841 n=5+5)
      fs1-zwrk.go·8                                              4.58µs ± 2%              4.56µs ± 2%     ~     (p=0.548 n=5+5)
      fs1-zwrk.go·12                                             4.69µs ± 0%              4.77µs ± 3%     ~     (p=0.063 n=4+5)
      fs1-zwrk.go·16                                             5.53µs ± 1%              5.51µs ± 1%     ~     (p=0.310 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        233µs ± 8%               195µs ± 2%  -16.41%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        315µs ± 2%               314µs ± 2%     ~     (p=0.095 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        435µs ± 0%               426µs ± 1%   -2.08%  (p=0.016 n=4+5)
      zeo/py/fs1-zwrk.go·4                                        560µs ± 1%               554µs ± 2%     ~     (p=0.111 n=4+5)
      zeo/py/fs1-zwrk.go·8                                       1.06ms ± 2%              1.07ms ± 1%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zwrk.go·12                                      1.57ms ± 0%              1.59ms ± 0%   +1.62%  (p=0.016 n=4+5)
      zeo/py/fs1-zwrk.go·16                                      2.11ms ± 0%              2.09ms ± 1%   -1.15%  (p=0.032 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               288µs ±14%               220µs ± 2%  -23.74%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               358µs ± 0%               358µs ± 1%     ~     (p=0.730 n=4+5)
      neo/py(!log)/sqlite-zwrk.go·3                               533µs ± 2%               539µs ± 0%     ~     (p=0.190 n=5+4)
      neo/py(!log)/sqlite-zwrk.go·4                               720µs ± 1%               723µs ± 0%     ~     (p=0.095 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                              1.43ms ± 2%              1.43ms ± 2%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                             2.14ms ± 1%              2.15ms ± 0%   +0.82%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                             2.85ms ± 1%              2.87ms ± 0%     ~     (p=0.413 n=4+5)
      neo/py(!log)/sql-zwrk.go·1                                  400µs ±16%               278µs ± 1%  -30.47%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  562µs ± 8%               470µs ± 0%  -16.47%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  827µs ±13%               699µs ± 1%  -15.44%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                 1.13ms ±14%              0.96ms ±10%  -15.10%  (p=0.016 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                 2.13ms ±13%              1.90ms ± 1%  -10.78%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                3.24ms ±12%              2.82ms ± 2%  -12.82%  (p=0.032 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                4.62ms ± 8%              3.76ms ± 1%  -18.69%  (p=0.016 n=5+4)
      neo/go/fs1-zwrk.go·1                                       93.9µs ± 4%              90.4µs ± 7%     ~     (p=0.310 n=5+5)
      neo/go/fs1-zwrk.go·2                                       89.6µs ± 1%              86.5µs ± 2%   -3.55%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·3                                       94.6µs ± 1%              93.3µs ± 1%   -1.33%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·4                                       92.6µs ± 1%              91.9µs ± 0%   -0.71%  (p=0.032 n=5+5)
      neo/go/fs1-zwrk.go·8                                        102µs ± 0%               102µs ± 0%     ~     (p=0.222 n=5+5)
      neo/go/fs1-zwrk.go·12                                       130µs ± 0%               130µs ± 0%     ~     (p=0.690 n=5+5)
      neo/go/fs1-zwrk.go·16                                       156µs ± 1%               157µs ± 0%     ~     (p=0.310 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                         66.8µs ± 5%              66.1µs ± 3%     ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                         63.5µs ± 1%              62.9µs ± 1%   -0.90%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                         68.5µs ± 0%              68.0µs ± 0%   -0.81%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                         69.7µs ± 0%              69.0µs ± 0%   -0.91%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                         79.7µs ± 0%              79.9µs ± 0%     ~     (p=0.222 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         103µs ± 0%               103µs ± 0%     ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         127µs ± 1%               127µs ± 0%     ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     208µs ±14%               139µs ± 1%  -32.89%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     166µs ± 2%               147µs ± 1%  -11.70%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     158µs ± 1%               150µs ± 0%   -4.60%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     162µs ± 0%               157µs ± 0%   -3.12%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     178µs ± 0%               178µs ± 0%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    213µs ± 0%               215µs ± 0%   +0.93%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    276µs ± 0%               279µs ± 1%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              185µs ± 4%               130µs ± 1%  -29.53%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              156µs ± 1%               136µs ± 1%  -12.98%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              149µs ± 1%               139µs ± 0%   -6.76%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              149µs ± 1%               142µs ± 0%   -4.81%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              166µs ± 1%               163µs ± 0%   -2.04%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             199µs ± 0%               199µs ± 0%     ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             259µs ± 1%               259µs ± 1%     ~     (p=0.690 n=5+5)
      cluster:z6001 dataset:prod1-1024
      fs1-zwrk.go·1                                              2.88µs ± 2%              2.88µs ± 2%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·2                                              3.03µs ± 3%              3.03µs ± 3%     ~     (p=0.841 n=5+5)
      fs1-zwrk.go·3                                              3.05µs ± 4%              3.07µs ± 4%     ~     (p=0.421 n=5+5)
      fs1-zwrk.go·4                                              3.05µs ± 2%              3.09µs ± 4%     ~     (p=0.421 n=5+5)
      fs1-zwrk.go·8                                              3.14µs ± 4%              3.18µs ± 6%     ~     (p=0.690 n=5+5)
      fs1-zwrk.go·12                                             4.28µs ± 1%              3.97µs ± 1%   -7.22%  (p=0.008 n=5+5)
      fs1-zwrk.go·16                                             5.63µs ± 2%              5.23µs ± 1%   -7.01%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        208µs ± 5%               163µs ± 1%  -21.69%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        245µs ± 1%               245µs ± 2%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        335µs ± 1%               334µs ± 2%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        453µs ±10%               427µs ± 1%     ~     (p=0.548 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        803µs ± 2%               815µs ± 5%     ~     (p=0.905 n=4+5)
      zeo/py/fs1-zwrk.go·12                                      1.23ms ± 6%              1.31ms ± 8%     ~     (p=0.056 n=5+5)
      zeo/py/fs1-zwrk.go·16                                      1.59ms ± 6%              1.82ms ±14%     ~     (p=0.095 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               271µs ± 7%               210µs ± 6%  -22.43%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               346µs ± 0%               338µs ± 0%   -2.52%  (p=0.029 n=4+4)
      neo/py(!log)/sqlite-zwrk.go·3                               520µs ± 0%               521µs ± 0%   +0.25%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               694µs ± 0%               688µs ± 2%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                              1.37ms ± 1%              1.39ms ± 0%   +1.68%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                             2.07ms ± 2%              2.10ms ± 0%   +1.28%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                             2.76ms ± 1%              2.80ms ± 0%   +1.65%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  400µs ±11%               261µs ± 1%  -34.78%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  554µs ± 7%               463µs ± 1%  -16.42%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  783µs ±11%               692µs ± 0%  -11.57%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                 1.06ms ±11%              0.92ms ± 1%  -12.52%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                 2.07ms ± 9%              1.83ms ± 2%  -11.28%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                3.02ms ± 7%              2.80ms ± 3%   -7.52%  (p=0.032 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                4.32ms ±12%              3.67ms ± 2%  -15.10%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·1                                       72.6µs ± 3%              71.5µs ± 3%     ~     (p=0.310 n=5+5)
      neo/go/fs1-zwrk.go·2                                       71.2µs ± 0%              70.3µs ± 1%   -1.27%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·3                                       74.6µs ± 0%              74.1µs ± 0%   -0.59%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·4                                       75.7µs ± 1%              75.3µs ± 0%   -0.54%  (p=0.032 n=5+5)
      neo/go/fs1-zwrk.go·8                                       88.3µs ± 0%              88.7µs ± 0%   +0.48%  (p=0.032 n=5+5)
      neo/go/fs1-zwrk.go·12                                       125µs ± 1%               126µs ± 2%     ~     (p=0.151 n=5+5)
      neo/go/fs1-zwrk.go·16                                       176µs ± 1%               177µs ± 2%     ~     (p=0.841 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                         61.7µs ± 2%              61.3µs ± 2%     ~     (p=0.651 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                         60.7µs ± 1%              59.8µs ± 0%   -1.50%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                         64.9µs ± 0%              64.5µs ± 0%   -0.68%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                         66.9µs ± 1%              66.3µs ± 0%   -0.90%  (p=0.016 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                         81.5µs ± 0%              81.0µs ± 1%     ~     (p=0.056 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         118µs ± 1%               116µs ± 1%     ~     (p=0.095 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         165µs ± 2%               163µs ± 2%     ~     (p=0.095 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     177µs ± 8%               126µs ± 1%  -29.04%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     151µs ± 2%               136µs ± 1%   -9.65%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     148µs ± 1%               140µs ± 0%   -5.57%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     151µs ± 0%               145µs ± 0%   -3.78%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     180µs ± 1%               177µs ± 1%   -1.31%  (p=0.016 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    229µs ± 1%               228µs ± 0%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    327µs ± 1%               328µs ± 1%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              176µs ± 4%               120µs ± 2%  -31.54%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              152µs ± 3%               131µs ± 1%  -13.38%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              147µs ± 1%               135µs ± 0%   -7.68%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              148µs ± 2%               140µs ± 1%   -5.20%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              176µs ± 1%               173µs ± 1%   -1.65%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             225µs ± 1%               224µs ± 0%     ~     (p=0.222 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             321µs ± 1%               321µs ± 1%     ~     (p=1.000 n=5+5)
      65de70b8
    • Kirill Smelkov's avatar
      X neo1: localhost timings, C > C1 disabled · f40c8b4b
      Kirill Smelkov authored
      $ benchstat -split node,cluster,dataset 20180306-neo1-ffixed-c.txt 20180306-neo1-ffixed-noc_C1\(3µs\).txt
      
      Disabling C states helps serial cases for zeo/py and neo/py/sqlite and
      both serial and parallel cases for neo/py/sql. For neo/py/sql it also
      denoises the timing.
      
      ---- 8< ----
      cluster:neo1 dataset:wczblk1-8
      zeo/py/fs1-zhash.py                                         523µs ± 1%               465µs ± 4%  -11.04%  (p=0.008 n=5+5)
      zeo/py/fs1-zhash.go                                         194µs ± 4%               173µs ± 2%  -10.70%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                684µs ± 3%               389µs ± 1%  -43.08%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                236µs ± 2%               198µs ± 5%  -16.19%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zhash.py                                   942µs ±47%               448µs ± 3%  -52.47%  (p=0.016 n=5+4)
      neo/py(!log)/sql-zhash.go                                   300µs ±17%               251µs ± 2%  -16.37%  (p=0.008 n=5+5)
      
      zeo/py/fs1-zwrk.go·1                                        194µs ± 1%               171µs ± 1%  -11.93%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               232µs ± 4%               198µs ± 3%  -14.97%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  323µs ± 6%               242µs ± 1%  -24.90%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  503µs ± 2%               421µs ± 5%  -16.28%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  742µs ± 3%               639µs ± 4%  -13.97%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  986µs ± 4%               838µs ± 2%  -15.02%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                 2.11ms ± 8%              1.71ms ± 4%  -18.91%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                3.02ms ± 3%              2.57ms ± 3%  -14.83%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                4.06ms ± 1%              3.39ms ± 3%  -16.33%  (p=0.008 n=5+5)
      
      cluster:neo1 dataset:prod1-1024
      zeo/py/fs1-zhash.go                                         170µs ± 3%               148µs ± 3%  -13.05%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                665µs ± 2%               382µs ± 3%  -42.60%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                219µs ± 2%               181µs ± 1%  -17.27%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zhash.py                                   886µs ±56%               426µs ± 1%  -51.90%  (p=0.016 n=5+4)
      neo/py(!log)/sql-zhash.go                                   298µs ± 9%               234µs ± 2%  -21.22%  (p=0.008 n=5+5)
      
      zeo/py/fs1-zwrk.go·1                                        173µs ± 3%               146µs ± 2%  -15.31%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               204µs ± 8%               182µs ± 3%  -11.14%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  287µs ± 8%               236µs ± 8%  -17.73%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  495µs ± 6%               406µs ± 1%  -17.95%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  740µs ± 8%               618µs ± 3%  -16.50%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                 1.01ms ± 4%              0.82ms ± 2%  -18.75%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                 1.93ms ± 3%              1.64ms ± 1%  -15.14%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                3.01ms ± 4%              2.45ms ± 3%  -18.53%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                4.05ms ±10%              3.33ms ± 8%  -17.74%  (p=0.008 n=5+5)
      ---- 8< ----
      
      It looks to be also helping to neo/go/* with python (thus slower)
      client:
      
      ---- 8< ----
      cluster:neo1 dataset:wczblk1-8
      neo/go/fs1-zhash.py                                         383µs ±20%               270µs ± 2%  -29.62%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.py                                      402µs ± 6%               323µs ± 1%  -19.66%  (p=0.008 n=5+5)
      
      cluster:neo1 dataset:prod1-1024
      neo/go/fs1-zhash.py                                         319µs ±11%               260µs ± 2%  -18.46%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.py                                      382µs ± 6%               310µs ± 2%  -19.04%  (p=0.008 n=5+5)
      ---- 8< ----
      
      ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
      
      $ benchstat -split node,cluster,dataset 20180306-neo1-ffixed-c.txt 20180306-neo1-ffixed-noc_C1\(3µs\).txt
      
      name                                           old pystone/s            new pystone/s            delta
      node:neo1
      pystone                                                      106k ± 1%                106k ± 1%     ~     (p=0.548 n=5+5)
      
      name                                           old time/op              new time/op              delta
      node:neo1
      crc32/py/4K                                                5.13µs ± 1%              5.13µs ± 1%     ~     (p=1.000 n=5+5)
      crc32/go/4K                                                2.79µs ± 0%              2.79µs ± 0%   -0.06%  (p=0.032 n=5+5)
      sha1/py/4K                                                 13.4µs ± 1%              13.5µs ± 1%     ~     (p=0.548 n=5+5)
      sha1/go/4K                                                 9.83µs ± 0%              9.85µs ± 1%     ~     (p=0.905 n=5+4)
      unzlib/py/wczdata                                          36.1µs ± 0%              36.1µs ± 1%     ~     (p=0.841 n=5+5)
      unzlib/go/wczdata                                          31.1µs ± 1%              30.9µs ± 1%     ~     (p=0.111 n=5+5)
      unzlib/py/prod1-avg                                        16.3µs ± 2%              16.8µs ±10%     ~     (p=0.548 n=5+5)
      unzlib/go/prod1-avg                                        9.42µs ± 0%              9.27µs ± 1%   -1.58%  (p=0.008 n=5+5)
      disk/randread/direct/4K-min                                 162µs ± 0%               162µs ± 0%     ~     (p=0.270 n=5+4)
      disk/randread/direct/4K-avg                                 187µs ± 2%               172µs ± 0%   -8.20%  (p=0.008 n=5+5)
      disk/randread/pagecache/4K-min                              389ns ± 1%               390ns ± 1%     ~     (p=0.548 n=5+5)
      disk/randread/pagecache/4K-avg                              804ns ± 0%               894ns ± 0%  +11.28%  (p=0.016 n=4+5)
      
      name                                           old time/object          new time/object          delta
      cluster:neo1 dataset:wczblk1-8
      fs1-zhash.py                                               34.7µs ± 2%              34.4µs ± 2%     ~     (p=0.119 n=5+5)
      fs1-zhash.go                                               6.00µs ± 2%              5.90µs ± 0%     ~     (p=0.095 n=5+4)
      fs1-zhash.go+prefetch128                                   6.52µs ± 4%              6.26µs ± 3%     ~     (p=0.079 n=5+5)
      zeo/py/fs1-zhash.py                                         523µs ± 1%               465µs ± 4%  -11.04%  (p=0.008 n=5+5)
      zeo/py/fs1-zhash.go                                         194µs ± 4%               173µs ± 2%  -10.70%  (p=0.008 n=5+5)
      zeo/py/fs1-zhash.go+prefetch128                            98.6µs ± 3%              98.8µs ± 1%     ~     (p=0.810 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                684µs ± 3%               389µs ± 1%  -43.08%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                236µs ± 2%               198µs ± 5%  -16.19%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zhash.go+prefetch128                    162µs ± 2%               165µs ± 4%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sql-zhash.py                                   942µs ±47%               448µs ± 3%  -52.47%  (p=0.016 n=5+4)
      neo/py(!log)/sql-zhash.go                                   300µs ±17%               251µs ± 2%  -16.37%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zhash.go+prefetch128                       240µs ± 6%               220µs ± 1%   -8.51%  (p=0.008 n=5+5)
      neo/go/fs1-zhash.py                                         383µs ±20%               270µs ± 2%  -29.62%  (p=0.008 n=5+5)
      neo/go/fs1-zhash.go                                        81.3µs ± 1%              81.0µs ± 4%     ~     (p=0.690 n=5+5)
      neo/go/fs1-zhash.go+prefetch128                            33.8µs ± 5%              34.9µs ± 6%     ~     (p=0.381 n=5+5)
      neo/go/fs1(!sha1)-zhash.go(!sha1)                          57.6µs ± 3%              56.0µs ± 3%   -2.71%  (p=0.024 n=5+5)
      neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1)              22.9µs ± 6%              22.7µs ± 7%     ~     (p=1.000 n=5+5)
      neo/go/sqlite-zhash.py                                      402µs ± 6%               323µs ± 1%  -19.66%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.go                                      125µs ± 1%               124µs ± 1%     ~     (p=0.056 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128                         48.4µs ± 8%              46.9µs ± 2%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zhash.go(!sha1)                               116µs ± 2%               113µs ± 2%   -1.96%  (p=0.032 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128(!sha1)                  45.9µs ± 5%              46.6µs ± 4%     ~     (p=0.341 n=5+5)
      cluster:neo1 dataset:prod1-1024
      fs1-zhash.py                                               28.9µs ± 1%              28.9µs ± 1%     ~     (p=0.746 n=5+5)
      fs1-zhash.go                                               3.76µs ± 4%              3.76µs ± 2%     ~     (p=1.000 n=5+5)
      fs1-zhash.go+prefetch128                                   3.86µs ± 2%              3.74µs ± 2%   -3.11%  (p=0.048 n=5+5)
      zeo/py/fs1-zhash.py                                         474µs ± 2%               442µs ± 9%     ~     (p=0.095 n=5+5)
      zeo/py/fs1-zhash.go                                         170µs ± 3%               148µs ± 3%  -13.05%  (p=0.008 n=5+5)
      zeo/py/fs1-zhash.go+prefetch128                            87.8µs ± 1%              87.9µs ± 2%     ~     (p=0.881 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                665µs ± 2%               382µs ± 3%  -42.60%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                219µs ± 2%               181µs ± 1%  -17.27%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zhash.go+prefetch128                    151µs ± 1%               150µs ± 1%     ~     (p=0.206 n=5+4)
      neo/py(!log)/sql-zhash.py                                   886µs ±56%               426µs ± 1%  -51.90%  (p=0.016 n=5+4)
      neo/py(!log)/sql-zhash.go                                   298µs ± 9%               234µs ± 2%  -21.22%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zhash.go+prefetch128                       230µs ± 3%               210µs ± 6%   -8.71%  (p=0.008 n=5+5)
      neo/go/fs1-zhash.py                                         319µs ±11%               260µs ± 2%  -18.46%  (p=0.008 n=5+5)
      neo/go/fs1-zhash.go                                        61.3µs ± 3%              61.4µs ± 2%     ~     (p=0.802 n=5+5)
      neo/go/fs1-zhash.go+prefetch128                            22.5µs ± 3%              22.2µs ± 5%     ~     (p=0.595 n=5+5)
      neo/go/fs1(!sha1)-zhash.go(!sha1)                          52.0µs ± 3%              51.9µs ± 4%     ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1)              18.3µs ± 2%              18.3µs ± 3%     ~     (p=0.667 n=5+5)
      neo/go/sqlite-zhash.py                                      382µs ± 6%               310µs ± 2%  -19.04%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.go                                      113µs ± 1%               112µs ± 1%     ~     (p=0.063 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128                         40.9µs ± 4%              41.9µs ± 4%     ~     (p=0.190 n=5+5)
      neo/go/sqlite-zhash.go(!sha1)                               108µs ± 1%               107µs ± 1%     ~     (p=0.056 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128(!sha1)                  41.1µs ± 5%              41.1µs ± 2%     ~     (p=0.881 n=5+5)
      
      name                                           old req/s                new req/s                delta
      cluster:neo1 dataset:wczblk1-8
      fs1-zwrk.go·1                                                229k ± 0%                229k ± 0%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·2                                                443k ± 1%                439k ± 0%     ~     (p=0.111 n=5+4)
      fs1-zwrk.go·3                                                662k ± 1%                660k ± 1%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·4                                                867k ± 1%                865k ± 0%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·8                                                988k ± 0%                959k ±11%     ~     (p=0.548 n=5+5)
      fs1-zwrk.go·12                                              1.02M ± 0%               1.02M ± 0%     ~     (p=0.841 n=5+5)
      fs1-zwrk.go·16                                               976k ±12%               1015k ± 0%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        5.15k ± 1%               5.84k ± 1%  +13.54%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        7.08k ± 1%               7.05k ± 5%     ~     (p=0.841 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        7.73k ± 1%               7.82k ± 1%   +1.29%  (p=0.032 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        7.97k ± 4%               8.07k ± 1%     ~     (p=0.421 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        8.30k ± 2%               8.40k ± 2%     ~     (p=0.095 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       8.15k ± 1%               8.40k ± 2%   +3.08%  (p=0.016 n=5+5)
      zeo/py/fs1-zwrk.go·16                                       8.25k ± 1%               8.48k ± 1%   +2.85%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               4.31k ± 4%               5.06k ± 3%  +17.59%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               6.28k ± 5%               6.39k ± 0%     ~     (p=0.730 n=5+4)
      neo/py(!log)/sqlite-zwrk.go·3                               6.38k ± 0%               6.28k ± 8%     ~     (p=0.730 n=4+5)
      neo/py(!log)/sqlite-zwrk.go·4                               6.15k ± 5%               6.10k ± 5%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               6.27k ± 4%               6.22k ± 9%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                              6.33k ± 2%               6.28k ± 6%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                              6.25k ± 4%               6.17k ± 6%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  3.10k ± 6%               4.12k ± 1%  +33.05%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  3.98k ± 1%               4.76k ± 5%  +19.62%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  4.04k ± 3%               4.70k ± 4%  +16.27%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  4.06k ± 4%               4.78k ± 2%  +17.62%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                  3.79k ± 7%               4.67k ± 5%  +23.22%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                 3.98k ± 3%               4.67k ± 3%  +17.40%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                 3.94k ± 1%               4.72k ± 3%  +19.55%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·1                                        12.8k ± 0%               12.8k ± 1%     ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·2                                        24.8k ± 0%               25.0k ± 1%     ~     (p=0.063 n=4+5)
      neo/go/fs1-zwrk.go·3                                        32.3k ± 0%               32.2k ± 2%     ~     (p=0.222 n=5+5)
      neo/go/fs1-zwrk.go·4                                        40.7k ± 0%               40.9k ± 0%   +0.47%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·8                                        54.5k ± 1%               54.9k ± 0%   +0.66%  (p=0.016 n=5+5)
      neo/go/fs1-zwrk.go·12                                       56.5k ± 1%               56.7k ± 1%     ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·16                                       53.2k ±10%               54.4k ± 2%     ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                          19.0k ± 2%               19.3k ± 2%     ~     (p=0.056 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                          37.8k ± 0%               37.8k ± 1%     ~     (p=0.841 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                          48.0k ± 1%               48.2k ± 0%   +0.50%  (p=0.032 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                          59.0k ± 0%               59.2k ± 0%   +0.39%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          78.0k ± 1%               78.3k ± 0%     ~     (p=0.095 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         82.2k ± 2%               82.5k ± 1%     ~     (p=0.690 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         80.4k ± 1%               80.3k ± 2%     ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     8.06k ± 4%               8.24k ± 1%   +2.17%  (p=0.016 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     14.9k ± 0%               15.0k ± 0%     ~     (p=0.095 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     20.7k ± 0%               20.8k ± 0%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     24.8k ± 0%               24.9k ± 0%   +0.39%  (p=0.016 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     31.7k ± 1%               31.6k ± 1%     ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    30.8k ± 5%               31.4k ± 1%     ~     (p=0.310 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    30.4k ± 2%               30.6k ± 3%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              8.95k ± 1%               9.05k ± 1%     ~     (p=0.056 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              16.2k ± 1%               16.3k ± 1%   +0.88%  (p=0.016 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              22.6k ± 0%               22.6k ± 0%     ~     (p=0.905 n=4+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              27.9k ± 0%               27.7k ± 0%   -0.83%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              35.0k ± 1%               34.4k ± 1%   -1.78%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             34.7k ± 1%               33.4k ± 2%   -3.68%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             33.0k ±11%               32.9k ± 2%     ~     (p=0.151 n=5+5)
      cluster:neo1 dataset:prod1-1024
      fs1-zwrk.go·1                                                451k ± 0%                451k ± 1%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·2                                                893k ± 0%                871k ± 9%     ~     (p=0.690 n=5+5)
      fs1-zwrk.go·3                                               1.34M ± 1%               1.33M ± 0%     ~     (p=0.690 n=5+5)
      fs1-zwrk.go·4                                               1.77M ± 0%               1.76M ± 0%     ~     (p=0.310 n=5+5)
      fs1-zwrk.go·8                                               1.99M ± 1%               2.00M ± 2%     ~     (p=0.421 n=5+5)
      fs1-zwrk.go·12                                              2.03M ± 1%               2.03M ± 0%     ~     (p=0.556 n=4+5)
      fs1-zwrk.go·16                                              2.03M ± 0%               2.03M ± 0%     ~     (p=0.111 n=5+4)
      zeo/py/fs1-zwrk.go·1                                        5.79k ± 3%               6.83k ± 2%  +18.03%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        8.55k ± 1%               8.70k ± 1%   +1.74%  (p=0.016 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        9.28k ± 7%               9.54k ± 2%     ~     (p=0.151 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        9.72k ± 1%               9.77k ± 1%     ~     (p=0.151 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        10.4k ± 1%               10.5k ± 1%     ~     (p=0.421 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       10.5k ± 1%               10.6k ± 1%     ~     (p=0.310 n=5+5)
      zeo/py/fs1-zwrk.go·16                                       10.4k ± 4%               10.7k ± 1%   +2.75%  (p=0.016 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               4.90k ± 7%               5.51k ± 3%  +12.34%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               6.28k ± 4%               6.38k ± 3%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               6.32k ± 5%               6.27k ± 5%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               6.45k ± 2%               6.54k ± 0%   +1.35%  (p=0.032 n=5+4)
      neo/py(!log)/sqlite-zwrk.go·8                               6.45k ± 2%               6.48k ± 2%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                              6.31k ± 3%               6.43k ± 2%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                              6.36k ± 5%               6.41k ± 3%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  3.50k ± 9%               4.25k ± 7%  +21.25%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  4.05k ± 6%               4.92k ± 1%  +21.64%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  4.06k ± 7%               4.85k ± 3%  +19.49%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  3.98k ± 4%               4.90k ± 2%  +22.98%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                  4.15k ± 3%               4.89k ± 1%  +17.81%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                 4.00k ± 5%               4.90k ± 3%  +22.72%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                 3.96k ±11%               4.81k ± 7%  +21.32%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·1                                        17.1k ± 1%               17.4k ± 2%   +2.02%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·2                                        32.6k ± 0%               32.8k ± 1%     ~     (p=0.310 n=5+5)
      neo/go/fs1-zwrk.go·3                                        43.3k ± 0%               43.2k ± 0%     ~     (p=1.000 n=5+5)
      neo/go/fs1-zwrk.go·4                                        52.9k ± 0%               52.9k ± 0%     ~     (p=0.905 n=5+4)
      neo/go/fs1-zwrk.go·8                                        66.3k ± 1%               65.4k ± 1%     ~     (p=0.063 n=4+5)
      neo/go/fs1-zwrk.go·12                                       61.6k ± 1%               59.6k ± 4%   -3.20%  (p=0.016 n=5+5)
      neo/go/fs1-zwrk.go·16                                       55.6k ± 4%               53.9k ± 2%     ~     (p=0.056 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                          19.6k ± 5%               20.1k ± 2%     ~     (p=0.310 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                          40.3k ± 0%               39.9k ± 5%     ~     (p=0.690 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                          51.6k ± 0%               51.7k ± 0%     ~     (p=0.421 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                          62.0k ± 0%               62.5k ± 0%   +0.78%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          74.2k ± 4%               74.0k ± 3%     ~     (p=0.841 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         64.8k ± 7%               66.8k ± 3%     ~     (p=0.222 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         59.5k ± 4%               58.6k ± 2%     ~     (p=0.222 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     9.02k ± 1%               9.16k ± 1%   +1.58%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     16.0k ± 0%               16.0k ± 1%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     21.8k ± 1%               21.8k ± 0%     ~     (p=0.730 n=4+5)
      neo/go/sqlite-zwrk.go·4                                     26.2k ± 0%               26.2k ± 1%     ~     (p=0.905 n=5+4)
      neo/go/sqlite-zwrk.go·8                                     30.0k ± 2%               29.9k ± 1%     ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    28.6k ± 2%               28.5k ± 2%     ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    28.7k ± 1%               28.9k ± 2%     ~     (p=0.730 n=4+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              9.45k ± 1%               9.51k ± 1%     ~     (p=0.222 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              16.6k ± 1%               16.5k ± 1%     ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              23.0k ± 0%               22.7k ± 0%   -1.37%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              28.0k ± 1%               27.4k ± 0%   -2.02%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              32.3k ± 0%               30.4k ±12%   -5.86%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             30.6k ± 2%               29.6k ± 2%   -3.24%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             30.3k ± 2%               29.5k ± 2%   -2.73%  (p=0.008 n=5+5)
      
      name                                           old latency-time/object  new latency-time/object  delta
      cluster:neo1 dataset:wczblk1-8
      fs1-zwrk.go·1                                              4.36µs ± 0%              4.37µs ± 0%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·2                                              4.52µs ± 1%              4.56µs ± 0%     ~     (p=0.111 n=5+4)
      fs1-zwrk.go·3                                              4.53µs ± 1%              4.54µs ± 1%     ~     (p=0.881 n=5+5)
      fs1-zwrk.go·4                                              4.61µs ± 1%              4.62µs ± 0%     ~     (p=0.889 n=5+5)
      fs1-zwrk.go·8                                              8.10µs ± 0%              8.37µs ±12%     ~     (p=0.548 n=5+5)
      fs1-zwrk.go·12                                             11.8µs ± 0%              11.8µs ± 0%     ~     (p=0.841 n=5+5)
      fs1-zwrk.go·16                                             16.5µs ±13%              15.8µs ± 0%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        194µs ± 1%               171µs ± 1%  -11.93%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        282µs ± 1%               284µs ± 5%     ~     (p=0.841 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        388µs ± 1%               383µs ± 1%   -1.27%  (p=0.032 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        502µs ± 5%               496µs ± 1%     ~     (p=0.421 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        964µs ± 2%               952µs ± 2%     ~     (p=0.095 n=5+5)
      zeo/py/fs1-zwrk.go·12                                      1.47ms ± 1%              1.43ms ± 2%   -2.98%  (p=0.016 n=5+5)
      zeo/py/fs1-zwrk.go·16                                      1.94ms ± 1%              1.89ms ± 1%   -2.77%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               232µs ± 4%               198µs ± 3%  -14.97%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               319µs ± 5%               313µs ± 0%     ~     (p=0.730 n=5+4)
      neo/py(!log)/sqlite-zwrk.go·3                               470µs ± 0%               469µs ± 1%     ~     (p=0.343 n=4+4)
      neo/py(!log)/sqlite-zwrk.go·4                               651µs ± 5%               656µs ± 5%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                              1.28ms ± 4%              1.29ms ±10%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                             1.90ms ± 2%              1.91ms ± 6%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                             2.56ms ± 4%              2.60ms ± 6%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  323µs ± 6%               242µs ± 1%  -24.90%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  503µs ± 2%               421µs ± 5%  -16.28%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  742µs ± 3%               639µs ± 4%  -13.97%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  986µs ± 4%               838µs ± 2%  -15.02%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                 2.11ms ± 8%              1.71ms ± 4%  -18.91%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                3.02ms ± 3%              2.57ms ± 3%  -14.83%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                4.06ms ± 1%              3.39ms ± 3%  -16.33%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·1                                       77.8µs ± 0%              78.2µs ± 1%     ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·2                                       80.6µs ± 0%              80.0µs ± 1%     ~     (p=0.063 n=4+5)
      neo/go/fs1-zwrk.go·3                                       92.8µs ± 0%              93.1µs ± 2%     ~     (p=0.222 n=5+5)
      neo/go/fs1-zwrk.go·4                                       98.2µs ± 0%              97.7µs ± 0%   -0.47%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·8                                        147µs ± 1%               146µs ± 0%   -0.66%  (p=0.016 n=5+5)
      neo/go/fs1-zwrk.go·12                                       212µs ± 1%               212µs ± 1%     ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·16                                       293µs ± 1%               294µs ± 2%     ~     (p=0.556 n=4+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                         52.7µs ± 2%              51.8µs ± 2%     ~     (p=0.056 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                         53.0µs ± 0%              52.9µs ± 1%     ~     (p=0.841 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                         62.5µs ± 1%              62.2µs ± 0%   -0.50%  (p=0.032 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                         67.8µs ± 0%              67.6µs ± 0%   -0.39%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          103µs ± 1%               102µs ± 0%     ~     (p=0.095 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         146µs ± 2%               145µs ± 1%     ~     (p=0.690 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         199µs ± 1%               199µs ± 2%     ~     (p=0.794 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     124µs ± 4%               121µs ± 1%   -2.17%  (p=0.016 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     134µs ± 0%               134µs ± 0%     ~     (p=0.095 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     145µs ± 0%               144µs ± 0%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     161µs ± 0%               161µs ± 0%   -0.38%  (p=0.016 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     252µs ± 1%               253µs ± 1%     ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    390µs ± 5%               382µs ± 1%     ~     (p=0.310 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    526µs ± 2%               524µs ± 3%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              112µs ± 1%               110µs ± 1%     ~     (p=0.056 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              124µs ± 1%               123µs ± 1%   -0.87%  (p=0.016 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              133µs ± 0%               133µs ± 0%     ~     (p=0.905 n=4+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              143µs ± 0%               145µs ± 0%   +0.83%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              228µs ± 1%               232µs ± 1%   +1.81%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             346µs ± 1%               359µs ± 2%   +3.82%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             486µs ±11%               486µs ± 2%     ~     (p=0.151 n=5+5)
      cluster:neo1 dataset:prod1-1024
      fs1-zwrk.go·1                                              2.22µs ± 1%              2.22µs ± 1%     ~     (p=0.889 n=5+5)
      fs1-zwrk.go·2                                              2.24µs ± 0%              2.30µs ± 9%     ~     (p=0.690 n=5+5)
      fs1-zwrk.go·3                                              2.25µs ± 1%              2.25µs ± 0%     ~     (p=0.738 n=5+5)
      fs1-zwrk.go·4                                              2.26µs ± 0%              2.27µs ± 0%     ~     (p=0.286 n=5+5)
      fs1-zwrk.go·8                                              4.02µs ± 1%              4.00µs ± 2%     ~     (p=0.460 n=5+5)
      fs1-zwrk.go·12                                             5.92µs ± 1%              5.91µs ± 0%     ~     (p=0.619 n=4+5)
      fs1-zwrk.go·16                                             7.87µs ± 0%              7.88µs ± 0%     ~     (p=0.127 n=5+4)
      zeo/py/fs1-zwrk.go·1                                        173µs ± 3%               146µs ± 2%  -15.31%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        234µs ± 1%               230µs ± 1%   -1.71%  (p=0.016 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        324µs ± 7%               315µs ± 2%     ~     (p=0.151 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        412µs ± 1%               409µs ± 1%     ~     (p=0.151 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        768µs ± 1%               765µs ± 1%     ~     (p=0.421 n=5+5)
      zeo/py/fs1-zwrk.go·12                                      1.14ms ± 1%              1.13ms ± 1%     ~     (p=0.310 n=5+5)
      zeo/py/fs1-zwrk.go·16                                      1.54ms ± 4%              1.49ms ± 1%   -2.71%  (p=0.016 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               204µs ± 8%               182µs ± 3%  -11.14%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               319µs ± 4%               314µs ± 3%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               475µs ± 5%               479µs ± 5%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               620µs ± 2%               612µs ± 0%   -1.34%  (p=0.032 n=5+4)
      neo/py(!log)/sqlite-zwrk.go·8                              1.24ms ± 2%              1.23ms ± 2%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                             1.90ms ± 3%              1.87ms ± 2%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                             2.52ms ± 5%              2.49ms ± 3%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  287µs ± 8%               236µs ± 8%  -17.73%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  495µs ± 6%               406µs ± 1%  -17.95%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  740µs ± 8%               618µs ± 3%  -16.50%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                 1.01ms ± 4%              0.82ms ± 2%  -18.75%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                 1.93ms ± 3%              1.64ms ± 1%  -15.14%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                3.01ms ± 4%              2.45ms ± 3%  -18.53%  (p=0.008 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                4.05ms ±10%              3.33ms ± 8%  -17.74%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·1                                       58.5µs ± 1%              57.4µs ± 2%   -1.98%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·2                                       61.4µs ± 0%              61.1µs ± 1%     ~     (p=0.238 n=5+5)
      neo/go/fs1-zwrk.go·3                                       69.3µs ± 0%              69.4µs ± 0%     ~     (p=0.881 n=5+5)
      neo/go/fs1-zwrk.go·4                                       75.6µs ± 0%              75.6µs ± 0%     ~     (p=0.952 n=5+4)
      neo/go/fs1-zwrk.go·8                                        121µs ± 1%               122µs ± 1%     ~     (p=0.063 n=4+5)
      neo/go/fs1-zwrk.go·12                                       195µs ± 1%               201µs ± 4%   +3.35%  (p=0.016 n=5+5)
      neo/go/fs1-zwrk.go·16                                       288µs ± 4%               297µs ± 2%     ~     (p=0.056 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                         50.9µs ± 5%              49.8µs ± 2%     ~     (p=0.310 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                         49.7µs ± 0%              50.1µs ± 5%     ~     (p=0.690 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                         58.2µs ± 0%              58.0µs ± 0%     ~     (p=0.421 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                         64.5µs ± 0%              64.0µs ± 0%   -0.77%  (p=0.008 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          108µs ± 4%               108µs ± 3%     ~     (p=0.841 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         185µs ± 8%               180µs ± 3%     ~     (p=0.222 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         269µs ± 4%               273µs ± 2%     ~     (p=0.222 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     111µs ± 1%               109µs ± 1%   -1.55%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     125µs ± 0%               125µs ± 1%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     137µs ± 1%               137µs ± 0%     ~     (p=0.730 n=4+5)
      neo/go/sqlite-zwrk.go·4                                     153µs ± 0%               153µs ± 1%     ~     (p=0.905 n=5+4)
      neo/go/sqlite-zwrk.go·8                                     267µs ± 1%               267µs ± 1%     ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    420µs ± 2%               421µs ± 2%     ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    558µs ± 1%               554µs ± 2%     ~     (p=0.730 n=4+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              106µs ± 1%               105µs ± 1%     ~     (p=0.222 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              121µs ± 1%               121µs ± 1%     ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              130µs ± 0%               132µs ± 0%   +1.39%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              143µs ± 1%               146µs ± 0%   +2.06%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              248µs ± 0%               264µs ±13%   +6.65%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             393µs ± 2%               406µs ± 2%   +3.34%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             528µs ± 2%               543µs ± 2%   +2.81%  (p=0.008 n=5+5)
      f40c8b4b
    • Kirill Smelkov's avatar
      X deco: localhost timings, C > C1 disabled · 0867c981
      Kirill Smelkov authored
      Probably what is above noise is:
      
      ---- 8< ----
      cluster:deco dataset:wczblk1-8
      zeo/py/fs1-zhash.go                                         126µs ± 1%               112µs ± 1%  -10.86%  (p=0.008 n=5+5)
      
      zeo/py/fs1-zwrk.go·1                                        9.12k ± 0%               8.04k ± 4%  -11.87%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        11.6k ± 1%                9.5k ± 1%  -17.54%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        13.4k ± 1%               10.5k ± 0%  -21.56%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        14.0k ± 1%               11.0k ± 1%  -21.81%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        14.7k ± 1%               11.4k ± 1%  -22.03%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       15.0k ± 1%               11.7k ± 0%  -22.09%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·16                                       15.1k ± 0%               11.8k ± 2%  -22.32%  (p=0.008 n=5+5)
      
      zeo/py/fs1-zwrk.go·1                                        110µs ± 0%               125µs ± 4%  +13.55%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        173µs ± 1%               210µs ± 1%  +21.27%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        224µs ± 1%               286µs ± 0%  +27.49%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        286µs ± 1%               365µs ± 1%  +27.90%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        545µs ± 1%               699µs ± 1%  +28.25%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       802µs ± 1%              1029µs ± 0%  +28.35%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·16                                      1.06ms ± 0%              1.36ms ± 2%  +28.74%  (p=0.008 n=5+5)
      ---- 8< ----
      
      however it strangely shows that serial zeo-zhash.go latency improved
      126µs -> 112µs and serial zeo-zwrk.go latency got worse 110µs -> 125µs,
      so probably it is all noise and I will remeasure.
      
      Otherwise no significant change.
      
      $ benchstat -split node,cluster,dataset 20180306-deco-ffixed-c.txt 20180306-deco-ffixed-noc_C1\(2µs\).txt
      
      name                                           old pystone/s            new pystone/s            delta
      node:deco
      pystone                                                      217k ± 4%                218k ± 2%     ~     (p=0.841 n=5+5)
      
      name                                           old time/op              new time/op              delta
      node:deco
      crc32/py/4K                                                5.73µs ± 0%              5.72µs ± 0%     ~     (p=0.151 n=5+5)
      crc32/go/4K                                                 279ns ± 0%               280ns ± 1%     ~     (p=0.444 n=5+5)
      sha1/py/4K                                                 6.74µs ± 1%              6.72µs ± 1%     ~     (p=0.310 n=5+5)
      sha1/go/4K                                                 5.60µs ± 0%              5.59µs ± 0%   -0.16%  (p=0.016 n=5+4)
      unzlib/py/wczdata                                          27.2µs ± 1%              27.2µs ± 1%     ~     (p=0.690 n=5+5)
      unzlib/go/wczdata                                          27.0µs ± 0%              26.8µs ± 0%   -0.49%  (p=0.032 n=5+5)
      unzlib/py/prod1-avg                                        5.14µs ± 3%              5.08µs ± 1%     ~     (p=0.690 n=5+5)
      unzlib/go/prod1-avg                                        5.30µs ± 1%              5.29µs ± 1%     ~     (p=0.151 n=5+5)
      disk/randread/direct/4K-min                                 104µs ± 2%               105µs ± 0%   +1.23%  (p=0.016 n=5+5)
      disk/randread/direct/4K-avg                                 141µs ± 0%               142µs ± 0%   +0.60%  (p=0.008 n=5+5)
      disk/randread/pagecache/4K-min                              579ns ± 2%               582ns ± 0%     ~     (p=0.548 n=5+5)
      disk/randread/pagecache/4K-avg                              993ns ± 0%               987ns ± 0%   -0.60%  (p=0.008 n=5+5)
      
      name                                           old time/object          new time/object          delta
      cluster:deco dataset:wczblk1-8
      fs1-zhash.py                                               20.3µs ± 1%              20.2µs ± 1%     ~     (p=0.444 n=4+5)
      fs1-zhash.go                                               3.26µs ± 4%              3.20µs ± 0%     ~     (p=0.444 n=5+5)
      fs1-zhash.go+prefetch128                                   4.04µs ± 1%              4.14µs ± 1%     ~     (p=0.079 n=5+5)
      zeo/py/fs1-zhash.py                                         383µs ± 5%               361µs ± 3%     ~     (p=0.056 n=5+5)
      zeo/py/fs1-zhash.go                                         126µs ± 1%               112µs ± 1%  -10.86%  (p=0.008 n=5+5)
      zeo/py/fs1-zhash.go+prefetch128                            63.1µs ± 1%              63.9µs ± 1%   +1.14%  (p=0.040 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                344µs ± 6%               321µs ± 8%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                140µs ± 1%               141µs ± 3%     ~     (p=0.286 n=5+5)
      neo/py(!log)/sqlite-zhash.go+prefetch128                    119µs ± 2%               119µs ± 1%     ~     (p=0.897 n=5+5)
      neo/py(!log)/sql-zhash.py                                   386µs ± 1%               376µs ± 2%     ~     (p=0.114 n=4+4)
      neo/py(!log)/sql-zhash.go                                   183µs ± 3%               187µs ± 5%     ~     (p=0.341 n=5+5)
      neo/py(!log)/sql-zhash.go+prefetch128                       164µs ± 3%               164µs ± 2%     ~     (p=1.000 n=5+5)
      neo/go/fs1-zhash.py                                         226µs ± 3%               226µs ± 2%     ~     (p=0.841 n=5+5)
      neo/go/fs1-zhash.go                                        57.1µs ± 0%              57.1µs ± 1%     ~     (p=1.000 n=5+5)
      neo/go/fs1-zhash.go+prefetch128                            24.7µs ± 5%              24.0µs ± 4%   -2.91%  (p=0.048 n=5+5)
      neo/go/fs1(!sha1)-zhash.go(!sha1)                          40.2µs ± 1%              40.3µs ± 1%     ~     (p=0.952 n=5+5)
      neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1)              17.1µs ± 6%              17.2µs ± 4%     ~     (p=0.786 n=5+5)
      neo/go/sqlite-zhash.py                                      272µs ± 3%               253µs ± 1%   -6.99%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.go                                     92.8µs ± 0%              93.7µs ± 1%   +0.99%  (p=0.016 n=4+5)
      neo/go/sqlite-zhash.go+prefetch128                         40.5µs ± 5%              39.5µs ± 6%     ~     (p=0.222 n=5+5)
      neo/go/sqlite-zhash.go(!sha1)                              86.5µs ± 2%              86.4µs ± 3%     ~     (p=0.571 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128(!sha1)                  38.8µs ± 9%              39.4µs ± 7%     ~     (p=0.730 n=5+5)
      cluster:deco dataset:prod1-1024
      fs1-zhash.py                                               15.8µs ± 3%              15.9µs ± 2%     ~     (p=0.413 n=4+5)
      fs1-zhash.go                                               2.80µs ± 0%              2.80µs ± 0%     ~     (all equal)
      fs1-zhash.go+prefetch128                                   3.42µs ± 8%              3.34µs ± 2%     ~     (p=0.683 n=5+5)
      zeo/py/fs1-zhash.py                                         361µs ± 5%               347µs ± 3%     ~     (p=0.095 n=5+5)
      zeo/py/fs1-zhash.go                                         105µs ± 0%               105µs ± 0%   -0.42%  (p=0.016 n=5+5)
      zeo/py/fs1-zhash.go+prefetch128                            58.9µs ± 1%              58.9µs ± 1%     ~     (p=0.508 n=5+5)
      neo/py(!log)/sqlite-zhash.py                                344µs ± 7%               317µs ± 5%   -7.93%  (p=0.016 n=5+5)
      neo/py(!log)/sqlite-zhash.go                                137µs ± 2%               138µs ± 1%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zhash.go+prefetch128                    114µs ± 1%               112µs ± 1%   -1.48%  (p=0.024 n=5+5)
      neo/py(!log)/sql-zhash.py                                   380µs ± 4%               377µs ± 2%     ~     (p=1.000 n=4+4)
      neo/py(!log)/sql-zhash.go                                   180µs ± 1%               184µs ± 2%   +2.44%  (p=0.032 n=5+5)
      neo/py(!log)/sql-zhash.go+prefetch128                       159µs ± 1%               160µs ± 2%     ~     (p=0.889 n=5+5)
      neo/go/fs1-zhash.py                                         221µs ± 1%               225µs ± 1%   +1.59%  (p=0.016 n=5+5)
      neo/go/fs1-zhash.go                                        45.2µs ± 2%              44.6µs ± 0%   -1.37%  (p=0.016 n=5+5)
      neo/go/fs1-zhash.go+prefetch128                            17.6µs ± 2%              17.2µs ± 3%     ~     (p=0.087 n=5+5)
      neo/go/fs1(!sha1)-zhash.go(!sha1)                          39.1µs ± 2%              39.1µs ± 3%     ~     (p=0.659 n=5+5)
      neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1)              14.6µs ± 4%              15.2µs ± 3%   +4.25%  (p=0.024 n=5+5)
      neo/go/sqlite-zhash.py                                      271µs ± 2%               254µs ± 1%   -6.14%  (p=0.008 n=5+5)
      neo/go/sqlite-zhash.go                                     86.4µs ± 0%              86.3µs ± 0%     ~     (p=0.325 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128                         35.8µs ± 2%              36.6µs ± 5%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zhash.go(!sha1)                              84.0µs ± 1%              83.8µs ± 2%     ~     (p=0.952 n=5+5)
      neo/go/sqlite-zhash.go+prefetch128(!sha1)                  36.5µs ± 5%              36.9µs ± 8%     ~     (p=1.000 n=5+5)
      
      name                                           old req/s                new req/s                delta
      cluster:deco dataset:wczblk1-8
      fs1-zwrk.go·1                                                436k ± 0%                431k ± 1%   -1.23%  (p=0.008 n=5+5)
      fs1-zwrk.go·2                                                744k ± 1%                760k ± 3%     ~     (p=0.056 n=5+5)
      fs1-zwrk.go·3                                               1.09M ± 0%               1.08M ± 2%     ~     (p=0.095 n=5+5)
      fs1-zwrk.go·4                                               1.16M ± 1%               1.16M ± 1%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·8                                               1.27M ± 1%               1.27M ± 1%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·12                                              1.27M ± 1%               1.28M ± 1%     ~     (p=0.310 n=5+5)
      fs1-zwrk.go·16                                              1.27M ± 1%               1.28M ± 1%     ~     (p=0.222 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        9.12k ± 0%               8.04k ± 4%  -11.87%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        11.6k ± 1%                9.5k ± 1%  -17.54%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        13.4k ± 1%               10.5k ± 0%  -21.56%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        14.0k ± 1%               11.0k ± 1%  -21.81%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        14.7k ± 1%               11.4k ± 1%  -22.03%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       15.0k ± 1%               11.7k ± 0%  -22.09%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·16                                       15.1k ± 0%               11.8k ± 2%  -22.32%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               7.09k ± 1%               7.04k ± 1%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               8.48k ± 1%               8.52k ± 1%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               8.48k ± 1%               8.51k ± 1%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               8.47k ± 1%               8.50k ± 1%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               8.43k ± 1%               8.53k ± 1%   +1.16%  (p=0.032 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                              8.46k ± 1%               8.48k ± 2%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                              8.46k ± 1%               8.48k ± 1%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  5.51k ± 1%               5.37k ± 3%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  6.32k ± 1%               6.34k ± 0%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  6.29k ± 1%               6.28k ± 1%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  6.27k ± 1%               6.29k ± 1%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                  6.27k ± 1%               6.29k ± 1%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                 6.29k ± 0%               6.25k ± 1%     ~     (p=0.056 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                 6.22k ± 1%               6.23k ± 2%     ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·1                                        18.4k ± 1%               18.4k ± 0%     ~     (p=0.151 n=5+5)
      neo/go/fs1-zwrk.go·2                                        38.1k ± 1%               38.3k ± 1%     ~     (p=0.310 n=5+5)
      neo/go/fs1-zwrk.go·3                                        46.0k ± 1%               45.9k ± 0%     ~     (p=1.000 n=5+5)
      neo/go/fs1-zwrk.go·4                                        50.2k ± 1%               50.0k ± 0%     ~     (p=0.056 n=5+5)
      neo/go/fs1-zwrk.go·8                                        61.0k ± 0%               60.3k ± 1%   -1.09%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·12                                       62.1k ± 1%               62.1k ± 1%     ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·16                                       62.5k ± 1%               61.6k ± 1%   -1.37%  (p=0.032 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                          26.3k ± 1%               26.3k ± 0%     ~     (p=0.841 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                          55.3k ± 1%               55.7k ± 1%     ~     (p=0.056 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                          62.7k ± 1%               62.8k ± 1%     ~     (p=0.690 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                          69.3k ± 1%               69.4k ± 1%     ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          88.2k ± 0%               88.3k ± 1%     ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         93.4k ± 0%               93.5k ± 1%     ~     (p=0.421 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         93.5k ± 2%               93.8k ± 0%     ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     11.0k ± 1%               11.0k ± 0%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     18.4k ± 1%               18.3k ± 1%     ~     (p=0.556 n=5+4)
      neo/go/sqlite-zwrk.go·3                                     24.4k ± 1%               24.2k ± 0%   -0.73%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     26.8k ± 0%               26.8k ± 1%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     30.4k ± 2%               29.6k ± 2%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    30.5k ± 1%               29.3k ± 2%   -4.15%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    29.9k ± 2%               28.6k ± 1%   -4.50%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              11.9k ± 1%               11.9k ± 1%     ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              19.7k ± 0%               19.6k ± 1%     ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              26.5k ± 1%               26.4k ± 0%     ~     (p=0.310 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              30.0k ± 0%               30.0k ± 0%     ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              31.2k ± 2%               31.2k ± 2%     ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             28.9k ± 1%               28.8k ± 3%     ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             28.4k ± 2%               28.4k ± 1%     ~     (p=0.841 n=5+5)
      cluster:deco dataset:prod1-1024
      fs1-zwrk.go·1                                                555k ± 0%                556k ± 0%     ~     (p=0.421 n=5+5)
      fs1-zwrk.go·2                                               1.01M ± 3%               0.99M ± 6%     ~     (p=0.310 n=5+5)
      fs1-zwrk.go·3                                               1.32M ± 1%               1.33M ± 2%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·4                                               1.55M ± 2%               1.53M ± 0%     ~     (p=0.421 n=5+5)
      fs1-zwrk.go·8                                               1.59M ± 0%               1.59M ± 1%     ~     (p=0.690 n=5+5)
      fs1-zwrk.go·12                                              1.59M ± 0%               1.60M ± 1%     ~     (p=0.095 n=5+5)
      fs1-zwrk.go·16                                              1.59M ± 0%               1.59M ± 0%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        9.70k ± 0%               9.75k ± 1%     ~     (p=0.095 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        12.4k ± 1%               12.4k ± 1%     ~     (p=0.421 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        14.2k ± 1%               14.2k ± 1%     ~     (p=0.841 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        14.9k ± 0%               14.9k ± 1%     ~     (p=0.421 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        15.6k ± 0%               15.6k ± 1%     ~     (p=0.548 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       15.2k ±11%               16.0k ± 1%     ~     (p=0.056 n=5+5)
      zeo/py/fs1-zwrk.go·16                                       16.1k ± 1%               16.0k ± 6%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               7.44k ± 1%               7.45k ± 2%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               8.59k ± 1%               8.71k ± 1%   +1.33%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               8.61k ± 1%               8.69k ± 1%     ~     (p=0.095 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               8.57k ± 1%               8.61k ± 1%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               8.56k ± 1%               8.61k ± 1%     ~     (p=0.222 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                              8.51k ± 1%               8.59k ± 1%     ~     (p=0.222 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                              8.54k ± 1%               8.60k ± 1%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  5.55k ± 2%               5.45k ± 2%     ~     (p=0.056 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  6.36k ± 1%               6.25k ± 1%   -1.67%  (p=0.016 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  6.31k ± 0%               6.24k ± 1%   -1.09%  (p=0.016 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  6.28k ± 0%               6.27k ± 1%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                  6.34k ± 1%               6.28k ± 1%     ~     (p=0.095 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                 6.35k ± 1%               6.33k ± 0%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                 6.36k ± 0%               6.30k ± 1%   -0.95%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·1                                        23.7k ± 0%               23.9k ± 0%   +0.71%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·2                                        45.4k ± 0%               45.5k ± 1%     ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·3                                        55.2k ± 1%               55.1k ± 0%     ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·4                                        60.7k ± 2%               60.4k ± 0%     ~     (p=0.548 n=5+5)
      neo/go/fs1-zwrk.go·8                                        70.9k ± 2%               69.2k ± 2%   -2.41%  (p=0.032 n=5+5)
      neo/go/fs1-zwrk.go·12                                       71.1k ± 3%               68.0k ± 5%     ~     (p=0.056 n=5+5)
      neo/go/fs1-zwrk.go·16                                       71.0k ± 3%               68.1k ± 3%   -4.07%  (p=0.016 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                          27.3k ± 0%               27.2k ± 1%     ~     (p=0.548 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                          55.4k ± 1%               55.5k ± 1%     ~     (p=0.548 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                          64.0k ± 1%               64.0k ± 1%     ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                          69.0k ± 1%               69.1k ± 1%     ~     (p=0.421 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          80.9k ± 2%               81.1k ± 4%     ~     (p=0.690 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         78.3k ± 5%               77.8k ± 8%     ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         75.4k ± 3%               76.8k ± 5%     ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go·1                                     11.7k ± 1%               11.7k ± 1%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     19.0k ± 0%               18.9k ± 1%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     24.5k ± 1%               24.4k ± 2%     ~     (p=0.222 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     26.3k ± 1%               26.0k ± 3%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     24.9k ± 3%               24.6k ± 5%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    24.0k ± 5%               23.7k ± 3%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    25.4k ± 1%               24.1k ± 3%   -5.14%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                              12.2k ± 0%               12.2k ± 1%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              19.8k ± 0%               19.6k ± 1%   -0.81%  (p=0.032 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              26.2k ± 1%               25.5k ± 1%   -2.65%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              28.7k ± 1%               27.5k ± 2%   -4.20%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              27.2k ± 3%               25.6k ± 2%   -5.54%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             25.3k ± 2%               24.0k ± 2%   -5.13%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             25.3k ± 1%               24.2k ± 1%   -4.63%  (p=0.008 n=5+5)
      
      name                                           old latency-time/object  new latency-time/object  delta
      cluster:deco dataset:wczblk1-8
      fs1-zwrk.go·1                                              2.29µs ± 0%              2.32µs ± 1%   +1.24%  (p=0.008 n=5+5)
      fs1-zwrk.go·2                                              2.69µs ± 1%              2.63µs ± 3%     ~     (p=0.056 n=5+5)
      fs1-zwrk.go·3                                              2.76µs ± 0%              2.78µs ± 2%     ~     (p=0.079 n=5+5)
      fs1-zwrk.go·4                                              3.44µs ± 1%              3.44µs ± 1%     ~     (p=1.000 n=5+5)
      fs1-zwrk.go·8                                              6.28µs ± 1%              6.28µs ± 1%     ~     (p=0.984 n=5+5)
      fs1-zwrk.go·12                                             9.46µs ± 1%              9.40µs ± 1%     ~     (p=0.310 n=5+5)
      fs1-zwrk.go·16                                             12.6µs ± 1%              12.5µs ± 1%     ~     (p=0.222 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        110µs ± 0%               125µs ± 4%  +13.55%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        173µs ± 1%               210µs ± 1%  +21.27%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        224µs ± 1%               286µs ± 0%  +27.49%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        286µs ± 1%               365µs ± 1%  +27.90%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        545µs ± 1%               699µs ± 1%  +28.25%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       802µs ± 1%              1029µs ± 0%  +28.35%  (p=0.008 n=5+5)
      zeo/py/fs1-zwrk.go·16                                      1.06ms ± 0%              1.36ms ± 2%  +28.74%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               141µs ± 1%               142µs ± 1%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               236µs ± 1%               235µs ± 1%     ~     (p=0.548 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               354µs ± 1%               353µs ± 1%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               472µs ± 1%               470µs ± 1%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               949µs ± 1%               938µs ± 1%   -1.15%  (p=0.032 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                             1.42ms ± 1%              1.41ms ± 2%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                             1.89ms ± 1%              1.89ms ± 1%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  181µs ± 1%               186µs ± 3%     ~     (p=0.151 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  317µs ± 1%               315µs ± 0%     ~     (p=0.690 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  477µs ± 1%               478µs ± 1%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  638µs ± 1%               636µs ± 1%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                 1.28ms ± 1%              1.27ms ± 1%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                1.91ms ± 0%              1.92ms ± 1%     ~     (p=0.056 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                2.57ms ± 1%              2.57ms ± 2%     ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·1                                       54.2µs ± 1%              54.4µs ± 0%     ~     (p=0.151 n=5+5)
      neo/go/fs1-zwrk.go·2                                       52.5µs ± 1%              52.2µs ± 1%     ~     (p=0.333 n=5+5)
      neo/go/fs1-zwrk.go·3                                       65.3µs ± 1%              65.3µs ± 0%     ~     (p=1.000 n=5+5)
      neo/go/fs1-zwrk.go·4                                       79.6µs ± 1%              80.0µs ± 0%     ~     (p=0.056 n=5+5)
      neo/go/fs1-zwrk.go·8                                        131µs ± 0%               133µs ± 1%   +1.10%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·12                                       193µs ± 1%               193µs ± 1%     ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·16                                       256µs ± 1%               260µs ± 1%   +1.38%  (p=0.032 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                         38.0µs ± 1%              38.0µs ± 0%     ~     (p=0.889 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                         36.1µs ± 1%              35.9µs ± 1%     ~     (p=0.056 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                         47.8µs ± 1%              47.7µs ± 1%     ~     (p=0.690 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                         57.7µs ± 1%              57.7µs ± 1%     ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                         90.7µs ± 0%              90.6µs ± 1%     ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         129µs ± 0%               128µs ± 1%     ~     (p=0.421 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         171µs ± 2%               171µs ± 0%     ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go·1                                    90.7µs ± 1%              91.2µs ± 0%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     109µs ± 1%               109µs ± 1%     ~     (p=0.556 n=5+4)
      neo/go/sqlite-zwrk.go·3                                     123µs ± 1%               124µs ± 0%   +0.74%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     149µs ± 0%               149µs ± 1%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     263µs ± 2%               270µs ± 2%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    393µs ± 1%               410µs ± 2%   +4.33%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    534µs ± 2%               560µs ± 1%   +4.70%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                             84.0µs ± 1%              84.0µs ± 1%     ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              102µs ± 0%               102µs ± 1%     ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              113µs ± 1%               113µs ± 0%     ~     (p=0.310 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              133µs ± 0%               133µs ± 0%     ~     (p=1.000 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              257µs ± 2%               257µs ± 2%     ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             415µs ± 1%               417µs ± 3%     ~     (p=0.841 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             563µs ± 2%               563µs ± 1%     ~     (p=0.841 n=5+5)
      cluster:deco dataset:prod1-1024
      fs1-zwrk.go·1                                              1.80µs ± 0%              1.80µs ± 0%     ~     (p=0.413 n=5+5)
      fs1-zwrk.go·2                                              1.98µs ± 3%              2.01µs ± 6%     ~     (p=0.310 n=5+5)
      fs1-zwrk.go·3                                              2.27µs ± 1%              2.26µs ± 2%     ~     (p=0.889 n=5+5)
      fs1-zwrk.go·4                                              2.58µs ± 2%              2.61µs ± 0%     ~     (p=0.492 n=5+5)
      fs1-zwrk.go·8                                              5.04µs ± 0%              5.04µs ± 1%     ~     (p=0.730 n=5+5)
      fs1-zwrk.go·12                                             7.55µs ± 0%              7.52µs ± 1%     ~     (p=0.095 n=5+5)
      fs1-zwrk.go·16                                             10.0µs ± 0%              10.0µs ± 0%     ~     (p=1.000 n=5+5)
      zeo/py/fs1-zwrk.go·1                                        103µs ± 0%               103µs ± 1%     ~     (p=0.095 n=5+5)
      zeo/py/fs1-zwrk.go·2                                        162µs ± 1%               161µs ± 1%     ~     (p=0.421 n=5+5)
      zeo/py/fs1-zwrk.go·3                                        212µs ± 1%               212µs ± 1%     ~     (p=0.841 n=5+5)
      zeo/py/fs1-zwrk.go·4                                        269µs ± 0%               268µs ± 1%     ~     (p=0.421 n=5+5)
      zeo/py/fs1-zwrk.go·8                                        512µs ± 0%               512µs ± 1%     ~     (p=0.548 n=5+5)
      zeo/py/fs1-zwrk.go·12                                       793µs ±12%               752µs ± 1%     ~     (p=0.056 n=5+5)
      zeo/py/fs1-zwrk.go·16                                       991µs ± 1%              1001µs ± 6%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·1                               134µs ± 1%               134µs ± 1%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·2                               233µs ± 1%               230µs ± 1%   -1.31%  (p=0.008 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·3                               348µs ± 1%               345µs ± 1%     ~     (p=0.095 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·4                               467µs ± 1%               465µs ± 1%     ~     (p=0.310 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·8                               935µs ± 1%               929µs ± 1%     ~     (p=0.222 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·12                             1.41ms ± 1%              1.40ms ± 1%     ~     (p=0.222 n=5+5)
      neo/py(!log)/sqlite-zwrk.go·16                             1.87ms ± 1%              1.86ms ± 1%     ~     (p=0.421 n=5+5)
      neo/py(!log)/sql-zwrk.go·1                                  180µs ± 2%               184µs ± 2%     ~     (p=0.056 n=5+5)
      neo/py(!log)/sql-zwrk.go·2                                  315µs ± 1%               320µs ± 1%   +1.69%  (p=0.016 n=5+5)
      neo/py(!log)/sql-zwrk.go·3                                  475µs ± 0%               481µs ± 1%   +1.11%  (p=0.016 n=5+5)
      neo/py(!log)/sql-zwrk.go·4                                  637µs ± 0%               638µs ± 1%     ~     (p=1.000 n=5+5)
      neo/py(!log)/sql-zwrk.go·8                                 1.26ms ± 1%              1.27ms ± 1%     ~     (p=0.095 n=5+5)
      neo/py(!log)/sql-zwrk.go·12                                1.89ms ± 1%              1.89ms ± 0%     ~     (p=0.841 n=5+5)
      neo/py(!log)/sql-zwrk.go·16                                2.52ms ± 0%              2.54ms ± 1%   +0.96%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·1                                       42.2µs ± 0%              41.9µs ± 0%   -0.70%  (p=0.008 n=5+5)
      neo/go/fs1-zwrk.go·2                                       44.1µs ± 0%              44.0µs ± 1%     ~     (p=0.421 n=5+5)
      neo/go/fs1-zwrk.go·3                                       54.4µs ± 1%              54.5µs ± 0%     ~     (p=0.841 n=5+5)
      neo/go/fs1-zwrk.go·4                                       65.9µs ± 2%              66.2µs ± 0%     ~     (p=0.548 n=5+5)
      neo/go/fs1-zwrk.go·8                                        113µs ± 2%               116µs ± 2%   +2.48%  (p=0.032 n=5+5)
      neo/go/fs1-zwrk.go·12                                       169µs ± 4%               177µs ± 5%     ~     (p=0.056 n=5+5)
      neo/go/fs1-zwrk.go·16                                       225µs ± 3%               235µs ± 3%   +4.24%  (p=0.016 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                         36.6µs ± 0%              36.8µs ± 1%     ~     (p=0.548 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                         36.1µs ± 1%              36.0µs ± 1%     ~     (p=0.548 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                         46.9µs ± 1%              46.9µs ± 1%     ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                         57.9µs ± 1%              57.9µs ± 1%     ~     (p=0.421 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                         98.9µs ± 2%              98.6µs ± 4%     ~     (p=0.690 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         153µs ± 5%               155µs ± 8%     ~     (p=1.000 n=5+5)
      neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         212µs ± 3%               208µs ± 5%     ~     (p=0.421 n=5+5)
      neo/go/sqlite-zwrk.go·1                                    85.1µs ± 1%              85.5µs ± 1%     ~     (p=0.151 n=5+5)
      neo/go/sqlite-zwrk.go·2                                     105µs ± 0%               106µs ± 1%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go·3                                     123µs ± 1%               123µs ± 2%     ~     (p=0.222 n=5+5)
      neo/go/sqlite-zwrk.go·4                                     152µs ± 1%               154µs ± 3%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go·8                                     321µs ± 3%               325µs ± 5%     ~     (p=0.548 n=5+5)
      neo/go/sqlite-zwrk.go·12                                    500µs ± 5%               507µs ± 3%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go·16                                    630µs ± 1%               665µs ± 3%   +5.46%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·1                             82.0µs ± 0%              82.3µs ± 1%     ~     (p=0.690 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·2                              101µs ± 0%               102µs ± 1%   +0.82%  (p=0.032 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·3                              115µs ± 1%               118µs ± 1%   +2.73%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·4                              139µs ± 1%               145µs ± 2%   +4.40%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·8                              295µs ± 3%               312µs ± 2%   +5.87%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·12                             474µs ± 2%               500µs ± 2%   +5.41%  (p=0.008 n=5+5)
      neo/go/sqlite-zwrk.go(!sha1)·16                             632µs ± 1%               662µs ± 1%   +4.85%  (p=0.008 n=5+5)
      0867c981