Commits · dabeb4b8628a9f423606a5c4d9f96355237b2b9a · Kirill Smelkov / neo

06 Mar, 2018 3 commits

X deco: localhost timings, Cenabled · dabeb4b8

Kirill Smelkov authored Mar 06, 2018

Compared to yesterday shows not significant change, thus meaning
benchmarking is more or less stable (+/- 5% at ·12 and ·16 is probably
due to scheduling):

$ benchstat -split node,cluster,dataset 20180305-deco-ffixed-c.txt 20180306-deco-ffixed-c.txt

name old pystone/s new pystone/s delta
node:deco
pystone 219k ± 3% 217k ± 4% ~ (p=0.548 n=5+5)

name old time/op new time/op delta
node:deco
crc32/py/4K 5.72µs ± 0% 5.73µs ± 0% ~ (p=0.460 n=5+5)
crc32/go/4K 279ns ± 0% 279ns ± 0% ~ (all equal)
sha1/py/4K 6.69µs ± 0% 6.74µs ± 1% +0.66% (p=0.024 n=5+5)
sha1/go/4K 5.59µs ± 0% 5.60µs ± 0% +0.19% (p=0.008 n=5+5)
unzlib/py/wczdata 27.2µs ± 0% 27.2µs ± 1% ~ (p=0.905 n=4+5)
unzlib/go/wczdata 26.9µs ± 1% 27.0µs ± 0% ~ (p=0.222 n=5+5)
unzlib/py/prod1-avg 5.06µs ± 0% 5.14µs ± 3% ~ (p=0.603 n=4+5)
unzlib/go/prod1-avg 5.33µs ± 1% 5.30µs ± 1% ~ (p=0.087 n=5+5)
disk/randread/direct/4K-min 105µs ± 0% 104µs ± 2% ~ (p=0.270 n=5+5)
disk/randread/direct/4K-avg 142µs ± 0% 141µs ± 0% -0.31% (p=0.032 n=5+5)
disk/randread/pagecache/4K-min 583ns ± 1% 579ns ± 2% ~ (p=0.246 n=5+5)
disk/randread/pagecache/4K-avg 1.00µs ± 1% 0.99µs ± 0% -0.98% (p=0.024 n=5+5)

name old time/object new time/object delta
cluster:deco dataset:wczblk1-8
fs1-zhash.py 20.2µs ± 1% 20.3µs ± 1% ~ (p=0.571 n=4+4)
fs1-zhash.go 3.20µs ± 0% 3.26µs ± 4% ~ (p=0.444 n=5+5)
fs1-zhash.go+prefetch128 4.14µs ± 6% 4.04µs ± 1% ~ (p=0.444 n=5+5)
zeo/py/fs1-zhash.py 379µs ± 3% 383µs ± 5% ~ (p=0.730 n=5+5)
zeo/py/fs1-zhash.go 127µs ± 1% 126µs ± 1% ~ (p=0.317 n=4+5)
zeo/py/fs1-zhash.go+prefetch128 64.1µs ± 2% 63.1µs ± 1% ~ (p=0.222 n=5+5)
neo/py(!log)/sqlite-zhash.py 335µs ± 4% 344µs ± 6% ~ (p=0.421 n=5+5)
neo/py(!log)/sqlite-zhash.go 145µs ± 2% 140µs ± 1% -3.07% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zhash.go+prefetch128 118µs ± 1% 119µs ± 2% ~ (p=0.548 n=5+5)
neo/py(!log)/sql-zhash.py 454µs ±61% 386µs ± 1% ~ (p=1.000 n=5+4)
neo/py(!log)/sql-zhash.go 183µs ± 1% 183µs ± 3% ~ (p=1.000 n=5+5)
neo/py(!log)/sql-zhash.go+prefetch128 164µs ± 2% 164µs ± 3% ~ (p=0.690 n=5+5)
neo/go/fs1-zhash.py 227µs ± 2% 226µs ± 3% ~ (p=0.690 n=5+5)
neo/go/fs1-zhash.go 56.9µs ± 1% 57.1µs ± 0% ~ (p=0.119 n=5+5)
neo/go/fs1-zhash.go+prefetch128 24.7µs ± 2% 24.7µs ± 5% ~ (p=0.571 n=5+5)
neo/go/fs1(!sha1)-zhash.go(!sha1) 40.5µs ± 1% 40.2µs ± 1% ~ (p=0.254 n=5+5)
neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1) 16.8µs ± 5% 17.1µs ± 6% ~ (p=0.579 n=5+5)
neo/go/sqlite-zhash.py 269µs ± 1% 272µs ± 3% ~ (p=0.690 n=5+5)
neo/go/sqlite-zhash.go 92.7µs ± 0% 92.8µs ± 0% ~ (p=0.397 n=5+4)
neo/go/sqlite-zhash.go+prefetch128 39.8µs ± 8% 40.5µs ± 5% ~ (p=0.548 n=5+5)
neo/go/sqlite-zhash.go(!sha1) 86.4µs ± 2% 86.5µs ± 2% ~ (p=0.571 n=5+5)
neo/go/sqlite-zhash.go+prefetch128(!sha1) 40.1µs ±11% 38.8µs ± 9% ~ (p=0.579 n=5+5)
cluster:deco dataset:prod1-1024
fs1-zhash.py 15.8µs ± 2% 15.8µs ± 3% ~ (p=0.629 n=4+4)
fs1-zhash.go 2.80µs ± 0% 2.80µs ± 0% ~ (all equal)
fs1-zhash.go+prefetch128 3.54µs ± 7% 3.42µs ± 8% ~ (p=0.381 n=5+5)
zeo/py/fs1-zhash.py 362µs ± 6% 361µs ± 5% ~ (p=1.000 n=5+5)
zeo/py/fs1-zhash.go 106µs ± 1% 105µs ± 0% ~ (p=0.214 n=5+5)
zeo/py/fs1-zhash.go+prefetch128 58.9µs ± 1% 58.9µs ± 1% ~ (p=0.881 n=5+5)
neo/py(!log)/sqlite-zhash.py 331µs ± 1% 344µs ± 7% ~ (p=0.063 n=5+5)
neo/py(!log)/sqlite-zhash.go 136µs ± 1% 137µs ± 2% ~ (p=0.222 n=5+5)
neo/py(!log)/sqlite-zhash.go+prefetch128 112µs ± 1% 114µs ± 1% +1.73% (p=0.008 n=5+5)
neo/py(!log)/sql-zhash.py 389µs ± 6% 380µs ± 4% ~ (p=0.486 n=4+4)
neo/py(!log)/sql-zhash.go 180µs ± 2% 180µs ± 1% ~ (p=0.548 n=5+5)
neo/py(!log)/sql-zhash.go+prefetch128 157µs ± 1% 159µs ± 1% ~ (p=0.095 n=5+5)
neo/go/fs1-zhash.py 223µs ± 0% 221µs ± 1% -0.79% (p=0.016 n=5+5)
neo/go/fs1-zhash.go 44.9µs ± 1% 45.2µs ± 2% ~ (p=0.357 n=5+5)
neo/go/fs1-zhash.go+prefetch128 17.6µs ± 5% 17.6µs ± 2% ~ (p=1.000 n=5+5)
neo/go/fs1(!sha1)-zhash.go(!sha1) 39.1µs ± 1% 39.1µs ± 2% ~ (p=0.714 n=5+5)
neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1) 14.8µs ± 3% 14.6µs ± 4% ~ (p=0.302 n=5+5)
neo/go/sqlite-zhash.py 269µs ± 3% 271µs ± 2% ~ (p=0.548 n=5+5)
neo/go/sqlite-zhash.go 86.0µs ± 1% 86.4µs ± 0% ~ (p=0.206 n=5+5)
neo/go/sqlite-zhash.go+prefetch128 36.4µs ± 6% 35.8µs ± 2% ~ (p=0.532 n=5+5)
neo/go/sqlite-zhash.go(!sha1) 83.6µs ± 1% 84.0µs ± 1% ~ (p=0.516 n=5+5)
neo/go/sqlite-zhash.go+prefetch128(!sha1) 35.9µs ± 5% 36.5µs ± 5% ~ (p=0.444 n=5+5)

name old req/s new req/s delta
cluster:deco dataset:wczblk1-8
fs1-zwrk.go·1 438k ± 1% 436k ± 0% ~ (p=0.222 n=5+5)
fs1-zwrk.go·2 745k ± 1% 744k ± 1% ~ (p=0.548 n=5+5)
fs1-zwrk.go·3 1.09M ± 0% 1.09M ± 0% ~ (p=0.095 n=5+5)
fs1-zwrk.go·4 1.15M ± 1% 1.16M ± 1% ~ (p=0.095 n=5+5)
fs1-zwrk.go·8 1.27M ± 1% 1.27M ± 1% ~ (p=0.841 n=5+5)
fs1-zwrk.go·12 1.27M ± 1% 1.27M ± 1% ~ (p=0.690 n=5+5)
fs1-zwrk.go·16 1.28M ± 1% 1.27M ± 1% ~ (p=0.841 n=5+5)
zeo/py/fs1-zwrk.go·1 9.04k ± 1% 9.12k ± 0% +0.89% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·2 11.4k ± 1% 11.6k ± 1% +1.58% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·3 13.4k ± 1% 13.4k ± 1% ~ (p=0.310 n=5+5)
zeo/py/fs1-zwrk.go·4 14.0k ± 1% 14.0k ± 1% ~ (p=0.595 n=5+5)
zeo/py/fs1-zwrk.go·8 14.6k ± 4% 14.7k ± 1% ~ (p=0.690 n=5+5)
zeo/py/fs1-zwrk.go·12 14.9k ± 1% 15.0k ± 1% ~ (p=0.421 n=5+5)
zeo/py/fs1-zwrk.go·16 15.3k ± 1% 15.1k ± 0% -0.79% (p=0.016 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 7.03k ± 3% 7.09k ± 1% ~ (p=0.310 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 8.52k ± 1% 8.48k ± 1% ~ (p=0.151 n=5+5)
neo/py(!log)/sqlite-zwrk.go·3 8.48k ± 1% 8.48k ± 1% ~ (p=0.690 n=5+5)
neo/py(!log)/sqlite-zwrk.go·4 8.45k ± 1% 8.47k ± 1% ~ (p=0.841 n=5+5)
neo/py(!log)/sqlite-zwrk.go·8 8.44k ± 1% 8.43k ± 1% ~ (p=0.690 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 8.48k ± 1% 8.46k ± 1% ~ (p=0.841 n=5+5)
neo/py(!log)/sqlite-zwrk.go·16 8.49k ± 1% 8.46k ± 1% ~ (p=0.310 n=5+5)
neo/py(!log)/sql-zwrk.go·1 5.51k ± 1% 5.51k ± 1% ~ (p=1.000 n=5+5)
neo/py(!log)/sql-zwrk.go·2 6.31k ± 1% 6.32k ± 1% ~ (p=0.841 n=5+5)
neo/py(!log)/sql-zwrk.go·3 6.20k ± 1% 6.29k ± 1% +1.37% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·4 6.22k ± 1% 6.27k ± 1% +0.83% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·8 6.25k ± 1% 6.27k ± 1% ~ (p=0.548 n=5+5)
neo/py(!log)/sql-zwrk.go·12 6.26k ± 1% 6.29k ± 0% ~ (p=0.841 n=5+5)
neo/py(!log)/sql-zwrk.go·16 6.26k ± 1% 6.22k ± 1% ~ (p=0.421 n=5+5)
neo/go/fs1-zwrk.go·1 18.4k ± 0% 18.4k ± 1% ~ (p=0.167 n=5+5)
neo/go/fs1-zwrk.go·2 38.2k ± 1% 38.1k ± 1% ~ (p=0.841 n=5+5)
neo/go/fs1-zwrk.go·3 45.8k ± 1% 46.0k ± 1% ~ (p=0.421 n=5+5)
neo/go/fs1-zwrk.go·4 49.8k ± 0% 50.2k ± 1% +0.94% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·8 60.3k ± 1% 61.0k ± 0% +1.16% (p=0.016 n=5+5)
neo/go/fs1-zwrk.go·12 61.6k ± 1% 62.1k ± 1% ~ (p=0.222 n=5+5)
neo/go/fs1-zwrk.go·16 61.4k ± 1% 62.5k ± 1% ~ (p=0.095 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 26.1k ± 1% 26.3k ± 1% ~ (p=0.222 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 55.3k ± 1% 55.3k ± 1% ~ (p=1.000 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 62.7k ± 1% 62.7k ± 1% ~ (p=0.841 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 69.1k ± 0% 69.3k ± 1% ~ (p=0.421 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 87.9k ± 0% 88.2k ± 0% ~ (p=0.310 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 92.2k ± 1% 93.4k ± 0% +1.32% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 93.4k ± 1% 93.5k ± 2% ~ (p=0.690 n=5+5)
neo/go/sqlite-zwrk.go·1 11.1k ± 0% 11.0k ± 1% ~ (p=0.421 n=5+5)
neo/go/sqlite-zwrk.go·2 18.5k ± 0% 18.4k ± 1% -0.68% (p=0.016 n=5+5)
neo/go/sqlite-zwrk.go·3 24.5k ± 0% 24.4k ± 1% ~ (p=0.151 n=5+5)
neo/go/sqlite-zwrk.go·4 26.9k ± 1% 26.8k ± 0% ~ (p=0.151 n=5+5)
neo/go/sqlite-zwrk.go·8 29.9k ± 2% 30.4k ± 2% ~ (p=0.310 n=5+5)
neo/go/sqlite-zwrk.go·12 29.2k ± 2% 30.5k ± 1% +4.49% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·16 28.4k ± 2% 29.9k ± 2% +5.53% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 11.8k ± 0% 11.9k ± 1% ~ (p=0.063 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 19.5k ± 0% 19.7k ± 0% +0.60% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 26.8k ± 1% 26.5k ± 1% -1.14% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 30.3k ± 1% 30.0k ± 0% -1.12% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 32.0k ± 2% 31.2k ± 2% -2.46% (p=0.032 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 30.2k ± 3% 28.9k ± 1% -4.20% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 29.7k ± 1% 28.4k ± 2% -4.27% (p=0.008 n=5+5)
cluster:deco dataset:prod1-1024
fs1-zwrk.go·1 555k ± 0% 555k ± 0% ~ (p=1.000 n=5+5)
fs1-zwrk.go·2 982k ± 2% 1008k ± 3% +2.66% (p=0.032 n=5+5)
fs1-zwrk.go·3 1.32M ± 1% 1.32M ± 1% ~ (p=0.421 n=5+5)
fs1-zwrk.go·4 1.51M ± 1% 1.55M ± 2% +2.80% (p=0.032 n=5+5)
fs1-zwrk.go·8 1.58M ± 1% 1.59M ± 0% ~ (p=0.548 n=5+5)
fs1-zwrk.go·12 1.59M ± 0% 1.59M ± 0% ~ (p=0.548 n=5+5)
fs1-zwrk.go·16 1.59M ± 0% 1.59M ± 0% ~ (p=0.095 n=5+5)
zeo/py/fs1-zwrk.go·1 9.70k ± 1% 9.70k ± 0% ~ (p=1.000 n=5+5)
zeo/py/fs1-zwrk.go·2 12.2k ± 1% 12.4k ± 1% +1.67% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·3 14.2k ± 1% 14.2k ± 1% ~ (p=0.095 n=5+5)
zeo/py/fs1-zwrk.go·4 14.9k ± 0% 14.9k ± 0% ~ (p=0.841 n=5+5)
zeo/py/fs1-zwrk.go·8 15.6k ± 0% 15.6k ± 0% ~ (p=0.548 n=5+5)
zeo/py/fs1-zwrk.go·12 15.9k ± 1% 15.2k ±11% ~ (p=0.310 n=5+5)
zeo/py/fs1-zwrk.go·16 16.1k ± 0% 16.1k ± 1% ~ (p=0.421 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 7.51k ± 1% 7.44k ± 1% -0.91% (p=0.016 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 8.72k ± 1% 8.59k ± 1% -1.45% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·3 8.69k ± 1% 8.61k ± 1% ~ (p=0.095 n=5+5)
neo/py(!log)/sqlite-zwrk.go·4 8.67k ± 1% 8.57k ± 1% ~ (p=0.095 n=5+5)
neo/py(!log)/sqlite-zwrk.go·8 8.72k ± 0% 8.56k ± 1% -1.83% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 8.63k ± 1% 8.51k ± 1% ~ (p=0.056 n=5+5)
neo/py(!log)/sqlite-zwrk.go·16 8.64k ± 1% 8.54k ± 1% ~ (p=0.095 n=5+5)
neo/py(!log)/sql-zwrk.go·1 5.56k ± 2% 5.55k ± 2% ~ (p=1.000 n=5+5)
neo/py(!log)/sql-zwrk.go·2 6.42k ± 0% 6.36k ± 1% -0.97% (p=0.032 n=5+5)
neo/py(!log)/sql-zwrk.go·3 6.40k ± 0% 6.31k ± 0% -1.44% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·4 6.38k ± 1% 6.28k ± 0% -1.57% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·8 6.39k ± 1% 6.34k ± 1% ~ (p=0.056 n=5+5)
neo/py(!log)/sql-zwrk.go·12 6.42k ± 1% 6.35k ± 1% -1.11% (p=0.016 n=5+5)
neo/py(!log)/sql-zwrk.go·16 6.41k ± 2% 6.36k ± 0% ~ (p=0.151 n=5+5)
neo/go/fs1-zwrk.go·1 23.8k ± 0% 23.7k ± 0% -0.33% (p=0.032 n=5+5)
neo/go/fs1-zwrk.go·2 45.0k ± 1% 45.4k ± 0% +0.93% (p=0.032 n=5+5)
neo/go/fs1-zwrk.go·3 55.1k ± 1% 55.2k ± 1% ~ (p=1.000 n=5+5)
neo/go/fs1-zwrk.go·4 60.1k ± 0% 60.7k ± 2% ~ (p=0.151 n=5+5)
neo/go/fs1-zwrk.go·8 68.3k ± 2% 70.9k ± 2% +3.72% (p=0.016 n=5+5)
neo/go/fs1-zwrk.go·12 69.3k ± 5% 71.1k ± 3% ~ (p=0.310 n=5+5)
neo/go/fs1-zwrk.go·16 68.8k ± 6% 71.0k ± 3% ~ (p=0.690 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 27.3k ± 0% 27.3k ± 0% ~ (p=0.095 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 54.9k ± 1% 55.4k ± 1% ~ (p=0.095 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 64.0k ± 0% 64.0k ± 1% ~ (p=0.841 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 68.7k ± 1% 69.0k ± 1% ~ (p=0.222 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 79.4k ± 2% 80.9k ± 2% ~ (p=0.222 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 77.9k ± 2% 78.3k ± 5% ~ (p=1.000 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 75.3k ± 6% 75.4k ± 3% ~ (p=1.000 n=5+5)
neo/go/sqlite-zwrk.go·1 11.8k ± 0% 11.7k ± 1% ~ (p=0.095 n=5+5)
neo/go/sqlite-zwrk.go·2 19.2k ± 0% 19.0k ± 0% -0.85% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·3 24.5k ± 1% 24.5k ± 1% ~ (p=1.000 n=5+5)
neo/go/sqlite-zwrk.go·4 26.6k ± 1% 26.3k ± 1% -1.38% (p=0.016 n=5+5)
neo/go/sqlite-zwrk.go·8 25.1k ± 3% 24.9k ± 3% ~ (p=0.421 n=5+5)
neo/go/sqlite-zwrk.go·12 23.8k ± 2% 24.0k ± 5% ~ (p=1.000 n=5+5)
neo/go/sqlite-zwrk.go·16 24.3k ± 2% 25.4k ± 1% +4.53% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 12.1k ± 1% 12.2k ± 0% ~ (p=0.151 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 19.6k ± 0% 19.8k ± 0% +0.98% (p=0.016 n=4+5)
neo/go/sqlite-zwrk.go(!sha1)·3 25.3k ± 1% 26.2k ± 1% +3.40% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 27.3k ± 1% 28.7k ± 1% +5.03% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 25.4k ± 3% 27.2k ± 3% +6.78% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 23.8k ± 2% 25.3k ± 2% +6.21% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 23.9k ± 2% 25.3k ± 1% +6.14% (p=0.008 n=5+5)

name old latency-time/object new latency-time/object delta
cluster:deco dataset:wczblk1-8
fs1-zwrk.go·1 2.29µs ± 1% 2.29µs ± 0% ~ (p=0.222 n=5+5)
fs1-zwrk.go·2 2.68µs ± 1% 2.69µs ± 1% ~ (p=0.524 n=5+5)
fs1-zwrk.go·3 2.76µs ± 0% 2.76µs ± 0% ~ (p=0.111 n=5+5)
fs1-zwrk.go·4 3.46µs ± 1% 3.44µs ± 1% ~ (p=0.095 n=5+5)
fs1-zwrk.go·8 6.28µs ± 1% 6.28µs ± 1% ~ (p=0.889 n=5+5)
fs1-zwrk.go·12 9.42µs ± 1% 9.46µs ± 1% ~ (p=0.690 n=5+5)
fs1-zwrk.go·16 12.5µs ± 1% 12.6µs ± 1% ~ (p=0.841 n=5+5)
zeo/py/fs1-zwrk.go·1 111µs ± 1% 110µs ± 0% -0.88% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·2 176µs ± 1% 173µs ± 1% -1.56% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·3 224µs ± 1% 224µs ± 1% ~ (p=0.310 n=5+5)
zeo/py/fs1-zwrk.go·4 285µs ± 1% 286µs ± 1% ~ (p=0.690 n=5+5)
zeo/py/fs1-zwrk.go·8 549µs ± 4% 545µs ± 1% ~ (p=0.690 n=5+5)
zeo/py/fs1-zwrk.go·12 805µs ± 1% 802µs ± 1% ~ (p=0.421 n=5+5)
zeo/py/fs1-zwrk.go·16 1.05ms ± 1% 1.06ms ± 0% +0.80% (p=0.016 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 142µs ± 3% 141µs ± 1% ~ (p=0.310 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 235µs ± 1% 236µs ± 1% ~ (p=0.151 n=5+5)
neo/py(!log)/sqlite-zwrk.go·3 354µs ± 1% 354µs ± 1% ~ (p=0.690 n=5+5)
neo/py(!log)/sqlite-zwrk.go·4 473µs ± 1% 472µs ± 1% ~ (p=0.841 n=5+5)
neo/py(!log)/sqlite-zwrk.go·8 948µs ± 1% 949µs ± 1% ~ (p=0.690 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 1.42ms ± 1% 1.42ms ± 1% ~ (p=0.841 n=5+5)
neo/py(!log)/sqlite-zwrk.go·16 1.88ms ± 1% 1.89ms ± 1% ~ (p=0.310 n=5+5)
neo/py(!log)/sql-zwrk.go·1 181µs ± 1% 181µs ± 1% ~ (p=1.000 n=5+5)
neo/py(!log)/sql-zwrk.go·2 317µs ± 1% 317µs ± 1% ~ (p=0.841 n=5+5)
neo/py(!log)/sql-zwrk.go·3 484µs ± 1% 477µs ± 1% -1.36% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·4 643µs ± 1% 638µs ± 1% -0.82% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·8 1.28ms ± 1% 1.28ms ± 1% ~ (p=0.548 n=5+5)
neo/py(!log)/sql-zwrk.go·12 1.92ms ± 1% 1.91ms ± 0% ~ (p=0.841 n=5+5)
neo/py(!log)/sql-zwrk.go·16 2.56ms ± 1% 2.57ms ± 1% ~ (p=0.421 n=5+5)
neo/go/fs1-zwrk.go·1 54.5µs ± 0% 54.2µs ± 1% ~ (p=0.167 n=5+5)
neo/go/fs1-zwrk.go·2 52.4µs ± 1% 52.5µs ± 1% ~ (p=0.841 n=5+5)
neo/go/fs1-zwrk.go·3 65.4µs ± 1% 65.3µs ± 1% ~ (p=0.421 n=5+5)
neo/go/fs1-zwrk.go·4 80.4µs ± 0% 79.6µs ± 1% -0.93% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·8 133µs ± 1% 131µs ± 0% -1.15% (p=0.016 n=5+5)
neo/go/fs1-zwrk.go·12 195µs ± 1% 193µs ± 1% ~ (p=0.222 n=5+5)
neo/go/fs1-zwrk.go·16 261µs ± 1% 256µs ± 1% ~ (p=0.095 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 38.3µs ± 1% 38.0µs ± 1% ~ (p=0.222 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 36.2µs ± 1% 36.1µs ± 1% ~ (p=1.000 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 47.8µs ± 1% 47.8µs ± 1% ~ (p=0.841 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 57.9µs ± 0% 57.7µs ± 1% ~ (p=0.421 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 91.0µs ± 0% 90.7µs ± 0% ~ (p=0.310 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 130µs ± 1% 129µs ± 0% -1.31% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 171µs ± 1% 171µs ± 2% ~ (p=0.690 n=5+5)
neo/go/sqlite-zwrk.go·1 90.4µs ± 0% 90.7µs ± 1% ~ (p=0.421 n=5+5)
neo/go/sqlite-zwrk.go·2 108µs ± 0% 109µs ± 1% +0.69% (p=0.016 n=5+5)
neo/go/sqlite-zwrk.go·3 123µs ± 0% 123µs ± 1% ~ (p=0.151 n=5+5)
neo/go/sqlite-zwrk.go·4 148µs ± 1% 149µs ± 0% ~ (p=0.151 n=5+5)
neo/go/sqlite-zwrk.go·8 267µs ± 2% 263µs ± 2% ~ (p=0.310 n=5+5)
neo/go/sqlite-zwrk.go·12 411µs ± 2% 393µs ± 1% -4.31% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·16 564µs ± 2% 534µs ± 2% -5.24% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 84.5µs ± 0% 84.0µs ± 1% ~ (p=0.063 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 102µs ± 0% 102µs ± 0% -0.60% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 112µs ± 1% 113µs ± 1% +1.16% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 132µs ± 1% 133µs ± 0% +1.13% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 250µs ± 2% 257µs ± 2% +2.52% (p=0.032 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 397µs ± 3% 415µs ± 1% +4.38% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 539µs ± 1% 563µs ± 2% +4.47% (p=0.008 n=5+5)
cluster:deco dataset:prod1-1024
fs1-zwrk.go·1 1.80µs ± 0% 1.80µs ± 0% ~ (p=0.968 n=5+5)
fs1-zwrk.go·2 2.04µs ± 2% 1.98µs ± 3% -2.55% (p=0.032 n=5+5)
fs1-zwrk.go·3 2.28µs ± 1% 2.27µs ± 1% ~ (p=0.389 n=5+5)
fs1-zwrk.go·4 2.65µs ± 1% 2.58µs ± 2% -2.71% (p=0.032 n=5+5)
fs1-zwrk.go·8 5.05µs ± 1% 5.04µs ± 0% ~ (p=0.548 n=5+5)
fs1-zwrk.go·12 7.54µs ± 0% 7.55µs ± 0% ~ (p=0.571 n=5+5)
fs1-zwrk.go·16 10.1µs ± 0% 10.0µs ± 0% ~ (p=0.095 n=5+5)
zeo/py/fs1-zwrk.go·1 103µs ± 1% 103µs ± 0% ~ (p=1.000 n=5+5)
zeo/py/fs1-zwrk.go·2 164µs ± 1% 162µs ± 1% -1.64% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·3 211µs ± 1% 212µs ± 1% ~ (p=0.095 n=5+5)
zeo/py/fs1-zwrk.go·4 269µs ± 0% 269µs ± 0% ~ (p=0.841 n=5+5)
zeo/py/fs1-zwrk.go·8 512µs ± 0% 512µs ± 0% ~ (p=0.548 n=5+5)
zeo/py/fs1-zwrk.go·12 755µs ± 1% 793µs ±12% ~ (p=0.310 n=5+5)
zeo/py/fs1-zwrk.go·16 993µs ± 0% 991µs ± 1% ~ (p=0.421 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 133µs ± 1% 134µs ± 1% +0.92% (p=0.016 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 229µs ± 1% 233µs ± 1% +1.47% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·3 345µs ± 1% 348µs ± 1% ~ (p=0.095 n=5+5)
neo/py(!log)/sqlite-zwrk.go·4 461µs ± 1% 467µs ± 1% ~ (p=0.095 n=5+5)
neo/py(!log)/sqlite-zwrk.go·8 917µs ± 0% 935µs ± 1% +1.87% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 1.39ms ± 1% 1.41ms ± 1% ~ (p=0.056 n=5+5)
neo/py(!log)/sqlite-zwrk.go·16 1.85ms ± 1% 1.87ms ± 1% ~ (p=0.095 n=5+5)
neo/py(!log)/sql-zwrk.go·1 180µs ± 2% 180µs ± 2% ~ (p=1.000 n=5+5)
neo/py(!log)/sql-zwrk.go·2 311µs ± 0% 315µs ± 1% +0.99% (p=0.032 n=5+5)
neo/py(!log)/sql-zwrk.go·3 468µs ± 0% 475µs ± 0% +1.47% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·4 627µs ± 1% 637µs ± 0% +1.59% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·8 1.25ms ± 1% 1.26ms ± 1% ~ (p=0.056 n=5+5)
neo/py(!log)/sql-zwrk.go·12 1.87ms ± 1% 1.89ms ± 1% +1.13% (p=0.016 n=5+5)
neo/py(!log)/sql-zwrk.go·16 2.50ms ± 2% 2.52ms ± 0% ~ (p=0.151 n=5+5)
neo/go/fs1-zwrk.go·1 42.0µs ± 0% 42.2µs ± 0% +0.33% (p=0.032 n=5+5)
neo/go/fs1-zwrk.go·2 44.5µs ± 1% 44.1µs ± 0% -0.92% (p=0.032 n=5+5)
neo/go/fs1-zwrk.go·3 54.5µs ± 1% 54.4µs ± 1% ~ (p=1.000 n=5+5)
neo/go/fs1-zwrk.go·4 66.5µs ± 0% 65.9µs ± 2% ~ (p=0.151 n=5+5)
neo/go/fs1-zwrk.go·8 117µs ± 2% 113µs ± 2% -3.59% (p=0.016 n=5+5)
neo/go/fs1-zwrk.go·12 173µs ± 4% 169µs ± 4% ~ (p=0.310 n=5+5)
neo/go/fs1-zwrk.go·16 233µs ± 6% 225µs ± 3% ~ (p=0.690 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 36.7µs ± 0% 36.6µs ± 0% ~ (p=0.095 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 36.4µs ± 1% 36.1µs ± 1% ~ (p=0.095 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 46.9µs ± 0% 46.9µs ± 1% ~ (p=0.841 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 58.2µs ± 1% 57.9µs ± 1% ~ (p=0.222 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 101µs ± 2% 99µs ± 2% ~ (p=0.222 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 154µs ± 2% 153µs ± 5% ~ (p=1.000 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 213µs ± 6% 212µs ± 3% ~ (p=1.000 n=5+5)
neo/go/sqlite-zwrk.go·1 84.7µs ± 0% 85.1µs ± 1% ~ (p=0.095 n=5+5)
neo/go/sqlite-zwrk.go·2 104µs ± 0% 105µs ± 0% +0.86% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·3 123µs ± 1% 123µs ± 1% ~ (p=1.000 n=5+5)
neo/go/sqlite-zwrk.go·4 150µs ± 1% 152µs ± 1% +1.40% (p=0.016 n=5+5)
neo/go/sqlite-zwrk.go·8 319µs ± 3% 321µs ± 3% ~ (p=0.421 n=5+5)
neo/go/sqlite-zwrk.go·12 504µs ± 2% 500µs ± 5% ~ (p=1.000 n=5+5)
neo/go/sqlite-zwrk.go·16 659µs ± 2% 630µs ± 1% -4.34% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 82.5µs ± 1% 82.0µs ± 0% ~ (p=0.151 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 102µs ± 0% 101µs ± 0% -0.97% (p=0.016 n=4+5)
neo/go/sqlite-zwrk.go(!sha1)·3 119µs ± 1% 115µs ± 1% -3.29% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 146µs ± 1% 139µs ± 1% -4.78% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 315µs ± 3% 295µs ± 3% -6.37% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 503µs ± 2% 474µs ± 2% -5.86% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 671µs ± 2% 632µs ± 1% -5.79% (p=0.008 n=5+5)

dabeb4b8

X z6001 localhost timings after switch to zwrk + stabilizing benchmark format. · 6a5c1f93
Kirill Smelkov authored Mar 06, 2018

6a5c1f93
X neo1 timings (ffixed, C not disabled) · 8748ba93
Kirill Smelkov authored Mar 06, 2018

8748ba93

05 Mar, 2018 6 commits

X save time not benchmarking things we do not show · b655da26
Kirill Smelkov authored Mar 05, 2018

b655da26

X deco-rio timings · a1dde3c9

Kirill Smelkov authored Mar 05, 2018

Latency is awful (> 500µs) because RX coalescing is not disabled on rio.

a1dde3c9

X rio localhost timings after switch to zwrk & stabilizing output format · 2d0b54ad
Kirill Smelkov authored Mar 05, 2018
```
Like in previous commit should not be changing compared to 39a77e3b, but
it was not checked.
```
2d0b54ad

X noturbo deco timings after switch to zwrk + stabilizing neotest output format · ea5f9d26

Kirill Smelkov authored Mar 05, 2018

Compared to 0ed7b1fc there should not be a difference (checked only on
serial cases with manually ediging 20180221-deco-noturbo-noz.txt-fix to
use updated output format for wczblk1-8 dataset):

$ benchstat -split node,cluster,dataset 20180221-deco-noturbo-noz.txt-fix 20180305-deco-noturbo-c.txt
name old pystone/s new pystone/s delta
node:deco
pystone 221k ± 0% 219k ± 3% ~ (p=0.690 n=5+5)

name old time/op new time/op delta
node:deco
sha1/py/1K 1.85µs ± 2% 1.84µs ± 1% ~ (p=0.508 n=5+5)
sha1/go/1K 1.53µs ± 0% 1.53µs ± 0% ~ (p=0.103 n=5+5)
sha1/py/4K 6.68µs ± 1% 6.69µs ± 0% ~ (p=0.151 n=5+5)
sha1/go/4K 5.59µs ± 0% 5.59µs ± 0% ~ (p=0.333 n=5+5)
sha1/py/2M 3.18ms ± 0% 3.18ms ± 0% ~ (p=0.421 n=5+5)
sha1/go/2M 2.78ms ± 0% 2.78ms ± 0% ~ (p=1.000 n=5+5)
unzlib/py/null-1K 2.81µs ± 0% 2.91µs ± 3% +3.49% (p=0.008 n=5+5)
unzlib/go/null-1K 2.86µs ± 0% 2.88µs ± 1% +0.93% (p=0.008 n=5+5)
unzlib/py/null-4K 11.3µs ± 1% 11.4µs ± 2% +0.89% (p=0.040 n=5+5)
unzlib/go/null-4K 11.3µs ± 0% 11.4µs ± 0% +0.89% (p=0.008 n=5+5)
unzlib/py/null-2M 5.71ms ± 5% 5.66ms ± 3% ~ (p=1.000 n=5+5)
unzlib/go/null-2M 4.79ms ± 0% 4.79ms ± 0% ~ (p=0.095 n=5+5)
unzlib/py/prod1-avg 5.02µs ± 1% 5.06µs ± 0% ~ (p=0.057 n=4+4)
unzlib/go/prod1-avg 5.27µs ± 1% 5.33µs ± 1% ~ (p=0.087 n=5+5)
unzlib/py/prod1-max 512µs ± 2% 438µs ± 5% -14.45% (p=0.008 n=5+5)
unzlib/go/prod1-max 336µs ± 0% 352µs ± 4% +4.67% (p=0.008 n=5+5)
disk/randread/direct/4K-min 105µs ± 1% 105µs ± 0% ~ (p=1.000 n=5+5)
disk/randread/direct/4K-avg 144µs ± 0% 142µs ± 0% -1.54% (p=0.008 n=5+5)
disk/randread/direct/2M-min 5.48ms ± 3% 5.34ms ± 3% ~ (p=0.135 n=5+5)
disk/randread/direct/2M-avg 6.13ms ± 1% 6.04ms ± 2% ~ (p=0.056 n=5+5)
disk/randread/pagecache/4K-min 570ns ± 1% 583ns ± 1% +2.28% (p=0.008 n=5+5)
disk/randread/pagecache/4K-avg 975ns ± 0% 1003ns ± 1% +2.91% (p=0.008 n=5+5)
disk/randread/pagecache/2M-min 195µs ± 4% 197µs ± 4% ~ (p=0.690 n=5+5)
disk/randread/pagecache/2M-avg 214µs ± 0% 220µs ± 1% +2.80% (p=0.008 n=5+5)

name old time/object new time/object delta
cluster:deco dataset:wczblk1-8
fs1-zhash.py 20.3µs ± 1% 20.2µs ± 1% ~ (p=0.444 n=5+4)
fs1-zhash.go 3.20µs ± 0% 3.20µs ± 0% ~ (all equal)
fs1-zhash.go+prefetch128 4.16µs ± 4% 4.14µs ± 6% ~ (p=0.952 n=5+5)
zeo/py/fs1-zhash.py 375µs ± 4% 379µs ± 3% ~ (p=0.690 n=5+5)
neo/py/sqlite-zhash.py 355µs ± 6% 362µs ± 6% ~ (p=0.421 n=5+5)
neo/py/sqlite-zhash.go 156µs ± 2% 158µs ± 1% ~ (p=0.151 n=5+5)
neo/py/sqlite-zhash.go+prefetch128 134µs ± 2% 135µs ± 1% ~ (p=0.421 n=5+5)
neo/py(!log)/sqlite-zhash.py 326µs ± 3% 335µs ± 4% ~ (p=0.381 n=5+5)
neo/py(!log)/sqlite-zhash.go 143µs ± 3% 145µs ± 2% ~ (p=0.508 n=5+5)
neo/py(!log)/sqlite-zhash.go+prefetch128 119µs ± 2% 118µs ± 1% ~ (p=0.421 n=5+5)
neo/py/sql-zhash.py 466µs ±45% 392µs ± 5% ~ (p=0.111 n=5+4)
neo/py/sql-zhash.go 201µs ± 2% 197µs ± 1% -1.63% (p=0.008 n=5+5)
neo/py/sql-zhash.go+prefetch128 184µs ± 2% 180µs ± 2% -1.96% (p=0.032 n=5+5)
neo/py(!log)/sql-zhash.py 375µs ± 2% 454µs ±61% ~ (p=0.286 n=4+5)
neo/py(!log)/sql-zhash.go 182µs ± 2% 183µs ± 1% ~ (p=0.802 n=5+5)
neo/py(!log)/sql-zhash.go+prefetch128 164µs ± 1% 164µs ± 2% ~ (p=0.881 n=5+5)
neo/go/fs1-zhash.py 226µs ± 1% 227µs ± 2% ~ (p=0.397 n=5+5)
neo/go/fs1-zhash.go 56.8µs ± 1% 56.9µs ± 1% ~ (p=0.889 n=5+5)
neo/go/fs1-zhash.go+prefetch128 24.8µs ± 3% 24.7µs ± 2% ~ (p=0.651 n=5+5)
neo/go/sqlite-zhash.py 264µs ± 4% 269µs ± 1% ~ (p=0.548 n=5+5)
neo/go/sqlite-zhash.go 93.5µs ± 0% 92.7µs ± 0% -0.83% (p=0.008 n=5+5)
neo/go/sqlite-zhash.go+prefetch128 39.3µs ± 4% 39.8µs ± 8% ~ (p=0.952 n=5+5)

( not sure what it was for unzlib/py/prod1-max - probaby some background process
was also running last time at that test )

ea5f9d26

. · 7c21fb98
Kirill Smelkov authored Mar 05, 2018

7c21fb98
X normalize/convert units, so that disk and ping/tcp latencies could be plotted too · 916782b6
Kirill Smelkov authored Mar 05, 2018

916782b6

04 Mar, 2018 9 commits
- . · 89682f01
  Kirill Smelkov authored Mar 04, 2018
  
  89682f01
- . · 2fd51bd0
  Kirill Smelkov authored Mar 04, 2018
  
  2fd51bd0
- . · 5369d45c
  Kirill Smelkov authored Mar 04, 2018
  
  5369d45c
- . · 12722462
  Kirill Smelkov authored Mar 04, 2018
  
  12722462
- . · fc4a7c11
  Kirill Smelkov authored Mar 04, 2018
  
  fc4a7c11
- . · 37d24e29
  Kirill Smelkov authored Mar 04, 2018
  
  37d24e29
- . · 5e042262
  Kirill Smelkov authored Mar 04, 2018
  
  5e042262
- . · 0c4e10dd
  Kirill Smelkov authored Mar 04, 2018
  
  0c4e10dd
- . · 9eae441c
  Kirill Smelkov authored Mar 04, 2018
  
  9eae441c
02 Mar, 2018 6 commits
- . · 16ac482c
  Kirill Smelkov authored Mar 02, 2018
  
  16ac482c
- X switch node info to labels; start adding that to plot · f5fec740
  Kirill Smelkov authored Mar 02, 2018
  
  f5fec740
- . · 28d00786
  Kirill Smelkov authored Mar 02, 2018
  
  28d00786
- . · 1d1e8ba6
  Kirill Smelkov authored Mar 02, 2018
  
  1d1e8ba6
- . · 12d6f138
  Kirill Smelkov authored Mar 02, 2018
  
  12d6f138
- X benchlib/benchstat: Emit label:value info for several labels on one line, similary to go version · a9b10a45
  Kirill Smelkov authored Mar 02, 2018
  
  a9b10a45
01 Mar, 2018 2 commits
- . · 32fc8327
  Kirill Smelkov authored Mar 02, 2018
  
  32fc8327
- . · c1300da3
  Kirill Smelkov authored Mar 01, 2018
  
  c1300da3
28 Feb, 2018 9 commits
- . · 6ade4c8c
  Kirill Smelkov authored Mar 01, 2018
  
  6ade4c8c
- . · f4b40c52
  Kirill Smelkov authored Feb 28, 2018
  
  f4b40c52
- . · 1b2bc5a8
  Kirill Smelkov authored Feb 28, 2018
  
  1b2bc5a8
- X neotest: Move cluster / node out fro benchmark name to label in environment · 906462a3
  Kirill Smelkov authored Feb 28, 2018
```
This should make inter-host or inter-cluster comparisions of benchmark more straightforward.
```
  906462a3
- X z600: localhost timings with upgraded everything and disabled HT · 321dfcc7
  Kirill Smelkov authored Feb 28, 2018
```
Cstates are not disabled.
First dataset graphed here:

https://lab.nexedi.com/kirr/misc/raw/526e5ca/t/zwrk-z600-htoff.png
```
  321dfcc7
- X z6001: localhost timings with upgraded everything · 97f35994
  Kirill Smelkov authored Feb 28, 2018
```
Cstates are not disabled.
First dataset grpahed here:

https://lab.nexedi.com/kirr/misc/raw/4a8fedc/t/zwrk-z6001.png
```
  97f35994
- X neotest: Prefer first part of FQDN for hostname · 2910cf56
  Kirill Smelkov authored Feb 28, 2018
```
Handy for misconfigured systems like fqdn=z6001.ivan.nexedi.com,
hostname=z6001-COMP-2784.
```
  2910cf56
- . · fe8fd50e
  Kirill Smelkov authored Feb 28, 2018
  
  fe8fd50e
- . · 174e4835
  Kirill Smelkov authored Feb 28, 2018
  
  174e4835
27 Feb, 2018 2 commits
- X benchplot: Start of automated plotting for neotest benchmark data · cceca65f
  Kirill Smelkov authored Feb 27, 2018
```
very draft; work in progress.
```
  cceca65f
- X benchlib: Python module to read & work with data in Go benchmark format · 502d9477
  Kirill Smelkov authored Feb 27, 2018
  
  502d9477
26 Feb, 2018 3 commits

X zhash: Show N(obj) read, not 1, in place of N(iter) · f834f40d
Kirill Smelkov authored Feb 26, 2018

f834f40d

X zwrk: New tool to simulate paralell load from multiple clients · 7f22bba6

Kirill Smelkov authored Feb 26, 2018

Similarly to wrk on HTTP.

Rationale: simulating multiple clients is:

1. noisy - the timings from run to run are changing sometimes up to 50%
2. with significant additional overhead - there are constant OS-level
   process switches in between client processes and this prevents to
   actually create the load.
3. the above load from "2" actually takes resources from the server in
   localhost case.

So let's switch to simlating many requests in lightweight way similarly
to how it is done in wrk - in one process and not so many threads (it
can be just 1) with many connections opened to server and epolly way to
load it with Go providing epoll-goroutine matching.

7f22bba6

X bench-cpu += crc32, adler32 · c86ba1b0
Kirill Smelkov authored Feb 26, 2018

c86ba1b0