1. 27 May, 2017 2 commits
    • Josh Bleecher Snyder's avatar
      benchstat: don't print sign for 0% when there is no change · ae5bfa61
      Josh Bleecher Snyder authored
      When all samples are identical, instead of printing
      +0.00%, print just 0.00%.
      
      This is not just more accurate.
      When benchmarking the compiler, one item of interest
      is the impact on object file and executable sizes.
      These can change by tiny amounts, below two sig figs.
      However, the existence of any change is sometimes a cue
      to the reader to investigate further.
      This obviously should not be relied on,
      but it is nevertheless a useful signal.
      
      Change-Id: I1e5157a52fc47c6871ca87b0e9cff223f4fd43d9
      Reviewed-on: https://go-review.googlesource.com/44190
      Run-TryBot: Josh Bleecher Snyder <josharian@gmail.com>
      TryBot-Result: Gobot Gobot <gobot@golang.org>
      Reviewed-by: default avatarBrad Fitzpatrick <bradfitz@golang.org>
      ae5bfa61
    • Josh Bleecher Snyder's avatar
      benchstat: handle user-ns/op units · 0da03b58
      Josh Bleecher Snyder authored
      compilebench emits both ns/op and user-ns/op measurements.
      This CL improves benchstat's handling of such measurements.
      Migrated from https://github.com/rsc/benchstat/pull/5.
      
      Sample output, before:
      
      name       old user-ns/op  new user-ns/op  delta
      Template        279M ± 7%       273M ± 4%     ~     (p=0.329 n=6+5)
      Unicode         148M ±11%       131M ± 7%  -11.49%  (p=0.030 n=6+5)
      GoTypes         830M ± 2%       835M ± 3%     ~     (p=0.792 n=6+5)
      SSA            9.60G ± 3%      9.64G ± 2%     ~     (p=0.792 n=6+5)
      Flate           158M ± 3%       155M ± 1%     ~     (p=0.329 n=6+5)
      GoParser        204M ± 6%       202M ± 8%     ~     (p=0.792 n=6+5)
      Reflect         511M ± 9%       531M ± 6%     ~     (p=0.177 n=6+5)
      Tar             151M ± 3%       151M ± 5%     ~     (p=0.931 n=6+5)
      XML             271M ± 3%       268M ± 3%     ~     (p=0.429 n=6+5)
      
      Sample output, after:
      
      name       old user-time/op  new user-time/op  delta
      Template         279ms ± 7%        273ms ± 4%     ~     (p=0.329 n=6+5)
      Unicode          148ms ±11%        131ms ± 7%  -11.49%  (p=0.030 n=6+5)
      GoTypes          830ms ± 2%        835ms ± 3%     ~     (p=0.792 n=6+5)
      SSA              9.60s ± 3%        9.64s ± 2%     ~     (p=0.792 n=6+5)
      Flate            158ms ± 3%        155ms ± 1%     ~     (p=0.329 n=6+5)
      GoParser         204ms ± 6%        202ms ± 8%     ~     (p=0.792 n=6+5)
      Reflect          511ms ± 9%        531ms ± 6%     ~     (p=0.177 n=6+5)
      Tar              151ms ± 3%        151ms ± 5%     ~     (p=0.931 n=6+5)
      XML              271ms ± 3%        268ms ± 3%     ~     (p=0.429 n=6+5)
      
      Change-Id: I716b4e89a28adc72e9135b8c580434f748a9c0a9
      Reviewed-on: https://go-review.googlesource.com/39794
      Run-TryBot: Josh Bleecher Snyder <josharian@gmail.com>
      TryBot-Result: Gobot Gobot <gobot@golang.org>
      Reviewed-by: default avatarQuentin Smith <quentin@golang.org>
      0da03b58
  2. 12 May, 2017 1 commit
  3. 11 May, 2017 1 commit
  4. 21 Apr, 2017 3 commits
  5. 07 Apr, 2017 2 commits
  6. 04 Apr, 2017 1 commit
  7. 03 Apr, 2017 1 commit
  8. 31 Mar, 2017 3 commits
  9. 14 Mar, 2017 3 commits
  10. 07 Mar, 2017 1 commit
  11. 06 Mar, 2017 1 commit
  12. 28 Feb, 2017 2 commits
  13. 27 Feb, 2017 5 commits
  14. 17 Feb, 2017 5 commits
  15. 10 Feb, 2017 1 commit
  16. 09 Feb, 2017 1 commit
  17. 08 Feb, 2017 3 commits
  18. 03 Feb, 2017 1 commit
  19. 02 Feb, 2017 3 commits