because json output is different on python2 and python3 and cli is only
used on python2, we don't test the exact output in python2.