This is an ops feature flag that will only be enabled in exceptional
circumstances so it's better to disable this by default so that we don't
have to update a lot of specs