We will soon need this to be run from several places when implementing
support for -i.

/reviewed-by @jerome
/reviewed-on !15