This fixes the deprecation messages showing up because
we are using autoload in initializers

There is now easy way to not autoload in initializers
because we load a lot of application code there

One side-effect of this is that autoload_paths is now
frozen when running the initializers. We don't mutate
autoload_paths here anyway so this should be fine