This skips some hooks when some associations are not persisted. We still
keep them in `after(:build)` because there are still some cases where we
pass persisted associations to `build`