Remove unneeded preloading of notes. This can be really expensive
because it is not unusual for issues to have lots of notes.

Changelog: performance
MR: https://gitlab.com/gitlab-org/gitlab/-/merge_requests/60981