Contributes to https://gitlab.com/gitlab-org/gitlab/-/issues/271242

* Short-circuit cross_namespace check
* Use memoized result of the full_path

Changelog: performance