We noticed that the Gitaly `FetchIntoObjectPool` RPC can fail in
Gitaly Cluster. As a result, garbage collection was blocked,
preventing cleanup from happening.

We now allow GC to continue if GRPC either times out or raise some
internal error.

Relates to https://gitlab.com/gitlab-org/gitaly/-/issues/4022

Changelog: fixed