Always call the refnanny on function exit if we set it up on entry, not just in GIL-owning functions.
This was previously using inconsistent conditions on entry and exit of the function.