If we ask for a string as non-interned, and then ask for an interned
version of the string, we will discard the non-interned version and
generated a new interned version.  Now, keep the old version alive
as well.