They form a circular self-reference and so continue to exist forever, but become inaccessible.

There are debates about whether the next version of Perl should able to eliminate them properly with a garbage collector, but that is still the subject of discussion.