Actually, to the best of my knowledge it goes back into the pool that perl allocates from. I'm surprised that any of it appears to be freed back to the OS.
If you'd like to find out more about it, I remember a post on here by elian talking about the internals of this process.