There are a number of ways to really mess up the memory handling. I suggest you summarise the key parts of your perl code, without seeing that it is hard to suggest what is wrong.

(One thing that I found recently was the use of the ".=" operator)