If it's really running out of memory, and the files are too large for 5.5.3 to handle, you will probably need to look at splitting up the job somehow. You could also use standard unix utilities like sort (which can remove duplicates too). I believe sort can handle just about anything that your OS can.