in reply to scalable chomping
You're right about crashing. You need to process huge files in chunks. If + really is the "end of line" character, it's easy to change the end of line separator in perl. If it's more complex you have to pick some other line end character. Or, use sysread() to read the file in chunks.
In Section Seekers of Perl Wisdom