I've written a parser using Parse::RecDescent and it works perfect for files of a Not Huge(*) size. But with one of my files the size of one of tokens is just very large.
I've separated that particular token and ran it through 'wc':
940 964 24576
So it's pretty big. When the parser gets to this particular token it segfaults - presumably because the internal perl variable is overflowed (which sounds stupid to me)?
Anyone had this problem before or know something I could do to fix it?