Re^2: Parsing 12GB Entourage database in pieces...

I don't know how regular expressions perform with such a huge string.

Some uses of "*" are equivalent to "{0,32767}", so you might have problems.

>perl -Mre=debug -we"qr/^(.)(\1*)\z/"
...
   9:   CURLYX[1] {0,32767}(14)
...
[download]

Be sure to prevent backtracking using (?>...) or (in 5.10.0+) the possessive quantifier.

Update: "/\0\0MSrc.{16}((?>[^\0]*))(?=\0)/s" looks safe.

Comment on Re^2: Parsing 12GB Entourage database in pieces... Select or Download Code

Replies are listed 'Best First'.
Re^3: Parsing 12GB Entourage database in pieces... by betterworld (Curate) on Aug 28, 2008 at 20:40 UTC
Interesting... `perl5.8.8 -wle '$s = "x" x 40_000; $s =~ /^(.)(\1)/ and print length $2' # (segfaults) perl5.10.0 -wle '$s = "x" x 40_000; $s =~ /^(.)(\1)/ and print length $2' Complex regular subexpression recursion limit (32766) exceeded at -e l +ine 1. 32767` [download] Well, at least it seems to warn when this limitation affects the result...	[reply] [d/l]
Re^4: Parsing 12GB Entourage database in pieces... by ikegami (Patriarch) on Aug 29, 2008 at 00:21 UTC
I believe p5p is working on a patch to change that warning to a `die`.	[reply] [d/l]