in reply to Re: Reg: Performance
in thread Reg: Performance

Greetings,

I realize that it is your intention to use perl for this task, and while I haven't seen either dump_a || dump_b

I can't help but wonder if

cat | sed | sort | uniq

might not be of great help here.

I run a _huge_ RBL with _millions_ of IP addresses.

I constantly need to parse logs, and add/remove results from the block lists.

While I began my strategy using perl scripts. I ultimately found that

cat | sed | sort | uniq

would accomplish the task in seconds as opposed to minutes/hours.

Perhaps it's my perl skills. But I just thought it was worth mentioning.

HTH

--Chris

Shameless self pronotion follows
PerlWatch