in reply to Re: Reg: Performance
in thread Reg: Performance
Greetings,
I realize that it is your intention to use perl for this task, and while I haven't seen either dump_a || dump_b
I can't help but wonder if
cat | sed | sort | uniq
might not be of great help here.
I run a _huge_ RBL with _millions_ of IP addresses.
I constantly need to parse logs, and add/remove results from the block lists.
While I began my strategy using perl scripts. I ultimately found that
cat | sed | sort | uniq
would accomplish the task in seconds as opposed to minutes/hours.
Perhaps it's my perl skills. But I just thought it was worth mentioning.
HTH
--Chris
Shameless self pronotion follows
PerlWatch
|
|---|