in reply to REGEX or Not to REGEX for many items

I can't help thinking you should ask Google how to perform this sort of task. Rapid lookup of mega-large databases is their bread and butter.

Speaking of databases, that's probably a part of the solution. Distil the data into a suitably indexed database, then use that to perform the searches. Maybe if you tell us something of the why we can give somewhat more focused advice. If you've actually tried to solve the problem yourself you might like to tell us what you've tried and where it came unstuck.

True laziness is hard work
  • Comment on Re: REGEX or Not to REGEX for many items

Replies are listed 'Best First'.
Re^2: REGEX or Not to REGEX for many items
by r1n0 (Beadle) on Oct 26, 2009 at 12:11 UTC
    GrandFather,
    Thank you very much for your response. About asking Google... I have thought of that, but like you said, that is one of their bread-'n-butter items, and I don't think they are just going to hand it over. :-) I promise to keep the monks up on whatever the solution turns out to be. I have lot's of log files from various websites/ftp servers, and I am seeking a method to identify certain requests people have made. Some of the information is being looked up against header request data and other info is being looked up against content requested. This can apply to so many other things, too. I have lots of ideas for use, once I come up with something that works well. Shoving stuff into a DB has been a thought and use of triggers. Thanks again.
[reply]

In Section Seekers of Perl Wisdom