URL filtering in Perl

Anonymous Monk has asked for the wisdom of the Perl Monks concerning the following question:

Hey monks,

I'm in a bit of tight spot with optimization and regular expressions. I'm making a program that uses URLs, but I'd like to filter out some URLs by using the easylist that Adblock Plus uses. Found here:
http://easylist.adblockplus.org/easylist.txt
What's the best way to pass hundreds, maybe thousands of URLs through that list?

Any tips would be greatly appreciated,
Mike

Comment on URL filtering in Perl

Replies are listed 'Best First'.
Re: URL filtering in Perl by jethro (Monsignor) on Jun 20, 2009 at 10:38 UTC
It seems the maker of adblock plus detailed its algorithm on the page http://adblockplus.org/blog/investigating-filter-matching-algorithms Unlike javascript perl would have no problem with the Robin-Karp algorithm so you might choose either the Robin-Karp or the adapted Boyer-Moore I believe. I found the following sentence in the comments of the page http://adblockplus.org/blog/investigating-filter-matching-algorithms : Btw, EasyList doesn’t have any regexps, you must be confusing something here. If that is true, all you need to do for the final matching of a pattern is to use quotemeta on the pattern and then use it as is in the regex	[reply]
Re: URL filtering in Perl by Anonymous Monk on Jun 20, 2009 at 09:15 UTC
First find the format specification for that file, them rules.	[reply]