in reply to Re^3: Any spider framework?
in thread Any spider framework?
As the author of WWW::Crawler::Lite, I am also appalled at the use of that regexp for URL detection! (What was I thinking?)
I am quite pressed for time at the moment, but I will put the module on github and re-release it with the patches/updates suggested on RT already.
FWIW I use this module in several places (and have for some time now). While there are perhaps some more "robust" spiders/crawlers out there, I wasn't able to find one as simple to use and understand as W:C:L.
Once the github + pause uploads are completed, I'll re-post here.
Thanks!
|
|---|