Hi, I've been playing around with WWW::Spyder which seems to be a nice module and does most of what I need. Unfortunately I don't see a way to analyze the URL to be crawled before the spider crawls it which it hard to control the crawling process. Below is the while loop I'm using. Does anyone have a suggestion or is there a better module to use? while ( my $page = $spyder->crawl ) { #process page... }