in reply to web scraper testing

you could create some webpages somewhere that mimick various situations you want to scrape and have these be your test-cases.