in reply to How To Write A Scraper?

I've been doing a lot of scraping, and what works for me is:

-- HTML::Treebuilder

-- Inheritance

-- Every scrape operation in its own module, and each module gets tested separately, against test data, to make sure the right thing gets extracted. This uses Test::Harness.

Replies are listed 'Best First'.
Re^2: How To Write A Scraper?
by Cody Pendant (Prior) on Jul 05, 2005 at 23:18 UTC
    Have you considered publicising what you've done, or making it available for use or comment?

    ($_='kkvvttuu bbooppuuiiffss qqffssmm iibbddllffss')
    =~y~b-v~a-z~s; print
[reply]

In Section Seekers of Perl Wisdom