in reply to web crawler infrastructure

Why sure, Web::Magic, maybe pdf/word... plugins