Re: Help Writing a System to Grab Data from a Site

If this is an authorized activitiy, why don't you slurp it from the actual data source? (i.e. database, text files, etc) It is generally much easier to do the that, because HTML scrapers are difficult do write and tend to break easily with minor HTML variances.

-Blake

Comment on Re: Help Writing a System to Grab Data from a Site

Replies are listed 'Best First'.
Re: Re: Help Writing a System to Grab Data from a Site by LostS (Friar) on Aug 29, 2001 at 08:14 UTC
Well I did contact them and ask for a dump of the Forum's... They said I would have to write a script to grab the data from the web site... So I assume that is them giving me permission to do so... ----------------------- Billy S. Slinar Hardtail - Guildless Datal Ephialtes - Guildless RallosZek.Net Admin/WebMaster Aerynth.Net Admin/WebMaster `perl -e '$cat = "cat"; if ($cat =~ /\143\x61\x74/) { print "Its a cat! +\n"; } else { print "Thats a dog\n"; } print "\n";'` [download]	[reply] [d/l]
Re: Re: Help Writing a System to Grab Data from a Site by Anonymous Monk on Aug 29, 2001 at 19:27 UTC
Also..check out w3mir http://langfeldt.net/w3mir/	[reply]