Re: Unique spidering need

You could use WWW::Mechanize and read a couple of merlyn's articles at his stonehenge website.

If you give us more info, eg., link to a sample website to parse, the pattern you are looking for on the webpage, the output format, I can do a little demo script for you later today. ;-)

And yes, I am quite sure you can do this in a single Perl script, and it's free (but of course :-).

Comment on Re: Unique spidering need

Replies are listed 'Best First'.
Re: Re: Unique spidering need by cleverett (Friar) on Jan 23, 2004 at 05:28 UTC
Well, the WW::Mechanize part I can handle. It would be a IFRAME or A tag with a given URL as the SRC or HREF attribute. And basically, I need to know if it appears in the top left 800x600 pixels in the browser window. but having the X/Y coords would be better.	[reply]
Re: Re: Re: Unique spidering need by Roger (Parson) on Jan 23, 2004 at 05:45 UTC
I would probably use the *libgtkhtml* library to do the HTML rendering part. I haven't got a linux box handy to verify this at the moment, but I am sure that you would be able to get the level of control you seek with the library.	[reply]
Re**4: Unique spidering need by cleverett (Friar) on Jan 23, 2004 at 06:10 UTC
Installing Gtk::HTML (actually getting all the *-dev packages I need from Debian). We'll see how it goes. The best part will be if I can do this without installing XFree on my server.	[reply]