I am using something similar for myself, to try and find a new apartment. There is this site for my town that posts available apartments, and you can then apply for them at this site. Apartments are extremely rare here in Gothenburg, and usually the one that gets first application (with good enough credentials) gets the apartment. Given this, and the fact that new entries are not even every day sometimes, you would need to sit and refresh your browser 24/7 to even have a shot at it without extreme luck.

Anyhow, my script runs in the background and polls the page at regular intervals (with my preferred search options) for changes, and if there are any, it fires up a browser with the page in question so I can see if it seems interesting and then apply. Just like yours do.

I have this running here on my comp while I am working.

I have one "significant" extra, and that is a few regexps that strips everything but the apt list from the HTML before comparing, due ot the fact that otherwise dynamics like different ads or such could affect the size comparison. This is probably not necessary for many pages, not even sure if it is for the one I am polling. :)

What all those words are trying to say is that yes, there is a use for such a script. :)

As for improvements, well, I guess it could be more configurable - maybe even put it in a module on its own, so you could just say something like:

check_site( url => $url, 
            interval => 1800,
            process => \&clean_page,
            etc => 'more options',
);
[download]

Well, you get the idea. In that case, I guess it should also fork/thread, so you could poll several sites at the same time.

Not if I know if there would be a great demand for such a module, but hey - if nothing else, it may be fun to write. :)

There are rumours that cattle prods may have at least a limited effect on the behaviour of users... :)

---

You have moved into a dark place.
It is pitch black. You are likely to be eaten by a grue.