in reply to Re: Speeding things up
in thread Speeding things up

Thanks. I'll explore the Mojo thingy to minimise thumps.

I'd hope that 100 hits a minute to a site that size wouldn't trigger and DDoS alarms but you're right, I should have a look at their robot policy.

Replies are listed 'Best First'.
Re^3: Speeding things up
by marto (Cardinal) on Apr 15, 2018 at 13:34 UTC

    I find the mojo route quick, easy to code and maintain, selectors make this sort of thing trivial. Post a reply if you have problems, I'll take a look.