But you could still address the webmaster with a question like:

If I write a spidering agent that hits your site, do you have any guidelines, such as time-of-day, rate-of-hits, or areas examined?

If you were to write me with that, I'd be very happy to tell you.