Since the decision between GET/HEAD would be very website dependent, looking for non-html extensions would seem the way to go.

Judicious use of sleep between requests would also be a simple way to be gentle.