Re: Script is accurate 80% of time

See LWP head mystery and replies, particularly merlyn's succinct explanation. Many sites deny HEAD requests (does anyone know why?), so failed ones should be retried with get().

After Compline,
Zaxo

Comment on Re: Script is accurate 80% of time

Replies are listed 'Best First'.
Re: Re: Script is accurate 80% of time by belg4mit (Prior) on Mar 27, 2002 at 18:23 UTC
I don't know why, but the only reason I can think of makes the site operator out to be really stupid/vicious. Without a HEAD a client cannot determine the state of a page and will have to refetch with GET. For users this means you might be able to show more ad's. It might also be possible to exploit this for search-engines as well. However according to this page it would seem that HTTP/0.9 did not have HEAD. Though I hope there aren't that many HTTP/0.9 hosts out there... `-- perl -pe "s/\b;([st])/'\1/mg"`	[reply]

Replies are listed 'Best First'.

Re: Re: Script is accurate 80% of time
by belg4mit (Prior) on Mar 27, 2002 at 18:23 UTC

However

page

-- perl -pe "s/\b;([st])/'\1/mg"

[reply]