Re: Transaction time for LWP::UserAgent GET

Many monks have already answered, but only on a technical level. And in that respect I have nothing to add.

However, I can't help but wonder what the timing information will tell you. Either you need a copy of a page at a specific time, or you don't. Unless you want to use the timing information to be able to determine how often you can fetch the remote page before you start overlapping requests.

I don't know whether that is the case or not, but if it is, and if I were the hostmaster of this website from which you are repeatedly fetching pages without my explicit consent, I would consider your action to be akin to a DoS attack. Not to mention the possible copyright violations involved if you are redistributing the obtained information further.

In your example you're using the Perl Monks website. I'm only a user for a few weeks so far, but I already find Perl Monks sluggish at times. And I wouldn't be surprised if it were "experiments", such as yours, are at least partly responsible for this.

I may seem a bit agitated about this, but I just have had to block too many stupid slurpers in my life.

Liz

Comment on Re: Transaction time for LWP::UserAgent GET

Replies are listed 'Best First'.
Re: Re: Transaction time for LWP::UserAgent GET by c (Hermit) on Jul 25, 2003 at 17:12 UTC
Liz, The example in my post, was just that, an example and certainly not meant to be taken as production code. The URL provided in the message was a placeholder in order to not reveal the actual domain that I'll be testing against. The purpose of the script is to pull the same website over the course of a day from various locations across several NSP backbones to graph and compare latency at various points of the day. I understand your frustration with sluggish websites and having to wait for information on the internet, but I don't appreciate the character judgement you're making without any investigation. If you have a suggestion or a comment to make, please take it offline and keep this off of a forum like this. The only reason I post this publicly is to offer a bit of personal defense.	[reply]
Re: Re: Re: Transaction time for LWP::UserAgent GET by liz (Monsignor) on Jul 25, 2003 at 21:42 UTC
...The purpose of the script is to pull the same website over the course of a day from various locations across several NSP backbones to graph and compare latency at various points of the day... Wish you had said this in the first place. I'm glad you're not working on a "stupid slurper". ;-) And if I offended you, I hereby apologize. It's just that your initial description hit a nerve. I'm glad mod_perl 2 allows you to break a connection before it is actually completely set up. Liz	[reply]