80degreez has asked for the wisdom of the Perl Monks concerning the following question:
I wrote a script in perl using WWW::Mechanize to automate MySpace functions. And I noticed recently it seems to be getting "stuck" a lot so I had it dump the mech content and it returns:
"500 Server closed connection without sending any data back"
Is there any way to have it handle this without waiting for time-out?
some sites like MySpace don't like web spiders like so you probably must trick it
into thinking you are a normal user using a normal browser
see this for a reference on how to use the agent_alias method for this purpose.
also check out the already written myspace modules on cpan