Why is it that when i run a perl script using

#!/usr/bin/perl -w

use WWW::Mechanize;

my $mech = WWW::Mechanize->new();
$mech->get("http://ebay.com/help/policies/group-guidelines.html");
print $mech->content();
print $mech->uri();
[download]

it allows me to get the content of the site, even though i went to the robots.txt file on ebay and checked to see what sites it disallowed to check its ability to obey rules. did i do something wrong so that it doesnt use LWP::UserAgent? Thanks