Help for this page

Select Code to Download


  1. or download this
    use LWP::UserAgent;
    use WWW::RobotRules;
    ...
    } else {
      die "cant fetch $robots_url: " . $response->status_line;
    }