in reply to Anyone know why I can't scrape this page?

Check your URL, please.

I copied it to my browser and got a "page not found", too.
Then I saw the URL itself:

http://www.vegasinsider.com/nfl/odds/las-vegas/line-movement/jets-@-dolphins.%C2%ADcfm/date/9-07-08/

Looks as if there are some bytes too much...

When I removed the '%C2%AD' from the URL, the page was found and I saw a table with game stats!

update:

I tested above with Firefox 2.0.0.16.
Same test with konqueror 3.5.9 is little different, because konqueror already shows a red '-' before the 'cfm' when displaying the page.
Opera 9.52 seems to remove the strange characters silently.

Update:

Stepped in a bad trap of auto wrap option.... whatever, still don't understand completely what went wrong.

  • Comment on Re: Anyone know why I can't scrape this page?