in reply to Scrape "generated" content from secure site?

Hackerkatt, have you tried using different User-Agent strings? Some sites will only deliver content to known browser user-agents as a measure to prevent robotic browsing or spidering.
  • Comment on Re: Scrape "generated" content from secure site?