rkg has asked for the wisdom of the Perl Monks concerning the following question:
Screen scraping is horrible, and clearly not the Right Way to access web resources. But sometimes screen scraping is necessary to get things done.
For serious screen scraping (yuck), I'm more convinced OLE + IE is the way to go. Often the pages I need to access involve Javascript, pop-up confirmation menus, file selection windows, and file download windows.
To my understanding, LWP and its derivitatives can't handle this sort of complexity. And to my understanding, samie doesn't yet handle popup dialog screens, upload screens, or file downloads.
In my opinion, there's a need for a solid Win32 app to drive IE in a serious way, to allow access to complex web environments involving non-vanilla pages. I asked a few months ago, but I'll toss out the question again:
Does anyone know of a robust full-featured module for driving IE?
Thanks for suggestions --
|
---|
Replies are listed 'Best First'. | |
---|---|
Re: On being an IE browser, revisited
by PodMaster (Abbot) on Feb 29, 2004 at 16:12 UTC | |
Re: On being an IE browser, revisited
by grinder (Bishop) on Feb 28, 2004 at 22:08 UTC | |
by rkg (Hermit) on Feb 28, 2004 at 22:36 UTC | |
by flyingmoose (Priest) on Feb 28, 2004 at 23:52 UTC |