Extract Web Page with Images and HTML to PS

rose has asked for the wisdom of the Perl Monks concerning the following question:

Great Monks,

I need two helps are followings:

1. Extract the webpages with images to local system.

I tried the following: lwp-rget, lwp-download and LWP::UserAgent

but It gets the html file only. I need Images also.

2. How to convert the HTML files to PS Files.

Advance Thanks,
Rose

Comment on Extract Web Page with Images and HTML to PS Download Code

Replies are listed 'Best First'.
Re: Extract Web Page with Images and HTML to PS by planetscape (Chancellor) on Jul 20, 2006 at 07:34 UTC
I heartily recommend WWW::Mechanize for web scraping. HTTP::Recorder or WWW::Mechanize::Shell can do much to make your life easier. w3mir works well for mirroring entire pages/sites, including multimedia. I would suggest searching CPAN for PostScript modules. You may wish to take a slightly different approach with PDF::FromHTML (credit Ieronim for that link). I can also recommend PrimoPDF, if you decide to go that route. HTH, planetscape	[reply]
Re: Extract Web Page with Images and HTML to PS by davorg (Chancellor) on Jul 20, 2006 at 07:45 UTC
Easiest way to download web pages is to use wget. You'll probably find it preinstalled on most Linux systems. And to convert PS I often use Firefox's "print to file" feature. It's just a shame that (as far as I know) that can't be controlled programatically. -- <http://dave.org.uk> "The first rule of Perl club is you do not talk about Perl club." -- Chip Salzenberg	[reply]
Re^2: Extract Web Page with Images and HTML to PS by prostoalex (Scribe) on Jul 20, 2006 at 21:43 UTC
wget would get you the ascii returned by the server, but not the images, etc. If he's generating a snapshot of a Web site, he needs some rendering as well, I'd assume.	[reply]
Re^3: Extract Web Page with Images and HTML to PS by davorg (Chancellor) on Jul 21, 2006 at 05:25 UTC
If you use the -p option with wget then you get all the images too. -- <http://dave.org.uk> "The first rule of Perl club is you do not talk about Perl club." -- Chip Salzenberg	[reply]