in reply to Grabbing a hundred pages
However, you might not want to put them into variables. Why do you want to run regexen on these pages in the first place? If you want to store them locally and/or put them back, you could set up a directory accessible only by your script, and fetch all the pages into that directory using LWP, then read each one (line by line or as a whole). If you need to run regexen which modify the string, try in-place editing (documented under the -i switch in perlrun).
Also, if you're planning on parsing the HTML using regexen, that's generally a bad idea; in that case, look into HTML::Parser instead.
|
|---|