for each page-I-want-to-get{
  get it using LWP:Simple or skip if error
  munge the HTML
  write it out to a file
}

then write out a new "index.html" file with links to all the files 
rewritten at the previous step.

##</code><code>##

for each page-I-want-to-get{
  check it's up using LWP:Simple's head(); or skip if error
}
output a new "index.cgi" page with links to all the files which are 
*about* to be created from the pages which passed the test 
above

then go and actually get the pages' html , munge it and write the
files 

##</code><code>##

print '</body></html>';