give the spider a URL, say www.whereiwork.com/site/
recursively {
  find all linked pages, but only within that directory
}
for each page found {
  print out their titles and any meta-tags we find
}
report any errors following the links