in reply to Help with Web Scraping Script - Updated

This isn't a SSCCE (e.g. get is not shown), however, a couple of points. You read from STDIN but don't chomp. You don't print the reason for failure when you call die, e.g. ....or die "Can't open directory: $!\n". Hopefully you have rate limited requests so you're not hammering the sites in question. Also How do I post a question effectively?

Update: Strikeout, see below.

Replies are listed 'Best First'.
Re^2: Help with Web Scraping Script
by hippo (Archbishop) on Oct 19, 2017 at 10:33 UTC
    This isn't a SSCCE (e.g. get is not shown)

    The OP is using LWP::Simple which exports get so it's probably safe to assume that it is that one.

      (Picard) Face palm. I sit corrected. Too early for me.