The "hash" solution is probably the fastest, but less flexible as you can only check on the exact match between IDs and the filename part of the filepath.

It will not work if you have to check if the ID is *somewhere* mentioned in the filepath.

Still you do not have to despair! Nor do you have to check each filepath against each ID with a separate regex (which would be very slow).

Through the magic of Regexp::Assemble it only takes a program of a few lines:

use Modern::Perl;
use Regexp::Assemble;
use autodie;

open my $PATTERNS, '<', './patterns.txt';
my $re_pattern = Regexp::Assemble->new->add(<$PATTERNS>)->re;
close $PATTERNS;

open my $PATHS, '<', './paths.txt';
do {print unless /$re_pattern/} while <$PATHS>;
close $PATHS;

[download]

CountZero

A program should be light and agile, its subroutines connected like a string of pearls. The spirit and intent of the program should be retained throughout. There should be neither too little or too much, neither needless loops nor useless variables, neither lack of structure nor overwhelming rigidity." - The Tao of Programming, 4.1 - Geoffrey James

My blog: Imperial Deltronics

In reply to Re: Memory issue with large array comparison by CountZero
in thread Memory issue with large array comparison by bholcomb86

Title:
Use:  <p> text here (a paragraph) </p>
and:  <code> code here </code>
to format your post, it's "PerlMonks-approved HTML":


  • Posts are HTML formatted. Put <p> </p> tags around your paragraphs. Put <code> </code> tags around your code and data!
  • Titles consisting of a single word are discouraged, and in most cases are disallowed outright.
  • Read Where should I post X? if you're not absolutely sure you're posting in the right place.
  • Please read these before you post! —
  • Posts may use any of the Perl Monks Approved HTML tags:
    a, abbr, b, big, blockquote, br, caption, center, col, colgroup, dd, del, details, div, dl, dt, em, font, h1, h2, h3, h4, h5, h6, hr, i, ins, li, ol, p, pre, readmore, small, span, spoiler, strike, strong, sub, summary, sup, table, tbody, td, tfoot, th, thead, tr, tt, u, ul, wbr
  • You may need to use entities for some characters, as follows. (Exception: Within code tags, you can put the characters literally.)
            For:     Use:
    & &amp;
    < &lt;
    > &gt;
    [ &#91;
    ] &#93;
  • Link using PerlMonks shortcuts! What shortcuts can I use for linking?
  • See Writeup Formatting Tips and other pages linked from there for more info.