Thank you, I finally got around to trying this out. Rather than use the data tree, I used a hash with keys of the form "$rule$file$line" and made the value be 1 (anything would do, as long as a value exists). I then checked if the value existed, and if it did I ignored the line. It took less than a minute to complete.