Syntactic Confectionery Delight | |
PerlMonks |
Re^2: Using indexing for faster lookup in large fileby anli_ (Novice) |
on Mar 02, 2015 at 17:41 UTC ( [id://1118446]=note: print w/replies, xml ) | Need Help?? |
Thanks for a great reply. This was exactly what I was looking for. It is quite time consuming to do the indexing, currently is taken > 2 hours (still running), but the lookups seem much faster. Testing it out on a smaller dataset, there is a 3x time reduction vs grep, and I'll have to see how that scales with the full dataset. I did some modifications to the code, adapting it to the Lucy::Simple module, so right now it looks like this: indexer.pl
query.pl:
All the perlmonks XP is your birthday reward :)
In Section
Seekers of Perl Wisdom
|
|