Beefy Boxes and Bandwidth Generously Provided by pair Networks
Do you know where your variables are?
 
PerlMonks  

Re: efficient way of searching though large number of text file in a given directory

by pemungkah (Priest)
on Dec 02, 2010 at 01:02 UTC ( [id://874791]=note: print w/replies, xml ) Need Help??


in reply to efficient way of searching though large number of text file in a given directory

And adding a combination of caching and Linux::Inotify2 would let you get a nice additional speed gain (plus let you know when to invalidate the cache), assuming repeated searches for the same string are going to be happening. You might even be able to quickly re-prime the cache if the underlying files change infrequently by hanging onto the N most-commonly-repeated searches, redoing these, and then reloading them into the cache in the background.
  • Comment on Re: efficient way of searching though large number of text file in a given directory

Log In?
Username:
Password:

What's my password?
Create A New User
Domain Nodelet?
Node Status?
node history
Node Type: note [id://874791]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this?Last hourOther CB clients
Other Users?
Others pondering the Monastery: (4)
As of 2024-04-18 22:46 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    No recent polls found