in reply to Dealing with large logfiles
You also asked:
Yes, so long as you use them correctly. By that I mean, you need to structure your data in such a way--namely, key-value pairs--that the benefits of using a DBM will be displayed. For doing lookups on data, getting that data out of a DBM, where you have some unique key into the DBM, is much faster than searching through each line in a text file, trying to find the data. But you have to get your data set up in such a way that this is the case.> Assuming I can't get SQL, would I see a performance > increase if (e.g.) I moved to DBM from the > tab-delimited flat files?
And yes, I would recommend using Berkeley DB. Get version 2, because I've heard about memory leaks in 1.
|
|---|