Re: Best way to cache large amount of data?

Turn on MySQL's query cache. This is the kind of thing that databases are designed for. Especially if you're using proper LIMIT clauses and have your query properly indexed.

Alternately, if you're insistent on taking it out of the DB, take a look at DBM::Deep.

My criteria for good software:

Does it work?
Can someone else come in, make a change, and be reasonably certain no bugs were introduced?

Comment on Re: Best way to cache large amount of data?

Replies are listed 'Best First'.
Re^2: Best way to cache large amount of data? by hallikpapa (Scribe) on Oct 30, 2007 at 00:55 UTC
I read a bit about the query cache in mysql, but these tables are constantly updated. Anywhere from 10-16 million records a day, so if someone issued the same query again, it may pull up older data instead of the most current. I will check out DBM::Deep. I suppose it could go either way. Send more parameters to the database so it sends the same query everytime, or use a perl mod.	[reply]
Re^3: Best way to cache large amount of data? by dragonchild (Archbishop) on Oct 30, 2007 at 01:03 UTC
Well, if the intent is for a user to be able to sort the same data they just saw, then it makes sense to be able to see the same data each time. Another possilibity is to use something like DBM::Deep to pull the data you want to show, then build your view from that intermediate cache. My criteria for good software: Does it work? Can someone else come in, make a change, and be reasonably certain no bugs were introduced?	[reply]