in reply to Re^2: persistent cache using Cache::FileCache
in thread persistent cache using Cache::FileCache

Hmmm, have you run benchmarks? For reads, it's going to be "fast": faster, I'd expect, than BerkleyDB, and more or less as fast as MySQL if indeed the queries are for simple indexed keys, significantly faster otherwise. I don't know anything about Cache::FastMap. (But I'll read up on it; sounds interesting!)

If you have lots of RAM, and your data is big, too, memcached will outperform MySQL because you can run several daemons and circumvent the process size limit problem. (Talking 32-bit here.)

  • Comment on Re^3: persistent cache using Cache::FileCache

Replies are listed 'Best First'.
Re^4: persistent cache using Cache::FileCache
by perrin (Chancellor) on Nov 06, 2004 at 05:14 UTC
    I've run benchmarks -- I wouldn't make statements like that without trying it. BerkeleyDB is insanely fast. You can run Rob Mueller's benchmark yourself and see what you think, although it doesn't currently include a memcached comparison. It makes sense that it would be faster than Memcached, since it has no network overhead or separate server process and can cache things in shared memory.

    Striping your data across multiple machines is an advantage of memcached, although it doesn't seem relevant to this particular person's needs.

[reply]
      Thanks for the very interesting benchmarks. I didn't realize BerkeleyDB was so fast.

      If you mentioned striping in response to my point about huge data, then note that you can get the benefits even on a single machine. If, for example, you have 8GB of RAM, you can run several memcached instances on the same machine, all under 2GB in size, but still have an effective cache size that is close to your potential maximum. Of course in a few years when 64-bit machines become common this advantage goes away, but in the meanwhile memcached works around it pretty much transparently.

      But yes, this is not necessarily as useful for the OP's needs as it was for the designers of memcached.

[reply]
        How can you get a 32-bit machine to even recognize 8GB of RAM? I didn't think individual process size was the problem there. Are you talking about using PAE?
[reply]

In Section Seekers of Perl Wisdom