I've never seen the behavior you're describing. It should not remove the files unless you intentionally clear the cache. However, Cache::FileCache is not very fast. Using BerkeleyDB or Cache::FastMmap or even DBD::mysql is much faster.