Your multi-dbm file approach sounds solid and will be very fast. Use DB_File or GDBM and you won't have to worry about any size limits.