in reply to hashes performance issue
It's been six years since I played with it but this worked nicely: Building a Vector Space Search Engine in Perl. Berkeley DBs for the hashes?