in reply to Re^9: Byte allign compression in Perl..
in thread Byte allign compression in Perl..

It does sound as though the OP has a bigger data set in mind though.

I'm setting up a bigger DB (and one that doesn't require all the quoted field/table/function names), as we speak to test the scalability, but on my preliminary tests it should scala pretty nearly linearly. (Famous last words :)

Intruiging dataset you have there!

I selected 15,000 words at random from my dictionary. Then 554 words at random from that 5000 times to become the documents. They wouldn't make for very interesting reading :)

The schema I'm using is the one I posted earlier. And some of the complexity of the query is hidden behind user defined functions in the DB.


Examine what is said, not who speaks -- Silence betokens consent -- Love the truth but pardon error.
"Science is about questioning the status quo. Questioning authority".
In the absence of evidence, opinion is indistinguishable from prejudice.
"Too many [] have been sedated by an oppressive environment of political correctness and risk aversion."
  • Comment on Re^10: Byte allign compression in Perl..