Beefy Boxes and Bandwidth Generously Provided by pair Networks
laziness, impatience, and hubris
 
PerlMonks  

Re: Efficient 7bit compression

by QM (Parson)
on Mar 15, 2005 at 00:06 UTC ( [id://439504]=note: print w/replies, xml ) Need Help??


in reply to Efficient 7bit compression

Does it make any sense to incorporate several approaches, and make the system adaptive?

Let's say we've done some benchmarking (which I haven't), and I have these systems, breakpoints and savings (negative is space saved):

string length system 0-10 plain (+10%) 11-50 7bit packing (-10%) 51-100 huffman (-20%) 101- LZ (-35%)
Now, the first 2 bits (or byte, if plain) indicates which system is being used. Note that the plain text system suffers because of the overhead of the leading indicator.

Would a system like this work? What would the breakpoints be? Is it worthwhile to combine any elements together?

Or is it the case that benchmarking should be used to find the system that gives the best performance on the typical data, and stick with that?

-QM
--
Quantum Mechanics: The dreams stuff is made of

Log In?
Username:
Password:

What's my password?
Create A New User
Domain Nodelet?
Node Status?
node history
Node Type: note [id://439504]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this?Last hourOther CB clients
Other Users?
Others about the Monastery: (7)
As of 2024-03-28 18:39 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    No recent polls found