Re^10: bit by overhead

I have indeed tried your suggestion:


sub to_cache {
    my( $ticker, $data ) = @_;

    $data_cache{$ticker} = pack "(A10FFFFL)*", map @$_, @$data;
}

sub from_cache {
    my $ticker = shift;
    return [
        map[
            unpack("A10FFFFL", $_)
        ], unpack '(A[A10FFFFL])*', $data_cache{$ticker}
        ];
}
[download]

But it doesn't seem to be working. Is this code assuming that the packed rows are stored together as a single scalar?

Comment on Re^10: bit by overhead Download Code

Replies are listed 'Best First'.
Re^11: bit by overhead by BrowserUk (Patriarch) on Jan 07, 2011 at 18:14 UTC
That code comes from Re^9: bit by overhead and is identified as being slower than this: `my %cache2; sub to_cache2 { my( $ticker, $data ) = @_; $cache2{$ticker} = [ map pack("A10FFFFL", @$_), @$data ]; } sub from_cache2 { my $ticker = shift; return [ map unpack("A10FFFFL", $_), @{ $cache2{$ticker} } ]; }` [download] which you should use instead. The suggestions I was referring to are: Do you use all 251 sets of 6 values every time you retrieve the data from the cache? The gist of where I'm going with this, is that if you don't use them all each time, you might be better to use a two level cache so that you unpack less data each time. Or, if you do use all the value for each ticker each time, then could you not cache the results of whatever you do with them, rather than the raw data itself? Examine what is said, not who speaks -- Silence betokens consent -- Love the truth but pardon error. "Science is about questioning the status quo. Questioning authority". In the absence of evidence, opinion is indistinguishable from prejudice.	[reply] [d/l]

Replies are listed 'Best First'.

Re^11: bit by overhead
by BrowserUk (Patriarch) on Jan 07, 2011 at 18:14 UTC

That code comes from Re^9: bit by overhead and is identified as being slower than this:

my %cache2;
sub to_cache2 {
    my( $ticker, $data ) = @_;

    $cache2{$ticker} = [ map pack("A10FFFFL", @$_), @$data ];
}

sub from_cache2 {
    my $ticker = shift;
    return [ map unpack("A10FFFFL", $_), @{ $cache2{$ticker} } ];
}
[download]

which you should use instead.

The suggestions I was referring to are:

Do you use all 251 sets of 6 values every time you retrieve the data from the cache?
The gist of where I'm going with this, is that if you don't use them all each time, you might be better to use a two level cache so that you unpack less data each time.
Or, if you do use all the value for each ticker each time, then could you not cache the results of whatever you do with them, rather than the raw data itself?

Examine what is said, not who speaks -- Silence betokens consent -- Love the truth but pardon error.

"Science is about questioning the status quo. Questioning authority".

In the absence of evidence, opinion is indistinguishable from prejudice.

[reply]
[d/l]