Hmm, well, it's going to be hard to get rid of 'bigint' if you want 64-bit arithmetic to work correctly :(

If your perl doesn't know about pack 'q', then you can roll it yourself with the following, but it will be even slower:

use strict;
use warnings;
use Fcntl ':seek';
use bigint;

use constant CHUNK => 65536;

sub calc {
    my $file  = shift or die "no filename given\n";
    my $hash  = -s $file;
    my $chunk = CHUNK;

    $hash < $chunk and die "$file is too small ($hash bytes < $chunk)\
+n";

    open my $in, '<', $file or die "Cannot open $file for input: $!\n"
+;
    local $/ = \$chunk;

    my @val = unpack 'L*' , readline($in);
    for (my $j = 0; $j < $#val; $j += 2) {
        $hash += ($val[$j] << 32) + $val[$j+1];
        $hash &= 2 ** 64 - 1;
    }
    seek($in, SEEK_END, -$chunk);
    @val = unpack 'L*' , readline($in);
    for (my $j = 0; $j < $#val; $j += 2) {
        $hash += ($val[$j] << 32) + $val[$j+1];
        $hash &= 2 ** 64 - 1;
    }

    close $in;
    return sprintf '%016x', $hash;
}

open my $out, '>', 'test.deleteme';
print $out ' ' x (65536*4);
close $out;

print calc('test.deleteme'), $/;

[download]

Perl's probably not the best language for this. The code is much shorter than the other languages, which is usually the case for a given algorithm, but the performance is horrible. You really want to do yourself a favour and run this stuff on a 64 bit architecture.

Maybe there's another monk who's into numerical analysis and can spot an insight, but it's beyond my ken.

• another intruder with the mooring in the heart of the Perl

In reply to Re^3: Creating custom hash of file by grinder
in thread Creating custom hash of file by 2ge

Title:
Use:  <p> text here (a paragraph) </p>
and:  <code> code here </code>
to format your post, it's "PerlMonks-approved HTML":


  • Posts are HTML formatted. Put <p> </p> tags around your paragraphs. Put <code> </code> tags around your code and data!
  • Titles consisting of a single word are discouraged, and in most cases are disallowed outright.
  • Read Where should I post X? if you're not absolutely sure you're posting in the right place.
  • Please read these before you post! —
  • Posts may use any of the Perl Monks Approved HTML tags:
    a, abbr, b, big, blockquote, br, caption, center, col, colgroup, dd, del, details, div, dl, dt, em, font, h1, h2, h3, h4, h5, h6, hr, i, ins, li, ol, p, pre, readmore, small, span, spoiler, strike, strong, sub, summary, sup, table, tbody, td, tfoot, th, thead, tr, tt, u, ul, wbr
  • You may need to use entities for some characters, as follows. (Exception: Within code tags, you can put the characters literally.)
            For:     Use:
    & &amp;
    < &lt;
    > &gt;
    [ &#91;
    ] &#93;
  • Link using PerlMonks shortcuts! What shortcuts can I use for linking?
  • See Writeup Formatting Tips and other pages linked from there for more info.