Re: file size limit with Tie::File

I notice that you are processing a UNIXish file on a DOSish system, so you may be running into line ending issues (with your code thinking the file contains a single 30Mb line). Just a guess of course.

It's exceedingly unlikely to be an issue with your perl version or build options.

Dave.

Comment on Re: file size limit with Tie::File

Replies are listed 'Best First'.
Re^2: file size limit with Tie::File by alw (Sexton) on Apr 10, 2007 at 23:40 UTC
I ended up using $. to keep track of line numbers and a scale widget to select what chunk I want to display. $pointer is the value of the scale. I read the whole file in first and display $pagesize worth of lines. The -to for scale is then computed and the scale callback(getNextPage) configured(not shown here). The response time is really good and the memory usage is kept low also. `while ( <FH> ) { $tw->insert('end',$_) if $. <= $pagesize; } my $to = ($. % $pagesize == 0) ? int( $. / $pagesize) : int( $. / $pagesize) + 1;` [download] `sub getNextPage { my ( $tw ) = @_; $tw->delete('1.0','end'); my $start = ( $pointer -1 ) * $pagesize; open FH,$messvar or warn "messvar= $messvar $!\n"; while ( my $line = <FH> ) { next if $. <= $start; $tw->insert('end',$line); last if $. == ($pointer * $pagesize); } $tw->see('1.0'); close FH; }` [download]	[reply] [d/l] [select]

Replies are listed 'Best First'.

Re^2: file size limit with Tie::File
by alw (Sexton) on Apr 10, 2007 at 23:40 UTC

while ( <FH> ) {
    $tw->insert('end',$_) if $. <= $pagesize;        
}
        
my $to = ($. % $pagesize == 0) ? int( $. / $pagesize)
                               : int( $. / $pagesize) + 1;
[download]

sub getNextPage {
    my ( $tw ) = @_;
    $tw->delete('1.0','end');
    my $start = ( $pointer -1 )  * $pagesize;
    open FH,$messvar or warn "messvar= $messvar $!\n";
    while ( my $line = <FH> ) {    
        next if $. <= $start;
        $tw->insert('end',$line);
        last if $. == ($pointer * $pagesize);
    }
    $tw->see('1.0');
    close FH;
}
[download]

[reply]
[d/l]
[select]