Update:
It's one of the filesystem, the OS or the clib on the host platform. Perl is able to handle everything the host is able to throw at it, but the host system is spraining itself on the dataset. I've re-created the problem environment on other systems (different host OS) and have had no problems working with file up to (at this time) 18G.

I've just returned from perusing the archives here without finding an appropriate repsonse to my problem. I have the debug output from a process and it's some 11G in size. This is on a Solaris system with largefile support: 

ettest:/opt/qipgen_log $cat /etc/mnttab
...
/dev/dsk/c0t9d0s0       /a      ufs     rw,intr,largefiles,xattr,onerr
+or=panic,suid,dev=800040  1123102217
ettest:/opt/qipgen_log $perl -V | less
Summary of my perl5 (revision 5.0 version 6 subversion 1) configuratio
+n:
  Platform:
    osname=solaris, osvers=2.9, archname=sun4-solaris-64int
    uname='sunos localhost 5.9 sun4u sparc sunw,ultra-1'
... useperlio=undef d_sfio=undef uselargefiles=define usesocks=undef
...
  Compiler:
    cc='cc', ccflags ='-D_LARGEFILE_SOURCE -D_FILE_OFFSET_BITS=64',

[download]
split failed after some 44,000,000 lines; Perl is getting to ~ 43,835,940 lines in a 
 <br>
perl -ne '$prn++ if /18:04:54.631:/; print if $prn' FILENAME

[download]
construct.

Because I have the first 44,000,000 lines extracted through split the objective has been to pull off the last X lines. (tail -1000000 FILENAME is failing).

Suggestions?

Michael 'yes, next time I'll use the option for the source program to make lots of smaller files' R

Be Appropriate && Follow Your Curiosity

In reply to Largefile failure by mikeraz

Title:
Use:  <p> text here (a paragraph) </p>
and:  <code> code here </code>
to format your post, it's "PerlMonks-approved HTML":


  • Posts are HTML formatted. Put <p> </p> tags around your paragraphs. Put <code> </code> tags around your code and data!
  • Titles consisting of a single word are discouraged, and in most cases are disallowed outright.
  • Read Where should I post X? if you're not absolutely sure you're posting in the right place.
  • Please read these before you post! —
  • Posts may use any of the Perl Monks Approved HTML tags:
    a, abbr, b, big, blockquote, br, caption, center, col, colgroup, dd, del, details, div, dl, dt, em, font, h1, h2, h3, h4, h5, h6, hr, i, ins, li, ol, p, pre, readmore, small, span, spoiler, strike, strong, sub, summary, sup, table, tbody, td, tfoot, th, thead, tr, tt, u, ul, wbr
  • You may need to use entities for some characters, as follows. (Exception: Within code tags, you can put the characters literally.)
            For:     Use:
    & &amp;
    < &lt;
    > &gt;
    [ &#91;
    ] &#93;
  • Link using PerlMonks shortcuts! What shortcuts can I use for linking?
  • See Writeup Formatting Tips and other pages linked from there for more info.