I think TedPride has the right idea. Setting $INPUT_RECORD_SEPERATOR to undefined (undef $/) has the effect of causing the while(<IN> statement to slurp the entire three+ gig file at once. From the docs
"Entirely undefining $/ makes the next line input operation slurp in the remainder of the file as one scalar value"
Set $/ to some reasonable size, maybe to satisfy memory limitations. Then you can match blocks of the file in much the way TedPride describes. Something like this

#undef $/;
$/ = \2048;         # 2K blocks
my $blocksz = 2048;

open IN, "tmp";
open OUT, ">>$ARGV[1]";   #more efficient when parsing more than one b
+lock

#Extract the necessary data bits
my $block01 = <IN>;
my $block02 = '';
while ($block02 = <IN>) {

     my $block = $block01.$block02;
     $block =~ s/11110100.{8}(.{1520})11110100.{8}(.{464}).{1056}/$1$2
+/g;

#     $_ =~ s/11110100.{8}(.{1520})11110100.{8}(.{464}).{1056}/$1$2/g;

#     $final - pack("B*", $_); #Conver data back to original binary fo
+rmat
#     $final = pack("B*", $block);  # this is wrong
     $final = pack("B*", substr($block,0,$blocksz)); # this should wor
+k

     print OUT "$final";

     $final = ''; # this is strictly unnecssary but does keep variable
+ clean
#     undef $final;

     $block01 = substr($block,-$blocksz);  # this moves the upper bloc
+k down 
}

$final = pack("B*", substr($block,-$blocksz)); # get final block
print OUT "$final";

close OUT;
close IN;

[download]

Update:

Corrected a couple lines in code

PJ
use strict; use warnings; use diagnostics;

In reply to Re: Out of memory problems by periapt
in thread Out of memory problems by tperdue

Title:
Use:  <p> text here (a paragraph) </p>
and:  <code> code here </code>
to format your post, it's "PerlMonks-approved HTML":


  • Posts are HTML formatted. Put <p> </p> tags around your paragraphs. Put <code> </code> tags around your code and data!
  • Titles consisting of a single word are discouraged, and in most cases are disallowed outright.
  • Read Where should I post X? if you're not absolutely sure you're posting in the right place.
  • Please read these before you post! —
  • Posts may use any of the Perl Monks Approved HTML tags:
    a, abbr, b, big, blockquote, br, caption, center, col, colgroup, dd, del, details, div, dl, dt, em, font, h1, h2, h3, h4, h5, h6, hr, i, ins, li, ol, p, pre, readmore, small, span, spoiler, strike, strong, sub, summary, sup, table, tbody, td, tfoot, th, thead, tr, tt, u, ul, wbr
  • You may need to use entities for some characters, as follows. (Exception: Within code tags, you can put the characters literally.)
            For:     Use:
    & &amp;
    < &lt;
    > &gt;
    [ &#91;
    ] &#93;
  • Link using PerlMonks shortcuts! What shortcuts can I use for linking?
  • See Writeup Formatting Tips and other pages linked from there for more info.