Re^4: How to capture data length from the record ?

in reply to Re^3: How to capture data length from the record ?
in thread How to capture data length from the record ?

hi..

Thank you very much for your help but i still stuck on reading the file format.

Right now, I am able to open the file and read every 2048 block. But, I do not have any ideas how to read each of record on the block based on the total record length?. End of the block will be padded by filler to make the block size is 2048.

The file format description as below:-

The Ericsson AIN records are stored in an input file in 2048 byte bloc
+ks. Every block is made of variable length records padded to make a 2
+048 byte blocks. 

Every record is made of a fixed 180 byte part and records may contain 
+additional tagged fields making the total length variable.

Total length of the record including fix length and variable length ca
+n be determined based on field RECORD_LENGTH.
[download]

This is my coding:-

#!/usr/bin/perl -w

use Cwd;
use warnings;
use strict;
use Getopt::Long;

use constant BLOCKLEN  => 2048;
use constant FIXRECORD => 180;

my ($trace, $help, $infile);
my $swap = '';
my $indir  = getcwd;
my $outdir = getcwd;

GetOptions (
    "h|help"    => \$help,
    "filename|f=s"    => \$infile,
    "swap|s"    => \$swap,
    "input|i=s"    => \$indir,
    "output|o=s"    => \$outdir,
    "trace|t"    => \$trace
) or usage();

my $template  = "A8 A1 A2 A2 A5 A3 A20 A20 A2 A3 A2 A2 A28 A2 A3 A5 A1
+ A1 A1 A6 A6 A6 A6 A6 A1 A6 A3 A15 A7 A7 H*";
#my @fldsize = (A8 A1 A2 A2 A5 A3 A20 A20 A2 A3 A2 A2 A28 A2 A3 A5 A1 
+A1 A1 A6 A6 A6 A6 A6 A1 A6 A3 A15 A7 A7 H*);

my @fldname = (
    "Call Identification Number",    "Cause for Output",        "Recor
+d Type",
    "Record Number",        "Record Sequence Number",    "Record Size"
+,
    "X Number",            "A Sub Number",            "A Category",
    "A Sub Number Type",        "A Sub Numbering Plan Ind",    "A Sub 
+Type",
    "B Sub Number",            "B Category",            "B Sub Number 
+Type",
    "Fault Code",            "Call Status",            "Force Disconne
+ction Info",
    "Abnormal Call Release Ind",    "Start Date",            "Start Ti
+me",
    "End Date",            "End Time",            "Duration",
    "Pulse Charging Ind",        "Number of Meter Pulses",    "Tariff 
+Class",
    "Exchange ID",            "Outgoing Route",        "Incoming Route
+",
    "Additional TAG"
);

sub usage {
    print ("USAGE: $0 -i <input_folder> -o <output_folder> -f <input_f
+ilename>\n\n");
    exit;
}

my $outfile = $infile;
my ($data, $cdr, $offset, $recLen);
my ($callid,$cause,$recType,$recNum,$recSeq);
my @rec = ();

if ($infile) {
    open (OUTPUT, ">$outdir/$outfile") or die ("Can't open $outdir/$ou
+tfile\n");
    open (DATA, "$indir/$infile") or die ("Can't open $indir/$infile\n
+");
    binmode DATA;

    while (read(DATA, $data,2048)) {
        $recLen = 0;
        $offset = 0;

        foreach my $val ($data) {
            ($callid,$cause,$recType,$recNum,$recSeq,$recLen) = unpack
+ "A8 A1 A2 A2 A5 A3", $val;

            #if ($recLen == 0x81) {
            #$recLen = unpack "C3", substr $data, 18, 3, '';
            #}

            #$cdr = substr($data, $offset, $recLen);
            #@rec = unpack $template, $cdr;
            print "RECLen : $callid,$cause,$recType,$recNum,$recSeq,$r
+ecLen,$offset\n";
            $offset += $recLen;
        }
    }
    print "~~~~~~~~~~~~~~~~~~~~~~~~~~~ NEXT BLOCK ~~~~~~~~~~~~~~~~~~~~
+~~~~~~~~~~~~~\n";
    close(DATA);
    close(OUTPUT);
}
[download]

This is the real file data:-

30 30 32 30 33 34 37 30 30 30 32 30 31 32 36 34
30 38 32 34 34 20 20 20 20 20 20 20 20 20 20 20
20 20 20 20 20 20 20 20 20 30 31 37 32 35 37 31
34 32 32 20 20 20 20 20 20 20 20 20 20 31 20 30
30 34 30 31 30 31 30 33 32 37 38 36 35 31 30 30
20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20
20 20 31 30 30 30 33 20 20 20 20 20 30 30 30 31
30 30 34 32 33 30 33 32 32 31 37 31 30 30 34 32
33 30 33 32 34 34 30 30 30 30 32 32 34 30 20 20
20 20 20 20 30 30 30 47 4c 4d 41 2f 4d 59 35 34
43 4e 41 31 2f 30 49 4e 42 47 4d 4f 20 49 41 42
31 49 20 20 9f a1 0b 00 9f be 00 02 00 16 9f be
01 81 0f 01 55 01 f0 83 18 02 20 10 00 10 00 00
00 01 9f be 19 81 09 00 01 10 60 13 00 13 13 00
9f be 1b 08 02 01 10 ff ff ff ff ff a1 06 82 04
04 00 00 00 30 30 32 30 33 34 39 36 30 30 32 30
31 32 36 34 30 39 31 38 30 20 20 20 20 20 20 20
20 20 20 20 20 20 20 20 20 20 20 20 20 30 31 32
32 37 33 38 36 39 37 20 20 20 20 20 20 20 20 20
20 31 20 30 30 34 30 31 30 31 30 33 32 37 31 30
31 38 38 33 46 20 20 20 20 20 20 20 20 20 20 20
20 20 20 20 20 20 30 30 30 30 34 20 20 20 20 20
30 30 30 31 30 30 34 32 33 30 33 32 34 34 37 31
30 30 34 32 33 30 33 32 35 30 31 30 30 30 30 31
34 31 30 30 30 30 31 33 30 30 34 47 4c 4d 41 2f
4d 59 35 34 43 4e 41 31 2f 30 4e 41 54 47 4d 4f
20 4e 41 54 47 57 49 20 30 30 32 30 33 34 37 33
30 30 32 30 31 32 36 34 31 30 32 30 30 20 20 20
20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20
20 30 31 37 36 39 38 37 35 35 36 20 20 20 20 20
20 20 20 20 20 31 20 30 30 34 30 31 30 31 31 33
30 30 31 33 31 33 30 30 46 20 20 20 20 20 20 20
20 20 20 20 20 20 20 20 20 20 31 30 30 30 34 20
20 20 20 20 30 30 30 31 30 30 34 32 33 30 33 32
32 33 34 31 30 30 34 32 33 30 33 32 35 31 33 30
30 30 32 34 30 31 30 30 30 33 31 38 30 30 34 47
4c 4d 41 2f 4d 59 35 34 43 4e 41 31 2f 30 53 53
46 44 43 46 4f 4e 41 54 47 57 49 20 9f a1 0b 00
9f a0 01 81 03 03 1a d2 a1 06 82 04 04 00 00 00
30 30 32 30 33 34 37 34 34 30 32 30 31 32 36 34
31 31 32 35 32 20 20 20 20 20 20 20 20 20 20 20
20 20 20 20 20 20 20 20 20 30 31 37 36 39 38 37
35 35 36 20 20 20 20 20 20 20 20 20 20 31 20 30
30 34 30 31 30 31 30 33 32 37 38 36 35 31 30 30
20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20
20 20 31 30 30 30 33 20 20 20 20 20 30 30 30 31
30 30 34 32 33 30 33 32 32 33 34 31 30 30 34 32
33 30 33 32 35 31 33 30 30 30 32 34 30 31 30 30
30 31 35 39 30 31 31 47 4c 4d 41 2f 4d 59 35 34
43 4e 41 31 2f 30 49 4e 42 47 4d 4f 20 49 41 42
32 49 20 20 9f a1 0b 00 9f a0 01 81 03 03 1a d1
9f be 00 02 00 16 9f be 01 81 0f 01 55 01 f0 83
19 02 20 10 00 10 00 00 00 01 9f be 19 81 09 00
03 10 60 13 00 13 13 00 9f be 1b 08 02 01 10 ff
ff ff ff ff a1 06 82 04 04 00 00 00 30 30 32 30
33 34 39 37 30 30 30 30 31 32 36 34 31 32 31 38
30 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20
20 20 20 20 20 30 37 34 31 35 36 38 39 31 20 20
20 20 20 20 20 20 20 20 20 31 20 30 30 34 30 31
30 30 32 37 33 30 35 35 32 30 46 20 20 20 20 20
20 20 20 20 20 20 20 20 20 20 20 20 20 20 30 30
30 30 33 20 20 20 20 20 30 30 30 31 30 30 34 32
33 30 33 32 34 34 33 31 30 30 34 32 33 30 33 32
35 31 35 30 30 30 30 33 33 31 30 30 30 30 33 32
30 30 34 47 4c 4d 41 2f 4d 59 35 34 43 4e 41 31
2f 30 4e 41 54 47 4c 4f 20 54 4d 4b 4c 47 49 20
30 30 32 30 33 35 30 30 30 30 30 30 31 32 36 34
31 33 31 38 30 20 20 20 20 20 20 20 20 20 20 20
20 20 20 20 20 20 20 20 20 30 33 33 31 36 38 31
37 32 33 20 20 20 20 20 20 20 20 20 20 31 20 30
30 34 30 31 30 30 32 37 33 30 35 35 31 35 46 20
20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20
20 20 30 30 30 30 33 20 20 20 20 20 30 30 30 31
30 30 34 32 33 30 33 32 34 34 34 31 30 30 34 32
33 30 33 32 35 31 36 30 30 30 30 33 33 31 30 30
30 30 33 32 30 30 34 47 4c 4d 41 2f 4d 59 35 34
43 4e 41 31 2f 30 4e 41 54 47 4c 4f 20 54 4d 4b
4c 4a 49 20 30 30 32 30 33 34 39 39 30 30 30 30
31 32 36 34 31 34 31 38 30 20 20 20 20 20 20 20
20 20 20 20 20 20 20 20 20 20 20 20 20 30 33 35
36 33 35 32 33 39 38 20 20 20 20 20 20 20 20 20
20 31 20 30 30 34 30 31 30 30 32 37 33 30 35 35
31 35 46 20 20 20 20 20 20 20 20 20 20 20 20 20
20 20 20 20 20 20 30 30 30 30 33 20 20 20 20 20
30 30 30 31 30 30 34 32 33 30 33 32 34 34 34 31
30 30 34 32 33 30 33 32 35 31 36 30 30 30 30 33
33 31 30 30 30 30 33 32 30 30 34 47 4c 4d 41 2f
4d 59 35 34 43 4e 41 31 2f 30 4e 41 54 47 4c 4f
20 54 4d 4b 4c 47 49 20 30 30 32 30 33 34 39 38
30 30 30 30 31 32 36 34 31 35 31 38 30 20 20 20
20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20
20 30 33 37 39 38 31 32 32 37 34 20 20 20 20 20
20 20 20 20 20 31 20 30 30 34 30 31 30 30 32 37
33 30 35 35 31 35 46 20 20 20 20 20 20 20 20 20
20 20 20 20 20 20 20 20 20 20 30 30 30 30 33 20
20 20 20 20 30 30 30 31 30 30 34 32 33 30 33 32
34 34 33 31 30 30 34 32 33 30 33 32 35 33 32 30
30 30 30 34 39 31 30 30 30 30 34 38 30 30 34 47
4c 4d 41 2f 4d 59 35 34 43 4e 41 31 2f 30 4e 41
54 47 4c 4f 20 54 4d 4b 4c 47 49 20 00 00 00 00
00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[download]

In Section Seekers of Perl Wisdom