But the idea is to make this as extensible and manageable as possible since there can be new data sources, change in specification or new specification, and change in output format. Any suggestions are most welcome. thank you, Sam
My comments are this:
  1. I think it is best to abstract from something that is working, rather than create something which is abstractly satisfying that you need to get practical results from. In other words, I would just get some sources parsed and then allow the patterns to show themselves and then abstract that into a framework as a framework is needed. Also, I hope that a friend of mine can dig up the link to a CPAN data processing framework that I once saw.. the only only one I found via google was Data::Consumer
  2. There are several modules for parsing fixed with (fixed-length) data:
    1. Parse::FixedLength
    2. Text::FixedLength
    3. DataExtract::FixedWidth

In reply to Re: framework for data parsing by metaperl
in thread framework for data parsing by sam700

Title:
Use:  <p> text here (a paragraph) </p>
and:  <code> code here </code>
to format your post, it's "PerlMonks-approved HTML":


  • Posts are HTML formatted. Put <p> </p> tags around your paragraphs. Put <code> </code> tags around your code and data!
  • Titles consisting of a single word are discouraged, and in most cases are disallowed outright.
  • Read Where should I post X? if you're not absolutely sure you're posting in the right place.
  • Please read these before you post! —
  • Posts may use any of the Perl Monks Approved HTML tags:
    a, abbr, b, big, blockquote, br, caption, center, col, colgroup, dd, del, details, div, dl, dt, em, font, h1, h2, h3, h4, h5, h6, hr, i, ins, li, ol, p, pre, readmore, small, span, spoiler, strike, strong, sub, summary, sup, table, tbody, td, tfoot, th, thead, tr, tt, u, ul, wbr
  • You may need to use entities for some characters, as follows. (Exception: Within code tags, you can put the characters literally.)
            For:     Use:
    & &amp;
    < &lt;
    > &gt;
    [ &#91;
    ] &#93;
  • Link using PerlMonks shortcuts! What shortcuts can I use for linking?
  • See Writeup Formatting Tips and other pages linked from there for more info.