All,

This might be a little hard to explain, but I'll try anyway. I have a xls/csv file, that has multiple data records in it. The problem is the records are not grouped together. For example (where '-' is being used to signify a new column), (the numbers are obviously made up) 

# - size - reads   - writes   - read IOPs - write IOPs  
1 - 512  - 1000    - 0        - 2000      - 0
2 - 1024 - 0       - 1000     - 0         - 2000
3 - 2048 - 500     - 500      - 1000      - 1000

# - Time Stamp
1 - 2005-05-02 18:16:36:589
2 - 2005-05-03 18:16:36:589
3 - 2005-05-04 18:16:36:589

# - Comments
1 - This test failed
2 - This test passed
3 - This test needs more data.

[download]
So, in this case, there are 3 records that I want to import into my db (all the lines that start with 1, 2 and 3). But, as you can see, they are on different lines. Each column name (size, reads, writes, etc) are attributes in my database table.

So, my thought was to make a array of hash references where the array size would be how many records are in the file (because it may vary), and the hash ref would contain all the data for that record. So, my array would look something like: 

$myarray[0] = {
              'size'       => '512',
              'reads'      => '1000',
              'writes'     => '0',
              'read IOPs'  => '2000',
              'write IOPS' => '0',
              'Time Stamp' => '2005-05-02 18:16:36:589',
              'Comments'   => 'Thie tst failed'
              }

[download]
I'm just not sure how to parse that file where the data is all on different lines. There is one thing, each line that starts with a "#" is the column name, so that might help in the parsing.

As always - thanks all.

In reply to Parsing a csv file with multiple data records in it (generated from Window's IOMeter) by TASdvlper

Title:
Use:  <p> text here (a paragraph) </p>
and:  <code> code here </code>
to format your post, it's "PerlMonks-approved HTML":


  • Posts are HTML formatted. Put <p> </p> tags around your paragraphs. Put <code> </code> tags around your code and data!
  • Titles consisting of a single word are discouraged, and in most cases are disallowed outright.
  • Read Where should I post X? if you're not absolutely sure you're posting in the right place.
  • Please read these before you post! —
  • Posts may use any of the Perl Monks Approved HTML tags:
    a, abbr, b, big, blockquote, br, caption, center, col, colgroup, dd, del, details, div, dl, dt, em, font, h1, h2, h3, h4, h5, h6, hr, i, ins, li, ol, p, pre, readmore, small, span, spoiler, strike, strong, sub, summary, sup, table, tbody, td, tfoot, th, thead, tr, tt, u, ul, wbr
  • You may need to use entities for some characters, as follows. (Exception: Within code tags, you can put the characters literally.)
            For:     Use:
    & &amp;
    < &lt;
    > &gt;
    [ &#91;
    ] &#93;
  • Link using PerlMonks shortcuts! What shortcuts can I use for linking?
  • See Writeup Formatting Tips and other pages linked from there for more info.