Text::CSV and getline_hr

neilwatson has asked for the wisdom of the Perl Monks concerning the following question:

Greetings, I'm trying to get Text::CSV's getline_hr_all to slurp an entire CSV into a data structure, but the structure appears empty. What is my mistake?

UPDATE: Allow_loose_quotes is the winner.

#!/usr/bin/perl

use strict;
use warnings;
use Data::Dumper;
use Text::CSV;

my $file = $ARGV[0];

my $csv = Text::CSV->new ({
   sep_char         => '|',
   allow_whitespace => 1,
   binary           => 1,
   eol              => "|$/",
   allow_loose_quotes => 1, ## <--added for the win
});

open my $csv_file, "<", $file or die "Cannot open [$file] [$!]";

my $headers_ref = $csv->getline($csv_file) or die "no header";
$csv->column_names($headers_ref);

my $table_ref = $csv->getline_hr_all($csv_file);
close $csv_file;


print "headers: ".Dumper( $headers_ref );
print "table:   ".Dumper( $table_ref );
[download]

A Some lines of the csv:


job_execution_id | job_status | step_name | job_params  | job_instance
+_id | read_count | write_count | exit_message  |
625 | FAILED     | parseSchemaStep | {"dataFeedURI":"\/storage\/D1200.
+txt","metadataID":"meta.xml","Date":"2015-07-31","Id":"146"} | 625 | 
+ 0 |0 | org.springframework.integration.transformer.MessageTransforma
+tionException: ; nested exception is org.springframework.messaging.Me
+ssageHandlingException: ; nested exception is java.io.IOException: IO
+Exception encountered while retrieving metadata. 

   at
   org.springframework.integration.transformer.MessageTransformingHand
+ler.handleRequestMessage(MessageTransformingHandler.java:74) |
[download]

Now run it:

$ ./readjoblog.pl failedjob.csv 
headers: $VAR1 = [
          'job_execution_id',
          'job_status',
          'step_name',
          'job_params',
          'job_instance_id',
          'read_count',
          'write_count',
          'exit_message'
        ];
table:   $VAR1 = [];
[download]

Neil Watson
watson-wilson.ca

Comment on Text::CSV and getline_hr_all Select or Download Code

Replies are listed 'Best First'.
Re: Text::CSV and getline_hr_all by Tux (Canon) on Feb 01, 2016 at 21:59 UTC
Get Text::CSV_XS and use it's `csv` function: `use Text::CSV_XS qw( csv ); my $aoh = csv (in => $file, headers => "auto", sep => "\|", allow_white +space => 1);` [download] Enjoy, Have FUN! H.Merijn	[reply] [d/l] [select]
Re: Text::CSV and getline_hr_all by poj (Abbot) on Feb 01, 2016 at 21:08 UTC
`->getline()` returns an array ref not an array use strict; use warnings; use Data::Dumper; use Text::CSV; my $file = $ARGV[0]; my $csv = Text::CSV->new ({ sep_char => '\|', allow_whitespace => 1, binary => 1, eol => "\|$/", allow_loose_quotes => 1, ## <--add }); open my $csv_file, "<", $file or die "Cannot open [$file] [$!]"; my $headers = $csv->getline($csv_file) or die "no header"; $csv->column_names($headers); my $table_ref = $csv->getline_hr_all($csv_file); close $csv_file; print "headers: ".Dumper( $headers ); print "table: ".Dumper( $table_ref ); [download] poj	[reply] [d/l] [select]