in reply to Re^2: Building a dynamic array or some other method?
in thread Building a dynamic array or some other method?

It looks like The_DJ post was slurping in correctly, but was not using csv to output a correct csv file.

Try this: 

#!/usr/bin/perl

use strict; # https://perlmonks.org/?node_id=11159049
use warnings;
use Text::CSV qw( csv );

my $data = <<'';
File Server,Access Path,Current Permissions,Logon Name,Inherited From 
+Folders,Flags,User/Group,Classification Results,Classification Result
+s by Category (Including Nested),Total Hit Count
10.15.106.71,/Common/Awareness and Training/KnowBe4/2020- KnowBe4 Subs
+cription Renewal Docs/Axidome Quote My Corp 2020211 KnowBe4 2-yr Rene
+wal FINAL.pdf,FMRWX,@FOO NOW Onsite Support,\Common,This folder only,
+Pathway12.My.Corp.com\@FOO NOW Onsite Support,IRS Data (1/1),PII (1),
+1
10.15.106.71,/Common/Awareness and Training/KnowBe4/2020- KnowBe4 Subs
+cription Renewal Docs/Axidome Quote My Corp 2020211 KnowBe4 2-yr Rene
+wal FINAL.pdf,FMRWX,Administrators,\Common,This folder only,10.15.106
+.71\Administrators,IRS Data (1/1),PII (1),1
10.15.106.71,/Common/Awareness and Training/KnowBe4/2020- KnowBe4 Subs
+cription Renewal Docs/Axidome Quote My Corp 2020211 KnowBe4 2-yr Rene
+wal FINAL.pdf,FMRWX,Creator Owner,\Common,This folder only,Abstract\C
+reator Owner,IRS Data (1/1),PII (1),1
10.15.106.71,/Common/Awareness and Training/KnowBe4/2020- KnowBe4 Subs
+cription Renewal Docs/Axidome Quote My Corp 2020211 KnowBe4 2-yr Rene
+wal FINAL.pdf,FMRWX,FP NOW BMG FSE NTFS Admins,\Common,This folder on
+ly,Pathway12.My.Corp.com\FP NOW BMG FSE NTFS Admins,IRS Data (1/1),PI
+I (1),1
10.15.106.71,/Common/Awareness and Training/KnowBe4/2020- KnowBe4 Subs
+cription Renewal Docs/Axidome Quote My Corp 2020211 KnowBe4 2-yr Rene
+wal FINAL.pdf,FMRWX,ClusterSvcDIR,\Common,This folder only,Pathway12.
+My.Corp.com\ClusterSvcDIR,IRS Data (1/1),PII (1),1
10.15.106.71,/Common/Awareness and Training/KnowBe4/2020- KnowBe4 Subs
+cription Renewal Docs/Axidome Quote My Corp 2020211 KnowBe4 2-yr Rene
+wal FINAL.pdf,FMRWX,SYSTEM,\Common,This folder only,Abstract\SYSTEM,I
+RS Data (1/1),PII (1),1
10.15.106.71,/Common/Awareness and Training/KnowBe4/2020- KnowBe4 Subs
+cription Renewal Docs/Axidome Quote My Corp 2020211 KnowBe4 2-yr Rene
+wal FINAL.pdf,FMRWX,MiJim,<not inherited>,This folder only,"Pathway12
+.My.Corp.com\Michaels, Jim@My",IRS Data (1/1),PII (1),1
10.15.106.71,/Common/Awareness and Training/KnowBe4/2020- KnowBe4 Subs
+cription Renewal Docs/Axidome Quote My Corp 2020211 KnowBe4 2-yr Rene
+wal FINAL.pdf,MRWX,@FP DIR BMG,\Common,This folder only,Pathway12.My.
+Corp.com\@FP DIR BMG,IRS Data (1/1),PII (1),1
10.15.106.71,/Common/Awareness and Training/KnowBe4/2020- KnowBe4 Subs
+cription Renewal Docs/Axidome Quote My Corp 2020211 KnowBe4 2-yr Rene
+wal FINAL.pdf,RX,&CDAdmin,\Common,This folder only,Pathway12.My.Corp.
+com\&CDAdmin,IRS Data (1/1),PII (1),1
10.15.106.71,/Common/Awareness and Training/KnowBe4/2020- KnowBe4 Subs
+cription Renewal Docs/Axidome Quote My Corp 2020211 KnowBe4 2-yr Rene
+wal FINAL.pdf,RX,@FOO DSMS Admins,\Common,This folder only,Pathway12.
+My.Corp.com\@FOO DSMS Admins,IRS Data (1/1),PII (1),1
10.15.106.71,/Common/Awareness and Training/KnowBe4/2020- KnowBe4 Subs
+cription Renewal Docs/Axidome Quote My Corp 2020211 KnowBe4 2-yr Rene
+wal FINAL.pdf,RX,FOO BMG FS Support,\Common,This folder only,Pathway1
+2.My.Corp.com\FOO BMG FS Support,IRS Data (1/1),PII (1),1
10.15.106.71,/Common/Awareness and Training/KnowBe4/2020- KnowBe4 Subs
+cription Renewal Docs/Axidome Quote My Corp 2020211 KnowBe4 2-yr Rene
+wal FINAL.pdf,RX,DPeterso,\Common,This folder only,"Pathway12.My.Corp
+.com\Peterson, Dan@My",IRS Data (1/1),PII (1),1
10.15.106.71,/Common/Awareness and Training/KnowBe4/2020- KnowBe4 Subs
+cription Renewal Docs/Axidome Quote My Corp 2020211 KnowBe4 2-yr Rene
+wal FINAL.pdf,RX,FP BMG IMG Read Access,\Common,This folder only,Path
+way12.My.Corp.com\FP BMG IMG Read Access,IRS Data (1/1),PII (1),1
10.15.106.71,/Common/Awareness and Training/KnowBe4/2020- KnowBe4 Subs
+cription Renewal Docs/My-B8245.pdf,FMRWX,@FOO NOW Onsite Support,\Com
+mon,This folder only,Pathway12.My.Corp.com\@FOO NOW Onsite Support,IR
+S Data (1/1),PII (1),1
10.15.106.71,/Common/Awareness and Training/KnowBe4/2020- KnowBe4 Subs
+cription Renewal Docs/My-B8245.pdf,FMRWX,Administrators,\Common,This 
+folder only,10.15.106.71\Administrators,IRS Data (1/1),PII (1),1
10.15.106.71,/Common/Awareness and Training/KnowBe4/2020- KnowBe4 Subs
+cription Renewal Docs/My-B8245.pdf,FMRWX,Creator Owner,\Common,This f
+older only,Abstract\Creator Owner,IRS Data (1/1),PII (1),1

my %database;
my $aoa = csv( in => \$data ); # FIXME change to filename
my @output = shift @$aoa; # the header

for my $fields ( @$aoa )
  {
  my $ref = \%database;
  $ref = $ref->{$_} //= {} for @$fields;
  }

combine( \%database ); # combine lines with common beginning
csv( in => \@output, out => *STDOUT ); # FIXME change to filename

sub tail
  {
  my $ref = shift;
  my ($key) = sort keys %$ref;
  $key ? ( $key, tail( $ref->{$key} ) ) : ();
  }

sub combine
  {
  my ($ref, @lines) = @_;
  my @keys = sort keys %$ref;
  if( @keys > 1 and @lines >= 3 )
    {
    my $group = join ',', @keys;
    push @output, [ @lines, $group, tail $ref->{$keys[0]} ];
    }
  else
    {
    combine( $ref->{$_}, @lines, $_ ) for @keys;
    @keys or push @output, \@lines;
    }
  }

[download]

which outputs: 

"File Server","Access Path","Current Permissions","Logon Name","Inheri
+ted From Folders",Flags,User/Group,"Classification Results","Classifi
+cation Results by Category (Including Nested)","Total Hit Count"
10.15.106.71,"/Common/Awareness and Training/KnowBe4/2020- KnowBe4 Sub
+scription Renewal Docs/Axidome Quote My Corp 2020211 KnowBe4 2-yr Ren
+ewal FINAL.pdf",FMRWX,"@FOO NOW Onsite Support,Administrators,Cluster
+SvcDIR,Creator Owner,FP NOW BMG FSE NTFS Admins,MiJim,SYSTEM",\Common
+,"This folder only","Pathway12.My.Corp.com\@FOO NOW Onsite Support","
+IRS Data (1/1)","PII (1)",1
10.15.106.71,"/Common/Awareness and Training/KnowBe4/2020- KnowBe4 Sub
+scription Renewal Docs/Axidome Quote My Corp 2020211 KnowBe4 2-yr Ren
+ewal FINAL.pdf",MRWX,"@FP DIR BMG",\Common,"This folder only","Pathwa
+y12.My.Corp.com\@FP DIR BMG","IRS Data (1/1)","PII (1)",1
10.15.106.71,"/Common/Awareness and Training/KnowBe4/2020- KnowBe4 Sub
+scription Renewal Docs/Axidome Quote My Corp 2020211 KnowBe4 2-yr Ren
+ewal FINAL.pdf",RX,"&CDAdmin,@FOO DSMS Admins,DPeterso,FOO BMG FS Sup
+port,FP BMG IMG Read Access",\Common,"This folder only",Pathway12.My.
+Corp.com\&CDAdmin,"IRS Data (1/1)","PII (1)",1
10.15.106.71,"/Common/Awareness and Training/KnowBe4/2020- KnowBe4 Sub
+scription Renewal Docs/My-B8245.pdf",FMRWX,"@FOO NOW Onsite Support,A
+dministrators,Creator Owner",\Common,"This folder only","Pathway12.My
+.Corp.com\@FOO NOW Onsite Support","IRS Data (1/1)","PII (1)",1

[download]

This looks like it correctly quotes unchanged fields that contain commas. If it doesn't for you, please post the failed lines and the code you ran to get the failed lines.

Replies are listed 'Best First'.
Re^4: Building a dynamic array or some other method?
by The_Dj (Scribe) on May 09, 2024 at 02:19 UTC
    Hi.

    I was aiming to replicate the output as provided by OP, which you'll note also doesn't have "proper" use of quoted strings.

    I should have highlighted that issue.
    My bad

[reply]
      No worries. Thank you! I took some time and studied your code, and understood it!
[reply]
Re^4: Building a dynamic array or some other method?
by CAdood (Acolyte) on May 10, 2024 at 23:54 UTC
    Okay.. I'm REALLY struggling to understand what's going on here - few others used similar syntax. I've tried running it through a debugger and I think that because there's SOOO much going on in individual lines, I'm missing a lot.

    my $ref = \%database;
  $ref = $ref->{$_} //= {} for @$fields;

    [download]
    is puzzling. I tried to find info on //= and found only a clumping of similar nomenclature vaguely saying it transfers info into arrays. But couldn't look at intermediate values from what I think is a for loop built into the end of the end of the 2nd line. The $_ is familiar vaguely as a reference to a value within a for loop (for instance), but the $ref->{$_} part, along with the //= {} (empty set?) is throwing me as to what's happening here.

    (try searching for "//=" and you get back a lot of nothing!! Yeesh... I was (somewhat) happy to have finally found the vague reference. It just didn't help me much. LOL

    I'm admittedly struggling with references and dereferences, and how it's being used or addressed.

    So looking at how %database gets filled isn't intuitively obvious for me. , nor the entire effort within combine and tail.

    I'll study this some more. Have had to deal with my mother-in-law's recent stroke and husband ( both 90), and competing priorities in the job. It's hard to keep focused and dive slowly through this.

    I did want to say thank you tybalt89!
[reply]
[d/l]
      I tried to find info on //= and found only a clumping of similar nomenclature vaguely saying it transfers info into arrays.

      //= combines the // (defined-or) operator and the = (assignment) operatior into one, exactly like ||= (or + assign), += (add + assign), -= (subtract + assign), and many others.

      The // (defined-or) operator is relatively new, it was introduced in 5.10.0 and you can find a short intro in perl5100delta:

      Defined-or operator

      A new operator // (defined-or) has been implemented. The following expression:

      $a // $b

      [download]

      is merely equivalent to

      defined $a ? $a : $b

      [download]

      and the statement

      $c //= $d;

      [download]

      can now be used instead of

      $c = $d unless defined $c;

      [download]

      The // operator has the same precedence and associativity as ||. Special care has been taken to ensure that this operator Do What You Mean while not breaking old code, but some edge cases involving the empty regular expression may now parse differently. See perlop for details.

        my $ref = \%database;
  $ref = $ref->{$_} //= {} for @$fields;

      [download]

      is puzzling.

      Yes, it is. Partly because it is optimized for minimal keystrokes, not for readability. A typical beginner's mistake.

      But it does not take much to decode. You should now know //=. $ref is initially a reference to the hash %database. (If you know C, a reference can be thought of as a pointer.) $ref->{$_} //= {} assigns a new, empty hash ({}) to $ref->{$_} unless $ref->{$_} exists and is not undef. Then, $ref is assigned whatever is stored in $ref->{$_}. And finally, the entire $ref = $ref->{$_} //= {} is executed for all elements of the $fields array reference, setting $_ to each array element. (Technically, $_ is aliased, but it does not matter here.)

      The same code, but much more verbose, looks like this:

          my $ref = \%database;
    foreach my $field (@$fields) {
        unless (defined $ref->{$field}) {
            $ref->{$field} = {};
        }
        $ref = $ref->{$field};
    }

      [download]

      (Seven lines instead of just two. What a waste of disk space and screen estate! And all the wear on the keyboard for those unnecessary characters! A single line would have been sufficient, no whitespace needed at all: my$r=\%d;$r=$r->{$_}//={}for@$f; - SCNR)

      Alexander

      --
      Today I will gladly share my knowledge and experience, for there are no sweeter words than "I told you so". ;-)
[reply]
[d/l]
[select]
        Alexander, THANK YOU for the pointer to the //= info, and also explaining it.

        I very much appreciate your explaining the one line of code, and breaking it out to 7 lines where I can see what's happening more fully. I'll step through it with a debugger so I can make sure I understand how this is working. (references, mostly, but it's used recursively elsewhere, and because the original code is compact and seems to work magically.)

        Your 1-line condensation (without spaces!) didn't go unnoticed. LOL

        And you had an OUTSTANDING sig there on the end of your post. (I'm gonna borrow that, if you don't mind.)

        Right up there with the coffee mug my wife gave me that says, "Of course I talk to myself. Where else am I going to get expert advice?" (I think she's riffing on my talking to myself, because she sure doesn't take any of my advice.)

        Again, THANK YOU, Alexander!
[reply]

In Section Seekers of Perl Wisdom