Re^3: Comparison of the parsing features of CSV (and xSV) modules

Replies are listed 'Best First'.
Re^4: Comparison of the parsing features of CSV (and xSV) modules by tilly (Archbishop) on Jun 18, 2004 at 02:01 UTC
There are, of course, going to be boundary cases that don't work as expected as soon as you start playing with allowing undoubled double-quotes inside of a format that expects them doubled. However Text::xSV allows you to define arbitrary filters that it preprocesses text with, and should do a reasonable job on the above with the following filter: `sub { my $line = shift; $line =~ s/\r$//; $line =~ s/"(.)/""$1/g; $line =~ s/"?,"?/,/g; return $line; }` [download] Yes, there is some fragility, but it should be at least moderately hard to trigger.	[reply] [d/l]
Re^4: Comparison of the parsing features of CSV (and xSV) modules by dragonchild (Archbishop) on Jun 15, 2004 at 23:17 UTC
And, what should the parser do with the following: `"Smith","John",12/31/1962,"Author of "How to Break Programs" and other + books,"Bugger" "Smith","John",12/31/1962,Author of "How to Break Programs" and other +books,"Bugger" "Smith","John",12/31/1962,'Author of "How to Break Programs" and other + books,"Bugger" "Smith","John",12/31/1962,'Author of "How to Break Programs" and other + books',"Bugger"` [download] ------ We are the carpenters and bricklayers of the Information Age. Then there are Damian modules.... sigh* ... that's not about being less-lazy -- that's about being on some really good drugs -- you know, there is no spoon.* - flyingmoose I shouldn't have to say this, but any code, unless otherwise stated, is untested	[reply] [d/l]
Re^5: Comparison of the parsing features of CSV (and xSV) modules by Wally Hartshorn (Hermit) on Jun 16, 2004 at 16:13 UTC
And, what should the parser do with the following: `"Smith","John",12/31/1962,"Author of "How to Break Programs" and other + books,"Bugger" "Smith","John",12/31/1962,"Author of ""How to Break Programs"" and oth +er books,"Bugger"` [download] `"Smith","John",12/31/1962,Author of "How to Break Programs" and other +books,"Bugger" "Smith","John",12/31/1962,Author of ""How to Break Programs"" and othe +r books,"Bugger"` [download] `"Smith","John",12/31/1962,'Author of "How to Break Programs" and other + books,"Bugger" (Reject?)` [download] `"Smith","John",12/31/1962,'Author of "How to Break Programs" and other + books',"Bugger" (Reject?)` [download] (I haven't encountered any improperly quoted data, just data that doesn't escape embedded delimiters.) Wally Hartshorn	[reply] [d/l] [select]
Re^6: Comparison of the parsing features of CSV (and xSV) modules by dragonchild (Archbishop) on Jun 16, 2004 at 16:37 UTC
What about the following: `abcd,"efgh,"ijkl,"mnop",qrst` [download] Is that malformed or is that meant to be `abcd,"efgh,""ijkl,""mnop",qrst` [download] The issue is that there are too many edge cases for a general-purpose parser to handle. I'm coming up with a bunch and I'm not even trying hard. ------ We are the carpenters and bricklayers of the Information Age. Then there are Damian modules.... sigh* ... that's not about being less-lazy -- that's about being on some really good drugs -- you know, there is no spoon.* - flyingmoose I shouldn't have to say this, but any code, unless otherwise stated, is untested	[reply] [d/l] [select]
Re^7: Comparison of the parsing features of CSV (and xSV) modules by Wally Hartshorn (Hermit) on Jun 16, 2004 at 19:37 UTC
Re^8: Comparison of the parsing features of CSV (and xSV) modules by dragonchild (Archbishop) on Jun 16, 2004 at 19:59 UTC