Re^5: Splitting compound (concatenated) words )

I will spend some time to understand this part print for grep defined(), $s =~ /^$re2$/;

Maybe this will help:

#! perl -slw
use strict;

my @w = do{ local @ARGV = 'words.txt'; <> };
chomp @w;

my $s = 'couldsomeonerecommendaworkingperlmoduletosplitconcatenatedwor
+ds';

my @subset = grep{ $s =~ /$_/ } 'a', 'perl', @w;

my $re1 = join '|', sort{ length( $b ) <=> length( $a ) }@subset;
my $re2 = "($re1)?" x 20;

my @found = $s =~ /^$re2$/;

print join '|', @found;

my @undefsRemoved = grep defined(), @found;

print for @undefsRemoved;
[download]

Note: I've increase the number of repetitions from 11 to 20 to allow for sentences with more words. The side effect of that is that the unmatched captures now return undef, so If I just printed out @found, I get this:

c:\test>junk
Use of uninitialized value $found[12] in join or string at C:\test\jun
+k.pl line 15, <> line 178691.
Use of uninitialized value $found[13] in join or string at C:\test\jun
+k.pl line 15, <> line 178691.
Use of uninitialized value $found[14] in join or string at C:\test\jun
+k.pl line 15, <> line 178691.
Use of uninitialized value $found[15] in join or string at C:\test\jun
+k.pl line 15, <> line 178691.
Use of uninitialized value $found[16] in join or string at C:\test\jun
+k.pl line 15, <> line 178691.
Use of uninitialized value $found[17] in join or string at C:\test\jun
+k.pl line 15, <> line 178691.
Use of uninitialized value $found[18] in join or string at C:\test\jun
+k.pl line 15, <> line 178691.
Use of uninitialized value $found[19] in join or string at C:\test\jun
+k.pl line 15, <> line 178691.
could|someone|recommend|aw|or|king|perl|module|to|split|concatenated|w
+ords||||||||
[download]

So I use grep to remove any undefined values:

my @undefsRemoved = grep defined(), @found;
[download]

Actually it needs print "$_\n" for grep defined(), $s =~ /^$re2$/; to print line-wise.

If you look at the first line of the code I posted: #! perl -slw, the l in the -slw has the affect of adding "\n" to print statements automatically. Saves me having to type them all the time.

I can send you a link to the tool, but I am not sure it's a right way to do it through the forum.

Just post the link as text, or wrap it in brackets: [ link here ] to make it an active link.

With the rise and rise of 'Social' network sites: 'Computers are making people easier to use everyday'

Examine what is said, not who speaks -- Silence betokens consent -- Love the truth but pardon error.

"Science is about questioning the status quo. Questioning authority".

In the absence of evidence, opinion is indistinguishable from prejudice.

The start of some sanity?

Comment on Re^5: Splitting compound (concatenated) words ) Select or Download Code

Replies are listed 'Best First'.
Re^6: Splitting compound (concatenated) words ) by vit (Friar) on May 17, 2012 at 14:34 UTC
I sent you a private message, please check. I understand these steps. `my $re1 = join '\|', sort{ length( $b ) <=> length( $a ) }@subset; my $re2 = "($re1)?" x 20; my @found = $s =~ /^$re2$/; print join '\|', @found; my @undefsRemoved = grep defined(), @found; print for @undefsRemoved;` [download] Except $s =~ /^$re2$/; How can it match $s from the beginning to the end? And when match occurs how a part of the string which already matched is not considered any more. I understand that you somehow do it by iterations with repeated (xxxx\|yyy\|zz)? but cannot get it.	[reply] [d/l]
Re^7: Splitting compound (concatenated) words ) by BrowserUk (Patriarch) on May 17, 2012 at 14:52 UTC
In the same way that this matches: `$s = 'fred';; print for $s =~ /^(.)?(.)?(.)?(.)?(.)?(.)?$/;; f r e d Use of uninitialized value $_ in print at (eval 10) line 1, <STDIN> li +ne 2. Use of uninitialized value $_ in print at (eval 10) line 1, <STDIN> li +ne 2.` [download] Although there are 6 capture groups, and only 4 characters, the capture groups are optional because of the trailing '?' (`(.)?`). So long as the regex has more capture groups than the string contains matches, the regex will match as many as are available, and the remaining capture groups will (optionally) "match" nothing, and so return undefs. Does that clarify things? With the rise and rise of 'Social' network sites: 'Computers are making people easier to use everyday' Examine what is said, not who speaks -- Silence betokens consent -- Love the truth but pardon error. "Science is about questioning the status quo. Questioning authority". In the absence of evidence, opinion is indistinguishable from prejudice. The start of some sanity?	[reply] [d/l] [select]