That gives an off-by-one  $tokens value (it's actually counting the stuff "around" the tokens (update: and it requires creation of an otherwise unused array to hold most of that stuff)), but that's easy to fix: 

c:\@Work\Perl\monks>perl -wMstrict -MData::Dump -le
"my $t = 'x';
 ;;
 for my $line (qw(
   1212123x534534534534xx4545454x232322xx
   0901001x876879878787xx0909918x212245xx
   1212123x534534534534xx4545454x232323xx
   1212133x534534534534xx4549454x232322xx
   4352342xx23232xxx345545x45454x23232xxx
   )) {
   my $tokens = my ($first, @rest) = split $t, $line, -1;
   $tokens -= 1;
   print qq{'$line':  num '$t' tokens is: $tokens};
   dd ($first, \@rest);
   }
"
'1212123x534534534534xx4545454x232322xx':  num 'x' tokens is: 6
(1212123, [534534534534, "", 4545454, 232322, "", ""])

'0901001x876879878787xx0909918x212245xx':  num 'x' tokens is: 6
("0901001", [876879878787, "", "0909918", 212245, "", ""])

'1212123x534534534534xx4545454x232323xx':  num 'x' tokens is: 6
(1212123, [534534534534, "", 4545454, 232323, "", ""])

'1212133x534534534534xx4549454x232322xx':  num 'x' tokens is: 6
(1212133, [534534534534, "", 4549454, 232322, "", ""])

'4352342xx23232xxx345545x45454x23232xxx':  num 'x' tokens is: 10
(
  4352342,
  ["", 23232, "", "", 345545, 45454, 23232, "", "", ""],
)

[download]
(But I don't really see anything wrong with using good old  tr/// for counting and poor old substr for fixed-field extraction.)

Update: This gets rid of  @rest and the  $tokens -= 1; statement for all you one-liner addicts out there:
    my $tokens = (my ($first) = split $t, $line, -1) - 1;

Give a man a fish:  <%-{-{-{-<

In reply to Re^2: Perl - Remove duplicate based on substring and check on delimiters by AnomalousMonk
in thread Perl - Remove duplicate based on substring and check on delimiters by bopibopi

Title:
Use:  <p> text here (a paragraph) </p>
and:  <code> code here </code>
to format your post, it's "PerlMonks-approved HTML":


  • Posts are HTML formatted. Put <p> </p> tags around your paragraphs. Put <code> </code> tags around your code and data!
  • Titles consisting of a single word are discouraged, and in most cases are disallowed outright.
  • Read Where should I post X? if you're not absolutely sure you're posting in the right place.
  • Please read these before you post! —
  • Posts may use any of the Perl Monks Approved HTML tags:
    a, abbr, b, big, blockquote, br, caption, center, col, colgroup, dd, del, details, div, dl, dt, em, font, h1, h2, h3, h4, h5, h6, hr, i, ins, li, ol, p, pre, readmore, small, span, spoiler, strike, strong, sub, summary, sup, table, tbody, td, tfoot, th, thead, tr, tt, u, ul, wbr
  • You may need to use entities for some characters, as follows. (Exception: Within code tags, you can put the characters literally.)
            For:     Use:
    & &amp;
    < &lt;
    > &gt;
    [ &#91;
    ] &#93;
  • Link using PerlMonks shortcuts! What shortcuts can I use for linking?
  • See Writeup Formatting Tips and other pages linked from there for more info.