I'm not too sure I have a very clear view of what the skillset of the "average programmer" looks like. I'm fairly sure if you took the average skill level of everyone who work with Perl, it would be pretty low because of all the poor CGI programming out there. (I'm also sure it'd be worse without the Monastery, where everyone tries to improve their skills.)

I imagine the spirit of your post could be phrased in something like "What little corner of Perl have you worked hard to master that other Perl programmers might have overlooked?"

So, in the spirit of that question, my work in Corpus Linguistics has forced me to be a fair hand at dealing with data munging. We constantly need to get data from some raw form into something that we can run through a natural language tokenizer, then through a tagger, then do some post-tagging cleanup (parsing), and then export our data to a MySQL database.

I recently rewrote our tokenizer using Parse::RecDescent. The net result is that the tokenization is slower, but it the accuracy and recall are much higher. A lot of that improvement had to do with re-thinking/re-factoring the algorithms I was using to do this.

Another thing that is really necessary and is often overlooked (or neglected) by Perl programmers--especially in the US--is dealing with various encodings that are not ISO-8859-1. It saves us work in the long run if our scripts handle ISO-5559-15 and UTF-8 just as well. So perllocale is one thing I've really had to master.

--
Allolex

In reply to Re: Easy Things by allolex
in thread Easy Things by Anonymous Monk

Title:
Use:  <p> text here (a paragraph) </p>
and:  <code> code here </code>
to format your post, it's "PerlMonks-approved HTML":


  • Posts are HTML formatted. Put <p> </p> tags around your paragraphs. Put <code> </code> tags around your code and data!
  • Titles consisting of a single word are discouraged, and in most cases are disallowed outright.
  • Read Where should I post X? if you're not absolutely sure you're posting in the right place.
  • Please read these before you post! —
  • Posts may use any of the Perl Monks Approved HTML tags:
    a, abbr, b, big, blockquote, br, caption, center, col, colgroup, dd, del, details, div, dl, dt, em, font, h1, h2, h3, h4, h5, h6, hr, i, ins, li, ol, p, pre, readmore, small, span, spoiler, strike, strong, sub, summary, sup, table, tbody, td, tfoot, th, thead, tr, tt, u, ul, wbr
  • You may need to use entities for some characters, as follows. (Exception: Within code tags, you can put the characters literally.)
            For:     Use:
    & &amp;
    < &lt;
    > &gt;
    [ &#91;
    ] &#93;
  • Link using PerlMonks shortcuts! What shortcuts can I use for linking?
  • See Writeup Formatting Tips and other pages linked from there for more info.