Assessing competency of IT staff sounds like something every conscientious company might do; however, as far as the means of accomplishing this go, I doubt TeckCheck is anywhere close to the mark. After all, they even used invalid code in some of their own questions!

I glanced over their site and even took their sample assessment test. What surprised me is that the sample test contained questions loosely related to the IT field. For example, one question was on geography, while another touched on general history. In fact, none of the questions I was presented with were anywhere close to IT. I found this rather odd for a company claiming to be in the business they are in. Thereofre, I’m afraid that not having done an actual IT skill testing questionnaire myself, I'll have to base my critique squarely on your summary.

Concerning test scope, I believe that it takes completely different set of questions in order to objectively measure IT skills of a systems administrator as compared to a programmer analyst. Former would have to be tested on a shallow knowledge of Perl or any other systems scripting language. A programmer analyst, on the other hand, would be expected to have a more thorough knowledge of Perl, software design, etc.

Relating this back to the Perl/CGI test you took, scoring criteria might vary based on your position within the company. Therefore, questions on the proper use of the 'format' method may carry different weight for different kind of employee? Also, even amongst a group of adapt Perl programmers, you may expect varying level of expertise in any specific area. As you have rightly mentioned, having more than one legitimate way of accomplishing a task in Perl, it may be hard to come up with a yard stick that would provide an objective measure of an individual’s skill. If I was tasked to come up with a test, I’d lean towards questions of general nature that would encompass common Perl features and avoid those rarely used (such as the ‘format’ method :). I think that questions testing common problem solving skills would be more appropriate than those which concentrate on specific, and often obscure, areas of Perl.

_____________________ 
# Under Construction

[download]

In reply to Re: TeckChek and other online assessments by vladb
in thread TeckChek and other online assessments by Anonymous Monk

Title:
Use:  <p> text here (a paragraph) </p>
and:  <code> code here </code>
to format your post, it's "PerlMonks-approved HTML":


  • Posts are HTML formatted. Put <p> </p> tags around your paragraphs. Put <code> </code> tags around your code and data!
  • Titles consisting of a single word are discouraged, and in most cases are disallowed outright.
  • Read Where should I post X? if you're not absolutely sure you're posting in the right place.
  • Please read these before you post! —
  • Posts may use any of the Perl Monks Approved HTML tags:
    a, abbr, b, big, blockquote, br, caption, center, col, colgroup, dd, del, details, div, dl, dt, em, font, h1, h2, h3, h4, h5, h6, hr, i, ins, li, ol, p, pre, readmore, small, span, spoiler, strike, strong, sub, summary, sup, table, tbody, td, tfoot, th, thead, tr, tt, u, ul, wbr
  • You may need to use entities for some characters, as follows. (Exception: Within code tags, you can put the characters literally.)
            For:     Use:
    & &amp;
    < &lt;
    > &gt;
    [ &#91;
    ] &#93;
  • Link using PerlMonks shortcuts! What shortcuts can I use for linking?
  • See Writeup Formatting Tips and other pages linked from there for more info.