when to choose between the glory that is Perl, the grandeur that is C?

You can, of course, have both "the glory that is Perl" *and* "the grandeur that is C" by making use of Inline::C/XS.

For matrix operations, you might want to make use of PDL - though it's a hefty and not always troublefree beast to install.

Cheers,
Rob