PDL was already mentioned, but I don't know of any better starting point for this linear-algebra type problem than PDL::LinearAlgebra, probably one of the msolve* routines. If anyone does know of such, I'd love to know of it!