To the best of my knowledge, there isn't yet any PDL MPI interface. The closest to working is PDL::SVDSLEPc, but that has (per moocow) never been used in production. However, there are plans afoot (see https://github.com/PDLPorters/pdl/issues/349) to use Alien::OpenMP to get OpenMP support going in PDL.

Once that is in place, it will make sense to start thinking about use of MPI. A hint of what's required is that GPUs require passing data to and from them, and marshalling execution, which resembles MPI somewhat.