I see no reason why your Perl 5 technique would not work with Perl 6 or Parrot. If anything, it ought to be easier if even the XS equivalent files are cross-platform bytecode (and it appears that they may be).

As long as Parrot can read the libraries it needs, and as long as you have the proper libparrot for your architecture, everything should work correctly.