It depends on where the boundaries between machines and JVMs are, and how they communicate. If it's through message passing (and not RPC calls or serialized objects), Parrot should be able to do the same, keeping in mind that communication latency is almost always a bottleneck.