in reply to Loading modules remotely
Also see lazy (and its references) for an example implementation.
These will not do ssh transport and do expect modules to conform to the CPAN standard, but maybe that isn't all bad.