One more way to do it:

package my::foo;
BEGIN { $INC{'my/foo.pm'} ||= 'dev/null'; }
require exporter; # etc.
package main;
use my::foo;
[download]

The addition to %INC tells use/require that the package is already in memory, so it won't try to load it again.