I mean perl itself won't stop running or anything, just that module will vanish?

Yes. Perl code which tries to load a vanished module will fail with the usual

Can't locate Vanished/Module.pm in @INC (@INC contains: ... )
BEGIN failed--compilation aborted.
[download]

which means that perl is working fine :)