Not necessarily. If you maintain a version number for the dist which applies also to all the modules then you can pick one master module which all the others use and have them set their versions from that one. eg.

package Foo;
our $VERSION = '1.01';

# ...

package Foo::Bar;
use Foo;
our $VERSION = $Foo::VERSION;
[download]

I never bother specifying version numbers in POD so you're on your own there. :-) Doubtless there's a way in Dist::Zilla but then you'd have $problems++