It really depends on what you're building... there's certainly nothing stopping you from dissecting a module, copying the relevant sections, and putting them in your own programs. (This providing both benefits -- a high-quality implementation, tested by hundreds of other smart Perl hackers, and portability).
Don't stay away from the core modules, though! They're in the core for good reason!