In the FC3 distribution, perl, perldoc, and the man pages are all part of the same rpm, so you are likely to have them all or nothing.
Can you give a conrete example of running perldoc, showing what you're looking up and the error message you get in return?