Are you setting these environment variables?

ORACLE_HOME=/usr/somewhere/oracle10g
LD_LIBRARY_PATH=$ORACLE_HOME/lib
[download]

You could also try installing without perl -MCPAN -e shell by downloading the tar ball from CPAN untaring it and installing with ...

# perl Makefile.PL
# make
# make test
# make install
[download]