If you do have the libraries installed, try the following:

(For gnu libc based systems - as root:)

ldconfig
[download]

or

Force a re-build and re-install:

cpan> force install DBD::Oracle
[download]

(If your problem is elsewhere, forcing it to rebuild may cause more problems.)