I have Oracle working with the same version of Perl you're using.
I have a gut feeling that your ORA_HOME environment variable is not pointing to the right direction. Do you have an Oracle client installed? When you type SET in cmd, what is ORA_HOME set to?