I don't have a great answer to this, in the sense of fixing my original problem.

However I can say that the most recent Strawberry Perl comes with a readymade DBD::Oracle and it worked without a problem. So I have a solution to the general case "can I get Perl working with Oracle on Windows?" at least.