For ActiveState perl, there is also registry data. So, if you resort to deleting the c:\perl tree, you should also clean any references to ActiveState from the registry.
If you cannot get DBD-Oracle to work, you could also use DBD-ODBC. Does that meet your needs?
Comment on Re: Oracle 9I DBI on windows install question