It definitly isn't a security issue as I'm running as workstation admin, and can delete files myself, either manually or from a .BAT if I run the .EXE from a .BAT that takes care of cleaning the directory.
I've already done several .EXEs from perl scripts on that computer using various modules like Win32::GUI, Encode::* etc and the problem is really only with DBI.