Deleting the .pm and the binary components if there are any should do the trick. I don't know if there's an automatic way of doing that because it's just not something that needs to be done.

I wonder why you'd want to do that. I can think of a couple of specific cases where you'd want to do what, but I'm curious as to what yours is.