This would be a very good solution indeed if my module was object oriented...
I found some stuff about why what I wanted to do isn't possible on : Name Collision of Modules and libs
A very interesting reading for us mod_perl users.
Now I think i will use a method based on the previous link: Config Files, using a hash with a key for each vHost.