Is it possible to modify the stringification of $! (obviously without touching at the perl intrpreter code) to include user-defined messages?

Not in pure Perl. It's probably possible in XS.

Obviouly I'd like to have these custom messages localized accordigly to the locale setted by the user.

Do you have to use $! for that? You can freely assign to $@.

Abigail