Are you expecting the $_ variable to magically know that it should be "whatever", or is it actually set to something? Or do you mean something like this:

s#href="([^":/]*?)"#href="http://domain/$1"#g
[download]

Or as others have suggested (in the Chatterbox), use HTML::TokeParser