is your 'string' a valid variable?, because it is not preceded by a sigil, to account for deleting more than one double quote you can
"$string =~ s/"+//;"
see
quantifiers and matching repitions
UPDATE: The g modifier is more robust so toolic's solution is better.
Excellence is an Endeavor of Persistence.
Chance Favors a Prepared Mind.