If you just need a quote character all by itself, you can make one using the chr function: Use the ASCII code for the double quote character ("). With chr:

print chr(34);

my $quot = chr(34);
print "This is ${quot}not$quot a quote.\n";
[download]

Use the octal or hexadecimal escape code:

print "\042";
print "\x22";
[download]