I say "$" as just "dollar", not "dollar sign". When I'm talking about punctuation variables, I name the punctuation marks, but sometimes use the English names (e.g., "input record separator" instead of "dollar slash").

Other variables, I think I just drop the sigil half the time. It's "some scalar", and "odds".

Mostly, though, I just don't talk in code. I write it—in emails, in chats, here, and in the software I'm writing.