It depends what you actually want to achieve -

• Set the bit: $value |= 0x02;
• Toggle the bit: $value ^= 02;
• Increment the bit: $value += 0b00000010;

Note that the constants are given as hex, octal and binary for the successive samples.

For completeness it should be noted that $value &= ~2 resets the bit.