OP is short for either "Original Post" or "Original Poster" depending on context (e.g. "In the OP..." vs. "The OP said...").

The Chaterbox nodelet is also used to indicate if you have new messages. You can enable it and place it via your Nodelet Settings. You can also manually check your Message Inbox, which includes reply notifications.