I'm able to message other users (and receive messages) just fine. How does chanserv reply? It doesn't send a private message, and doesn't just message the channel? What handler should I use to listen to its replies?
Well, after checking what ChanServ was saying by adding an on_notice handler, I realized that my bot didn't have an access level of 10. Now I feel like an idiot. Oh well, It is working now.