This isn't perl, but a very long time ago I used the mailutils part of the UW imap suite to great success, and it does support TLS/SSL.

It's a collection of C utilities that would be easy to script, or you could borrow their code to make an XS api: http://www.washington.edu/imap/