IMAP EXPUNGE actually expunges \Deleted messages from the mailbox which is currently selected. Try to call ->expunge_mailbox() without arguments.

This could be an omission in Net::IMAP::Simple interface or something. There's no way to expunge non-selected mailbox in the IMAP protocol.