I'd go with Postfix (non-Perl). Postfix (and most other decent SMTP servers I'm sure) can be easily configured to pipe incoming messages to a script. That can be your Perl.