Only to a level. With reasonable knowledge of socket programming and SMTP protocol, it is very easy to write a TCP socket server listening port 25 with limited SMTP functionality to work with your validation process.

If that's the case why should you worry?