Your or die "$!" clause on your call to new is a waste of time as the module returns an object regardless of whether the attempt to connect was successful or not.

You need to call $pop3->Message to find out if any errors occured.

-1 is the initial value of Count. If the connection failed to occur, it would still have that value.