I can even get that error when I send 1 email after 10 mins of sending nothing
Can you get the same error when you send email using a "normal" email client ?
If so, then you have good grounds for asking your ISP to take action to eliminate this problem.
If not, then you still face the possibility that this problem is specific to your use of MIME::Lite.