I'm not sure about how this may affect the rest of your code, but using Net::Telnet will make your life ever so much easier if all you are doing is connecting to telnet.
I wrote a review that may be of interest to you, it is over here.
"Nothing is sure but death and taxes" I say combine the two and its death to all taxes!