You should try to minimze the problem.
How did you install the ssh modules?
I am working with threads on Linux on an ES4 system and Perl 5.10 wo problems.
I doubt that the problem comes from the threads. I had problems with the threading as the runtime behaviour changed when moving from a slower Solaris machine to a faster Linux Opteron.