What are you using the ssh agent for? If you are trying to push out some kind of configuration or process you might be better of with SSLeay. Using SSL you could create the pem's at the server that the remote clients would be allowed to connect with and then preform the function on the backend that needed to be done in an encrypted fashion.

If that dosen't work ... then my question would be what is the purpose of your application and what is it using ssh for?

Dave -- Saving the world one node at a time