The ssh logs from your server should be very helpful in determining why permission is denied.

Also, Try using SFTP client module Net::SFTP::Foreign and check.