The work involved shouldn't be to hard. You'd only need a user which can only connect to and from localhost defined in your SSHD, with a key, so it can passwordless connect to localhost. The general user will never notice a thing if you do it right. Right?