you have to add your public key, usually ~/.ssh/id_rsa.pub, to ~/.ssh/authorized_keys on the remote machine.

Googling, I have found this page that explains all the required steps in detail.

If you are using the commercial version of ssh, the process is different but it is explained on the FAQ