Hello, this is OP

Actually I just solved my problem. This may have been obvious to any who might have read this but the issue was with the pub key itself. It was generated from puttygen. So I created a new pub key from my private key using ssh-keygen and now it works fine. Sorry to waste anyone's time!!