EDIT: Putting exactly what was done
I need to SSH localhost without password, the usual way of doing it (with public keys) do not work.
user@PC:~$ rm
as the accepted answer do, if you encount a problem of
Agent admitted failure to sign using the key.
you need to
ssh-add