I just started to work on Git. I use windows 7 and has installed msysgit(1.7.8) and Tortoisegit(1.7.6). The repository is created on Linux server which is accessible thru LA
Pramodtech's answer stopped working for me with the current version of the official Windows Git client. It stores the ssh executable in Git\usr\bin instead of Git\bin now (since version 2.5 released in Aug 2015).
So go to TortoiseGit > Settings > Network and change the SSH client path to:
C:\Program Files\Git\usr\bin\ssh.exe (or whatever the path to your Git installation is)