I installed TortoiseGIT using TortoisePink as my SSH client. But I later found out that that was not the correct one to use for my purposes. So, I uninstalled TortoiseGIT an
I was able to circumvent this problem by going to the TortoiseGIT settings page. Under "network" I noticed that the "TortoisePink.exe" file was still selected. So, I just changed this to "ssh.exe" without a path and viola! My issue is fixed.