Really silly problem here.
In Visual Studio 2010, the text cursor has changed from the blinking line, to a blinking grey box around the characters. When I type over
Ran into this issue with Parallels and VS 2013. Command + Insert also fixed it in my setup, in addition to the accepted answer. On my Windows USB keyboard Command == WindowsKey.