I\'ve been having this problem for a while now. I created a brand new winforms c# application in Visual Studio. I can usually launch it in debug mode once without a problem.
First check to see if you can delete the EXE. If you can't that means some process has a handle on it.
Run Process Explorer and do a search for TestApplication.exe to find what it is