I would separate the main method from the code.
Although I also have a different type of project. It includes not a real working program for a solution. Here I need to run different solutions for different problems using (and developing) the same library. Different problems are not parallel. I need to run one single problem alone from my IDE. I found it convenient to use the same project with a huge number of classes with PSVM methods.
This project contains programming contests solutions for over 400 of different problems. Do you have a better organizing for this?