It's been 1.5 years now that I'm using SVN for various projects. Setups I've used so far:
- AnkhSVN client for Visual Studio. It integrates nicely as Source Control provider since version 2.
- Servers either CollabNet Subversion on windows or Apache 2.2 with SSL + SVN through DAV on linux.
Haven't had any problems with any of these setups and I definetly recommend using SVN as it's free and easy to start using. Also many project management / bug tracking packages integrate with SVN (like trac for instance).