Much of our C# release code is built with the \'Optimize code\' option turned off. I believe this is to allow code built in Release mode to be debugged more easily.
The optimizations done by the compiler are fairly low level and shouldn't affect your users' experience.
If you'd like to quantify the optimization on your application, simply profile a non-optimized and an optimized build and compare the results.