This SO post explains very well how to install command line tools for Xcode 4.4.
But how to uninstall them?
This should still work to remove xcode.
sudo /Developer/Library/uninstall-devtools –mode=all