bundle exec gem uninstall - uninstalls gem from the bundle (the /vendor/bundle/ruby/2.3.0/gems/ path). This is equivalent to the answer @ioquatix gave, but is the slightly more convenient solution that he was looking for.
gem uninstall - uninstalls gem only from the global gemset in the system