In the end, you want something that's going to make you the most productive. Whether that's Notepad or Vim or Sublime or something else is up to the user and the tasks required at the time.
With that said, an IDE does bring some solid benefits for development. Depending on the language and IDE, this may include integrated build tools, source control management, unit testing tools, automatic boilerplate generation, and class/variable refactoring.