I found an interesting solution which might help. I did this in my onBackPressed() method.
finishAffinity();
finish();
FinishAffinity removes the connection of the existing activity to its stack. And then finish helps you exit that activity. Which will eventually exit the application.