I can not see an option to disable that in the new Developers design!
Our app went to the sandbox mode automatically after a while. We had to fill the 'privacy policy' url, after that we could disable sandbox mode again.
So make sure you have everything filled in correctly.