As mentioned in this unanswered question: WebView throws Receiver not registered: android.widget.ZoomButtonsController
By turning the WebView zoom controls on and of
webView.getSettings().setBuiltInZoomControls(true); did not work for me.
dkneller's suggestion did work, however:
long timeout = ViewConfiguration.getZoomControlsTimeout(); new Timer().schedule(new TimerTask() { @Override public void run() { webview.destroy(); } }, timeout);