As far as I know, currently there is no plugin available to browse SQLite database directly from the Android Studio.
You can extract your database file from "File Explorer".
You can find "File Explorer" from here.
Tools > Android > Android Device Monitor
