How to see preview of .mdx file as markdown in VSCode

Question

Is there a way I can force VSCode to preview *.mdx files as markdown just like it does for *.md files? For reference see how Github shows