React router not working for direct url's from browser omnibox

Question

I want to serve a react app locally for testing purpose. If I serve the the build from my own server.js then the react router does not serve all the routes in my application