Requests won't get the text from web page?

Question

I am trying to get the value of VIX from a webpage.

The code I am using:

raw_page = requests.get(\"https://www.nseindia.com/live_market/dynaContent/live         


        

Answer 1

When you open the page in a web browser, the text (e.g., 15.785) is inserted into the span element by the getIndiaVixData.js script.

When you get the page using requests in Python, only the HTML code is retrieved and no JavaScript processing is done. So, the span element stays empty.

It is impossible to get that data by solely parsing the HTML code of the page using requests.