mechanicalsoup is not redirecting to where it should redirect to

问题

I am trying to make a webscraping bot that logs into https://adelbert.magister.net/ so that I can scrap data in the website after logging in.

My code:

import mechanicalsoup
browser = mechanicalsoup.StatefulBrowser(
    soup_config={'features': 'lxml'},
    raise_on_404=True,
    user_agent='bot',
)

browser.open("https://adelbert.magister.net/")
print(browser.get_url())

If you visit the page in your normal browser it redirects to a URL that looks like this: https://accounts.magister.net/account/login?sessionId=6aa0c7f9387a4b4b8acea413446d918c&returnUrl=%2Fconnect%2Fauthorize%2Fcallback%3Fclient_id%3DM6-adelbert.magister.net%26redirect_uri%3Dhttps%253A%252F%252Fadelbert.magister.net%252Foidc%252Fredirect_callback.html%26response_type%3Did_token%2520token%26scope%3Dopenid%2520profile%2520magister.ecs.legacy%2520magister.mdv.broker.read%2520magister.dnn.roles.read%26state%3D505f79f6dc244b8ba45daaa215709ac0%26nonce%3D49d332e1fb2e499fb2a17bcd37d756a4%26acr_values%3Dtenant%253Aadelbert.magister.net#!/gebruikersnaam

How can I get it on the good page so that I can make the program login with mechanicalsoup?

This is the same question as posted Here but no one has answered that post. Please help me.

回答1:

The redirect is done using JavaScript. MechanicalSoup won't help with JavaScript (see MechanicalSoup's FAQ).

来源：https://stackoverflow.com/questions/50703203/mechanicalsoup-is-not-redirecting-to-where-it-should-redirect-to