Selenium is not loading TikTok pages

问题

I'm implementing a TikTok crawler using selenium and scrapy

start_urls = ['https://www.tiktok.com/trending']
....
def parse(self, response):
    options = webdriver.ChromeOptions()
    from fake_useragent import UserAgent
    ua = UserAgent()
    user_agent = ua.random
    options.add_argument(f'user-agent={user_agent}')
    options.add_argument('window-size=800x841')
    driver = webdriver.Chrome(chrome_options=options)
    driver.get(response.url)

The crawler open Chrome but it does not load videos. Image loading

The same problem happens also using Firefox No loading page using Firefox

The same problem using a simple script using Selenium

from selenium import webdriver
import time


driver = webdriver.Firefox()
driver.get("https://www.tiktok.com/trending")
time.sleep(10)
driver.close()

driver = webdriver.Chrome()
driver.get("https://www.tiktok.com/trending")
time.sleep(10)
driver.close()

回答1:

You can use Windows IE. Instead of chrome or firefox

Videos will load in IE but IE's Layout of showing feed is somehow different from chrome and firefox.

Reasons, why your page, is not loading.

Few advance web apps check your browser history, profile data and cached to check the authentication of the user. One other thing you can do is run your default profile within your selenium It would be helpfull.

来源：https://stackoverflow.com/questions/59277001/selenium-is-not-loading-tiktok-pages