I have tried a number of ways, from xpath to link text to get Selenium to locate the \"Next Page\" button, and then click until the last page, but just couldn\'t get this to wor
As you can see in the next picture, there are two elements in the page that are identical to the xpath
syntax you defined.
In order to get to the second value, you need to define the xpath
from the parent div
and nav
import requests, bs4, time, selenium #import libraries
from selenium import webdriver
from selenium.webdriver.support.select import Select
driver=webdriver.Chrome()
driver.get('https://egov2.manchesternh.gov/Click2GovTX/accountsearch.html')
select=Select(driver.find_element_by_id('searchMethod'))
select.select_by_value('2')
streetName=driver.find_element_by_id('addressName')
time.sleep(1)
streetName.clear()
streetName.send_keys("A")
streetName.send_keys(u'\ue007')
nxt=driver.find_element_by_xpath('//div[@class="panel-body"]/nav[2]//li[@class="next"]/a')
nxt.click()
time.sleep(1)