Python: Element is not clickable selenium

You need to close this banner first -

Since selenium opens a fresh browser instance so the website will ask you to store cookies every time you run the script. It is this exact banner which is coming in the way of selenium clicking your "next" button. Use this code to delete that close button -

driver.find_element_by_xpath("//a[@class='grid--cell fc-white js-notice-close']").click()

Also, driver.find_element_by_link_text('next') will throw a StaleElementReferenceException. Use this locator instead -

driver.find_element_by_xpath("//span[contains(text(),'next')]").click()

Final code -

driver.get("https://stackoverflow.com/users/37181/alex-gaynor?tab=tags")

driver.find_element_by_xpath("//a[@class='grid--cell fc-white js-notice-close']").click()


while True:
  try:
      time.sleep(3)
      driver.find_element_by_xpath("//span[contains(text(),'next')]").click()

    except NoSuchElementException:
        break

As per your question to click through the next page until the it reaches to the last page, you can use the following solution:

• Code Block:

  from selenium import webdriver
  from selenium.webdriver.common.by import By
  from selenium.webdriver.support.ui import WebDriverWait
  from selenium.webdriver.support import expected_conditions as EC
  from selenium.common.exceptions import TimeoutException
  from selenium.common.exceptions import NoSuchElementException
  from selenium.common.exceptions import StaleElementReferenceException
  
  options = webdriver.ChromeOptions() 
  options.add_argument("start-maximized")
  options.add_argument('disable-infobars')
  driver=webdriver.Chrome(chrome_options=options, executable_path=r'C:\Utility\BrowserDrivers\chromedriver.exe')
  driver.get("https://stackoverflow.com/users/37181/alex-gaynor?tab=tags")
  WebDriverWait(driver, 20).until(EC.element_to_be_clickable((By.XPATH, "//a[@class='grid--cell fc-white js-notice-close' and @aria-label='notice-dismiss']"))).click()
  while True:
      try:
      driver.execute_script(("window.scrollTo(0, document.body.scrollHeight)"))
      WebDriverWait(driver, 20).until(EC.element_to_be_clickable((By.XPATH, "//div[@class='pager fr']//a[last()]/span[@class='page-numbers next']")))
      driver.find_element_by_xpath("//div[@class='pager fr']//a[last()]/span[@class='page-numbers next']").click()
      except (TimeoutException, NoSuchElementException, StaleElementReferenceException) :
      print("Last page reached")
      break
  driver.quit()
  

• Console Output:

  Last page reached
  

There are couple of things that need to be taken care of:

1. It seems the element is hidden by the cookies banner. By scrolling the page the element can be made available.
2. When you click on the next - the page is reloaded. So you need to handle the StaleElementException.

Adding both these the code looks as follows:

from selenium import webdriver
from selenium.common.exceptions import NoSuchElementException
from selenium.common.exceptions import StaleElementReferenceException

driver = webdriver.Chrome()
driver.get("https://stackoverflow.com/users/37181/alex-gaynor?tab=tags")
driver.execute_script(("window.scrollTo(0, document.body.scrollHeight)"))

while True:
    try:
        webdriver.ActionChains(driver).move_to_element(driver.find_element_by_link_text('next')).click().perform()
    except NoSuchElementException:
        break
    except StaleElementReferenceException:
        pass

print "Reached the last page"
driver.quit()

I met the same error and the solution is not to scroll the window to the object(Maybe it can fix some errors but not in my case). My solution is using javascript, the code as follows:

click_goal = web.find_element_by_xpath('//*[@id="s_position_list"]/ul/li[1]/div[1]/div[1]/div[1]/a/h3')
web.execute_script("arguments[0].click();", click_goal)

problem:After login the page i cant able to click any element.when i try to click on the element it shows the error shild crossed.

My solution is using javascript,the code as follows: element = self.driver.find_element_by_xpath("/html/body/section[1]/div/ul/li[2]/ul/li/a self.driver.execute_script("arguments[0].click();",element)