Python Selenium TimeoutException error even with wait until clickable and except TimeoutException:

Question

My selenium webdriver been constantly crashing due to

TimeoutException: Message: timeout: Timed out receiving message from renderer: 298.972

The cookies pop up opens up but the script doesn't click on it, in like 20 driver.get(url), 19 times it will accept cookies but the 20th will fail to accept cookies, although the window has opened up, I tried to use the code below but still fails.

retries = 1
while retries <= 5:
    try:
        element = WebDriverWait(driver, 20).until(EC.element_to_be_clickable((By.XPATH, '//*[@class="coi-banner__accept"]'))) #wait until cookies clickable
        element.click()
        break
    except TimeoutException:
        driver.refresh()            
        element = WebDriverWait(driver, 20).until(EC.element_to_be_clickable((By.XPATH, '//*[@class="coi-banner__accept"]'))) #wait until cookies clickable
        element.click()
        retries += 1

can you share a link to that page?

Prophet
– Prophet

2022-01-08 17:53:14 +00:00
Commented Jan 8, 2022 at 17:53 — Prophet
– Prophet, Commented Jan 8, 2022 at 17:53
@Prophet novasol.com

Skittles
– Skittles

2022-01-08 17:54:26 +00:00
Commented Jan 8, 2022 at 17:54 — Skittles
– Skittles, Commented Jan 8, 2022 at 17:54

cruisepandey · Accepted Answer · 2022-01-11 18:06:54Z

2

I ran the below script more than 20 times and still it was able to click on the desired button every single time.

All I had to do was basically to change the locator to CSS from XPath:

driver = webdriver.Chrome(driver_path)
driver.maximize_window()
wait = WebDriverWait(driver, 30)

driver.get("https://www.novasol.com/")

try:
    wait.until(EC.element_to_be_clickable((By.CSS_SELECTOR, "button[onclick='CookieInformation.submitAllCategories();']"))).click()
    print('Clicked it')
except:
    print('Either element was not found, or Bot could not click on it.')
    pass

Imports:

from selenium.webdriver.support.ui import WebDriverWait
from selenium.webdriver.common.by import By
from selenium.webdriver.support import expected_conditions as EC

Updated:

driver.get("https://www.novasol.com/")

def retry_click(number_of_retries, wait_before_performing_click):
    while number_of_retries > 0:
        time.sleep(wait_before_performing_click)
        try:
            wait.until(EC.element_to_be_clickable((By.CSS_SELECTOR, "button[onclick='CookieInformation.submitAllCategories();']"))).click()
            break
        except:
            pass
        number_of_retries = number_of_retries - 1


try:
    wait.until(EC.element_to_be_clickable((By.CSS_SELECTOR, "button[onclick='CookieInformation.submitAllCategories();']"))).click()
    print('Clicked it')
except:
    print('Either element was not found, or Bot could not click on it.')
    driver.refresh()
    retry_click(20, 10)
    pass

edited Jan 11, 2022 at 18:06

answered Jan 8, 2022 at 18:05

cruisepandey

29.5k6 gold badges23 silver badges43 bronze badges

Sign up to request clarification or add additional context in comments.

6 Comments

Skittles Over a year ago

Used this, but this time it failed to accept cookies at the 17th try : TimeoutException: Message: timeout: Timed out receiving message from renderer: 298.955, maybe how could I add in except to refresh the link and try find the element again?

cruisepandey Over a year ago

@Skittles: Updated, see above. if that still shows the issue, we would have to put a max_retry var and keep on retrying until we get succeed.

Skittles Over a year ago

thank you, tried the updated code, but again failed on get(URL) 5th try, I could try to run it again because it doesn't fail every time, but would like to solve it that it works every time.

cruisepandey Over a year ago

Need to create a function that will keep on retrying after a specified time and only exit once it's available to click.

Skittles Over a year ago

could you please help with that how to write that? I tried to write in except : driver.quit( ), driver.get(link), wait.until.. but that didn't do anything.

|

Shivang Gupta · Accepted Answer · 2022-01-08 17:58:28Z

1

Try to use driver.execute_script() instead of element.click()

htmlElement = driver.find_element_by_xpath('//*[@class="coi-banner__accept"]')
driver.execute_script("arguments[0].click();", htmlElement)

answered Jan 8, 2022 at 17:58

Shivang Gupta

3474 silver badges11 bronze badges

Comments

Prophet · Accepted Answer · 2022-01-08 18:05:39Z

0

Generally,

element = WebDriverWait(driver, 20).until(EC.element_to_be_clickable((By.XPATH, '//*[@class="coi-banner__accept"]'))) #wait until cookies clickable
element.click()

should work. From the code you shared I can't see why it works in 95% cases but fails in 5% case.
What I do see:
You are trying to find exactly the same condition in except block that caused the TimeoutException.
So, if somehow Selenium could not find element matching this locator //*[@class="coi-banner__accept"] to be clickable and thrown an TimeoutException waiting for the same condition in except will give you the same result.... Also, I see no sense to put this in a loop of 5 attempts.
In case element was found, clicked and closed - no sense to try again.
And in case you could not do that in the first attempt - this will throw you TimeoutException exception on the first attempt, you will never continue to the second attempt here...

answered Jan 8, 2022 at 18:05

Prophet

33.5k28 gold badges58 silver badges90 bronze badges

2 Comments

Skittles Over a year ago

for some reason sometimes it doesn't recognize the cookies pop up, I wanted to add in except: refresh the browser/link and try to find the element again.

Prophet Over a year ago

OK, with refresh it should work.

Collectives™ on Stack Overflow

Python Selenium TimeoutException error even with wait until clickable and except TimeoutException:

3 Answers 3

6 Comments

Comments

2 Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

3 Answers 3

6 Comments

Comments

2 Comments

Your Answer

Sign up or log in

Post as a guest

Related