Access html text through python selenium

Question

I am trying to get text (marked by hashtags).

<div class="XYZ">
        <h5>
    "
          #######Reports due by##############
    "
          <span class="hbl" data-hint="task due date">
            <i class="icon-boxy-sign"></i>
          </span>
        </h5>
        <script type="jsv#61^"></script><script type="jsv#123_"></script>
        <script type="jsv#60^"></script><script type="jsv#124_"></script>
      <script type="jsv#59^"></script><p>#################07/10/2020#######################</p><script type="jsv/125^"></script>
    <script type="jsv/52_"></script><script type="jsv/24^"></script>
        <script type="jsv/42_"></script><script type="jsv/23^"></script>
      </div>

Python line to get the text inside the hashtags:

txt = dat =wait(driver, 10).until(EC.visibility_of_element_located((By.CSS_SELECTOR, 'div[class="XYZ"]'))).text

I expect the line to print: "Reports due by" and "07/10/2020, I keep getting timeoutException and Unable to locate element errors.

Try div.XYZ instead of div[class="XYZ"] (see class selector docs) — Eric
– Eric, Commented Sep 10, 2019 at 21:35
div.XYZ not working either. And I don't think that python syntax! — Mixter
– Mixter, Commented Sep 10, 2019 at 21:50

undetected Selenium · Accepted Answer · 2019-09-11 08:07:49Z

1

Seems you were close. To extract the text (marked by hashtags) you have to induce WebDriverWait for the visibility_of_element_located() and you can use either of the following Locator Strategies:

Using CSS_SELECTOR:

print(WebDriverWait(browser, 20).until(EC.visibility_of_element_located((By.CSS_SELECTOR, "div.XYZ"))).get_attribute("title"))

Using XPATH:

print(WebDriverWait(browser, 20).until(EC.visibility_of_element_located((By.XPATH, "//div[@class='XYZ']"))).get_attribute("title"))

Note : You have to add the following imports :

from selenium.webdriver.support.ui import WebDriverWait
from selenium.webdriver.common.by import By
from selenium.webdriver.support import expected_conditions as EC

Here you can find a relevant discussion on selenium.common.exceptions.NoSuchElementException: Message: no such element: Unable to locate element while trying to click Next button with selenium

answered Sep 11, 2019 at 8:07

undetected Selenium

194k44 gold badges304 silver badges387 bronze badges

Sign up to request clarification or add additional context in comments.

3 Comments

Mixter Over a year ago

I have the correct imports. Neither expression above works for this particular situation. CSS_SELECTOR returns NONE Type, and XPATH times out! Is there a way to access the strings by their tags? <h5> and <p>. I think that's the only hope left.

Mixter Over a year ago

I also have the correct wait "from selenium.webdriver.support.ui import WebDriverWait as wait" thanks

Mixter Over a year ago

Marking this solution because it shows good response effort, and will help others. Thanks.

IPolnik · Accepted Answer · 2019-09-10 21:34:09Z

0

Change By. CSS_SELECTOR to By.XPATH and update locator to '//div[@class='XYZ']'. Should work.

answered Sep 10, 2019 at 21:34

IPolnik

6495 silver badges13 bronze badges

1 Comment

Mixter Over a year ago

Tried: (By.XPATH, '//div[@class='XYZ']). No Luck!

Collectives™ on Stack Overflow

Access html text through python selenium

2 Answers 2

3 Comments

1 Comment

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

3 Comments

1 Comment

Your Answer

Sign up or log in

Post as a guest

Linked

Related