Selenium returns empty string instead of the actual data

Question

I am using Selenium via Python in attempts to web scrape. I'm almost where I want to be but I ran into what I am now realizing is not so small of a problem. So the element I am working with is this:

<td class=" ui-datepicker-days-cell-over  ui-datepicker-current-day ui-datepicker-today" 
data-handler="selectDay" data-event="click" data-month="3" data-year="2018">
    <a class="ui-state-default ui-state-highlight ui-state-active" href="#">10
    </a>
</td>

My ultimate goal is to get the 10 that's between the a tags. This is my code so far:

option = selenium.webdriver.ChromeOptions()
option.add_argument(" - incognito")
browser = webdriver.Chrome(executable_path=r"chromedriver.exe")
browser.get(myUrl)
calendar = browser.find_element_by_xpath(
    '/html/body/main/section/div[2]/div[1]/div[2]/div[3]/div/div[1]/div/div[1]/div[2]')
viewCal = browser.find_element_by_name('choice_set[begin_at]')
viewCal.click()

row = calendar.find_elements_by_tag_name('tr')

column = calendar.find_elements_by_tag_name('td')
numb = column[0].find_element_by_tag_name('a')
numb.text

numb.text returns '' instead of 10.

What am I doing wrong here?

So, how is going? Did you try my answer?

Ratmir Asanov
– Ratmir Asanov

2018-04-10 10:44:19 +00:00
Commented Apr 10, 2018 at 10:44 — Ratmir Asanov
– Ratmir Asanov, Commented Apr 10, 2018 at 10:44

halfer · Accepted Answer · 2018-08-14 13:23:06Z

23

Try to use the following code:

numb.get_attribute("innerText")

edited Aug 14, 2018 at 13:23

halfer

20.2k20 gold badges110 silver badges207 bronze badges

answered Apr 10, 2018 at 9:49

Ratmir Asanov

6,4795 gold badges30 silver badges44 bronze badges

Sign up to request clarification or add additional context in comments.

3 Comments

Kusal Hettiarachchi Over a year ago

thank you for the answer. can you think of a reason why this works but not the property method

Nam G VU Over a year ago

this saved my life today coding ^^

Ratmir Asanov Over a year ago

@NamGVU, sounds good)

Herker · Accepted Answer · 2022-11-16 10:05:02Z

7

The text & innerText does only work with visible elements
If you want to get the text of a hidden element
then textContent could be an option

get_attribute("textContent")

Source - https://stackoverflow.com/a/43430097/14454151

edited Nov 16, 2022 at 10:05

answered Apr 12, 2021 at 12:47

Herker

6029 silver badges20 bronze badges

Comments

crifan · Accepted Answer · 2021-08-11 07:41:57Z

Core logic for get text from WebElement：

webElement.text
webElement.get_attribute("innerText")
webElement.get_attribute("textContent")

Full code:

def getText(curElement):
    """
    Get Selenium element text

    Args:
        curElement (WebElement): selenium web element
    Returns:
        str
    Raises:
    """
    # # for debug
    # elementHtml = curElement.get_attribute("innerHTML")
    # print("elementHtml=%s" % elementHtml)

    elementText = curElement.text # sometime NOT work

    if not elementText:
        elementText = curElement.get_attribute("innerText")

    if not elementText:
        elementText = curElement.get_attribute("textContent")

    # print("elementText=%s" % elementText)
    return elementText

Calll it:

curTitle = getText(h2AElement)

Frank · Accepted Answer · 2018-04-10 10:19:29Z

1

I think you don't select the right WebElements in your code.

I tried the following code with a similar datepicker and it was printing the expected daynumber.

days = driver.find_elements_by_xpath('//a[@class="ui-state-default"]')
daynumber = days[12].text
print(daynumber)

edited Apr 10, 2018 at 10:19

answered Apr 10, 2018 at 9:22

Frank

8711 gold badge11 silver badges23 bronze badges

2 Comments

Chae Over a year ago

It is returning None :( Do you have any idea why this might be so?

Frank Over a year ago

@Chae I changed my answer can you check it again

halfer · Accepted Answer · 2018-08-14 13:25:35Z

0

(Posted answer on behalf of the question author.)

I am very confused about why this is so but I guess I went in too deep. I skipped the last two steps of my code and finished with column[0].text instead and that worked! Also as Ratmir answered on the bottom numb.get_attribute("innerText") also gives the correct answer.

answered Aug 14, 2018 at 13:25

community wiki

halfer

Collectives™ on Stack Overflow

Selenium returns empty string instead of the actual data

5 Answers 5

3 Comments

Comments

Comments

2 Comments

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

5 Answers 5

3 Comments

Comments

Comments

2 Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related