Python - Getting text using selenium from text node

Question

I'm trying to scrape some information from a website using Selenium and Python and sometimes there's texts like this HZS stonks remaining... that does not have any name or label that I can get the text by:

snapshot

I can get the mkt-card class element easily and I assume that I can somehow get it from the mkt-card element but I can't figure out how to do it.

Barry the Platipus · Accepted Answer · 2022-07-18 12:31:42Z

1

This is how you can get the text in question:

from bs4 import BeautifulSoup
html = '''
    <div class="mkt-card"><div>some text</div><div class="error"></div>"HZS stonks remaining 0.14"</div>
'''
soup = BeautifulSoup(html, 'html.parser')
stonks_text = soup.select_one('div.error').next_sibling
print(stonks_text)

This returns "HZS stonks remaining 0.14"

Next time do not post screenshots, but actual text.

answered Jul 18, 2022 at 12:31

Barry the Platipus

10.5k2 gold badges9 silver badges33 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

undetected Selenium · Accepted Answer · 2022-07-18 14:12:00Z

0

As per the HTML:

snapshot

the desired element is within a text node and is within it's parent element <div class="mkt-card">

Solution

To print the text HZS stonks remaining 0.14 you can use either of the following locator strategies:

Using css_selector`:

print(driver.find_element(By.CSS_SELECTOR, "div.mkt-card").text)

Using xpath:

print(driver.find_element(By.XPATH, "//div[@class='mkt-card']").text)

answered Jul 18, 2022 at 14:12

undetected Selenium

194k44 gold badges304 silver badges387 bronze badges

Collectives™ on Stack Overflow

Python - Getting text using selenium from text node

2 Answers 2

Comments

Solution

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

Comments

Solution

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related