How to get data of html table with selenium python

Question

I want to get some td data from dynamic table with selenium and push them in array. I tried to use:

driver.find_elements_by_class_name("row_data")

and get the html then find td but the list element can't get attribute innerHTML ...

<tr class="row_data text-silver">
                <td class="link">
                        <a href="/Account/UserCompleteRegister" data-toggle="tooltip" data-placement="left" title="ویرایش" class="btn btn-info btn-xs btnEditUser">
                            <i class="fa fa-edit"></i>
                        </a> 
مرضیه<input type="hidden" value="1332162477" class="userId">
                </td>
<td class="text-right">
ایرج ساعی 

</td>
<td class="text-right">
6180033005  

</td>
<td class="text-right">


</td>
<td class="text-right">
25 سال و 2 روز    

</td>
<td class="text-right">

<span class="GenderText">زن</span>


</td>
</tr>

Does this answer your question? Iterate through table rows and print column text with Python Selenium — Sariq Shaikh
– Sariq Shaikh, Commented Mar 22, 2020 at 10:58
try driver.find_elements_by_class_name("row_data.text-silver"), space become dot. BTW for web scrapping tables i would recommend using pandas.read_html. — ofeks
– ofeks, Commented Mar 22, 2020 at 11:18

undetected Selenium · Accepted Answer · 2020-03-22 14:34:16Z

A bit of more information with respect to which data you are exactly looking for would have helped us to construct the answer in a canonical way. However as the class attribute of the <tr> node contains row_data and text-silver you need to induce WebDriverWait for the visibility_of_element_located() and you can use either of the following Locator Strategies:

Using CSS_SELECTOR:

print(WebDriverWait(driver, 20).until(EC.visibility_of_element_located((By.CSS_SELECTOR, "tr.row_data.text-silver))).text)

Using XPATH:

print(WebDriverWait(driver, 20).until(EC.visibility_of_element_located((By.XPATH, "//tr[@class='row_data text-silver']"))).text)

Note : You have to add the following imports :

from selenium.webdriver.support.ui import WebDriverWait
from selenium.webdriver.common.by import By
from selenium.webdriver.support import expected_conditions as EC

SeleniumUser · Accepted Answer · 2020-03-22 11:45:59Z

0

If its single table on your page and you want to use xpath then please refer below solution :

1.  //table//td[*]      
2.  //table//tr//td[*]

or else provide specific table id to handle your tabel

answered Mar 22, 2020 at 11:45

SeleniumUser

4,1973 gold badges15 silver badges45 bronze badges

Collectives™ on Stack Overflow

How to get data of html table with selenium python

2 Answers 2

Comments

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related