PHP Scraping Page

Question

I'm trying to scrape a page where the information I'm looking for lies within:

 <tr class="defRowEven">
   <td align="right">label</td>
   <td>info</td>
 </tr>

I'm trying to get the label and info out of the page. Before I was doing something like:

$hrefs = $xpath->evaluate("/html/body//a");

That is how I'm grabbing the URL's. Is there a way to grab that tr information? Would it be better to use regex or using the DOMXPath? I'm very unfamiliar with DOMXPath and any information would be more than helpful. Thank you!

eswald · Accepted Answer · 2009-09-03 15:21:19Z

4

XPath can select based on attributes. To find your row, then, use:

$rows = $xpath->query("//tr[@class='defRowEven']");

This should return a list of rows, so you can select the label and info for each without mixing them up:

foreach ($rows as $row) {
    $label = $xpath->evaluate("td[@align='right']", $row);
    $info = $xpath->evaluate("td[2]", $row);
}

In case that doesn't work out, you can try the regex route:

preg_match_all('/<tr class="defRowEven">\s*<td align="right">(.*?)<\/td>\s*<td>(.*?)<\/td>/',
    $html, $matches, PREG_SET_ORDER);
foreach ($matches as $match) {
    list($full, $label, $info) = $match;
}

edited Sep 3, 2009 at 15:21

answered Sep 3, 2009 at 2:43

eswald

8,4145 gold badges31 silver badges28 bronze badges

Sign up to request clarification or add additional context in comments.

1 Comment

Petrogad Over a year ago

Tried your 2nd example, and couldn't get that working. I'll keep trying though. Thank you!

karim79 · Accepted Answer · 2009-09-03 01:49:21Z

1

I'm not familiar with xpath, but using SimpleHtmlDom you can do this:

foreach($html->find('tr.defRowEven') as $row) {

    //get the 'label' (first cell)
    echo $row->find('td', 0)->innerText;

    //get the 'info' (second cell)
    echo $row->find('td', 1)->innerText;
}

answered Sep 3, 2009 at 1:49

karim79

343k67 gold badges420 silver badges409 bronze badges

2 Comments

Petrogad Over a year ago

Tried that, no luck. Just a blank screen. I'll keep working with the class though, Thank you!

karim79 Over a year ago

@Frederico - maybe try echo $row->find('td', 0)->plainText; instead

Scott Evernden · Accepted Answer · 2009-09-03 02:17:55Z

0

Someone here recently at SO gave a link to phpQuery .. a kind of jQuery for php/server-side .. which SHOULD make this kinda thing easy. I've not tried it so can't comment first hand

answered Sep 3, 2009 at 2:17

Scott Evernden

40.1k15 gold badges81 silver badges84 bronze badges

Collectives™ on Stack Overflow

PHP Scraping Page

3 Answers 3

1 Comment

2 Comments

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

3 Answers 3

1 Comment

2 Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Related