Scraping html data using php

Question

How to parse the HTML data to an PHP array PHP

HTML Data

<div class="test">
    <strong>ID</strong>
    <a href="a.html" title="a html">123456</a><br>
    <label class='label'>Occupation </label>    
    House wife      <br>
    <label>Language?</label>    
    English     <br>
    <label style="width:50%">Basic Language Knowledge of?</label>   
    Hindi       <br>
    <label>Start date</label>
    Nov 2013        <br>
    <label>Other Info</label>
    yes     <br>
    <label>age</label>
    19      <br>
    <label>Gender</label>   
    Female      <br>
    <strong>Address</strong>
    India       <br><br>
    <p>Hi, <br>
Lorem ipsum doner inut</p>
</div>

I tried this,

<?php
    $html='Let above html to parse';
    preg_match_all('/<label\s(.*)>(.*)<\/label>/U',$html,$m);
    print_r($m);
    // gives all label contents only but I need pair of label text 
    // and value showing after it
?>

Output like,

Array('ID'=>123456,'link'=>'a.html','Occupation'=>'House wife','Language?'=>'English', 'Basic Language Knowledge of?'=>'Hindi','Start date'=>'Nov 2013','Other Info'=>'yes' ,'age'=>'19','Gender'=>'Female','Address'=>'India','description'=>'Hi, Lorem ipsum doner inut');

Yes, forgot to mention I am using ganon for scraping

so what is the problem?

Suresh Kamrushi
– Suresh Kamrushi

2013-11-11 10:16:20 +00:00
Commented Nov 11, 2013 at 10:16 — Suresh Kamrushi
– Suresh Kamrushi, Commented Nov 11, 2013 at 10:16

TiMESPLiNTER · Accepted Answer · 2013-11-11 10:55:21Z

1

Use DOMDocument to parse HTML.

$doc = new DOMDocument();
$doc->loadHTML($html);

And use DOMXPath to get all your labels:

$xpath = new DOMXPath($doc);
$allLabels = $xpath->query('//label');

foreach($allLabels as $label) {
    var_dump($label, $label->nodeValue);

    /* or */
    $labelElmnts = $xpath->query('/*', $label);

    $innerHTML = '';

    foreach($labelElmnts as $elmnt)
        $innerHTML .= $domDoc->saveHTML($elmnt);

    var_dump($innerHTML);
}

edited Nov 11, 2013 at 10:55

answered Nov 11, 2013 at 10:17

TiMESPLiNTER

5,9193 gold badges31 silver badges68 bronze badges

Sign up to request clarification or add additional context in comments.

2 Comments

Rohan Kumar Over a year ago

It will only give the list of label data and I need the text after label data like, occupation=>'house wife'`

TiMESPLiNTER Over a year ago

Read the doc: php.net/manual/en/class.domnode.php. ->nodeValue is what you're looking for. Have a look at my edited code in t he answer.

Dieter Gribnitz · Accepted Answer · 2013-11-11 11:02:54Z

0

Even easier solution.

Use QueryPath:

foreach(qp($html, 'label') as $label){
  echo $label->text();
}

Just like jquery.

answered Nov 11, 2013 at 11:02

Dieter Gribnitz

5,2192 gold badges44 silver badges38 bronze badges

Comments

Rohan Kumar · Accepted Answer · 2013-11-12 04:20:15Z

0

I used ganon so I don't want to use Dom Document I tried it something and worked like,

// for description
echo $desc=$html('div.right_div p',0)->getInnerText();

$s=$html('div.right_div',0)->getInnerText();

// for occupation
$r='/<label>\s*Occupation\s*<\/label>\s*(.*)\s*<br\s*[\/]>/i';
preg_match_all($r,$s,$ma);
echo $occupation=$ma[1];

// for address
$r='/<strong>\s*Address\s*<\/strong>\s*(.*)\s*<br\s*[\/]>/i';
preg_match_all($r,$s,$ma);
echo $address=$ma[1];

// for id
echo $id=$html('div.right_div a',0)->getInnerText();

And so on ...

edited Nov 12, 2013 at 4:20

answered Nov 11, 2013 at 12:21

Rohan Kumar

40.7k11 gold badges81 silver badges111 bronze badges

Collectives™ on Stack Overflow

Scraping html data using php

3 Answers 3

2 Comments

Comments

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

3 Answers 3

2 Comments

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Related