Scraping <script> tag with certain keyword using Simple HTML Dom Parser

Question

I'm attempting to scrape a <script> tag from a set of webpages using Simple HTML Dom. At first, I was scraping it by providing the numerical order of the tag I needed:

$script = $html->find('script', 17); //The tag I need is typically the 18th <script> tag on the page

I've come to realize that the order differs depending on the page (and it's just not a scalable way of doing this since it could change at any time). How can I instead search for a keyword within the tag that I need and then pull back the full tag? For example, the tag I need always contains the string "PRODUCT_METADATA".

Thanks in advance for any ideas!

Use Xpath with simpleXML aor DomDocument

splash58
– splash58

2015-08-03 18:49:55 +00:00
Commented Aug 3, 2015 at 18:49 — splash58
– splash58, Commented Aug 3, 2015 at 18:49

user994585 · Accepted Answer · 2015-08-03 20:24:27Z

7

I ended up using the below code to search all script tags for my keyword:

$scripts = $html->find('script');
    foreach($scripts as $s) {
        if(strpos($s->innertext, 'PRODUCT_METADATA') !== false) {
            $script = $s;
        }
    }

answered Aug 3, 2015 at 20:24

user994585

6714 gold badges14 silver badges28 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

justin.m.chase · Accepted Answer · 2021-05-03 15:55:18Z

0

It works, but for me I was trying to find a csrf token hidden in a script tag and at first couldn't get it to work, all a got out was NULL.

My solution was use explode() on the script s and very important remember ->innertext else you can't get a string.

I was lucky that the token was in doublequotes so it was easy to get it.

My final code looks like this:

$scripts = $html->find('script');
foreach($scripts as $s) {
    if (strpos($s->innertext, 'csrf_token') !== false) {
        $script_array = explode('"', $s->innertext);
        $token = $script_array[1];
        break;
    }
}

edited May 3, 2021 at 15:55

justin.m.chase

13.7k9 gold badges61 silver badges111 bronze badges

answered May 3, 2021 at 8:53

Stev.dev

411 bronze badge

Collectives™ on Stack Overflow

Scraping <script> tag with certain keyword using Simple HTML Dom Parser

2 Answers 2

Comments

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Related