Google Apps Script regex returning null (data scraping) (google sheets)

Question

Goal: The goal is to grab the shiller PE from this website and to put it in a google sheet that updates every 24 hours.

Website: https://www.gurufocus.com/sector_shiller_pe.php

The table on the website with "shiller pe" values that needs to be scraped

Live values needed to be put in this google sheet

Solutions Tried:

=IMPORTXML("URL","XPATH")

Tried to use this function in the spreadsheet, but it is just unable to grab the website because the website is too slow

Google Apps Script

Made this script to grab the HTML of the data and return the shiller value for the Energy sector:

function energyFinder() {
  var url = "https://www.gurufocus.com/sector_shiller_pe.php";
  const html = UrlFetchApp.fetch(url).getContentText();
  var regex = new RegExp(/\/mq5xwwf">26<\/a><\/b><\/u><\/td><td class="text_center">([0-9][0-9].[0-9][0-9])<\/td>/);
  var e = regex.exec(html);
  return e
Logger.log(e)

}

But this just returns null. Any solution would help, thanks!

p.s. new to the website so I cannon embed pictures yet, so sorry for that

Can you add Logger.log(html) to ensure that the page is getting downloaded. — Amit Agarwal
– Amit Agarwal, Commented Sep 15, 2020 at 14:11

Amit Agarwal · Accepted Answer · 2020-09-15 14:16:33Z

1

You probably have an issue with the regex itself as there's no quotation mark before 26.

This should work:

\/mq5xwwf?>26<\/a><\/b><\/u><\/td><td class='text_center'>([0-9][0-9]\.[0-9][0-9])<\/td>

answered Sep 15, 2020 at 14:16

Amit Agarwal

11.3k1 gold badge35 silver badges44 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

Google Apps Script regex returning null (data scraping) (google sheets)

1 Answer 1

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Related