Extracting dynamically rendered content in a HTML page using Java

Question

I have a HTML page like

<html>
<head>
<!-- necessary java scripts -->
</head>
<body>
<div id="content"></div>
</body>

Using the script, when the page renders, appropriate html content is placed withing the div element with id "content". So after the page renders there are a whole lot of html content withing div element.

Now i need to extract the dynamically rendered content within the div element using Java. Can anyone please suggest a way to do it?

Community · Accepted Answer · 2017-05-23 12:06:47Z

1

The problem is that you need to evaluate script on the page in java. You need to get some web engine to do it. You can look here: Embedding Gecko/Webkit in Java And try to use webkit or gecko to load page. Then you can use some java library to parse html.

edited May 23, 2017 at 12:06

CommunityBot

11 silver badge

answered May 23, 2012 at 8:33

Mikita Belahlazau

15.4k2 gold badges41 silver badges44 bronze badges

Sign up to request clarification or add additional context in comments.

1 Comment

Sripaul Over a year ago

I implemented using SWT and it worked fine! Thanks for the link :-)

UVM · Accepted Answer · 2012-05-23 08:28:30Z

0

You can parse html with javax.swing.text.html.HTMLEditorKit.Parser.Have a look at this link

http://java.sun.com/products/jfc/tsc/articles/bookmarks/

answered May 23, 2012 at 8:28

UVM

9,9247 gold badges43 silver badges66 bronze badges

Comments

Jack · Accepted Answer · 2012-05-23 08:31:08Z

0

Have a look through these:

http://java-source.net/open-source/html-parsers

answered May 23, 2012 at 8:31

Jack

16.8k21 gold badges104 silver badges171 bronze badges

Collectives™ on Stack Overflow

Extracting dynamically rendered content in a HTML page using Java

3 Answers 3

1 Comment

Comments

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

3 Answers 3

1 Comment

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related