Is it possible to do HTML scraping , data mining through Python?

Question

Can I gather intelligent data , HTML scraping using python? I have no knowledge of it , so I would like to get some idea.

possible duplicate of Python and data mining

Felix Kling
– Felix Kling

2011-05-23 00:04:36 +00:00
Commented May 23, 2011 at 0:04 — Felix Kling
– Felix Kling, Commented May 23, 2011 at 0:04

user2665694 · Accepted Answer · 2011-04-30 16:22:33Z

3

Look at the module scrapy:

http://scrapy.org/

answered Apr 30, 2011 at 16:22

user2665694

Sign up to request clarification or add additional context in comments.

Comments

Bill the Lizard · Accepted Answer · 2012-08-04 01:46:07Z

3

You certainly can - I developed this library in Python for my web scraping work.

A good parsing library is lxml.

If you are new to Python you may want to work through this ebook first.

edited Aug 4, 2012 at 1:46

Bill the Lizard

407k213 gold badges579 silver badges892 bronze badges

answered May 3, 2011 at 14:42

hoju

29.6k40 gold badges138 silver badges178 bronze badges

3 Comments

Tilak Madichetti Over a year ago

The Links Are Dead .

SmallChess Over a year ago

@TilakMadichetti No they are not.

Tilak Madichetti Over a year ago

oops sorry ! there was a problem with my network that time . My bad :)

Alex Smith · Accepted Answer · 2011-04-30 21:23:47Z

1

Try using urllib2 and Beautiful Soup.

urllib2 is useful for requesting URLs programmatically. It's part of the standard library: http://docs.python.org/library/urllib2

Beautiful Soup is good for mining HTML/XML and can be found here: http://pypi.python.org/pypi/BeautifulSoup

answered Apr 30, 2011 at 21:23

Alex Smith

1,53512 silver badges13 bronze badges

Comments

seagulf · Accepted Answer · 2011-05-23 00:00:12Z

0

You may also use htql library at: http://htql.net.

answered May 23, 2011 at 0:00

seagulf

3783 silver badges5 bronze badges

Collectives™ on Stack Overflow

Is it possible to do HTML scraping , data mining through Python?

4 Answers 4

Comments

3 Comments

Comments

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

4 Answers 4

Comments

3 Comments

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Related