3

I'm working on an SEO app that (among other things) shows the number of incoming links to your site over time.

There are a few ways to get this data. Scraping Google "link:yoursite.com" results gives you some (not all) of the links they know about, but they aren't too happy if you are doing lots of scraping. Similarly Yahoo has their site explorer API calls which give you 20,000 queries per day I think, but it has a non commercial use limitation.

Are there any services out there which provide this information in some kind of API call? Probably a pay service would be best, need something reliable for commercial use. Basically it would have to be an index of the web that was updated fairly regularly selling API access to it. Or any other ways people get this info short of writing a SETI at home type app to make a bot army of scrapers?

1
  • You could always check the referrer on your site, certainly doesn't get you all links, but those which are actually clicked on. Commented Nov 19, 2009 at 17:31

3 Answers 3

1

Have a look at http://www.majesticseo.com.

They have reports for the incoming links to a website and you can even download them in CSV format. If you own the website (or doing it for a client who owns the site) then you can get the reports for free. Otherwise you can pay to obtain access statistics for other sites.

Sign up to request clarification or add additional context in comments.

1 Comment

Yep, had just started speaking with them! This is the closest answer I've found so far. Thanks!
0

Could you do the following:

Use google analytics, or logs to determine the referer websites to the page. (Which use the referer header to determine where there visitor has come from.)

Then you write a program to scan those websites, to determine the links on each page, referring to your website?

You might be able to use Yahoo's BOSS API, but that's going to be different to google's index.

1 Comment

Thats a good point, the referrer log entries are a decent source. Although it does require a human or bot click the link first, and the user to paste some code into their site. That could work though.
0

The SeoMoz API has more frequent batched of crawls and more recent results http://www.seomoz.org/api seomoz also gives you some awesome trust metrics so you can see what value the links have aswell

you can also use the Majestic SEO api http://www.majesticseo.com/plans-pricing but it just keep sadding links and doesnt really check to see if the links are still there after the first check

Comments

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Start asking to get answers

Find the answer to your question by asking.

Ask question

Explore related questions

See similar questions with these tags.