Does Open Site Explorer purposefully not crawl some sites?
-
I use both SEOmoz's Open Site Explorer and Web Master Tools to find backlinks when conducting link audits. WMT always finds more links than OSE; I understand Google's database is bigger. But what is interesting to me is that it seems that a large percentage of the links WMT finds that OSE does not are real crappy links that I don't want. That makes me wonder if SEOmoz decides not to crawl certain, low quality, sites? Just curious.
-
If only we had Google's computer budget, or even their food budget, to throw into our server farm! We do realize that we can't cover everything and that for an audit you will need multiple tools. Keep in mind that Bing offers link information, even for sites you haven't verified in their Webmaster Tools.
-
Thanks for responding Keri. The fact that OSE crawls higher quality sites is great from a link building perspective. However, from a link audit perspective, which is so important these days, it does not give me the information I need to research poor quality links. This forces me to rely on multiple tools.
Thanks again!
Megan
-
We do try to crawl higher-quality sites and show some of the better, more meaningful links to you.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Links from Dofollow sites are Nofollow ?
Hii i have made few links from dofollow site through blog commenting method and when i checked my site on Open Site Explorer it shows Nofollow . So my question is links from Dofollow blogs will be nofollow ? There is any benefit of getting links from dofollow site through comments ? Thanks
Moz Pro | | sumit40 -
Why is my MOZ report only crawling 1 page?
just got this weeks MOZ report and it states that it have only crawled: Pages Crawled: 1 | Limit: 10,000 it was over 1000 a couple of weeks ago, we have moved servers recently but is there anything i have done wrong here? indigocarhire.co.uk thanks
Moz Pro | | RGOnline0 -
Seo moz has only crawled 2 pages of my site. Ive been notified of a 403 error and need an answer as to why my pages are not being crawled?
SEO Moz has only crawled 2 pages of my clients site. I have noticed the following. A 403 error message screaming frog also cannot crawl the site but IIS can. Due to the lack of crawling ability, im getting no feed back on my on page optimization rankings or crawl diagnostics summary, so my competitive analysis and optimization is suffering Anybody have any idea as to what needs to be done to rectify this issue as access to the coding or cms platform is out of my hands. Thank you
Moz Pro | | nitro-digital0 -
Find out what keywords a site is ranking for
I want to find out what keywords a site is ranking for. In other words, I want to find out how Google is currently seeing a site. I've used Google KW tool - not very accurate when you simply type in the URL. Is there anything in SEOMoz I can use? New to this. thanks
Moz Pro | | goodge0 -
Crawl Diagnostics Update
I have corrected some errors in my SEOMoz Crawl Diagnostics, however the errors are still showing. It says a crawl has happen since. Any idea's why?
Moz Pro | | petewinter0 -
When to stop link building because page authority is low - open site explorer
Hi, I'm link building with Open Site Explorer. I'm really picky in get links from only high quality sites. When do you stop going down the list of possible backlink providers because the page authority is too low. I usually stop at 40, but what do you do, why, and what does it depend on?
Moz Pro | | BobGW0 -
SEOMoz Pro and Multiple Niche Sites
Currently I have 15 affiliate marketing sites and three blogs which are monetized. My budget dictates the base pro package so may I get some recommendations on how or if I can do analysis over time for all the sites. I ask this because it seems you would set your campaigns for long-term but I imagine you delete/modify/add campaigns to analyze different key words. Thanks for your help.
Moz Pro | | JavaManOne0 -
Tons of Crappy links in new OSE (Open Site Explorer)
I am starting to miss the old OSE. I've found that for a lot of the pages on our site, the new OSE is showing WAY more links and most of them are garbage nonsense links from China, Russia, and the rest of the internet Wild West. For instance, in the old OSE, this page used to show 9 linking domains: http://www.uncommongoods.com/gifts/by-recipient/gifts-for-him It now shows 454 links. Some of the new links (about 5 of them) are legitimate. The other 400+ are garbage. Some are porn sites, most of them don't even open a web page, they just initiate some shady download. I've seen this for other sites as well (like Urban Outfitters) This is making it much harder for me to do backlink analysis on bc I have no clue how many "Normal" links they have. Is anyone else having this problem ? Any way to filter all this crap out ? See attached screenshot of the list of links I'm getting from OSE. NHXnn
Moz Pro | | znotes1