Is Moz's backlink checker.... just... not good?
-
Hey everyone!
Can somebody explain to me why this keeps happening: Whenever I'm trying to backlink my competitors, I typically use RavenTools. Every time, without fail, if I put that same URL into Moz's Open Site Explorer - It gives me about 1/20th of what RavenTools shows me. Sometimes it literally comes up with 2 or 3 links total.
Unfortunately, RavenTools has a cap on how many backlink checks you can perform in a month - so once I've used those up, I have to start using OSE... But, it just doesn't work.
Does anyone else have this issue?
Thanks!
-
Hey there! Tawny from Moz's Help Team here. I think I can help explain why you're seeing fewer links with our tools than with others.
Open Site Explorer and the Link Analysis page of Moz Pro Campaigns are both tied to our Mozscape index, which tends to update roughly once a month.
Just a few points on how we compile our index:
- We grab the most recent index.
- We take the top 10 billion URLs with the highest MozRank (with a fixed limit on some of the larger domains).
- We start crawling from the top down until we've crawled ~130 billion URLs
The idea here is that we're focusing on the highest-quality links we can find, coming from the most prominent pages of authoritative sites. So, while you may not see every link for a site within our index, we're aiming to report the most valuable ones available!
Most new sites and links will be indexed by our spiders and available in Mozscape and Open Site Explorer within 60 days, but some take even longer for many reasons - including the crawl-ability of sites, the number of inbound links to them, and the depth of pages in subdirectories. This tends to bias our index in favor of newer links. Linking data is only stored in the index for around 180 days. After that point, unless the crawler has a compelling reason to return to your site and the sites linking to yours, recrawl and reindex them, those links to your site can fall back out of our index again. That doesn't mean they're not out there on the web affecting your SEO, just that our tools don't see them anymore.
You can see our most recently updated schedule here as well as some more technical metrics on our Mozscape API Updates page. You can also see when the last and next updates happened on the Open Site Explorer (OSE) homepage at any time.
Since Moz focuses on quality of links over quantity, we are always focused on the most relevant links to display to our users. It's possible that Moz's index will leave out some of the lower-quality (non-link juice providing) links out of our index because of this. So, that might explain why you may see some discrepancies with what other tools may be showing.
You can read more about how we build our index in our guide here.
I know this is a ton of information, so if you have any questions or if I didn't make anything clear enough, please don't hesitate to ask! You can always drop us a line at help@moz.com and we'll do our best to clear up any questions you might have.
-
Bump.
-
I'm going to comment on here again to bump this post. This is a little aggravating: I ran a report on one of our clients using OSE and it says they have 3 backlinks. I then immediately ran a report on RavenTools and their report says we have 61 backlinks.
Why would I want to use OSE if it is only going to provide me >5% of my client's backlink profiles? I simply don't understand.
-
You are most welcome. And thank you for the followup.
You are right. More results are better. The point I meant to establish was that OSE is not bad even though it could be better. It, like the other tools, provides an accurate slice of a site's back links. The size of that slice depends on the tool's resources.
Equipped to Act Having back link profiles from these tools leaves us equipped to act. I said this in my answer as a blanket statement for link building, disavowing*, content development, and outreach. Here are some quick examples:
Link building — If OSE (or any tool) returns 4 domains for you and 150 for your competition, It's time to get some links. Plug in some competitors to see if there are any gaps you can target, hit up Fresh Web Mentions to focus your outreach, and explore content opportunities.
Disavow* — If your tool returns 4 root domains, 15 total links and one of those is complete spam level 10, I'd probably want to disavow* it and audit my site for more spammy links using GSC. I'd know from the slice of back links Moz provided that my site was likely to have more.
Footnote on Disavowing* Penguin 4.0 has presented some changes for us as to the when and what to disavow. I have not had a recent and significant enough experience with spammy back links to formulate my response yet. If you find yourself the victim of bad back links, do some research before you throw the SEO book at the issue. It might save time.
Cultivate those links,
CopyChrisSEO and the Vizergy Team -
Thanks for the well articulated response, Chris! It's much appreciated.
I'm gonna contest your last statement though, and I'd like to see what you have to say. If I use Moz to check my backlinks, and it gives me (4 root domains, 15 total links) VS. using someone else and getting (150 root domains, X amount of links) ---- How is this a good way to be equipped to act on my backlink portfolio, in regards to using Moz? I wouldn't be able to know if I have spammy backlinks, or a good amount of high quality links?
-
Hello TaylorRHawkins and fellow Mozers,
I have had the pleasure of using all sorts of backlink tools, including OSE and RavenTools. In doing so, I've run into this issue. Clients notice this difference too and frequently bring it to my attention. Here's what I say: These are different tools with different limitations. They give different results because of these limitations, which always come down to resources. Whether it's the software, indexing process, or bots, all of these tools are limited by their resources.
Tools with larger resources typically return more results. However, even more well-funded tools, including Ahref's beefy bot and index, won't get them all. You can see this in action by comparing your site's links—as reported per your chosen tool—to Google Search Console, which Google has pinky-promised us is the full list. You'll see the difference right away.
So is this a bad thing? No, not at all.
The tools I've used (OSE, RavenTools, Ahrefs, SEM Rush, and Brightedge) all do a pretty great job of delivering an accurate slice of my competitor's backlinks across the internet. Take this data and extrapolate the backlink profile using other metrics like domain authority. You'll get a good picture of what they have—and be equipped to act on it—even if you can only see 1/20th of their backlink pie.
Keep crawling,
CopyChrisSEO and the Vizergy Team
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Backlinks Indexed?
my question is that in Moz what is speed of Backlinks indexed, while ahref show indexed backlink after 2 or 3 days, but still Moz does not show that backlinks index or not Ahref has already increased site DR, while Moz still not increase Domain Authority or PA, I want to know the procedure how DA increase while I have high authority backlinks for my site [https://www.sipotek.net] Homepage
Link Explorer | | younus_51110 -
Backlink not showing on Link Explorer
Hello, Our team have been doing link building for a month, however non of the links are coming up in MOZ Link Explorer. We used link tracker to check, and it is not linking back. when checking on the other blog's site, they are linking back but we are unable to see it in moz. For example:
Link Explorer | | WAUBIKE
Indiegogo: https://www.indiegogo.com/projects/wau-the-best-feature-packed-smart-ebike#/
NewAtlas: https://newatlas.com/wau-ebike-affordable/56791/ These both links are linking back to us at www.waubike.com, and we can see it on google web masters, but we cannot see it on Moz? We have checked our server and they confirmed they are not blocking Moz's crawlers. Anyone else have this issue ?0 -
Moz Spam Score 9/17 when there are no links
Hi I was just looking at a competitors new site in OSE and it had a DA and PA of 1 which I would expect and also no links, which again I would expect, basically the guy used to design stuff for me and thinks he can do a better job so he is giving it ago. But he has a spam score of 9/17 but no links - how is this even possible. Thanks Andy
Link Explorer | | Andy-Halliday0 -
Moz cannot crawl domain. Also OSE does not work properly on this specific domain?
Hi all, Moz cannot crawl the domein http://www.hoesjescases.nl.
Link Explorer | | Guapa_zwolle
When I open the crawl report I only see one line: <colgroup><col width="229"><col width="287"><col width="420"><col width="370"><col width="141"></colgroup>
| URL | Time Crawled | Title Tag | Meta Description | HTTP Status Code |
| http://www.hoesjescases.nl | 2015-10-05T12:20:48Z | 404 : Received 404 (Not Found) error response for page. | Error attempting to request page; see title for details. | 404 | Also when running OSE on this domain, Moz only can find 4 root domains while Majestic can find 91 domains. Google seems not to have any problems. What can be the problem for MOZ? Greetings!0 -
Changed URL from HTTP to HTTPS - 99% of my backlinks don't know though
Hi Moz community, I've got a question about all old backlinks pointing to the http version of my site: Firstly, how it impacts my site's backlinks for SEO and secondly, why does Moz and if you know why Majestic have different metric report values for the different URLs. The Back Story Two months ago I bought an SSL for my personal domain and changed my URL from http to the https version. I 301'd it and can verify that on Majestic SEO using the old http URL. I did this sitewide for an eCommerce site that I'm working and did see a lift in traffic; that was the main reason based on Google talking about sites moving to the SSL Web. I'm No Stranger to 301s Of course all the URLs on my site have been 301'd. I used a HTTPS Redirect plugin for my WordPress site and there's been no issue. I also installed a 404 Checker plugin to log broken external links to my site where I can create a redirect right away in case the HTTPS plugin missed something along the way. I'm comfortable knowing that doing when you change the domain name for a site or just a page going from one URL to another will transfer all the link equity over time. What's Causing the Confusion What's a little confusing is that when I use tools like OSE or Majestic's Explorer, the data doesn't match. For instance in OSE, the https version of my domain has a DA of 1 and PA of 1. But, the http version of my site has a DA of 25 and PA of 36. With Majestic (BTW, please feel free to stop me from asking questions about another tool on Moz, but since we're all part of the same SEO community, I thought I'd ask it here anyway) the Trust and Citation flow values are definitely closely matched but still different values nonetheless. My Question Will I ever see the DA and PA the same for the https & http versions in the future? Does OSE catch the fact that there is a 301 redirect to the https version or does it only recognize that it redirects from http://kingrosales.com to http://www.kingrosales.com when in fact it redirects to https://www.kingrosales.com? My second question is, what about the backlinks? Is it because they are different URLs that OSE doesn't have a way to recognize this and display links from the old http version to the new https version? How will I know the true PA and DA of the https version of my site even with a perfectly executed 301 redirect? lol Let me know if you need more clarification. Thanks
Link Explorer | | KingRosales3 -
How can I get a Moz crawl report of 404 errors on my site
I have a Moz subscription and I see dead links on my website that link externally. Is there a Moz crawl report which will show me these 404 errors and which pages on my site those 404 links are on?
Link Explorer | | Marbanasin0 -
Repeated mysterious 404's from ancient site structure killing my rankings
Several years ago I changed my site structure to go from a flash based site to a blog based wordpress site. After doing so I went from page 1 to page 30 for my relevant search terms. I have employed people to help me track down the problem and I believe that they have narroed it to the existance of 404's being created from some unknown internal source. I have been for years getting links like this... <colgroup><col width="792"></colgroup>
Link Explorer | | dfphotographer.com
| http://www.dfphotographer.com.au/brisbaneweddingphotographer/2011/10/brisbane-wedding-photographer-charisma-and-steve-victoria-park-brisbane/?share=facebook http://www.dfphotographer.com.au/brisbaneweddingphotographer/2011/10/brisbane-wedding-photographer-charisma-and-steve-victoria-park-brisbane/charisma-and-steve-301/?share=email http://www.dfphotographer.com.au/brisbaneweddingphotographer/2011/10/brisbane-wedding-photographer-charisma-and-steve-victoria-park-brisbane/photography-brisbane-04-2/?share=email http://www.dfphotographer.com.au/brisbaneweddingphotographer/2011/10/brisbane-wedding-photographer-charisma-and-steve-victoria-park-brisbane/photography-brisbane-12-2/ http://www.dfphotographer.com.au/brisbaneweddingphotographer/2011/10/brisbane-wedding-photographer-charisma-and-steve-victoria-park-brisbane/photography-brisbane-13-2/ http://www.dfphotographer.com.au/brisbaneweddingphotographer/2011/10/brisbane-wedding-photographer-charisma-and-steve-victoria-park-brisbane/photography-brisbane-13-2/?share=facebook http://www.dfphotographer.com.au/brisbaneweddingphotographer/2011/10/brisbane-wedding-photographer-charisma-and-steve-victoria-park-brisbane/photography-brisbane-13-2/feed/ http://www.dfphotographer.com.au/brisbaneweddingphotographer/2011/10/brisbane-wedding-photographer-charisma-and-steve-victoria-park-brisbane/photography-brisbane-16-2/?share=email | ......regularly showing in webmaster tools, (this is from a top pages report from MOZ where there are hundreds also shown). When I do a moz crawl of the site, none of these links show up. Therefore I have no way of finding the source of these links (they also do not show me the source in WMT as they should). We have completely cleared the site and rebuilt it and although it is still only a couple of weeks in it still does not appear to have stopped them. Does anyone have any way of helping me find the source of these mysterious 404's?0