Moz Q&A is closed.
After more than 13 years, and tens of thousands of questions, Moz Q&A closed on 12th December 2024. Whilst we’re not completely removing the content - many posts will still be possible to view - we have locked both new posts and new replies. More details here.
Open Site Explorer
-
I have entered my site (patioenjoyment.com) a few different times into the OSE and it never seems to find it, MOZ has found it because it has done the crawl test for me a few times, found some issues and I have been working on those. But I assume that if it is able crawl my site it should find it to run the OSE. It has come back with "**It looks like we haven't discovered established link data for this URL yet." everytime. **
Thanks,
Julie
-
Hey Julie,
Thanks for writing in and sorry for the confusion. Our link index is not created using our crawl test or campaign crawls of a site. The index is actually a completely separate database compiled by crawling the web and following the links we find there. Your site will only be included in Open Site Explorer if we find links to your site from outside sources.
Just so you know, here's how we compile our index:
- We grab the most recent index.
- We take the top 10 billion URLs with the highest MozRank (with a fixed limit on some of the larger domains).
- We start crawling from the top down until we've crawled 90,000,000,000 pages (which is about 35% the amount in Google's index).
Therefore, if the site is not linked to by one of these seed URLs (or one of the URLs linked to by them in the next update) then it won't show up in our index. Most new sites and links will be indexed by our spiders and available in Mozscape and Open Site Explorer within 60 days, but some take even longer for many of reasons, including the crawl-ability of sites, the amount of inbound links to them, and the depth of pages in subdirectories.
As Pixelbypixel mentioned, Majestic SEO and Ahrefs often have a larger index than we do because their tools are exclusively focused on links, while we have a wide variety of tools with an overview of a site rather than on one specific aspect of SEO or marketing.
I hope this helps! Please let me know if I can help you with anything else.
Chiaryn
Help Team Ninja -
Hi Julie,
Rogerbot isn't as big as other bots so it takes him a little while to get about. did you make sure you gave him enough time?
Now if you really need to you can also try other sites like Majestic SEO & ahrefs to find links but again they will also need a bit of time (though i tend to find them a bit faster than OSE). Other things to remember is the more you links to a page the easier it is for it to be crawled so if you don't have any links on it it can take a bit longer too.
Hope that helps.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Unsolved Why am I not seeing search.yahoo.com in my site's backlink profile?
When looking at the backlinks for a client's competitor I found that they had a backlink on search.yahoo.com/reviews and our domain (harmonyhit.com) did not. I was using the Link Explorer tool. However, when I go to yahoo Search I see that the website of harmonyhit.com is indexed in Yahoo search and has links to the site. Also, it's sitemap has been recently crawled in Bing webmaster tools which Yahoo uses. Why does our client have the backlink accounted for and we do not?
Link Explorer | | DigitalThirdCoast0 -
My Website's Links Are Not Showing In Moz Link Explorer
Hello Team, I was analyzing my domain (https://www.amzonestep.com) in link explored but there are many websites that are not showing there. Questions
Link Explorer | | amzonestep
1. Is this reason website's DA is not increasing 2. Is there wrong steps taken by me for this website. Well, I know there are many factors work in increasing DA but what is should do if these kind on links are not indexing in MOZ. I things these are one of the factors my DA is not Increasing. Please save my job guys. The company has sent me an ultimatum mail of 2 months that they will take back the projects from me. Please save my job. Thanks & Regards Aashirvad Kumar moz.png Screenshot-2020-02-19-at-11.48.21-am.png0 -
How do you check for .gov and .edu backlinks using the new link explorer?
I'm trying to do an audit but I can't seem to figure out how to find .edu and .gov backlinks from the new link explorer. Can someone please help? I'm trying to learn how as open site explorer will be replaced by the link explorer. Thank you!
Link Explorer | | AFARiva1 -
REACT site and sitemap.xml
I have a REACT site www.nettheory.com. MOZ seems to only index the homepage but not all the internally linked pages, even the sitemap.xml is there. The reason I say that is the crawl result only shows the http and https version of the homepage, no other pages mentioned. I also noticed MOZ crawl results point out my content is very thin (<50 words). As a matter of fact, it has a lot more words if the JS runs correctly. Do we know if MOZ crawls REACT or JS based sites correctly?
Link Explorer | | NetTheory-Analysts0 -
Moz's new Link Explorer, including our revamped index and DA/PA scores is now open to everyone!
Hey Moz Community, Link Explorer is now open to the public! Everyone can access it via a subscription or a free Moz ‘Community’ account. As you may know by now, the brand-new Link Explorer tool is primed to replace Open Site Explorer as Moz’s link building and analysis tool. The Link Explorer project is the result of an incredible amount of perseverance and hard work by the team, and we’re proud to be able to finally share it with you — we know it’s going to revolutionize how you approach link building and make your job easier. You can read more about the tool here in Sarah Bird’s announcement post. Because Link Explorer improves on almost every aspect of Open Site Explorer, the metrics have improved, too. That means you’re likely going to see some Domain Authority and Page Authority discrepancies between OSE’s index and Link Explorer’s index. We definitely suggest you use the new DA/PA from Link Explorer, as they’re more accurate and refresh daily rather than monthly, as was the case with OSE’s index. However, we also realize that many of you use these metrics to report to your clients and colleagues, and a sudden change or fluctuation could potentially make your job harder. Which DA is the real DA? The new DA is based on a much larger index that has many improvements, several of which are designed to make the index more like Google’s than ever before. You should consider moving towards the new DA (and the old DA won’t be updated after April 26th 2018, so the sooner the better). While there will be fluctuations as we improve the model and add features to the index, we expect it to remain largely stable and to be a far more accurate picture of a site’s authority according to how it’s seen by Google. Why is Link Explorer’s DA/PA considered better than OSE’s, and which should I trust? The larger link index with improved crawl selection allows us to produce a stronger model that includes a much larger proportion of the web. That being said, DA and PA should always be considered in the context of your competitors. A drop in PA or DA relative to the old OSE is of little concern if your competitors saw similar movement. Is Domain Authority/Page Authority an absolute score or a relative one? Both DA and PA are relative to the Internet as a whole. If Facebook acquired a billion new links, everyone’s PA and DA would drop relative to Facebook. Because of this, it’s always best to look at PA and DA in comparison to your competitors. What does a drop/raise in DA mean in Link Explorer vs OSE? How can I explain this to my clients when I’m reporting it? DA and PA should always be considered in the context of your competitors. A drop or raise in PA or DA relative to the old OSE is of little concern if your competitors saw similar movement. Reporting that your site has moved from a DA of 45 to a DA of 42 doesn’t tell the whole story, but reporting that your site has a DA of 42 while your main competitor moved from a 43 to a 37 shows that, relative to the sites you’re competing against in the SERPs, your site has significantly more authority and ranking power. What’s happening to MozTrust and MozRank and why, and what should I replace those with? The improvements to our DA/PA and Spam Score metrics now now account for more important nuances in helping you determine one site’s ability to rank higher than another. Because they no longer correlate with Google’s ranking model as well as they used to, MozRank and MozTrust are being deprecated for better metrics. Users should rely on Page Authority, Domain Authority, and Spam Score to determine the importance and quality of pages, domains, and links. I have historical data I use to help my clients benchmark their progress. What do I do now that DA is calculated differently? You should annotate any KPI changes referencing the change in DA and PA. However, most importantly, you should compare those changes to your competitors, as this will best show how strong your site’s authority is relative to the sites you’re competing against in the SERPs. We take updating our metrics very seriously, and our last major update to the model was 7 years ago. Users of Domain Authority and Page Authority can expect us to continue to produce steady, reliable metrics for the long haul, and only make changes to these metrics when we believe the benefits dramatically outweigh the stability of the metric. Do you have any questions about the new metrics? Anticipating a tough time reporting changes to clients or bosses? Metrics, features or functionality missing that you would want to see? Let us know in the thread, and we’ll work to find a good answer for you. Hope you enjoy the new Link Explorer product and the amazing new link index powering it. We are very excited to provide this valuable data to our community and customers.
Link Explorer | | IanWatson9 -
What does "Number of Linking Root Domains" in Open Site Explorer actually mean?
I've read through the forum, but I'm confused as to what "Number of Linking Root Domains" means in the Linking Domains report. For example, if the root domain is Moz.com and the number is 135,000 does that mean there are 135,000 links from Moz pointing back to my site or does it mean there are 135,000 sites linking back to Moz? Any help is appreciated. Thank you!
Link Explorer | | karrabarron1 -
Spam Score and crawling of my site
Hello, I'm trying to analyze the spam score of my site which is 9/17 Actually I have few backlinks and all of them have a low spam score (max 4/17, just one). I think there's some kind of issue with the crawler since I get strange spam factors: Large Site with Few Links (likely true, I recently deleted a lot of tags used once) Low Number of Pages Found (wasn't it a "Large Site"??) Low Number of Internal Links (I got a considerable number) No Contact Info (I have a link to my facebook in the menu and a "contacts" page) Thin Content (It's just a blog with min 300 words per post, why thin?) Site Link Diversity is Low (likely true) Ratio of Followed to Nofollowed Subdomains (likely true) Low MozTrust or MozRank Score (true) Ratio of Followed to Nofollowed Domains (likely true) Can you please help me to understand it, is it a crawling problem or similar? If needed I will post the url of the website. Thank you so much Marco
Link Explorer | | MarcoBP0 -
Open site explorer
Hi, I am a little confused how open site explorer updates (not sure its working as aspected). It shows the recent discovered links but these then disappear and do not show in the main list (Inbound links) after a few days. Plus the links in the inbound links tab has not changed for nearly 10 weeks, my other tools are showing the new links..... Does it update on a certain data, if so where can i check the status? Thanks
Link Explorer | | 720digital0