Opensite Explorer Not Showing Link Root Domains correctly
-
Howdy Moz friends,
In opensiteexplorer It shows my linking root domains as 45. I have been adding several new links over the past few months from various websites but my linking root domain still remains the same. In the "just discovered" tool it has been showing my links but not in the linking root domain section.
Can anyone tell me what I'm missing?
Thanks
-
Hey Thomas,
Thanks for writing in with a great question. The Mozscape index, which powers Open Site Explorer, is actually a different system than the Just Discovered Links section. Just Discovered Links specifically crawls fresh news sources and blogs to find links that were updated recently, while the data for the Mozscape index is collected by a separate crawler that can take weeks to crawl the web based on the top 10 billion URLs with the highest MozRank. The data in the main section of Open Site Explorer can be collected several weeks prior to the index update while Just Discovered Links is collected constantly. While these to data sources aren't currently integrated, we are working to integrate them in the future.
Just so you know, here's how we compile our Mozscape index:
- We grab the most recent index.
- We take the top 10 billion URLs with the highest MozRank (with a fixed limit on some of the larger domains).
- We start crawling from the top down until we've crawled 90,000,000,000 pages (which is about 35% the amount in Google's index).
Therefore, if the site is not linked to by one of these seed URLs (or one of the URLs linked to by them in the next update) then it won't show up in our index. Sorry!
We update our Mozscape Index every 4 weeks. Crawling the entire Internet to look for links takes 2-3 weeks, but our crawlers are always in motion. When we need to start processing, we grab all the data they have collected and start processing which can take up to 3 weeks to determine which of those links are the most important. You can see our most recently updated schedule here: http://seomoz.zendesk.com/entries/345964-linkscape-update-schedule
Mozscape focuses on a breadth-first approach. Therefore we almost always have content from the homepage of websites, externally linked-to pages, and pages higher up in a site's information hierarchy. However, deep pages that are buried beneath many layers of navigation are sometimes missed and it may be several index updates before we catch all of these.
If our crawlers or data sources are blocked from reaching those URLs, they may not be included in our index (though links that point to those pages will still be available). Finally, the URLs seen by Mozscape must be linked-to by other documents on the web or our index will not include them.
I hope this information helps! While the site and links may not be indexed yet, give it some time - maybe we'll see it in OSE next month.
Chiaryn Miranda
Help Team Ninja
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
If we put the disavow links in google, does MOZ crawl the same links?
I have put bad or spam links in disavow file, but still showing in MOZ backlinks. So, I want to know that Why is MOZ not removing the spam links from their system?
Moz Bar | | insidewebanalytics0 -
How accurate is Moz Rank Tracker tool? It's showing different results than a Google incognito search.
I have a keyword/url combo with Moz Rank Tracker showing 3 spots above what a Google Incognito search showed. I performed my Google Incognito search based on these suggestions: https://moz.com/community/q/best-and-easiest-google-depersonalization-method Is the Moz Rank Tracker tool off?
Moz Bar | | chiefmoz1 -
Keyword Research Using K Explorer for Company with No Competitors
Hello, I'm doing keyword research for vapementors.com I'm trying to use Moz's Keyword Explorer to do keyword research for them, but it's tough. They have no real direct competitors. I typed in a lot of related keywords in KE but couldn't find anything real high traffic. So far I have just gave them a list that I extracted from a bunch of KE results, but they rank for most of them already and there wasn't a lot of insight from my list. What do you suggest? Thanks
Moz Bar | | BobGW0 -
Keyword Explorer is Now Live; Ask Me Anything About It!
Howdy gang - as you probably saw, we launched our biggest new tool in Pro in many years today: https://moz.com/explorer If you're a Moz Pro subscriber, you've already got access. We went ahead and gave folks who were at $99/month before today 300 queries/month. If you're signing up new, $99/month doesn't have KW Explorer access, but the other levels - at $149/month and above, do (5,000+ queries/month). You can read the blog post here for lots of details, but if you have questions or product suggestions, please don't hesitate to ask!
Moz Bar | | randfish14 -
Why is the exact same URL being seen as duplicate and showing an error in my SEO reports
Well, I am still having duplicate page issues. I have a question about one of the errors SEO is giving me when I download a crawl report. I am going to attach a screen shot of part of the report so you can see for yourself, along with explaining it here. SEO shows the list of URL's that it crawled in the report. In this(see attachment) portion of the report it has 321 results for the exact same URL. It also says all of these exact same URL's have received a 404 error. What I want to know is how does it make 321 results for the same URL? And with this error that I don't see when I look at the page? 0hkRDST
Moz Bar | | JoshMaxAmps0 -
Just discover link not show
Why just discover link not show of my website on open site explorer tool? when all links are shared by bitly then why links are not show?
Moz Bar | | surabhi60 -
Moz Crawl Showing Duplicate Content But It's Not?!
Unfortunately I can't give out the URL, but here's the deal... I have two URL's which have completely different content on them but are being crawled as duplicate content. Any Idea how that would happen? I'm not seeing any errors in WMT's. Has anyone seen this before? Is the duplicate content reporting based on a % of the page content matching as the same?
Moz Bar | | Swarm-SEO0 -
Open site explorer linking root domains
My company has been trying to increase the number of linking root domains for a specific page on our website using our PR company and press releases that are sent out and linked back to this page. This is working nicely, but the number of linking root domains is still not increasing under the "linking root domains" tab. I am noticing the correct links to this domain under "fresh web mentions" though. I know this tool can take a bit to update, but it has been quite some time and I still only see the one link.
Moz Bar | | isret_efront0