Opensite Explorer Not Showing Link Root Domains correctly
-
Howdy Moz friends,
In opensiteexplorer It shows my linking root domains as 45. I have been adding several new links over the past few months from various websites but my linking root domain still remains the same. In the "just discovered" tool it has been showing my links but not in the linking root domain section.
Can anyone tell me what I'm missing?
Thanks
-
Hey Thomas,
Thanks for writing in with a great question. The Mozscape index, which powers Open Site Explorer, is actually a different system than the Just Discovered Links section. Just Discovered Links specifically crawls fresh news sources and blogs to find links that were updated recently, while the data for the Mozscape index is collected by a separate crawler that can take weeks to crawl the web based on the top 10 billion URLs with the highest MozRank. The data in the main section of Open Site Explorer can be collected several weeks prior to the index update while Just Discovered Links is collected constantly. While these to data sources aren't currently integrated, we are working to integrate them in the future.
Just so you know, here's how we compile our Mozscape index:
- We grab the most recent index.
- We take the top 10 billion URLs with the highest MozRank (with a fixed limit on some of the larger domains).
- We start crawling from the top down until we've crawled 90,000,000,000 pages (which is about 35% the amount in Google's index).
Therefore, if the site is not linked to by one of these seed URLs (or one of the URLs linked to by them in the next update) then it won't show up in our index. Sorry!
We update our Mozscape Index every 4 weeks. Crawling the entire Internet to look for links takes 2-3 weeks, but our crawlers are always in motion. When we need to start processing, we grab all the data they have collected and start processing which can take up to 3 weeks to determine which of those links are the most important. You can see our most recently updated schedule here: http://seomoz.zendesk.com/entries/345964-linkscape-update-schedule
Mozscape focuses on a breadth-first approach. Therefore we almost always have content from the homepage of websites, externally linked-to pages, and pages higher up in a site's information hierarchy. However, deep pages that are buried beneath many layers of navigation are sometimes missed and it may be several index updates before we catch all of these.
If our crawlers or data sources are blocked from reaching those URLs, they may not be included in our index (though links that point to those pages will still be available). Finally, the URLs seen by Mozscape must be linked-to by other documents on the web or our index will not include them.
I hope this information helps! While the site and links may not be indexed yet, give it some time - maybe we'll see it in OSE next month.
Chiaryn Miranda
Help Team Ninja
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Outbound 404 Links
My blog goes back to 2005 and occasionally I find outbound links on old posts that now generate a 404 error. Is there a Moz tool that can find and report on such errors? If not, are there other tools you can recommend?
Moz Bar | | btreloar0 -
Can Moz Keyword Explorer help target keywords for Google Images results?
I'm wondering if I can use Keyword Explorer (or maybe another tool?) to target keywords for image rankings. I'd like to play around with optimizing images so that they appear in search results and thus provide traffic - but wasn't sure the best way to track that kind of progress. My ultimate goal is to analyze the difficulty of ranking for a certain keyword via Google images. (I do know to optimize alt tag/title tag/place in relevant article etc, but wanted to know if I could research the difficulty). Any help is much appreciated. Thanks!
Moz Bar | | naturalsociety0 -
Changed Domains and Internal Links haven't followed, Old Domain redirects to new domain
On our domain residentiallandlord.com we are a little confused on the Compare Link Profiles option,I'm wondering if you can helpWe changed our domain a few years back and have our old domain redirected to our new domain.On our new domain we have only internal links visible, https://residentiallandlord.com/wp-content/uploads/2018/06/moz-rl.com.pngbut if you look at our old domain, which goes to our new domain it has loads of internal links, even though there is no physical site on this domain as it redirects to our new one, https://residentiallandlord.com/wp-content/uploads/2018/06/moz-rl.co.uk.png Can you help me understand why no internal links are showing for the new domain and how to fix this.
Moz Bar | | karlh19740 -
Keyword Explorer how can I uncover all phrases relating to a single keyword?
From what I can see in Keyword Explorer you cannot enter a single keyword and uncover all search phrases that include this word. Or at least when I try to "Display keyword suggestions that" and select "only include keywords that contain all the query terms" and then enter a keyword. I cannot find a phrase in the list even when I can find it via a different search when if I type it directly.
Moz Bar | | GrouchyKids0 -
Keyword Explorer - Unable to complete searches for data?
Hey guys, I'm in the process of completing some keyword research using Keyword Explorer but every time I complete a search I'm told that explorer is unable to perform the search at this time and that I should refresh the page, or search with a new query. Is anyone else having this issue/had this problem in the past?
Moz Bar | | daniel-brooks0 -
Turn off Pagination in Keyword Explorer results?
In the keyword suggestions of Keyword Explorer, is there a way to switch from paginated results back to results loading on one page? I used to be able to scroll down and have additional results load when I reached the end of the page.
Moz Bar | | watchandlearn0 -
How does it work Fresh Web Explorer Mention Tool?By given information is right or wrong?
Fresh Web Explorer Mention Tool show two new brand mention urls on my campaign dashboard but i have checked through this urls we don't have any brand and keywords related to my campaign in this urls. So, why it is mentioned that "you have new brand mentions" in this url? Kind for information i have mentioned those urls when show my brand: http://www.slideshare.net/acoleman2/principles-of-micro-economics http://www.scribd.com/doc/237030746/Children-s-Spaces
Moz Bar | | surabhi60 -
Moz showing warnings for each dynamic link despite canonicalization?
As you can see in the attached image, Moz is showing a warning for each dynamic URL despite a rel=canonical tag. Is this by design? If so, it is frustrating seeing as it is really just the one page with many links . . . 9h5oDmr.png
Moz Bar | | BlueLinkERP0