Opensite Explorer Not Showing Link Root Domains correctly
-
Howdy Moz friends,
In opensiteexplorer It shows my linking root domains as 45. I have been adding several new links over the past few months from various websites but my linking root domain still remains the same. In the "just discovered" tool it has been showing my links but not in the linking root domain section.
Can anyone tell me what I'm missing?
Thanks
-
Hey Thomas,
Thanks for writing in with a great question. The Mozscape index, which powers Open Site Explorer, is actually a different system than the Just Discovered Links section. Just Discovered Links specifically crawls fresh news sources and blogs to find links that were updated recently, while the data for the Mozscape index is collected by a separate crawler that can take weeks to crawl the web based on the top 10 billion URLs with the highest MozRank. The data in the main section of Open Site Explorer can be collected several weeks prior to the index update while Just Discovered Links is collected constantly. While these to data sources aren't currently integrated, we are working to integrate them in the future.
Just so you know, here's how we compile our Mozscape index:
- We grab the most recent index.
- We take the top 10 billion URLs with the highest MozRank (with a fixed limit on some of the larger domains).
- We start crawling from the top down until we've crawled 90,000,000,000 pages (which is about 35% the amount in Google's index).
Therefore, if the site is not linked to by one of these seed URLs (or one of the URLs linked to by them in the next update) then it won't show up in our index. Sorry!
We update our Mozscape Index every 4 weeks. Crawling the entire Internet to look for links takes 2-3 weeks, but our crawlers are always in motion. When we need to start processing, we grab all the data they have collected and start processing which can take up to 3 weeks to determine which of those links are the most important. You can see our most recently updated schedule here: http://seomoz.zendesk.com/entries/345964-linkscape-update-schedule
Mozscape focuses on a breadth-first approach. Therefore we almost always have content from the homepage of websites, externally linked-to pages, and pages higher up in a site's information hierarchy. However, deep pages that are buried beneath many layers of navigation are sometimes missed and it may be several index updates before we catch all of these.
If our crawlers or data sources are blocked from reaching those URLs, they may not be included in our index (though links that point to those pages will still be available). Finally, the URLs seen by Mozscape must be linked-to by other documents on the web or our index will not include them.
I hope this information helps! While the site and links may not be indexed yet, give it some time - maybe we'll see it in OSE next month.
Chiaryn Miranda
Help Team Ninja
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Keyword Explorer - Unable to complete searches for data?
Hey guys, I'm in the process of completing some keyword research using Keyword Explorer but every time I complete a search I'm told that explorer is unable to perform the search at this time and that I should refresh the page, or search with a new query. Is anyone else having this issue/had this problem in the past?
Moz Bar | | daniel-brooks0 -
Is there any way to automatically filter negative keywords out of Keyword Explorer results?
I use Keyword Explorer a LOT for fleshing out new campaigns. However, the results I get frequently contain queries with words that are in my negative keyword lists. Today, I solve this with export and some Excel wizardry but keep thinking how convenient it would be if there was a way to provide a list upfront of negative keywords and get pre-scrubbed results. Does this exist? If not, how can I escalate this as a feature request? 🙂
Moz Bar | | ngowdy1 -
Turn off Pagination in Keyword Explorer results?
In the keyword suggestions of Keyword Explorer, is there a way to switch from paginated results back to results loading on one page? I used to be able to scroll down and have additional results load when I reached the end of the page.
Moz Bar | | watchandlearn0 -
External links that don't exist
I did a crawl test and it shows that there are 2215 external links on my home page here: https://www.playshakespeare.com An "External Link" is defined here: https://moz.com/researchtools/crawl-test "Number of links on a page that point to a page that is not on the same domain as that page." There are NOT 2215 external links on that page. There are only a handful at any given time. Why is the crawl test reporting thousands over that?
Moz Bar | | playshakespeare0 -
I have 3 domains with deffrent TLD and convert them to .com domaim why spam score show 9/17 for them
My other domains (.net - .org) was redirect by 301 redirection domain.net domain.org redirect to domain.com then i show 9/17 flag spam score please if there any problems just tell me . my website: arabbus.com xnnnTCj.png
Moz Bar | | mahmoudsamy3600 -
Is it normal for my homepage's page authority to be higher than my domain authority?
Hi everyone, I've just been checking my MOZ authority scores, and the page authority of my home page, www.concerthotels.com is 53 (mozRank of 6.16) which seems pretty good to me. However, the domain authority is only showing as 45. Is this typical? There is such a big difference between these two scores - what does that suggest? Is there anything obvious that I can do to bring the domain authority up to the level of authority that the homepage commands? Similarly, the UK version of my site has a homepage authority of 41, but the domain authority is only 30. Looking at numerous other websites, quite often the homepage and domain authority scores are very similar, or the domain authority is slightly higher, so it does look as if this is unusual. Any comments would be greatly appreciated, Many thanks Mike
Moz Bar | | mjk260 -
Tracking a domain with multiple locations
Esteemed Marketers of the Moz community, We'd like to track a domain that has a separate web presence for specific locations. In other words, the business has multiple locations in NJ and one in NYC. Any tips and tricks to track how we're doing in the rankings for both NJ and NY? Thanks Much, Paul
Moz Bar | | brainrainmedia1 -
Why do my top linking domains according to Webmaster tools, not even appear in my OSE report?
I know the Google index is obviously a lot larger than the MOZ index...but.... I have 8,000 links from blogspot.com according to Webmaster tools, and just one link according to OSE I have 600 links from an online dictionary according to Webmaster tools, not one is mentioned in my OSE report. I'd go so far as to say most of my top 10 linking domains according to Webmaster Tools, don't even have a single mention in my OSE report. We've been hit hard by Penguin 2.0 and I want to look at our link profile.....it seems OSE may be great for looking at my competitors link profiles, but for my own site it seems to be, well, not very accurate at all! So from a trying to do undo the damage caused by Penguin 2.0 point of view, should I just use webmaster tools and forget about OSE? Thanks!
Moz Bar | | MarbellaSurferDude0