Does OSE crawl our site often? Or do we have an other problem? (internal links)
-
I am wondering if i can find out when OpenSiteExplorer crawled our entire website for the last time.
A few months ago we added some internal textlinks to all of our productpages. Those are links to the brandpage of that particular product. Some of our brands do have up to 1500 products, so there should be at least 1500 internal links pointing to that brandpage.But OSE still gives me a wrong count. It says there is only 1 internal link pointing to that brandpage.
Is it because OSE never crawled our site again? Or am i missing something here?(maybe too many internal links to one specific brandpage is not okay?)I'll hope you guys can help me out with this one.
-
Hi there!
For our inbound links, here is how we compile our index:
<code>- We grab the most recent index. - We take the top 10 billion URLs with the highest MozRank (with a fixed limit on some of the larger domains). - We start crawling from the top down until we've crawled 90,000,000,000 pages (which is about 35% the amount in Google's index).</code>
Therefore, if the site is not linked to by one of these seed URLs (or one of the URLs linked to by them in the next update) then it won't show up in our index. Sorry!
We update our Mozscape Index every 4 weeks. Crawling the entire Internet to look for links takes 2-3 weeks, but our crawlers are always collecting data. When we need to put the index together, we grab all the data they have collected and start processing which can take up to 3 weeks to determine which of those links are the most important. You can see our most recently updated schedule here: http://moz.com/products/api/updates
Mozscape focuses on a breadth-first approach. Therefore we almost always have content from the homepage of websites, externally linked-to pages, and pages higher up in a site's information hierarchy. However, deep pages that are buried beneath many layers of navigation are sometimes missed and it may be several index updates before we catch all of these.
If our crawlers or data sources are blocked from reaching those URLs, they may not be included in our index (though links that point to those pages will still be available). Finally, the URLs seen by Mozscape must be linked-to by other documents on the web or our index will not include them.
For now, the best thing you can do to help your domain become indexed is to work on link building for links from sites with high mozrank.
Hope this helps clear things up!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Unsolved Moz link explorer is how much reliable and accurate as compared to others link explorer tools like Ahref
Hi.. I need to check backlinks for one of my client website duplicatebills through Moz Pro link explorer tool then its show that linking domain to this website are 90 but when i cross check these links from other tools like Ahref free backlinking tool then its show a different figure (ahref show that linking domain to this website are 103).
Link Explorer | | dbills
I am confused that which one correct. And MOZ link explorer tools in reliable to which extent?0 -
My backlinks are not indexing , Added in the link tracking list too
I have waited for three days to index my backlinks on moz but still they are not indexed in moz backlink index 😞 How to index backlinks in moz so that I can track all are ok ?
Link Explorer | | esdda81111 -
What steps should I follow after submitting disavow link list?
Hey Moz Team, This is Devesh Srivastava, you can call me Dev.
Link Explorer | | nikh26
Recently there was an update from your side and that was pretty good. I have analyzed model factors regarding Moz 2.0. Though my DA score has been down to 36 from 52, I would still say that an update was really necessary. I have some questions which require some clarification or you can say a proper solution.
As of now, I have removed all the Spam links which were coming to my website (https://edugorilla.com) and I have submitted the disavow list to GSC but I would like to know how should I begin my link building strategy keep everything in mind. And now that, I have removed those spam links how would Moz or how should I tell Moz or Google that those have been removed so how soon can I get back to my previous DA score? I am very much confused with the link building strategy now. What steps should I follow after submitting a disavow list and would Moz stats will change after Google Disavowing those links? Can anyone answer my question?1 -
Help needed interpreting inbound link analysis please
Hi I am trying to determine how effective our store blog is and am trying to analyse the inbound links it provides to our store domain but am confused with the results, can anyone help please? For information the blog is on a subdomain of the store site, has plenty of relevant original content, and has been regularly updated over several years in line with basic Yoast SEO best practice. When I look at analysis of inbound links and linking domains for the store site in Moz Pro, the blog subdomain does not show as providing any inbound links. Google Search Console shows similar results, with no inbound links to the store domain showing from the blog subdomain in either 'search traffic > links to your site', or 'search traffic > inbound links'. Open Site Explorer for the store domain also shows no inbound links from the blog subdomain to the store with 'link source > only external' selected. But if I change to 'link source > only internal' then all of the inbound links from the blog subdomain to the main store that I would expect to see appear. Should I be concerned by the fact I can only find these inbound links under this one specific search and not in any of the others? Does this suggest a problem in the passing of any current and future SEO benefit from subdomain blog to main domain? Or should I not worry about it too much? I am looking to begin a full overhaul of all SEO for the store and blog from the ground up and want to be sure the connections between the blog subdomain and store are functioning properly before I start. Any help in unpicking this would be really appreciated Thanks very much
Link Explorer | | Warren_330 -
Root domains that link to the URL or domain
Hello Everyone, I need help understanding how does Moz linking root domains work. My website shows 73 domain pointing backlinks to my domain in google webmaster where on Moz Linking domain it only shows 18 domian. Any help on how this works. Thanks in advance. Sagar
Link Explorer | | wolfeyes1 -
Why is OSE showing a higher Domain Authority than Moz?
Moz has today run monthly reports for 2 of my clients' sites. For both of these, the Domain Authority reported on the Moz dashboard is several points lower than that shown by OSE today for the same sites. Why would that be?
Link Explorer | | mfrgolfgti0 -
Why does OSE only show top 25 pages in Top Pages for Social Metrics?
Any way around this? Would like to find out the top social pages for a site. thx
Link Explorer | | IsHot0 -
Why does OSE & Moz Q&A sections not work for me in Chrome any more?
A few weeks ago I started seeing instances of OSE not showing all the information when it was showing I was logged in while using Google Chrome. It would work, then not work and kept showing me the button to sign up for Moz Analytics even though I was logged in. I'm a Pro Member, which is confusing. Then I noticed that while logged in, I would be logged out somehow when trying to contribute to the Q&A's and it would bounce me back to the Moz Home page or show me the white Login button in the upper right. Again, in Chrome only. I was told by support to clean my cookies/cache and that works for maybe a few hours, but then would resort back to logging me out. It has become very annoying, and now can only work logged in from FireFox. Not a huge issue, but everything else I do all day is in Chrome. Is anyone else having this same issues? Any recommendations? Thanks in advance. - Patrick
Link Explorer | | WhiteboardCreations0