Internal Equity-Passing Links not getting crawled in Moz Open Site Explorer?
-
Internal Equity-Passing Links not getting crawled in Moz Open Site Explorer. What is the cause of this? We've checked the robots.txt and htaccess file, but so far we can't find anything that would be blocking Moz from crawling the internal links. We manage loads of other clients on this platform and this is the first time we've run into this issue. What else can I check?
-
Thanks for your response! We've had this particular client in the Open Site Explorer for several months now, so I'm not sure if the time it takes to index is the issue. I've attached a screenshot of what we see and what we share with out clients. It looks like all of the other metrics are being gathered correctly, it's just internal links that aren't working. Are there any possible causes for this?
-
Hi there!Thanks so much for the question! Open Site Explorer is powered by our Mozscape index which is still growing with each index. Most newer sites are indexed within about 60 days but some take longer- this can be dependent on quite a few different factors. When we collect link data, we look for the most valuable links so this means we may not crawl your entire site or every site. We do this by starting our crawler on a few high ranking sites and then have it perform a breadth first search to see what it finds. This means we may not immediately find links which are farther down in the hierarchy of your site.I hope this helps! If you have any other questions or if you would like us to look into this further, feel free to send us a note at help@moz.com and we’ll be happy to take a look! We'll just need to know the link for the site you're working with.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Unsolved Google results linking domains
When I check the linking domains of a root domain, a lot of Google results from other countries appear. Does this mean all of these domains are linking to my root domain? Can anybody explain this and tell me if this can be seen as spam or not? linking-domain-moz.png
Link Explorer | | dirkjandirkjan02 -
Moz Crawl Issue?
So I've been looking over my latest crawl and two of each category appears, the only difference between them is a / at the end, i.e. http://thespacecollective.com/space-clothing/ http://thespacecollective.com/space-clothing One brings in a 200 code while the other brings in a 301. Given that the 301 is in place I know Google won't see it as a duplicate, but I'm curious as to why Moz picks up on this and whether or not there is an issue that needs addressing here?
Link Explorer | | moon-boots0 -
Open Site Explorer -> Just Discovered -> Internal Links: Only shown 1 url link per day
Hi, We have a page that have like 10-15 new content/pages per day.
Link Explorer | | Inspiringinterns
eg. domain.com/post-id-01/, omain.com/post-id-02/, omain.com/post-id-03/ etc
But somehow, under Just-Discovered, internal links only show 1 per day when it suppose to display like 10-15.
The layout for each pages is exact same except for the content changes and the url's ID changes. Our competitor on the other hand, they have like 5 new page per day, but somehow Moz shows their internal links as 25 per days. Each of their new url have 4 more prefix number.
Eg:
new-page-01?track=990
new-page-01?track=991
new-page-01?track=992 etc
The above example url is technically as 1 page if without the "?" affix. Whiles all our new pages/url have unique id, but Moz only show 1 a day. Please advise on how to get Moz to shows all the new pages in Just-Discovered (internal link). Thanks, Cam0 -
Root domains that link to the URL or domain
Hello Everyone, I need help understanding how does Moz linking root domains work. My website shows 73 domain pointing backlinks to my domain in google webmaster where on Moz Linking domain it only shows 18 domian. Any help on how this works. Thanks in advance. Sagar
Link Explorer | | wolfeyes1 -
Not existing domains linking to my website (spam)
Hello, When i run my platform www.taobao.nl through https://moz.com/researchtools/ose/ i see a lot of nasty adult domains that link to my platform. These give a very negative (spam)score to my platform. I already disavowed quite a few via Webmastertools, but they keep coming. When i check the names in the Whois, they don't even seem to exist! (anymore) What could cause this and how can i end it?? Thanks for your help! Sander
Link Explorer | | benhond1 -
Internal links - OpenSiteExplorer vs Webmaster tools
Hi guys, I run Opensiteexplorer on the website www.fazland.com (in italian...). (https://moz.com/researchtools/ose/comparisons?site=www.fazland.com) It only shows ca 240 internal links where I know there are plenty more also shown in Google Webmaster Tools. I cannot figure out why it can crawl so few links - Google shows 79.000 links found and internal links are pretty well established. Any suggestions from your experience on this difference? Cheers, Rob
Link Explorer | | r.bonsanti0 -
When requesting a CSV for an internal 302 redirect report, the data isn't aligning with the UI. Does anyone have any suggestions?
When requesting a CSV for an internal 302 redirect report, the data isn't aligning with the UI. Does anyone have any suggestions?
Link Explorer | | Merkle-Impaqt0