How Is a Page Crawled by Moz When Moz Says 'No Links'?
-
As above, really. I've crawled a new client's site to find the Moz crawler has identified a handful of 404 errors.
The Moz crawler says these pages have '0 linking domains', and OSE has no data for these pages.
So how are these pages being crawled by Moz and what should I advise my client?
-
Thanks again, Peter.
-
That's great, thanks Keri.
-
Hi, no problem. Keri has answered your query re the Moz crawler not finding them.
Peter
-
If you download the CSV report, we list the referring page there. We know it isn't obvious and we're working on making this a little easier to find.
-
Hi Keri,
Thanks for getting back to me (thanks to Peter above, also).
So what is the best way of me finding where these 404 pages are linked from?
I am 99% sure they are internal links that I will ask the client to remove, but would like to avoid manually checking every link on the site if possible.
-
Hi Peter,
I searched for their domain name and about the expected number of results came up.
I searched for these individual URLs that Moz is reporting using the site: command, and they were not returned.
They are also neither in the site's sitemap (HTML page or XML file).
So how is SEOmoz Crawler finding them?
-
We have two completely different crawling systems. We have on crawler for your website, where you enter in your URL and we crawl your site looking for problems. We have a different crawler for OSE that goes and looks at the web in general and crawls for links. The two crawlers do not talk to each other, so it is actually understandable that OSE may not have data on the site. OSE doesn't have the same index size as Google, so we don't see all the links that are actually out there (though we're working all the time on improving this!).
-
Hi, if you put site:xxx.com into Google where xxx.com is your client's domain name, does Google report anything?
Peter
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Moz isn't crawling all my backlinks.
Moz isn't crawling all my backlinks. It's showing only 29 referring domain when I have more than 200 referring domains linking to my website. My website URL is 360gisthub.com.ng 360gisthub.com.ng
Link Explorer | | Mustybay0 -
Top Pages report
The Top Pages report only includes the Title tag. Is there any way to also include the meta-description, and and tags? I generated a Top Pages report and was surprised to see that it also includes image files. How come?
Link Explorer | | MedicalSEOMarketing0 -
Moz crawling http rather than https site
Our site is secure but when I ask moz to crawl it by giving the root domain including https moz insists on crawling the non secure version. How do i force it to crawl the secure version?
Link Explorer | | media12340 -
Can I check outbound links from a website?
Hi! Is there an easy way to check if a certain domain has a link to my domain. Is there something similar to "checking outbound links" on a website?
Link Explorer | | AnnabelH0 -
Weekly and other data not available in moz tools
Dear All, Since last few days we are not getting updated results in moz tools. We get following warnings in the pages. "Hello! Weekly data for some campaigns is a bit behind schedule. Don't worry; it's processing now and will be available soon. Check out http://health.moz.com for the latest status on all of our tools. And thanks for your patience!" How much time it will take to show us the current results, so that we can properly work on it. Right now we are not able to measure any changes affected our site. Thanks, Om
Link Explorer | | omverma0 -
Why I am not seeing any inbound link to my website?
While using the Open Site Explorer tool, I don't get any resultfor Inbound Links, while with other services and the Webmaster Tools I can see which websites are linking to mine. What I can do to see these results here on the MOZ analytics software? The website is http://b5footballcup.com Thanks for the support. Luca
Link Explorer | | lucab50 -
My linked in profile is showing up the opensite exploer but not showing up in on page grader, any ideas why? the onpage grader says in url is in accessible
my linked on company profile ios not showing up in the on page grader tool, it return un accessible uRL? but we give me metrics in domain checker? its a new profile i set up about 8 hours ago,
Link Explorer | | maxmxmax0 -
Confused about the link metrics showing up in MOZ & OSE
For my campaign "itelligence Applications" which is for site itelligencegroup.com/uk/ - MOZ seems to be giving me different stats on links, depending on which tab I look it in the Link Analysis section. Then when I look at OSE, the numbers are totally different again, not just a little bit different. Example: In MOZ Link Analysis, on the "inbound links" tab, it says there are 129 Root Domains and 6832 Total External Inbound Links. If I then look at the Competitive Metrics screen, it says there are 46,284 external followed links and 240 total linking root domains. If I then go to OSE for the same site, it says there are 14 Root Domains and 686 total links. I have no idea why these numbers vary so much or how to even report them to my client. Am I missing something here? Any help would be gratefully received! Maureen
Link Explorer | | mfrgolfgti0