How Is a Page Crawled by Moz When Moz Says 'No Links'?
-
As above, really. I've crawled a new client's site to find the Moz crawler has identified a handful of 404 errors.
The Moz crawler says these pages have '0 linking domains', and OSE has no data for these pages.
So how are these pages being crawled by Moz and what should I advise my client?
-
Thanks again, Peter.
-
That's great, thanks Keri.
-
Hi, no problem. Keri has answered your query re the Moz crawler not finding them.
Peter
-
If you download the CSV report, we list the referring page there. We know it isn't obvious and we're working on making this a little easier to find.
-
Hi Keri,
Thanks for getting back to me (thanks to Peter above, also).
So what is the best way of me finding where these 404 pages are linked from?
I am 99% sure they are internal links that I will ask the client to remove, but would like to avoid manually checking every link on the site if possible.
-
Hi Peter,
I searched for their domain name and about the expected number of results came up.
I searched for these individual URLs that Moz is reporting using the site: command, and they were not returned.
They are also neither in the site's sitemap (HTML page or XML file).
So how is SEOmoz Crawler finding them?
-
We have two completely different crawling systems. We have on crawler for your website, where you enter in your URL and we crawl your site looking for problems. We have a different crawler for OSE that goes and looks at the web in general and crawls for links. The two crawlers do not talk to each other, so it is actually understandable that OSE may not have data on the site. OSE doesn't have the same index size as Google, so we don't see all the links that are actually out there (though we're working all the time on improving this!).
-
Hi, if you put site:xxx.com into Google where xxx.com is your client's domain name, does Google report anything?
Peter
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
How Does Moz Spam Score Increase and Decrease?
Hello Moz Community, I'm facing spam score issue on my site General Queen according to MOZ my website spam score is 30% but anybody can explain how can i decrease it? Firstly I disavowed all low-quality and high spam score links (6 months ago) but my spam score was not decreased after that I created some high-quality and 0 spam score backlinks but still, my spam score is same 😞 According to Moz link explorer, my domain backlinks spam score ratio was below; Stats of 14 July 2019 .. Screen shot is attached 1-30% .. 45.3%
Link Explorer | | BloggerSEObd
31-60% .. 32.1%
61-100% .. 22.6% Stats of 13 June 2020 .. Screen shot is attached 1-30% .. 65.1%
31-60% .. 30.7%
61-100% .. 4.2% You can see a huge difference in the backlinks spam score in it. But why my spam score is still 30%? Looking forward to your reply. Thanks & Regards, abu1NiB XGLkr5z1 -
Different results when running spam score tests with and without www in moz
Hey, can anyone help with this? I am receiving extremely different results running spam score tests with and without www in moz.
Link Explorer | | DarkoA
No www - is getting a spam score 8
And with www. is 1. Should I be worried here, and how should I move to handle this? Thanks in advance guys1 -
Will Moz move DA from an old domain to the new?
Hi folks, I'm moving a digital magazine of mine, which has a great deal of authority (DA53!) to a new domain, which is much more brandable. I'm curious if Moz ever passes the actual DA/PA numbers to the new domain. Does the tool pick this up, eventually? I know once the domain is switched, DA will show a "1" -- as the domain is brand new, technically. This is NOT a question about authority/link juice being passed, but rather the numbers being displayed by Open Site Explorer. Some authors do look at Moz DA as an indicator of a sites "power" before applying for authorship, so I'm trying to find a way to move to a more brandable domain, while keeping the OSE stats in place. If it's not possible, I'll have to live with it 🙂 Any input? Thanks everyone!
Link Explorer | | avilawebfirm0 -
Internal links - OpenSiteExplorer vs Webmaster tools
Hi guys, I run Opensiteexplorer on the website www.fazland.com (in italian...). (https://moz.com/researchtools/ose/comparisons?site=www.fazland.com) It only shows ca 240 internal links where I know there are plenty more also shown in Google Webmaster Tools. I cannot figure out why it can crawl so few links - Google shows 79.000 links found and internal links are pretty well established. Any suggestions from your experience on this difference? Cheers, Rob
Link Explorer | | r.bonsanti0 -
External link numbers down year on year
Hi, Just wondering if anyone knows why a website that has definitely had some links acquired over the last year would now show less links and from fewer referring domains than they had this time last year? How is that possible - assume it is down to the way OSE / Moz crawl the web and collect data but need a definitive explanation for a client that has noticed the drop in link metrics and as a result authority. Many thanks,
Link Explorer | | lollowe0 -
Why does OSE only show top 25 pages in Top Pages for Social Metrics?
Any way around this? Would like to find out the top social pages for a site. thx
Link Explorer | | IsHot0 -
Open Site Explorer not detecting linking domain on my site
So I was using Open Site Explorer to analyze my domain authority and page authority as can be seen here. My site has been covered by some press and in the article it actually links my site. Some of the articles can be seen on, here, here, and here. Any idea why none of these articles are detected as a linking domain to my site? Is there something that I am doing wrong?
Link Explorer | | herlamba1