How Is a Page Crawled by Moz When Moz Says 'No Links'?
-
As above, really. I've crawled a new client's site to find the Moz crawler has identified a handful of 404 errors.
The Moz crawler says these pages have '0 linking domains', and OSE has no data for these pages.
So how are these pages being crawled by Moz and what should I advise my client?
-
Thanks again, Peter.
-
That's great, thanks Keri.
-
Hi, no problem. Keri has answered your query re the Moz crawler not finding them.
Peter
-
If you download the CSV report, we list the referring page there. We know it isn't obvious and we're working on making this a little easier to find.
-
Hi Keri,
Thanks for getting back to me (thanks to Peter above, also).
So what is the best way of me finding where these 404 pages are linked from?
I am 99% sure they are internal links that I will ask the client to remove, but would like to avoid manually checking every link on the site if possible.
-
Hi Peter,
I searched for their domain name and about the expected number of results came up.
I searched for these individual URLs that Moz is reporting using the site: command, and they were not returned.
They are also neither in the site's sitemap (HTML page or XML file).
So how is SEOmoz Crawler finding them?
-
We have two completely different crawling systems. We have on crawler for your website, where you enter in your URL and we crawl your site looking for problems. We have a different crawler for OSE that goes and looks at the web in general and crawls for links. The two crawlers do not talk to each other, so it is actually understandable that OSE may not have data on the site. OSE doesn't have the same index size as Google, so we don't see all the links that are actually out there (though we're working all the time on improving this!).
-
Hi, if you put site:xxx.com into Google where xxx.com is your client's domain name, does Google report anything?
Peter
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Unsolved Looking for someone from Moz to comment on unrealistic spam score
Two years ago I bought domain name aroundtheworldwithme.com as a travel blog. I built the site up slowly and currently have a DA of 28 with decent Google search results. However, according to Moz my spam score is 43%. I am convinced that something funny is going on to give me this spam score. I have gone though all 27 factors that play into the spam score in great detail. I only fail a few of the checks. These are the Double Click Tag, LinkedIn profile, phone number, email, and Facebook Pixel. Which as far as I know, literally zero travel blog websites provide this info. So I am on par with evert other travel blog website. Now I know Moz will say this "doesn't mean your website is spam, just that our algorithm found that websites with similar attributes are spam." But this is completely bogus. All similar websites to mine have spam scores of 1-2%. All other websites I see with spam scores over 40% are literally spam websites. Why am I literally the only legitimate travel blog site that has a spam score over 40%? My backlink profile is similar to all other travel blogs. I actually have less spammy links as most, as I haven't been around too long. So I don't think my backlinks are causing the high spam score. The only thing I can think of is that my domain name used to be owned by someone else. I have a lot of backlinks from a random blog website that were discovered in 2018, three years before I bought the domain. Is it possible that the domain used to be an actual spam site name and I am now being punished for that? If not, then I cannot think of anything that would cause my high spam score other than fundamental defects in the Moz spam score algorithm. Something is going on, and I'd love someone from Moz to actually be able to have a look at my website and tell me why I have such a high spam score. I know Google doesn't care about Moz's spam score (thankfully) but other websites don't want links from me due to my completely bogus spam score. Thanks everyone
Link Explorer | | Heckmantis
aroundtheworldwithme.com0 -
Link Explorer Is not working
My Links Explorer is not working, Does anybody has the same issue? Note Also, why do I have to open an account imgur.com to upload a screenshot to fix a problem of MOZ tool Help with Moz Products & Tools on the question categories does not show the option for Link Explorer
Link Explorer | | Roman-Delcarmen2 -
How can I tell what pages have links TO this page?
Hello, Mozzers! My client has a rather messy situation, with redirects for HTTP vs. HTTPS, and two different home pages, both in subdirectories. I could explain the whole setup, but I don't think it's relevant for my question, which is this: OSE is showing three links to the page in question, but doesn't tell me WHAT those links are. Am I just missing the information somewhere? Please see screenshot for details. Thanks so much! ~ Scott view?usp=sharing
Link Explorer | | measurableROI0 -
Why is moz telling me I have duplicate content, but neither the content nor the urls are duplicates?
I just upgraded our website to a new one. This is the first crawl of the new website. It is telling me I have 24 Critical issues, all of which are duplicate content errors. Thing is, the urls are not duplicates and the content on the page is not duplicated either. Example, here is one error where it says there are two duplicates: <colgroup><col width="595"></colgroup>
Link Explorer | | damon1212
| http://winterguardtarps.com/portfolio-item/props-10 |
| http://winterguardtarps.com/portfolio-item/props-2 |
| http://winterguardtarps.com/portfolio-item/props-7 | There are photos in our portfolio, and none of them are the same. I'm a bit of a noob, but what am I missing here?0 -
How is Moz Page Authority Calculated?
Can anyone refer me to a document that explains the measures that go into the calculation of Moz Page Authority? I'm chiefly interested in what counts and what doesn't -- follow links, no-follow links, internal and external, what (if any) on-site factors, etc.
Link Explorer | | GlennFerrell0 -
Question in regards to Comparing Metrics with MOZ tools
Hi all! After using the "Compare Links Metrics" in the research tools, a few questions popped up. Particularly, in regards to what key metrics to look for when determining if a websites outbound links are trustworthy and may pass Link-juice. Basically, "if my link is put on that website, will search engines trust it"? I've copied an example below and typed a few comments next to particular metrics. Please share some insight them: Page Authority: 48 Page MozRank: 4.94 -Is 4.94 considered OK? Page MozTrust: 4.96 -Is 4.96 considered OK? Internal Equity-Passing Links: 2,819 External Equity-Passing Links: 2,326 -Lower = better? Total Equity-Passing Links: 5,145 Total Internal Links: 2,844 Total External Links: 2,383 - Lower = better? Total Links: 5,227 Followed Linking Root Domains: 88 Total Linking Root Domains: 129 Linking C Blocks: 30 Equity-Passing Links vs
Link Explorer | | 90miLLA
Non-Equity-Passing Links:** I am assuming that the higher the Non-equity passing links VS the Equity passing links is typically better? What would be an idea ratio?** Internal Links vs
External Links: Lower external = better?0 -
Discrepancy between number of links from web master tools and open site explorer.
Hi I am looking at number of link to www.bagnodesignglasgow.com on open site explorer shows as total links 24 but on WMT it says 937 ? Why are these two numbers so different ? Thanks
Link Explorer | | VIVOWeb0 -
I want to do a Keyword Difficulty and SERP Analysis for a core keyword and compare the top 10 ranking pages againt my page. How can I do that? Running a full report? Thanks!
I want to do a Keyword Difficulty and SERP Analysis for a core keyword and compare the top 10 ranking pages againt my page. How can I do that? Running a full report? Thanks!
Link Explorer | | estebancitus0