How Is a Page Crawled by Moz When Moz Says 'No Links'?
-
As above, really. I've crawled a new client's site to find the Moz crawler has identified a handful of 404 errors.
The Moz crawler says these pages have '0 linking domains', and OSE has no data for these pages.
So how are these pages being crawled by Moz and what should I advise my client?
-
Thanks again, Peter.
-
That's great, thanks Keri.
-
Hi, no problem. Keri has answered your query re the Moz crawler not finding them.
Peter
-
If you download the CSV report, we list the referring page there. We know it isn't obvious and we're working on making this a little easier to find.
-
Hi Keri,
Thanks for getting back to me (thanks to Peter above, also).
So what is the best way of me finding where these 404 pages are linked from?
I am 99% sure they are internal links that I will ask the client to remove, but would like to avoid manually checking every link on the site if possible.
-
Hi Peter,
I searched for their domain name and about the expected number of results came up.
I searched for these individual URLs that Moz is reporting using the site: command, and they were not returned.
They are also neither in the site's sitemap (HTML page or XML file).
So how is SEOmoz Crawler finding them?
-
We have two completely different crawling systems. We have on crawler for your website, where you enter in your URL and we crawl your site looking for problems. We have a different crawler for OSE that goes and looks at the web in general and crawls for links. The two crawlers do not talk to each other, so it is actually understandable that OSE may not have data on the site. OSE doesn't have the same index size as Google, so we don't see all the links that are actually out there (though we're working all the time on improving this!).
-
Hi, if you put site:xxx.com into Google where xxx.com is your client's domain name, does Google report anything?
Peter
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Unsolved How To Check Outbound Links Of wesite?
I have a competitor website name Richmond Locksmith 24/7 How can i check its outbound links on moz??
Link Explorer | | Anjana96380 -
Unsolved Large discrepancy in number of links using compare links tool
Hi there, I’m trying to understand the large discrepancy in number of links among websites. For instance, I am comparing landing pages among two different colleges. One college has over 7 million links, while the other has only 72,000 links. Meanwhile, these colleges are fairly comparable in terms of population and prestige. Could anyone help me understand why this metric is wide ranging, and how a college could have so many links? Specifically looking at total links, internal links, external links, and linking domains.
Link Explorer | | HanoverianHE0 -
Link Explorer is not working for particular domain
Hello, Linking Domain section in Link Explorer is not working fine for sewingmachineprice.com. When I put this domain to analyze for backlinks it says, "You entered the URL https://sewingmachineprice.com/ which redirects to www.hugedomains.com/domain_profile.cfm?d=sewingmachineprice&e=com. Click here to analyze www.hugedomains.com/domain_profile.cfm?d=sewingmachineprice&e=com instead." In fact, this domain is not redirected to any third domain or URL. I personally checked it and can access this website without any redirection.
Link Explorer | | Jacksmorrin0 -
Moz Pro: Filter inbound links by partial anchor text?
My site has been targeted by a spam farm with hundreds of different domains, all linking to images on our CDN with similar variations of anchor text, eg: get free high quality hd wallpapers wedding cake makers
Link Explorer | | James_NZ
get free high quality hd wallpapers hairstyle makeover
get free high quality hd wallpapers living room cafe
etc Is it possible within Moz Pro to filter all incoming links with anchor text including "free high quality hd wallpapers" so that I can disavow all of the domains en masse? So far I've only been able to display/download the list of links exactly matching the full anchor text which is very time-consuming with 100+ variations. Regards,
James0 -
No link to Open Site Explorer from Campaigns tracked keywords?
Hi there, The Guide to tracking your keyword rankings in Moz Pro states that "Click on the keyword to analyze it, the URL to be taken to that page in Open Site Explorer or the Optimize link to get a Page Optimization Score with recommendations.". But my URLs all target to the specific page on my site. I figure it would be nice to dive deeper in analysing specific pages, using Open Site Explorer Is just the link with Open Site Explorer broken, or is the Guide out of date? Thanks, Arnout
Link Explorer | | BentoPres1 -
DA hasn't Moved over
We moved our site over a couple of weeks ago from bi-mi.com to bimi.co - its a magento site. We followed instructions to wait 2 weeks and upload a coming soon page etc to help google realise it was not just a parked domain. We moved everything over and then set a hta record up to redirect the "bi-mi" base domain to "bimi" , we then logged teh site move within web master tools also and I set the bimi.co preferred url etc. However its been about a week and half now and the DA is still showing as 1 and bi-mi (the old site that is redirecting) is showing as 18 Is it just patience needed here or have any of you also come across this issue?
Link Explorer | | Kelly33301 -
How Does Moz Assign Domain Authority?
When I use Site Explorer to test the following URL, http://jennathuening.results.net/site/index.php, it renders a domain authority of 47. (Clients site on real estate host) There are no page social metrics: no Facebook share no Facebook likes no Twitter tweets no Google+ plus 1's no "just discovered" in 60 days no one has made a post in 3 weeks much or most of the content is duplicate content across all affiliate sites inbound links - only one link - a 301 redirect http://jennathuening.results.net/ Images - 18 (Alt tags missing: 18) Created - 1998-10-15 Registered Org - REMAX RESULTS is associated with ~416 other domains Whois SEO Score 68% AND YET IT HAS A ROOT DOMAIN OF "47" and page authority of 33 More confusing, its page authority of 33 is at that top on blue background and then page 30 just listed below. When I use Site Explorer to test the following URL, http://www.homedestination.com, it renders a domain authority of 26. (Site personally owned and continually update with highly optimized fresh, relevant, quality content with grade "A" moz ranked pages and blog posts) 92 Facebook share 68 Facebook likes 13 Twitter tweets 420 Google+ plus 1's 2 "just discovered" in 60 days Images 25 (Alt tags missing: 0) inbound links - on 48 Root Domains Created - 2002-08-15 9 new indexed blog post so far in August / 19 new indexed blog post in July Whois SEO Score 100% AND YET IT HAS A ROOT DOMAIN OF "26" and page authority of 36 While I am sure there are many other factors as well; it still is hard to see where a "smaller guy" could ever be given an even opportunity to play in the same SEO arena. Could you help me understand better? I like to build a stronger marketing and optimization strategy as we are just beginning AdWord campaigns. | SEO Score | 100% |
Link Explorer | | jessential1