How Is a Page Crawled by Moz When Moz Says 'No Links'?
-
As above, really. I've crawled a new client's site to find the Moz crawler has identified a handful of 404 errors.
The Moz crawler says these pages have '0 linking domains', and OSE has no data for these pages.
So how are these pages being crawled by Moz and what should I advise my client?
-
Thanks again, Peter.
-
That's great, thanks Keri.
-
Hi, no problem. Keri has answered your query re the Moz crawler not finding them.
Peter
-
If you download the CSV report, we list the referring page there. We know it isn't obvious and we're working on making this a little easier to find.
-
Hi Keri,
Thanks for getting back to me (thanks to Peter above, also).
So what is the best way of me finding where these 404 pages are linked from?
I am 99% sure they are internal links that I will ask the client to remove, but would like to avoid manually checking every link on the site if possible.
-
Hi Peter,
I searched for their domain name and about the expected number of results came up.
I searched for these individual URLs that Moz is reporting using the site: command, and they were not returned.
They are also neither in the site's sitemap (HTML page or XML file).
So how is SEOmoz Crawler finding them?
-
We have two completely different crawling systems. We have on crawler for your website, where you enter in your URL and we crawl your site looking for problems. We have a different crawler for OSE that goes and looks at the web in general and crawls for links. The two crawlers do not talk to each other, so it is actually understandable that OSE may not have data on the site. OSE doesn't have the same index size as Google, so we don't see all the links that are actually out there (though we're working all the time on improving this!).
-
Hi, if you put site:xxx.com into Google where xxx.com is your client's domain name, does Google report anything?
Peter
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Unsolved Thousands of links with same IP address found in backlinks
Hey, While researching the backlinks of a client's website I found around 3000 links with the structure: http://54.201.231.138/page. The IP doesn't seem to be of their website and the MOZ Spam score for the domain is 1%. Wondering what these links are and if they're a big problem? Thank you in advance. Warmly,
Link Explorer | | JoePen1010
Joe Screenshot 2022-09-30 at 10.58.12.png0 -
Why are my trackable links appearing in my site crawls?
Our Google-created trackable campaign URLs are appearing in site crawls and often triggering error warnings.
Link Explorer | | K.Reeves0 -
Link Explorer Export
Does anyone know how to export more than 50 keywords at a time from Link Explorer? I'm trying to extract the keywords from a competitor domain to do some analysis/big data queries. I'm using the link Explorer but I can't see any way to export more than 50 keywords at a time! The total I can export seems to be around 100k but it's going to take a very long time if I've got to do 50 at a ago!
Link Explorer | | seoman100 -
OSE: Missing back-links and High DA website with low DA backlinks
I have gone through a website with 81 DA; where its link equity back-links with highest DA of 70. Hardly 5 back-links 60 to 70 DA and just 25 root domains. This seems very unusual to me. Can someone clarify this for me? Can a website with low DA back-links can make high DA? If so what could be other major contributing factors for this?
Link Explorer | | vtmoz0 -
Custom ranking report based on pages
Is it possible to generate a report that shows the keywords and position per page? For example Page xyc ranks for keyword1 - position 5, keyword2 - position 32, keyword3 - position9. I don't want to input the keywords, I want to be told via the report. I am trying to find out what SEO weight certain pages/sections of the website offer and if its OK to pull the content to change it into something else.
Link Explorer | | differentmoney0 -
Backlinks not showing on Open Site Explorer's Just-Discovered Links
Hi guys! My name is Edgar. I've recently been adding a bunch of backlinks to the site i work for, and most of them have a very high DA (DA > 80. Wohoo!). Nevertheless i'm often feel a bit frustrated when i check my site with the OSE, because just a few part of these links are showed in the just-discovered section, although i created them few days ago. So, i would like to know why is this happening, how long it take for my links to get crawled, and when can i stop getting frustrated on this? Than you very much! Edgar.
Link Explorer | | PCBU0 -
Moz Spam Score
Hi! The spam score for my sites is "--" with no graph. The sites are large ecommerce sites with a ton of branded search and DAs of 50+. Simple question - are these clean spam scores, or has Moz not calculated the scores yet?
Link Explorer | | AMHC1 -
Need advice on creating link report
I am trying to create a new report that will show the effectiveness of each link source in terms of delivering traffic and how quality that traffic is with regard to conversions.... With that, I want to know how I can first get a list of all external links to any page on my subdomain and then align that list with traffic/conversion data in Google Analytics. Can someone provide me step by step instructions on this? I assume I would start with Open Site Explorer and export the list of external links to pages on my subdomain. My issue lies in how to get the same general list out of GA that lines up with the urls in the OSE export. I have tried referrals, but that does not give me a compatible list.
Link Explorer | | dsinger0