Moz crawling doesn't show all of my pages
-
Hello,
I'm trying to make an SEO on-pages audit of my website.
When using the SEO crawl, i see only one page while i have much more pages in this website (200+). Is it an issue with the sitemap ? The robot.txt ?
How can i check and correct this. My website is discoolver.com
-
Hi there,
Sam from Moz's Help Team here!
So, I took a look at your site, and unfortunately I believe this is a result of our crawler's inability to work with Javascript. Any client side loaded content will not be rendered to our crawler as we are only seeing what is rendered by your server.
Our crawler works by parsing the source code of your site, looking at HTML elements. If your site is primarily Javascript, then the data you get back with regards to the crawl report won't be completely accurate because of this. There's no real workaround that I can recommend for this one, since it is a technical limitation of our tools, but there are some good blog posts and discussions in the Q&A about this if you head over to our Help Hub.
While the tools and data that rely on our crawl of your site may not return the best results because of that Javascript, your keyword rankings and link profile should work just fine.
You might also want to check out a few tools that are compatible with Javascript, like Botify or Screaming Frog.
I'm really sorry I can't be of more help here; Please let me know if there's anything else I can help with, or if there are any follow-up questions you might have!
-
Thanks for the answers.
I believe the issue is about a rel=canonical from the homepage which links to an external website...
Can this tag prevent a good website crawl ?
-
So just looking it appears you don't have a robots.txt file or a sitemap. At least one that I could easily find.
This Moz post might help when creating one.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Moz Pro Tools Inbound Links
Is there a way to get a date of when a inbound link was created from a external website. And if so is there a way to add that to the Moz Pro tools reports on a csv file.
Link Explorer | | willakawillow221 -
MOZ competitor analysis tool
Hi Guys Has anyone also noticed that the MOZ competitor analysis tool does not always pick up on all back-links? If I put two competitors into MOZ and Ahrefs I get so many more back-link info from Ahrefs. Has anyone else experienced the same issue? Thanks Jon
Link Explorer | | NaughtyChilli0 -
Crawling and Links - Showing Links
Hello I have a campaign in Moz that shows a new site as having no domain authority and no links. The site does have links to it, but they don't show up on OSE. Does Moz count links in the comments section of blogs (or is this counted as social, when the commenting system is one that requires facebook login?) I know blog comments are not great for SEO, I just use them when the post/link is 100% genuinely relevant. The site does have actual links on websites not just comment links, so it isn't showing any type of link. What is the best way to see the links the site has? Thanks!
Link Explorer | | wearehappymedia1 -
How often are Moz Domain authority and Page Authority Metrics Refreshed?
How often are the MOZ metrics of DA and PA refreshed, this is because i have noticed when i conduct an Inbound link analysis of my blog, i realize that MOZ is merely detecting around 100+ only links to what is being detected on Google Webmaster Tools, any advise?
Link Explorer | | ConnectMedia0 -
Is there some way to tell the Moz crawler not to crawl URL's with particular dynamic tags such as "?redirect-to:http//" ?
We are encountering an issue where the crawler is finding a ton of pages from our wordpress login url that has this dynamic tag in it to kinds of different blog entries. It's madness. I can't figure out what is causing these URLs to generate to be crawled in the first place! Does this sound familiar to anyone out there, any constructive suggestions? Robots text or maybe meta robots tags that would resolve this crawl issue?
Link Explorer | | RegistrarCorp0 -
Getting Different PA/DA for 'www' and 'non-www'?
Can anyone explain why we're seeing different DA/PA for our website when viewing in OSE for 'www' and 'non-www'? This is for our site whiteboardcreations.com Our 'www' is resolving at DA 37 | PA 47
Link Explorer | | WhiteboardCreations
Our 'non-www' is resolving at DA 37 | PA 44 Thanks! - Patrick0 -
How long does it take for moz to index new domain?
Hi, Two months ago we changed our site www.jicht.nl to jicht.nl. Everthing is redirected properly but the page authority remains 1. How long does is take rogerbot to index the site without www? Google rankings are also dropping so there might be a bigger issue. Thanx
Link Explorer | | AlkaVitae0