Moz Not Crawling Angular SPA
-
I have a client that just launched a redesigned website using Angular as a single page app. Google appears to be able to crawl the site just fine, but Moz crawl is only finding one page. We have updated the htaccess to allow for Rogerbot and Dotbot, but still unable to crawl any pages other than the home page. Does anyone have experience with this or ideas of why it won't crawl all pages, and how to allow for Moz to crawl all pages? There is a sitemap with approx. 390 pages.
Thanks!
-
I recommended to another Moz agent that it put a clearer warning label to users that Moz Pro's on-page grader and site crawl will not work with single page apps. Alternatively, I'd have a pop-up if the Moz tools run and come up with results like the ones the poster described. I ran into the same issue.
-
Hi!
One way to get around this one is making use of pre-rendering. So if you setup your site/server to pre-render your pages either for all user agents, or specifically for MozBot and other bots not capable of crawling through JavaScript then it might work.
Facing the same issue for us now, but will try this at least.
Best regards,
Anders -
Thank you very much for your quick response. I'm taking a look at the Q&A section and the tools you recommended. I appreciate your help!
-
Hi there! Tawny from Moz's Help Team here.
Thanks for writing in and sorry about the trouble!
I took a look at your Site Crawl results and your site, and I believe this is a result of our crawler's inability to work with Javascript. If your site is primarily Javascript, then the data you get back with regards to the crawl report won't be completely accurate because of this. It looks like, due to the Javascript on the page, we weren't able to find any links to keep crawling: https://www.screencast.com/t/mqy7SUb9f
There's no real workaround that I can recommend for this one, since it is a technical limitation of our tools, but I did find some good blog posts and discussions in the Q&A about this when I searched our Help Hub.
While the tools and data that rely on our crawl of your site may not return the best results because of that Javascript, your keyword rankings and link profile should work just fine.
You might also want to check out a few tools that are compatible with Javascript, like Botify or Screaming Frog.
I'm really sorry I can't be of more help here; I'll definitely be sure to pass this along to our Product team as feedback on your behalf. If you have any follow-up questions or if there's anything else you need help with, please write in to help@moz.com and we'll do our best to sort everything out.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
I used moz tool and it was very useful to me.
I used moz tool for 3 months. Before that my website never ranked. But now it started ranking. Thanks to moz. My website is https://www.designcafe.com
Getting Started | | designcafe1 -
Attempts to fix MOZ recommended issues resulted in drastic ranking drop.
I have a website built in SquareSpace. https://www.ruffhaus.com/ I recently started working with MOZ to track and improve organic SEO. After my initial site crawl, search visibility was reported at a waping 2.38%. Moz showed several critical crawler issues. Most were redirect, 4xx and long URL. So I started working on fixing the redirect and 4xx issues first. I thought this was a good thing. But now my already sad search visibility has dropped to .07% (-95.97%!). I also went from #1 on keyword, brand implementation plan (and 3 variations), to #27. What? Wondering where I went wrong and how to remedy? This is all new to me so I am sure I'm not providing all the info you need to answer my question. Hoping providing the site URL will help. Fire away!
Getting Started | | RuffHaus0 -
Canonical url does not seem to be recognised by Moz
Hey guys, forgive me... brand new user of Moz. Moz is telling me I have duplicate url's - a lot of them. Investigating I see that it is classing http://creativedigital.co.nz/artprints/lake-tekapo-church-of-the-good-shepherd?tag=lake as a duplicate of http://creativedigital.co.nz/artprints/lake-tekapo-church-of-the-good-shepherd even though there is a canonical tag in head as follows I'm not quite sure what I am doing wrong. Any advice would really be appreciated 🙂 Mike
Getting Started | | creative.digital0 -
Why wont rogerbot crawl my page?
How can I find out why rogerbot won't crawl an individual page I give it to crawl for page-grader? Google, bing, yahoo all crawl pages just fine, but I put in one of the internal pages fo page-grader to check for keywords and it gave me an F -- it isn't crawling the page because the keyword IS in the title and it says it isn't. How do I diagnose the problem?
Getting Started | | friendoffood0 -
Does the Moz crawler have a static ip address?
We block AWS from crawling our site. Does the moz crawler use a static ip address that we could allow? I'm currently not able to add a campaign because Moz can't connect to our site.
Getting Started | | uShip0 -
I don't believe moz is seeing everything that is on my webpage
I used the page key word grader and got an "F" Moz said that my keyword employee handbook was not in my title nor was it found in the body of my page. But when I look at the page and double check everything it is there all over the place. I am not blaming moz this is a wiz site and while I am a beginner and very well could be wrong could anyone just take a look and tell me if I am nuts or what. The web page is http://www.cestoday.com/#!employee-handbook/co0h I now have the font so big I will have to fix that. Thank you
Getting Started | | redsman9440 -
Changes to Moz
I used to think Moz was rich and full but man, there is so Much new stuff! I love it! I still need to explore everything. Does anybody know if its going to be an option for our clients to log in and see just their account? are changes in the works for reports we can pull and send to clients? thank you!! Matthew
Getting Started | | Mrupp441 -
Cant download my crawl csv
When I click on the [download csv] in my crawl campaign section nothing happens.
Getting Started | | digitalmedialounge0