Moz Not Crawling Angular SPA
-
I have a client that just launched a redesigned website using Angular as a single page app. Google appears to be able to crawl the site just fine, but Moz crawl is only finding one page. We have updated the htaccess to allow for Rogerbot and Dotbot, but still unable to crawl any pages other than the home page. Does anyone have experience with this or ideas of why it won't crawl all pages, and how to allow for Moz to crawl all pages? There is a sitemap with approx. 390 pages.
Thanks!
-
I recommended to another Moz agent that it put a clearer warning label to users that Moz Pro's on-page grader and site crawl will not work with single page apps. Alternatively, I'd have a pop-up if the Moz tools run and come up with results like the ones the poster described. I ran into the same issue.
-
Hi!
One way to get around this one is making use of pre-rendering. So if you setup your site/server to pre-render your pages either for all user agents, or specifically for MozBot and other bots not capable of crawling through JavaScript then it might work.
Facing the same issue for us now, but will try this at least.
Best regards,
Anders -
Thank you very much for your quick response. I'm taking a look at the Q&A section and the tools you recommended. I appreciate your help!
-
Hi there! Tawny from Moz's Help Team here.
Thanks for writing in and sorry about the trouble!
I took a look at your Site Crawl results and your site, and I believe this is a result of our crawler's inability to work with Javascript. If your site is primarily Javascript, then the data you get back with regards to the crawl report won't be completely accurate because of this. It looks like, due to the Javascript on the page, we weren't able to find any links to keep crawling: https://www.screencast.com/t/mqy7SUb9f
There's no real workaround that I can recommend for this one, since it is a technical limitation of our tools, but I did find some good blog posts and discussions in the Q&A about this when I searched our Help Hub.
While the tools and data that rely on our crawl of your site may not return the best results because of that Javascript, your keyword rankings and link profile should work just fine.
You might also want to check out a few tools that are compatible with Javascript, like Botify or Screaming Frog.
I'm really sorry I can't be of more help here; I'll definitely be sure to pass this along to our Product team as feedback on your behalf. If you have any follow-up questions or if there's anything else you need help with, please write in to help@moz.com and we'll do our best to sort everything out.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
901 error code showing url back to back in crawl
Hi Everyone, I'm absolutely dumbfounded about this 901 issue (showing pages with our url back to back). Our site is hosted on Big Commerce: https://www.santabarbarachocolate.com When I look for these pages being crawled I don't find them. I've called BC for help and I can't seem to find a solution or where to turn as to how to fix the issue at hand or even if it matters. Please see below what the Moz crawl shows. Could this be related to Yotpo or some app we have running? Or does this even matter and does it have any influence on rank? Do you have recommendations or ideas? Thanks so much. Pages with Crawl Attempt Error as of Mar 3 URL Page Authority Linking Root Domains Status Code | Error Code 901: DNS Errors Prevented Crawler from Resolving Hostname http://www.santabarbarachocolate.comhttp/www.santabarbarachocolate.com/100-percent-pure-cacao-unsweetened-baking-chocolate -- -- 901 Error Code 901: DNS Errors Prevented Crawler from Resolving Hostname http://www.santabarbarachocolate.comhttp/www.santabarbarachocolate.com/buy-wholesale-bulk-chocolate -- -- 901 Error Code 901: DNS Errors Prevented Crawler from Resolving Hostname http://www.santabarbarachocolate.comhttp/www.santabarbarachocolate.com/organic-chocolate-wholesale | -- | -- | 901 |
Getting Started | | santabarbarachocolate0 -
Moz scraper
How often do you Moz do whatever it is they do for me to get up-to-date data?
Getting Started | | infinety0 -
Newbie question: 5 ways to get the most from Moz
Hi there, I'm new to Moz. I work for a furniture retailer and I'm in the process of auditing our digital presence and improving how we appear on Google and therefore to our customers. I am working on our website's content and SEO, Google Local Listing, getting our products added to Google Shopping and updating our social media accounts, removing old accounts and improving current ones. I'd like to know how to make the most of Moz. I have set our site up in Moz Pro but I'm unsure where to go next, so I was wondering if you'd be able to offer 5 tips on where to really get started. Thank you.
Getting Started | | Bee1590 -
Why can't I Ctrl + click on links on Moz any more?
I'm interested if it's just me that gets frustrated by this? I've just Ctrl + clicked a few links to open them in separate tabs and then realised that none of them had opened. I know it's been like this for a while. It's a usability issue as it goes against expected norms, and now I have to right-click and then click "Open in new tab" on each link, which is more time-consuming and frustrating. More and more websites seem to be losing their Ctrl + click on links ability (JavaScript often breaks it). I don't know if there's a Mac equivalent... Anyway, I hope that doesn't seem like I'm too angry. It just frustrates me a little and I hope it gets fixed. 🙂 Edit - I've just realised these are getting blocked by Chrome's pop-up blocker - but why? It's only an issue on a small number of websites.
Getting Started | | Alex-Harford1 -
Why does Moz Analytics only let you look at last month / last week?
I cant think of any other reporting product that only lets you look at the last period, am I missing a setting somewhere. I need to take a look at Feb!
Getting Started | | locusm1 -
Moz Analytics - Custom Report Question
Hello Moz Forums! I'm having problems building custom reports for my clients. So, i've managed to put together a few reports and I've set these to be scheduled for weekly automated emailing! Now, here's the problem, before sending it to my clients, I was testing this by sending it to myself. This is what I receive: http://www.freelance-seo.co.uk/images/Moz.png I don't really want my clients to see 'By Moz!' everywhere when I send this out, is there a way to change this automated mail? Or a way to just just send the PDF without a link? Alternatively, have I just failed in using this product? Edit: Just to clarify! The 'simply change your report settings' option, just takes me to an option to edit the report title, not the email in any way.
Getting Started | | Paul_Tovey0 -
Fastest way to set up Moz to produce a list of easy-to-rank for keyword opps
I've used Hubspot's keyword tool previous to MOZ, and I know that they import data generated from MOZ into their tool... but I find it a much more convoluted process using Moz's more robust system. ALL I want is to dump in a long list of keyword possibilities, then see where we can easily rank for these terms, especially against our local competitors. How do I set this up???? It's not as self-explanitory as Hubspot! Thanks!!!
Getting Started | | uptongirl340 -
New to MOZ and working with Web Mentions. Can I use operators?
Our name is HostDime but often put as Host Dime (2 words) by news sources and other sites. How do I set up my brand mention so I only get a notice when both words appear, in order, together. I don't want "That host is a dime" and such. Can I use a +Host +Dime?"Host Dime"? Do these operators work in MOZ?
Getting Started | | hostdime0