Crawl a node js page - Why can I only see my frontpage?
-
Hi
When i am trying to crawl my website ( https://www.doorot.com/ ) it can only find my frontpage. It's a node js page. Any one had the same problem or know how to crawl my site in order to see all my pages?
Kasper
-
Hi there!
Sam from Moz's Help Team here - I'm sorry about the trouble!
Unfortunately, this would be a result of our crawler's inability to work with Javascript. If your site is primarily Javascript, then the data you get back with regards to the crawl report won't be completely accurate because of this. There's no real work around that I can recommend for this one, since it is a technical limitation, but I did find some good blog posts and discussions in the Q&A about this when I searched our Help Hub. While the tools and data that rely on our crawl of your site may not return the best results because of that Javascript, your keyword rankings and link profile should work just fine.
You might also want to check out a few tools that are compatible with Javascript, like Botify or Screaming Frog.
I'm really sorry I can't be of more help here; I'll definitely be sure to pass this along to our Product team as feedback on your behalf. Please let me know if there's anything else I can help with, or if there are any follow-up questions you might have!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Moz was unable to crawl your site on Jun 22, 2020\. We were unable to access your site due to a page timeout on your robots.txt, which prevented us from crawling the rest of your site.
Site: www.kpmg.us Getting robots.txt timeout fail since 02/29/20. We've checked our server logs and see no errors. Went through all the steps of the "Troubleshooter". Updated robots.txt to allow rogerbot full access: User-agent: rogerbot
Link Explorer | | KPMG-Search-Social
Disallow: Any ideas how to get roger to crawl my site????1 -
How can i reduce spam score
my website is activate in egg incubation industry https://chicken-device.ir . Level of this site spam score is 19% . now how can i reduce that ?
Link Explorer | | HeidiMaryAyuningtyas0 -
Can improving page authority on all pages help overall domain auth?
Our website is made up of approx 4000 pages - some of which are old pages with a pa of 1. I am removing these pages (ensuring they don't have links etc). Can removing so many low scoring and useless pages impact on domain authority. Our DA jumped 4 points and i wondered if this was helping Example 4000 pages in total 2500 have PA 1 - these get removed will it look better for DA that overall there are now no pages where PA =1 and the site now contains higher PA pages only?
Link Explorer | | acsilver0 -
Open Site Explorer not attributing page authority
Hi there, I have been having an issue with OSE attributing page authority to one of the sites I have been looking at. The homepage page authority is fine but any page after this does not have any according to OSE. I have been in touch with Moz and they have stated it's because there are no external or internal links pointing to any of these pages. However, I know that their are internal links pointing to these pages from the homepage in the nav. The domain is: https://healys.com/ If anyone has any ideas what may be going on that would be great. Thanks!
Link Explorer | | Alice-20160 -
How can I tell what pages have links TO this page?
Hello, Mozzers! My client has a rather messy situation, with redirects for HTTP vs. HTTPS, and two different home pages, both in subdirectories. I could explain the whole setup, but I don't think it's relevant for my question, which is this: OSE is showing three links to the page in question, but doesn't tell me WHAT those links are. Am I just missing the information somewhere? Please see screenshot for details. Thanks so much! ~ Scott view?usp=sharing
Link Explorer | | measurableROI0 -
Page Authority dropped to 1 for subdirectory in my site
Hey, one of my sites https://www.automationanywhere.com/testing has had all it's pages drop to a page authority of 1 in Moz and the campaign doesnt appear to be indexing any pages from this directory. We launched a new site in this directory on the 12th and havent been getting any moz love since. The pages are indexable and followable, and are being indexed by google and others. The site on the root domain has been unaffected. Please help me get my moz campaign back on track. Thanks!
Link Explorer | | aatethys0 -
How can I get a list of all the links going out from my website
How can I get a list of all the links going out from my website and from which pages of my site. can I get this list using Moz, I also have ahref.com account, can I use that if yes how or do I need to use some other tools. Thank you
Link Explorer | | SinaKashani0