Does Moz's crawlers use _escaped_fragment_ to inspect pages on a single-page application?
-
I just got started, but got a 902 error code on some pages, with a message saying there might be an outage on my site.
That's certainly not the case, so I'm wondering if the crawlers actually respect and use the escaped_fragment query parameter.
Thanks, David.
-
David, yes you can serve that as a solution as well and the User-agent string will be rogerbot. Sorry for any confusion this caused on your end. Once you get this up and running Roger will crawl like there is no tomorrow!
-
Hi James,
I can also serve the pre-rendered, static version of the website to Moz's bots. In order to detect the bots, I'll have to scan the User-Agent string.
Is it safe / enough to look for "rogerbot" in the User-Agent string?
Thanks, David.
-
Hi CareerDean,
At this time we are not supporting escaped_fragment for crawling websites and our crawler rogerbot will simply hit anchor tag links. I was able to take a look at your site and rogerbot will definitely have some trouble crawling anywhere here due to the lack of a hrefs.
What we have typically suggested in the past is using an HTML link at the bottom of the page leading to a basic site map so that Roger can navigate through. This will allow you to keep the same look and feel and just add one link to enable crawlers.
Please let me know if you need anything else and feel free to get us at help@moz.com with any further questions. Also feel free to ask any follow ups here as well.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Moz Tool to embed on website
Are there tools to embed on website to serve as initial lead gen opportunities? Like a site audit?
API | | Cobblerocks0 -
Is there an easy way to get MOZ data into Google Sheets?
Is there any way to pull data directly from MOZ to Google sheets, like a plug-in for sheets?
API | | Storfiskaren2 -
Moz & Google Tag Manager
Does Moz take into account Google Tag Manager or will it keep flagging up duplicate content, etc?
API | | moon-boots0 -
How to retrieve keyword difficulty information using Mozscape API?
Hi, Are we possible to use Mozscape API to retrieve keyword difficulty information for a list of keywords? I can't find its documentation. Thanks
API | | uceo0 -
Is there a way to include Moz Analytics in my website backend.
Hi, Does any one know if using the moz APIs, I can created a "SEO" dashboard inside my backend? Thanks
API | | Felip30 -
HELP, I can't download my keyword rankings history to csv
I have been trying to download my keyword rankings history to csv, and nothing happens. If I am in chrome, a page pops up with the url vanguard.moz.com-but nothing happens. I tried in firefox as well, and absolutely nothing happens there at all. Thank you!
API | | level60 -
Huge in crease in on page errors
Hi guys I’ve just checked my online campaign and I see errors in my crawl diagnostics have almost doubled from the 21<sup>st</sup> of October to the 25<sup>th</sup> of October going from 6708 errors to 11 599. Can anyone tell me what may have caused this? Also I notice we have a lot of issues with duplicate page titles which seems strange as no new pages have been added, can anyone explain why this might be? I look forward to hearing from you
API | | Hardley1110