Does Moz's crawlers use _escaped_fragment_ to inspect pages on a single-page application?
-
I just got started, but got a 902 error code on some pages, with a message saying there might be an outage on my site.
That's certainly not the case, so I'm wondering if the crawlers actually respect and use the escaped_fragment query parameter.
Thanks, David.
-
David, yes you can serve that as a solution as well and the User-agent string will be rogerbot. Sorry for any confusion this caused on your end. Once you get this up and running Roger will crawl like there is no tomorrow!
-
Hi James,
I can also serve the pre-rendered, static version of the website to Moz's bots. In order to detect the bots, I'll have to scan the User-Agent string.
Is it safe / enough to look for "rogerbot" in the User-Agent string?
Thanks, David.
-
Hi CareerDean,
At this time we are not supporting escaped_fragment for crawling websites and our crawler rogerbot will simply hit anchor tag links. I was able to take a look at your site and rogerbot will definitely have some trouble crawling anywhere here due to the lack of a hrefs.
What we have typically suggested in the past is using an HTML link at the bottom of the page leading to a basic site map so that Roger can navigate through. This will allow you to keep the same look and feel and just add one link to enable crawlers.
Please let me know if you need anything else and feel free to get us at help@moz.com with any further questions. Also feel free to ask any follow ups here as well.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
How to remove bad or spammy links from Moz?
My website has gotten some bad and spammy links. I know how to disavow bad links from Google. But I reviewed Moz and haven't got any disavow option.
API | | juanitajb9
Have any disavow option on Moz? How can I remove the bad links from Moz? Thanks0 -
Sitemaps and Indexed Pages
Hi guys, I created an XML sitemap and submitted it for my client last month. Now the developer of the site has also been messing around with a few things. I've noticed on my Moz site crawl that indexed pages have dropped significantly. Before I put my foot in it, I need to figure out if submitting the sitemap has caused this.. can a sitemap reduce the pages indexed? Thanks David.
API | | Slumberjac0 -
Crawler unable to access pages
Hi crawler is unable to access site and crawl properly. Mainly for the backlink checker, it's producing no results There is nothing in the robots.txt file blocking crawler access. Any help is much appreciated as it's driving me crazy!
API | | 2Cubedie0 -
In lue of the canceled Moz Index update
Hey Moz, Overall we love your product and are using it daily to help us grow, part of that has been to rely on the Moz Index for DA and PA as well as places where we are doing positive linking through genuine partnerships and reviews of clients. We were really excited to see any the results for this month as we have been partner linked from lots of high reputation sites and google seems to agree as our rankings are moving up weekly. The question from our marketing team is, since a significant part of Moz will not be available to us this month, will there be any compensation handed out to the paying community. PS: I am an engineer and I know how you have probably lost a very large set of data which cant simply be re-crawled over night but Moz Pro is not a cheap product and we do expect it to work. Source: https://moz.com/products/api/updates Kind Regards.
API | | SundownerRV0 -
Integrate Piwik data with Moz instead of Google Analytics?
Hello everyone, The company I work for had Google Analytics for all of our websites, dating back at least 4 years. Because of our email infrastructure, we accessed Analytics through a temporary account. Now this account worked fine for 4 years, until over the last two weeks where at some point Google deleted that account, and the Analytics connected to it. I've had no response from Google regarding this, but that's by the by. Anyway, I've made the decision to bring the analytics in house and hold the data ourselves. I've chosen Piwik for this, and it's been running fine for the last few days. However, I know Moz integrates with Google Analytics, but at the moment this is useless to me. Is there a way, or are there any plans, to integrate Piwik with Moz? If not, what benefits will I lose if I discontinue using Google Analytics with Moz?
API | | theponyclub0 -
Is Moz Pro down?
This morning, just before trying to meet with a client, I cannot access Moz Pro. Here is the page I get: This XML file does not appear to have any style information associated with it. The document tree is shown below.
API | | jessential
<error>NoSuchBucket<message>The specified bucket does not exist</message><bucketname>analytics.moz.com</bucketname><requestid>DC68738B494D30A1</requestid><hostid>r13H1pVq04vKGcKkAD9AUCTRXNdZAhUOULNwv4/TB74e0utcat2mV3PT7dXOtnuG</hostid></error> What can I do to access my information?0 -
On Page Grader Problem-Sorry But This Page Inaccessible
Greetings: When I try to use the on page grader and enter my URL, an error message appears stating: "Sorry But This Page Inaccessible". The URL is http://www.nyc-officespace-leader.com/commercial-space/office-space and it works fine when I enter it on my browser. Any page from this domain generates this error. Is there a bug with this tool? How would I go about tracking ranking on various keywords? I see it is possible to tag keywords, and I have done so for about 250. But I don't know how to generate a ranking report for these keywords; ideally I would like to do so filtering them by the label I have applied. Any suggestions? Thanks,
API | | Kingalan1
Alan0