Welcome to the Q&A Forum

Browse the forum for helpful insights and fresh discussions about all things SEO.

Your browser does not seem to support JavaScript. As a result, your viewing experience will be diminished, and you have been placed in read-only mode.

Please download a browser that supports JavaScript, or enable it if it's disabled (i.e. NoScript).

How I can check if Google and other search engines will properly cache a page (a dynamic one)?

Algorithm Updates

500

esiow2013 last edited by

My site is currently disallowing search engine bots with the help of robots.txt. These dynamic pages can be crawled using Screamingfrog since they are linked to a static category page which is also linked to the homepage.

Thanks in advance!
1 Reply Last reply
Reply Quote 0
danwebman last edited by

Great idea using Screaming Frog first then :-

Then use Google Web Master Tools > Crawl > Fetch as Google to see what Google sees
1 Reply Last reply
Reply Quote 1

Got a burning SEO question?

Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.

Start my free trial

Browse Questions

View

From

Sorted by

With category

Explore more categories

Related Questions

Will more landing pages with related keywords improve ranking of main keyword?

Hi all, We are in the process of creating new landing pages and noticed something what our competitors been following with landing pages. They have created multiple landing pages targeting the related keywords of a main topic / main keyword. Like "seo defined", "seo history", "seo benefits", "seo strategies", "types of seo", etc being "SEO" as main keyword or main topic. Will this works? Thanks
Algorithm Updates | | vtmoz

0
Can 'Jump link'/'Anchor tag' urls rank in Google for keywords?

E.g. www.website.com/page/#keyword-anchor-text Where the part after the # is a section of the page you can jump to, and the title of that section is a secondary keyword you want the page to rank for?
Algorithm Updates | | rwat

0
404s in Google Search Console and javascript

The end of April, we made the switch from http to https and I was prepared for a surge in crawl errors while Google sorted out our site. However, I wasn't prepared for the surge in impossibly incorrect URLs and partial URLs that I've seen since then. I have learned that as Googlebot grows up, he'she's now attempting to read more javascript and will occasionally try to parse out and "read" a URL in a string of javascript code where no URL is actually present. So, I've "marked as fixed" hundreds of bits like /TRo39,
category/cig
etc., etc.... But they are also returning hundreds of otherwise correct URLs with a .html extension when our CMS system generates URLs with a .uts extension like this: https://www.thompsoncigar.com/thumbnail/CIGARS/90-RATED-CIGARS/FULL-CIGARS/9012/c/9007/pc/8335.html
when it should be:
https://www.thompsoncigar.com/thumbnail/CIGARS/90-RATED-CIGARS/FULL-CIGARS/9012/c/9007/pc/8335.uts Worst of all, when I look at them in GSC and check the "linked from" tab it shows they are linked from themselves, so I can't backtrack and find a common source of the error. Is anyone else experiencing this? Got any suggestions on how to stop it from happening in the future? Last month it was 50 URLs, this month 150, so I can't keep creating redirects and hoping it goes away. Thanks for any and all suggestions!
Liz Micik
Algorithm Updates | | LizMicik

0
Google Adding / Manipulating Page Meta Titles?

We have a client who is experiencing some heavy google modification to the title tags being displayed on the search engine. It is adding "- 0 Reviews" to an ecommerce site. Obviously a bad start. There were no instances of these keywords anywhere on any of these pages, header tag or otherwise (on only a handful of the affected pages there was a single commented out image with an alt tag 0 reviews - but it was commented out and since removed) We have attempted to rewrite the title multiple times and it will modify the title but still include the non-relevant addition. Has anyone ever experienced anything like this?
Algorithm Updates | | Spindle

0
Is it stil a rule that Google will only index pages up to three tiers deep? Or has this changed?

I haven't looked into this in a while, it used to be that you didn't want to bury pages beyond three clicks from the main page. What is the rule now in order to have deep pages indexed?
Algorithm Updates | | seoessentials

0
Help on Page Load Time

I'm trying to track page load time of the visits on my site and GA only says to me that it's equal to zero and page load sample is aways zero too. I've made a research, and I found that GA is used to track page load time automatically, isn't it?
Algorithm Updates | | ivan.precisodisso

0
How did a competitor's brand name get in google's related search list?

When doing a google search for the term "ulster county real estate" the related search list at the bottom of the serp includes 7 obviously related search terms and 1 brand name of a competitor. (see attachment) The competitor doesn't rank for this term organically at all yet he enjoys a link on the first page with those of us that do by being in the related search list? I don't get it. Anyone know how something like this happens? Innhs.png
Algorithm Updates | | jhogan80

1
Manual query to search for backlinks?

Hello, I've been using open site explorer, dabbled with seo spy glass, and other back linking sites, but I was wondering if there was a manual way of searching for back links? Such as site.www.widgets.com +keyword -widgets.com to show me results of all the sites pointing to www.widgets.com, or pointing to the keywords linking to widgets.com. I do enjoy Open Site Explorer, but it takes a few months index the back links ive done.
Algorithm Updates | | Modbargains

0