undefined
Skip to content
Moz logo Menu open Menu close
  • Products
    • Moz Pro
    • Moz Pro Home
    • Moz Local
    • Moz Local Home
    • STAT
    • Moz API
    • Moz API Home
    • Compare SEO Products
    • Moz Data
  • Free SEO Tools
    • Domain Analysis
    • Keyword Explorer
    • Link Explorer
    • Competitive Research
    • MozBar
    • More Free SEO Tools
  • Learn SEO
    • Beginner's Guide to SEO
    • SEO Learning Center
    • Moz Academy
    • MozCon
    • Webinars, Whitepapers, & Guides
  • Blog
  • Why Moz
    • Digital Marketers
    • Agency Solutions
    • Enterprise Solutions
    • Small Business Solutions
    • The Moz Story
    • New Releases
  • Log in
  • Log out
  • Products
    • Moz Pro

      Your all-in-one suite of SEO essentials.

    • Moz Local

      Raise your local SEO visibility with complete local SEO management.

    • STAT

      SERP tracking and analytics for enterprise SEO experts.

    • Moz API

      Power your SEO with our index of over 44 trillion links.

    • Compare SEO Products

      See which Moz SEO solution best meets your business needs.

    • Moz Data

      Power your SEO strategy & AI models with custom data solutions.

    NEW Keyword Suggestions by Topic
    Moz Pro

    NEW Keyword Suggestions by Topic

    Learn more
  • Free SEO Tools
    • Domain Analysis

      Get top competitive SEO metrics like DA, top pages and more.

    • Keyword Explorer

      Find traffic-driving keywords with our 1.25 billion+ keyword index.

    • Link Explorer

      Explore over 40 trillion links for powerful backlink data.

    • Competitive Research

      Uncover valuable insights on your organic search competitors.

    • MozBar

      See top SEO metrics for free as you browse the web.

    • More Free SEO Tools

      Explore all the free SEO tools Moz has to offer.

    NEW Keyword Suggestions by Topic
    Moz Pro

    NEW Keyword Suggestions by Topic

    Learn more
  • Learn SEO
    • Beginner's Guide to SEO

      The #1 most popular introduction to SEO, trusted by millions.

    • SEO Learning Center

      Broaden your knowledge with SEO resources for all skill levels.

    • On-Demand Webinars

      Learn modern SEO best practices from industry experts.

    • How-To Guides

      Step-by-step guides to search success from the authority on SEO.

    • Moz Academy

      Upskill and get certified with on-demand courses & certifications.

    • MozCon

      Save on Early Bird tickets and join us in London or New York City

    Unlock flexible pricing & new endpoints
    Moz API

    Unlock flexible pricing & new endpoints

    Find your plan
  • Blog
  • Why Moz
    • Digital Marketers

      Simplify SEO tasks to save time and grow your traffic.

    • Small Business Solutions

      Uncover insights to make smarter marketing decisions in less time.

    • Agency Solutions

      Earn & keep valuable clients with unparalleled data & insights.

    • Enterprise Solutions

      Gain a competitive edge in the ever-changing world of search.

    • The Moz Story

      Moz was the first & remains the most trusted SEO company.

    • New Releases

      Get the scoop on the latest and greatest from Moz.

    Surface actionable competitive intel
    New Feature

    Surface actionable competitive intel

    Learn More
  • Log in
    • Moz Pro
    • Moz Local
    • Moz Local Dashboard
    • Moz API
    • Moz API Dashboard
    • Moz Academy
  • Avatar
    • Moz Home
    • Notifications
    • Account & Billing
    • Manage Users
    • Community Profile
    • My Q&A
    • My Videos
    • Log Out

The Moz Q&A Forum

  • Forum
  • Questions
  • Users
  • Ask the Community

Welcome to the Q&A Forum

Browse the forum for helpful insights and fresh discussions about all things SEO.

  1. Home
  2. SEO Tactics
  3. Intermediate & Advanced SEO
  4. After Server Migration - Crawling Gets slow and Dynamic Pages wherein Content changes are not getting Updated

Moz Q&A is closed.

After more than 13 years, and tens of thousands of questions, Moz Q&A closed on 12th December 2024. Whilst we’re not completely removing the content - many posts will still be possible to view - we have locked both new posts and new replies. More details here.

After Server Migration - Crawling Gets slow and Dynamic Pages wherein Content changes are not getting Updated

Intermediate & Advanced SEO
4
8
2.1k
Loading More Posts
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as question
Log in to reply
This topic has been deleted. Only users with question management privileges can see it.
  • Modi
    Modi last edited by Jun 19, 2015, 6:36 AM

    Hello,

    I have just performed doing server migration 2 days back

    All's well with traffic moved to new servers

    But somehow - it seems that w.r.t previous host that on submitting a new article - it was getting indexed in minutes. Now even after submitting page for indexing - its taking bit of time in coming to Search Engines and some pages wherein content is daily updated - despite submitting for indexing - changes are not getting reflected

    Site name is - http://www.mycarhelpline.com

    Have checked in robots, meta tags, url structure - all remains well intact. No unknown errors reports through Google webmaster

    Could someone advise - is it normal - due to name server and ip address change and expect to correct it automatically or am i missing something

    Kindly advise in . Thanks

    1 Reply Last reply Reply Quote 0
    • Modi
      Modi last edited by Jun 20, 2015, 12:52 PM Jun 20, 2015, 12:50 PM

      Thanks all for Inputs

      I searched Google and found this note from Google which may happen post server migration

      https://support.google.com/webmasters/answer/6033412?hl=en&ref_topic=6033383

      A note about Googlebot’s crawl rate

      It’s normal to see a temporary drop in Googlebot’s crawl rate immediately after the launch, followed by a steady increase over the next few weeks, potentially to rates that may be higher than from before the move.

      This fluctuation occurs because we determine crawl rate for a site based on many signals, and these signals change when your hosting changes. As long as Googlebot does not encounter any serious problems or slowdowns when accessing your new serving infrastructure, it will try to crawl your site as fast as necessary and possible.

      Add on Thompson Paul - Appreciate - yes its a good suggestion, will see to include sitemap

      1 Reply Last reply Reply Quote 0
      • ThompsonPaul
        ThompsonPaul last edited by Jun 20, 2015, 12:50 PM Jun 20, 2015, 9:51 AM

        The one thing you haven't mentioned, which is likely to be most critical for this issue, is your XML sitemap. I couldn't find it at any of the standard URLs (/sitemap.xml and /sitemap_index.xml both lead to generic 404 pages). Also, there's no directive to the sitemap in your robots.txt.

        Given that the sitemap.xml is the clearest and fastest way for you to help Google to discover new content, I'd strongly recommend you get a clean, dynamically updated sitemap.xml implemented for the site, submit it through both Google and Bing webmaster tools, and place the proper pointer to it in your robots.txt file.

        Once it's been submitted to the webmaster tools, you'll be able to see exactly how frequently its being discovered/crawled.

        Hope that helps?

        Paul

        1 Reply Last reply Reply Quote 1
        • Cyrus-Shepard
          Cyrus-Shepard @Modi last edited by Jun 20, 2015, 12:50 PM Jun 19, 2015, 11:43 PM

          The good news is, this actually sounds pretty normal. 24 hours to reflect changes in content is better than many sites. I can't account for why it dropped from 4 to 24, but I'd say this is still in the range of "good"

          1 Reply Last reply Reply Quote 1
          • Modi
            Modi @Cyrus-Shepard last edited by Jun 19, 2015, 10:56 PM Jun 19, 2015, 10:56 PM

            @ Cyrus

            Certain pages

            Earlier it was less than 4 hrs - but now its taking around 24 hrs - basis the data been updated in Search engine result just found today - i thought it was not getting updated at all

            Fetch & render - no issues, Its submitting. No errors in GWT

            Tested speed test - though no noticeable improvement in loading time - but no unnessary page size or load time been increased too

            I was wondering - can it be a temporary phenomena - where crawl speed is slow and later on will come back to normal. Its less than 72 hrs when server been migrated

            Google Search Console Crawl Stats is last updated for 16th June - so unable to figure it out from there. No errors in webmaster

            Cyrus-Shepard 1 Reply Last reply Jun 19, 2015, 11:43 PM Reply Quote 0
            • Cyrus-Shepard
              Cyrus-Shepard last edited by Jun 19, 2015, 4:09 PM Jun 19, 2015, 4:09 PM

              Howdy,

              A couple of questions:

              1. Are there certain pages that aren't getting updated, or is it your entire site?
              2. How often are changes in the pages reflected in Google's cache?

              Is it a case where Google simply displays old/outdated information all the time? Finally, have you done a "Fetch and Render" check in Google Webmaster Tools?

              Modi 1 Reply Last reply Jun 19, 2015, 10:56 PM Reply Quote 0
              • Modi
                Modi @vivekrathore last edited by Jun 19, 2015, 10:07 AM Jun 19, 2015, 10:07 AM

                @Anirban

                Thanks, no errors in GWT Tools. Loading time - could not observe a change. As per Gtmetrics - tested - is well within limits. Pages with dynamic content are not getting updated in Search Engine - which earlier was happening on immediate basis

                1 Reply Last reply Reply Quote 0
                • vivekrathore
                  vivekrathore last edited by Jun 19, 2015, 7:48 AM Jun 19, 2015, 7:48 AM

                  It should not be. check your page load time. If pages takes longer to load than google bot may bounce off. Check your webmaster tool as see if there are any server errors showing.

                  Modi 1 Reply Last reply Jun 19, 2015, 10:07 AM Reply Quote 0
                  • 1 / 1
                  1 out of 8
                  • First post
                    1/8
                    Last post

                  Got a burning SEO question?

                  Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.


                  Start my free trial


                  Browse Questions

                  Explore more categories

                  • Moz Tools

                    Chat with the community about the Moz tools.

                  • SEO Tactics

                    Discuss the SEO process with fellow marketers

                  • Community

                    Discuss industry events, jobs, and news!

                  • Digital Marketing

                    Chat about tactics outside of SEO

                  • Research & Trends

                    Dive into research and trends in the search industry.

                  • Support

                    Connect on product support and feature requests.

                  • See all categories

                  Related Questions

                  • ycnetpro101

                    Duplicate content in Shopify - subsequent pages in collections

                    Hello everyone! I hope an expert in this community can help me verify the canonical codes I'll add to our store is correct. Currently, in our Shopify store, the subsequent pages in the collections are not indexed by Google, however the canonical URL on these pages aren't pointing to the main collection page (page 1), e.g. The canonical URL of page 2, page 3 etc are used as canonical URLs instead of the first page of the collections. I have the canonical codes attached below, it would be much appreciated if an expert can urgently verify these codes are good to use and will solve the above issues? Thanks so much for your kind help in advance!! -----------------CODES BELOW--------------- <title><br /> {{ page_title }}{% if current_tags %} – tagged "{{ current_tags | join: ', ' }}"{% endif %}{% if current_page != 1 %} – Page {{ current_page }}{% endif %}{% unless page_title contains shop.name %} – {{ shop.name }}{% endunless %}<br /></title>
                    {% if page_description %} {% endif %} {% if current_page != 1 %} {% else %} {% endif %}
                    {% if template == 'collection' %}{% if collection %}
                    {% if current_page == 1 %} {% endif %}
                    {% if template == 'product' %}{% if product %} {% endif %}
                    {% if template == 'collection' %}{% if collection %} {% endif %}

                    Intermediate & Advanced SEO | Nov 6, 2019, 8:55 AM | ycnetpro101
                    0
                  • KenSchaefer

                    No Index thousands of thin content pages?

                    Hello all! I'm working on a site that features a service marketed to community leaders that allows the citizens of that community log 311 type issues such as potholes, broken streetlights, etc.  The "marketing" front of the site is 10-12 pages of content to be optimized for the community leader searchers however, as you can imagine there are thousands and thousands of pages of one or two line complaints such as, "There is a pothole on Main St. and 3rd." These complaint pages are not about the service, and I'm thinking not helpful to my end goal of gaining awareness of the service through search for the community leaders.  Community leaders are searching for "311 request service", not "potholes on main street". Should all of these "complaint" pages be NOINDEX'd?   What if there are a number of quality links pointing to the complaint pages?  Do I have to worry about losing Domain Authority if I do NOINDEX them? Thanks for any input. Ken

                    Intermediate & Advanced SEO | Feb 11, 2018, 9:03 AM | KenSchaefer
                    0
                  • SEOhmygod

                    Does content revealed by a 'show more' button get crawled by Google?

                    I have a div on my website with around 500 words of unique content in, automatically when the page is first visited the div has a fixed height of 100px, showing a couple of hundred words and fading out to white, with a show more button, which when clicked, increases the height to show the full content. My question is, does Google crawl the content in that div when it renders the page? Or disregard it? Its all in the source code. Or worse, do they consider this cloaking or hidden content? It is only there to make the site more useable for customers, so i don't want to get penalised for it. Cheers

                    Intermediate & Advanced SEO | Oct 11, 2016, 9:41 PM | SEOhmygod
                    0
                  • ennovators

                    Replace dynamic paramenter URLs with static Landing Page URL - faceted navigation

                    Hi there, got a quick question regarding faceted navigation. If a specific filter (facet) seems to be quite popular for visitors. Does it make sense to replace a dynamic URL e.x http://www.domain.com/pants.html?a_type=239 by a static, more SEO friendly URL e.x http://www.domain.com/pants/levis-pants.html by creating a proper landing page for it. I know, that it is nearly impossible to replace all variations of this parameter URLs by static ones but does it generally make sense to do this for the most popular facets choose by visitors. Or does this cause any issues? Any help is much appreciated. Thanks a lot in advance

                    Intermediate & Advanced SEO | Jul 9, 2015, 5:26 PM | ennovators
                    0
                  • JonathanLeplang

                    Contextual FAQ and FAQ Page, is this duplicate content?

                    Hi Mozzers, On my website, I have a FAQ Page (with the questions-responses of all the themes (prices, products,...)of my website) and I would like to add some thematical faq on the pages of my website. For example : adding the faq about pricing on my pricing page,... Is this duplicate content? Thank you for your help, regards. Jonathan

                    Intermediate & Advanced SEO | May 7, 2015, 3:02 AM | JonathanLeplang
                    0
                  • EndeR-

                    No-index pages with duplicate content?

                    Hello, I have an e-commerce website selling about 20 000 different products. For the most used of those products, I created unique high quality content. The content has been written by a professional player that describes how and why those are useful which is of huge interest to buyers. It would cost too much to write that high quality content for 20 000 different products, but we still have to sell them. Therefore, our idea was to no-index the products that only have the same copy-paste descriptions all other websites have. Do you think it's better to do that or to just let everything indexed normally since we might get search traffic from those pages? Thanks a lot for your help!

                    Intermediate & Advanced SEO | Jul 30, 2014, 4:18 PM | EndeR-
                    0
                  • Thos003

                    Server Migration, Does it effect SEO?

                    About to go through a server migration. My intitial thought is that a change in servers shouldn't really change my rankings. But I've heard rumors... Can a server migration change rankings? Why?

                    Intermediate & Advanced SEO | Sep 10, 2012, 8:10 PM | Thos003
                    0
                  • WSOT

                    How get rid of duplicate content, titles, etc on php cartweaver site?

                    my website http://www.bartramgallery.com was created using php and cartweaver  2.0 about five years ago by a web developer.  I was really happy with the results of the design was inspired to get into web development and have been studying ever since.  My biggest problem at this time is that I am not knowledgable with php and the cartweaver product but am learning as I read more.  The issue is that seomoz tools are reporting tons of duplicate content and duplicate title pages etc.  This is likely from the dynamic urls and same pages with secondary results etc.  I just made a new sitemap with auditmypc I think it was called in an attempt to get rid of all the duplicate page titles but is that going to solve anything or do I need to find another way to configure the site?  There are many pages with the same content competing for page rank and it is a bit frustrating to say the least.  If anyone has any advice it would be greatly appreciated even pointing me in the right direction. Thank you, Jesse

                    Intermediate & Advanced SEO | Dec 29, 2011, 12:17 AM | WSOT
                    0

                  Get started with Moz Pro!

                  Unlock the power of advanced SEO tools and data-driven insights.

                  Start my free trial
                  Products
                  • Moz Pro
                  • Moz Local
                  • Moz API
                  • Moz Data
                  • STAT
                  • Product Updates
                  Moz Solutions
                  • SMB Solutions
                  • Agency Solutions
                  • Enterprise Solutions
                  Free SEO Tools
                  • Domain Authority Checker
                  • Link Explorer
                  • Keyword Explorer
                  • Competitive Research
                  • Brand Authority Checker
                  • Local Citation Checker
                  • MozBar Extension
                  • MozCast
                  Resources
                  • Blog
                  • SEO Learning Center
                  • Help Hub
                  • Beginner's Guide to SEO
                  • How-to Guides
                  • Moz Academy
                  • API Docs
                  About Moz
                  • About
                  • Team
                  • Careers
                  • Contact
                  Why Moz
                  • Case Studies
                  • Testimonials
                  Get Involved
                  • Become an Affiliate
                  • MozCon
                  • Webinars
                  • Practical Marketer Series
                  • MozPod
                  Connect with us

                  Contact the Help team

                  Join our newsletter
                  Moz logo
                  © 2021 - 2025 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
                  • Accessibility
                  • Terms of Use
                  • Privacy

                  Looks like your connection to Moz was lost, please wait while we try to reconnect.