undefined
Skip to content
Moz logo Menu open Menu close
  • Products
    • Moz Pro
    • Moz Pro Home
    • Moz Local
    • Moz Local Home
    • STAT
    • Moz API
    • Moz API Home
    • Compare SEO Products
    • Moz Data
  • Free SEO Tools
    • Domain Analysis
    • Keyword Explorer
    • Link Explorer
    • Competitive Research
    • MozBar
    • More Free SEO Tools
  • Learn SEO
    • Beginner's Guide to SEO
    • SEO Learning Center
    • Moz Academy
    • SEO Q&A
    • Webinars, Whitepapers, & Guides
  • Blog
  • Why Moz
    • Agency Solutions
    • Enterprise Solutions
    • Small Business Solutions
    • Case Studies
    • The Moz Story
    • New Releases
  • Log in
  • Log out
  • Products
    • Moz Pro

      Your all-in-one suite of SEO essentials.

    • Moz Local

      Raise your local SEO visibility with complete local SEO management.

    • STAT

      SERP tracking and analytics for enterprise SEO experts.

    • Moz API

      Power your SEO with our index of over 44 trillion links.

    • Compare SEO Products

      See which Moz SEO solution best meets your business needs.

    • Moz Data

      Power your SEO strategy & AI models with custom data solutions.

    NEW Keyword Suggestions by Topic
    Moz Pro

    NEW Keyword Suggestions by Topic

    Learn more
  • Free SEO Tools
    • Domain Analysis

      Get top competitive SEO metrics like DA, top pages and more.

    • Keyword Explorer

      Find traffic-driving keywords with our 1.25 billion+ keyword index.

    • Link Explorer

      Explore over 40 trillion links for powerful backlink data.

    • Competitive Research

      Uncover valuable insights on your organic search competitors.

    • MozBar

      See top SEO metrics for free as you browse the web.

    • More Free SEO Tools

      Explore all the free SEO tools Moz has to offer.

    What is your Brand Authority?
    Moz

    What is your Brand Authority?

    Check yours now
  • Learn SEO
    • Beginner's Guide to SEO

      The #1 most popular introduction to SEO, trusted by millions.

    • SEO Learning Center

      Broaden your knowledge with SEO resources for all skill levels.

    • On-Demand Webinars

      Learn modern SEO best practices from industry experts.

    • How-To Guides

      Step-by-step guides to search success from the authority on SEO.

    • Moz Academy

      Upskill and get certified with on-demand courses & certifications.

    • SEO Q&A

      Insights & discussions from an SEO community of 500,000+.

    Unlock flexible pricing & new endpoints
    Moz API

    Unlock flexible pricing & new endpoints

    Find your plan
  • Blog
  • Why Moz
    • Small Business Solutions

      Uncover insights to make smarter marketing decisions in less time.

    • Agency Solutions

      Earn & keep valuable clients with unparalleled data & insights.

    • Enterprise Solutions

      Gain a competitive edge in the ever-changing world of search.

    • The Moz Story

      Moz was the first & remains the most trusted SEO company.

    • Case Studies

      Explore how Moz drives ROI with a proven track record of success.

    • New Releases

      Get the scoop on the latest and greatest from Moz.

    Surface actionable competitive intel
    New Feature

    Surface actionable competitive intel

    Learn More
  • Log in
    • Moz Pro
    • Moz Local
    • Moz Local Dashboard
    • Moz API
    • Moz API Dashboard
    • Moz Academy
  • Avatar
    • Moz Home
    • Notifications
    • Account & Billing
    • Manage Users
    • Community Profile
    • My Q&A
    • My Videos
    • Log Out

The Moz Q&A Forum

  • Forum
  • Questions
  • Users
  • Ask the Community

Welcome to the Q&A Forum

Browse the forum for helpful insights and fresh discussions about all things SEO.

  1. Home
  2. SEO Tactics
  3. Technical SEO
  4. Site Audit Tools Not Picking Up Content Nor Does Google Cache

Moz Q&A is closed.

After more than 13 years, and tens of thousands of questions, Moz Q&A closed on 12th December 2024. Whilst we’re not completely removing the content - many posts will still be possible to view - we have locked both new posts and new replies. More details here.

Site Audit Tools Not Picking Up Content Nor Does Google Cache

Technical SEO
4
9
1.3k
Loading More Posts
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as question
Log in to reply
This topic has been deleted. Only users with question management privileges can see it.
  • nezona
    nezona Subscriber last edited by Dec 17, 2018, 9:11 AM

    Hi Guys,

    Got a site I am working with on the Wix platform. However site audit tools such as Screaming Frog, Ryte and even Moz's onpage crawler show the pages having no content, despite them having 200 words+. Fetching the site as Google clearly shows the rendered page with content, however when I look at the Google cached pages, they also show just blank pages.

    I have had issues with nofollow, noindex on here, but it shows the meta tags correct, just 0 content.

    What would you look to diagnose? I am guessing some rogue JS but why wasn't this picked up on the "fetch as Google".

    dmfitrs12312 1 Reply Last reply Feb 13, 2024, 6:12 PM Reply Quote 0
    • dmfitrs12312
      dmfitrs12312 @nezona last edited by Feb 13, 2024, 6:12 PM

      @nezona
      DM Fitrs
      Facing issues with site audit tools and Google Cache not picking up content can be a technical puzzle to solve. It's crucial to address these challenges for a smoother online presence. Similarly, in managing our digital responsibilities, like checking PESCO online bills, reliability is key. Just as we troubleshoot website-related matters, staying on top of utility payments ensures a hassle-free experience. Navigate technical hiccups, both in website diagnostics and bill management, to maintain a seamlessly connected online routine.

      1 Reply Last reply Reply Quote 0
      • lobor
        lobor last edited by Feb 9, 2024, 8:58 AM

        Hi Team,
        I am facing problem with one of my website where google is caching the page when checked using cache: operator but displaying a 404 msg in the body of the cached version.
        But when i check the same in 'text-only version' the complete content and element is visible to Google and also GSC shows the page with no issue and rendering is also fine.
        The canonicals and robots are properly set with no issues on them.
        Not able to figure out what is the problem. Experts advice would help!

        Regards,
        Ryanimage (2).png

        1 Reply Last reply Reply Quote 0
        • effectdigital
          effectdigital last edited by Dec 19, 2018, 9:44 AM Dec 19, 2018, 9:38 AM

          Hey Neil 🙂

          Wow, we are really chuffed here at Effect Digital! I guess... we have a lot of combined experience - and we also try to give something back to the community (as well as making profit, obviously)

          We didn't actually know how many people used the Moz Q&A forum until recently. It seemed like a good hub to demonstrate that, not all agency accounts have to exist to give shallow 1-liner replies from a position of complete ignorance (usually just so they can link spam the comments). Groups of people, **can **be insightful and 'to the point'

          Again we're just really thrilled that you found our analysis to be useful. It also shows what goes into what we do. Most of the responses on here which are under-detailed have the potential to lead people down rabbit holes. Sometimes you just have to get into the thick of it right?

          I think our email address is publicly listed on our profile page. Feel free to hit us up

          1 Reply Last reply Reply Quote 0
          • nezona
            nezona Subscriber @effectdigital last edited by Dec 19, 2018, 8:35 AM Dec 19, 2018, 8:35 AM

            My Friend,

            That is some analysis you have done there!! and I am eternally greatful. It's people like you, who are clearly so passionate about SEO, that make our industry amazing!!

            I am going to private message you a longer reply, later but i just wanted to publicly say thank you!!

            Regards

            Neil

            1 Reply Last reply Reply Quote 1
            • effectdigital
              effectdigital @nezona last edited by Dec 18, 2018, 11:34 AM Dec 18, 2018, 11:31 AM

              Ok let's have a look here.

              So this is the URL of the page you want me to look at:

              • https://www.nubalustrades.co.uk/

              I can immediately tell you that, from my end it doesn't look like Google has even cached this page at all:

              • http://webcache.googleusercontent.com/search?q=cache:https%3A%2F%2Fwww.nubalustrades.co.uk%2F (live)
              • https://d.pr/i/DhmPEr.png (screenshot)

              As you know I can't fetch someone else's web page as Google, but I do know Screaming Frog pretty well so let's give that a blast

              First let's try a quick crawl with no client-side rendering enabled, see what that comes back with:

              • https://d.pr/f/u3bifA.seospider (SF crawl file)
              • https://d.pr/f/9TfNR5.xlsx (Excel spreadsheet output)

              Seems as if, even without rendered crawling the words are being picked up:

              • https://d.pr/i/426Ck9.png

              Only the rows highlighted in green (the 'core' site URLs) should have a word count anyway. The other URLs are fragments and resources. They're scripts, stylesheets, images etc (none of which need copy).

              Let's try a rendered crawl, see what we get:

              • https://d.pr/f/ijprbx.seospider (SF crawl file)
              • https://d.pr/f/c8ljoF.xlsx (Excel spreadsheet output)

              Again - it seems as if the words are picked up, though oddly fewer are picked up with rendered crawling than with a simple AJAX source scrape:

              • https://d.pr/i/y3Jv51.png

              That could easily be something to do with my time-out or render-wait settings though (that being said I did give a pretty generous 23 seconds so...)

              In any case, it seems to me that the content is search readable in either event.

              Let's look at the homepage specifically in more detail. Basically if content appears in "inspect element" but not in "view source", **that's **when you know you have a real problem

              • view-source:https://www.nubalustrades.co.uk/ - (you can only open this link with Chrome browser, it's free to download from Google)

              As you can see, lots of the content does indeed appear in the 'base' source code:

              • https://d.pr/i/8BzTjd.png

              That's a good thing.

              That being said, each piece of content seems to be replicated twice in the source code which is really weird and may be creating some content duplication issues, if Google's more simple crawl-bots aren't taking the time to analyse the source code correctly.

              Go back here:

              • view-source:https://www.nubalustrades.co.uk/ - (this link only works in Chrome!)

              Ctrl+F to find the string of text: "issued by the British Standards Institution". Hit enter a few times. You'll see the page jump about.

              On the one hand you have this, further up the page which looks alright:

              https://d.pr/i/8AlJJ1.png

              On the other hand you have this further down which looks like a complete mess, embedded within some kind of script or something?

              https://d.pr/i/mJJaqa.png

              Line 6,212 of the source code is some gigantic JavaScript thing which has been in-lined (and don't get me started on how this site is over-using inline code in general, for CSS, JS - everything). No idea what it's for or does, might be deferred stuff to boost page speed without breaking the visuals or whatever (there are many clever tricks like that, but they make the source code a virtually unreadable mess for a human - let alone a programmed bot!)

              What really concerns me is why such a simple page needs to have 6,250 lines of source code. That's mental!

              What we all forget is that, whilst the crawl and fetch bots pull information quickly - Google's algorithms have to be run over the top of that source code and data (which is a much more complex affair)

              Usually people think that  normalizing the code-to-text ratio is a pointless SEO maneuver and in most cases, yes the return is vastly outweighed by the time taken to do it. But in your case it's actually very extreme:

              • https://www.prepostseo.com/code-to-text-ratio

              Put your URL in and you'll get this:

              • https://d.pr/i/nXBu0S.png

              I tried like 5-8 different tools and this was the most favorable result :')

              It is clear that, even were the page successfully downloaded by Google, their algorithms may have trouble hunting out the nuggets of content within the vast, sprawling and unnecessary coding structure. My older colleagues had always warned me away from Wix... now I can see why, with my own two eyes

              Ok. So we know that Google isn't bothering to cache the page, and that - despite the fact your content can 'technically' be crawled, it may be a marathon to do that and dig it out (especially for non-intelligent robots)

              But is the content being indexed? Let's check:

              • https://www.google.co.uk/search?q=site%3Anubalustrades.co.uk+%22issued+by+the+British+Standards+Institution%22
              • https://www.google.co.uk/search?num=100&ei=q_MYXMj3EM_srgSNh6LYCQ&q=site%3Anubalustrades.co.uk+%22product+and+your+happy+with%22
              • https://www.google.co.uk/search?num=100&ei=6vMYXPuLC4yYsAXAoKfAAg&q=site%3Anubalustrades.co.uk+%22Some+customers+like+to+have+more+than+one+balustrade%22
              • https://www.google.co.uk/search?num=100&ei=CPQYXOmJFYu6tQXi8arwBA&q=site%3Anubalustrades.co.uk+%22installations+which+will+help+you+visualise+your+future+project%22
              • https://www.google.co.uk/search?num=100&ei=KvQYXMyhC4LStAWopbqACg&q=site%3Anubalustrades.co.uk+%22Cleanly-designed%2C+high-quality+handrail+systems+combined+with+attention%22

              Those are all special Google search queries, designed to specifically search for strings of content on your website from all the different, primary content boxes

              Good news fella, it's all being found:

              • https://d.pr/i/Zlb926.png

              Let's make up an invalid text string and see what Google returns when text can't be found, to validate our findings thus-far:

              • https://www.google.co.uk/search?num=100&ei=SfQYXJitEomwtQWRk43QDg&q=site%3Anubalustrades.co.uk+%22what+the+heck+I+don%27t+even+I+never+wrote+this+on+my+site+how+dare+you%22

              If nothing is found you get this:

              • https://d.pr/i/FGvT49.png

              So I guess Google can find your content and is indexing your content

              Phew, crisis over! Onto the next one...

              nezona 1 Reply Last reply Dec 19, 2018, 8:35 AM Reply Quote 2
              • nezona
                nezona Subscriber @effectdigital last edited by Dec 18, 2018, 10:00 AM Dec 18, 2018, 10:00 AM

                Hi There,

                This is the URL:-

                https://www.nubalustrades.co.uk/

                Be great if you could give me your opinion. I am thinking that this content isn't being indexed.

                Regards

                Neil

                effectdigital 1 Reply Last reply Dec 18, 2018, 11:31 AM Reply Quote 0
                • effectdigital
                  effectdigital last edited by Dec 18, 2018, 6:12 AM Dec 18, 2018, 6:12 AM

                  If you can share a link to the site I can probably diagnose it. It's probably that the content is within the modified (client-side rendered) source code, rather than the 'base' (non-modified) source code. Google fetches pages in multiple different ways, so using fetch as Google artificially makes it seem as if they always use exactly the same crawling technology. They don't.

                  Google 'can' crawl modified content. But they don't always do it, and they don't do it for everyone. Rendered crawling takes like... 10x longer than basic source scraping. Their mission is to index the web!

                  The fetch tool shows you their best-case scenario crawling methodology. Don't assume their indexation bots, which have a mountain to climb - will always be so favourable

                  nezona 1 Reply Last reply Dec 18, 2018, 10:00 AM Reply Quote 0
                  • nezona
                    nezona Subscriber last edited by Dec 17, 2018, 9:51 AM Dec 17, 2018, 9:51 AM

                    Just an update on this one

                    Looks like it may be a problem with Wix

                    https://moz.com/community/q/wix-problem-with-on-page-optimization-picking-up-seo

                    I have another client who also uses Wix and they also show now content in screaming frog but worryingly their pages show in a cached version of the site. I know the "cache" isn't the best way to see what content is indexed and the fetch as Google is fine.

                    I just get the feeling something isn't right.

                    1 Reply Last reply Reply Quote 0
                    • 1 / 1
                    1 out of 9
                    • First post
                      1/9
                      Last post

                    Got a burning SEO question?

                    Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.


                    Start my free trial


                    Browse Questions

                    Explore more categories

                    • Moz Tools

                      Chat with the community about the Moz tools.

                    • SEO Tactics

                      Discuss the SEO process with fellow marketers

                    • Community

                      Discuss industry events, jobs, and news!

                    • Digital Marketing

                      Chat about tactics outside of SEO

                    • Research & Trends

                      Dive into research and trends in the search industry.

                    • Support

                      Connect on product support and feature requests.

                    • See all categories

                    Related Questions

                    • QuantumWeb62

                      Removing site subdomains from Google search

                      Hi everyone, I hope you are having a good week? My website has several subdomains that I had shut down some time back and pages on these subdomains are still appearing in the Google search result pages. I want all the URLs from these subdomains to stop appearing in the Google search result pages and I was hoping to see if anyone can help me with this. The subdomains are no longer under my control as I don't have web hosting for these sites (so these subdomain sites just show a default hosting server page). Because of this, I cannot verify these in search console and submit a url/site removal request to Google. In total, there are about 70 pages from these subdomains showing up in Google at the moment and I'm concerned in case these pages have any negative impacts on my SEO. Thanks for taking the time to read my post.

                      Technical SEO | Jul 27, 2016, 4:24 AM | QuantumWeb62
                      0
                    • Francis.Magos

                      Why does my Google Web Cache Redirects to My Homepage?

                      Why does my Google Webcache appears in a short period of time and then automatically redirects to my homepage? Is there something wrong with my robots.txt? The only files that I have blocked is below: User-agent: * Disallow: /bin/ Disallow: /common/ Disallow: /css/ Disallow: /download/ Disallow: /images/ Disallow: /medias/ Disallow: /ClientInfo.aspx Disallow: /*affiliateId* Disallow: /*referral*

                      Technical SEO | Jun 16, 2016, 6:08 AM | Francis.Magos
                      0
                    • SarahLK

                      Removed Subdomain Sites Still in Google Index

                      Hey guys, I've got kind of a strange situation going on and I can't seem to find it addressed anywhere.  I have a site that at one point had several development sites set up at subdomains.  Those sites have since launched on their own domains, but the subdomain sites are still showing up in the Google index.  However, if you look at the cached version of pages on these non-existent subdomains, it lists the NEW url, not the dev one in the little blurb that says "This is Google's cached version of www.correcturl.com."  Clearly Google recognizes that the content resides at the new location, so how come the old pages are still in the index?  Attempting to visit one of them gives a "Server Not Found" error, so they are definitely gone. This is happening to a couple of sites, one that was launched over a year ago so it doesn't appear to be a "wait and see" solution. Any suggestions would be a huge help.  Thanks!!

                      Technical SEO | Apr 9, 2015, 2:07 PM | SarahLK
                      0
                    • melen

                      Staging site and "live" site have both been indexed by Google

                      While creating a site we forgot to password protect the staging site while it was being built.  Now that the site has been moved to the new domain, it has come to my attention that both the staging site (site.staging.com) and the "live" site (site.com) are both being indexed.  What is the best way to solve this problem?  I was thinking about adding a 301 redirect from the staging site to the live site via HTACCESS. Any recommendations?

                      Technical SEO | Sep 16, 2013, 6:51 PM | melen
                      0
                    • sparts

                      Why is my site jumping around in google search ?

                      Hi I've been trying to get my page up in google results and I was wondering why the constant fluctuation. For example, on one day the pages is nr. 26, the next day it's nr. 65 then jumps back on say 30 and then in a few more days it's going back to 50. What's the logic behind that ? Thanks Cezar

                      Technical SEO | Oct 16, 2012, 1:43 PM | sparts
                      1
                    • lemonz

                      How does Google Crawl Multi-Regional Sites?

                      I've been reading up on this on Webmaster Tools but just wanted to see if anyone could explain it a bit better. I have a website which is going live soon which is going to be set up to redirect to a localised URL based on the IP address i.e. NZ IP ranges will go to .co.nz, Aus IP addresses would go to .com.au and then USA or other non-specified IP addresses will go to the .com address. There is a single CMS installation for the website. Does this impact the way in which Google is able to search the site? Will all domains be crawled or just one? Any help would be great - thanks!

                      Technical SEO | Oct 2, 2012, 9:16 PM | lemonz
                      0
                    • JamesDixon70

                      Google Cache Version and Text Only Version are different

                      Across various websites we found Google cache version in the browser loads the full site and all content is visible. However when we try to view TEXT only version of the same page we can't see any content. Example: we have a client with JS scroller menu on the home page. Each scroller serves a separate content section on the same URL. When we copy paste some of the page content in Google, we can see that copy indexed in Google search results as well as showing in Cache version . But as soon as we go into Text Only version we cant see the same copy. We would like to know which version we should trust, Google cache version or the TEXT only version.

                      Technical SEO | Sep 13, 2012, 10:49 PM | JamesDixon70
                      0
                    • dsexton10

                      Content loc and player log tags for XML video site maps

                      I need a little help understanding how to create two of the required tags for a XML video  site map for Google. 1. video:content_loc2.<video:player_loc< p=""></video:player_loc<></video:content_loc> Google explains their Video XML Site map requirements here:
                      www.google.com/support/webmasters/bin/answer.py?answer=80472
                      Using the example on this Google Web Master Help page (where they explain all six of the required tags) , here are examples of the two  tags I need help with: video:content_locwww.example.com/video123.flv</video:content_loc> <video:player_loc allow_embed="yes" autoplay="ap=1">www.example.com/videoplayer.swf?video=12...video:player_loc></video:player_loc> The video I am trying to optimize is located on a page on my site:
                      www.mountainbikingmaine.com/races/bradbury_hawk.html
                      This page has an embedded Vimeo video. So I don't have the video file on my domain. It is on Vimeo. Here is source code from my page that I think provides the information I need to create the two tags that Google requires. <iframe src="<a rel=" nofollow"="" href="http://player.vimeo.com/video/24580638?title=0&byline=0&portrait=0"" target="_blank">player.vimeo.com/video/24580638?title=0&...amp;portrait=0"</a> width="400" height="533" frameborder="0"></iframe> [vimeo.com/24580638">Bradbury](<a rel=) Mountain Maine Hawk Migration Count from [vimeo.com/user3219915">dan](<a rel=) sexton Using this source from my site, can you suggest what to put in the two tags? Thanks! Dan

                      Technical SEO | Aug 14, 2012, 12:04 AM | dsexton10
                      0

                    Get started with Moz Pro!

                    Unlock the power of advanced SEO tools and data-driven insights.

                    Start my free trial
                    Products
                    • Moz Pro
                    • Moz Local
                    • Moz API
                    • Moz Data
                    • STAT
                    • Product Updates
                    Moz Solutions
                    • SMB Solutions
                    • Agency Solutions
                    • Enterprise Solutions
                    Free SEO Tools
                    • Domain Authority Checker
                    • Link Explorer
                    • Keyword Explorer
                    • Competitive Research
                    • Brand Authority Checker
                    • MozBar Extension
                    • MozCast
                    Resources
                    • Blog
                    • SEO Learning Center
                    • Help Hub
                    • Beginner's Guide to SEO
                    • How-to Guides
                    • Moz Academy
                    • API Docs
                    About Moz
                    • About
                    • Team
                    • Careers
                    • Contact
                    Why Moz
                    • Case Studies
                    • Testimonials
                    Get Involved
                    • Become an Affiliate
                    • MozCon
                    • Webinars
                    • Practical Marketer Series
                    • MozPod
                    Connect with us

                    Contact the Help team

                    Join our newsletter
                    Moz logo
                    © 2021 - 2025 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
                    • Accessibility
                    • Terms of Use
                    • Privacy

                    Looks like your connection to Moz was lost, please wait while we try to reconnect.