Javascript content not being indexed by Google
-
I thought Google has gotten better at picking up unique content from javascript. I'm not seeing it with our site. We rate beauty and skincare products using our algorithms. Here is an example of a product -- https://www.skinsafeproducts.com/tide-free-gentle-he-liquid-laundry-detergent-100-fl-oz
When you look at the cache page (text) from google none of the core ratings (badges like fragrance free, top free and so forth) are being picked up for ranking. Any idea what we could do to have the rating incorporated in the indexation.
-
Hello!
Pretty sure the issue is that this content requires a user action before being seen. Google will not crawl/index content which is not loaded until the user interacts. This post is a great resource %20Summary:%20How%20to%20Make%20Your%20Company%20Diverse%20Without%20Focusing%20on%20Diversity%20%20%20Name:%20Heather%20Huhman%20Spark%20Hire%20%20Category:%20Business%20and%20Finance%20%20%20Email:%20query-7wru@helpareporter.net%20%20%20Media%20Outlet:%20Spark%20Hire%20%20Deadline:%205:00%20PM%20EST%20-%2023%20April%20%20%20Query:%20%20%20LinkedIn's%20most%20recent%20Global%20Recruiting%20Trends%20report,%20recruiters%20say%20their%20top%20focus%20is%20on%20diversity%20and%20inclusion.%20But%20when%20it%20comes%20to%20hiring%20for%20diversity,%20there's%20a%20misunderstanding%20that%20the%20focus%20must%20be%20on%20the%20ethnicity,%20race,%20and%20sex%20of%20candidates.%20We're%20looking%20for%20insight%20into%20how%20hiring%20pros%20can%20break%20out%20of%20that%20rigid%20diversity%20box%20and%20find%20creative%20ways%20to%20hire%20diverse%20candidates%20who%20will%20positively%20impact%20various%20aspects%20of%20their%20company.%20Responses%20that%20are%20selected%20will%20be%20featured%20on%20the%20Spark%20Hire%20blog%20and%20promoted%20to%20over%2010K%20blog%20subscribers.%20%20Please%20respond%20to%20the%20following%20questions:%20%20How%20can%20focusing%20only%20on%20the%20ethnicity,%20race,%20and%20sex%20of%20candidates%20hurt%20hiring%20pros'%20efforts%20of%20hiring%20the%20best%20diverse%20candidates?%20What%20other%20candidate%20factors%20can%20hiring%20pros%20look%20into%20to%20find%20diverse%20candidates?%20Please%20share%20a%20story%20of%20a%20time%20when%20you%20or%20a%20fellow%20hiring%20pro%20narrowed%20your%20diversity%20focus%20too%20much,%20resulting%20in%20hires%20that%20weren%27t%20the%20best%20fit%20for%20the%20company.%20How%20can%20hiring%20professionals%20create%20a%20unique%20hiring%20strategy%20to%20attract%20diverse%20candidates%20who%20are%20the%20best%20fit%20for%20their%20open%20roles%20and%20company?%20%20Requirements:%20%20%20Please%20send%20your%20input%20in%20your%20initial%20response%20(don%27t%20send%20requests%20for%20interviews%20or%20article%20links).%20Include%20%22How%20to%20Make%20Your%20Company%20Diverse%20Without%20Focusing%20on%20Diversity%22%20in%20the%20subject%20line.%20Answer%20each%20question%20separately.%20Keep%20answers%20brief%20but%20informative.%20%20Include:%20%20Your%20title%20and%20qualifications%20Contact%20information,%20including%20an%20email%20Headshot%20(must%20be%20a%20link%20and%20at%20least%20200x200)%20Twitter%20handle%20%20Thank%20You.)on JS auditing/crawling%20Summary:%20How%20to%20Make%20Your%20Company%20Diverse%20Without%20Focusing%20on%20Diversity%20%20%20Name:%20Heather%20Huhman%20Spark%20Hire%20%20Category:%20Business%20and%20Finance%20%20%20Email:%20query-7wru@helpareporter.net%20%20%20Media%20Outlet:%20Spark%20Hire%20%20Deadline:%205:00%20PM%20EST%20-%2023%20April%20%20%20Query:%20%20%20LinkedIn's%20most%20recent%20Global%20Recruiting%20Trends%20report,%20recruiters%20say%20their%20top%20focus%20is%20on%20diversity%20and%20inclusion.%20But%20when%20it%20comes%20to%20hiring%20for%20diversity,%20there's%20a%20misunderstanding%20that%20the%20focus%20must%20be%20on%20the%20ethnicity,%20race,%20and%20sex%20of%20candidates.%20We're%20looking%20for%20insight%20into%20how%20hiring%20pros%20can%20break%20out%20of%20that%20rigid%20diversity%20box%20and%20find%20creative%20ways%20to%20hire%20diverse%20candidates%20who%20will%20positively%20impact%20various%20aspects%20of%20their%20company.%20Responses%20that%20are%20selected%20will%20be%20featured%20on%20the%20Spark%20Hire%20blog%20and%20promoted%20to%20over%2010K%20blog%20subscribers.%20%20Please%20respond%20to%20the%20following%20questions:%20%20How%20can%20focusing%20only%20on%20the%20ethnicity,%20race,%20and%20sex%20of%20candidates%20hurt%20hiring%20pros'%20efforts%20of%20hiring%20the%20best%20diverse%20candidates?%20What%20other%20candidate%20factors%20can%20hiring%20pros%20look%20into%20to%20find%20diverse%20candidates?%20Please%20share%20a%20story%20of%20a%20time%20when%20you%20or%20a%20fellow%20hiring%20pro%20narrowed%20your%20diversity%20focus%20too%20much,%20resulting%20in%20hires%20that%20weren%27t%20the%20best%20fit%20for%20the%20company.%20How%20can%20hiring%20professionals%20create%20a%20unique%20hiring%20strategy%20to%20attract%20diverse%20candidates%20who%20are%20the%20best%20fit%20for%20their%20open%20roles%20and%20company?%20%20Requirements:%20%20%20Please%20send%20your%20input%20in%20your%20initial%20response%20(don%27t%20send%20requests%20for%20interviews%20or%20article%20links).%20Include%20%22How%20to%20Make%20Your%20Company%20Diverse%20Without%20Focusing%20on%20Diversity%22%20in%20the%20subject%20line.%20Answer%20each%20question%20separately.%20Keep%20answers%20brief%20but%20informative.%20%20Include:%20%20Your%20title%20and%20qualifications%20Contact%20information,%20including%20an%20email%20Headshot%20(must%20be%20a%20link%20and%20at%20least%20200x200)%20Twitter%20handle%20%20Thank%20You.) and will show you how to use Chrome's 'inspect element' as a better way to see what's going on.
But in general, the content needs to load before a user action takes place (even if in JS) and yes Google is getting better, but won't look at anything behind a click. Google just confirmed this at their recent I/O conference, stating that they do render JavaScript but it could be a week after they first render the normal HTML.
-Dan
PS - Huge apologies for the delay in answering, Moz was having technical issues with the backend of the forum, affecting the ability to reply to some questions.
-
Hi akih,
I don't believe the "text-only" cache is representative of Google's index. They process JavaScript via their rendering service before they index content - so the full cached version is a more accurate representation of the content Google has seen/indexed.
Also, I ran a search for your site using a snippet of copy from the "Common Preservative Free" badge, and Google is returning pages with this text in the displayed page description. Here's a link to the SERP for the query I used.
I'd say Google's able to see and index this content just fine - it's just the "text-only" cached content does not include any JavaScript-rendered content.
Best,
Mike
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Content Strategy/Duplicate Content Issue, rel=canonical question
Hi Mozzers: We have a client who regularly pays to have high-quality content produced for their company blog. When I say 'high quality' I mean 1000 - 2000 word posts written to a technical audience by a lawyer. We recently found out that, prior to the content going on their blog, they're shipping it off to two syndication sites, both of which slap rel=canonical on them. By the time the content makes it to the blog, it has probably appeared in two other places. What are some thoughts about how 'awful' a practice this is? Of course, I'm arguing to them that the ranking of the content on their blog is bound to be suffering and that, at least, they should post to their own site first and, if at all, only post to other sites several weeks out. Does anyone have deeper thinking about this?
Intermediate & Advanced SEO | | Daaveey0 -
Google Docs
Hi Mozers, I was wondering what do you guys think about indexing Google Docs files as Documents or Spreadsheets? Can you do that and is it any help if you what to get some content on the firs page of Google. And also can Google see that content and links, because when I deactivate the javascript on chrome I couldn't see anything from the content Thanks
Intermediate & Advanced SEO | | VeeamSoftware0 -
"Null" appearing as top keyword in "Content Keywords" under Google index in Google Search Console
Hi, "Null" is appearing as top keyword in Google search console > Google Index > Content Keywords for our site http://goo.gl/cKaQ4K . We do not use "null" as keyword on site. We are not able to find why Google is treating "null" as a keyword for our site. Is anyone facing such issue. Thanks & Regards
Intermediate & Advanced SEO | | vivekrathore0 -
Best way to remove full demo (staging server) website from Google index
I've recently taken over an in-house role at a property auction company, they have a main site on the top-level domain (TLD) and 400+ agency sub domains! company.com agency1.company.com agency2.company.com... I recently found that the web development team have a demo domain per site, which is found on a subdomain of the original domain - mirroring the site. The problem is that they have all been found and indexed by Google: demo.company.com demo.agency1.company.com demo.agency2.company.com... Obviously this is a problem as it is duplicate content and so on, so my question is... what is the best way to remove the demo domain / sub domains from Google's index? We are taking action to add a noindex tag into the header (of all pages) on the individual domains but this isn't going to get it removed any time soon! Or is it? I was also going to add a robots.txt file into the root of each domain, just as a precaution! Within this file I had intended to disallow all. The final course of action (which I'm holding off in the hope someone comes up with a better solution) is to add each demo domain / sub domain into Google Webmaster and remove the URLs individually. Or would it be better to go down the canonical route?
Intermediate & Advanced SEO | | iam-sold0 -
We're indexed in Google News, any tips or suggestions for getting traffic from news?
We have a news sitemap, and follow all best practices as outlined by Google for news. We are covering breaking stories at the same time as other publications, but have only made it to the front page of Google News once in the last few weeks. Does anyone have any tips, recommended reading, etc for how to get to the front page of Google News? Thanks!
Intermediate & Advanced SEO | | nicole.healthline0 -
Indexed Pages in Google, How do I find Out?
Is there a way to get a list of pages that google has indexed? Is there some software that can do this? I do not have access to webmaster tools, so hoping there is another way to do this. Would be great if I could also see if the indexed page is a 404 or other Thanks for your help, sorry if its basic question 😞
Intermediate & Advanced SEO | | JohnPeters0 -
Is there a way to contact Google besides the google product forum?
Our traffic from google has dropped more than 35% and continues to fall. We have been on this forum and google's webmaster forum trying to get help. We received great advice, have waited months, but instead of our traffic improving, it has worsened. We are being penalized by google for many keywords such as trophies, trophies and awards and countless others - we were on page one previously. We filed two reconsideration requests and were told both times that there were no manual penalties. Some of our pages continue to rank well, so it is not across the board (but all of our listings went down a bit). We have made countless changes (please see below). Our busy season was from March to May and we got clobbered. Google, as most people know, is a monopoly when it comes to traffic, so we are getting killed. At first we thought it was Penquin, but it looks like we started getting killed late last year. Lots of unusual things happened - we had a large spike in traffic for two days, then lost our branded keywords, then our main keywords. Our branded keywords came back pretty quickly, but nothing else did. We have received wonderful advice and made most of the changes. We are a very reputable company and have a feeling we are being penalized for something other than spamming. For example, we have a mobile site we added late last year and a wholesale system was added around the same time. Since the date does not coincide with Penquin, we think there is some major technical driver, but have no idea what to do at this point. The webmasters have all been helpful, but nothing is working. We are trying to find out what one does in a situation as we are trying to avoid closing our business. Thank you! Changes Made: 1. We had many crawl errors so we reduced them significantly 2. We had introduced a mobile website in January which we
Intermediate & Advanced SEO | | trophycentraltrophiesandawards
thought may have been the cause (splitting traffic, duplicate content, etc.),
so we had our mobile provider add the site to their robots.txt file. 3. We were told by a webmaster that their were too many
links from our search provider, so we have them put the search pages in a
robots.txt file. 4. We were told that we had too much duplicate content. This was / is true, as we have hundred of legitate products that are similar:
example trophies and certificates that are virtually the same but are
for different sports or have different colors and sizes. Still, we added more content and added no index tags to many products. We compared our % of dups to competitors and it is far less. 5. At the recommendation of another webmaster, we changed
many pages that might have been splitting traffic. 6. Another webmaster told us that too many people were
linking into our site with the same text, namely Trophy Central and that it
might have appeared we were trying to game the system somehow. We have never bought links and don't even have a webmaster although over the last 10 years have worked with programmers and seo companies (but we don't think any have done anything unusual). 7. At the suggestion of another webmaster, we have tried to
improve our link profile. For example,
we found Yahoo was not linking to our url. 8. We were told to setup a 404 page, so we did 9. We were told to ensure that all of the similar domains
were pointing to www.trophycentral.com/ so we setup redirects 10. We were told that a site that we have linking to us from too many places so we reduced it to 1. Our key pages have A rankings from SEOMOZ for the selected keywords. We have made countless other changes recommended by experts
but have seen no improvements (actually got worse). I am the
president of the company and have made most of the above recent changes myself. Our website is trophycentral.com0 -
Google indexing flash content
Hi Would googles indexing of flash content count towards page content? for example I have over 7000 flash files, with 1 unique flash file per page followed by a short 2 paragraph snippet, would google count the flash as content towards the overall page? Because at the moment I've x-tagged the roberts with noindex, nofollow and no archive to prevent them from appearing in the search engines. I'm just wondering if the google bot visits and accesses the flash file it'll get the x-tag noindex, nofollow and then stop processing. I think this may be why the panda update also had an effect. thanks
Intermediate & Advanced SEO | | Flapjack0