Javascript content not being indexed by Google
-
I thought Google has gotten better at picking up unique content from javascript. I'm not seeing it with our site. We rate beauty and skincare products using our algorithms. Here is an example of a product -- https://www.skinsafeproducts.com/tide-free-gentle-he-liquid-laundry-detergent-100-fl-oz
When you look at the cache page (text) from google none of the core ratings (badges like fragrance free, top free and so forth) are being picked up for ranking. Any idea what we could do to have the rating incorporated in the indexation.
-
Hello!
Pretty sure the issue is that this content requires a user action before being seen. Google will not crawl/index content which is not loaded until the user interacts. This post is a great resource %20Summary:%20How%20to%20Make%20Your%20Company%20Diverse%20Without%20Focusing%20on%20Diversity%20%20%20Name:%20Heather%20Huhman%20Spark%20Hire%20%20Category:%20Business%20and%20Finance%20%20%20Email:%20query-7wru@helpareporter.net%20%20%20Media%20Outlet:%20Spark%20Hire%20%20Deadline:%205:00%20PM%20EST%20-%2023%20April%20%20%20Query:%20%20%20LinkedIn's%20most%20recent%20Global%20Recruiting%20Trends%20report,%20recruiters%20say%20their%20top%20focus%20is%20on%20diversity%20and%20inclusion.%20But%20when%20it%20comes%20to%20hiring%20for%20diversity,%20there's%20a%20misunderstanding%20that%20the%20focus%20must%20be%20on%20the%20ethnicity,%20race,%20and%20sex%20of%20candidates.%20We're%20looking%20for%20insight%20into%20how%20hiring%20pros%20can%20break%20out%20of%20that%20rigid%20diversity%20box%20and%20find%20creative%20ways%20to%20hire%20diverse%20candidates%20who%20will%20positively%20impact%20various%20aspects%20of%20their%20company.%20Responses%20that%20are%20selected%20will%20be%20featured%20on%20the%20Spark%20Hire%20blog%20and%20promoted%20to%20over%2010K%20blog%20subscribers.%20%20Please%20respond%20to%20the%20following%20questions:%20%20How%20can%20focusing%20only%20on%20the%20ethnicity,%20race,%20and%20sex%20of%20candidates%20hurt%20hiring%20pros'%20efforts%20of%20hiring%20the%20best%20diverse%20candidates?%20What%20other%20candidate%20factors%20can%20hiring%20pros%20look%20into%20to%20find%20diverse%20candidates?%20Please%20share%20a%20story%20of%20a%20time%20when%20you%20or%20a%20fellow%20hiring%20pro%20narrowed%20your%20diversity%20focus%20too%20much,%20resulting%20in%20hires%20that%20weren%27t%20the%20best%20fit%20for%20the%20company.%20How%20can%20hiring%20professionals%20create%20a%20unique%20hiring%20strategy%20to%20attract%20diverse%20candidates%20who%20are%20the%20best%20fit%20for%20their%20open%20roles%20and%20company?%20%20Requirements:%20%20%20Please%20send%20your%20input%20in%20your%20initial%20response%20(don%27t%20send%20requests%20for%20interviews%20or%20article%20links).%20Include%20%22How%20to%20Make%20Your%20Company%20Diverse%20Without%20Focusing%20on%20Diversity%22%20in%20the%20subject%20line.%20Answer%20each%20question%20separately.%20Keep%20answers%20brief%20but%20informative.%20%20Include:%20%20Your%20title%20and%20qualifications%20Contact%20information,%20including%20an%20email%20Headshot%20(must%20be%20a%20link%20and%20at%20least%20200x200)%20Twitter%20handle%20%20Thank%20You.)on JS auditing/crawling%20Summary:%20How%20to%20Make%20Your%20Company%20Diverse%20Without%20Focusing%20on%20Diversity%20%20%20Name:%20Heather%20Huhman%20Spark%20Hire%20%20Category:%20Business%20and%20Finance%20%20%20Email:%20query-7wru@helpareporter.net%20%20%20Media%20Outlet:%20Spark%20Hire%20%20Deadline:%205:00%20PM%20EST%20-%2023%20April%20%20%20Query:%20%20%20LinkedIn's%20most%20recent%20Global%20Recruiting%20Trends%20report,%20recruiters%20say%20their%20top%20focus%20is%20on%20diversity%20and%20inclusion.%20But%20when%20it%20comes%20to%20hiring%20for%20diversity,%20there's%20a%20misunderstanding%20that%20the%20focus%20must%20be%20on%20the%20ethnicity,%20race,%20and%20sex%20of%20candidates.%20We're%20looking%20for%20insight%20into%20how%20hiring%20pros%20can%20break%20out%20of%20that%20rigid%20diversity%20box%20and%20find%20creative%20ways%20to%20hire%20diverse%20candidates%20who%20will%20positively%20impact%20various%20aspects%20of%20their%20company.%20Responses%20that%20are%20selected%20will%20be%20featured%20on%20the%20Spark%20Hire%20blog%20and%20promoted%20to%20over%2010K%20blog%20subscribers.%20%20Please%20respond%20to%20the%20following%20questions:%20%20How%20can%20focusing%20only%20on%20the%20ethnicity,%20race,%20and%20sex%20of%20candidates%20hurt%20hiring%20pros'%20efforts%20of%20hiring%20the%20best%20diverse%20candidates?%20What%20other%20candidate%20factors%20can%20hiring%20pros%20look%20into%20to%20find%20diverse%20candidates?%20Please%20share%20a%20story%20of%20a%20time%20when%20you%20or%20a%20fellow%20hiring%20pro%20narrowed%20your%20diversity%20focus%20too%20much,%20resulting%20in%20hires%20that%20weren%27t%20the%20best%20fit%20for%20the%20company.%20How%20can%20hiring%20professionals%20create%20a%20unique%20hiring%20strategy%20to%20attract%20diverse%20candidates%20who%20are%20the%20best%20fit%20for%20their%20open%20roles%20and%20company?%20%20Requirements:%20%20%20Please%20send%20your%20input%20in%20your%20initial%20response%20(don%27t%20send%20requests%20for%20interviews%20or%20article%20links).%20Include%20%22How%20to%20Make%20Your%20Company%20Diverse%20Without%20Focusing%20on%20Diversity%22%20in%20the%20subject%20line.%20Answer%20each%20question%20separately.%20Keep%20answers%20brief%20but%20informative.%20%20Include:%20%20Your%20title%20and%20qualifications%20Contact%20information,%20including%20an%20email%20Headshot%20(must%20be%20a%20link%20and%20at%20least%20200x200)%20Twitter%20handle%20%20Thank%20You.) and will show you how to use Chrome's 'inspect element' as a better way to see what's going on.
But in general, the content needs to load before a user action takes place (even if in JS) and yes Google is getting better, but won't look at anything behind a click. Google just confirmed this at their recent I/O conference, stating that they do render JavaScript but it could be a week after they first render the normal HTML.
-Dan
PS - Huge apologies for the delay in answering, Moz was having technical issues with the backend of the forum, affecting the ability to reply to some questions.
-
Hi akih,
I don't believe the "text-only" cache is representative of Google's index. They process JavaScript via their rendering service before they index content - so the full cached version is a more accurate representation of the content Google has seen/indexed.
Also, I ran a search for your site using a snippet of copy from the "Common Preservative Free" badge, and Google is returning pages with this text in the displayed page description. Here's a link to the SERP for the query I used.
I'd say Google's able to see and index this content just fine - it's just the "text-only" cached content does not include any JavaScript-rendered content.
Best,
Mike
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Does Google frown on using 3 different page titles with same content to secure the top 3 results in SERPs?
Is it frowned upon by Google to create 3 different pages with the sames content yet different titles to secure the top three results in SERPs? For example: Luxury Care Homes in Liverpool Care Homes in Liverpool Private Care Homes in Liverpool The page titles are different with slightly different meta data but the user content is exactly the same, would this be considered a cheeky win or negative to rankings?
Intermediate & Advanced SEO | | TrustedCare.co.uk1 -
Should I use noindex or robots to remove pages from the Google index?
I have a Magento site and just realized we have about 800 review pages indexed. The /review directory is disallowed in robots.txt but the pages are still indexed. From my understanding robots means it will not crawl the pages BUT if the pages are still indexed if they are linked from somewhere else. I can add the noindex tag to the review pages but they wont be crawled. https://www.seroundtable.com/google-do-not-use-noindex-in-robots-txt-20873.html Should I remove the robots.txt and add the noindex? Or just add the noindex to what I already have?
Intermediate & Advanced SEO | | Tylerj0 -
"No Index, No Follow" or No Index, Follow" for URLs with Thin Content?
Greetings MOZ community: If I have a site with about 200 thin content pages that I want Google to remove from their index, should I set them to "No Index, No Follow" or to "No Index, Follow"? My SEO firm has advised me to set them to "No Index, Follow" but on a recent MOZ help forum post someone suggested "No Index, No Follow". The MOZ poster said that telling Google the content was should not be indexed but the links should be followed was inconstant and could get me into trouble. This make a lot of sense. What is proper form? As background, I think I have recently been hit with a Panda 4.0 penalty for thin content. I have several hundred URLs with less than 50 words and want them de-indexed. My site is a commercial real estate site and the listings apparently have too little content. Thanks, Alan
Intermediate & Advanced SEO | | Kingalan10 -
Dropped from Google?
My website www.weddingphotojournalist.co.uk appears to have been penalised by Google. I ranked fairly well for a number of venue related searches from my blog posts. Generally I'd find myself somewhere on page one or towards the top of page two. However recently I found I am nowhere to be seen for these venue searches. I still appear if I search for my name, business name and keywords in my domain name. A quick check of Yahoo and I found I am ranking very well, it is only Google who seem to have dropped me. I looked at Google webmaster tools and there are no messages or clues as to what has happened. However it does show my traffic dropping off a cliff edge on the 19th July from 850 impressions to around 60 to 70 per day. I haven't made any changes to my website recently and hadn't added any new content in July. I haven't added any new inbound links either, a search for inbound links does not show anything suspicious. Can anyone shed any light on why this might happen?
Intermediate & Advanced SEO | | weddingphotojournalist0 -
Pages getting into Google Index, blocked by Robots.txt??
Hi all, So yesterday we set up to Remove URL's that got into the Google index that were not supposed to be there, due to faceted navigation... We searched for the URL's by using this in Google Search.
Intermediate & Advanced SEO | | bjs2010
site:www.sekretza.com inurl:price=
site:www.sekretza.com inurl:artists= So it brings up a list of "duplicate" pages, and they have the usual: "A description for this result is not available because of this site's robots.txt – learn more." So we removed them all, and google removed them all, every single one. This morning I do a check, and I find that more are creeping in - If i take one of the suspecting dupes to the Robots.txt tester, Google tells me it's Blocked. - and yet it's appearing in their index?? I'm confused as to why a path that is blocked is able to get into the index?? I'm thinking of lifting the Robots block so that Google can see that these pages also have a Meta NOINDEX,FOLLOW tag on - but surely that will waste my crawl budget on unnecessary pages? Any ideas? thanks.0 -
Blocked from google
Hi, i used to get a lot of trafic from google but sudantly there was a problem with the website and it seams to be blocked. We are also in the middle of changing the root domain because we are making a new webpage, i have looked at the webmaster tools and corrected al the errors but the page is still not visible in google. I have also orderd a new crawl. Anyone have any trics? do i loose a lot when i move the domainname, or is this a good thing in this mater? The old one is smakenavitalia.no The new one is Marthecarrara.no Best regards Svein Økland
Intermediate & Advanced SEO | | sveinokl0 -
Why is Google Reporting big increase in duplicate content after Canonicalization update?
Our web hosting company recently applied a update to our site that should have rectified Canonicalized URLs. Webmaster tools had been reporting duplicate content on pages that had a query string on the end. After the update there has been a massive jump in Webmaster tools reporting now over 800 pages of duplicate content, Up from about 100 prior to the update plus it reporting some very odd pages (see attached image) They claim they have implement Canonicalization in line with Google Panda & Penguin, but surely something is not right here and it's going to cause us a big problem with traffic. Can anyone shed any light on the situation??? Duplicate%20Content.jpg
Intermediate & Advanced SEO | | Towelsrus0 -
Google bot vs google mobile bot
Hi everyone 🙂 I seriously hope you can come up with an idea to a solution for the problem below, cause I am kinda stuck 😕 Situation: A client of mine has a webshop located on a hosted server. The shop is made in a closed CMS, meaning that I have very limited options for changing the code. Limited access to pagehead and can within the CMS only use JavaScript and HTML. The only place I have access to a server-side language is in the root where a Defualt.asp file redirects the visitor to a specific folder where the webshop is located. The webshop have 2 "languages"/store views. One for normal browsers and google-bot and one for mobile browsers and google-mobile-bot.In the default.asp (asp classic). I do a test for user agent and redirect the user to one domain or the mobile, sub-domain. All good right? unfortunately not. Now we arrive at the core of the problem. Since the mobile shop was added on a later date, Google already had most of the pages from the shop in it's index. and apparently uses them as entrance pages to crawl the site with the mobile bot. Hence it never sees the default.asp (or outright ignores it).. and this causes as you might have guessed a huge pile of "Dub-content" Normally you would just place some user-agent detection in the page head and either throw Google a 301 or a rel-canon. But since I only have access to JavaScript and html in the page head, this cannot be done. I'm kinda running out of options quickly, so if anyone has an idea as to how the BEEP! I get Google to index the right domains for the right devices, please feel free to comment. 🙂 Any and all ideas are more then welcome.
Intermediate & Advanced SEO | | ReneReinholdt0