Difficulty with Indexing Pages - Desperate for Help!
-
I have a website with product pages that use the same URL, but load different data based on what's passed to them with GET. I am using a Wordpress website, but all of the page information is retrieved from a database using PHP and displayed with PHP.
Somehow these pages are not being indexed by Google.
I have done the following:
1. Created a site map pointing to each page.
2. Defined URL parameters in Search Console for these type of pages.
3. Created a product schema using schema.org, and tested it without errors.
I have requested re-indexing repeatedly and these pages and images on the pages are still not being indexed! Does anybody have any suggestions?
-
Hey, David Butler . . . you are probably the only person who has looked at this issue, so I want to thank you again for your input.
I wanted to follow up about this. Since I am using Wordpress for the website, I used Wordpress's rewrite_rule function.
After confirming that it was working correctly, I deleted the old sitemaps and created new ones, then submitted them to Google.
Shortly after this, the pages were successfully indexed.
So from this experience I get the impression that using URL parameters doesn't necessary work -- I certainly am not going to use them in the future.
I am going to mark this issue as resolved.
-
Hi jacleaves,
I'm interested to see how this works out for you!
Please post an update after you've finished your work
Cheers,
David
-
Hey, David Butler,
I am at a loss when it comes to canonical tags -- I am trying to understand how to use them. However, in this case I thought it was set up correctly.
To better explain the website . . . all of the product pages use the same URL, which is http://amishdirectplaysets.com/playset-details/.
I programmed the pages to retrieve info from a database and display specific product information based on the parameters passed to them (?mfgID=A-1&catID=4). I cannot change the URL's to be anything different, as they are not actually different pages.
What I had read is that the canonical url should not include the URL parameters, so that is why they were just going to the same page. I created URL parameters in Google Search Console because I thought that would take care of this issue. However it is not.
So . . . what I have done (after reading your post) is gone ahead and changed the canonical URL to include the URL parameters.
Is that how I'm supposed to handle it in this type of a situation?
I am updating this response . . . after further investigation I can take care of changing the URL to something more search-engine friendly by using mod rewrite. I'll test it out.
-
Hi jacleaves,
The problem here is with your canonical tags (more info on canonical tags here).
This page: http://amishdirectplaysets.com/playset-details/?mfgID=A-1&catID=4
Has a canonical tag pointing to: http://amishdirectplaysets.com/playset-details/
The same thing is happening on all of your product pages.
I would change all of your product pages to use "SEO-friendly" URLs and have a self-referring canonical tag.
Eg. your example page: http://amishdirectplaysets.com/playset-details/?mfgID=A-1&catID=4
Would become: http://amishdirectplaysets.com/playset-details/a-1-standard-climber-vinyl-playset
And the canonical tag would point to: http://amishdirectplaysets.com/playset-details/a-1-standard-climber-vinyl-playsetCheers,
David
-
Hi Matthew,
Thanks for your quick response!
Here's one page:
http://amishdirectplaysets.com/playset-details/?mfgID=A-1&catID=4
My issue is none of the individual product pages are being indexed.
In response to your starting suggestions:
1. I am not blocking any resources.
2. I am not using noindex.
3. Page is being rendered successfully.
One more thing . . . I mis-spoke about how the content is generated. The content on this page is generated by PHP and NOT Javascript. So that is a non-issue. (I corrected this in my initial question.)
I appreciate your feedback. Please let me know if you are able to determine what else I could be missing!
-
Hi jacleaves!
Without your website URL it will be difficult to diagnose the problem as there are a few potential technical issues here. My main worries would be whether you're blocking indexation somehow and the fact you're displaying your content using JavaScript.
I'd start here:
- Check you're not blocking crawlers in your robots.txt file
- Check you're not using the noindex tag
I'd also try using fetch and render in Google Search Console (https://support.google.com/webmasters/answer/6066468?hl=en) for your site pages to see how Google sees them. If googlebot isn't seeing your content, that's a strong hint there's a JavaScript crawling problem.
Also, strap yourself in and read this - https://www.elephate.com/blog/ultimate-guide-javascript-seo/ - it's THE guide for JavaScript SEO.
Let us know how you get on and we'll go from there!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Category Page as Shopping Aggregator Page
Hi, I have been reviewing the info from Google on structured data for products and started to ponder.
Intermediate & Advanced SEO | | Alexcox6
https://developers.google.com/search/docs/data-types/products Here is the scenario.
You have a Category Page and it lists 8 products, each products shows an image, price and review rating. As the individual products pages are already marked up they display Rich Snippets in the serps.
I wonder how do we get the rich snippets for the category page. Now Google suggest a markup for shopping aggregator pages that lists a single product, along with information about different sellers offering that product but nothing for categories. My ponder is this, Can we use the shopping aggregator markup for category pages to achieve the coveted rich results (from and to price, average reviews)? Keen to hear from anyone who has had any thoughts on the matter or had already tried this.0 -
Would it work to place H1 (or important page keywords) at the top of your page in HTML and move lower on page with CSS?
I understand that the H1 tag is no longer heavily correlated with stronger ranking signals but it is more important that Keywords or keyphrases are at the top of a page. My question is, if I just put my important keyword (or H1) toward the top of my page in the HTML and move it towards the middle/lower portion with css position elements, will this still be viewed by Googlebot as important keywords toward the top of my page? QCaxMHL
Intermediate & Advanced SEO | | Jonathan.Smith0 -
What to do when your home page an index for a series of pages.
I have created an index stack. My home page is http://www.southernwhitewater.com The home page is the index itself and the 1st page http://www.southernwhitewater.com/nz-adventure-tours-whitewater-river-rafting-hunting-fishing My home page (if your look at it through moz bat for chrome bar} incorporates all the pages in the index. Is this Bad? I would prefer to index each page separately. As per my site index in the footer What is the best way to optimize all these pages individually and still have the customers arrive at the top to a picture. rel= canonical? Any help would be great!! http://www.southernwhitewater.com
Intermediate & Advanced SEO | | VelocityWebsites0 -
Links from non-indexed pages
Whilst looking for link opportunities, I have noticed that the website has a few profiles from suppliers or accredited organisations. However, a search form is required to access these pages and when I type cache:"webpage.com" the page is showing up as non-indexed. These are good websites, not spammy directory sites, but is it worth trying to get Google to index the pages? If so, what is the best method to use?
Intermediate & Advanced SEO | | maxweb0 -
Whats the best way to remove search indexed pages on magento?
A new client ( aqmp.com.br/ )call me yestarday and she told me since they moved on magento they droped down more than US$ 20.000 in sales revenue ( monthly)... I´ve just checked the webmaster tool and I´ve just discovered the number of crawled pages went from 3.260 to 75.000 since magento started... magento is creating lots of pages with queries like search and filters. Example: http://aqmp.com.br/acessorios/lencos.html http://aqmp.com.br/acessorios/lencos.html?mode=grid http://aqmp.com.br/acessorios/lencos.html?dir=desc&order=name Add a instruction on robots.txt is the best way to remove unnecessary pages of the search engine?
Intermediate & Advanced SEO | | SeoMartin10 -
Getting Google in index but display "parent" pages..
Greetings esteemed SEO experts - I'm hunting for advice: We operate an accommodation listings website. We monetize by listing position in search results, i.e. you pay more to get higher placing in the page. Because of this, while we want individual detailed listing pages to be indexed to get the value of the content, we don't really want them appearing in Google search results. We ideally want the "content value" to be attributed to the parent page - and google to display this as the link in the search results instead of the individual listing. Any ideas on how to achieve this?
Intermediate & Advanced SEO | | AABAB0 -
Help! Why did Google remove my images from their index?
I've been scratching my head over this one for a while now and I can't seem to figure it out. I own a website that is user-generated content. Users submit images to my sites of graphic resources (for designers) that they have created to share with our community. I've been noticing over the past few months that I'm getting completely dominated in Google Images. I used to get a ton of traffic from Google Images, but now I can't find my images anywhere. After diving into Analytics I found this: http://cl.ly/140L2d14040Q1R0W161e and realized sometime about a year ago my image traffic took a dive. We've gone back through all the change logs and can't find where we made any changes to the site structure that could have caused this. We are stumped. Does anyone know of any historical Google updates that could have caused this last year around the end of April 2010? Any help or insight would be greatly appreciated!
Intermediate & Advanced SEO | | shawn810 -
Can a XML sitemap index point to other sitemaps indexes?
We have a massive site that is having some issue being fully crawled due to some of our site architecture and linking. Is it possible to have a XML sitemap index point to other sitemap indexes rather than standalone XML sitemaps? Has anyone done this successfully? Based upon the description here: http://sitemaps.org/protocol.php#index it seems like it should be possible. Thanks in advance for your help!
Intermediate & Advanced SEO | | CareerBliss0