Difficulty with Indexing Pages - Desperate for Help!
-
I have a website with product pages that use the same URL, but load different data based on what's passed to them with GET. I am using a Wordpress website, but all of the page information is retrieved from a database using PHP and displayed with PHP.
Somehow these pages are not being indexed by Google.
I have done the following:
1. Created a site map pointing to each page.
2. Defined URL parameters in Search Console for these type of pages.
3. Created a product schema using schema.org, and tested it without errors.
I have requested re-indexing repeatedly and these pages and images on the pages are still not being indexed! Does anybody have any suggestions?
-
Hey, David Butler . . . you are probably the only person who has looked at this issue, so I want to thank you again for your input.
I wanted to follow up about this. Since I am using Wordpress for the website, I used Wordpress's rewrite_rule function.
After confirming that it was working correctly, I deleted the old sitemaps and created new ones, then submitted them to Google.
Shortly after this, the pages were successfully indexed.
So from this experience I get the impression that using URL parameters doesn't necessary work -- I certainly am not going to use them in the future.
I am going to mark this issue as resolved.
-
Hi jacleaves,
I'm interested to see how this works out for you!
Please post an update after you've finished your work
Cheers,
David
-
Hey, David Butler,
I am at a loss when it comes to canonical tags -- I am trying to understand how to use them. However, in this case I thought it was set up correctly.
To better explain the website . . . all of the product pages use the same URL, which is http://amishdirectplaysets.com/playset-details/.
I programmed the pages to retrieve info from a database and display specific product information based on the parameters passed to them (?mfgID=A-1&catID=4). I cannot change the URL's to be anything different, as they are not actually different pages.
What I had read is that the canonical url should not include the URL parameters, so that is why they were just going to the same page. I created URL parameters in Google Search Console because I thought that would take care of this issue. However it is not.
So . . . what I have done (after reading your post) is gone ahead and changed the canonical URL to include the URL parameters.
Is that how I'm supposed to handle it in this type of a situation?
I am updating this response . . . after further investigation I can take care of changing the URL to something more search-engine friendly by using mod rewrite. I'll test it out.
-
Hi jacleaves,
The problem here is with your canonical tags (more info on canonical tags here).
This page: http://amishdirectplaysets.com/playset-details/?mfgID=A-1&catID=4
Has a canonical tag pointing to: http://amishdirectplaysets.com/playset-details/
The same thing is happening on all of your product pages.
I would change all of your product pages to use "SEO-friendly" URLs and have a self-referring canonical tag.
Eg. your example page: http://amishdirectplaysets.com/playset-details/?mfgID=A-1&catID=4
Would become: http://amishdirectplaysets.com/playset-details/a-1-standard-climber-vinyl-playset
And the canonical tag would point to: http://amishdirectplaysets.com/playset-details/a-1-standard-climber-vinyl-playsetCheers,
David
-
Hi Matthew,
Thanks for your quick response!
Here's one page:
http://amishdirectplaysets.com/playset-details/?mfgID=A-1&catID=4
My issue is none of the individual product pages are being indexed.
In response to your starting suggestions:
1. I am not blocking any resources.
2. I am not using noindex.
3. Page is being rendered successfully.
One more thing . . . I mis-spoke about how the content is generated. The content on this page is generated by PHP and NOT Javascript. So that is a non-issue. (I corrected this in my initial question.)
I appreciate your feedback. Please let me know if you are able to determine what else I could be missing!
-
Hi jacleaves!
Without your website URL it will be difficult to diagnose the problem as there are a few potential technical issues here. My main worries would be whether you're blocking indexation somehow and the fact you're displaying your content using JavaScript.
I'd start here:
- Check you're not blocking crawlers in your robots.txt file
- Check you're not using the noindex tag
I'd also try using fetch and render in Google Search Console (https://support.google.com/webmasters/answer/6066468?hl=en) for your site pages to see how Google sees them. If googlebot isn't seeing your content, that's a strong hint there's a JavaScript crawling problem.
Also, strap yourself in and read this - https://www.elephate.com/blog/ultimate-guide-javascript-seo/ - it's THE guide for JavaScript SEO.
Let us know how you get on and we'll go from there!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Paginated Pages Page Depth
Hi Everyone, I was wondering how Google counts the page depth on paginated pages. DeepCrawl is showing our primary pages as being 6+ levels deep, but without the blog or with an infinite scroll on the /blog/ page, I believe it would be only 2 or 3 levels deep. Using Moz's blog as an example, is https://moz.com/blog?page=2 treated to be on the same level in terms of page depth as https://moz.com/blog? If so is it the https://site.comcom/blog" /> and https://site.com/blog?page=3" /> code that helps Google recognize this? Or does Google treat the page depth the same way that DeepCrawl is showing it with the blog posts on page 2 being +1 in page depth compared to the ones on page 1, for example? Thanks, Andy
Intermediate & Advanced SEO | | AndyRSB0 -
Would it work to place H1 (or important page keywords) at the top of your page in HTML and move lower on page with CSS?
I understand that the H1 tag is no longer heavily correlated with stronger ranking signals but it is more important that Keywords or keyphrases are at the top of a page. My question is, if I just put my important keyword (or H1) toward the top of my page in the HTML and move it towards the middle/lower portion with css position elements, will this still be viewed by Googlebot as important keywords toward the top of my page? QCaxMHL
Intermediate & Advanced SEO | | Jonathan.Smith0 -
Should I set up no index no follow on low quality pages?
I know it is a good idea for duplicate pages, blog tags, etc. but I remember somewhere that you can help the overall link juice of a website by adding no index no follow or no index follow low quality content pages of your website. Is it still a good idea to do this or was it never a good idea to begin with? Michael
Intermediate & Advanced SEO | | Michael_Rock0 -
I've seen and heard alot about city-specific landing pages for businesses with multiple locations, but what about city-specific landing pages for cities nearby that you aren't actually located in? Is it ok to create landing pages for nearby cities?
I asked here https://www.google.com/moderator/#7/e=adbf4 but figured out ask the Moz Community also! Is it actually best practice to create landing pages for nearby cities if you don't have an actual address there? Even if your target customers are there? For example, If I am in Miami, but have a lot of customers who come from nearby cities like Fort Lauderdale is it okay to create those LP's? I've heard this described as best practice, but I'm beginning to question whether Google sees it that way.
Intermediate & Advanced SEO | | RickyShockley2 -
How to associate content on one page to another page
Hi all, I would like associate content on "Page A" with "Page B". The content is not the same, but we want to tell Google it should be associated. Is there an easy way to do this?
Intermediate & Advanced SEO | | Viewpoints1 -
On Page vs Off Page - Which Has a Greater Effect on Rankings?
Hi Mozzers, My site will be migrating to a new domain soon, and I am not sure how to spend my time. Should I be optimizing our content for keywords, improving internal linking, and writing new content - or should I be doing link building for our current domain (or the new one)? Is there a certain ratio that determines rankings which can help me prioritize these to-dos?, such as 70:30 in favor of link-building? Thanks for any help you can offer!
Intermediate & Advanced SEO | | Travis-W0 -
Have completed keyword analysis and on page optimization. What else can I do to help improve SERP ranking besides adding authoritative links?
Looking for concrete ways to continue to improve SERP results. thanks
Intermediate & Advanced SEO | | casper4340 -
Best way to stop pages being indexed and keeping PageRank
If for example on a discussion forum, what would be the best way to stop pages such as the posting page (where a user posts a topic or message) from being indexed AND not diluting PageRank too? If we added them to the Disallow on robots.txt, would pagerank still flow through the links to those blocked pages or would it stay concentrated on the linking page? Your ideas and suggestions will be greatly appreciated.
Intermediate & Advanced SEO | | Peter2640