Adding Millions of Products to Google
-
What is the best way to submit all of your product pages, millions, to Google for serps? XML, RSS, Google Product Search, etc.
These are products that are updated on a daily basis, and change often.
-
When you say 'submit all of your product pages' - Do you mean submit them to Google's organic search engine, or Google Shopping?
For the organic search engine, depending on how many pages you really have, I would say you should submit xml sitemaps, and you may need to submit a sitemap index too (check the current max. limit on a single sitemap submission, I am not sure what it is these days!).
Personally though, with a good navigation system and a few backlinks, you shouldn't need to worry 'too much' about submitting xml sitemaps.
As you say the product pages are updated daily though, I can see why you feel the need to do this.
Or, did you mean submitting them to...
If you have lots of products, I would strongly recommend submitting them to Google Shopping - it's free, after all!
This should help you to get some 'quick wins' whilst you work at getting your products and category pages ranking well in the organic results.
**Canonicalisation **
As you are running an ecom. store, with lots of products - be very careful with canonical and duplication issues, especially since Google Panda! Ensure that query strings in your URLs don't result in multiple URLs for the same products, likewise make sure if you have products in multiple categories, that you are not creating duplicate content/URLs that way either! - I guess you have this covered already?
-
I would mark them up as a product using http://schema.org/
Then simply putting the main catagory pages in your site map will be fine. Search engines will find them. Bing for one has said not to put every page in a sitemap as they will just start tio ignore your sitemap. just the important pages.
This is assuming you do have a good linking stucture so that they can be found.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Google Update
My rank has dropped quite a lot this past week and I can see from the Moz tools that there is an unconfirmed Google update responsible. Is there any information from Moz on this?
Intermediate & Advanced SEO | | moon-boots0 -
What is Google supposed to return when you submit an image URL into Fetch as Google? Is a few lines of readable text followed by lots of unreadable text normal?
I am seeing something like this (Is this normal?): HTTP/1.1 200 OK
Intermediate & Advanced SEO | | Autoboof
Server: nginx
Content-Type: image/jpeg
X-Content-Type-Options: nosniff
Last-Modified: Fri, 13 Nov 2015 15:23:04 GMT
Cache-Control: max-age=1209600
Expires: Fri, 27 Nov 2015 15:23:55 GMT
X-Request-ID: v-8dd8519e-8a1a-11e5-a595-12313d18b975
X-AH-Environment: prod
Content-Length: 25505
Accept-Ranges: bytes
Date: Fri, 13 Nov 2015 15:24:11 GMT
X-Varnish: 863978362 863966195
Age: 16
Via: 1.1 varnish
Connection: keep-alive
X-Cache: HIT
X-Cache-Hits: 1 ����•JFIF••••��;CREATOR: gd-jpeg v1.0 (using IJG JPEG v80), quality = 75
��C•••••••••• •
••
••••••••• $.' ",#(7),01444'9=82<.342��C• ••••
•2!!22222222222222222222222222222222222222222222222222��•••••v••"••••••��••••••••••••••••
•���•••••••••••••}•••••••!1A••Qa•"q•2���•#B��•R��$3br�
••••%&'()*456789:CDEFGHIJSTUVWXYZcdefghijstuvwxyz���������������������������������������������������������������������������•••••••••••••••••••
•���••••••••••••••w••••••!1••AQ•aq•"2�••B���� #3R�•br�0 -
Problem with Google finding our website
We have an issue with Google finding our website: (URL removed) When we google "(keyword removed)" in google.com.au, our website doesn't come up anywhere. This is despite inserting the suitable title tag and onsite copy for SEO. We found this strange, and thought we'd investigate further. We decided to just google the website URL in google.com.au, to see if it was being properly found. Our site appeared at the top but with this description: A description for this result is not available because of this site's robots.txt – learn more. We also can see that the incorrect title tag is appearing. From this, we assumed that there must be an issue with the robot.txt file. We decided to put a new robot.txt file up: (URL removed) This hasn't solved the problem though and we still have the same issue. If someone could get to the bottom of this for us, we would be most appreciative. We are thinking that there may possibly be another robot.txt file that we can't find that is causing issues, or something else we're not sure of! We want to get to the bottom of it so that the site can be appropriately found. Any help here would be most appreciated!
Intermediate & Advanced SEO | | Gavo0 -
Adding some unique text to search
I do not know how to easily explain that but I will try 🙂 We are running the yellow pages in our country, where most (all) of the companies are listed. Each company has their keywords that are used in our search. All of those search keywords are indexed by Google and it goes something like that domain.com/search/keyword So far this page only lists the companies that match the search query. So that's not much content. I'm thinking about adding a sentence that would go something like this:
Intermediate & Advanced SEO | | FCRMediaLietuva
The search query lists the companies of our country that do KEYWORD. So far COUNT was found. That seems pretty short and I am not sure if that does a lot of help for Google. But I cannot think of more text. Any ideas? Or should I give up on the idea of adding anything at all?0 -
Pages ending in .ad extension?
My company recently updated it's layout for thumbnails and property pages. Previously they displayed as /Property/123456-123%20MAIN%20Street-SPRINGFIELD-PA-98765 I know that was pretty bad URL structure so I was glad it was being changed, but now property pages are simply displaying as /6294888.ad What the heck is the .ad extension?
Intermediate & Advanced SEO | | BD690 -
Google's serp
Hello Guys ! I will appreciate if you will share your thoughts re the situation i have. The homepage for one of my sites is one last page of google's serp, although internal pages are displayed in the top 10. 1. Why ?
Intermediate & Advanced SEO | | Webdeal
2. What should I do to correct the situation with the homepage ? regards0 -
How do I optimise my products for best results?
Hi We have a number of products we want to optimise for example. Barbeque Boss Double Oven Glove, Black When performing keyword research, there are a number of generic terms such as, black oven gloves, barbeque boss and so on. Now i can write the page and optimise for these keyword phrases but I am not sure this is the right way about going for it, particularly if i have several products in the range that are "black oven gloves" or " double oven gloves" How so i best structure my meta tags, meta description and descriptions? Should i just use the product title and optimise around this in the hope Google displays our page in any search queries containing words in this product title? Any advice would be appreciated. Thanks Craig
Intermediate & Advanced SEO | | Towelsrus0 -
Does Google punish sites for Backlinks?
Here is Matt Cutts video, for those of you who have not seen it already. http://www.youtube.com/watch?v=f4dAWb5jUws (Very Short) In this Video Matt explains that Google does not look at backlinks. Many link spamming sites have detected, there have been many website receiving warning messages in their Google web tools to deindex these links, etc.. My theory is that Google will not punish sites for backlinks. However, they manually check for "link farming sites" and warn anyone affiliated with them, just in case these links were built from a competitor. This way they can eliminate all the "Bad Link Farm" sites and not hurt anyone who does not deserve to be hurt. Google is not going to give us all their information to rank, they dont want us to rank. They want us to PPC. However, they do want to have the best SERPs available. I call it Google juggling! Thoughts?
Intermediate & Advanced SEO | | SEODinosaur0