Magento Hidden Products & Google Not Found Errors
-
We recently moved our website over to the Magento eCommerce platform. Magento has functionality to make certain items not visible individually so you can, for example, take 6 products and turn it into 1 product where a customer can choose their options. You then hide all the individual products, leaving only that one product visible on the site and reducing duplicate content issues.
We did this. It works great and the individual products don't show up in our site map, which is what we'd like. However, Google Webmaster Tools has all of these individual product URLs in its Not Found Crawl Errors.
! For example:
White t-shirt URL: /white-t-shirt
Red t-shirt URL: /red-t-shirt
Blue t-shirt URL: /blue-t-shirt
All of those are not visible on the site and the URLs do not appear in our site map. But they are all showing up in Google Webmaster Tools.
Configurable t-shirt URL: /t-shirt
This product is the only one visible on the site, does appear on the site map, and shows up in Google Webmaster Tools as a valid URL. !
Do you know how it found the individual products if it isn't in the site map and they aren't visible on the website? And how important do you think it is that we fix all of these hundreds of Not Found errors to point to the single visible product on the site? I would think it is fairly important, but don't want to spend a week of man power on it if the returns would be minimal.
Thanks so much for any input!
-
I also have this same issue.... looking for a solution.
-
Hi there,
I know this is an older question, but I wanted to follow up to see if you found a solution. We're currently experiencing the same issue with simple/not visible individually URLs appear in WMT's crawl error report.
Thanks in advance for any help!
-
The problem I am currently facing is a site where the individual 'Simple Products' were not set to be invisible. They have all been indexed!
So I have the same question really.
-
Yes, the page is modified based on selected options and it is done via Javascript.
-
OK. In a product page, the individual page is modified by a customer selecting options? If so, is that accomplished with Javascript substitution?
-
So those individual pages never actually appear on the site. They are just created to allow Magento to pull inventory on those items from that configurable product, which is why I'm not sure how Google is finding them.
For example, if I go to mysite.com/white-t-shirt, I would get a 404 (and if I searched for it, nothing would come up) because as far as the world outside of Magento admin is concerned, that URL doesn't exist.
-
How do those pages appear? In response to an AJAX call? A sitesearch? I've been hearing that Google has increased their ability to crawl pages that appear through dynamic calls.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Google Indexing
Hi We have roughly 8500 pages in our website. Google had indexed almost 6000 of them, but now suddenly I see that the pages indexed has gone to 45. Any possible explanations why this might be happening and what can be done for it. Thanks, Priyam
Intermediate & Advanced SEO | | kh-priyam0 -
With the New Panda update supposedly only weeks away, is it wise to No Index my products I have not had time to rewrite the product descriptions for ?
Hi Mozzers, I read on SEJ yesterday than apparently the Panda update was due in the 2 - 4 weeks. I still have a large of my products which I have not got around to rewriting unique product descriptions for. I know these product descriptions are duplicated on other affiliate sites so do it think it in light of the panda update coming , would it wise to put a NO INDEX Meta tag on these product pages until I get around to rewriting the descriptions. That way, I may not hit my Panda and it will buy me a bit more time. Just an idea , but thought I'd run it by. thanks Pete
Intermediate & Advanced SEO | | PeteC120 -
Google search results
I have been doing some searches on google to see where my new site shows up, I started using the search words "graphic design firm st. louis" as a gauge, because my title is St. Louis Missouri Graphic Design Firm. I showed up on about page 5 to start , if I include the word "firm" and a few pages further back if I just search "graphic design st. louis", without the word firm. It seemed i was slowly moving up pages with both searches and then a few days ago I jumped to page 1 for search "graphic design firm st. louis" the thing is it doesnt show up at all now if i search "graphic design st. louis" without the word firm. what would cause the one search to jump so high while the other one dissapeared completely?? and what can i do? my keyword density is same for both , any ideas.
Intermediate & Advanced SEO | | eric69660 -
Need help with Google Webmaster Tools Errors
I have a lots of error on my Google webmaster tools under Search Appearance -> Structure Data there are two sets of items 1- "hentry" and source is "Markup: microformats.org" and error says: "Missing: author | Missing: updated" 2-"hcard" and source is "Markup: microformats.org" and error says: "Missing: fn" I am using WordPress. Can anybody tell me how to fix these errors please. Thank you Sina
Intermediate & Advanced SEO | | SinaKashani1 -
Quantity or quality in Google+ authorship?
Hi folks, here goes a (hopefully) easy one for the local authorship gurus. For our blog content strategy we currently have two inhouse contributors. Both have decent Google+ profiles and one is in the process of really establishing authorship/influence by submitting guest posts to several industry sites, sharing content in Google+, engaging in conversations in twitter, etc. Posts by this latter contributor already rank page 1 for the main keywords. We now have a new content contributor who is a retired employee from the company and a good friend. He has written excellent content that will be published in our blog in the coming few months. He does not have a Google+ profile but he can have one if we ask him to, but he is not going to use it for anything other than writting on our blog. He does not mind having his content published under any of our current Google+ profiles. Question: should we include this new content under our current profiles or should we create a new Google+ profile for this new contributor knowing that it will be an 'empty' profile? Thanks in advance!
Intermediate & Advanced SEO | | TIBA0 -
Crawl errors in GWT!
I have been seeing a large number of access denied and not found crawl errors. I have since fixed the issued causing these errors; however, I am still seeing the in webmaster tools. At first I thought the data was outdated, but the data is tracked on a daily basis! Does anyone have experience with this? Does GWT really re-crawl all those pages/links everyday to see if the errors still exist? Thanks in advance for any help/advice.
Intermediate & Advanced SEO | | inhouseseo0 -
Google Places Alternatives
Hello, I have been looking into Google places alternatives. Any suggestions? On a related note. I am based in the UK and looking to add a UK business to Bing Local but having read this thread ( - http://www.bing.com/community/maps/f/12264/t/653672.aspx -) I don't think it's possible. Anyone had any luck or experience? Cheers dj
Intermediate & Advanced SEO | | JohnW-UK0 -
Duplicate Listings on Google Maps
About 3 weeks ago google created a duplicate listing for our law firm on google maps. In building links I have tried very hard to ensure that our address and company name was always listed identically. Our correct firm name and address is Feldman Feldman & Associates, PC 2221 Camino Del Rio South, Suite 201 inevitably somehow the new listing stated Camino Del Rio S, Ste 201 All of our reviews moved over to this new profile, I claimed it, changed it to make it the same reported it to Google. Google merged them. Now Google has created another profile this time the firm name and address matches ours exactly (South and Suite both spelled out), but all of the reviews have moved over except for the most recent one(s). I have claimed it again and reported it to google, changed the address. Google then created another listing. Our page rank for keywords has been hurt by this. any idea why this keeps happening suggestions? Here are the two pages. This is our original listing http://maps.google.com/maps/place?hl=en&cid=468564492130231259 This is the new one google self created that stole all our reviews, but is ranked very poorly for the keyword searches. http://maps.google.com/maps/place?&cid=468564492130231259
Intermediate & Advanced SEO | | jfeld2220