An affiliate website uses datafeeds and around 65.000 products are deleted in the new feeds. What are the best practises to do with the product pages? 404 ALL pages, 301 Redirect to the upper catagory?
-
Note: All product pages are on INDEX FOLLOW.
Right now this is happening with the deleted productpages:
1. When a product is removed from the new datafeed the pages stay online and are showing simliar products for 3 months. The productpages are removed from the categorie pages but not from the sitemap!
2. Pages receiving more than 3 hits after the first 3 months keep on existing and also in the sitemaps. These pages are not shown in the categories.
3. Pages from deleted datafeeds that receive 2 hits or less, are getting a 301 redirect to the upper categorie for again 3 months
4. Afther the last 3 months all 301 redirects are getting a customized 404 page with similar products.
Any suggestions of Comments about this structure?
Issues to think about:
- The amount of 404 pages Google is warning about in GWT
- Right now all productpages are indexed
- Use as much value as possible in the right way from all pages
- Usability for the visitorExtra info about the near future: Beceause of the duplicate content issue with datafeeds we are going to put all product pages on NOINDEX, FOLLOW and focus only on category and subcategory pages.
-
Also see answers on Wesley's other question thread here:
Should we noindex 65,000 product pages all at once or in steps? (paraphrasing) -
OK I understand a bit better now, yes I agree with what you are doing. All makes sense
-
Hi Alan,
Thanks for your reply!
Only the most impotant product pages are shown in the xml sitemap. Not in the HTML sitemap.
If the pages are live, than they stay in the sitemap. Off course when the pages are offline there is no sign of these pages anywere so not in the sitemaps and not in the website categories.The custom 404 returns indeed a 404 status code, so we don't got soft 404 problems
We also don't have any broken links on the website beceause links of deleted products are not shown
Thats right! You don't want to end up in a 404 loop! Crawlers will instantly hate your website...
But we really want to show some links on the custom 404 to help the visitor searching what he/she's looking for.
Just have to make sure that the links are working right_One question: You said "no redirect from internal links" but it's more about redirect from internal pages beceause all the links to productpages that are not exisiting anymore are getting removed.... Do you agree overall with the structure of 3 months redirecting and than the 404 page? _
_Note: the 3 months redirecting is important to not lose any visitors from organic rankings. It takes Google time to de-index the pages. _
Thanks in Advanced!
-
A few points, I would not put al these pages in the sitemap.xml, if you are a talking about a html sitemap visually showing on your site, then I would not have any links on y site that do not go directly to a page, don't want redirects from internal links, and you definitely don't want 404s.
You say you have a customized 404 page. does this page return a 404 status code? if not you will be getting soft 404 problems. Also a 404 page really should not have any images js or css files on it, especially if they are changing. if you get a broken link on your 404 page, such as a missing image, you will get a internal loop, and search engines really don't like that.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
400+ deleted pictures, 404 on URLs, can they be deleted without penalty?
A client had a website redesign and over 400 pictures (she's a photographer) were lost. The URL's (ending in .png) are hanging out there and according to the site scan, they have a matching current URL. Since the pictures are gone can the URL be deleted?
Intermediate & Advanced SEO | | fcromwell0 -
Why does Google rank a product page rather than a category page?
Hi, everybody In the Moz ranking tool for one of our client's (the client sells sport equipment) account, there is a trend where more and more of their landing pages are product pages instead of category pages. The optimal landing page for the term "sleeping bag" is of course the sleeping bag category page, but Google is sending them to a product page for a specific sleeping bag.. What could be the critical factors that makes the product page more relevant than the category page as the landing page?
Intermediate & Advanced SEO | | Inevo0 -
Best wordpress plugin for redirects, Old to new pages
What is the best wordpress plugin for redirects, Old to new pages?
Intermediate & Advanced SEO | | Michael.Leonard1 -
301 redirect to multiple domain
Hi guys, I have a domain A, B and C. The domain A was an association of two business and they are about to split. Parts of domain A are going to be redirect to domain B, but some content belong to the domain C. So my question : Is it possible to 301 redirect some pages from A to B and some other pages from A to C and if yes, what would be the impact on SEO ? Thanks a lot!
Intermediate & Advanced SEO | | StevePatenaude0 -
Mass 301 redirect from a sub-domain - using Joomla or htaccess
How is best to mass redirect old domains - Listing the URL's in htaccess? We are looking to use Joomla as a CMS - transferring a blog from a sub-domain to the main site and want to 301 all the sub domain blog posts - any ideas?
Intermediate & Advanced SEO | | JohnW-UK0 -
404 ? 301 ? What is your opinion ?
Hi, I have a classifieds website and I am wondering about the life of a page with an ad. An announcement has therefore a limited life, so : Is a 404 pages? a 301 redirect to the section? let the content without redirection? What is your opinion? Sorry for my english, i'm french 😉 Thanks. A.
Intermediate & Advanced SEO | | android_lyon0 -
Product pages content
Hi! I'm doing some SEO work for a new client. I've been tasked with boosting some of their products, such as http://www.lawnmowersdirect.co.uk/product/self-propelled-rear-roller-rotary-petrol-lawnmowers/honda-hrx426qx. It's currently #48 for the term Honda Izy HRG465SD, while http://www.justlawnmowers.co.uk/lawnmowers/honda-izy-hrg-465-sd.htm is #2, behind Amazon. Regarding links, there's no great shakes between the pages or even the domains. However, there's major difference in content. I'm happy to completely revamp it, I just wanted to check I'm not missing anything out before starting to rewrite it altogether! Thanks
Intermediate & Advanced SEO | | neooptic0 -
Does 301 redirect to a new domain removes penguin penality
Hi, One of my client has shady link profile and has hit by penguin update. I have confirmed the penalty using Google hack. Now, seeing his link profile, most of his links comes from blog comments which are from unmoderated blogs, and there is no way, we cant remove those comments. But without removing them, we cant get rid of the Google's penguin penality. So, i am planning on 301 redirecting to a new domain. But my question is, will the penality transfers, if i 301 to a new domain? What iff, if someone buys an old domain hit by a penguin update? Please clarify me, or if there are any alternatives to get rid of penguin update, please help me.
Intermediate & Advanced SEO | | Indexxess0