Navigation for search
-
We are getting ready to launch a site that has great navigation for users, but it is not so great for search engines. As long as we are ethical about it, does anyone see a downside to detecting a bot user agent and displaying different nav to it? I suppose some could consider it cloaking, but I noticed amazon uses this strategy and they don't seem to be getting a big penalty lol. We are not going to do anything shady with it, just offer the bot a different way to access our content. Any thoughts?
-
I would never recommend altering your site in any way specifically for a bot. Google has repeatedly stated that would be seen as cloaking and you definitely run the risk of a penalty. It can happen any time. Do you really want that cloud over your head?
Even if Amazon is able to do it, you are not Amazon. Despite any statement to the contrary, a huge site like Amazon can do things that you or I may not be able to do. We can debate the fairness of it, but we are not on a level playing field with them.
You seem to really want to do this, so feel free. But x months from now you will likely make a post "My rankings dropped and I can't figure out why", and then someone will notice the setting and that will be the answer.
-
Could you please share the site in question? we might be able to give a much more insightful thought
-
Thanks for your suggestion Alex!
-
All the content will be accessible through the sitemap which will be displayed in both versions (the user and the bot) version of the site. The only difference is the navigation will change from one version to another. It could be perceived as a gray area, even though we really are just making it more friendly to bots not trying to be deceptive at all.
-
And that should be okay if they see the content is the same between your normal version and the spider version, just a difference in presentation. It becomes a problem when you start serving drastically different content.
-
How about adding an indexable version of the navigation and then hiding it with CSS? The crawlers would see that. I haven't thought about whether that'd be a good idea, just a quick thought.
-
We usually operate under the principal that would this be ok if it were manually reviewed? In our plan, I am pretty confident that it would pass. We are planning on making what is displayed to bots very basic text link navigation. Our XML and html sitemaps will correspond well with the bot navigation (so to show G we really are not trying to hide anything). And yes we could make the nav more search friendly, but one of our main goals is to have the site look as clean as possible. As far as I can tell Amazon uses this method to avoid duplicate content issues and make their site generally more crawlable which is why I think it is on the table as an option.
-
Depending on how much you're changing, I think it could be considered cloaking and end up getting you in trouble. You'll get looked at any time you're sniffing for bots and serving up different content. Are there other ways you could make the navigation index-able?
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Does redoing a homepage impact search rankings?
Hello, all! Does anyone know if redesigning a website's homepage affects search rankings? I'm considering redoing my website's homepage - including rewriting the copy, and perhaps in Leadpages - but I don't want to compromise search. I gather that SEO is a bit of a black box, but am curious to hear others' perspectives before moving ahead. Thanks in advance for sharing your time and thoughts!
On-Page Optimization | | lightsfilmschool0 -
Best way for navigation, niche E-commerce
Hi community friends. Ive have started to work on our 2.0 e-commerce store mostly when it comes to design and the ux. Its a woocommerce setup and in total we have 34 products! We have e niche site where we sell products as a system towards the building industry. Each product served its purpose within a construction detail and needs some explanation for a first time user/customer. So, first thing we did now was to ad the short description to our loop to bring some more info to the user and guide them in the right direction quick. Now the products are divided in to four categories. We actually gain a lot of traffic from those category landing pages and i am not so eager to change the way the products are categorised. The old menu where built up by a sidebar with links to the different categories and to tags pages. Where the category where for example "Adhesive" and the Tag "Seal a window from the outside". The category gives the broader direction, and the tag gives the final usage/solution/purpose with the product. In the 2.0 we would like to remove the sidebar in the product pages in favor for a full widht product page with more focus on the product and the specs. This leads us to put our navigation up in the main menu part for the desktop version. Now to the questions. 1. Do you think that we are doing it the right way, to niche and set the final usage/path to our products with tags, or should it be done in another way? 2. For the UX, do you think that removing the sidebar navigation on the product pages will lead to a worse user/shopping experience? Attached you can see some pics from our dev server where the new menu are being built up, and also the new product page layout. Please give me some feedback! 🙂 // J open?id=0BzS3SfsD0lmcSFR4a21rRlVBcjA open?id=0BzS3SfsD0lmcM0djUi1pcXdrOWM
On-Page Optimization | | knubbz0 -
Putting review aggregation in product's navigation
Do you guys think it's a bad idea to put a review aggregation page in a product's navigation? Such as: "Which Brand of Men's Shampoo Is Best for You?" Rand suggests against it in this Whiteboard Friday as it interferes with a product's funnel, but I wonder if including it in navigation will give a domain and that page increased authority for a head keyword, such as "men's shampoo." What do you guys think?
On-Page Optimization | | Edward_Sturm0 -
Does PLA hurt my organic google search.
I have experienced a big drop in my organic trafic to my site. But an increase in my cpc...? Does google punish my site for PLA to get higher revenue?
On-Page Optimization | | Egmont0 -
Please give me advice on how to get this page back into search engines
Hi. Before we had our site www.in2town.co.uk upgraded, we had this section on the first page of google and even though it does not badly with other search engines, with google we are not in the top fifty. the page is http://www.in2town.co.uk/gastric-band-hypnotherapy i would be so grateful for advice on how to get this section back into google i am also concerned that i have a category called gastric band hypnotherapy, what i mean is, http://www.in2town.co.uk/gastric-band-hypnotherapy/crash-diets-can-damage-your-health-says-gastric-band-hypnosis-expert as you can see from above, we have the category name which is gastric band hypnotherapy and then the article name, just wondering if this is damaging us. any help to sort our ranking issue our would be amazing
On-Page Optimization | | ClaireH-1848860 -
How do I avoid cannibalization and point search engines to the correct page?
Currently this page ranks for the phrase "keep calm and carry on" http://www.paper-source.com/cgi-bin/paper/item/Keep-Calm-and-Carry-On-Bandages/3307.010/413160.html This page is just one product of many in the Keep Calm category. I'd rather this page be the result: http://www.paper-source.com/cgi-bin/paper/gifts/keep-calm-and-carry-on.html seomoz states: "To prevent engines from potentially seeing a signal that this page is not the intended ranking target and creating additional competition for your page, we suggest staying away from linking internally to another page with the target keyword(s) as the exact anchor text." So obviously I should remove the link from the product detail page, but what other things can I do to get the category page to rank higher than the one product page? Thanks!
On-Page Optimization | | leighw0 -
Footer Navigation
We have links to our key pages at the top of the website:- Home Our Services Work Examples About Us But we have many more pages than this. In the footer of the website we have additional links to the individual services and pages such as FAQs and Customer Feedback. Does having the links here lessen their effectiveness in terms of SEO?
On-Page Optimization | | AndieF0 -
Numbers in URL's - Search friendly or not?
Hi Mozzers, I have a client who has just launched a new website and we are having difficulties in making the URL's search friendly. I wont get into the technical aspects, but I'll explain the potential solutions the developers have given me. current: www.site.com/en/product/browse-by-product/37/22 Where 'en' stands for the English version of the website, 37 is the product category for example 'hard drives', and 22 is the product name or example 'seagate' Option to fix; www.site.com/en/p/product/hard-drives-37/seagate-22 This optional fix reduces the word product down to p, reduces 'browse by product' to 'product' and inserts the category and product names. Note the category identifier '37' has to be included in the URL, and the product identifier '22' also has to be in the URL. Obviously this is not great, but it is required at the moment. Best case scenario would be to have the URL like this... www.site.com/en/hard-drives/seagate So my question is, how far off the best case scenario is the option to fix? Scale of 1 to 10 would be good?
On-Page Optimization | | JoeyDorrington0