Navigation for search
-
We are getting ready to launch a site that has great navigation for users, but it is not so great for search engines. As long as we are ethical about it, does anyone see a downside to detecting a bot user agent and displaying different nav to it? I suppose some could consider it cloaking, but I noticed amazon uses this strategy and they don't seem to be getting a big penalty lol. We are not going to do anything shady with it, just offer the bot a different way to access our content. Any thoughts?
-
I would never recommend altering your site in any way specifically for a bot. Google has repeatedly stated that would be seen as cloaking and you definitely run the risk of a penalty. It can happen any time. Do you really want that cloud over your head?
Even if Amazon is able to do it, you are not Amazon. Despite any statement to the contrary, a huge site like Amazon can do things that you or I may not be able to do. We can debate the fairness of it, but we are not on a level playing field with them.
You seem to really want to do this, so feel free. But x months from now you will likely make a post "My rankings dropped and I can't figure out why", and then someone will notice the setting and that will be the answer.
-
Could you please share the site in question? we might be able to give a much more insightful thought
-
Thanks for your suggestion Alex!
-
All the content will be accessible through the sitemap which will be displayed in both versions (the user and the bot) version of the site. The only difference is the navigation will change from one version to another. It could be perceived as a gray area, even though we really are just making it more friendly to bots not trying to be deceptive at all.
-
And that should be okay if they see the content is the same between your normal version and the spider version, just a difference in presentation. It becomes a problem when you start serving drastically different content.
-
How about adding an indexable version of the navigation and then hiding it with CSS? The crawlers would see that. I haven't thought about whether that'd be a good idea, just a quick thought.
-
We usually operate under the principal that would this be ok if it were manually reviewed? In our plan, I am pretty confident that it would pass. We are planning on making what is displayed to bots very basic text link navigation. Our XML and html sitemaps will correspond well with the bot navigation (so to show G we really are not trying to hide anything). And yes we could make the nav more search friendly, but one of our main goals is to have the site look as clean as possible. As far as I can tell Amazon uses this method to avoid duplicate content issues and make their site generally more crawlable which is why I think it is on the table as an option.
-
Depending on how much you're changing, I think it could be considered cloaking and end up getting you in trouble. You'll get looked at any time you're sniffing for bots and serving up different content. Are there other ways you could make the navigation index-able?
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
What is the perfect way to handle multiple sitemaps index in Search Console?
Hello friends, I have this doubt for a long and i want to share it with you. In our agency many clients have a PHP template for the home page of their sites, and also have a blog with wordpress as CMS. When i am optimizing sitemaps, I have two separate files, an index of Sitemaps created with Wordpress SEO by Yoast (which inside has separate Sitemaps tags, categories, posts, pages, authors, etc.) and on the other hand the home page sitemap with the subsections. As you know the sitemap generated by "Wordpress SEO by Yoast" is dynamic as it creates the sitemap according to current site content, and is updated every time a new entry is raised or modify any URL. This makes it very practical. I can not have a unique index sitemap sitemaps nesting inside another, as it is not allowed by Google or Sitemap protocol. I read in the Google Support you can upload multiple sitemaps to Search Console but does not say anywhere on upload multiple sitemaps index, or a combination thereof. In my case, I would have to upload two separately files, the dynamically generated with wordpress and the manual created for the PHP template. In my opinion there is no problem and Google will index everything properly performing it this way, but I wanted to share it with you to see how you solve this problem and what experiences had. Thanks and best regards.
On-Page Optimization | | NachoRetta1 -
Keep our category navigation in tree structure but move our URLs to a more flat structure. Good plan?
In our Magento store, products are arranged into categories, subcategories and so on. We typically have 3 or 4 layers of category depth. This makes it nice and easy for customers to find stuff, but it means that the end categories have massive long urls. I'd like to keep our category tree structure in place from a navigation point of view, but I feel the url structure is pushing some important stuff to the back of the shop as it were. We have something like 200 categories in total. So, assuming every individual category has an a unique name, I'd like to rewrite the urls so that: ourshop.com/car-parts/
On-Page Optimization | | DWJames
stays as
ourshop.com/car-parts/ ourshop.com/car-parts/suspension/
becomes
ourshop.com/suspension/ ourshop.com/car-parts/suspension/springs
becomes
ourshop.com/springs/ ourshop.com/car-parts/suspension/springs/thismake-lowering-springs
becomes
ourshop.com/thismake-lowering-springs/ and so on....
I'll need some custom magento URL rewrite work done, but that's another story. The real question is whether you guys feel this is worthwhile? Are there any other stores with a deep categorised navigation structure, but a flat url structure? thanks, James0 -
Main navigation with pictures & Alt Tags vs Text/ Link based Navigation
Hi, do I loose an opportunity to rank better if I use a navigation with Alt-tagged Pictures in comparison to a Text/ Link based main navigation? Thanks, Sebastian
On-Page Optimization | | Naturalmente0 -
How do I avoid cannibalization and point search engines to the correct page?
Currently this page ranks for the phrase "keep calm and carry on" http://www.paper-source.com/cgi-bin/paper/item/Keep-Calm-and-Carry-On-Bandages/3307.010/413160.html This page is just one product of many in the Keep Calm category. I'd rather this page be the result: http://www.paper-source.com/cgi-bin/paper/gifts/keep-calm-and-carry-on.html seomoz states: "To prevent engines from potentially seeing a signal that this page is not the intended ranking target and creating additional competition for your page, we suggest staying away from linking internally to another page with the target keyword(s) as the exact anchor text." So obviously I should remove the link from the product detail page, but what other things can I do to get the category page to rank higher than the one product page? Thanks!
On-Page Optimization | | leighw0 -
How could I avoid the "Duplicate Page Content" issue on the search result pages of a webshop site?
My webshop site was just crawled by Roger, and it found 683 "Duplicate Page Content" issues. Most of them are result pages of different product searches, that are not really identical, but very similar to each other. Do I have to worry about this? If yes, how could I make the search result pages different? IS there any solution for this? Thanks: Zoltan
On-Page Optimization | | csajbokz0 -
Value in a Bottom Navigation Bar
Hi Guys, I'm trying to decide whether or not to have a bottom navigation bar. I'm thinking of putting a mini site map at the bottom of each page. This mini site map will change depending on the page the user is on. I'm curious on the SEO value this will bring as I understand that there is very little SEO value from links this far down the page but also it could potentially bring the total number of links on that page to over 100. What do you guys think? To have or not to have a bottom navigation bar and why? Thanks, Walid
On-Page Optimization | | walidalsaqqaf0 -
Does anyone know why my Home page isn't visible in search terms?
If I type in my meta description for my homepage in google search or any of my keywords only my inner pages are returned in the results. I have a PR3 on the homepage so I don't think google is blocking my site and all my inner pages seem to show up.
On-Page Optimization | | Michael.Constable0