Navigation for search
-
We are getting ready to launch a site that has great navigation for users, but it is not so great for search engines. As long as we are ethical about it, does anyone see a downside to detecting a bot user agent and displaying different nav to it? I suppose some could consider it cloaking, but I noticed amazon uses this strategy and they don't seem to be getting a big penalty lol. We are not going to do anything shady with it, just offer the bot a different way to access our content. Any thoughts?
-
I would never recommend altering your site in any way specifically for a bot. Google has repeatedly stated that would be seen as cloaking and you definitely run the risk of a penalty. It can happen any time. Do you really want that cloud over your head?
Even if Amazon is able to do it, you are not Amazon. Despite any statement to the contrary, a huge site like Amazon can do things that you or I may not be able to do. We can debate the fairness of it, but we are not on a level playing field with them.
You seem to really want to do this, so feel free. But x months from now you will likely make a post "My rankings dropped and I can't figure out why", and then someone will notice the setting and that will be the answer.
-
Could you please share the site in question? we might be able to give a much more insightful thought
-
Thanks for your suggestion Alex!
-
All the content will be accessible through the sitemap which will be displayed in both versions (the user and the bot) version of the site. The only difference is the navigation will change from one version to another. It could be perceived as a gray area, even though we really are just making it more friendly to bots not trying to be deceptive at all.
-
And that should be okay if they see the content is the same between your normal version and the spider version, just a difference in presentation. It becomes a problem when you start serving drastically different content.
-
How about adding an indexable version of the navigation and then hiding it with CSS? The crawlers would see that. I haven't thought about whether that'd be a good idea, just a quick thought.
-
We usually operate under the principal that would this be ok if it were manually reviewed? In our plan, I am pretty confident that it would pass. We are planning on making what is displayed to bots very basic text link navigation. Our XML and html sitemaps will correspond well with the bot navigation (so to show G we really are not trying to hide anything). And yes we could make the nav more search friendly, but one of our main goals is to have the site look as clean as possible. As far as I can tell Amazon uses this method to avoid duplicate content issues and make their site generally more crawlable which is why I think it is on the table as an option.
-
Depending on how much you're changing, I think it could be considered cloaking and end up getting you in trouble. You'll get looked at any time you're sniffing for bots and serving up different content. Are there other ways you could make the navigation index-able?
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
How to get stars in my search results?
Is it possible for me to take my Google reviews and show them under my homepage as stars when my page is shown in search results. I provide a service, so I don't have separate product reviews. My homepage is what ranks most in the searches I target. If this is possible, what is the best way to do it technically? I have a wordpress site. Thank you in advance!
On-Page Optimization | | CalicoKitty20001 -
Fixing Index Errors in the new Google Search Console - Help
Hi, So I have started using the new Search Console and for one of my clients, there are a few 'Index Coverage Errors'. In the old version you could simply, analyse, test and then mark any URLs as fixed - does anyone know if that is possible in the new version? There are options to validate errors but no 'mark as fixed' options. Do you need to validate the errors before you can fix them?
On-Page Optimization | | daniel-brooks0 -
How to rank in Google during domain name search?
We have received one requirement for this website. http://www.coldcasebeer.com/ We would like to rank in Google during domain name search. If we are going to search following search terms in Google then We are not able to see this domain on first page of Google search result. cold case beer coldcasebeer We have done quick research on this issue. And, We have decided to implement following tasks to make it happen.But, We are quite excited to read certain inputs on this question from experts! 1. Upload default Robots.txt file 2. Verify website on Google webmaster tools 3. Set up USA region on Google webmaster tools 4. Submit Google crawl request on Google webmaster tools 5. Title tag and Meta description optimization for all pages (There are 5 pages only on website) 6. Audit Google local listing 7. Develop quality links with domain name
On-Page Optimization | | CommercePundit0 -
Google Site Search & SEO benefits
Hi all - I've had a comb through the forums here but can't seem to find any updates on whether there any tangible benefits for using Google Site Search. We're currently exploring using Lucene, Oracle Endeca, & Google Site Search - but from what I've read so far there are no quantifiable benefits for choose Google over any others. Everything I've read is rumor-mill...anybody have experience or references? Thanks in advance!
On-Page Optimization | | kenno690 -
Your thoughts on page navigation
Hi again SEOmoz community. What are your thoughts on mainpage navigation. How it should be handled? Scenario 1. - links to the main sections with a mouse rollover feature where it shows subsections of the main sections Scenario 2. - links to the main sections, but the subsections are hidden and only visible on the click Scenario 3. links to the main sections and subsections allways visible I would like to hear you oppinions on this. What did you find as the best featrue, or did you try to find someting new entirely. What do you think would be the best scenario SEO wise and in the light of keeping links on page in decent numbers 🙂 Imo, Scenario 2 is the option to go with. Tnx in advance for all your replys. Sincerely, sinisa
On-Page Optimization | | TataSinke0 -
Authorship and 50% Drop in Search Traffic
Hi. I had some problems with my content being copied by other sites, and was suggested to claim my pages. Immediately after Google started listing the posts with my photo next to them my traffic picked up slightly but since, over the past few weeks, it has dropped by about 50%! It seems that the average position has declined (as has the CTR) At the same time as claiming authorship I added the post date to my articles which I have now removed. Does anyone have any ideas for me? Thanks!
On-Page Optimization | | ben10000 -
Seomoz tabbed search
Hi, this question might not be SEO specific but i was wondering how seomoz implemented a direct search from the chrome omnibox (you write www.seomoz.org and the press TAB)? BR Carl
On-Page Optimization | | careeron0 -
Google is indexing spam pages from my site. What is the most effective way to get ride of the search results? Pages are deleted now but should I do something more?
A long time ago I created a forum (Invision Power Board) and it got full of spam. Massive amounts! /forum/ I've now deleted the forum but the spam pages are still indexed on Google. Can I do something else to hurry up the process to get ride of them?
On-Page Optimization | | ocarlsson0