Navigation for search
-
We are getting ready to launch a site that has great navigation for users, but it is not so great for search engines. As long as we are ethical about it, does anyone see a downside to detecting a bot user agent and displaying different nav to it? I suppose some could consider it cloaking, but I noticed amazon uses this strategy and they don't seem to be getting a big penalty lol. We are not going to do anything shady with it, just offer the bot a different way to access our content. Any thoughts?
-
I would never recommend altering your site in any way specifically for a bot. Google has repeatedly stated that would be seen as cloaking and you definitely run the risk of a penalty. It can happen any time. Do you really want that cloud over your head?
Even if Amazon is able to do it, you are not Amazon. Despite any statement to the contrary, a huge site like Amazon can do things that you or I may not be able to do. We can debate the fairness of it, but we are not on a level playing field with them.
You seem to really want to do this, so feel free. But x months from now you will likely make a post "My rankings dropped and I can't figure out why", and then someone will notice the setting and that will be the answer.
-
Could you please share the site in question? we might be able to give a much more insightful thought
-
Thanks for your suggestion Alex!
-
All the content will be accessible through the sitemap which will be displayed in both versions (the user and the bot) version of the site. The only difference is the navigation will change from one version to another. It could be perceived as a gray area, even though we really are just making it more friendly to bots not trying to be deceptive at all.
-
And that should be okay if they see the content is the same between your normal version and the spider version, just a difference in presentation. It becomes a problem when you start serving drastically different content.
-
How about adding an indexable version of the navigation and then hiding it with CSS? The crawlers would see that. I haven't thought about whether that'd be a good idea, just a quick thought.
-
We usually operate under the principal that would this be ok if it were manually reviewed? In our plan, I am pretty confident that it would pass. We are planning on making what is displayed to bots very basic text link navigation. Our XML and html sitemaps will correspond well with the bot navigation (so to show G we really are not trying to hide anything). And yes we could make the nav more search friendly, but one of our main goals is to have the site look as clean as possible. As far as I can tell Amazon uses this method to avoid duplicate content issues and make their site generally more crawlable which is why I think it is on the table as an option.
-
Depending on how much you're changing, I think it could be considered cloaking and end up getting you in trouble. You'll get looked at any time you're sniffing for bots and serving up different content. Are there other ways you could make the navigation index-able?
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Text that appears when hovering over navigation tabs
Hi, I have a Wordpress website and want to delete or edit the text that appears when I hover over my navigation tabs. In my case, the text is always the same as the page title, but I don't know where to edit it separately. When I change the title of a page that is in the navigation, the text that appears changes too. So the general setting is that this text is the same as the page title. Does somebody have an idea where to edit this? Thanks!
On-Page Optimization | | Mat_C0 -
We have new website abexpress.ae. The website is not ranking in the first page when I search with the Domain name itself. Any tips to improve the SEO for a new website?
We have launched a website abexpress.ae. The website is not ranking well even if we search with the Domain name. The Domain authority of the website it 10. How to increase this?
On-Page Optimization | | AlliedTransport0 -
Are three Adsense ads on a long page a negative for search ranking?
I've not a site whose home page that is #1 for a popular keyword. The page is 1200 words, plus comments following. It's a clean page with no popups, and has one large rectangle Adsense ad above the fold (lots of text around this ad, and a very high percentage of page ATF is text), and another large rectangle Adsense ad that is midway down the article (after you have to page twice to get there). So, it's a very low ad to text ratio and ATF looks very clean. I have room for one more Adsense ad closer to the bottom of the article, which would be about five page downs through the page. My question is, will placing another ad way down the page affect my ranking in any negative way? I'm so pleased with my #1 ranking I hesitate to add it. But the page converts in Adsense so well, and heat maps show a large number readers do read all the way down the page, so I'd like to pick up some more ad revenue.
On-Page Optimization | | bizzer0 -
How to exclude URL filter searches in robots.txt
When I look through my MOZ reports I can see it's included 'pages' which it shouldn't have included i.e. adding filtering rules such as this one http://www.mydomain.com/brands?color=364&manufacturer=505 How can I exclude all of these filters in the robots.txt? I think it'll be: Disallow: /*?color=$ Is that the correct syntax with the $ sign in it? Thanks!
On-Page Optimization | | neenor0 -
Infinite Scrolling in On-Page Search Results
We have a website being built that will effectively function like an e-commerce site. When customers search within the site, we will display the results (sometimes hundreds). We were thinking of implementing infinite scrolling, but with so many results which all function as links to product pages, would this look funny i.e. having too many onpage links? Would the links at the bottom pretty much just be ignored (which is fine) or would they bring disrepute to the results further toward the top of the page? Thanks!
On-Page Optimization | | LeahHutcheon0 -
How to make video snapshot appear near your search result
What's the proper way to have google display a video near the search result for my webpage (I'm using LeadPlayer to play videos). I think that the information regarding the video is there (I also submitted a video sitemap) but when I do a search the author picture is displayed instead of the video. Have I set anything wrong? How can I display the video if my post contains a video? You can try searching "phraseexpander create customizable templates" There's my youtube video and then the result from my webpage http://www.phraseexpander.com I would like to display the video as a result. Thanks a lot. Andrea
On-Page Optimization | | nagar0 -
Accessibility search
Hello there, One of the sites we do work for is a chain of care homes. We are in the process of adding a page reader so any visitors they have who are visually impaired will find it easier to access the info they need. We're doing this from a usability point of view more than anything (given their target audience), but while looking to see if there were any accessibility news sites /directories we could leverage for some links I came across mentions of the old Google Accessibility search. It seems to have been before my time as an SEO, so I wondered: is this still relevant, or has it just been assimilated into the regular algorithm (the only mentions I could find were very dated) if relevant and separate from the main search, are there many who use it what other things should we take into account when trying to optimise for this (assuming it's still relevant, of course) Cheers guys!
On-Page Optimization | | themegroup0 -
ON SITE SEARCH INDEXED BY GOOGLE - no follow or no index
Google indexes alll our internetal searches: search box is brand - clothes types - size type - and for each page it creates a page that which creates duplicate page title and unnecessary content. Should I do a nofollow on the advance search or a no index. Many thanks for the info. Sonja
On-Page Optimization | | reallyitsme0