Navigation for search
-
We are getting ready to launch a site that has great navigation for users, but it is not so great for search engines. As long as we are ethical about it, does anyone see a downside to detecting a bot user agent and displaying different nav to it? I suppose some could consider it cloaking, but I noticed amazon uses this strategy and they don't seem to be getting a big penalty lol. We are not going to do anything shady with it, just offer the bot a different way to access our content. Any thoughts?
-
I would never recommend altering your site in any way specifically for a bot. Google has repeatedly stated that would be seen as cloaking and you definitely run the risk of a penalty. It can happen any time. Do you really want that cloud over your head?
Even if Amazon is able to do it, you are not Amazon. Despite any statement to the contrary, a huge site like Amazon can do things that you or I may not be able to do. We can debate the fairness of it, but we are not on a level playing field with them.
You seem to really want to do this, so feel free. But x months from now you will likely make a post "My rankings dropped and I can't figure out why", and then someone will notice the setting and that will be the answer.
-
Could you please share the site in question? we might be able to give a much more insightful thought
-
Thanks for your suggestion Alex!
-
All the content will be accessible through the sitemap which will be displayed in both versions (the user and the bot) version of the site. The only difference is the navigation will change from one version to another. It could be perceived as a gray area, even though we really are just making it more friendly to bots not trying to be deceptive at all.
-
And that should be okay if they see the content is the same between your normal version and the spider version, just a difference in presentation. It becomes a problem when you start serving drastically different content.
-
How about adding an indexable version of the navigation and then hiding it with CSS? The crawlers would see that. I haven't thought about whether that'd be a good idea, just a quick thought.
-
We usually operate under the principal that would this be ok if it were manually reviewed? In our plan, I am pretty confident that it would pass. We are planning on making what is displayed to bots very basic text link navigation. Our XML and html sitemaps will correspond well with the bot navigation (so to show G we really are not trying to hide anything). And yes we could make the nav more search friendly, but one of our main goals is to have the site look as clean as possible. As far as I can tell Amazon uses this method to avoid duplicate content issues and make their site generally more crawlable which is why I think it is on the table as an option.
-
Depending on how much you're changing, I think it could be considered cloaking and end up getting you in trouble. You'll get looked at any time you're sniffing for bots and serving up different content. Are there other ways you could make the navigation index-able?
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Text that appears when hovering over navigation tabs
Hi, I have a Wordpress website and want to delete or edit the text that appears when I hover over my navigation tabs. In my case, the text is always the same as the page title, but I don't know where to edit it separately. When I change the title of a page that is in the navigation, the text that appears changes too. So the general setting is that this text is the same as the page title. Does somebody have an idea where to edit this? Thanks!
On-Page Optimization | | Mat_C0 -
Google search returns blog homepage, but not article
When I do a google search for a specific article on our blog the search results only return the blog homepage with the article title shown in the meta description, but never the actual article page. I've tried to refine my search by using site: and quotation marks around the article title (e.g site:www.example.com "article title") but still only get the homepage. Our blog is showing up so I assume it's not an indexing issue, but not sure how to get the article pages to show on serps. Any ideas? Thanks!
On-Page Optimization | | STP_SEO0 -
New website showing old domain titles in search
Hello Moz, We have recently built a new website http://www.hegroup.org.uk/ The new site has the domain for one of the clients old sites pointing to it - heartofmersey.org.uk. When we check the SEO index (site:hegroup.org.uk) for the new site, most of of the indexed items are using the old 'Heart of Mersey' title in the index although these do redirect to the new site. See below. Heart of Mersey <cite class="_Rm">www.hegroup.org.uk/</cite>Jessica Bell · Andrew Bennett · Nicola Calder · Matt Donnelly · Alexandra Holt · Robin Ireland · Magdalena Kolka · Alison Gradwell · Matthew Philpott · Trustees. Not sure how to resolve this issue. Any suggestions Thanks Ian
On-Page Optimization | | Substance-create0 -
Site not showing up in Google search since move
Hi, hoping someone might help me with some answer(s) as to why our site no longer shows up in Google search results. Even when we type the full name and city into Google, the site is absent. Our Facebook page, LinkedIn and some backlinks show, but our site is missing. I can no longer find it in Google places. I'm sure I've done something wrong since moving from a static (flash-based) site to Wordpress. But the robots.txt file looks okay to me and the sitemap.xml file is present. Anyway, this is what happens when you ask a network technician handle website design... We know just enough to be dangerous! Here is the site in question: www.newfrontiertechnologies.com located in Shoreline WA. Any advice is much appreciated.
On-Page Optimization | | NFTECH0 -
Search Pages outranking Product Pages
A lot of the results seen in the search engines for our site are pages from our search results on our site, i.e. Widgets | Search Results This has happened over time and wasn't intentional, but in many cases we see our search results pages appearing over our actual product pages in search, which isn't ideal. Simply blocking indexing of these pages via robots wouldn't be ideal, at least all at once as we would have that period of time where those Search Results pages would be offline and our product pages would still be at the back of ranking. Any ideas on a strategy to replace these Search Results with the actual products in a way that won't hurt us too bad during the transition? Or a way to make the actual product pages rank above the search results? Currently, it is often the opposite. Thanks! Craig
On-Page Optimization | | TheCraig0 -
Making a subdomain more search engine friendly?
I have a volusion website, and I cannot have a subdirectory, it must be a subdomain. Is there anything I can do to optimize this subdomain to make it more search engine friendly?
On-Page Optimization | | SKMEIS0 -
Google Maps API as primary navigation
Is it okay for SEO to have a google maps api as the primary source of navigation? For example, have people find locations on a map instead of links to them. I'm wondering how/if Google views this method, kinda like how Google can't read images. Will Google realize that these pages are linked to from the homepage gmaps API?
On-Page Optimization | | terran0 -
Main navigation with pictures & Alt Tags vs Text/ Link based Navigation
Hi, do I loose an opportunity to rank better if I use a navigation with Alt-tagged Pictures in comparison to a Text/ Link based main navigation? Thanks, Sebastian
On-Page Optimization | | Naturalmente0