Navigation for search
-
We are getting ready to launch a site that has great navigation for users, but it is not so great for search engines. As long as we are ethical about it, does anyone see a downside to detecting a bot user agent and displaying different nav to it? I suppose some could consider it cloaking, but I noticed amazon uses this strategy and they don't seem to be getting a big penalty lol. We are not going to do anything shady with it, just offer the bot a different way to access our content. Any thoughts?
-
I would never recommend altering your site in any way specifically for a bot. Google has repeatedly stated that would be seen as cloaking and you definitely run the risk of a penalty. It can happen any time. Do you really want that cloud over your head?
Even if Amazon is able to do it, you are not Amazon. Despite any statement to the contrary, a huge site like Amazon can do things that you or I may not be able to do. We can debate the fairness of it, but we are not on a level playing field with them.
You seem to really want to do this, so feel free. But x months from now you will likely make a post "My rankings dropped and I can't figure out why", and then someone will notice the setting and that will be the answer.
-
Could you please share the site in question? we might be able to give a much more insightful thought
-
Thanks for your suggestion Alex!
-
All the content will be accessible through the sitemap which will be displayed in both versions (the user and the bot) version of the site. The only difference is the navigation will change from one version to another. It could be perceived as a gray area, even though we really are just making it more friendly to bots not trying to be deceptive at all.
-
And that should be okay if they see the content is the same between your normal version and the spider version, just a difference in presentation. It becomes a problem when you start serving drastically different content.
-
How about adding an indexable version of the navigation and then hiding it with CSS? The crawlers would see that. I haven't thought about whether that'd be a good idea, just a quick thought.
-
We usually operate under the principal that would this be ok if it were manually reviewed? In our plan, I am pretty confident that it would pass. We are planning on making what is displayed to bots very basic text link navigation. Our XML and html sitemaps will correspond well with the bot navigation (so to show G we really are not trying to hide anything). And yes we could make the nav more search friendly, but one of our main goals is to have the site look as clean as possible. As far as I can tell Amazon uses this method to avoid duplicate content issues and make their site generally more crawlable which is why I think it is on the table as an option.
-
Depending on how much you're changing, I think it could be considered cloaking and end up getting you in trouble. You'll get looked at any time you're sniffing for bots and serving up different content. Are there other ways you could make the navigation index-able?
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Snippet showed in google search is not from metaDescription
This is my page https://www.collegehippo.com/graduate-school/programs/top-ranked-masters-degree-museum-museology-and-curatorial-studies The metaDescription is | |
On-Page Optimization | | etattva
| name="description" content="Master's degree in Museum, Museology and Curatorial Studies is offered by 49 American universities. New York University had highest number of international students receiving a Master's degree. Johns Hopkins University had the most women graduates in this program. Job outlook for Museum, Museology and Curatorial Studies Museum, Museology and Curatorial Studies is projected to grow 13 percent from 2016 to 2026, faster than average for all occupations. Median pay for Museum, Museology and Curatorial Studies in 2018 was $53,360. The number of jobs were 11170. Check out best universities offering online Master's program in Museum, Museology and Curatorial Studies "/> |
| | | But when I see the page in google search results for (museum studies graduate programs), This is how it appears in the search results. It is showing the breadcrumbs from the page.I am not sure why is google is treating the page like this. It was not like that 5 months back. Nothing much changed in page and google is displaying the page content like this . How can I fix this?
0 -
Does redoing a homepage impact search rankings?
Hello, all! Does anyone know if redesigning a website's homepage affects search rankings? I'm considering redoing my website's homepage - including rewriting the copy, and perhaps in Leadpages - but I don't want to compromise search. I gather that SEO is a bit of a black box, but am curious to hear others' perspectives before moving ahead. Thanks in advance for sharing your time and thoughts!
On-Page Optimization | | lightsfilmschool0 -
Google search returns blog homepage, but not article
When I do a google search for a specific article on our blog the search results only return the blog homepage with the article title shown in the meta description, but never the actual article page. I've tried to refine my search by using site: and quotation marks around the article title (e.g site:www.example.com "article title") but still only get the homepage. Our blog is showing up so I assume it's not an indexing issue, but not sure how to get the article pages to show on serps. Any ideas? Thanks!
On-Page Optimization | | STP_SEO0 -
Snippet showing as domain name with apostrophe, instead of page title when searching for the domain name.
Hi, We have an issue with one of our websites, with the snippet dispaying differently in Google serps when searching for the domain or the website name rather than a search term. When searching for a search term, the page title shows as expected, but when searching for the site by the domain name either with or without the tld, it shows the snippet as the domain name with an apostrophe at the end. Domain is subli.co.uk Thanks in advance for any advice!
On-Page Optimization | | K3v1n0 -
Navigational Links in Dropdown Menus
Hi Mozzers will navigational links in dropdown menus carry the same weight for Google, just as navigational links that are always visible to the user do? Thx, Chris
On-Page Optimization | | Diderino0 -
Ecommerce internal search results pages
I'm working on a ecommerce site that allows product search results pages to be sorted a variety of ways (best selling, newest, by price). Each of these search filters creates a new url i.e. /all/best/1 and /all/best/2; /all/new/1 and /all/new/2; etc. These search results pages have been indexed and the site is receiving enough organic traffic from these pages that I don't want to add noindex,follow to them. I am planning on implementing rel=prev,rel=next for each filter, but I'm concerned about duplicate content considering I can't create unique meta data for each page. Should I canonical all pages to the first search results page without filters applied? Or any other ideas on how I should proceed?
On-Page Optimization | | ang0 -
Title Tag Not Relaying In Google Search
Our title tag is "<title>HCG</span> Diet - HCG Drops - Example Weight Loss - HCG Diet Weight Loss</title>" But in google it is only displaying "HCG diet" Reasons? What can I do to fix this? I'm trying to get this fixed asap, as it is our homepage that is being effected by it.
On-Page Optimization | | HCGDiet0 -
DUPLICATE PAGE VIA ONPAGE SEARCH
Hi, we have a fashion shop and we try to keep the page title as unique as possible. However google also indexes the search so the say search for brand gucci - type - dress - size 8 - then it indexes it with the homepage title rather then what the searched for. Should I block google from indexing search variation (because there could be thousand of variations) or is there a module that would use the search as a page title so gucci dress 8 for example. Many thanks for your time.
On-Page Optimization | | reallyitsme0