Navigation for search
-
We are getting ready to launch a site that has great navigation for users, but it is not so great for search engines. As long as we are ethical about it, does anyone see a downside to detecting a bot user agent and displaying different nav to it? I suppose some could consider it cloaking, but I noticed amazon uses this strategy and they don't seem to be getting a big penalty lol. We are not going to do anything shady with it, just offer the bot a different way to access our content. Any thoughts?
-
I would never recommend altering your site in any way specifically for a bot. Google has repeatedly stated that would be seen as cloaking and you definitely run the risk of a penalty. It can happen any time. Do you really want that cloud over your head?
Even if Amazon is able to do it, you are not Amazon. Despite any statement to the contrary, a huge site like Amazon can do things that you or I may not be able to do. We can debate the fairness of it, but we are not on a level playing field with them.
You seem to really want to do this, so feel free. But x months from now you will likely make a post "My rankings dropped and I can't figure out why", and then someone will notice the setting and that will be the answer.
-
Could you please share the site in question? we might be able to give a much more insightful thought
-
Thanks for your suggestion Alex!
-
All the content will be accessible through the sitemap which will be displayed in both versions (the user and the bot) version of the site. The only difference is the navigation will change from one version to another. It could be perceived as a gray area, even though we really are just making it more friendly to bots not trying to be deceptive at all.
-
And that should be okay if they see the content is the same between your normal version and the spider version, just a difference in presentation. It becomes a problem when you start serving drastically different content.
-
How about adding an indexable version of the navigation and then hiding it with CSS? The crawlers would see that. I haven't thought about whether that'd be a good idea, just a quick thought.
-
We usually operate under the principal that would this be ok if it were manually reviewed? In our plan, I am pretty confident that it would pass. We are planning on making what is displayed to bots very basic text link navigation. Our XML and html sitemaps will correspond well with the bot navigation (so to show G we really are not trying to hide anything). And yes we could make the nav more search friendly, but one of our main goals is to have the site look as clean as possible. As far as I can tell Amazon uses this method to avoid duplicate content issues and make their site generally more crawlable which is why I think it is on the table as an option.
-
Depending on how much you're changing, I think it could be considered cloaking and end up getting you in trouble. You'll get looked at any time you're sniffing for bots and serving up different content. Are there other ways you could make the navigation index-able?
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
How to best handle search landing pages - that don't exist
I have quite a bit of blog information that can be searched, which results in "pages" that don't actually live anywhere. These are scanned by Moz and appear as poor page quality for speed, etc. How do I get the service to either ignore all of these or is there a way to treat them as a real page with content? As there are quite a few generated over time, I'd like to be able to capture them somehow. Thanks.
On-Page Optimization | | amac70 -
Frustrated by Google Search Result
We have a page on our website for our review of the "Voltage" shisha flavor by "Social Smoke" (Social Smoke is the brand). Voltage is one of their hookah tobacco flavors. https://www.hookah.org/social-smoke-voltage-flavored-hookh-tobacco/. When I search for "Social Smoke Voltage Review", our page is at the bottom of the first page result. We have a video, decent content on the page, and a review function. We've implemented correct Schema code too: https://goo.gl/iwCP7E. When I use the page grade tool on Moz. Our page ranks B for that keyword but the results number 1 and 2 and 3 on Google all rank C or D. Our video and review schemas don't show up on Google search result either. We have a good community online. Our social media pages are popular. We share the blog posts on the social media accounts fairly regularly too. We have an old and established website. From what I understand we are following all of Google's standards and rules too. What does a website owner gotta do?
On-Page Optimization | | Heydarian0 -
Putting review aggregation in product's navigation
Do you guys think it's a bad idea to put a review aggregation page in a product's navigation? Such as: "Which Brand of Men's Shampoo Is Best for You?" Rand suggests against it in this Whiteboard Friday as it interferes with a product's funnel, but I wonder if including it in navigation will give a domain and that page increased authority for a head keyword, such as "men's shampoo." What do you guys think?
On-Page Optimization | | Edward_Sturm0 -
Should I block google indexing "search.php"
My question is I have a search page on our website , you can search by date, number of people staying and so on, I am just wondering should block this in the robots.txt ? Because we have pretty URL'S already for searching by county and searching by towns. I cannot see any benefit of having e.g "search/search.php?sp_dateFrom=16%2F12%2F2015&sp_dateTo=23%2F12%2F2015&sec_drop%5B%5D=727&spesh_town_id=764&q=&occupants=5&bedrooms=3&submit=SEARCH#search" indexed. Would I be correct in doing this ?
On-Page Optimization | | McCaldin0 -
Are three Adsense ads on a long page a negative for search ranking?
I've not a site whose home page that is #1 for a popular keyword. The page is 1200 words, plus comments following. It's a clean page with no popups, and has one large rectangle Adsense ad above the fold (lots of text around this ad, and a very high percentage of page ATF is text), and another large rectangle Adsense ad that is midway down the article (after you have to page twice to get there). So, it's a very low ad to text ratio and ATF looks very clean. I have room for one more Adsense ad closer to the bottom of the article, which would be about five page downs through the page. My question is, will placing another ad way down the page affect my ranking in any negative way? I'm so pleased with my #1 ranking I hesitate to add it. But the page converts in Adsense so well, and heat maps show a large number readers do read all the way down the page, so I'd like to pick up some more ad revenue.
On-Page Optimization | | bizzer0 -
Internal Links: Navigation Bar vs. Body Text
Hello. I have a page on our site that is especially popular and has many inbound links. This page has the same site navigation buttons (at the top) as every other page on the site. Do these site navigation buttons pass along link juice to other pages in the same way that an internal link would elsewhere on the page? Thank you!
On-Page Optimization | | nyc-seo0 -
Your thoughts on page navigation
Hi again SEOmoz community. What are your thoughts on mainpage navigation. How it should be handled? Scenario 1. - links to the main sections with a mouse rollover feature where it shows subsections of the main sections Scenario 2. - links to the main sections, but the subsections are hidden and only visible on the click Scenario 3. links to the main sections and subsections allways visible I would like to hear you oppinions on this. What did you find as the best featrue, or did you try to find someting new entirely. What do you think would be the best scenario SEO wise and in the light of keeping links on page in decent numbers 🙂 Imo, Scenario 2 is the option to go with. Tnx in advance for all your replys. Sincerely, sinisa
On-Page Optimization | | TataSinke0 -
Do Navigation links count the main link on the page?
After reading this article http://www.seomoz.org/learn-seo/anchor-text it talks about how only one link per page counts if they are going to the same page. This is what i had learned in the past; however, my understanding was if it was a in the main navigation as a child or grandchild or in the side navigation and then in the main body text, the link in the main body would count/ be held higher than the other options.
On-Page Optimization | | DoRM0