No follow for html sitemap?
-
Hi,
I have been working on an e-commerce site and have been wondering if i should add the meta robot tag with no follows, on pages like delivery , terms, returns and the html sitemap?
From what I have read this seems a good idea, but i am a little confused as what to do with the html sitemap. I can understand that having this on the homepage will allow crawlers quick access to the deeper pages within the site. But would it be better to guide them down the natural route of the category navigation instead?
Thanks
-
Matt Cutts recommends against using nofollow this way -- now, you might want to take anything Matt says with a grain of salt, but we do know that you cannot control the flow of PageRank in this way. Your other pages will not get more PR because you have nofollowed others; instead Matt says, the PR is lost. See the video
That said, a larger site might benefit indirectly from a judicious use of the robots.txt file to prevent the indexing pf pages that are not likely to end up in the SERPs and allowing more of the site's crawl time allotment for pages that have SERP value.
-
Basically you'll use the html sitemap for your visitors. The reason for adding no follow to the html sitemap and the other pages is that you would like the link juice not going to pages you have no intention for ranking (being high up in the SERPs).
For the search engine robots you'll need a sitemap.xml file. So in the optimal situation you need two sitemaps. Hope this helps!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
How to fix duplicate content for homepage and index.html
Hello, I know this probably gets asked quite a lot but I haven't found a recent post about this in 2018 on Moz Q&A, so I thought I would check in and see what the best route/solution for this issue might be. I'm always really worried about making any (potentially bad/wrong) changes to the site, as it's my livelihood, so I'm hoping someone can point me in the right direction. Moz, SEMRush and several other SEO tools are all reporting that I have duplicate content for my homepage and index.html (same identical page). According to Moz, my homepage (without index.html) has PA 29 and index.html has PA 15. They are both showing Status 200. I read that you can either do a 301 redirect or add rel=canonical I currently have a 301 setup for my http to https page and don't have any rel=canonical added to the site/page. What is the best and safest way to get rid of duplicate content and merge the my non index and index.html homepages together these days? I read that both 301 and canonical pass on link juice but I don't know what the best route for me is given what I said above. Thank you for reading, any input is greatly appreciated!
On-Page Optimization | | dreservices0 -
Which version of the homepage on the sitemap?
We have been wondering this for a while now. When we build our sitemaps, or when the yoast plugin does in WP we are often left with www.yourdomain.co.uk/ and www.yourdomain.co.uk/index.html in our sitemaps. Surely it isn't healthy to have both in the sitemap. Which one should we take out? Thanks
On-Page Optimization | | EveronSEO0 -
Is this sitemap valid?
I seem to be having a problem getting google to index all the pages on my site. Usually within a week they've been indexed. The sitemap url is http://www.local-sex-search.com/sitemap.xml (this is an adult dating site). Any help appreciated.
On-Page Optimization | | SamCUK0 -
I have a duplicate URL from example.html to example without .html
I've recently changed my links from example.html to just example, however, moz shows that its been duplicated. Is this effects my ranking? if yes, how i can fix it please?
On-Page Optimization | | aptustelecom0 -
How do you optimize for keyword phrases that don't follow natural speech patters?
For instance, We have a phase "solar panels for home" that sends decent traffic to our site, but I'm sure we could be capturing more if any of our content was optimized better for it. But how do you optimize for a phrase that makes you sound like a robot if you use it verbatim?
On-Page Optimization | | wreevesc0 -
Should "contact" and "Privacy Policy" pages be no-followed?
I have a few pages like the contact and privacy policy page that I could really care less about as far as whether people visit them, or whether the search engines index them. They also don't have any sort of unique content on them... pretty much duplicates of what you'd probably find on hundreds of other websites. Would it be logical then to just nofollow those pages? I just don't know if maybe there's something hidden that I'm not thinking of. For example, maybe Google wants to see that your website has a privacy policy, and by excluding it, you're actually hurting yourself.
On-Page Optimization | | JABacchetta0 -
To follow or not to follow...?
One of my client's uses alot of links in their content. They follow style and fashion news. Many times I find the use of nofollows unnecessary, but sometimes they have articles with well over 20 oubound links...I wonder if this "drains" the authority/link juice of the page to the point where the long tail traffic wont kick in? Should I have reason for concern, and should I use nofollow on the links? I notice many of our competitors dont really bother, but they also have alot more authority.
On-Page Optimization | | jkellz5140 -
Status of Ajax and SEO? Changing navigation from plain HTML to AJAX.
We will change an old school HTML drop down navigation for an AJAX drop down one. What's your experience in regards to Google indexing AJAX? I know that Google is now able to read more stuff than in the past, but I need some stories "from the trenches" if you're willing to share. Thanks in advance.
On-Page Optimization | | gerardoH0