Robots and Canonicals on Moz
-
We noticed that Moz does not use a robots "index" or "follow" tags on the entire site, is this best practice?
Also, for pagination we noticed that the rel = next/prev is not on the actual "button" rather in the header
Is this best practice? Does it make a difference if it's added to the header rather than the actual next/previous buttons within the body?
-
You don't have to put index & follow - that the default behaviour. It's only when you don't want to be indexed or links to be followed that you have to indicate it.
Rel next/previous have to be in the header - check https://support.google.com/webmasters/answer/1663744?hl=en - not on the links themselves.
Dirk
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Sub Domains and Robot.txt files...
This is going to seem like a stupid question, and perhaps it is but I am pulling out what little hair I have left. I have a sub level domain on which a website sits. The Main domain has a robots.txt file that disallows all robots. It has been two weeks, I submitted the sitemap through webmaster tools and still, Google has not indexed the sub domain website. My question is, could the robots.txt file on the main domain be affecting the crawlability of the website on the sub domain? I wouldn't have thought so but I can find nothing else. Thanks in advance.
Technical SEO | | Vizergy0 -
How to fix rel canonical tags?
Hello there, I am trying to fix the issues with my campaign and I am trying to fix Rel canonical issues. I tried to read a few blogs and other sources which talked about the Rel canonical but I am not able to understand why is Rel Canonical happening? I understand that http://elegancealways.com is not the same as http://elegancealways.com/about-us/ but then I cannot change the link as the link is correct. I read about 301 and 302 redirects. I do not understand that which link is correct then? The errors SEO MOZ is showing is what I am not able to understand as these links are correct. I need help here!! Thanks Vineeta qTc2a2H.png
Technical SEO | | vineeta0 -
Are my canonical re directs working?
Buonjourno from Wetherby UK 🙂 Ive been battlling sometime to get this site http://www.goldsboroughestates.co.uk to rank for term Right To Manage. Amongst other tactics ive set up a canonical http://www.goldsboroughestates.co.uk/about/right-to-manage.aspx * - Canonical version http://www.goldsboroughestates.co.uk/how-we-care-for-you/right-to-manage.aspx http://www.goldsboroughestates.co.uk/what-our-customers-say/right-to-manage.aspx http://www.goldsboroughestates.co.uk/ - But has this canonical redirect feature worked? The reason i doubt it is i notice when i enter a page http://www.goldsboroughestates.co.uk/what-our-customers-say/right-to-manage.aspx which has the below code in place: rell="canonical" href="http://www.goldsboroughestates.co.uk/About/right-to-manage.aspx/" /> It does not jump to http://www.goldsboroughestates.co.uk/about/right-to-manage.aspx So my question is... "is the canonical redirect working or not & waht is the best way / tool for diagnosing a canonical error" Grazie tanto,
Technical SEO | | Nightwing
David0 -
Adding Rel Canonical to multiple pages
Hi, Our CMS generates a lot of duplicate content, (Different versions of every page for 3 different font sizes). There are many other reasons why we should drop this current CMS and go with something else, and we are in the process of doing that. But for now, does anyone know how would I do the following: I've created a spreadsheet that contains the following: Column 1: rel="canonical" tag for URL Column 2: Duplicate Content URL # 1 Column 3: Duplicate Content URL # 2 Column 4: Duplicate Content URL # 3 I want to add the tag from column 1 into the head of every page from column 2,3, and 4. What would be a fast way to do this considering that I have around 1800 rows. Check the screenshot of the builtwith.com result to see more information about the website if that helps. Farris bxySL
Technical SEO | | jdossetti0 -
Canonical tag in preferred and duplicate page
Hi, I have a super spiffy (not) CMS that tends to create some pages at the root level of the site (not where I want it) i.e. www.site.com/page.htm as well as the desired location i.e. www.site.com/category/keyword/page.htm . Now obviously a canonical tag inserted into the URL at the undesired location would be the best option, however the source code is exactly the same for both pages (can’t change this) i.e. if I put the canonical tag that reads www.site.com/category/keyword/page.htm"/> it will appear in the head section of both pages, the desired URL and the non desired URL. Will a canonical tag inserted into the head section of a the preferred URL directing the search engine spiders pretty much to itself cause more grieft than the solution it offers re duplicate content ? Marc
Technical SEO | | NRMA0 -
Quick robots.txt check
We're working on an SEO update for http://www.gear-zone.co.uk at the moment, and I was wondering if someone could take a quick look at the new robots file (http://gearzone.affinitynewmedia.com/robots.txt) to make sure we haven't missed anything? Thanks
Technical SEO | | neooptic0 -
Canonical tag used on several pages?
Is it a bad idea to use rel=canonical from several pages back to one (if you are planning on no-indexing them)? Does this concentrate the “link juice” from those several pages back to one?
Technical SEO | | nicole.healthline0