undefined
Skip to content
Moz logo Menu open Menu close
  • Products
    • Moz Pro
    • Moz Pro Home
    • Moz Local
    • Moz Local Home
    • STAT
    • Moz API
    • Moz API Home
    • Compare SEO Products
    • Moz Data
  • Free SEO Tools
    • Domain Analysis
    • Keyword Explorer
    • Link Explorer
    • Competitive Research
    • MozBar
    • More Free SEO Tools
  • Learn SEO
    • Beginner's Guide to SEO
    • SEO Learning Center
    • Moz Academy
    • SEO Q&A
    • Webinars, Whitepapers, & Guides
  • Blog
  • Why Moz
    • Agency Solutions
    • Enterprise Solutions
    • Small Business Solutions
    • Case Studies
    • The Moz Story
    • New Releases
  • Log in
  • Log out
  • Products
    • Moz Pro

      Your all-in-one suite of SEO essentials.

    • Moz Local

      Raise your local SEO visibility with complete local SEO management.

    • STAT

      SERP tracking and analytics for enterprise SEO experts.

    • Moz API

      Power your SEO with our index of over 44 trillion links.

    • Compare SEO Products

      See which Moz SEO solution best meets your business needs.

    • Moz Data

      Power your SEO strategy & AI models with custom data solutions.

    NEW Keyword Suggestions by Topic
    Moz Pro

    NEW Keyword Suggestions by Topic

    Learn more
  • Free SEO Tools
    • Domain Analysis

      Get top competitive SEO metrics like DA, top pages and more.

    • Keyword Explorer

      Find traffic-driving keywords with our 1.25 billion+ keyword index.

    • Link Explorer

      Explore over 40 trillion links for powerful backlink data.

    • Competitive Research

      Uncover valuable insights on your organic search competitors.

    • MozBar

      See top SEO metrics for free as you browse the web.

    • More Free SEO Tools

      Explore all the free SEO tools Moz has to offer.

    NEW Keyword Suggestions by Topic
    Moz Pro

    NEW Keyword Suggestions by Topic

    Learn more
  • Learn SEO
    • Beginner's Guide to SEO

      The #1 most popular introduction to SEO, trusted by millions.

    • SEO Learning Center

      Broaden your knowledge with SEO resources for all skill levels.

    • On-Demand Webinars

      Learn modern SEO best practices from industry experts.

    • How-To Guides

      Step-by-step guides to search success from the authority on SEO.

    • Moz Academy

      Upskill and get certified with on-demand courses & certifications.

    • MozCon

      Save on Early Bird tickets and join us in London or New York City

    Unlock flexible pricing & new endpoints
    Moz API

    Unlock flexible pricing & new endpoints

    Find your plan
  • Blog
  • Why Moz
    • Small Business Solutions

      Uncover insights to make smarter marketing decisions in less time.

    • Agency Solutions

      Earn & keep valuable clients with unparalleled data & insights.

    • Enterprise Solutions

      Gain a competitive edge in the ever-changing world of search.

    • The Moz Story

      Moz was the first & remains the most trusted SEO company.

    • Case Studies

      Explore how Moz drives ROI with a proven track record of success.

    • New Releases

      Get the scoop on the latest and greatest from Moz.

    Surface actionable competitive intel
    New Feature

    Surface actionable competitive intel

    Learn More
  • Log in
    • Moz Pro
    • Moz Local
    • Moz Local Dashboard
    • Moz API
    • Moz API Dashboard
    • Moz Academy
  • Avatar
    • Moz Home
    • Notifications
    • Account & Billing
    • Manage Users
    • Community Profile
    • My Q&A
    • My Videos
    • Log Out

The Moz Q&A Forum

  • Forum
  • Questions
  • Users
  • Ask the Community

Welcome to the Q&A Forum

Browse the forum for helpful insights and fresh discussions about all things SEO.

  1. Home
  2. SEO Tactics
  3. Technical SEO
  4. Diagnosing Canonical Errors Is Screaming frog reliable?

Moz Q&A is closed.

After more than 13 years, and tens of thousands of questions, Moz Q&A closed on 12th December 2024. Whilst we’re not completely removing the content - many posts will still be possible to view - we have locked both new posts and new replies. More details here.

Diagnosing Canonical Errors Is Screaming frog reliable?

Technical SEO
3
9
2.2k
Loading More Posts
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as question
Log in to reply
This topic has been deleted. Only users with question management privileges can see it.
  • Nightwing
    Nightwing last edited by Aug 8, 2012, 5:26 AM

    Morning from suny & warm wetherby UK 🙂

    On this page http://www.goldsboroughestates.co.uk/how-we-care-for-you/right-to-manage/ screaming frog is citing a canonical error but I'm confused as this piece of code is in place:

    http://www.goldsboroughestates.co.uk/About/right-to-manage" />

    So my question is please - "Does this page  http://www.goldsboroughestates.co.uk/how-we-care-for-you/right-to-manage/ have a caninical error or is screaming frog useless?

    Other examples where screaming frog is picking up canonical errors include:
    http://www.goldsboroughestates.co.uk/what-our-customers-say/right-to-manage/
    http://www.goldsboroughestates.co.uk/buying-a-home/right-to-manage/

    Oh forgot to say the preffered version is http://www.goldsboroughestates.co.uk/About/right-to-manage/

    Any insights welcvome 🙂

    1 Reply Last reply Reply Quote 0
    • Keszi
      Keszi @Nightwing last edited by Dec 5, 2012, 6:57 PM Dec 5, 2012, 6:57 PM

      Hey,

      Long time since the Question, I was just wondering if you worked it out or not.

      Gr.,

      Istvan

      1 Reply Last reply Reply Quote 0
      • topic:timeago_earlier,3 months
      • Dr-Pete
        Dr-Pete Staff @Nightwing last edited by Sep 13, 2012, 5:44 PM Sep 13, 2012, 5:44 PM

        I think Screaming Frog is just warning you that the canonical version doesn't seem to match the display URL. They can't really tell (we have the same problem in SEOmoz tools) what the "right" canonical is - they can just warn of a mismatch.

        I'm a bit confused as to the purpose of the dual URLs here. The best canonical implementation is to use one URL. The canonical tag can act as a band-aid, but  consistency is still the best defense. Having multiple paths to the same page is rarely beneficial.

        1 Reply Last reply Reply Quote 0
        • Nightwing
          Nightwing @Nightwing last edited by Sep 13, 2012, 12:48 PM Sep 13, 2012, 12:48 PM

          Having spoke to oiur internal helpdesk (Who I trust & do know what theyre talking about) theyve taken a look at:

          http://www.goldsboroughestates.co.uk/footer-links/left/right-to-manage/

          http://www.goldsboroughestates.co.uk/how-we-care-for-you/right-to-manage/

          http://www.goldsboroughestates.co.uk/buying-a-home/right-to-manage/

          http://www.goldsboroughestates.co.uk/what-our-customers-say/right-to-manage/

          and I'm afraid they have a different perspective which is they see no canonical problem 😞 Hey ho think I'll just set my head on fire then maybe things will be more clearer 😉

          1 Reply Last reply Reply Quote 0
          • Nightwing
            Nightwing @Nightwing last edited by Sep 13, 2012, 12:14 PM Sep 13, 2012, 12:14 PM

            Hi Istvan - your advice is good but ive just discovered its not been implemented! Time to kick some ass, I'll update you 🙂

            1 Reply Last reply Reply Quote 0
            • topic:timeago_earlier,about a month
            • Keszi
              Keszi @Nightwing last edited by Aug 10, 2012, 5:49 AM Aug 10, 2012, 5:49 AM

              Hey,

              Any news on how it went? I am curious if that was the problem or not. 🙂

              Gr.,

              Istvan

              1 Reply Last reply Reply Quote 0
              • Keszi
                Keszi @Nightwing last edited by Aug 8, 2012, 2:29 PM Aug 8, 2012, 2:29 PM

                Hey,

                Maybe this helps you a littlebit: http://www.seomoz.org/blog/an-seos-guide-to-http-status-codes

                Dr. Pete's article explains well how the status codes work.

                Gr.,

                Istvan

                1 Reply Last reply Reply Quote -1
                • Nightwing
                  Nightwing @Keszi last edited by Aug 8, 2012, 11:17 AM Aug 8, 2012, 11:17 AM

                  Wow great anser, I'm on to this now & will updat you with how things went 🙂

                  Keszi Nightwing Dr-Pete 6 Replies Last reply Dec 5, 2012, 6:57 PM Reply Quote 0
                  • Keszi
                    Keszi last edited by Aug 10, 2012, 3:13 PM Aug 8, 2012, 7:39 AM

                    Hey there!

                    I think I have found what your problem is with you canonical link 🙂

                    In your code you have:

                    And probably you are somewhere forcing the URls to have a / at the end.

                    So basically you are confusing browsers and search engine bots, because they now cannot tell which is the real version:

                    SE enters the page. Then it sees that the right version should be the one WITHOUT a "/" at the end, then that pages has a 301 redirect to the version which HAS a "/" at the end of the URL (but that has a canonical which points out that the preffered version should be ). So it is a non-ending circle.

                    So if you add a / to the end of your URl, your problem should be solved.

                    Final thought: Screaming Frog is working well.

                    I hope this was a solution.

                    Cheers,

                    Istvan

                    Nightwing 1 Reply Last reply Aug 8, 2012, 11:17 AM Reply Quote 2
                    • 1 / 1
                    1 out of 9
                    • First post
                      1/9
                      Last post

                    Got a burning SEO question?

                    Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.


                    Start my free trial


                    Browse Questions

                    Explore more categories

                    • Moz Tools

                      Chat with the community about the Moz tools.

                    • SEO Tactics

                      Discuss the SEO process with fellow marketers

                    • Community

                      Discuss industry events, jobs, and news!

                    • Digital Marketing

                      Chat about tactics outside of SEO

                    • Research & Trends

                      Dive into research and trends in the search industry.

                    • Support

                      Connect on product support and feature requests.

                    • See all categories

                    Related Questions

                    • Extima-Christian

                      Sitemap error in Webmaster tools - 409 error (conflict)

                      Hey guys, I'm getting this weird error when I submit my sitemap to Google. It says I'm getting a 409 error in my post-sitemap.xml file (https://cleargear.com/post-sitemap.xml). But when I check it, it looks totally fine. I am using YoastSEO to generate the sitemap.xml file. Has anyone else experienced this? Is this a big deal? If so, Does anyone know how to fix? Thanks EwTswL4

                      Technical SEO | Dec 3, 2018, 10:56 AM | Extima-Christian
                      0
                    • DaleZon

                      Errors In Search Console

                      Hi All, I am hoping someone might be able to help with this. Last week one of my sites dropped from mid first day to bottom of page 1. We had not been link building as such and it only seems to of affected a single search term and the ranking page (which happens to be the home page). When I was going through everything I went to search console and in crawl errors there are 2 errors that showed up as detected 3 days before the drop. These are: wp-admin/admin-ajax.php showing as response code 400 and also xmlrpc.php showing as response code 405 robots.txt is as follows: user-agent: * disallow: /wp-admin/ allow: /wp-admin/admin-ajax.php Any help with what is wrong here and how to fix it would be greatly appreciated. Many Thanks

                      Technical SEO | Jul 9, 2018, 1:28 PM | DaleZon
                      0
                    • SoulSurfer8

                      Rel=Canonical For Landing Pages

                      We have PPC landing pages that are also ranking in organic search. We've decided to create new landing pages that have been improved to rank better in natural search. The PPC team however wants to use their original landing pages so we are unable to 301 these pages to the new pages being created. We need to block the old PPC pages from search. Any idea if we can use rel=canonical? The difference between old PPC page and new landing page is much more content to support keyword targeting and provide value to users. Google says it's OK to use rel=canonical if pages are similar but not sure if this applies to us. The old PPC pages have 1 paragraph of content followed by featured products for sale. The new pages have 4-5 paragraphs of content and many more products for sale. The other option would be to add meta noindex to the old PPC landing pages. Curious as to what you guys think. Thanks.

                      Technical SEO | Oct 4, 2017, 5:39 PM | SoulSurfer8
                      0
                    • A_Fotografy

                      Yoast SEO. After set up 404 error pages

                      Hello all, Something strange happened with my blog site. I recently signed to MOZ tools. Initially everything was fine, but during my last crawl I got loads of 404
                      pages. Few days ago I was tweaking some settings in SEO plugin according to this post https://moz.com/blog/setup-wordpress-for-seo-success What I noticed was that 404 pages were coming from my blog posts, but for
                      some reason category was missing in those posts. For example this link is 404
                      https://a-fotografy.co.uk/inchcolm-island-wedding-photography-bailie The one with category is https://a-fotografy.co.uk/wedding-pictures/inchcolm-island-wedding-photography-bailie/ So basically for some reason category was missing. Please let me know how can I fix this instead of doing hundreds of
                      redirects now. Thank you,
                      Regards,
                      Armands

                      Technical SEO | Feb 14, 2016, 3:53 PM | A_Fotografy
                      0
                    • Merkle-Impaqt

                      Can you use Screaming Frog to find all instances of relative or absolute linking?

                      My client wants to pull every instance of an absolute URL on their site so that they can update them for an upcoming migration to HTTPS (the majority of the site uses relative linking). Is there a way to use the extraction tool in Screaming Frog to crawl one page at a time and extract every occurrence of _href="http://" _? I have gone back and forth between using an x-path extractor as well as a regex and have had no luck with either. Ex. X-path: //*[starts-with(@href, “http://”)][1] Ex. Regex: href=\”//

                      Technical SEO | Oct 13, 2015, 6:31 PM | Merkle-Impaqt
                      0
                    • jeeyer

                      Set Canonical for Paginated Content

                      Hi Guys, This is a follow up on this thread: http://moz.com/community/q/dynamic-url-parameters-woocommerce-create-404-errors# I would like to know how I can set a canonical link in Wordpress/Woocommerce which points to "View All" on category pages on our webshop.
                      The categories on my website can be viewed as 24/48 or All products but because the quanity constantly changes viewing 24 or 48 products isn't always possible. To point Google in the right direction I want to let them know that "View All" is the best way to go.
                      I've read that Google's crawler tries to do this automatically but not sure if this is the case on on my website. Here is some more info on the issue: https://support.google.com/webmasters/answer/1663744?hl=en
                      Thanks for the help! Joost

                      Technical SEO | May 20, 2015, 1:10 PM | jeeyer
                      0
                    • EcommerceSite

                      Do I have a problem with missing pages in Screaming Frog?

                      We have category pages and some of those pages have pagination due to us having additional items. Screaming Frog could not find the items that were after page 1. Is this a problem for Google? These item pages are still in the sitemap. I am sure they can find them to index them but does it hurt rankings at all.

                      Technical SEO | Dec 3, 2014, 1:13 PM | EcommerceSite
                      0
                    • MagicDude4Eva

                      Duplicate title-tags with pagination and canonical

                      Some time back we implemented the Google recommendation for pagination (the rel="next/prev"). GWMT now reports 17K pages with duplicate title-tags (we have about 1,1m products on our site and about 50m pages indexed in Google) As an example we have properties listed in various states and the category title would be "Properties for Sale in [state-name]". A paginated search page or browsing a category (see also http://searchengineland.com/implementing-pagination-attributes-correctly-for-google-114970) would then include the following: The title for each page is the same - so to avoid the duplicate title-tags issue, I would think one would have the following options: Ignore what Google says Change the canonical to http://www.site.com/property/state.html (which would then only show the first XX results) Append a page number to the title "Properties for Sale in [state-name] | Page XX" Have all paginated pages use noindex,follow - this would then result in no category page being indexed Would you have the canonical point to the individual paginated page or the base page?

                      Technical SEO | Jan 15, 2013, 7:27 AM | MagicDude4Eva
                      2

                    Get started with Moz Pro!

                    Unlock the power of advanced SEO tools and data-driven insights.

                    Start my free trial
                    Products
                    • Moz Pro
                    • Moz Local
                    • Moz API
                    • Moz Data
                    • STAT
                    • Product Updates
                    Moz Solutions
                    • SMB Solutions
                    • Agency Solutions
                    • Enterprise Solutions
                    Free SEO Tools
                    • Domain Authority Checker
                    • Link Explorer
                    • Keyword Explorer
                    • Competitive Research
                    • Brand Authority Checker
                    • Local Citation Checker
                    • MozBar Extension
                    • MozCast
                    Resources
                    • Blog
                    • SEO Learning Center
                    • Help Hub
                    • Beginner's Guide to SEO
                    • How-to Guides
                    • Moz Academy
                    • API Docs
                    About Moz
                    • About
                    • Team
                    • Careers
                    • Contact
                    Why Moz
                    • Case Studies
                    • Testimonials
                    Get Involved
                    • Become an Affiliate
                    • MozCon
                    • Webinars
                    • Practical Marketer Series
                    • MozPod
                    Connect with us

                    Contact the Help team

                    Join our newsletter
                    Moz logo
                    © 2021 - 2025 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
                    • Accessibility
                    • Terms of Use
                    • Privacy

                    Looks like your connection to Moz was lost, please wait while we try to reconnect.