Why is the exact same URL being seen as duplicate and showing an error in my SEO reports
-
Well, I am still having duplicate page issues.
I have a question about one of the errors SEO is giving me when I download a crawl report. I am going to attach a screen shot of part of the report so you can see for yourself, along with explaining it here.
SEO shows the list of URL's that it crawled in the report. In this(see attachment) portion of the report it has 321 results for the exact same URL. It also says all of these exact same URL's have received a 404 error. What I want to know is how does it make 321 results for the same URL? And with this error that I don't see when I look at the page?
-
Hey Josh,
You may want to speak with your developer on this one PHP is a server language and could be generating the unique pages and causing Roger to crawl twice depending on which way he approaches the page. I apologize for the delay here as I was not receiving notifications on this post.
-
I think it does so by PHP. Is there any easy way I can make sure?
-
Hey Josh,
Rogerbot discovered this link through the /blog/ subfolder on your page which led him to the which battery post. By any chance does the auto forward do so by PHP or Javascript? Sometimes Roger can get a little hung up on these pages and think they don't exist.
Let me know either way so we can get this taken care of!
Thanks
-
Ok I get which page it is now but I do not understand the issue. There isnt a direct link to that blog post from any of the other pages crawled. And if you use either link they both work. The Column a link however does auto forward to the MaxAmps site equivalent page. Could it somehow have to do with this?
-
Hey Josh,
This is James from Moz Help. I'd like to see if I can assist in diagnosing this problem. I had a chance to pull your crawl .CSV and the 321 pages you have in column F are actually the referring pages the actual page we crawled will be in Column A. Essentially the What Battery Can we MaxAmps Build for You has 321 unique pages it links too. While this page does not 404 it seems Roger can not get to the pages after this.
Feel free to follow up here or send us a message to help@moz.com
Have a great day!
-
Okay I will be sure to try and implement this to the blog.
You seem to know how a php dynamic site builds itself from one page. May I ask you another question? We have been going through this duplicate page problem for a long time. I generally get the answer to redirect or canonical the pages. I understand how I can do this to our blog as it is in word press. However, the rest of our site is not. The category section of our page, for instance, generates depending on how the person gets there from one single page of coding. And that is for all of our categories, not just one. How can I implement a redirect or canonical to this type of site. I would not want all of the categories to lead to one particular category. So if I put the canonical tag in my category page with a single url than that won't work. Also if I use a redirct in this page it will still lead me to only one category (correct?) instead of the people having the option to go to several different categories.
-
Hi Josh,
By chance does this url have parameters. Those may not be reporting properly in this report. That would be my first thought. I have seen that frequently in blog / forum crawls, as those usually have many parameters for starting at a certain post number. The simple solution is to just rel canonical the page to its root.
As for the 404 error I would guess that some page is generated or linking to urls with certain parameters that the page itself doesn't know how to handle.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Moz Crawl - 804 : HTTPS (SSL) error encountered when requesting page.
Got an issue sending a Crawl Request to https://www.usernamebuddy.com/ " "804 : HTTPS (SSL) error encountered when requesting page." I have tried to recrawl several times now same issue keeps occurring. I cannot see an error when I access the site am I missing something, if so how can I diagnose the issue and sort the problem? I have reviewed the source and cannot use any http: resources.
Moz Bar | | GrouchyKids0 -
Moz keyword mention on-page counting errors
Hi. Moz is showing 18 mentions of the keyword 'street furniture' on this landing page https://www.broxap.com/street-furniture.html But I can only count 6 in total in the body copy and 13 if you include navigation links. This is the same on other pages too for that keyword. Does anyone know where it's counting these extra keywords from? I don't want to fall foul of keyword stuffing but as far as I can see we're not! Could Moz be miscalculating? Any help appreciated! Thanks Joe
Moz Bar | | iweb_agency0 -
Canonical in Moz crawl report
I'm wondering if the moz bot is seeing my rel="canonical" on my pages. There are 2 notices that are bothering me: Overly Dynamic URL Rel Canonical Overly Dynamic URL - This notice is being generated by urls with query strings. On the main page I have the rel="canonical" tag in the header. So every page with the query string has the canonical tag that points to the page that should be indexed. So my question...Why the notice? Isn't this being handled properly with the canonical tag? I know I can use my robots.txt or the tool in Google search console but is it really necessary when I have the canonical on every page? Here is one of the links that has the "Overly Dynamic URL" notice, as you can see the the canonical in the header points to the page without the query string: https://www.vistex.com/services/training/traditional-classroom/registration-form/?values=true&course-title=DMP101 – Data Maintenance Pricing – Business Processes&date=March 14, 2016 Rel Canonical - Every page in my report has this notice "Using rel=canonical suggests to search engines which URL should be seen as canonical". I'm using the rel="canonical" tag on all of my pages by default. Is the report suggesting that I don't do this? Or is it suggesting that I should? Again...why the notice?
Moz Bar | | Brando160 -
What does the green check mark mean in the KW Difficulty & SERP Analysis Report mean?
Hi, I just generated a Keyword Difficulty and SERP Analysis Report and I find that many of the metrics have a green checkmark besides them. What does that indicate? Similarly, there are many metrics which appear in green. However rest are in grey. Also help what does that indicate? Refer the attached link to the screenshot of the report. I tried looking at a couple of places for the answer but in vain.. Thanks.. DQSlssU
Moz Bar | | Shalin.TJ0 -
Moz Crawl Showing Duplicate Content But It's Not?!
Unfortunately I can't give out the URL, but here's the deal... I have two URL's which have completely different content on them but are being crawled as duplicate content. Any Idea how that would happen? I'm not seeing any errors in WMT's. Has anyone seen this before? Is the duplicate content reporting based on a % of the page content matching as the same?
Moz Bar | | Swarm-SEO0 -
Why isn't seo moz properly crawling my site?
In my campaign results, only 2 pages have been crawled, when there are many more. Also, when I do the on-page evaluation for my homepage and the main keyword, I get a grade of F, with a ton of errors that my page actually does not have. It's as if SEO moz is having trouble crawling through my site. Any ideas on this?
Moz Bar | | diplomajim0 -
Can I delete a SEO campaign in Moz, and start a new one for a different website?
Would be nice to know, as I'm limited to 5 campaigns, and the most important work is done for 2 site's, so I would like to switch that to 2 other website's. Regards,
Moz Bar | | mrblue910