Why is the exact same URL being seen as duplicate and showing an error in my SEO reports
-
Well, I am still having duplicate page issues.
I have a question about one of the errors SEO is giving me when I download a crawl report. I am going to attach a screen shot of part of the report so you can see for yourself, along with explaining it here.
SEO shows the list of URL's that it crawled in the report. In this(see attachment) portion of the report it has 321 results for the exact same URL. It also says all of these exact same URL's have received a 404 error. What I want to know is how does it make 321 results for the same URL? And with this error that I don't see when I look at the page?
-
Hey Josh,
You may want to speak with your developer on this one PHP is a server language and could be generating the unique pages and causing Roger to crawl twice depending on which way he approaches the page. I apologize for the delay here as I was not receiving notifications on this post.
-
I think it does so by PHP. Is there any easy way I can make sure?
-
Hey Josh,
Rogerbot discovered this link through the /blog/ subfolder on your page which led him to the which battery post. By any chance does the auto forward do so by PHP or Javascript? Sometimes Roger can get a little hung up on these pages and think they don't exist.
Let me know either way so we can get this taken care of!
Thanks
-
Ok I get which page it is now but I do not understand the issue. There isnt a direct link to that blog post from any of the other pages crawled. And if you use either link they both work. The Column a link however does auto forward to the MaxAmps site equivalent page. Could it somehow have to do with this?
-
Hey Josh,
This is James from Moz Help. I'd like to see if I can assist in diagnosing this problem. I had a chance to pull your crawl .CSV and the 321 pages you have in column F are actually the referring pages the actual page we crawled will be in Column A. Essentially the What Battery Can we MaxAmps Build for You has 321 unique pages it links too. While this page does not 404 it seems Roger can not get to the pages after this.
Feel free to follow up here or send us a message to help@moz.com
Have a great day!
-
Okay I will be sure to try and implement this to the blog.
You seem to know how a php dynamic site builds itself from one page. May I ask you another question? We have been going through this duplicate page problem for a long time. I generally get the answer to redirect or canonical the pages. I understand how I can do this to our blog as it is in word press. However, the rest of our site is not. The category section of our page, for instance, generates depending on how the person gets there from one single page of coding. And that is for all of our categories, not just one. How can I implement a redirect or canonical to this type of site. I would not want all of the categories to lead to one particular category. So if I put the canonical tag in my category page with a single url than that won't work. Also if I use a redirct in this page it will still lead me to only one category (correct?) instead of the people having the option to go to several different categories.
-
Hi Josh,
By chance does this url have parameters. Those may not be reporting properly in this report. That would be my first thought. I have seen that frequently in blog / forum crawls, as those usually have many parameters for starting at a certain post number. The simple solution is to just rel canonical the page to its root.
As for the 404 error I would guess that some page is generated or linking to urls with certain parameters that the page itself doesn't know how to handle.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Page Optimization Error
Hi, I am trying to track a page optimization feature for one of my project, https://www.writemyessay247.com for keyword: write my essay but i keep getting this below error: "Page Optimization Error There was a problem loading this page. Please make sure the page is loading properly and that our user-agent, rogerbot, is not blocked from accessing this page." I checked robots.txt file, it all looks fine. Not sure what is the problem? Is it a problem with Moz or the website?
Moz Bar | | j.rahimi19900 -
500 errors showing up differently on moz and google wmt
Lately, I've been having the issue of a large increase in 500 errors. These errors seem to be intermittent, in other words, Google and Moz are showing that I have server 500 errors for many pages but, when I actually check the links, everything's fine. I've run tests to see if there is any virus on the server or if I have any corrupt files and as far as I can tell, there are none. I'm left with the possibility that maybe one of my plugins is causing this issue (I'm built on top of Wordpress). Moz is showing that I had nearly five hundred 500 server errors on the 12th or the 11th. On the other hand, Google shows that on the 13th I had 179 server errors and then an additional 200 for the 15th. I'm assuming Google is slow to find or report these things? I would like to know which is more reliable so that I can try to figure out which of these plugins may be causing the problem, if any or if I'm investigating this the wrong way, I'd love to have more suggestions. Thanks in advance! Sorry, the url is http://www.heartspm.com if you'd like to take a look.
Moz Bar | | GerryWeitz0 -
Crawl Report Internal Links Count
We recently ran a crawl report on www.phase1tech.com. Some of the pages are coming back with a large amount of 'internal links'. These 2 pages for example are showing 800 internal links: http://www.phase1tech.com/Upcoming-Events
Moz Bar | | AISEO
http://www.phase1tech.com/Contact At best there are approximately 70 links on the page. Where is the 800 number coming from?0 -
Conversion tracking within Moz reports?
Hey guys, Quick question and apologies if this has been asked before, but is there an option within MOZ reporting (Pro) that allows you to focus on conversions for your clients? I'm finding rankings to be a very poor indicator of success. I'd much rather focus on conversions, and present this information to the client within my reports. Thanks
Moz Bar | | John_Romaine2 -
Moz Crawler URL paramaters & duplicate content
Hi all, this is my first post on Moz Q&A 🙂 Questions: Does the Moz Crawler take into account rel="canonical" for search results pages with sorting / filtering URL parameters? How much time does it take for an issue to disappear from the issues list after it's been corrected? Does it come op in the next weekly report? I'm asking because the crawler is reporting 50k+ pages crawled, when in reality, this number should be closer to 1000. All pages with query parameters have the correct canonical tag pointing to the root URL, so I'm wondering whether I need to noindex the other pages for the crawler to report correct data?: Original (canonical URL): DOMAIN.COM/charters/search/mx/BS?search_location=cabo-san-lucas Filter active URL: DOMAIN.COM/charters/search/mx/BS?search_location=cabo-san-lucas&booking_date=&booking_days=1&booking_persons=1&priceFilter%5B%5D=0%2C500&includedPriceFilter%5B%5D=drinks-soft Also, if noindex is the only solution, will it impact the ranking of the pages involved? Note: Google and Bing are semi-successful in reporting index page count, each reporting around 2.5k result pages when using the site:DOMAIN.com query. The rel canonical tag was missing for a short period of time about 4 weeks ago, but since fixing the issue these pages still haven't been deindexed. Appreciate any suggestions regarding Moz Crawler & Google / Bing index count!
Moz Bar | | Vukan_Simic0 -
Duplicate content errors
Hi I am getting some errors for duplicate content errors in my crawl report for some of our products www.....com/brand/productname1.html www.....com/section/productname1.html www.....com/productname1.html we have canonical in the header for all three pages rel="canonical" href="www....com/productname1.html" />
Moz Bar | | phes0 -
Crawl Diagnostics: Exlude known errors and others that have been detected by mistake? New moz analytics feature?
I'm curious if the new moz analytics will have the feature (filter) to exclude known errors from the crwal diagnostics. For example, the attached screenshot shows the URL as 404 Error, but it works fine: http://en.steag.com.br/references/owners-engineering-services-gas-treatment-ogx.php To maintain a better overview which errors can't be solved (so I just would like to mark them as "don't take this URL into account...") I will not try to fix them again next time. On the other hand I have hundreds of errors generated by forums or by the cms that I can not resolve on my own. Also these kind of crawl errors I would like to filter away and categorize like "errors to see later with a specialist". Will this come with the new moz analytics? Anyway is there a list that shows which new features will still be implemented? knPGBZA.png?1
Moz Bar | | inlinear0 -
Since the revised website was launched, I can't find the "Crawl Test" function showing Titles and Descriptions of other websites. Anyone know where that link is located?
MOZ can "crawl" any website and show information like Title, Description, etc.....Can't find that link.
Moz Bar | | bpedrazas0