Duplicate page errors
-
I have 102 duplicate page title errors and 64 duplicate page content errors. They are almost all from the email a friend forms that are on each product of my online store. I looked and the pages are identical except for the product name. Is this a real problem and if so is there a work around or should I see if I can turn off the email a friend option? Thanks for any information you can give me.
Cingin Gifts
-
Thanks for the good advice everyone. I really appreciate it.
Keith
-
Odds are that this isn't causing you major problems yet, but if the variants are indexed by Google (you can check with the "site:" operator), I would use the META robots tag. Robots.txt is good for prevention, but it's not great at clearing pages out of the index, in my experience.
-
The change you made to the robots should be sufficient. You can also add the meta tag in there to be doubly sure, but its not needed
Though, your social buttons has the Email A Friend option built in so you are replicating the same functionality with the Email a Friend button.
No problem, happy to help.
Aran
- if your problem is solved, dont forget the Answered, and Good answer buttons
- if your problem is solved, dont forget the Answered, and Good answer buttons
-
Hi Aran,
I added that line to my robots.txt file.
User-agent:*
Disallow: /cgi-bin/
Disallow: /v/vspfiles/photos/
Disallow: /EmailaFriend.aspSomeone else recommended adding the following line to the EmailAFriend.asp file. Do I need this line?
I like the suggestion for removing the email a friend and working more on the social area. I thought turning off the email part was probably the easiest fix for the duplicate pages.
Thanks for the great advice!
Keith
-
Looking at your site I see that your Email a friend script is opening a brand new page and passing through the product ID. To stop the page being indexed you can add the following line to the robots.txt
Disallow: /EmailaFriend.asp
afte the line that looks something like
User-Agent: *
Heres some light reading on the robots.txt file
http://www.seomoz.org/learn-seo/robotstxt
BE CAUTIOUS! if you dont know what your doing seek further assistance as you could do some bad things in the robots.txt.
Whilst the solution above will probably solve your duplicate page issue. I think there is room for improvement here.
Email a friend scripts needn't take the user away from the product they are viewing. You could open the email a friend script in a new window, or even better get rid of the Email a friend button altogether and make your social sharing buttons bigger and more prominent. Also, consider giving the users a Call to Action to sharing the product via the social buttons.
Hope this helps.
Aran
-
Hi Steven, I just got that report from seomoz and those errors were returned from their crawling of the site. I'm new to this SEO stuff so I'm not sure about the indexing thing. I do know a little about the robots.txt file so I'll look into blocking those pages.
Thanks,
Keith
-
Do they need to be indexed? Perhaps you should consider using blocking any spider from crawling them using robots and using a noindex meta tag.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Unsolved Blog archive pages in Craw Error Report
Hi there, I'm new to MOZ Pro and have a question. My scan shows Archive pages as having crawl issues, but this is because Yoast is set up to block robots on these pages. Should I be allowing search engines to crawl these pages, or am I fine to leave them as I have it set up already? Any advice is greatly appreciated.
Moz Pro | | mhenshall
Marc0 -
Videos on duplicate content editing
Hi, I am looking for good videos with visual examples on how to edit duplicate content issues. I am editing a law firms website, and for the most part the duplicate issues seem to show up in tag URL's on the blog. I feel like I have maybe half of the picture figured out, but I am not sure how or where to make changes. I have gone through the crawl diagnostic issues and a few articles, but I know I am a visual learner. Therefore a video might be helpful. Does anyone have any suggestions on where to get started? Thanks.
Moz Pro | | DigitalEnvy0 -
How do i fix these errors?
Hi How do i fix these errors? (attached) I dont understand them and dont see any instructions to fixing them.. Regards Chris capturefpa.jpg
Moz Pro | | chrisleonard0 -
Page Authority is the same on every page of my site
I'm analyzing a site and the page authority is the exact same for every page in the site. How can this be since the page authority is supposed to be unique to each page?
Moz Pro | | azjayhawk0 -
Page Penalization
Hiya, Looking for some advice, i have a page which the on page optimization tool shows as an A grade and Google has indexed it. I have checked vie site: however is not being found in search results even for an exact match on the page title which is very specific. I believe the page may be being penlized for over optimisation? any advice would be great! URL is www.tots-away.com/child-friendly-holidays-spain/
Moz Pro | | iprosoftware0 -
My campaigns are not analyzing all my pages.
Hi I created a campaign against http://www.universalpr.com, and this campaign reports that only one page has been crawled. This site uses a jsvascript redirect to the real page which can be found through the following: www.universalpr.com/wps/portal/universal/univhome/!ut/p/c5/04_SB8K8xLLM9MSSzPy8xBz9CP0os_hQdwtfCydDRwN_Jw9LA0-LAOPQYCdDI_9QY_1wkA6zeAMcwNFA388jPzdVPzi1WL8gO68cANNcdLU!/dl3/d3/L2dBISEvZ0FBIS9nQSEh/ Now I also attempted to create a campaign against this page in case that the javascript redirect was breaking things, but that campaign also reported 1 page crawled. Can anyone instruct me as to what I'm doing wrong? Thank you
Moz Pro | | jcmoreno0 -
Page Rank and offline sites
I have a domain with PR6 according to the Historical Pagerank Checker. But that last PR was calculated 2 years ago. I brought the site back online a few days ago and have checked that many/most of the backlinks are still valid. It is now in the Google index but the Historical Pagerank Checker shows PR0. Will it get back its previous rank or something close to it? How long will it take?
Moz Pro | | DomainOptions0 -
"Issue: Duplicate Page Content " in Crawl Diagnostics - but these pages are noindex
Hello guys, our site is nearly perfect - according to SEOmoz campaign overview. But, it shows me 5200 Errors, more then 2500 Pages with Duplicate Content plus more then 2500 Duplicated Page Titles. All these pages are sites to edit profiles. So I set them "noindex, follow" with meta robots. It works pretty good, these pages aren't indexed in the search engines. But why the SEOmoz tools list them as errors? Is there a good reason for it? Or is this just a little bug with the toolset? The URLs which are listet as duplicated are http://www.rimondo.com/horse-edit/?id=1007 (edit the IDs to see more...) http://www.rimondo.com/movie-edit/?id=10653 (edit the IDs to see more...) The crawling picture is still running, so maybe the errors will be gone away in some time...? Kind regards
Moz Pro | | mdoegel0