Our Duplicate Content Crawled by SEOMoz Roger, but Not in Google Webmaster Tools
-
Hi Guys,
We're new here and I couldn't find the answer to my question. Here it goes:
We had SEOMoz's Roger Crawl all of our pages and he came up with quite a few erros (Duplicate Content, Duplicate Page Titles, Long URL's).
Per our CTO and using our Google Webmaster Tools, we informed Google not to index those Duplicate Content Pages. For our Long URL Errors, they are redirected to SEF URL's.
What we would like to know is if Roger is able to know that we have instructed Google to not index these pages. My concern is
-
Should we still be concerned if Roger is still crawling those pages and the errors are not showing up in our Webmaster Tools
-
Is there a way we can let Roger know so they don't come up as errors in our SEOMoz Tools?
Thanks so much,
e
-
-
Thanks Kent!
-
In order to answer your questions, we need to understand exactly how you "instructed Google".
If you went into Google Webmaster Tools and changed settings such as parameters of URLs, then only Google will know about those changes. Roger wont know and neither will Bing or any other crawler.
Whenever possible I recommend making the proper adjustments on your site so all crawlers know and understand how to crawl your website.
**1) Should we still be concerned if Roger is still crawling those pages and the errors are not showing up in our Webmaster Tools **
Yes. First of all, Bing + Yahoo = 30% of the search market and they will experience the same trouble as Roger. Second, by informing Google directly you are making changes in a way that make it impossible for tools such as Roger to provide you with actionable data.
2) Is there a way we can let Roger know so they don't come up as errors in our SEOMoz Tools?
Not that I am aware of. I wish Roger made better friends with Googlebot and could learn all the personal settings, but that was not possible the last time I checked.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Duplicate Content
Hello, I'm managing a site which shows as having duplicate page issues (in the crawl analyser) for 3 pages. Basically the site is offering 3 different options of the same product so depending on which size you select, you are directed to the relevant page. These 3 pages are basically identical apart from a slight difference in copy regarding the size (small, medium, large) Is this likely to be a big issue regarding SEO, and what would the moz community suggest re this? Thank you!
Moz Pro | | wearehappymedia0 -
Duplicate conent
I found some duplicate content on my site.... but in my SEOMOZ campaigns account. It says that I do not have duplicate content... what is wrong? is the tool working ?
Moz Pro | | sandyallain0 -
Google Webmaster Tools and Open Site explorer's links not matching up
My question is why do my GWT's links not match up to the ones on Open Site Explorer. I watched John Mueller's video, and he said that they had problems with the link counts recently. After checking my links today, I can see that the problem is fixed, but my link count differs from Open Site Explorer. On Web Master Tools I have 307 links, but on Open Site Explore I have 42. Has anyone dealt with this problem? thanks. Peter
Moz Pro | | PeterRota0 -
Tried to find correlation between SEOMOZ statistic and google ranking.
I've made Google US search and than tried to compare SEOMOZ data for first few result. I've used Open Site Explorer and On-Page Report Card. On attached picture you can find this statistic. Pages are sorted in order as they appear in Google search. For me is big question why position 2 and 4 is so hight and 6 is only 6. And what position 6 should do to go up. Thank you. 2s9zlu8.jpg
Moz Pro | | ctam0 -
Crawl Diagnostic | Starter Crawl taken 14hrs.. so far
We started a starter crawl 14hrs ago and it's still going, can anyone help on why this is taking so long, when it says '2 hrs' on the interface.. Thanks, Rory
Moz Pro | | RoryMacDonald0 -
Crawl slow again
Once again the weekly crawl on my site is very slow. I have around 441 pages in the crawl and this has been running for over 12 hours. This last happened two weeks ago (ran for over 48 hours). Last week's crawl was much quicker (not sure exactly how long but guessing an hour or so). Is this a known issue and is there anything that can be done to unblock it? Weekends are the best time for me to assess and respond to changes I have made to my site so having this (small) crawl take most of the weekend is really quite problematic. Thanks. Mark
Moz Pro | | MarkWill0 -
How to Stop SEOMOZ from Crawling a Sub-domain without redoing the whole campaign?
I am using SEOMOZ for a client to track their website's performance and fix any errors and issues. A few weeks ago, they created a sub-domain (sub.example.com) to create a niche website for some of their specialized content. However, when SEOMOZ re-crawled the main domain (example.com), it also reported the errors for the subdomain. Is there any way to stop SEOMOZ from crawling the subdomain and only crawl the main domain? I know that can be done by starting a new campaign, but is there any way to work around an existing campaign? I'm asking because we would like to avoid the setting up the campaign again and losing the historical data as well. Any input would be greatly appreciated. Thanks!
Moz Pro | | TheNorthernOffice790