Do the SEOmoz Campaign Reports follow Robots.txt?
-
Hello,
Do the SEOmoz Campaign Reports (that track errors and warnings for a website) follow rules I write in the robots.txt file?
I've done all that I can to fix the legitimate errors with my website, as reported by the fabulous SEOmoz tools. I want to clean up my pages indexed with the search engines so I've written a few rules to exclude content from Wordpress tag URLs for instance.
Will my campaign report errors and warnings also drop as a result of this?
-
Thanks Chris and Sam. The confirmation and additional resources helped.
-
Hi,
Rogerbot does adhere to your robots.txt file as mentioned here under the section heading How come rogerbot isn’t crawling all of my pages?
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
SEOmoz not showing Google rankings accurately in Ranking Reports. How do we fix this?
We have a running campaign for a client who has rankings show for Yahoo and Bing within the SEOmoz Ranking Reports, however, Google shows no data or rankings. When we manually check from different IP's and computers and browsers, we see our client ranking very well in Google and for keywords which we have inside their campaign for SEOmoz. Can anyone provide insight into this? Have you experienced this also? Our reports would look terrible going to the client if sent from SEOmoz directly as Google shows 0 (Not in Top 50) for all keywords, so we have to get rankings from other sources or manually to show our client. Thank you in advance for your help and tips everyone!
Moz Pro | | WhiteboardCreations0 -
Rankings Different in Serps from Report
My site shows up on page one for many search queries, but I'm "not in the top 50" for those same terms according to the rankings report. Having troubleshooted the problem, it may be a canonical issue. I did not include www when I originally set up my reports and it seems that my site shows up in search results with www. However; if you type in the url without the www, it will automatically forward to the page with www. I did this intentionally in order not to get penalized for duplicate content pages. So here's my question: If I've got one page redirected to the other, shouldn't the rankings report also follow that redirect? If so, then it should show the correct results, right? Thanks, Dino
Moz Pro | | Dino640 -
How do I add a custom logo on the pdf reports?
I would like to remove the SEOMoz Logo from the reports and replace it with ours. Is this possible?
Moz Pro | | Mediablitzz0 -
SEOmoz Dashboard Report: Crawl Diagnostic Summary
Hi there, I'm noticing that the total errors for our website has been going up and down drastically almost every other week. 4 weeks ago there were over 10,000 errors. 2 weeks ago there were barely 1,000 errors. Today I'm noticing it's back to over 12,000 errors. It says the majority of the errors are from duplicate page content & page title. We haven't made any changes to the titles or the content. Some insight and explanation for this would be much appreciated. Thanks, Gemma
Moz Pro | | RBA1 -
SEOMOZ Crawler unicode bug
for the last couple of weeks the SEOMOZ crawls my homepage only and gets 4xx error for most of the URL's. the crawler have no issues with English url's only with the unicode(Hebrew) ones. this is what is see in the csv export for the crawl (one sample) : http://www.funstuff.co.il/׳ž׳¡׳™׳‘׳×-׳¨׳•׳•׳§׳•׳× 404 text/html; charset=utf-8 you can see that the URL is Gibberish please help.
Moz Pro | | AsafY0 -
Quantity of Internal Followed Links
We compared our and competitor pages. And we have got next statistics: Internal Followed Links: 184 4,496 We are thinking about changing our shopping cart links format from /product_info.php?products_id=3547 to /product_name.html This should increase "number of our pages" and "number of links" from them.
Moz Pro | | ctam
But in case a description of products from the same category often is very similar. We worry about duplicating page content. Could you give any advice in that situation? Do Internal Links play a big role in page rank? Thanks. PS: at attached image you can find full page metrics from open site explorer. Our metrics are at left, competitors - right. BtTap.jpg0 -
4XX links in SEOmoz
My campaign is showing me that I have 7 4XX errors. Is there anyway to see where these pages are linked from in order to remove the links?
Moz Pro | | MirandaP0 -
Historical error info on SEOMoz?
Is it possible to get a report of errors that were on a site back in April? Does SEOMoz keep that data available? There was a big decline in the number of errors on one of my sites and I'm trying to go back and see what it was. --Steve
Moz Pro | | Aggie0