Meta Noindex report: exclude urls and delete all warnings in once
-
Dear community,
I have a question about "Site Crawl" > "Crawler Warnings" > "Meta Noindex" reports. I see 3.6K errors with all the same url base: /register?url={{xxxxxxxx}}
The page have the following robots meta tag: 1. Can i exclude some urls from crawling by moz-spider bot? If yes, how?
2. Can i use the 'mark as fixed' or 'ignore' functionality for all urls in once? Now, i have to execute the action 36 times to 'ignore' all 3600 errors.Hope, someone can help me
-
Hi,
1. You can exclude the Moz crawler (Rogerbot) from various pages: https://moz.com/help/moz-procedures/crawlers/rogerbot
You need to use your robots.txt file, rather than trying to do it on page2. Once you've done the above, you can request a recrawl and they should all disappear
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Are Monthly-Run custom reports supposed to compare against the previous month?
When I run monthly reports, it looks like keywords are down, when they are actually up compared to the previous month. Is there a way to get the monthly reports to show how many positions up or down a keyword is compared to the prior run report?
Feature Requests | | bizmarquee0 -
In custom reports, Can we get a module for finished tasks?
Hello, I like the automatic scheduled report feature. I was wondering if I could send clients a small list of tasks completed on the 'insights' page of campaigns? Every week I usually do tasks from the 'insights' section of the campaign, then I click finish when I've completed that tasks. I would like to be able to show that to clients monthly. Is this possible?
Feature Requests | | Extima-Christian1 -
Is there a way to take notes on a crawled URL?
I'm trying to figure out the best way to keep track of there different things I've done to work on a page (for example, adding a longer description, or changing h2 wording, or adding a canonical URL. Is there a way to take notes for crawled URLs? If not what do you use to accomplish this?
Feature Requests | | TouchdownTech0 -
One of my Moz Campaigns was accidentally deleted. Any tips on getting it back?
I had a campaign setup with all of my keywords meticulously labeled and branded. Then by mistake, it was deleted. Is there any way I can restore/get the data back for an accidentally deleted campaign?
Feature Requests | | midcenturybliss0 -
Can I embed a Moz report in my own admin site?
I'd like to be able to pull one of the reports that I have on my campaign dashboard on another site (preferably via iframe). Is this possible?
Feature Requests | | m4change0 -
Is there a way to add custom dashboards into Moz's "Custom Reporting"?
I have dashboards set up in Google Analytics that track conversions and year over year traffic data and just wanted to see if their was a way to add those extra metrics Moz's Custom Report? Any help or suggestions would be much appreciated!
Feature Requests | | Gruenagency0 -
Is it possible to set up a custom report template to use on multiple campaigns?
As far as I can tell I have to create a custom report manually for each campaign. Is there a quick way to copy reports across multiple campaigns?
Feature Requests | | kingwheelie1 -
Competitor changed URL. What data do I lose if I update Moz settings?
One of my competitor's has changed their domain URL. I want to update this in the Moz campaign settings but I get a warning that all historical data will be lost if I do. Is that really true? I replaced one of my competitors with another for a week and didn't seem to lose historical data. Incidentally, could this be a feature request to allow more competitors to be tracked? eqEhEHz.jpg
Feature Requests | | justin-brock0