Crawler Accessibilit
-
In Insights section of MOZ campaign, I'm seeing this: https://imgur.com/Gu2K9dz
Here are the contents of robots.txt:
User-agent: *
Disallow: /wp-admin/Sitemap: http://website.com.com/sitemap_index.xml
Can you please let me know what is wrong here?
-
Hi there!
Thanks so much for the great question! The data that populates in the homepage insights module in your Campaign is pulled when your Campaign is initially created and we do not update that info with each crawl like your other data. If something has changed since the Campaign was initially created, that module will not reflect the change. Sorry for that confusion!
If you'd like me to look into this further for your specific Campaign, I would be happy to do so! I would just need you to send an email on over to help@moz.com with the Campaign name so we can investigate.
I hope this helps!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Unsolved Scripts?
0 -
Unsolved Website Traffic
Greetings All. I'm working on a new business website for a client, and I've been accessing the site numerous times daily (troubleshooting, confirming changes, etc.). I've been using Google search to access the site, and I use a VPN so that my IP would be random. So I would presume that the site traffic should be increasing. But on the last Moz Pro crawl, the site traffic was still listed as 0.
Getting Started | | depawl52
Is there a minimum amount of traffic required before Moz recognizes it or is something else going on?
Thank you.0 -
Unsolved How do I remove close caption when watching lessons
By default, the lesson videos I'm watching have closed caption turned on. I find it annoying and I'd like to turn it off. How do I do that?
Getting Started | | digipal550 -
When setting up a new campaign for a client should I add keywords
I'm new to Moz and SEO. When setting up a new campaign there are some keywords pre-filled. Sometimes there are a lot. Sometimes they are very client-specific rather than for the sector or for a search. Sometimes there are very few poor quality keywords. Should I research keywords so that there are as many as possible relevant keywords when first setting up the campaign or leave it as it is and add keywords later?
Getting Started | | thepeterlunt0 -
How do I check PA in moz
i see where I can check the DA for a site, but how can I check the PA of a page?
Getting Started | | Konvertica0 -
Has anyone purchased the MOZ SEO courses? Are they good?
I'm looking to learn more about SEO. Has anyone purchased the courses available through MOZ? If so, are they useful?
Getting Started | | Stevepair0 -
Our crawler was not able to access the robots.txt file on your site
Hello Mozzers! I've received an error message saying the site can't be crawled because Moz is unable to access the robots.txt. I've spoken to the webmaster and he can't understand why the robot.txt can't be accessed in Moz. https://www.thefurnshop.co.uk/robots.txt and Google isn't flagging anything up to us. Does anyone know how to solve this problem? Thanks
Getting Started | | tigersohelll0 -
Does the Moz crawler have a static ip address?
We block AWS from crawling our site. Does the moz crawler use a static ip address that we could allow? I'm currently not able to add a campaign because Moz can't connect to our site.
Getting Started | | uShip0