How do you tell SEOmoz to ignore a subdomain?
-
We have a subdomain that I don't want to show up in our root SEOmoz campaign. How do I tell SEOmoz to ignore it?
-
Hi John,
You'll want to enter the www.example.com in the campaign, so we crawl JUST the www subdomain. We don't often think of it this way, but www is a subdomain.
-
That is actually what I want. How is that done?
-
Hi John,
Thanks for the question.
Unfortunately though, there is no way to have one campaign specifically ignore a single subdomain and still crawl all other subdomains.It would be possible to set two subdomain campaigns if your site was set as such:
www.example.com
blog.example.comBut anything outside of either of those subdomains would not be touched.
Thanks,
Joel. -
Ah, misunderstood you. I don't think what you are trying to do is possible but you should ask someone who works for SEOMoz to confirm.
-
But I want the subdomain to be craweled, just under a different SEOmoz campaign. Blocking it in the robots.txt file will prevent that.
-
Well the subdomain should have its own folder where you can create you own robots.txt file for. That would only block the subdomain from being crawled.
If you don't have a separate folder, check out this Q&A.
-
That would prevent SEOmoz from crawling it completely. I don't want that. I want the subdomain to be crawled under a different campaign. I want the data for the subdomain, but the number of pages is much greater than the root domain, and is just a lot of noise when looking at the root domain. It's drowning it out. SEOmoz has no option to control this?
-
You can block the SEOmoz spider via robots.txt on the subdomain
<code>User-agent: rogerbot Disallow: /</code>
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Is SEOmoz spider ignoring my redirect?
My client was previously serving their website from both a .co.uk and a .com domain. The DNS for each of these domains was pointing to the same place, rather than redirecting. I saw this as a potential duplicate content problem so I set the .co.uk to 301 redirect on to the .com. As a user, the 301 seems to be working correctly. However, now that I have done this, SEOmoz is picking up thousands of "inbound" links from the .co.uk domain. Essentially, every single link on the internal site, is being duplicated in my stats as an inbound link as well. It appears that the spider is ignoring the redirect. I'm not sure if it's a legitimate issue that will upset Google too, or if it's just a bug with SEOMoz's spider.
Moz Pro | | MadisonSolutions0 -
How to set the crawler or reports to ignore
I have a mobile version of a site with a URL string that disables the mobile view on smartphones (view full site), string is like this example.com/page-name.html?mobile=off I need the seomoz pro reports or crawler to ignore it because the crawler visits both versions of the site then reports them as duplicate content. Is there a setting page I haven't visited yet that will set this?
Moz Pro | | Str82u0 -
Changing the way SEOmoz Detects Duplicate Content
Hey everyone, I wanted to highlight today's blog post in case you missed it. In short, we're using a different algorithm to detect duplicate pages. http://moz.com/blog/visualizing-duplicate-web-pages If you see a change in your crawl results and you haven't done anything, this is probably why. Here's more information taken directly from the post: 1. Fewer duplicate page errors: a general decrease in the number of reported duplicate page errors. However, it bears pointing out that: **We may still miss some near-duplicates. **Like the current heuristic, only a subset of the near-duplicate pages is reported. **Completely identical pages will still be reported. **Two pages that are completely identical will have the same simhash value, and thus a difference of zero as measured by the simhash heuristic. So, all completely identical pages will still be reported. 2. Speed, speed, speed: The simhash heuristic detects duplicates and near-duplicates approximately 30 times faster than the legacy fingerprints code. This means that soon, no crawl will spend more than a day working its way through post-crawl processing, which will facilitate significantly faster delivery of results for large crawls.
Moz Pro | | KeriMorgret2 -
SEOmoz Campaign Setup: What would you do?
I've been using moz for nearly a year now. Initially when I set up our site (rac.com.au) it was as a single campaign for the rac.com.au domain. However, our business has a number of different product offerings and marketing teams (Insurance, finance, travel/tourism, automotive, security etc) - would I be better off setting each of these 'sub' brands as a campaign on their own using the 'folder' campaign setup? For example, have a campaign setup for the Insurance business (rac.com.au/insurance) folder, Finance business (rac.com.au/finance) and so forth? The advantage I see to the folder campaign setup is more specific reporting for each of the business units. Are there disadvantages to this? Any recommendations would be greatly appreciated. Cheers Ryan
Moz Pro | | Hutch_e0 -
What user agent is used by SEOMOZ crawler?
We have a pretty tight robots.txt file in place to only allow the major search engines. I do not want to block SEOMOZ.ORG from being able to crawl the site so I want to make sure the user agent is open.
Moz Pro | | eseider0 -
How often does SEOMoz refresh their link analysis data?
I know that my link profile has changed within the last month, yet both SEOMoz campaign link analysis and Open Site Explorer have shown the exact same number of links for more than a month. Majestic SEO fluctuates as I would expect, but Moz data is unchanged.
Moz Pro | | Aggie0 -
Seomoz logging in
Hey, The seomoz toolbar was permenantly logged in. But for some reason after a period of inactivity it now logs out and I have to relogin. I'm using firefox, what could be causing this?
Moz Pro | | PeterM220 -
SEOmoz toolbar log in chrome wonky!
In Chrome, I'll start off not logged in to the toolbar. I'll click log in which forwards me to the SEOmoz login page. I'll login. Sometimes the toolbar will reflect this login and the metrics will poplulate in the PA and DA, other times it won't. If I navigate to another page within the same tab, it may show metrics still, but it is also just as likely to show that I'm not logged in. If I open a new tab, the toolbar will show that I'm not logged in. I click the log in again but when directed to SEOmoz, it'll show that I'm already logged in. I haven't been able to pinpoint exactly when it'll work and when it won't. Seems a bit random, so am wondering if anyone else has experienced this issue and has been able to solve this logged in / not logged in problem. As a note, anytime I navigate back to the SEOmoz site, whether by opening a new tab or a new window, the SEOmoz site does show I'm logged in, while the toolbar shows I'm not. You can see a demonstration of the simultaneous logged in SEOmoz site and logged out SEOmoz toolbar in the attached screen shot. UPDATE Also having similar issues in firefox. Am wondering if this has anything to do with the fact that I changed my email address within the past few weeks. KQXxN.gif
Moz Pro | | gregalam0