SEO impact on archives and mirror services?
-
Hi,
We're looking at setting up an email archive site for certain lists related to our niche. We've been considering using archives.ourdomain.com versus ourdomain.com/archives. Part of the problem is that while the archives won't initially have huge amounts of content, over time it'll outstrip the amount of content we produce and I was worried about whether or not this would cause a duplicate content penalty as the emails will also be archived elsewhere.
If the volume of mails over time combined with duplication penalties are going to penalise the site, I'd rather we used a subdomain or a separate domain. If not, then subdomains might be the way to go.
-
I meant include this robot in the subdomain not include the subdomain in the robot. Was answering an employee at the same time and crossed some wires.
-
You have a few choices here to avoid that.
If you want to avoid it completely, simply include this entire subdomain.domain.tld in the robots.txt as:
User-agent: *
Disallow: /
Disallow: *Then place it in the root of your subdomain folder, for example if you sub was at subdomain.domain.tld you would normally have a folder called subdomain within your normal root folder.
Do not place this robots.txt file in your main folder or the whole site will not be indexed.
Extra measure, you can place a:
in the head section of each page.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Mobile Version SEO question
Hi there, Quick question on mobile SEO. Basically, I don't think I can effectively format my mobile website design unless I just build it as a collection of pictures. This way it'll be possible to format so it doesn't look a jumbled mess. My question - if my mobile version is just essentially HQ screenshots/pictures put together, how will that affect my SEO for mobile? PS if anyone has suggestions on how I can design my mobile version without affecting desktop I'd appreciate it. I'm using shopify and across many of the themes I've tried whatever I design on desktop has to format on mobile as well. To my knowledge only wix allows you to independently edit the mobile and desktop versions.
Content Development | | markellw0 -
Could decreasing publishing frequency negatively affect our SEO?
Hi Moz Community! I run marketing for a DA 43 website. We've been consistently blogging 4-5 times per week for the past 7 years, and its become ingrained in company culture. Due to limited resources, I want to decrease publishing frequency on the blog and focus on other marketing activities (content promotion, higher value content, link outreach, CRO etc). However, our team is worried that decreasing frequency might negatively affect our SEO (organic search is by far our most important acquisition channel, is the main revenue driver for the whole company). When I look at metrics, a couple of things stand out: 1) a very small % of our blog posts get meaningful organic traffic, 2) the majority of organic traffic that produces customers actually goes through the homepage, not the blog, 3) the vast majority of our blog posts are not earning links as we have not focused much on promotion. Anybody have thoughts on specifically whether decreasing blogging frequency might have an impact? (I know Moz and Hubspot have both done frequency experiments, but those were on high-DA, high-engagement sites where every post had a chance to earn links, etc.) so I'm wanting to isolate the case where publishing frequency is decreased on a site where most posts aren't getting links/much engagement. Thanks!
Content Development | | paulz9990 -
Does a "Read More" button to open up the full content affect SEO?
As we've been refining our metrics for gauging whether or not a blog is effective -- if people are engaging with it -- one of the strategies we've seen (e.g. NYT, WaPo, Yahoo!) is "Read More." I've read a few articles with some who advocate using it and others who discourage it. Does anyone have any history adding "Read More" to their content and the effect it had?
Content Development | | ReunionMarketing0 -
My Boss tells me personal narrative content isn't read online and bad for SEO, anyone else disagree? b/c I do!
I am in a constant debate that content 1st person or 3rd person doesn't make a difference in terms of SEO and what people on the web want to read. What do you all think? Does it make a difference?
Content Development | | GoAbroadKP0 -
Hidden text that's not really "hidden" - seo
Hi guys, I have a question for you about a thing I saw on a website. I've attached the prints.
Content Development | | ricardomargalho
They have like "hidden text". It must be good for indexation, they can
target a lot of important keywords in it, and still keep the website
"clean".
Is this penalized by google if discovered? Do they see this as black hat? Thanks, Ricardo ?name=Captura+de+ecra%CC%83+2012-08-11%2C+a%CC%80s+06.00.36.png ?name=Captura+de+ecra%CC%83+2012-08-11%2C+a%CC%80s+06.00.36.png ?name=Captura+de+ecra%CC%83+2012-08-11%2C+a%CC%80s+05.59.56.png0 -
What is your opinion about: SEO SearchTerms Tagging 2 (WP plugin)
The purpose of this plugin is to strengthen our On Page SEO by adding new internal linking to the blog post using the most popular keywords used by search engine visitors to find the blog post from a search engine ( incoming search terms ). We can also display the most popular & recent search terms in the sidebar to get a side wide internal linking to the corresponding blog post. New since version 1.25: Automatically convert popular search terms into Post Tags.
Content Development | | cdrdz870 -
Copywritting Service Recommendations
Hi there, I'm looking for several recommendations for decent copywritting services, freelancers or otherwise. Ideally with B2B experience. Any ideas? Steve
Content Development | | phsgroup0 -
Displaying archive content articles in a writers bio page
My site has writers, and each has their own profile page (accessible when you click their name inside an article). We set up the code in a way that the bios, in addition to the actual writer photo/bio, would dynamically generate links to each article he/she produces. Figured that someone reading something by Bob Smith, might want to read other stuff by him. Which was fine, initially. Fast forward, and some of these writers have 3,4, even 15 pages of archives, as the archive system paginates every 10 articles (so www.example.com/bob-smith/archive-page3, etc) My thinking is that this is a bad thing. The articles are likely already found elsewhere in the site (under the content landing page it was written for, for example) and I visualize spiders getting sucked into these archive black holes, never to return. I also assume that it is just more internal mass linking (yech) and probably doesnt help the overall TOS/bounce/exit, etc. Thoughts?
Content Development | | EricPacifico0