Amazon CloudFront CDN
-
Hi,
I'd like to increase website's speed with Amazon CloudFront CDN.
I created some CNAMEs and i've something like this:
- www.mydomain.com (my website)
- cdn1.mydomain.com
- cdn2..mydomain.com
- cdn3.mydomain.com
But i've a lot duplicate content now ! One per subdomain and one per content (gif, css, html, and so one).
Have you any feedback in order to not have SEO penalty ?
Does Google detects CDN ? Can I help him to understand my CDNs ?
Thanks,
Best regards,
Maxime
-
Hi Max,
As you know, SEOmoz uses a CDN (Content Delivery Network) to host our static content. This greatly improves the load time of our pages by distributing our content across a cloud network, and results in an improved experience for users.
If I understand your question correctly, you have set up a CDN and have created duplicate content issues.
To solve this, it's important to set up your CDN only to serve static content, like images, stylesheets and javascript. That is what a CDN is designed for. Do not duplicate your entire site - your HTML - as this will cause duplicate content issues.
If for some reason you need to replicate your entire HTML, then there are some steps you can take to mitigate the damage, although it's going to depend on your exact circumstances.
For example, you can set full URL canonical tags so that all your mapped CNAMES point to your primary URL.
To revert back to one copy of your HTML, you might want to put 301 redirects in place on the duplicated content (pointing to the original) before removing them from the CDN.
But even these aren't ideal solutions. It's best just to serve your static content, and only one version of your HTML.
-
I think he didn't reply.
He store data onto Amazon S3 and serves pictures from CDN (Amazon CloudFront). So he told me he hasn't duplicate content issues because he serves pictures.
But he tolds too "This isn't an issue for duplicate content, unlike if you were replicating your HTML".
When you use Amazon CloudFront without Amazon S3, but you use it with your webserver, Amazon CloudFront duplicates all content (pictures, pages, ...).
Onto your website, you'll only link pictures to CDN, for example http://cdn1.test.com/picture.jpg. But if GoogleBot opens http://cdn1.test.com/ it'll find all your html content !
So it'll be a duplicate issue I think, and I don't really know what is the best way to fix that (not use Amazon CloudFront without Amazon S3, Canonical, http headers, ...)
Thanks
-
Did the author's reply in the comment of the blog post answer your question, or do you still have this question?
-
Great post, but he didn't talk about duplicate content, only increasing speed.
-
Here's the YouMoz post that might help.
http://www.seomoz.org/ugc/improving-page-speed-with-amazon-web-services-a-beginners-guide
-
Tomorrow morning (Seattle time) I'll be posting a YouMoz blog post at http://www.seomoz.org/ugc that deals directly with setting up a CDN on Amazon. You can read through the steps given in the article and see if that answers your questions, and if not, you can ask a question in the comments.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Why is Amazon crawling my website? Is this hurting us?
Hi mozzers, I discovered that Amazon is crawling our site and exploring thousands of profile pages. In a single day it crawled 75k profile pages. Is this related to AWS? Is this something we should worry about or not? If so what could be a solution to counter this? Could this affect our Google Analytics organic traffic?
Intermediate & Advanced SEO | | Ty19860 -
Will using CDN Affect SEO?
I'm got a website with a slider and each of the 6 slides has a 5-second video background. The website is B2B and the user profile for the website is employees at Fortune 1000 companies in the United States using desktop computers to browse. The videos are highly optimized and we did testing using various browsers and bandwidth connections to determine the videos loaded fast enough on down to a 15mbit/s connection (which is pretty low by today's average U.S. business bandwidths.) We tried hosting the videos on Vimeo and YouTube but it caused issues in the timing of the slide show display. (I've not seen any other website do what we do the way we do it. Most sites have a single video background with a single text overlay on top.) The downside to this is that loading all those videos produces a lot of bandwidth usage for our server. The website is serving a niche service industry though so we're not exceeding our current limits. I'm wondering though might there be some benefit to hosting just the video files on a CDN? Obviously that would mean lest bandwidth usage for our server, and possibly quicker load times where the CDN server is closer to the user than our server. But are there benefits or downsides from an SEO perspective noting that I'm proposing only putting the videos on the CDN, not the entire web page.
Intermediate & Advanced SEO | | Consult19010 -
CDN for SEO (or not)?
Does CDN impact on SEO or not? There seems conflicting ideas as to whether they impact positively or negatively, I realise that if the page loads quicker this is a good thing for SEO and usability of course. Does Google see CDN as just cheating and a get-around for not doing the work from the ground up and using good hosting etc? Do you have any direct experience? All constructive input much appreciated!
Intermediate & Advanced SEO | | seoman101 -
SEO: Can you rank Amazon product Pages ?
Hi Guys Just a general question about doing SEO for our product pages... We have a range of products on Amazon and wondered if it is worth build some good links to our product pages to get them ranked higher in Google ?? Is it easier to rank Amazon product pages ?? Thanks Guys G Gareth
Intermediate & Advanced SEO | | GAZ090 -
Using a US CDN (Cloudflare) for a UK Site. Should I use a UK Based CDN as it says my server is based in USA
Hi All, We are a UK Company with Uk customers only and use CloudFlare CND. Our Site is hosted by a UK company with servers here but from looking online and checking where my site is hosted etc etc , some sites are telling me the name of our UK Hosted company and other sites are telling me my site is hosted in San Fran (USA) , where I presume the Cloudflare is based. I know Cloudflare has a couple of servers in the UK it uses but given all my customers are UK based ,I don't want this is affect rankings etc , as I thought it was a ranking benefit to be hosted in the country you are based. Is there any issue with this and should I change or is google clever enough to know so i shouldn't worry. thanks Pet
Intermediate & Advanced SEO | | PeteC120 -
Mystery: Ranking in Amazon for a product page?
My client has a product on Amazon that has more reviews and better rankings. However, their competitor with less reviews and lower ratings are ranking #1 for our primary keyword in Google. Our product page doesn't even rank on Google, but I'm assuming Google doesn't want to display two results from Amazon. The only difference is they have 1 link pointed to the product page that has a small PA of 10 and DA of 15. Do you think this link could be the only thing making a difference? Should we start building more links to this product page in addition to their website? Any other tips to help our Amazon page rank?
Intermediate & Advanced SEO | | Stryde0 -
Microdata & Competeing against Amazon in the SERPs
Hello... I have an ecomm clients who's competing against Amazon in the SERPs. Amazon does a great job of leveraging micro-data. Here's the rub... Amazon is ranking for product level pages and my client is ranking for category level pages. How can my client leverage micro-data to 'compete'?
Intermediate & Advanced SEO | | 19prince0 -
How was cdn.seomoz.org configured?
The SEOmoz CDN appears to have a "pull zone" that is set to the root of the domain, such that any static file can be addressed from either subdomain: http://www.seomoz.org/q/moz_nav_assets/images/logo.png http://cdn.seomoz.org/q/moz_nav_assets/images/logo.png The risk of this configuration is that web pages (not just images/CSS/JS) also get cached and served by the CDN. I won't put the URL here for fear of Google indexing it, but if you replace the 'www' in the URL below with 'cdn', you'll see a cached copy of the original: http://www.seomoz.org/ugc/the-greatest-attribution-ever-graphed The worst-case scenario is that the homepage gets indexed. But this doesn't happen here: http://cdn.seomoz.org/ That URL issues a 301 redirect back to the canonical www subdomain. As it should. Here's my question: how was that done? Because maxcdn.com can't do it. If you set a "pull zone" to your entire domain, they'll cache your homepage and everything else. googlebot has a field day with that; it will reindex your entire site off the CDN. Maybe the SEOmoz CDN provider (CloudFront) allows specific URLs to be blocked? Or do you detect the CloudFront IPs and serve them a 301 (which they'd proxy out to anyone requesting cdn.seomoz.org)? One solution is to create a pull zone that points to a folder, like example.com/images... but this doesn't help a complex site that has cacheable content in multiple places (do you Wordpress users really store ALL your static content under /wp-content/ ?). Or, as suggested above, dynamically detect requests from the CDN's proxy servers, and give them a 301 for any HTML-page request. This gets complex quickly, and is both prone to breakage and very difficult to regression-test. Properly retrofitting a complex site to use a CDN, without creating a half-dozen new CDN subdomains, does not appear to be easy.
Intermediate & Advanced SEO | | mcglynn0