Blocking external links in Robots.txt - need advice on Best Practice
-
I look after an affiliate site that is doing quite well in the search rankings. We've been doing a review of our practices and one thing that has cropped up is our robots.txt.
In it, we disallow Google from crawling external links. This used to be best practice in the affiliate industry a couple of years ago, but I wanted to know if this is still the case, and what the implications are if we were to:
a/ leave it as is?
b/ allow crawling?
Thanks in advance.
-
I'm not sure how you're blocking Google from crawling external links in the robots.txt file--typically you only block them from crawling internal pages on your site.
If you're using a script, though, to track the clicks on external links and that script is running your site (and you're blocking that script in robot.txt), then that still should be fine. You may want to add a "nofollow" tag on those links, though, so you don't end up passing link "credit" or "link juice" to those affiliates (unless you want to do that?).
As far as external links go, though, it's typically okay (and expected) that you link out to other sites.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Need help about facebook fanepage!
I have a fanepage on facebook , some time have other fanpage go to my fanepage and spam..., now i want protect for they can't look at my fanpage :(( Who can help me thank very much! [link removed by staff]
Affiliate Marketing | | ITVSEO.COM0 -
SEO and Affiliate Links
Hello, We run a travel related website and we started to run our own affilate newtwork to promote the sales of our products. At the moment the affilate links pont to a spacific affilate url in order to tack conversions : abcweb.com/affiliate/nameqaz I'm wondering how is the best way to run a private affilate programm considering SEO: Is there a way yo benefit from those links ? What are the best strategies to do this? If yes, Is there any benefit from redirecting 301 those links to the original page (the one accesible to google and the one we want to rank for) or is it better to use a king of canonical method. Thanks a lot for sharing you experiences , giving your opinion and indicate resources. Best Regards Daria
Affiliate Marketing | | stereo690 -
How many affiliate links is considered too many?
Hi, Let's say you have great reviews for 50 products and some of these products do have affiliate links on review pages. And then you have user scores and you come up with a top 20 product list sorted by user scores. Now if you have the list of top 20 products on one page and all these products have an affiliate link (with nofollow relation and a 301 redirect) on the same page with only a couple of images and a summary of the review linked to the review pages, would this still be considered as what Google calls a "bridge page"? Would it be better to still generate the top 20 list but rather link to review pages only? (to avoid too many affiliate links on one single page).
Affiliate Marketing | | Gamer070 -
I need some feedback on the value of affiliate aggregators like Link Share
My company decided to start a Link Share affiliate program at the beginning of this year. I've had serious reservations about the value of the program since the beginning but was overruled. Here are my concerns: The majority of publishers seem to be coupon scraper sites or borderline link farms I am told the biggest revenue earners in our network are publishing articles about my company with links back to our site but if they are Google Alerts sure isn't finding them and a manual search hasn't turned up anything either. This makes me think these publishers are using some sort of unsavory way to drive traffic to our site or maybe even cookie traffic that was coming to our site anyway in order to get credit for the sale. Most of all I'd like to hear from anyone else who has used Link Share in the past. Secondly I realize there's not a lot of information here but I'm wondering if this passes the smell test for anyone else. Any feedback would be appreciated.
Affiliate Marketing | | eTundra0 -
Does an affiliate link bring the same SEO juice as a standard link?
I wonder if affiliate links, like the ones offered by Amazon Associates program bring the same SEO as would a link to the same page without this additional "ref=..."?
Affiliate Marketing | | maciek-0 -
Link exchange
Folks I just thought to myself that this forum must be filled with lovely SEOs who are busy working on multiple clients.... I'm very new to the industry myself... about a month into it 🙂 Any-hoots I was just wondering if anybody is working in a category that may be suitable for a link exchange with http://bluetea.com.au/ .... Please let me know
Affiliate Marketing | | PHDAustralia680 -
Link juice from my affiliates to my site
I'm setting up an affiliate program through 1shoppingcart. Even though I run 3 different websites, the way their program works is that I have to have 1 domain name that my affiliates get as their affiliate link, with their unique id attached at the end. I can give them multiple links that will redirect to various places on my 3 websites, but those original links that they put on their site will all be to just 1 domain. I'm wondering if I still get link juice to my sites even though the links are obviously being redirected? Does it depend on the redirection method? I was just thinking that getting hundreds of affiliates who run related sites could be a very good seo boost if they're all linking to my site, but I feel like it's going to be wasted because of this redirection thing. Hope this made sense. Thanks very much,
Affiliate Marketing | | philraymond
Phil0 -
How to use different affiliate link based on geolocalisation in a Seo friendly way ?
Hi All, My website Sportytrader.com http://www.sportytrader.com/ works as an sport betting affiliate website on the french language markets. With sport betting legalisation in Europe, only people from France can play on french sport betting website. The same for Belgium or swiss. We have traffic from everywhere. So we need to geolocalize all our affiliate links to provide the right affiliate link to the right person in function of his location? What is the best way and the more seo friendly way to do that? Thanks a lot, Renaud
Affiliate Marketing | | jarnac0