Free Article Previews (Free Registration Wall)
-
My site is www.optionmonster.com It has a few different areas of "Free" and "Premium" content.
1. We have a first click free program for Google visitors, where they can read the first news article in full.
2. Other visitors and subsequent news article views have a content preview, which includes headline and first paragraph of content, and then asks for a name and email address in order to consume the rest of the free news.
3. We have premium content (paid), and all of those folders are currently on our robots.txt file
My questions are as follows....
a. How much content is needed in front of the "pay/reg wall" in order to still get proper juice from linkbacks/pagerank crawls
b. Should I make the premium content a robots meta noindex tag, or because you can't see the article at all without logging in, is a proper place to include on robots.txt
-
Since GoogleBots can't access the premium regardless, is it redundant to have on the robots.txt file?
You are indeed correct the best practice is to minimize your robots.txt file. That is why the very first sentence in my initial response was the suggestion to NOT include your premium sections in the robots.txt file
Will google and other bots will hurt you if you have premium sections that they try to crawl but can't?
No.
-
Okay. But since GoogleBots can't access the premium regardless, is it redundant to have on the robots.txt file? I thought the best practice was to have almost nothing on the robots.txt file per (http://www.seomoz.org/blog/serious-robotstxt-misuse-high-impact-solutions)
So my question comes down to if google and other bots will hurt you if you have premium sections that they try to crawl but can't, vs ignoring them because they are on the robots.txt
-
So you wouldn't No index FOLLOW those pages, in case someone links to them?
I am not sure what I said to offer that impression.
By "those pages" I am guessing you are referring to your premium content? If so, it really doesn't matter what you do with the content as Google can't get to it due to the robots.txt file. Even if you change the meta tag, Google wont be able to see the change.
Yes, it is possible they could try to follow a link but since this is premium content, they wont be able to access it.
Perhaps I am not clear on your Free vs Premium division. In short, any content which you do not desire to be indexed should contain the NoIndex tag, but that only applies if a crawler has access to the content.
-
So you wouldn't No index FOLLOW those pages, in case someone links to them?
-
I would not include your premium area in the robots.txt file at all. Google will recognize that they are unable to access the content, and it won't get indexed. There is no need to block it further.
For your other content, as long as you are showing Google the same exact information as you are showing to other visitors, you are fine. If you show Google more then you do to other visitors, then your site can be blacklisted.
How much content is needed in front of the "pay/reg wall" in order to still get proper juice from linkbacks/pagerank crawls
There are many factors involved. There isn't an answer like "400 words and you are good". These type of setups can be tricky. If you have a forum, then you can allow visitors to see the first thread but not any of the replies. By limiting content based on a number of words, you will be cutting off some articles, and it is possible a small article can be viewed in it's entirety.
It is more important your key words are in the content. If I linked to an article with the anchor text of 1980 Corvette, and your article started off discussing cars but you cut it off before discussing the 1980 Corvette, then that link can be devalued.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Redirect chain error free htaccess code for website
i want to redirect domain, example.com to https://www.example.com, is anyone can help me to provide redirect chain error free ht-access code. I implemented this htaccess code on the website and mhy site show on the moz redirect chain error RewriteCond %{HTTP_HOST} !=""
Technical SEO | | truehab
RewriteCond %{THE_REQUEST} ^[A-Z]+\s//+(.)\sHTTP/[0-9.]+$ [OR]
RewriteCond %{THE_REQUEST} ^[A-Z]+\s(./)/+\sHTTP/[0-9.]+$
RewriteRule .* http://%{HTTP_HOST}/%1 [R=301,L]0 -
Site architecture? I've got a free user report, that shoots back a page with their data for them to share with co-workers and friends.
Hi, I have a site about to go online that users can run a free report that connects to their calendar app to get 12 months of statistics for their meetings, and then it shoots out a report. So they go to a.com/freereport and they get back a.zom/freereport/report/xxxxxx The content of those reports is different, but the structure is the same as it is a fun way to show off meeting stats to co-workers and friends. I don't see the point of Google indexing those as the traffic to those pages is going to be from social networks and viral, but I do want the backlink credit. Will I get backlink credit if I nofollow that folder? I am having a hard time deciding what to do seo wise and would love some thoughts and advice, what would you recommend? Do nothing fancy. Mark the report folder no follow. Try to do something with rel=cannonical to point those pages to the root page? Thoughts?
Technical SEO | | bwb0 -
Unpublish and republish old articles
This might be a dumb question but we had an incident where a new SEO guy thought it would be a good idea to un-publish and republish all of your 200+ blog posts which we carefully scheduled over the last 6 months. He did not update the content and did not change anything. His intention was to send out google a sign to recheck the sites or something. Now, the entire blog looks like it wen't live in one day, which I don't think is good? Should we load a backup and get our old publishing dates back, should we keep it with the new publishing dates? What are the consequences? Will it effect our SEO?
Technical SEO | | Funlocity1 -
Broken Instant Preview on SERPS
When I check on my SERPS the preview is all mixed up. The images are over each other and it is all like broken. What could cause the problem? Thank you very much in advance for any help! The website is http://villasdiani.com
Technical SEO | | VillasDiani0 -
Should I just have links on my home page or intro to articles
Hi, i am having problems optimizing my home page for the words, lifestyle magazine, online magazine and lifestyle news. my site is here www.in2town.co.uk I am just wondering if i have to much content on the page for google to understand that it is a lifestyle magazine. I am wondering if i should just have the links on the page and no introduction to the articles which i have seen here with a site http://www.femalefirst.co.uk and i am wondering how sites like this are ranking better than ours when they have hardly any content on their home page http://www.nelifestyle.co.uk/
Technical SEO | | ClaireH-184886
http://www.lifestyle.org/
http://www.internationallifestylemagazine.com/ any advice would be most welcome0 -
Blog article URL - with or without date?
Quick question to all you folks: does including the date in a blog article's permalink affect rankings? For example, here's an article with the month and year, as well as the blog title: http://www.ayzanyc.com/blog/2012/12/difference-between-hot-chocolate-hot-cocoa/ Is it better to omit the date and just put the blog title? Also, if is better to avoid using the date, is it worth it to change the link structure of our previous articles (given that the URL will now be different), or should we just focus on future articles? Thanks ahead of time for your advice.
Technical SEO | | onurkiyak0 -
Does posting an article on multiple sites hurt seo?
A client of mine creates thought leadership articles and pitches multiple sites to host the article on their site to reach different audiences. The sites that pick it up are places such as AdAge and MarketingProfs and we do get link juice from these sources most of the time. Does having the same article on these sites as well as your own hurt your SEO efforts in any way? Could it be recognized as duplicate content? I know the links are great just wondering if there is any other side effects especially when there are no links provided! Thank you!
Technical SEO | | Scratch_MM0 -
Google preview magnifying glass icon
Why are my search results missing the google preview magnifying glass icon next to them? My site is an adult toys e-commerce/portfolio site. but doesn't have any sexual explicit content especially on the homepage. I used to have Goole preview working a few month ago but have changed the skin a couple of month ago and Preview is not avalable for my site since then. Google's preview testing tool shows a perfect image for my site. url: http://www.funstuff.co.il Thanks, Asaf
Technical SEO | | AsafY0