Free Article Previews (Free Registration Wall)
-
My site is www.optionmonster.com It has a few different areas of "Free" and "Premium" content.
1. We have a first click free program for Google visitors, where they can read the first news article in full.
2. Other visitors and subsequent news article views have a content preview, which includes headline and first paragraph of content, and then asks for a name and email address in order to consume the rest of the free news.
3. We have premium content (paid), and all of those folders are currently on our robots.txt file
My questions are as follows....
a. How much content is needed in front of the "pay/reg wall" in order to still get proper juice from linkbacks/pagerank crawls
b. Should I make the premium content a robots meta noindex tag, or because you can't see the article at all without logging in, is a proper place to include on robots.txt
-
Since GoogleBots can't access the premium regardless, is it redundant to have on the robots.txt file?
You are indeed correct the best practice is to minimize your robots.txt file. That is why the very first sentence in my initial response was the suggestion to NOT include your premium sections in the robots.txt file
Will google and other bots will hurt you if you have premium sections that they try to crawl but can't?
No.
-
Okay. But since GoogleBots can't access the premium regardless, is it redundant to have on the robots.txt file? I thought the best practice was to have almost nothing on the robots.txt file per (http://www.seomoz.org/blog/serious-robotstxt-misuse-high-impact-solutions)
So my question comes down to if google and other bots will hurt you if you have premium sections that they try to crawl but can't, vs ignoring them because they are on the robots.txt
-
So you wouldn't No index FOLLOW those pages, in case someone links to them?
I am not sure what I said to offer that impression.
By "those pages" I am guessing you are referring to your premium content? If so, it really doesn't matter what you do with the content as Google can't get to it due to the robots.txt file. Even if you change the meta tag, Google wont be able to see the change.
Yes, it is possible they could try to follow a link but since this is premium content, they wont be able to access it.
Perhaps I am not clear on your Free vs Premium division. In short, any content which you do not desire to be indexed should contain the NoIndex tag, but that only applies if a crawler has access to the content.
-
So you wouldn't No index FOLLOW those pages, in case someone links to them?
-
I would not include your premium area in the robots.txt file at all. Google will recognize that they are unable to access the content, and it won't get indexed. There is no need to block it further.
For your other content, as long as you are showing Google the same exact information as you are showing to other visitors, you are fine. If you show Google more then you do to other visitors, then your site can be blacklisted.
How much content is needed in front of the "pay/reg wall" in order to still get proper juice from linkbacks/pagerank crawls
There are many factors involved. There isn't an answer like "400 words and you are good". These type of setups can be tricky. If you have a forum, then you can allow visitors to see the first thread but not any of the replies. By limiting content based on a number of words, you will be cutting off some articles, and it is possible a small article can be viewed in it's entirety.
It is more important your key words are in the content. If I linked to an article with the anchor text of 1980 Corvette, and your article started off discussing cars but you cut it off before discussing the 1980 Corvette, then that link can be devalued.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
No-follow for article directory?
My clients pull from a central article directory on our server (medical directory), as the information is about standard medical issues. This said, the MOZ analytics is showing these articles for each client as indexed and duplicate in content, descriptions, titles, etc. Would it be better to use a no-follow for these articles to avoid looking like duplicate content, or should I consider overhauling the resource section into static pages and making each article unique to each client-considering the latest updates in Google? Any help/insight would be greatly appreciated!!!!! Thanks
Technical SEO | | lfrazer0 -
Is it worth adding schema markup to articles?
I know things like location, pagination, breadcrumbs, video, products etc have value in using schema markup. What about things like articles though? Is it worth all the work involved in having the pages mark up automatically? How does this effect SEO, and is it worthwhile? Thanks, Spencer
Technical SEO | | MarloSchneider0 -
Influencing Google Instant Preview
Hello there! I have been looking at how our articles are shown in Google Instant Previews. While the description in the SERPs picks up the first paragraph from the article from the main table/div body, the Instant Preview highlights a text ad in the top right of the side column. According to Google https://sites.google.com/site/webmasterhelpforum/en/faq-instant-previews Q: How can I influence the text highlighted in the preview image?
Technical SEO | | CleverPhD
A: The highlighted text is automatically chosen based on the user's search query. Only text that is visible on the page can be selected for highlighting. Google is highlighting the same block of text from an ad space over and over again. "Download our Free Guide ...." vs the first paragraph in the article. Any ideas folks?0 -
Links into website that are unnatural - a paid article
I prepared an article for another related website and posted it on my website - http://www.gardenbeet.com/garden_design_blog/garden-ideas/save-money-and-create-diversity-seeds-and-small-plants-are-better/ I was paid to write an article and provided a link to the related website at the end of the article - I declared the payment a good 10 months later the page where the article sits has become the 2nd most linked to page on my website - SEOmoz is giving it a Page Authority of 48 and all the links are coming from a wide variety of forums using one anchor text link phrase in the latest google update my homepage PR dropped by 1 - I am assuming the penalty came because of this article is it worth changing the URL to remove these spammy links to my website?
Technical SEO | | GardenBeet0 -
Free Blogs Backlinks
Hello I have a very basic question, hope you people don't mind answering this. I plan to create a 10 blogs with keyword specific domain name, where in footer i can place back-link pointing to my website and thought to run on C-Class IP's which will cost me of-course. Now 2nd option which will be free, where i can plan to have my blog on wordpress, Timblr, blogger etc free blogging website and use the backlinks from there and all will have different IP which will also best for SEO prospective. Can you suggest me which will be the best option to have blogs on owned domain name or free blogging site, keeping in mind this will be just s prospective to generate backlinks. Do recommend is this a genuine way to get backliks or its another spam, and where we will keep on updating the all blogs regularly. Thanks in Advance! Regards Danish Wadhwa
Technical SEO | | DanishWadhwa0 -
Best free tool to check internal broken links
Question says it all I guess. What would your recommend as the best free tool to check internal broken links?
Technical SEO | | RikkiD225 -
Is it Panda?, how to deal with AP etc newswire articles
A site I have lost 30% of its traffic in June then another 10% in July, is it Panda? The site has 10's of thousands of AP or other syndicated articles on it, they are not there for SE benefits, they are categorized and relevant to the people who read them, the site gets half of its traffic from type ins/bookmarks. Should I nofollow the articles or rel="canonical" them? what can help...... Cheers
Technical SEO | | adamzski0 -
What are the best Free Press release sites to gain free links
Hi I am trying to find some good free press release sites that allow you to have a link with your press release to help drive traffic to your site but all the ones that i have found do not have links within them. The only ones i can find where you can have links in them are paid ones. Does anyone use press release sites to gain links to their sites and if so could you let me know which ones they are please and how important you feel they are.
Technical SEO | | ClaireH-1848860