Content available only on log-in/ sign up - how to optimise?
-
Hi Mozzers.
I'm working on a dev brief for a site with no search visibility at all. You have to log in (well, sign up) to the site (via Facebook) to get any content. Usability issues of this aside, I am wondering what are the possible solutions there are to getting content indexed.
I feel that there are two options:
1. Pinterest-style: this gives the user some visibility of the content on the site before presenting you with a log in overlay. I assume this also allows search engines to cache the content and follow the links.
2. Duplicate HTTP and HTTPS sites. I'm not sure if this is possible in terms of falling foul of the "showing one thing to search engines and another thing to users" guidelines. In my mind, you would block robots from the HTTPS site (and show it to the users where log in etc is required) but URLs would canonicalise to the HTTP version of the page, which you wouldn't present to the users, but would show to the search engines. The actual content on the pages would be the same.
I wonder if anyone knows any example of large(ish) websites which does this well, or any options I haven't considered here.
Many thanks.
-
Thanks Justin and Bruce,
I think I will try and push for the "limited view until signed in" solution. The HTTP/ HTTPS one just feels a bit too much like a dirty hack that will end up hurting in some way, at some point!
Thanks for your responses.
-
Could you model your approach after other subscription sites? Take, for example, the online version of the Wall Street Journal: http://online.wsj.com/home-page. They present enough content in preview mode to be relevant to both users and Google. You know from the blurb what the story is basically about.
Once someone logs in, they get the rest of the content. But I don't think they get a separate URL.
I wouldn't do the duplicate HTTP/HTTPS approach. In the future, you may want the whole site to be HTTPS, so you'd have to face this issue again.
-
Hi Pascale
If the content is visible to the "not signed in end user" then it is visible to google. If it is not, it is not visible to Google.
I might have this wrong, but it would appear that you have a pinterest style site and that you want further content only be visible when the user is logged in? This then would be a site settings and not crawl issue. This is a trgger on the website server to require the guest to log in after XYZ. The whole site is opened to crawl but you set these parameters for the guest user in your sites back office
I think it is a case of either or, not both
Bruce
edit typo
-
Hi Bruce,
Thanks for your response. I agree - that the whole point of login is to to stop unwanted visitors seeing private content. For the most part.
This is not a log in in that same way - it's more of a "sign up" so like Pinterest or DueDil - you have to sign up in order to view the content.
I hope that makes more sense and I will modify the title (if I can) to make it clearer.
Thanks
-
If the content is for Logged in Users, why would you want it crawled?
Google crawls sites open to the public, therefore if the site is behind a login, then google will not crawl it. If google crawls it, then the content will show up in search results, hence making the login process redundant.
If you want to offer subscription content, then this is a marketing issue, not a crawl issue. You will need to have open content available that the viewing will perhaps then make a call whether to subscribe to your site or not.
Remember login is a cloaking devise, designed to stop unwanted visitors viewing the content, hence why google will view this in the same way.
Hope that helps
Bruce
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Duplicate Content from Wordpress Template
Hi Wondering if anyone can help, my site has flagged up with duplicate content on almost every page, i think this is because the person who set up the site created a lot of template pages which are using the same code but have slightly different features on. How would I go about resolving this? Would I need to recode every template page they have created?
Technical SEO | | Alix_SEO0 -
Old / passed productpages
Hi, what shall i do with the old / passed productpages? The situation right now is, that all product url's are being saved wich cost me a lot of duplicate content and lot's of url's being indexed and crawled and no use to the website at all. As there are affiliate links to those passed url's i want to give them a 301 to the category page wicht fitst best for a time of period? Do you think that's the best solution? And what time of period shall ik give those 301 redirects? Thnx and grtz, Leonie
Technical SEO | | Leonie-Kramer0 -
Duplicate page content
Hello, My site is being checked for errors by the PRO dashboard thing you get here and some odd duplicate content errors have appeared. Every page has a duplicate because you can see the page and the page/~username so... www.short-hairstyles.com is the same as www.short-hairstyles.com/~wwwshor I don't know if this is a problem or how the crawler found this (i'm sure I have never linked to it). But I'd like to know how to prevent it in case it is a problem if anyone knows please? Ian
Technical SEO | | jwdl0 -
Duplicate Content
The crawl shows a lot of duplicate content on my site. Most of the urls its showing are categories and tags (wordpress). so what does this mean exactly? categories is too much like other categories? And how do i go about fixing this the best way. thanks
Technical SEO | | vansy0 -
Problem with duplicate content
Hi, My problem is this: SEOmoz tells me I have duplicate content because it is picking up my index page in three different ways: http://www.web-writer-articles.co.uk http://www.web-writer-articles.co.uk/ and http://www.web-writer-articles.co.uk/index.php Can someone give me some advice as to how I can deal with this issue? thank you for your time, louandel15
Technical SEO | | louandel150 -
Do trailing / in URLs matter?
I was wondering if search engines see duplicate content on two different URLs if the content is available via www.xyz.com/services or www.xyz,com/services/
Technical SEO | | TheOceanAgency0 -
E-Commerce Duplicate Content
Hello all We have an e-commerce website with approximately 3,000 products. Many of the products are displayed in multiple categories which in turn generates a different URL! 😞 Accross the entire site I have noticed that the product pages are always outranked by competitors who have lower page authority, domain authority, total links etc etc. I am convinced this is down to duplicate content issues. I understand there is no direct penalty but how would this affect our rankings? Is page rank split between all the duplicates, which in turn lowers it's ranking potential? I have looked for a way to identify duplicate content using Google analytics but i've been unsuccessful. If the duplicate content is the issue and page rank is divided am i best using canonical or 301 redirects? Sorry if this is an obvious question but If i'm correct we could see a huge improvement in rankings accross the board. Wow! Cheers Todd
Technical SEO | | toddyC0