Can Googlebot go through Paywalls?
-
So my website has a paywall that allows users that are IP Authenticated to look at content where unauthorized users don't have access to but this is hurting my SEO (since googlebot doesn't go past the paywall either). Is there any way that I could ask google to go through and crawl the entire site?
-
I am not saying that cloaking is the answer, or that is why you can get aound the paywall in the the australian site, just interesting how it happens.
by cloaking, i mean if you let the google ip though, but not cache, you shyould get the indexing you want. Maybe you can show just a snippet on the page for those not authenticated so that you get you tile and a description indexed.
-
You see, the site is a HUGE content site that gains most of its keyword conversions through deep links on the site (links to the articles) so I fear that cloaking will simply allow people to have more access to the site without paying. Is there another way other than cloaking?
-
Yes you can, but thsast would be cloaking, maybe they allow clocking for this reason, i dont know.
i can show you a site that sheds some light.
The Australian Newspapper has a pay wall, to get around it, all you have to do is search fopr the headline in google and then click on the link you will get directy to the full article, does not work with bing though.
give it a try
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Search Analytics update in Google Webmasters Tools? Where can we find search queries bringing traffic to website?
I just got up and see Search Analytic's being updated today totally. Their is no option to see old reports. As Search Analytics only share 999 keywords.
Search Behavior | | csfarnsworth
Whats next now?
How can a webmaster finds all search queries bringing traffic to his website?
Any paid or free tool?
Google Analytic's > Acquisition > Search engine optimization > search queries will this area helps? Whole question revolves around. Any good tool that will help you find all the queries bringing traffic to my website?0 -
What should go in a "Link Juice" cocktail?
The office just got some of those fancy Google Partner bottles, and I want to fill them up with a tasty cocktail that is link juice themed. Any ideas on how to tie Google and/or SEO into a fancy cocktail?
Search Behavior | | WilliamKammer1 -
Google Analytics Segments - Can't find location
Hi all, I am trying to set up a Google Analytics segment with the location as 'Kurdistan'. I have tried all location groupings (city, region etc) and am unable to locate it. Anyone else not able to locate it? Or does anyone know why I can't? Thanks,
Search Behavior | | Davinia22
Davinia0 -
Can you track "Add to home screen" for ios devices?
I was curious to know if there was a way to track in analytics users "adding to home screen" on ios devices. With the new ios map not receiving so much love and google maps "web app" process getting more attention, I feel knowing this stat would help us decide if we really need a native app or not. Our customers don't normally return within the year and when they do its about 2-3 (normally on a desk top), To us it does not completely justify the idea of making a native app with the world being so app heavy now a days. Any thoughts are always appreciated.
Search Behavior | | sknott0 -
Google Places rankings go away, but organic rankings stay the same / get better?
Hello, I hope you all can help me out here with the information I could provide. Anyways, the past number of months I have had 1 of our clients rank extremely high organically and on Google places. For example: My client is a law firm so if you search “CLIENTS-TOWN Attorney” they would come up organically on the first page and if you were in that town and search “CLIENTS-TOWN Attorney” or even just “Attorney” they would also come up in the Google Places list. Now for some reason starting a week ago I noticed they have completely disappeared from Google Places. No changes have been done to their site and everything is the same as it was. Their organic searches are the same if not better than before. Do you guys have any clue as to why this happened and how I could possibly turn this around? Thanks for your help in advance!
Search Behavior | | WhiteHat120 -
Where can I find research into consumer behavior in URL input?
I have a hypothesis that the % of users that type URLs is decreasing. Instead I think users will be arriving at sites by clicking on links in emails, search and social. Where can I find data / research to back me up?
Search Behavior | | TomCritchlow0 -
Can we rank as a related search query on a competitor's brand keyword?
One of my clients wanted to know whether it's possible for him to rank as one of the related pages on Google for a brand name of a competitor. I honestly don't know whether it's possible so any ideas whether it's possible and if so, ideas on what can be done is greatly welcome. Thank you in advance. 🙂
Search Behavior | | als0070