Serp tracking - legal?
-
Isn't this scraping Google results on a massive scale? Is this legal at all?
-
Well Google collects our data, why should you not collect theirs.
Put a button on your web site but dont make it easy to find, add some small print including your terms of use, and a disclamer that if search engines dont want their data scapped they can opt out by pressing the button, make them fill out a few forms, verify themsefls, make them wait 4 weeks then send them a no-reply email that does not address their concerns properly, so they have to go thought it all again.
-
You can get permission from Google, in which case it would not be illegal. ...But they don't just give permission away freely.
-
It's against the Google TOS. Source
That being said, there are many offenders. I'm not sure if Google lets any of the big marketing companies do it, or even give them API access in some shape or form, but I know for the smaller guys that it's frowned upon.
To my knowledge there has not been a case of Google pursuing action against someone who has scraped search results.
Scraping Google requires a proxy network because they do indeed block requests that appear like scraping bots. There are temporary bans and captcha tests put in place, but switching out an IP address works just fine until the test no longer appears.
When it comes down to it: no, not legal, but you also probably won't get in trouble for it.
(Would love to hear from official SEOmoz staff on this one...)
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Is there still any value in tracking keyword rankings for desktop?
Seeing as everything is graduating towards mobile first, is there any value in tracking desktop and smartphone keywords separately?
Keyword Research | | uniquedigital1 -
How many keywords do you recommend tracking?
I am working through thousands of organic keywords and would like to create a list of core keywords. I want the list to be small enough that we can really go after these keywords and track progress. I work for a B2B software company. I am thinking between 20-30 but I would love to hear any tips, opinions and recommendations! Thank you!
Keyword Research | | NikCall0 -
SERPs for English search terms in Google.es show NY and USA companies?
Hey Mozzers, I'm working for a client offering legal services in Spain for people from the UK. When I search 'legal services' in Google.es all the SERPs show sites from the US - mainly NY: https://www.google.es/search?source=hp&ei=tRbXWqzRDoSZsgGY6rmgCA&q=legal+services&oq=legal+services&gs_l=psy-ab.3..0l10.2835.4435.0.4512.15.10.0.0.0.0.297.1445.0j4j3.7.0....0...1c.1.64.psy-ab..8.7.1444.0..0i131k1j0i10k1.0.clK-EZ4vVWk There are lots of Spanish sites translated into English and showing sites in Google.es such as http://www.lsosm.org/ offer no value - it's a very weird SERP - any ideas why? Thanks Bush
Keyword Research | | Bush_JSM0 -
Any way to track rank of a URL for keyword BEFORE setting up in Rank Tracker?
Hello all I realize this data is probably impossible to get but thought I would take a chance and ask. Anyone know of a way to see ranking for a URL for a keyword before being setup in Rank Tracker? Would love to see how a URL moved up and down over time prior to tracking. I know its a long shot but if anyone knows its the Moz community! Have a great day people.
Keyword Research | | S2RSolutions0 -
Keyword tracking over time
Hi is there a recommended amount of keywords that I should try and optimise for on my site?
Keyword Research | | Hardley1111 -
Certain keyword not appearing in SERP but still in google index
I have a strange encounter since Sunday. One of my keyword not appearing in search. suddenly gone from pos 120+- to outer space. It is still in google index upon site: searches. My other keywords still appearing in google serps. Anybody encounter such scenario?
Keyword Research | | mavvy0 -
Can I Trace The Keywords From a PPC & SEO Campaign That Brought The individual To My Site Without Using a Call Tracking Service?
Hi All I was wondering if it is possible to trace the individual keywords/key-phrases that someone has used to get them to my pages/site and if they came in from PPC or SEO, preferably without having to use a call tracking service, code under number, or multi-telephone line system? Regards Nic
Keyword Research | | KDWeb0 -
3 monitoring tools are giving me the simular SERP ranking position but manual searching and traffic are telling me something different. What gives?
I have looked up SERP position in 4 different tools, 3 out of the 4 (Raven, SEO Moz, and Google webmaster tools) are telling me that the site is ranking in the 90s range. When I manually search for the term (when I'm logged out), the site lists on the 1st pages. I also see it listed as the #9 spot when I use SEO Books Rank Checker. Last month, Google webmaster says that the term got us 200 impressions. Has anyone seen this before? Thanks
Keyword Research | | TheOceanAgency0