Serp tracking - legal?
-
Isn't this scraping Google results on a massive scale? Is this legal at all?
-
Well Google collects our data, why should you not collect theirs.
Put a button on your web site but dont make it easy to find, add some small print including your terms of use, and a disclamer that if search engines dont want their data scapped they can opt out by pressing the button, make them fill out a few forms, verify themsefls, make them wait 4 weeks then send them a no-reply email that does not address their concerns properly, so they have to go thought it all again.
-
You can get permission from Google, in which case it would not be illegal. ...But they don't just give permission away freely.
-
It's against the Google TOS. Source
That being said, there are many offenders. I'm not sure if Google lets any of the big marketing companies do it, or even give them API access in some shape or form, but I know for the smaller guys that it's frowned upon.
To my knowledge there has not been a case of Google pursuing action against someone who has scraped search results.
Scraping Google requires a proxy network because they do indeed block requests that appear like scraping bots. There are temporary bans and captcha tests put in place, but switching out an IP address works just fine until the test no longer appears.
When it comes down to it: no, not legal, but you also probably won't get in trouble for it.
(Would love to hear from official SEOmoz staff on this one...)
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Any way to track rank of a URL for keyword BEFORE setting up in Rank Tracker?
Hello all I realize this data is probably impossible to get but thought I would take a chance and ask. Anyone know of a way to see ranking for a URL for a keyword before being setup in Rank Tracker? Would love to see how a URL moved up and down over time prior to tracking. I know its a long shot but if anyone knows its the Moz community! Have a great day people.
Keyword Research | | S2RSolutions0 -
Difference in Serp updates
I've notice that the Serp for some keywords are updated more frequently then others (or am I mistaken?) Do any of you have any data that might support that theory? what seems to be the longest periode it takes for a SERP to update for a certain keyword? Is there any rules of thumps on this matter?
Keyword Research | | Justian0 -
My Houzz Photo is Beating My Website in the SERPS
We were #3 for a keyword and now we are #4, oddly now Houzz.com is #2 and #3. The #3 slot is our photo on Houzz I optimized for our keyword. Should I dump the photo on Houzz? Since it is beating me on that keyword? The #2 slot is query for my keywords but we don't appear on that page. Thoughts?:) Thanks.
Keyword Research | | greenhornet770 -
Can I Trace The Keywords From a PPC & SEO Campaign That Brought The individual To My Site Without Using a Call Tracking Service?
Hi All I was wondering if it is possible to trace the individual keywords/key-phrases that someone has used to get them to my pages/site and if they came in from PPC or SEO, preferably without having to use a call tracking service, code under number, or multi-telephone line system? Regards Nic
Keyword Research | | KDWeb0 -
Inexpensive Daily SERP Report Service
I'm needing to get SERP reports on a daily basis for about 120 keywords. Can anyone recommend an inexpensive and accurate service for doing this? I need something more regular than once a week as many of our keywords are highly competitive. Thank you
Keyword Research | | jenadams0 -
My site fell off the serps for two keywords I tried to optimize the home page for
I was doing some keyword research about 45 days ago and stumbled across two keywords that I was ranking in the mid hundreds and decided I wanted to see if I could rank them. I went in and changed my title to my blog, and the description. Then about a week later I changed my mind and wanted to go for two other keywords so I changed it again. Then within a day or two, my site completely fell off the serps for those two key words that I changed the title to optimize for. None of my other rankings were effected for any of the other keywords, in fact most of my keywords have risen because of recent backlinking. I thought it was just a temporary google bounce because I was playing with my title of my blog or something, but after almost two months I am still nowhere to be found for words that I should easily at least be in the top 1000, especially because I was at about 150 by accident. Anyone have any ideas on what might have happened? Thanks.
Keyword Research | | FastLearner0 -
Google SERPS for similar Keywords?
I have website which is being listed for a keyword which is not in the site. It seems that google is using a Thesaurus to find words with similar meaning. Is this right? How could this be used for SEO purposes?
Keyword Research | | Tinderbox0