Serp tracking - legal?
-
Isn't this scraping Google results on a massive scale? Is this legal at all?
-
Well Google collects our data, why should you not collect theirs.
Put a button on your web site but dont make it easy to find, add some small print including your terms of use, and a disclamer that if search engines dont want their data scapped they can opt out by pressing the button, make them fill out a few forms, verify themsefls, make them wait 4 weeks then send them a no-reply email that does not address their concerns properly, so they have to go thought it all again.
-
You can get permission from Google, in which case it would not be illegal. ...But they don't just give permission away freely.
-
It's against the Google TOS. Source
That being said, there are many offenders. I'm not sure if Google lets any of the big marketing companies do it, or even give them API access in some shape or form, but I know for the smaller guys that it's frowned upon.
To my knowledge there has not been a case of Google pursuing action against someone who has scraped search results.
Scraping Google requires a proxy network because they do indeed block requests that appear like scraping bots. There are temporary bans and captcha tests put in place, but switching out an IP address works just fine until the test no longer appears.
When it comes down to it: no, not legal, but you also probably won't get in trouble for it.
(Would love to hear from official SEOmoz staff on this one...)
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Is there still any value in tracking keyword rankings for desktop?
Seeing as everything is graduating towards mobile first, is there any value in tracking desktop and smartphone keywords separately?
Keyword Research | | uniquedigital1 -
SERPs for English search terms in Google.es show NY and USA companies?
Hey Mozzers, I'm working for a client offering legal services in Spain for people from the UK. When I search 'legal services' in Google.es all the SERPs show sites from the US - mainly NY: https://www.google.es/search?source=hp&ei=tRbXWqzRDoSZsgGY6rmgCA&q=legal+services&oq=legal+services&gs_l=psy-ab.3..0l10.2835.4435.0.4512.15.10.0.0.0.0.297.1445.0j4j3.7.0....0...1c.1.64.psy-ab..8.7.1444.0..0i131k1j0i10k1.0.clK-EZ4vVWk There are lots of Spanish sites translated into English and showing sites in Google.es such as http://www.lsosm.org/ offer no value - it's a very weird SERP - any ideas why? Thanks Bush
Keyword Research | | Bush_JSM0 -
Keyword tracking for all keywords that contain a specific keyword
Hello, Is it possible to see keyword performance for all keywords that contain a specific phrase? Then see which landing page each keyword is most likely associated to? Thanks!
Keyword Research | | STP_SEO0 -
Difference in Serp updates
I've notice that the Serp for some keywords are updated more frequently then others (or am I mistaken?) Do any of you have any data that might support that theory? what seems to be the longest periode it takes for a SERP to update for a certain keyword? Is there any rules of thumps on this matter?
Keyword Research | | Justian0 -
Is there any way to track search volume for a particular keyword on a day-to-day basis?
My boss has asked me to track the number of searches for a keyword (a particular company's name) on a daily basis this week to see how the volume fluctuates from day to day. Is this even possible? I should note that his request does not involve an active SEO or AdWords campaign. In fact, the company my boss is interested in doesn't even have a website at the moment. Thanks in advance – either for helping me confirm that it's impossible to track keyword search volume on a day-to-day basis, or for showing me the magical way to actually do this.
Keyword Research | | matt-145670 -
Should my Google rank be different to actual SERP results?
In my reports this week I was delighted to see "emergency power" at #8 for http://apexgenerators.co.uk/emergency-power/ but then today seems to have jumped to page 4 in SERPS? Can anyone offer any advice? Thanks, Laura
Keyword Research | | lauratagdigital0 -
Inexpensive Daily SERP Report Service
I'm needing to get SERP reports on a daily basis for about 120 keywords. Can anyone recommend an inexpensive and accurate service for doing this? I need something more regular than once a week as many of our keywords are highly competitive. Thank you
Keyword Research | | jenadams0 -
3 monitoring tools are giving me the simular SERP ranking position but manual searching and traffic are telling me something different. What gives?
I have looked up SERP position in 4 different tools, 3 out of the 4 (Raven, SEO Moz, and Google webmaster tools) are telling me that the site is ranking in the 90s range. When I manually search for the term (when I'm logged out), the site lists on the 1st pages. I also see it listed as the #9 spot when I use SEO Books Rank Checker. Last month, Google webmaster says that the term got us 200 impressions. Has anyone seen this before? Thanks
Keyword Research | | TheOceanAgency0