Serp tracking - legal?
-
Isn't this scraping Google results on a massive scale? Is this legal at all?
-
Well Google collects our data, why should you not collect theirs.
Put a button on your web site but dont make it easy to find, add some small print including your terms of use, and a disclamer that if search engines dont want their data scapped they can opt out by pressing the button, make them fill out a few forms, verify themsefls, make them wait 4 weeks then send them a no-reply email that does not address their concerns properly, so they have to go thought it all again.
-
You can get permission from Google, in which case it would not be illegal. ...But they don't just give permission away freely.
-
It's against the Google TOS. Source
That being said, there are many offenders. I'm not sure if Google lets any of the big marketing companies do it, or even give them API access in some shape or form, but I know for the smaller guys that it's frowned upon.
To my knowledge there has not been a case of Google pursuing action against someone who has scraped search results.
Scraping Google requires a proxy network because they do indeed block requests that appear like scraping bots. There are temporary bans and captcha tests put in place, but switching out an IP address works just fine until the test no longer appears.
When it comes down to it: no, not legal, but you also probably won't get in trouble for it.
(Would love to hear from official SEOmoz staff on this one...)
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Snippet Tracking in MOZ
Where can I go in MOZ to view Google snippets that I am not currently tracking? I noticed a client is listed on a snippet but MOZ shows 0 snippets. I am also fairly confident given organic traffic data that this snippet has been listed for a while.
Keyword Research | | WebMarkets0 -
Is there still any value in tracking keyword rankings for desktop?
Seeing as everything is graduating towards mobile first, is there any value in tracking desktop and smartphone keywords separately?
Keyword Research | | uniquedigital1 -
No SERPs contains my keyword phrase
Hi! I have a question that is the best described by an concrete example: When I use Google UK and search for a keyword "wood floor" why the top 100 search results show pages for "wood flooring" instead? Is it because that keyword is simply more popular and pages are in general better optimized for "flooring"?
Keyword Research | | KAN-Malmo1 -
Site not visible on SERP
Hi all, I helped a client on launching his website for a new startup : www.blubridge.com. The site is not visible at all on Google, even on the startup name. I wonder why is that... There was a mistake while building the site, they used a dev site www2.blubridge.com which was indexed by Google. The 301 redirected has been done, however, there is still pages indexed by Google for the www2, and the www is still invisible on SERP... Does someone know how to solve that ?
Keyword Research | | 2MSens
Thanks ! 🙂 Best, Benoit0 -
Keyword tracking- Local
Silly question about Local ranking monitors. If I have a local client in Pheonix, AZ and I want to track rankings for keywords. Is it best to monitor city+keyword or just keyword? I have ran tests with multiple clients and locations, and cannot ascertain the difference- as far as rankings go. I appreciate all input.
Keyword Research | | TammyWood1 -
Certain keyword not appearing in SERP but still in google index
I have a strange encounter since Sunday. One of my keyword not appearing in search. suddenly gone from pos 120+- to outer space. It is still in google index upon site: searches. My other keywords still appearing in google serps. Anybody encounter such scenario?
Keyword Research | | mavvy0 -
Should my Google rank be different to actual SERP results?
In my reports this week I was delighted to see "emergency power" at #8 for http://apexgenerators.co.uk/emergency-power/ but then today seems to have jumped to page 4 in SERPS? Can anyone offer any advice? Thanks, Laura
Keyword Research | | lauratagdigital0 -
Google Keyword tool data + No. 1 Serp rank =/= to taffic on landing page
So a keyword we are targeting "painted bedroom furniture" google keyword tool says gets 480 exact local searches (and 880 broad), and in the same local google we have ranked 1st for months (and currently we are 2nd and 3rd too), but looking at the google analytics that landing page has only gotten 78 unique page views from searches and only 21 from "painted bedroom furniture" . (the 2nd link gets 12 page views and the 3rd gets none, from that keyword) Now for me that does not make sense! For other keyword which we rank No.1 the keyword data and analytics generally match/make sense. Is there something I'm missing?
Keyword Research | | eunaneunan0