Deny visitors by referrer in .htaccess to clean up spammy links?
-
I want to lead off by saying that I do not recommend trying this. My gut tells me that this is a bad idea, but I want to start a conversation about why.
Since penguin a few weeks ago, one of the most common topics of conversation in almost every SEO/Webmaster forum is "how to remove spammy links". As Ryan Kent pointed out, it is almost impossible to remove all of these links, as these webmasters and previous link builders rarely respond. This is particularly concerning given that he also points out that Google is very adamant that ALL of these links are removed.
After a handful of sleepless nights and some research, I found out that you can block traffic from specific referring sites using your.htaccess file. My thinking is that by blocking traffic from the domains with the spammy links, you could prevent Google from crawling from those sites to yours, thus indicating that you do not want to take credit for the link.
I think there are two parts to the conversation...
-
Would this work? Google would still see the link on the offending domain, but by blocking that domain are you preventing any strength or penalty associated with that domain from impacting your site?
-
If for whatever reason this would nto work, would a tweak in the algorithm by Google to allow this practice be beneficial to both Google and the SEO community? This would certainly save those of us tasked with cleaning up previous work by shoddy link builders a lot of time and allow us to focus on what Google wants in creating high quality sites.
Thoughts?
-
-
I've thought about this idea to get rid of bad links from specific referrers.
I agree with the comments Ian has made but when it is the homepage it's not always possible to follow those steps. Has anyone else had any experience/information?
-
Hi Ian,
Thanks for the response. I agree with you that this feels wrong and I don't recommend anyone try this (unless you have a site that you don't mind using as a guinea pig).
The problem is that, if this is your home page or a strong category page with many legitimate links, rankings, ect., it will be tough to abandon the page altogether.
To follow up about the original idea, I have done some additional research and found a few mentions, though none of them exceptionally credible, of the fact that the Googlebot does not pass referrer data to the server. Can anyone confirm?
-
Ooooh, that feels all wrong.
Seems to me .htaccess would block visitors that you may want. And while Google may obey the directive, they may also misinterpret a referrer-specific directive as cloaking.
If you want to get the same effect, here's what I'd do:
- Change the page to which the offending links point. Have it say "This page is gone, but you can get the information you want here" and make that a link to a new page.
- Set up your server to return a 410 code when folks visit that page.
- Set up a new page with the old page's content, so folks can click from the old to the new, but visiting bots and browsers get a 410 code and dump the page.
That will get Google to de-index the page in a hurry.
Another option: Simply add noindex, nofollow to the targeted page.
But I like the 410 option, because that should break the authority flow and has the best chance of giving Google what it wants, short of removing the link.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Do the links from top websites' forums boost in-terms of backlinks?
If we get any backlinks from discussions/forums of top websites like wordpress and joomla forums; do they count as valid and authority improving backlinks? I mean about the dofollow links.
White Hat / Black Hat SEO | | vtmoz1 -
Reorganizing Links
Hello Guys, Im Reorganizing my link building list in excel. I have tons of good links that I found in the last 3 months. What I want to ask is if there is a way to put those links in my excel list in a automatic way with the folowing fields: Domain Pagerank DA (from moz) Type Submission link Im doint it manual and is driving me crazy 😛 Tks in advance! Regards, MM
White Hat / Black Hat SEO | | CurriculosOnline0 -
Competition Link Metrics Analysis - Do you have any suggestions ?
My sub-pages are ranking well, but Homepage isn't ranking well for the keywords I'd like it to. It used to in the past. My site - njhypnotherapy.com used to rank (#2-5) 1st page in google for many keywords. In Sep/Oct I noticed my homepage ranking drop dramatically for the main keywords. Well, I made some foolish decisions and I'm trying to clean up the mess. Low quality links, duplicate content...etc I rewrote most of the content, removed unnecessary pages, removed as many low quality links, and used disavow for the rest. It's been a 2 Weeks now. I noticed a lot of improvements in my sub-pages. From #50 to #20. Not Bad. My homepage still isn't ranking. Any suggestions to improve? Btw, I've included my link metrics below if it helps 🙂 Thank You metricks.png
White Hat / Black Hat SEO | | njhypnotherapy0 -
Bad links showing up in opensiteexplorer
Hello Everybody,I've been working as an inhouse SEO for nearly a year and a half now and i've gotten some pretty great results. Two years ago our site was on the second page for the most important keywords in our niche and with a lot of work we've managed to get top 5 rankings for most keywords and even the number 1 spot for the most important keywords. I've been using opensite explorer to track backlinks and today i noticed that a lot of links we're discovered in the last week from websites that i did not recognize. Most url's won't even load properly because each "blogpost" has over a thousand comments. It took me a couple of tries to even find one that loaded properly and find the link to our website, and it was really there. There haven't been any drops in our rankings but i'm worried about a possible spam penalty. I know that i can use the disavow tool to at least disavow the links from these domains, but is that really the only thing i can do? Furthermore these are just the links that opensiteexplorer picked up, who knows how many more are out there.For any of you questioning wether or not i did this to myself, I'm no saint, but I'm definitely not stupid enough to buy these kinds of links. any help would be highly appreciated
White Hat / Black Hat SEO | | Laurensvda0 -
Cross linking websites of the same company, is it a good idea
As a user I think it is beneficial because those websites are segmented to answer to each customer needs, so I wonder if I should continue to do it or avoid it as much as possible if it damages rankings...
White Hat / Black Hat SEO | | mcany0 -
White hat link technique to banned domain
The question is: I have branddomain A (manually penalization by google, one year ago and after 4 consideration requests and more than 3/4 of links removed, stills banned) authority 42 And and new branddomain B (with fresh content created after penalization in the case of no recovery as it happen) authority 26 There are no links from A to B, both are now with same traffic but i want people that find me on domain A (partial penalized) to come to my new web brand. Both domains have same name, different extensión. So the question: Can i link with photo domain A to domain B, if i place nofollow and no ancor text on those linked photos. I want to have my traffic unified and i dont want to go against google guidelines
White Hat / Black Hat SEO | | maestrosonrisas0 -
How can I recover from an 'unnatrual' link penalty?
Hi I believe our site may have been penalised due to over optimised anchor text links. Our site is http://rollerbannerscheap.co.uk It seems we have been penalised for the key word 'Roller Banner' as the over optimised anchor text contains key word 'Roller Banner' or 'Roller Banners'. We dropped completely off page 1 for 'Roller Banner', how would I recover from this error?
White Hat / Black Hat SEO | | SO_UK0 -
Will Google perceive these as paid links? Thoughts?
Here's the challenge. I am doing some SEO triage work for a site which offers a legitimate business for sale listing service, which has a number of FOLLOWED link placements on news / newspaper sites - like this: http://www.spencercountyjournal.com/business-for-sale. (The "Business Broker" links & business search box are theirs.) The site has already been penalized heavily by Google, and just got pushed down again on May 8th, significantly (from what we see so far). Here's the question - is this the type of link that Google would perceive of as paid / passing page rank since it's followed vs. nofollowed? What would you advise if it were your site / client? From everything I've read, these backlinks, although perfectly legit, would likely be classified as paid / passing pagerank. But please tell me if I'm missing something. My advice has been to request that these links be nofollowed, but I am getting pretty strong resistance / lack of belief that these links in their current state (followed) could be harming them in any way. Would appreciate the input of the Moz community - if they won't believe me, and the majority here agrees about nofollowing, maybe they'll believe you. Thanks! BMT
White Hat / Black Hat SEO | | CliXelerate1