Quickest way to deindex a large number of pages
-
Our site was recently hacked by spammers posting fake content and bringing down our servers, etc. After a few months, we finally figured out what was going on and fixed the issue. However, it turns out that Google has indexed 26K+ spammy pages and we've lost page rank and search engine rankings as a result.
What is the best and fastest way to get these pages out of Google's index?
-
Given that I'm sure you've removed these pages from your site, there will be no page to which to add a meta-noindex tag.
Disallowing these pages in robots.txt in no way signals to the search engines that they should be removed from the index, just that they should no longer be crawled. Given that they're already indexed, blocking in robots.txt would potentially save some "crawl budget" but wouldn't do anything to remove them from the index.
So submitting them to the URL Removal Tool would be by far the most effective, along with an explanation.
You'll also want to keep a very close watch on your penalty warnings within Webmaster Tools. If you get flagged, you'll want a complete history of the issue and the steps you've taken to address it in order to prepare a reinclusion request.
Lastly, don't forget to submit these same URLs to the Bing Webmaster Tools Block URLs tool. You may not get a massive amount of traffic from Bing, but there's no sense throwing it away, since you've already prepared the URL removal list anyway.
Hope that helps?
Paul
-
Yup. Just wanted to add as well that if these pages are in a particular directory, then you can deindex the entire directory in one command using the URL removal tool.
-
Disallow in robots.txt
Add a noindex meta tag to these pages
Request Google to remove the URLs from their index via WMT URL removal request
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Does the more number of ranking pages improve the website ranking?
Hi all, Let's say there is a website with 100 pages ad 95 pages are not ranking for any keywords; but the other 5 pages including homepage are ranking for some keywords. In this scenario, the 95% non-ranking pages does impact the other 5% pages rankings? Or every page holds their credibility in ranking irrespective of other pages in website? Thanks
Algorithm Updates | | vtmoz0 -
Numbers vs #'s For Blog Titles
For your blog post titles, is it "better" to use numbers or write them out? For example, 3 Things I love About People Answering My Constant Questions or Three Things I Love About People Answering My Constant Questions? I could see this being like the attorney/lawyer, ecommerce/e-commerce and therefore not a big deal. But, I also thought you should avoid using #'s in your url's. Any thoughts, Ruben
Algorithm Updates | | KempRugeLawGroup0 -
How much is Page Rank really worth?
We are in a position to purchase a domain, made of relevant keywords to our company with a current page ranking of 4 for their home page. However in looking at their analytics and other information they do not do well on significant keywords and have very low site traffic. In fact they do very, very poorly. With their high page ranking would it be relatively easy to conduct a successful SEO campaign on the domain if we were to take it over as our own and attempt to climb in the SERP's? I know Page Rank doesn't mean everything when it comes to your ranking, but 4 is relatively high in our field, so I don't really understand why they do so poorly when it comes to their actual rankings on key words.
Algorithm Updates | | absoauto0 -
Page rank of 2 with zero SEO and a 2 month old domain?
Hello, I helped work on a website for a friend. We used wordpress, a theme from elegant themes and wrote the content over 4 days. Zero back links, no seo, etc. Well, a little on page optimization and that's about it. Oh, we did ONE back link from a review site. The domain was brand new; never registered before. About a week after it started getting indexed, it jump from no page rank to a page rank of 1. About a week later, it jumped to a page rank of 2. Again, zero seo (aside from above stated). The site is: trade lines review dot com A page rank of 2 is nothing to write home about, but given the circumstances, how is this even possible? Thanks you!
Algorithm Updates | | Friedman0 -
Why would Google read different pages to rank for a keyword?
I have noticed a large drop in a number of keywords in the latest rankings report. I have checked the results on the 'Ranking History Graph' and it appears that Google is reading different pages for the specific keyword and therefore, giving large fluctuations in ranking dependant on the page from week to week. Why would this be happening?
Algorithm Updates | | Benjamin3790 -
Changing the # of results per page in Google search settings displays totally different results. Why is this?
Curious what's going on here. This is the first time I've seen this before. What's happening is this ... In Google, I search for "mobile apps orange county" and get a standard list of 10 results. I go to Google's search settings in the top right corner of the page (button is grey with a gear) to change the number of results per page from 10 to 50 (also did 100). When I go back to Google and search again for "mobile apps orange county" I get a much larger list but with completely different results. This time around the top 10-12 are dominated by the same website (ocregister.com) What's going on here that Google would now show different results? Why is this one website all of a sudden dominating the first 12 results? Thanks everyone! ByteLaunch
Algorithm Updates | | ByteLaunch0 -
Is my page footer the reason keyword rankings have dropped?
Hi all, One of my sites http://henstuff.com/ has seen some ranking drops for major keywords over the past few weeks and I was wondering if it was something to do with Penguin not taking a positive view of link-filled footers. It is something we are looking at phasing out but wanted to get the opinions of the SEOMOZ community. Thanks! Rob
Algorithm Updates | | RobertHill0 -
How did my Page Authority and Page Rank disappear?
I've hit a problem. A couple days ago my site's page authority was 51 and the PR was 3 and now they're 1 and 0 respectively. The developer did adjust some of the code in the site in the past couple days but that shouldn't have affected this. It was last cached by Google on the 5th. Can anyone offer some good advice? If it helps the page is www.duracard.com
Algorithm Updates | | Andrea.G0