Remove internal site SERPS from Google Index?
-
1. Internal Serp pages did not have a robots meta tag
2. As a result, client site has thousands (~4,400) of internal site SERP pages in the Google index.
3. We added the NoIndex, Follow attribute to all internal SERPS
4. We Disallowed: domain.com/internal-search-operator in Robots.txt
5. No new SERP pages are being indexed, but the other 4000 something that were already there are still in the index weeks later.
6. The pages are dynamically created and still work, so I can't use the Remove Content tool from google, because the pages don't 404.
Is there any way to get these pages out of the index besides just waiting and hoping google eventuall drops them?
Thanks
-
You can still submit a url removal request from GWT, because it checks for 1 of 3 things:
- 404 header response code
- NOINDEX meta tag
- Robots.txt disallow rule
So even if its not 404 Google will still do the removal.
-
You can create a formal request to Google using Webmaster Tools and tell them the URLs or list of URLs that you'd like removed from the index. Whether or not they actually remove them is a completely different story.
-
I should have explained it what I meant by SERPS better.
These pages are generated by doing a text search on the site. (Magento) So yes, they are product listings, but obviously most queries are different, so the dynamically created pages are all unique but useless.
Thanks for the idea about rel=canonical them back to the search page - I will look into that.
-
Note: By SERPs I'm assuming you're referring to Search Results within the site (e.g. a product listing) and not actual Google SERPs.
If so, it sounds like it could be a case for canonical. If the pages are all site.com/search.htm?searchterm=xxxx&page=y&rows=100 kind of thing you could canonical them all back down to search.htm.
If you're not familiar with canonical here's a YouMoz post that explains it pretty well:
http://www.seomoz.org/blog/complete-guide-to-rel-canonical-how-to-and-why-not
Based on my experience in the past the canonicalized pages will eventually 'disappear' from the index (not really, but Google doesn't display them anymore) in time. They would also eventually fall out already with what you've done in regards to noindex no follow etc., but I've found it takes longer.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
site speed
i use mid-quality pic and... but my site speed is low
On-Page Optimization | | zlbvasgabc
any suggestion?
my site is:
https://bandolini.ir/0 -
Is this still considered true about INTERNAL anchor text? "Penguin seems to be targeting overly aggressive anchor text (both internally and externally), especially from low-quality sources."
Recently I've heard a few people say now it's okay to be aggressive with internal linking. So a link from mydomain.com/news to mydomain/widgets can use spammy anchor text like "best green widgets in California" that are an obvious problem for links coming in from external site. Which is accurate?
On-Page Optimization | | corlin0 -
New site pages are indexed but not ranking for anything
I just built this site for a client http://primedraftarchitecture.com. It went live 3 weeks ago and the pages are getting indexed as per Webmaster Tools. But I'm not seeing it rank for anything. We're adding blog articles regularly and used Moz Local for local links and have been building links in other local directories (probably about 15 so far). Usually I get some rankings, although very low, after just a week or two for new sites. Does anyone see anything glaring that may be causing a problem?
On-Page Optimization | | DonaldS1 -
Redirect closing established site to another established site.
We have 2 ecommerce websites with duplicate product/category content that have been around for years. "Site A" since 2004 and "Site B" since 2011. "Site B" doesn't generate many sells and we want to close the site in fear that it may look spammy to google and since we don't want to upkeep the site. Couple questions:
On-Page Optimization | | Tuurbo
1. Is it possible that "Site B" has damaged "Site A" with google since they are so similar?
2. Can i 301 redirect all of "Site B" to "Site A" without hurting "Site A"?
3. If question 2 is ok, should i use the "Change of Address" tool in google webmaster tools to point "Site B" to "Site A"? Thanks!0 -
How to optimize Google Places listing?
I have a couple friends who need more traffic from their Google Places listing. They are in very niche businesses. One is a home remodeling contractor and one is a music teacher. Does anyone know some good services to help optimize their listings? I feel I've helped them out as much as I can by getting real reviews to their Google Places page. But I feel that someone who's had the experience in Google Places optimization can pick up on something I'm overlooking.
On-Page Optimization | | RicktheMarkt0 -
Why is my site not ranking?
Could you please help me understand what is wrong with this site: www.award-certificates.com It simply isn't ranking after about 3 years and I am not so sure what I can do to improve it.
On-Page Optimization | | nicolebd0 -
Internal Followed Links and Total Internal Links as 1
It is showing Internal Followed Links and Total Internal Links as 1 in OpenSiteExplorer Tool http://www.expresscasket.com/ http://www.opensiteexplorer.org/comparisons?site=www.expresscasket.com Not able to understand and identify the problem and fix it. But when i check in google webmasters tool, it is showing lots of internal links. Does it differ those internal links and your trace of internal links
On-Page Optimization | | expresscasket0 -
Nofollow on these internal links?
On an x-cart ecommerce website we have, seomoz has picked up a lot of duplicate content, based on URLs that are different, but are essentially the same page. These come from Fitlers, that allow a page to show only certain colours and styles, reordering page by price etc, and also the page 2, page 3 etc of a category: All the below are '4ft-bedding.html' http://www.textilesdirect.co.uk/store/4ft-Bedding.html?filter=1&value=Pink http://www.textilesdirect.co.uk/store/4ft-Bedding.html?page=2 http://www.textilesdirect.co.uk/store/4ft-Bedding.html?sort=price&view_all=Y I've now changed all these internal links to rel="nofollow" on the a tag. Is that the correct and best way to sort? I might be mistaken on when I did this update and when the last report was ran, but on the SEOmoz crawling report, it still has the above as problem pages. thanks!
On-Page Optimization | | rowleysit-2598920