What should be noindexed on a Wordpress blog?
-
I know this can be a "it depends" answer so I'll try to explain. Qualifications on your answers would be great.
I use the Wordpress architecture for myself and clients on sites and blogs. Almost every business site we create has a blog and I'm always working to improve results on them. My strategy has been the following:
- Categories: General, main content types, general keywords. Index, follow
- Tags: Very specific, post specific, may only be used once for one post.
My categories have descriptions that are displayed on the category pages with excerpts. Tags rarely have a description but are displayed with excerpts on the page.
My idea has been to index the categories to crawl the content and they have unique content by showing the category description. Tags shouldn't be archived because they may be all over the place and may have only 1 post with no tag description. I'm trying to reduce duplicate content but I don't want to limit results for my clients and myself.
Should I set tags to noindex, follow or should I have them indexed?
The only thing I'm thinking with having the tags indexed is that I may be able to get additional traffic through the more specific tags (i.e. tag = meta tags, category = SEO).
-
Thank you for your update!
I agree with your tests and your solution is probably the best also from a user experience point of view: giving a nice description and useful links on category pages should improve the number of pageviews / time spent on site.
-
Thanks for replying and giving us a status update. It's always great to know what happens with the advice so we can all learn. Glad to hear you're getting such good results!
-
For anyone that's interested in results, I've taken my blog that had everything nonindex, follow (categories and tags) and set categories to index, follow and tags to noindex, follow. I've seen about a 20% increase in traffic (not all due to this), my category pages are indexed and cached, and they're being used as entrance pages in some cases. Note that I did add good descriptions for these and I'm displaying them on the category page.
I also took another blog that had everything index, follow and changed it to the same that I just described. They have seen a reduction in their bounce rate and an increase in traffic.
On the same subject, I've also changed my paginated pages (archive pages 2+) to noindex, follow. They pretty much look the same as page 1 and they're pretty low quality landing pages. I've just added it but I noticed many recommendations to do it, Yoast.com does, and I see it on other big sites.
-
I think you may have hit on some key points here that kind of work into my initial thoughts:
- Amount of high quality content
- Highly organized category/tag structure
I believe that if you have these two key attributes for your site, having your categories and tags indexed would be very useful. In myself and the clients that I work with, I feel like the categories have plenty of high quality content but the tags are hit or miss.
From hearing the discussions of others and my own experience, I feel like having the categories indexed and the tags noindex would work out well but I think it's worth a shot to index my tags and see what happens. I'm sure Google and SEOmoz will let me know if I have some big dupliate content issues and I can easily monitor the traffic to these pages.
The interesting statistic for the tag pages will be the bounce rate...
-
Ryan, I have to say that you do bring a great point here and kudos to you on that. I think I may have jumped the gun a little bit in my initial response without considering the exact situation.
If you look at site like Compendium, along with Smashing Magazine and Noupe, they use this same method. Although, they a lot of high quality content, get tons of traffic and their category and tag structure are highly organized. This does work well, but from my experience, if you don't have all of those keys in place then you won't rank well for those categories in search results. On the other hand, here at SEOmoz, they do not have their tags and categories indexed, but they have the organization, traffic and content. Although, the only difference is that SEOmoz isn't using URL friendly slugs for these categories...
Maybe the better suggestion to Jared should be, try it both ways. Use noindex, follow at first for a month or so, then switch to indexing them. Test each method and see what results you get for your blog. It won't hurt your site in any way. I would just suggest that if you are going to index categories that you make sure you have thought through your level of organization.
-
I really wonder about this assumption that Google will ding a blog for duplicate content based on category and tag pages. As Jared pointed out typically those pages only show snippets. I don't know one way or the other, but I'm inclined to think Google is smart enough not to respond with a penalty. TKIG and Dan, I'm not disagreeing with you because I have no data to support one opinion or the other, but I'm very curious what you are basing your opinions on. FYI, this approach is nearly identical to the strategy Compendium uses to generate long tail search landing pages and they claim to have no duplicate content issues.
-
The Wordpress SEO plugin by Yoast doesn't no index both by default and I would give him more authority on SEO than the all in one SEO pack. Maybe it's a "depends on the situation"?
I guess it sounds like noindex, follow tag pages there is a consensus but I'm surprised at everyone saying noindex, follow on the category pages. With providing a category description and only displaying an excerpt from the posts, I feel like you have a good page that should be indexed.
I guess that brings up a good question on the measure of duplicate content. Is seomoz pro crawler a good enough measure of duplicate content or is Google super sensitive?
-
The all in one seo pack plugin for wordpress automatically sets your category and tags pages to noindex, so that's a good clue right there. I never indesx them for duplicate content issues. I also don't index the date archives either. Of course I never link to them either or really use categories or tags, so it's never been much of an issue for me.
-
Tags and categories in Wordpress should always be set to noindex, follow. Why? Usually by allowing the search engines to index WordPress tags and categories you create duplicate content. If you have a lot of tags and categories you also create a numerous amount of non-signifcant search results for your domain.
EDIT: You are not hindering search results for potential visitors by not indexing your tags and categories. You are simply keeping them from being cached and indexed in search results. For SEO purposes it is much better to noindex, follow these pages.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Control indexed content on Wordpress hosted blog...
I have a client with a blog setup on their domain (example: blog.clientwebsite.com) and even though it loads at that subdomain it's actually a Wordpress-hosted blog. If I attempt to add a plugin like Yoast SEO, I get the attached error message. Their technical team says this is a brick wall for them and they don't want to change how the blog is hosted. So my question is... on a subdomain blog like this... if I can't control what is in the sitemap with a plugin and can't manually add a sitemap because the content is being pulled from a Wordpress-hosted install, what can I do to control what is in the index? I can't add an SEO plugin... I can't add a custom sitemap... I can't add a robots.txt file... The blog is setup with domain mapping so the content isn't actually there. What can I do to avoid tags, categories, author pages, archive pages and other useless content ending up in the search engines? 7Zo93b2.png
Technical SEO | | ShawnW0 -
Bulk redirection of blogs
Hi all, we're going to changing the url structure of our website. Moving from: /news-and-views/blog/thisistheblogpost to /blog/thisistheblogpost (ie removing the /news-and-views/ portion of the url). There's approximately 300 posts. I have 2 questions - will this have an impact on domain wide authority? and is bulk 301 redirects the best solution? The blogs themselves don't get a huge amount of traffic but we just want to make sure we don't do something that will be penalized by search engines.
Technical SEO | | francisclark2 -
How do you delete an admin user in wordpress that wont delete
I hired an indian company to do some work on three sites that I own. I used a freelancing platform and they have been banned and now when i check in my wordpress sites, the admin user will not delete. Everytime i try and delete them it comes back. I change the password and the email address, but when i check a couple of hours later it comes back again, giving them full control over my sites which they are playing around with. any help would be great. I have tried going into the cpanel but it still will not delete. my hosting company has tried to delete them but it is not working
Technical SEO | | in2townpublicrelations0 -
Website not ranking but the blog is!
I am hoping someone might be able to help me, I am doing some work on a website. A new version of the site was recently launched and since then rankings have plummeted and the new blog pages are ranking better! When the new version of the site went live, the domain changed to the non-www version, plus an incorrect robots.txt file and we have never really been able to fully recover (both of these things were beyond my control!). The robots.txt file was corrected and some of the external links links changed to the non-www but there is a 301 redirect in place so changing to the non-www shouldn't have been the reason to drop the site out completely. Before the launch of the new website, the site was ranking on the front page of Google for a lot of relevant keywords such as outdoor blinds, outdoor blinds Perth, cafe blinds, patio blinds, etc. The quality of the links is pretty bad and I am attempting to remove them before doing a disavow of all the really bad quality links but unless we were really unlucky I don't think it's the links right now that are causing the problem. I have ran the site through numerous crawl tests, checked the robots.txt, there are no messages in GWMT, the pages are indexed but I have a feeling there is something wrong with the site that is stopping this site from ranking well. If anyone could give me any insights I would be really grateful. I know the site could be better structured from a keyword/ structure perspective but the site was ranking fine!
Technical SEO | | Karen_Dauncey0 -
Wanted to shift a blog from sub domain to sub directory but...
Ok, I have a client who has their blog up and running on blog.website.com and they are planning to shift the blog to sub-directory www.websire.com/blog. The only problem is that the blog and website are hosted on two different servers so is there any way we can shift the blog to sub directory without shifting the blog to the similar server?
Technical SEO | | MoosaHemani0 -
Noindex nofollow issue
Hi, For some reason 2 pages on my website, time to time get noindex nofollow tags they disappear from search engine, i have to log in my thesis wp theme and uncheck box for "noindex" "nofollow" and them update, in couple days my website is back up. here is screen shot http://screencast.com/t/A6V6tIr2Cb6 Is that something in thesis theme that cause the problem? even though i unchecked the box and updated but its still stays checked http://screencast.com/t/TnjDcYfsH4sq appreciated for your help!
Technical SEO | | tonyklu0 -
Converting Old Web Site to Wordpress
I have a website I would like to update and convert to WordPress. My site rates very highly for the keywords I care about and I have a lot of domain authority and page authority that I don't want to lose. I'm concerned about the switch as I don't want to hurt my Google positioning, but would like the benefits of a WordPress site. Any assistance and advice is appreciated.
Technical SEO | | greg.baumgartner0 -
If I redirect my WordPress blog to my main site, will it help my main site's SEO?
I have separate sites for my blog and main website. I'd like to link them in a way that enables the blog to boost my main site's SEO. Is there an easy way to do this? Thanks in advance for any advice...
Technical SEO | | matt-145670