An immediate and long-term plan for expired Events?
-
Hello all, I've spent the past day scouring guides and walkthroughs and advice and Q&As regarding this (including on here), and while I'm pretty confident in my approach to this query, I wanted to crowd source some advice in case I might be way off base. I'll start by saying that Technical SEO is arguably my weakest area, so please bear with me. Anyhoozles, onto the question (and advance apologies for being vague):
PROBLEM
I'm working on a website that, in part, works with providers of a service to open their own programs/centers. Most programs tend to run their own events, which leads to an influx of Event pages, almost all of which are indexed. At my last count, there were approximately 800 indexed Event pages.
The problem? Almost all of these have expired, leading to a little bit of index bloat.
THINGS TO CONSIDER
-
A spot check revealed that traffic for each Event occurs for about a two-to-four week period then disappears completely once the Event expires.
-
About half of these indexed Event pages redirect to a new page. So the indexed URL will be /events/name-of-event but will redirect to /state/city/events/name-of-event.
QUESTIONS I'M ASKING
-
How do we address all these old events that provide no real value to the user?
-
What should a future process look like to prevent this from happening?
MY SOLUTION
Step 1: Add a noindex to each of the currently-expired Event pages. Since some of these pages have link equity (one event had 8 unique links pointing to it), I don't want to just 404 all of them, and redirecting them doesn't seem like a good idea since one of the goals is to reduce the number of indexed pages that provide no value to users.
Step 2: Remove all of the expired Event pages from the Sitemap and resubmit. This is an ongoing process due to a variety of factors, so we'd wrap this up into a complete sitemap overhaul for the client. We would also be removing the Events from the website so there are not internal links pointing to them.
Step 3: Write a rule (well, have their developers write a rule) that automatically adds noindex to each Event page once it's expired.
Step 4: Wait for Google to re-crawl the site and hopefully remove the expired Events from its index.
Thoughts? I feel like this is the simplest way to get things done quickly while preventing future expired events from being indexed. All of this is part of a bigger project involving the overhaul of the way Events are linked to on the website (since we wouldn't be 404ing them, I would simply suggest that they be removed entirely from all navigation), but ultimately, automating the process once we get this concern cleaned up is the direction I want to go.
Thanks. Eager to hear all your thoughts.
-
-
Great! Happy to help
-
Hi Robin, thanks for taking the time to write out such detailed and helpful responses. I think I've decided to go with the approach you're outlining above:
For those that are already indexed:
- Change the 302s to 301s (all of the expired events that are indexed are 302s for some reason)
- 404/410 those that don't have any equity
- Create a custom 404 page
- Wait for them to drop out of index
For future Expired Events
- Wait about one month, then apply a 404 with custom page
- Redirect any that have backlinks
It'll require a little more work, but it is, I think, the right thing to do in this very bizarre situation.
-
To be honest it sounds like you already have your plan.
One thing I'd bear in mind is a crawl you run of your site won't line up with the pages that Google is visiting. For one thing, the tools we use try to approximate Google but won't be exactly the same. More importantly, once Google knows of a page it'll come back and check on it to see if the content changed, the only way you'll see that is by looking at your log files.
Yea there's no point making it "noindex, follow", it's not that Google doesn't know what to do with the page, it's just that it's attitude to the page will change over time.
In terms of the large number of redirects, there is some risk that Google could see the large number of 301s as spammy but, to be honest, I've never directly seen evidence of that being a problem. The way I see it, the choice is fairly similar you could
-
404/410 that's the way the internet is meant to work when something no longer exists but you'll lose link equity.
-
301 to preserve link equity but you're essentially misusing the status code.
-
Do a monthly check, 301 any expired pages with discovered backlinks, 410 the rest. This is best of both worlds but is much more time consuming.
I think you can probably get away with the 301s but it all comes down to your appetite for risk.
Good luck!
-
-
Thanks for the detailed response and the suggestion. The problem is, I think, a little more complicated than that. So there are two main concerns:
**1. What do we do with the current expired pages? **
So one thing that happens is that the event pages are effectively orphaned once the event has passed. All trace of them is removed from the website, and if my previous crawl is to be believed, they don't get crawled. Right now, the majority of these expired and indexed event pages are actually 302 redirects. So we're getting a temporary redirect to a page that is expired. Hardly a good user experience.
I do know that since it's a 302, Google is thinking "Hey, the page is coming back, so we're going to index that but send visitors to the new pages." This would be why the 302 URL is indexed. Am I correct in assuming that updating all of these to a 301 would result in the URL ultimately being removed? If so, then I think the best course of action would simply be to 301 redirect all of the current 302 URLs, as well as the actual expired event pages to the relevant event host / program pages.
Also, I did not know that _noindex _was treated as noindex, nofollow after awhile. Would it be beneficial to make them _noindex, follow, _or would that still be a redundancy that Google will ultimately ignore? I also do not think a pop-up is the way to go. These are very short-term events, so the issue is _less _a user experience and more a means of preventing them from clogging up the index. Also it would just be more work for the client and I'm trying to keep things as simple as possible.
**2. What do we do with the future expired pages so they don't end up getting indexed? **
This is probably a more pressing question. So the main concern is we want the Event pages to be indexed while they're live then ultimately removed after they've expired. I'm okay with this process: write a script that auto-redirects and remove all internal links from the website and just simply be patient. My main concern is just having way too many 301 redirects in place.
I'm hoping that the 301 in place combined with the complete orphaning of the page will mean they simply won't be crawled and eventually dropped from the index and thus not accessible to Google or users, but I'm still a little wary. Thoughts? Is there any room for adding anything to robots.txt?
Thanks again for your help. It is much appreciated.
-
Hi there, thanks for posting!
I think my main question here is around the decision to note 404 or 301 these pages. I totally understand that you want to reduce the number of indexed pages which aren't providing value but also don't want to lose equity. I know you mention you're not super technical so I'm going to break down how I expect link equity to be passed around a site and therefore how I expect each of these techniques to impact the page.
Equity is passed from page to page via links so these events pages will pass equity to other pages on yo by Google having a record of the page and the equity of that page, then distributing that equity through links it can follow. Google representatives have said recently that, after a period of time, noindex pages are treated as noindex nofollow at which point we can't rely on equity being passed along any of the outbound links from these pages.
-
noindex: removes the page from the index, after a period of time no equity will be passed from the noindexed page. Initially Google will continue to crawl the page but that will reduce over time.
-
404: the page doesn't exist so will be removed from the index after a period of time. No equity will be passed from the page. Google should stop crawling the page fairly quickly.
-
410: more definitive than 404. Page should drop out of the index more quickly. No equity will be passed from the page. Google should should stop crawling the page fairly quickly.
-
301: we're telling Google that this address is no good any more and it should instead look at a different address. Again, the redirected page should drop out of the index and some proportion of the redirected page's equity should be transferred to the target page. Google should stop crawling the page more quickly than noindexed version but probably not as quickly as the 404/410.
Based on all that I don't think noindex is necessarily your best option. You'll still have a bunch of defunct pages, which Google may still spend time crawling, and you can't rely on them passing equity.
A custom 404/410 page explaining to users that the event has passed is probably a pretty good user experience and would be the most expected behaviour for a situation where content isn't there any more, but won't help you with equity.
I think what you could do is automatically 301 redirect to a relevant category page with a pop-up message that explains to users what's happened. Doesn't sound like you expect the event pages to pop in and out of existence so the logic should be fairly simple.
Hope that helps!
-
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Dealing with Expired & Reoccurring Content At Scale
Hello, I have a question concerning maintenance & pruning content with a large site that has a ton of pages that are either expired OR reoccurring. Firstly, there's ~ 12,000 pages on the site. They have large sections of the site that have individual landing pages for time-sensitive content, such as promotions and shows. They have TONS of shows every day, so the # of page to manage keeps exponentially increasing. Show URLs: I'm auditing the show URLs and looking at pages that have backlinks. With those, I am redirecting to the main show pages.
Technical SEO | | triveraseo
-However, there are significant # of show URLs that are from a few years ago (2012, 2013, 2014, 2015) that DON'T get traffic or have any backlinks (or ranking keywords). Can I delete these pages entirely from the site, or should I go through the process of 410-ing them (and then deleting? or ...?)Can you let 410's sit?)? They are in the XML sitemap right now, so they get crawled, but are essentially useless, and I want to cut off the dead weight, but I'm worried about deleting a large # of pages from the site at once. For show URLs that are still obsolete, but rank well in terms of kewyords and get some traffic...is there any recommended option? Should I bother adding them to a past shows archive section or not since they are bringing in a LITTLE traffic? Or ax them since it's such a small amount of traffic compared to what they get from the main pages. There are URLs that are orphaned and obsolete right now, but will reoccur. For instance, when an artist performs, they get their own landing page, they may acquire some backlinks and rank, but then that artist doesn't come back for a few months. The page just sits there, orphaned and in the XML sitemap. However, regardless of back-links/keywords, the page will come back eventually. Is there any recommended way to maintain this kind of situation? Again, there are a LOT of URLs in this same boat. Promotional URLs: I'm going about the same process for promotions and thankfully, the scale of hte issue is much less. However, same question as above...they have some promotional URLs, like NYE Special Menu landing pages or Lent-Specials, etc, for each of their restaurants. These pages are only valid for a short amount of time each year, and otherwise, are obsolete. I want to reuse the pages each year, though, but don't want them to just sit there in the XML sitemap. Is there ever an instance where I might want to 302 redirect them, and then remove the 302 for the short amount of time they are valid? I'm not AS concerned about the recycled promotional URLs. There are much fewer URLs in this category. However, as you can probably tell, this large site has this problem of reoccurring content throughout, and I'd like to get a plan in place to clean it up and then create rules to maintain. Promotional URLs that reoccur are smaller, so if they are orphaned, not the end of the world, but there are thousands of show URLs with this issue, so I really need to determine the best play here. Any help is MUCH appreciated!0 -
Do long UTM codes hurt SEO?
Since most UTM codes/URLs are longer than 70ish characters, is this hurting my SEO? If it is, how can I solve the problem while still using a UTM code? Thanks!
Technical SEO | | Cassie_Ransom0 -
Lower Level Pages Being Ranked for Key Terms
Good Afternoon We've been having problems with a site for a little while now. It had a penalty (partial link) a few years ago and never really recovered back to it's full potential despite the fact that the penalty was eventually removed and we've since changed the domain completely as well as moving over to https and left behind / disavowed bad links. In the Moz ranking stats now, I'm seeing that some of our lower level pages are ranking for core terms and the erratic nature of the ranking graph seems to indicate that Google is confused and not knowing what page to pull. For example, the top level page would be Hotel in Spain but the page that is ranking for that term is one of the individual hotel information (lower level) pages lets say the Holiday Inn . The lower level page has info on the individual property but also makes reference to it being a "Cheap Hotel In Spain" My suggestion to resolve the problem is to scale back the references to the top level terms on the hotel pages and reintroduce breadcrumb links to help Google follow the structure of the site again Does this sound reasonable or would anyone be able to suggest anything else to try?
Technical SEO | | Ham19790 -
Ranking for brand name but no other terms (no manual penalty) is this penguin?
Hi guys, I would like your opinions on this site www.colourbanners.co.uk Seems to be ranking for 'colour banners' but has dropped for keywords such as 'banners' and 'pvc banners' which were ranking well. There has been no manual actions against the site so im assuming this is an algo penalty? Any ideas/suggestions what could be causing this? regards Gerry
Technical SEO | | gezzagregz0 -
Why would an image that's much smaller than our Website header logo be taking so long to load?
When I check http://www.ccisolutions.com at Pingdom, we have a tiny graphic that is taking much longer to load than other graphics that are much bigger. Can anyone shed some light on why this might be happening and what can be done to fix it? Thanks in advance! Dana
Technical SEO | | danatanseo0 -
Term for how content or data is structured
There is a term for how data or content is structured and for the life of me I can't figure it out. The following is the best I know of how to explain it: magnolia is of Seattle. Seattle is of Washington. Washington is of the US. US is of North America. North America is of Earth. etc etc etc etc. Any help is much appreciated. I'm trying to use the term to communicate It's application to SEO in that Google analyze how information is structured to understand the breadth and depth of your sites content...
Technical SEO | | BonsaiMediaGroup0 -
How long for a sitewide 301 to reindex?
Hey Gang, Finally joined the big boys here, excited to see what we all can do together. Here is my situation. I have been struggling since panda 1.0 on a particular site at www.burnworld.com. Over 2011 we figured out what the issues were with the content and went on a major cleanup. This seemed to help towards the end of the 2011. However further panda updates this year mainly April have again struck. This was after adding a wordpress blog to the site late 2011, so it was a mix of a traditional html site and a wordpress blog. Thinking that this could be an issue in May this year we transferred all the content over to wordpress only. We did keep the same linking strucutre using a permallink plugin to set specific url's. Forward to Panda 20. This wiped out all rankings and then we could not even rank for our own content. One site that syndicates our content is now ranking for our content instead of us, and many 'feed' sites that scrape out feeds also rank insead of us. Okay now to my original question. 2 weeks ago we pulled the plug and made the decision it may be best to start over on www.burnworld.net since the .net in the past was a blog on wordpress (which was shutdown earlier n 2012), but sat with about 5 pages of content until we did the 301. So today none of the pages are in the main index and I am wondering if doing the 301 might have been a mistake by pointing it to an existing site that never really ranked. Would it have been best to start on a new domain? How long have others seen before google puts the pages back in the main index? Would like to figure out the best action to take to get back into google's good graces. I'll keep this page updated so others with this issue can hopefully have a resource to turn to. BTW- nothing has chaned with Binghoo, rankings are all the same and they have updated the domain change properly.
Technical SEO | | robdawg0 -
To get homepage to rank highly for a given term, do you only add the term(and variations) to the homepage?
If adding the term on all pages then won't the pages start competing with each other in the SERP? I'm building a site for a client who wants to rank highly for 'Southern California general contractors' and its not clear to me whether to fit these keywords (and variations) only into the homepage or if I should try to fit them into all pages.
Technical SEO | | kennysmith0