Soft 404
-
Hey forum,
My site is a Price Comparison site. Lately I've been getting some "Soft 404" errors with the Webmaster tool. I'll try to explain the steps causing it:
1. There's a valid link to a product
2. At some point the product is temporary out of stock or unavailable.
3. Google crawls this product page, getting a valid page with a message explaining this product is unavailable at this time.
4. Google see this page for few different products and (I assume) figures it's a none existing page and so it's a soft 404.
The possible solutions I see are:
1. Return real 404, I'm not a fan of this solution, because these links will very likely be valid again when the product is back in stock.
2. Live with some "soft 404" errors in the webmaster tool.
3. Find another way to explain to Google that it's not a real 404. This sounds great but I'm not sure how this can be done.
Any thoughts which would be the best method? Or maybe another solution I haven't thought of?
Thank you.
-
You're welcome. I hope it all works out as you expect.
-
Without getting too technical, currently the user isn't really being redirected at all, because it's a dynamic page with the results, which can be any number, in this case, 0.
I will take your advice and indeed create a custom "out of stock" page that will be returned for all these cases. Maybe it will be clearer to Google. Obviously these won't rank well, but I'm fine with it, as long as I don't get ranking penalty for the entire site, for none existing pages. Under the circumstances I guess this is the best option.
Thank you very Daniel, you've been very helpful.
-
This is where it goes a bit over my head as a programer, which I'm not, but we would need to dive into the code a bit. I'm not sure I can be of help with details, but from what I'm understanding is as follows.
I understand that if a product is in stock, it shows the page, if the product is not in stock, rather than that pages information changing to say it is no longer in stock, you get redirected to or the page changes to a new page that simply says it can't find what you are looking for.
If I'm right, you need to change the code so when a product is not found or no longer in stock, instead of pointing to this dead page returning zero, or instead of just having that page deleted (in turn being 404), have the page change content or redirect to another page saying it is no longer in stock.
I'm not sure I'm clear here, but what I'm saying is, have it direct to a page you created yourself that says you are temporarily out of stock, rather than the program automatically generating a 404 page.
I hope this helps send you in the right direction, otherwise I'm no programer so can't give you exact instructions, but maybe someone who knows e-commerce programming can help here.
-
Thanks again Daniel.
I'm a web developer too
What would a "proper page" be though? Keep in mind at this point I don't know anything about this product. Each general "out of stock" page will be the same for each product making it a "soft 404" probably, unless I make it a real 404, which will solve the "soft 404" but will create a new problem, 404 pages for some previously valid URLs.
Both are not good, I'm aware of it, however, we are talking less than 0.05% of the site's pages.
-
OK, from what I can see in your example link and what you just confirmed in your last note, the problem is in the design of the database search.
If a product is out of stock, instead of just saying that particular product is out of stock, it comes back with a 0 search results returned. It's basically searching for something and takes you to a page saying that doesn't exist. That would totally explain why you are getting soft 404 errors because you are basically searching for a page that doesn't exist.
You need your web developer to fix this so it takes you to a proper page with some sort of information rather than what is currently a nice looking soft 404 page.
-
Thanks for the reply Daniel. Here's an example link: link
Basically anything with a wrong number will return this page. I know it's not a great page for this purpose, just a regular product page with 0 items and a message. It's just rare enough that we didn't spend too much on it. How rare? According to the Webmaster tool, out of the last 296k pages crawled, 70 were found.
Basically at this point, I have no information on this item, all I know is that someone got here so it's probably a valid product code, which is true unless someone just edited the URL manually.
-
I'm not an expert in this area, but it sounds like a coding issue. Somehow when Google looks at the page it triggers that error. If I understand correctly, when you are out of stock, the system automatically generates a message that says it is out of stock. What does that page look like? Maybe if you post an example of that webpage it could be helpful.
I'm thinking you will need to modify that out of stock template so it includes other information. Whether it be as Kaushal recommended, or even just plain text saying anything. Maybe "Sorry we are currently out of stock, please check back later or contact us for an ETA". Having other information on the page should show to Google it is still an active page with content on it. One way or another, the problem sounds like it's with that out of stock template the database is using.
Maybe I'm way off, but if you link to an example page, that would probably help.
-
Thanks for the reply Kaushal. We actually don't have a system currently that lists similar products and considering we have over 20 million products, it's also not a minor thing to implement. Anyway I'm not sure I like the way other sites try to push products that aren't really what you were looking for.
-
Can't you show message "Product is out of stock for now" message. And show related product below with "You might be interested in below product" message.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
External 404 pages
A client of mine is linking to a third-party vendor from their main site. The page being linked to loads with a Page Not Found error and then replaces some application content once the Javascript kicks in. This process is not visible to users (the application loads fine for front-end users) but it is being picked up as a 404 error in broken link reports. This link is part of the site skin so it's on every page. Outside of the annoyance of having lots of 404 errors being flagged in a broken link report, does this cause any actual issue? Eg, do search enginges see that my client is linking to something that is a 404 error, and does that cause them any harm?
Intermediate & Advanced SEO | | mkleamy0 -
Should remove 404 page
Hello, I upload a new website with new web addresses and my current addresses don't work anymore. I don't want to do redirects. Should I just remove the old address from google index using their tool or let google do it on its own. Thank you,
Intermediate & Advanced SEO | | seoanalytics1 -
400+ deleted pictures, 404 on URLs, can they be deleted without penalty?
A client had a website redesign and over 400 pictures (she's a photographer) were lost. The URL's (ending in .png) are hanging out there and according to the site scan, they have a matching current URL. Since the pictures are gone can the URL be deleted?
Intermediate & Advanced SEO | | fcromwell0 -
Indexed Answer Box Result Leads to a 404 page?
Hey everyone, One of my clients is currently getting an answer box (people also ask) result for a page that is no longer live. They migrated their site approximately 6 months ago, and the old page is for some reason still indexed in the (people also asked) results. Weird thing is that this page leads to a 404 error. Why the heck is Google showing this? Are there separate indexes for "people also asked" results, and regular organic listings? Has anyone ever seen/experienced something like this before? Any insight would is much appreciated
Intermediate & Advanced SEO | | HSawhney0 -
Google Seeing 301 as 404
Hi all, We recently migrated a few small sites into one larger site and generally we had no problems. We read a lot of blogs before hand, 301'd the old links etc and we've been keeping an eye on any 404s. What we have found is that Webmaster is picking up quite a few 404s, yet when we investigate these 404s they are 301'd and work fine. This isn't for every url, but Google is finding more and I just want to catch any problems before they get out of hand. Is there any reason why Google would count a 301 as a 404? Thanks!
Intermediate & Advanced SEO | | HB170 -
How to fix Invalid Product Page registering as Soft 404
Somehow with our site architecture Google is crawling URLS for products we no longer carry (there are no links to those pages so I am still trying to figure out how Google is finding them).Those URLS are being redirected to our invalid product page. That invalid product page is returning a 200 OK code, but according to Google it should be a 404 so we get a soft 404 error. Google is seeing all of the URLs that redirect to that page as soft 404's as well. The first solution I can think of is to create a custom 404 page that looks just like our site, says we don't have the page/product they are looking for, has a search bar, sends a 404 code, etc. Is this the right way to go? And it will probably take some time to implement so is there a quick fix we could do first?
Intermediate & Advanced SEO | | ntsupply0 -
Do you add 404 page into robot file or just add no index tag?
Hi, got different opinion on this so i wanted to double check with your comment is. We've got /404.html page and I was wondering if you would add this page to robot text so it wouldn't be indexed or would you just add no index tag? What would be the best approach? Thanks!
Intermediate & Advanced SEO | | Rubix0 -
404 ? 301 ? What is your opinion ?
Hi, I have a classifieds website and I am wondering about the life of a page with an ad. An announcement has therefore a limited life, so : Is a 404 pages? a 301 redirect to the section? let the content without redirection? What is your opinion? Sorry for my english, i'm french 😉 Thanks. A.
Intermediate & Advanced SEO | | android_lyon0