Techniques to fix eCommerce faceted navigation
-
Hi everyone,
I've read a lot about different techniques to fix duplicate content problems caused by eCommerce faceted navigation (e.g. redundant URL combinations of colors, sizes, etc.). From what I've seen suggested methods include using AJAX or JavaScript to make the links functional for users only and prevent bots from crawling through them.
I was wondering if this technique would work instead?
If we detect that the user is a robot, instead of displaying a link, we simply display its anchor text.
So what would be for a human
COLOR
< li > < a href = red >red < /a > < /li >
< li > < a href = blue>blue < /a > < /li >Would be for a robot
COLOR
< li > red < /li >
< li > blue < /li >Any reason I shouldn't do this?
Thanks!
*** edit
Another reason to fix this is crawl budget since robots can waste their time going through every possible combination of facet. This is also something I'm looking to fix.
-
I share Alan's hesitation - it could look like cloaking, especially if a bot is making the call. If the pages aren't indexed yet, you could just "nofollow" the links - it sends the same signal transparently.
Home Depot is probably pulling it off with the AJAX/JS implementation, which is a bit harder for Google to parse. They also have a massive authority and link profile, so they can always squeak the small stuff by. You might not be so lucky. In general, it's best to stick to the standard practices and not get too tricky.
-
I've been browsing sites looking at what the big players are doing
Homedepot.com seems to be doing exactly this; if you go to
And you click a facet to narrow the result, the page is refreshed via AJAX
If you go to the same page with a Googlebot user agent, even with JavaScript enabled, clicking the checkbox does nothing!
Is this cloaking? Why is this legit?
-
But is it really cloaking? We wouldn't be showing different content. Just disabling links. This article describes a technique that's more akin to cloaking and justifies it because of "intent": http://www.seomoz.org/ugc/dealing-with-faceted-navigation-a-case-study.
The problem with canonical is that the robots will still waste crawl budget going through all the combinations of facets we have. We have hundreds of categories with complex products with 10+ facets with 10+ options each...
-
That would be cloaking, best not do that
A canonical tag would be best, thats what they are for
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Ecommerce New & Refurbished with multiple versions of refurbished
I am working with a website that sells new and multiple grades of refurbished power tools New Refurbished Grade A (top quality refurbished) Refurbished Grade C (had a few more scuffs but in perfect working order) Refurbished Grade D (no warranty / as is conditions, typically for parts) How would you create the Products and URL structure? Since they are all technically different products they have their own sku in magento. Would you combine them into one URL with different product options? or would you give each product version its own url (New, Grade A, Grade C, Grade D) Thanks! -- Steven
Intermediate & Advanced SEO | | intown0 -
How can I fix a SSL that is redirecting 3 times?
I have url that is redirecting three times. How do I fix that? I am using WP and running Really Simple SSL plugin. Is it ok to use the redirect plugin also? See here what the problem is: http://www.thepatrickmullin.com/ redirects to https://thepatrickmullin.com/ through a redirect chain. This hurts your rankings http://www.thepatrickmullin.com/ -->
Intermediate & Advanced SEO | | pmull
https://www.thepatrickmullin.com/ -->
https://thepatrickmullin.com/ Any help would be greatly appreciated!0 -
Should I 301 this ecommerce site, or turn it into a blog?
Hey everyone, I have a couple of ecommerce sites - Site 1 (DA33) and Site 2 (DA24). They are in the same niche and have the same products, a relic of how our business started in 2007. But now we just want to manage one brand, Site 1. This is our question: Is it better to 301 Site 2 into Site 1 (page by page redirect), or would it be valuable to instead turn Site 2 into a blog site? Site 2 currently has some good relevant links to it that would be nice to 301 to Site 1, but the value of 301 redirects seems to have been steadily diminishing since roughly 2011. If we take Site 2 and turn it into a WordPress blog, develop some good industry-relevant content on it (and outsource/allow guest posts on it for relevant quality content as well), and sometimes we drop a link or two into the content to help promote Site 1 - would that be more valuable than a 301? Obviously, a lot more "work" goes into creating a content site than just 301'ing it over. I guess the question is: does a page-by-page 301 of a niche-identical and even product-identical site into another have more of a benefit for SEO than getting some content-relevant anchor text links on a blog site? What would you do in my position?
Intermediate & Advanced SEO | | mozUser14692350692210 -
Can spiders crawl javascript navigation now?
I was reading Danny Dover's book and decided to try some websites and so far everyone I have looked at has had navigation that does not work with disabled javascript. Is this still as important as it was at the time of publish (2011)? Thanks!
Intermediate & Advanced SEO | | Sika220 -
When removing a product page from an ecommerce site?
What is the best practice for removing a product page from an Ecommerce site? If a 301 is not available and the page is already crawled by the search engine A. block it out in the robot.txt B. let it 404
Intermediate & Advanced SEO | | Bryan_Loconto0 -
How to generate xml sitemape for an ecommerce site with more than 50000 pages?
Hi, I am new to the forum and struggling hard to work on xml sitemap for an ecommerce site. Site is dynamic and more that 50,000 pages (including product pages). Challenges I am facing should I opt for category wise xml sitemap? how to include new product pages (dynamically) I was wondering if there is any tool that can generate xml site map online (I mean as soon as a new page is added to the site it will pick up automatically). thanks
Intermediate & Advanced SEO | | posy0 -
Fixing Duplicate Content Errors
SEOMOZ Pro is showing some duplicate content errors and wondered the best way to fix them other than re-writing the content. Should I just remove the pages found or should I set up permanent re-directs through to the home page in case there is any link value or visitors on these duplicate pages? Thanks.
Intermediate & Advanced SEO | | benners0 -
Site Wide Internal Navigation links
Hello all, All our category pages www.pitchcare.com/shop are linked to from every product page via the sidebar navigation. Which results in every category page having over 1700 links with the same anchor text. I have noticed that the category pages dont appear to be ranked when they most definately should be. For example http://www.pitchcare.com/shop/moss-control/index.html is not ranked for the term "moss control" instead another of our deeper pages is ranked on page 1. Reading a previous SEO MOZ article · Excessive Internal Anchor Text Linking / Manipulation Can Trip An Automated Penalty on Google
Intermediate & Advanced SEO | | toddyC
I recently had my second run-in with a penalty at Google that appears to punish sites for excessive internal linking with "optimized" (or "keyword stuffed anchor text") links. When the links were removed (in both cases, they were found in the footer of the website sitewide), the rankings were restored immediately following Google's next crawl, indicating a fully automated filter (rather than a manual penalty requiring a re-consideration request). Do you think we may have triggered a penalty? If so what would be the best way to tackle this? Could we add no follows on the product pages? Cheers Todd0