Layered navigation and hiding nav from user agent
-
I am trying to deal with the duplicate content issues presented by Magento's layered navigation feature (aka faceted navigation). I installed Amasty's Improved Navigation extension (https://amasty.com/improved-layered-navigation.html) and it offers the option to hide the layered navigation from specific user agents (ie googlebot, bingbot, etc).
This seems like cloaking to me and I hesitate to try it, unless hiding faceted navigation from specific user agents is known to be acceptable to Google (white hat practice). Does anyone know if this the case?
-
Great, thanks Carson! You're insights have been very helpful. I think we'll try to make the on-page ajax solution work.
-
If you're really worried about indexation I think that's a fine solution. It's definitely easier to manage, and it'll also be easier to track pageviews in most analytics platforms. The only downside is that if someone emails or links to a category page with filters applied the recipient won't see it. But generally people share products and not category pages, so it's not a big deal. I'd probably go that route.
Also make sure that your category pages still update the URL when you go to page 2, or that page 2 is somehow also being indexed. You don't want products that don't get indexed because categories can't be crawled.
-
Thanks for the link! I can see how Google offers me a way to tell it how to use my site variables. It seems like between managing parameters in webmaster tools, using canonical links and adding meta noindex tags on variable pages, there should be enough to keep things in order with the search engines. And I can just assume Google knows not to waste too much crawl budget on the variable pages.
I was considering one other option that would remove concerns about variables altogether. Using a different extension, I can set up Magento's layered navigation to work on the page without updating the URL. This eliminates the need for canonicals, parameters, and everything else that is more in Google's control than mine. What do you think of that as a solution?
-
Yes, the bots will crawl the pages, but they will not INDEX them.
There is a concern there, but mostly if the bots get caught in some kind of crawl trap - where they're trying out a near-infinite set of variables and getting stuck in a loop. Otherwise the spiders should understand the variables. You can actually check it in Webmaster tools to make sure Google understands. Instructions for that here:
https://support.google.com/webmasters/answer/6080550?hl=en
Ultimately Google will definitely not penalize you for having lots of duplicate content on URLs through variables, but it might be an issue with Googlebot not finding all your pages. You can make sure that doesn't happen by checking the indexation of your sitemap.
You could also try to block any URLs with the URL parameter in robots.txt. Make sure you get some help on the RegEx if you plan to do this. My advice is that blocking the variables in robots.txt is not worth it, as Google should have no problems with the variables - especially if the canonical tags are working.
Googlebot at least is smart enough these days to know when to stop crawling variable pages, so I think there are more important on-site things to worry about. Make sure your categories are linked to and optimized, for example.
-
This gets into an issue of bots and crawling where I am less clear. Even with canonicals, don't search engine bots crawl all of the pages produced with faceted navigation? That will easily reach 10,000+ pages on my site, which currently has a total number of pages in the low hundreds. I was under the impression I don't want to set up the faceted navigation in a way where the bots crawl through every combination of pages created by my products' attribute filters and bog the bots down in a quagmire of low-value pages. But I'm not sure if that's the case or how concerned I need to be about the bots spending their time on those pages.
-
If I'm not mistaken Magento has canonical tags on category pages by default, so you might be trying to solve an issue that doesn't exist. Take a look at the source code on faceted navigation to confirm. Or you can send me the site and I'll look over it.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Will exit intent layer harm google ranking? What if third party ad in exit intent layer?
We plan to implement an exit intent layer.
Intermediate & Advanced SEO | | lcourse
For mailing list expansion and/or to display personalized third party advertising. Any negative impact this may have on google rankings?
Shall we limit exit intent layer so to show only to users who visited at least 2 pages on our site?
Shall we reduce size of layer on mobile?
Anything else to consider to minimize potential negative impact on google rankings?0 -
Will two navigation components (one removed by Javascript) impact Google rankings?
We are trying to eliminate tedium when developing complexly designed responsive navigations for mobile, desktop and tablet. The changes between breakpoints in our designs are too complex to be handled with css, so we are literally grabbing individual elements with javascript and moving them around. What we'd like to do instead is have two different navigations on the page, and toggle which one is on the DOM based on breakpoint. These navigations will have the same links but different markup. Will having two navigation components on the page at page load negatively impact our Google SEO rankings or potential to rank, even if we are removing one or the other from the DOM with JavaScript?
Intermediate & Advanced SEO | | CaddisInteractive0 -
Help FORUM ( User generated content ) SEO best practices
Hello Moz folks ! For the very first time im dealing with a massive community who rely on UGC ( user generated content ). Their forum is finding a great deal of duplicate content/broken link/ duplicate title and on-site issue. I have Advance SEO knowledge related to ecommerce or blogging but new to forum and UGC. I would really love to learn or get ressources links that would allow me to see/understand the best practices in term of SEO. Any help is greatly appreciated. Best, Yan
Intermediate & Advanced SEO | | ydesjardins2000 -
User profile page optimisation - tips required
Hello, we have developed a network of medical professionals and our main goal on SEO is to rank on user names. I would like to use a profile [h**p://goo.gl/bUwFWW] i build in corporation with my client as sample and request any tips to increase ranking position of users profile page while searching for his name. Right now we list on 2nd page of google page. I would to know any specific tips / advices i miss out on page optimisation. Thanks in advance, C
Intermediate & Advanced SEO | | HaCos0 -
Does 'jump to' navigation work with a hidden div?
Will jump to navigation work when using a hidden div? Basically, we use a navigation system such that when a user clicks on a title, it expands to show the rest of the article, each title has an anchor associated with it, but no where else on the page / site do we link to those anchors. In order to make jump to navigation work, we are considering adding a hidden div with links to the anchors. Does anyone have experience doing this? Did it work?
Intermediate & Advanced SEO | | nicole.healthline0 -
Hiding tag and category root in wordrpess = plunge rank
I deleted the "tag" portion of my tag urls's that were ranking pretty high....so: www.businessinteriors.co.uk/tag/office-fit-out-bristol became www.businessinteriors.co.uk/office fit-out-bristol The old tag page ranked 7 before the change and even 3rd at one stage. The new name page without the tag has re-appeared at 23.... So quite a plunge in ranking from the change and this is across the board for all my tags (200) that were ranking high and I wanted to improve. Have I made a major error? Or will they naturally start coming back to where they were before? Weirdly some of the changes have had a positive impact - so ranking has gone up slightly in some areas..but completely out done by the plungers :-s
Intermediate & Advanced SEO | | bizint0 -
Navigation
An e-commerce site I am working on currently displays 6 Super-Categories with a drop down that contains about 100 Categories for items which filter down to sub-cats and then the actual products. The issue is that every page starts off with these 100+ links just in navigation alone. I can only assume this is crippling our ability to spread link juice efficiently. I have looked at larger sites that have moved towards side navigation. A few examples: *amazon.com *walmart.com *newegg.com My issue is that we would like to move towards less links on the homepage to funnel our incoming links more efficiently but I cannot figure out how large sites cope with this. As far as I can tell they are using side nav that disappears after selecting a category of item in which the navigation is replaced with filtering tools and the nav is hidden above (see the sites above). Is this the best way to handle this issue? Also is there a way to find out exactly what they are doing because I am trying to explain this to our IT person and I just get a response that our site is fine how it is and these navigation links don't affect anything...even though each page starts off with the same 100 follow links of navigation. Thanks
Intermediate & Advanced SEO | | MichealGooden0 -
Site navigation menu in head of page for SEO
We are considering expanding our site navigation menu (horizontal) at the top of our pages. However, once implemented, this would include around 30-40 links at the top of the page; before the content of the page. How much effect (good/bad) would this have on SEO? Are their any other options? (perhaps rendering the menu after the main content with CSS)? Any thoughts, suggestions or ideas would be greatly appreciated.
Intermediate & Advanced SEO | | Peter2640