Multi-Country Duplicate Content
-
Hello,
We have an ecommerce site that serves several countries on the same .com domain - US, UK and CA. We have duplicate content across these countries because they are all English speaking so there is little variance in the pages and they each sell most of the same products. We have implemented hreflang into our sitemaps but we need to address the duplicate content. We were advised to canonicalize our UK and CA pages back to the duplicate US pages (our US pages account for the majority of our traffic and sales). This would cause the UK and CA pages to fall out of the index but the visitor would still be taken to the correct country's page due to the hreflang.
I'm leary about doing this because they are across countries. Is this ok to do? If not, how do we address the duplicate content since they are not on their own CCTLD's?
-
Kelli (sorry, I had the wrong name somehow?)
First let me clarify a few things.
- Is the content between the US, Canada, and UK the exact same but on different URLs?
- Is any of the content translated to cater to the different markets (spellings, word usage, etc.)?
- Does each country have the same product set, etc.?
The HREFLANG is not necessary unless you are changing the language in some way. I am not sure that is what you should be using here. But your answers will help me understand so I can tell you what to do.
Check out my tool here to help: http://www.katemorris.com/issg/
-
It is of course slightly harder to answer without seeing any examples. However, assuming that the canonicalisation of Products B & C is the right thing to do in the first place, then I'd suggest that you should be consistent with your canonicalisation.
So, if you're canonicalising Products B and C to Product A on the US site, you are asking Google "please don't deliver B and C in search results; deliver A instead". If you are to then start canonicalising UK content to B & C then, as you rightly point out, that creates a chain of canonicals. The purpose of canonicals is to help Google to identify the single page (within a group) that they should deliver to their users. So it wouldn't make sense to canonicalise to one page which then canonicalises to another, IMO.
As for having to use both the canonical and rel-alternate-hreflang attributes, I have to say I'm surprised. I read this and strangely there is no mention of the canonical - it seems to suggest that this is the solution you've been looking for! However, clearly that's not been your experience.
Perhaps a silly question - but have you checked that you have rel-alternate-hreflang has been implemented correctly? E.g. have you implemented on a page-by-page basis, as opposed to a site-level basis? From the Google thread:
"rel="alternate" hreflang="x"
is used as a page level, not a site level, and you need to mark up each set of pages, including the home page, as appropriate. You can specify as many content variations and language/regional clusters as you need." -
Here's another question, if we do canonicalize our UK and CA pages back to the corresponding US pages, how should we handle the following scenario where most of our products are in 'groups' meaning there are very slight variances, but they are the same product:
US Site
Product A - canonical
Product B - canonicalizes to A
Product C - canonicalizes to AUK Site
Product A - canonicalizes to US version of A
Product B - canonicalizes to US version of B - OR - canonicalizes to US version of A??
Product C - canonicalizes to US version of C - OR - canonicalizes to US version of A??With thousands of products, canonicalizing to the exact duplicate page may be much easier to implement, but there will be a chain of canonicals.
-
I used to think the same thing, but it seems that Google has been unclear on the effects of hreflang as to whether it addresses duplicate content because at one time they said to use hreflang together, then they crossed it off of their guidelines, now they say it's ok. Based on my research, I'm thinking it's ok to use together as long as the languages aren't different, for instance, variations of English is ok, but don't use it with English and Spanish together because they are completely different.
Here is a snippet from http://searchengineland.com/cutting-through-the-confusion-of-googles-guidance-to-multilingual-website-owners-113586 which reads:
The Effect Of Combining Canonical Tags & Hreflang Tags
Not forgetting that the canonical tags should only be used with content in the same language, when would we use both? Well firstly, the use of both would involve what I usually call world languages such as English, Spanish, French or Portuguese. These languages are used in many countries and, whilst there are variations between the use of these languages in those countries, the variations are sometimes small. A__dditionally, multinational publishers often save costs by using one version of the language for all countries speaking that general language, thus ignoring the regional variations. In other words, for Spain and Mexico, Google is presented with exactly the same content, letter for letter. The canonical acknowledges that this is the same content. The Hreflang tag identifies which URL should be displayed in different sets of results. So, in other words, canonical + Hreflang = same content + different URL. Google knows the content is the same, but displays the correct URL for the Google domain search (e.g. google.com.mx will see the relevant URLs for Mexico displayed in the results).
This is also another good article from Distilled: http://www.distilled.net/blog/distilled/distilledlive-london-a-few-thoughts-on-hreflang/
Also, when a page canonicalizes to another page, it eventually drops out of the 'Duplicate Meta Descriptions' area of Google Webmaster Tools. We have had the hreflang implemented for some time, and none of the 'cross-country' pages are dropping out.
-
I thought that the whole point of rel-alternate-hreflang was to deal with the duplication of content when delivering the same or similar content to users in different locales.
For example, you have two sites - 1. US example.com and 2. UK example.co.uk. You sell the same products in both countries and the content on the sites is exactly the same. So there are two sites with exactly the same content, but the currency and delivery information etc is different.
If you implement on the .com site and on the .co.uk site, that means you don't need to implement the canonical tag.
At least that's how I understand this - I don't see the point of hreflang if you start having to mess around with canonicals etc.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Advise on the right way to block country specific users but not block Googlebot - and not be seen to be cloaking. Help please!
Hi, I am working on the SEO of an online gaming platform - a platform that can only be accessed by people in certain countries, where the games and content are legally allowed.
International SEO | | MarkCanning
Example: The games are not allowed in the USA, but they are allowed in Canada. Present Situation:
Presently when a user from the USA visits the site they get directed to a restricted location page with the following message: RESTRICTED LOCATION
Due to licensing restrictions, we can't currently offer our services in your location. We're working hard to expand our reach, so stay tuned for updates! Because USA visitors are blocked Google which primarily (but not always) crawls from the USA is also blocked, so the company webpages are not being crawled and indexed. Objective / What we want to achieve: The website will have multiple region and language locations. Some of these will exist as standalone websites and others will exist as folders on the domain. Examples below:
domain.com/en-ca [English Canada]
domain.com/fr-ca [french Canada]
domain.com/es-mx [spanish mexico]
domain.com/pt-br [portugese brazil]
domain.co.in/hi [hindi India] If a user from USA or another restricted location tries to access our site they should not have access but should get a restricted access message.
However we still want google to be able to access, crawl and index our pages. Can i suggest how do we do this without getting done for cloaking etc? Would this approach be ok? (please see below) We continue to work as the present situation is presently doing, showing visitors from the USA a restricted message.
However rather than redirecting these visitors to a restricted location page, we just black out the page and show them a floating message as if it were a model window.
While Googlebot would be allowed to visit and crawl the website. I have also read that it would be good to put paywall schema on each webpage to let Google know that we are not cloaking and its a restricted paid page. All public pages are accessible but only if the visitor is from a location that is not restricted Any feedback and direction that can be given would be greatly appreciated as i am new to this angle of SEO. Sincere thanks,0 -
Hreflang tags and canonical tags - might be causing indexing and duplicate content issues
Hi, Let's say I have a site located at https://www.example.com, and also have subdirectories setup for different languages. For example: https://www.example.com/es_ES/ https://www.example.com/fr_FR/ https://www.example.com/it_IT/ My Spanish version currently has the following hreflang tags and canonical tag implemented: My robots.txt file is blocking all of my language subdirectories. For example: User-agent:* Disallow: /es_ES/ Disallow: /fr_FR/ Disallow: /it_IT/ This setup doesn't seem right. I don't think I should be blocking the language-specific subdirectories via robots.txt What are your thoughts? Does my hreflang tag and canonical tag implementation look correct to you? Should I be doing this differently? I would greatly appreciate your feedback and/or suggestions.
International SEO | | Avid_Demand0 -
Country subfolders showing as sitelinks in Google, country targeting for home page no longer working
Hi There, Just wondering if you can help. Our site has 3 region versions (General .com, /ie/ for Ireland and /gb/ for UK), each submitted to Google Webmaster Tools as seperate sites with hreflang tags in the head section of all pages. Google was showing the correct results for a few weeks, but I resubmitted the home pages with slight text changes last week and something strange happened, though it may have been coincidental timing. When we search for the brand name in google.ie or google.co.uk, the .com now shows as the main site, where the sitelinks still show the correct country versions. However, the country subdirectories are now appearing as sitelinks, which is likely causing the problem. I have demoted these on GWT, but unsure as to whether that will work and it seems to take a while for sitelink demotion to work. Has anyone had anything similar happen? I thought perhaps it was a markup issue breaking the head section so that Google can no longer see the hreflangs pointing to each other as alternates. I checked the source code in w3 validator and it doesn't show any errors. Anyway, any help would be much appreciated - and thanks to anyone who gets back, it's a tricky type of issue to troubleshoot. Thanks, Ro
International SEO | | romh0 -
Any practical examples of ranking 1 domain in multiple countries?
Hi, I've done a fair amount of research on international SEO including here on MOZ but was hoping some fellow Mozzers might have some practical examples of how they have got 1 domain to rank in multiple countries, ideally US & UK. Im possibly looking at getting a high authority domain which ranks great on US into the UK engines. I want to keep to the 1 domain to benefit from the high authority and for logistical reasons. Thanks in advance, Andy
International SEO | | AndyMacLean0 -
How to optimise a site for 2 countries
Hi there - Any help with the below much appreciated I am helping an Australian company, producing packaging products for businesses. Their site is hosted in Australia and their offices are in Australia. They have asked me to take care of both on-page and off-page SEO so that they rank for keywords related to their products - e.g. 'cardboard boxes'. This should be fairly straightforward for Australian based (.com.au) searchers, but they also supply their products to South Africa, and so want their results to show up also for South African based (.co.za) searchers. Also consider: it is not typical for searchers for these products to use geomodifiers in their search terms there is no unique content for the South African market versus the Australian... the product information is essentially identical. What should we do to ensure their results show up equally for those in South Africa as well as Australia? I am considering building a completely separate site, hosted in South Africa and specifically for the S.A market, but will the duplicate content effect be an issue? Also, this would essentially mean double the SEO effort, is there no way I could achieve our goals more efficiently? many thanks to any help
International SEO | | dnaynay0 -
Use country-specific domains or stick to already strong .com domain?
We run an online store with the majority of our customers coming from 4 different European countries. The site is accessible through TLD's of all of these countries. However our .com domain currently has the most links pointing to it and the highest domain authority. Unfortunately, we are unable to tell through which TLD visitors reach our site. The niche is rather competetive, and therefore I am unsure whether it would be worth it to solely use our .com domain for the English language, and try to rank for each of the seperate languages with its own country-specific domain. **Question/discussion: **Will it be worth the costs and time to spent to build links for the country specific domains in these countries, or should we focus on making our .com domain stronger and use it for all countries? I'm aware of the benefits of ranking with a domain in the country the user is in. Note: We have major duplicate content issues at this moment, due the content being available in different languages, on a handful of domains. On each domain, users can view the site in different languages. In addition, the language indication in the url is not very clear (?lang=x) so I believe this should be improved to make it easier for search engines to tell which language is presented. If I choose to use a different language for each TLD, then the language flag in the navigation on the site will point to a different domain, so each language is hosted on 1 domain and there is no more duplicate content. However, I'm afraid this will lead to lower rankings, as the (strong) .com domain will no longer host the content in different languages.
International SEO | | 1200wd0 -
Tips for optimizing sites for arabian countries?
I'm going to assist a customer with SEO and we will also have to optimize the project for arabian countries. I'm looking for any helpful tips (links, blog-posts, experiences) like relevant search engines, best practices with keyword translation/localization, impact of mobile search/usage, recommendation for partners/companies... Thank you!
International SEO | | kqkq0 -
What countries does Google crawl from? Is it only US or do they crawl from Europe and Asia, etc.?
Where does Google crawl the web from? Is it in the US only, or do they do it from a European base too? The reason for asking is for GeoIP redirection. For example, if a website is using GeoIP redirection to redirect all US traffic to a .com site and all EU traffic to a .co.uk site, will Google ever see the .co.uk site?
International SEO | | Envoke-Marketing2