Duplicate Page Content
-
Hi there,
We keep getting duplicate page content issues. However, its not actually the same page.
E.G - There might be 5 pages in say a Media Release section of the website. And each URL says page 1, 2 etc etc. However, its still coming up as duplicate. How can this be fixed so Moz knows its actually different content? -
Thanks all - will give those options a try and see which works the best for us.
-
Hi!
I suggested the noindex in order to deindex pages that maybe are already indexed. But, yes, the rel="canonical" should be doing the same (the problem is that Google may not respect it).
The nofollow is order to not letting the crawler wasting budget crawl following the links of those (many) pages.
-
Gianluca,
Wouldn't be much more work to identify if the parameter is set and then add the noindex meta? Wouldn't be easier to just set the canonical? I'm sure that's a dynamic site, just one canonical cal without using any extra code (PHP or whatever).
Why the nofollow? If I just preventing that page for being indexed as it would constitute a duplicate content issue, why the nofollow?, noindex should be enough in this case.
We recently fixed a similar issue with our blog tags, showing duplicate content on about 400 pages. We fixed that by adding the noindex (they already had the canonical but it wasn't enough as the canonical couldn't point to a definite version as that changed if the tag had or not another post on it). Within a few days all those pages were deindexed, we noticed a loss in search traffic and I decided to run a small test removing the noindex tag. Results: 2 weeks later none of those pages returned to the index (I added the noindex tag back as it was just a test to see if we could regain that traffic, but ultimately decided it wouldn't help to have a duplicate content issue for that lost traffic).
-
Federico is right.
Your duplicated content issue is due to the date parameters, hence you are potentially duplicating every page having that calendar for all the possible combination of dates... and that is an huge issue.
You should implement the rel="canonical" in order to have all these kind of URLs having as canonical the URL without the parameter.
Or, even better, you should implement the meta robots "noindex,nofollow" in every date parametered URL.
Said that, the most logical thing to do was to block these URLs via robots.txt when launching the site. Unfortunately, now blocking these URLs is not enough, as they are already indexed (even if they not appear in the index because they are filtered out by Google).
-
Ah you mean that if the dates of the reservation changes then it creates a duplicate page content?
If that's the case, you should use the rel="canonical" the definite page, no dates selected, just the page that shows the property.
-
Did you try adding the rel="canonical" tag to the pages?
-
So they might look at this page: http://www.hihh.com.au/property-details?hihhpropertyId=HCP006&checkin=2013-08-06&checkout=2013-08-09&search=checkindate%3D2013-08-06%26checkoutdate%3D2013-08-09
Then the same page would come up on the error list but with different dates.
-
Can you provide us with some examples? It would make our job easier
-
Its basically all seperate pages/URL's with different information on each. However it seems to be crawled for each possible range of that page. e.g for check in/check out dates. It will search a range of dates and think that each page has different information. However, its all exactly the same.
-
Is the issue on the pagination? as sometimes some pages from categories/tags/etc can have the same content within an exact page.
If that's the issue, I would recommend you add a noindex meta to the least important pages (tags for example).
Hope that helps.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Pages with near duplicate content
Hi Mozzers, I need your opinion on the following. Imagine that we have a product X (brand Sony for example), so if we sell parts for different models of items of this product X, we then have numerous product pages with model number. Sony camera parts for Sony Camera XYZ parts for Sony Camera XY etc. So the thing is that these pages are very very similar, like 90% duplicate and they do duplicate pages for Panasonic, Canon let's say with small tweaks in content. I know that those are duplicates and I would experiment removing a category for one brand only (least seached for), but at the same time I cannot remove for the rest as they convert a lot, being close to the search query of the customer (customer looks for parts for Sony XYZ, lands on the page and buys, insteading of staying on a page for Sony parts where should additionally browse for model number). What would you advise to make as unique as possible these pages, I am thinking about: change page titles. meta descriptions tweak the content as much as I can (very difficult, there is nothing fancy or different in those :(() i will start with top top pages that really drive traffic first and see how it goes. I will remove least visited pages and prominently put the model number in Sony parts page to see how it goes in terms of organic and most importantly conversions Any other ideas? I am really concerned about dupes and a penalty, but I try to think of solutions in order not to kill conversions at this point. Have a lovely Monday
On-Page Optimization | | SammyT0 -
Duplicate content, which seems not to be duplicate :S
After crawling I am used to getting a lot of duplicate content messages in Moz, which are High Priority. I do not know what to do with them, since I believe we tackled all the issues. Main point being the advise to put in a link rel=canonical. An example of a page that accordeing to the report has a duplicate. I do not see how. Can you help with that? http://www.beat-it.nl/4y6hctr24x7wdmr-ml350-p-ic-procaresvc.html duplicate sample http://www.beat-it.nl/modu-hp-a5800-acm-for-64-256-aps.html
On-Page Optimization | | Raymo0 -
"Issue: Duplicate Page Content " in Crawl Diagnostics - but these pages are noindex
Saw an issue back in 2011 about this and I'm experiencing the same issue. http://moz.com/community/q/issue-duplicate-page-content-in-crawl-diagnostics-but-these-pages-are-noindex We have pages that are meta-tagged as no-everything for bots but are being reported as duplicate. Any suggestions on how to exclude them from the Moz bot?
On-Page Optimization | | Deb_VHB0 -
Page Analysis - Helping Product Pages Outrank Search Results Pages
Hi! We have a lot of our search results pages that have been indexed and outrank our product pages and in some instance the actual product pages barely show up at all. Here is an example query that includes our brand name: http://goo.gl/cgB6W So, we have loads of actual product pages, video pages, etc that should be showing up here, but are not and this is just one example. Unfortunately, there are a LOT of these Search Results pages out there and utlimately we would love to de-index them altogether, but it's going to have to be carefully done. So, was wondering if anyone would want to check out one of our product pages and give any feedback as to what we could change to possibly improve rank or to make them more search friendly or hopefully to help them rise above these indexed search results pages? Here is an example product page: http://goo.gl/2R4IT Thanks!! Craig
On-Page Optimization | | TheCraig0 -
How Can I Fix Adobe Bridge Photo Galleries and Duplicate Content?
I have used the Adobe bridge program for a number of photo galleries on a remodeling site and it is showing a large amount of duplicate titles, etc. Is there an easy fix to this? anyone?
On-Page Optimization | | DaveBrown3330 -
Creating a product per size causing duplicate content problems?
I have an e-commerce site and in order to receive a listing for each size and color in Google Merchant, I've created a new product for each size and color. The problem is that since I did this, the canonical tags aren't correct and there isn't a way to change them manually with the platform I'm on. I feel like this is one of the main reasons I've been dropping in the rankings. Should I delete all duplicate products? The system will take care of canonical tags automatically when creating a new size/color within the system (how it's supposed to be created) but the canonical tags become messy when I duplicate a product and edit the size/color to create a "whole new product". Here is an example of what I'm referring to: http://www.carbonconnection.com/search.php?search_query=nalini+rigel&x=0&y=0 (this problem actually isn't mine, it's a friend's but for the sake of simplicity and gaining a second opinion to be sure before he redoes all of his products, I'm asking as though it were my issue)
On-Page Optimization | | EmdeS0 -
Duplicate page titles
We have search results pages on our site. They share the same page title, there is no real differentiator between the result pages, other than page 1, page 2 etc. How do we de-dup the titles? just add page 1/2/3 etc to the end of them?
On-Page Optimization | | lilibooz0 -
Are duplicate titles an issue for pages I don't need ranking for?
A client has a load of duplicate page titles on their site. However, to cut a long story short, most of these pages are pointless and therefore we don't need ranking for them. As such, I'm not concerned whether any of the pages with duplicate content on them are ranked or not..... unless having duplicate page titles / content on these pages could mean that other pages on the site, like the homepage, don't rank as high because of this. Do I need to worry about duplicate titles on these pages, or can I ignore duplicate content on pages that I don't want to be ranked? Hope that makes sense!
On-Page Optimization | | RiceMedia0