Duplicate Sub-domains Being Indexed
-
Hi all,
I have this site that has a sub-domain that is meant to be a "support" for clients. Some sort of FAQ pages, if you will. A lot of them are dynamic URLs, hence, the title and most of the content are duplicated.
Crawl Diagnostics found 52 duplicate content, 138 duplicate title and a lot other errors.
My question is, what would be the best practice to fix this issue? Should I noindex and nofollow all of its subdomains? Thanks in advance.
-
Thanks a lot! I will definitely try that.
-
If you don't want these indexed, first put a noindex tag on all pages. Leave the follow alone as the engine still needs to find the pages to change the index status.
Add the domain to GWMT then request a removal all the pages.
Allow this to take effect then add a robots disallow to the entire sub-domain.
Your domain then be cleaned from the index and the duplication won't be an issue.
-
The site has a few subdomains. For example (below examples are not my site):
- https://support.medialayer.com/index.php?_m=knowledgebase&_a=view
- https://support.medialayer.com/index.php?_m=knowledgebase&_a=viewarticle&kbarticleid=9&nav=0
So basically, the pages got indexed, with the same title, and partial/whole duplicate content.
So, by simply making some changes on the robots.txt will fix this issue? Thanks.
-
How are all of these subdomains being created? Do you have just one subdomain you are worried about or multiple subdomains?
If you can do a robots.txt disallow on certain duplicate folders/files that you don't want indexed, that might help.
Let me know some more info first.
Scott.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Gradual Increase in Domain Authority After Domain Migration But No Improvement in Organic Traffic Yet
We migrated our domain in early April and simultaneously added an SSL certificate. Everything was done by the books. All redirects implemented perfectly, very few errors. Google notified via Search Console. Despite all steps being done perfectly our domain authority dropped from 24 to 8. Organic traffic dropped from about 80 per day to about 10. Each month domain authority increases by 2 or 3. We are now back up to a DA of 16. But no improvement in organic traffic yet. At what point should organic traffic start to return? Hopefully the consistent improvement in DA is a good sign. I have been told that adding SSL and moving the domain at the same time was a very bad idea. We are starting link building next week. Hopefully that will help further. Any ideas as to when this situation will improve? Needless to say it has been awful for our business.
Intermediate & Advanced SEO | | Kingalan10 -
Why Is this page de-indexed?
I have dropped out for all my first page KWDs for this page https://www.key.co.uk/en/key/dollies-load-movers-door-skates Can anyone see an issue? I am trying to find one.... We did just migrate to HTTPS but other areas have no problem
Intermediate & Advanced SEO | | BeckyKey0 -
How Can I Redirect an Old Domain to Our New Domain in .htaccess?
There is an old version of http://chesapeakeregional.com still floating around the web here: http://www.dev3.com.php53-24.dfw1-2.websitetestlink.com/component/content/category/20-our-services. Various iterations of this domain pop up when I do certain site:searches and for some queries as well (such as "Diagnostic Center of Chesapeake"). About 3 months ago the websitetestlink site had files and a fully functional navigation but now it mostly returns 404 or 500 errors. I'd like to redirect the site to our newer site, but don't believe I can do that in chesapeakeregional.com's .htaccess file. Is that so and would I need access to the websitetestlink .htaccess to forward the domain? Note* I (nor anyone else in our organization) has the login for the old site. The new site went live about 9 months before I arrived at the organization and I've been slowly putting the pieces together since arriving.
Intermediate & Advanced SEO | | smpomoryCRH0 -
Is having all your media hosted on a sub-domain bad?
I just realized yesterday while doing some audit work on our site (which is still relatively new) that all of our audio assets are stored on a separate sub-domain. We are an eCommerce site that sells audio books, and every product page has a sample audio file to listen to. But all those files are stored on a sub-domain of the main site. "cdn-media.oursite.com". First, I understand that media(our audio files) has some inherent SEO value if hosted correctly. Is that true? And if so, how important would you think it is? Secondly, assuming that it does have value, are we losing that value by having them hosted on a sub-domain? I have read things that say sub-domains are bad, and I have read things that say that Google at least has been treating sub-domains as sub-folders, but I can't find anything definitive one way or the other. On another note, another thing I saw is that people are linking to the sound files directly in various places, and those links are going to the sub-domain, not the main domain. There aren't even pages on the sub-domain, just the files, so those links deliver a "visitor" to a page that is completely blank except for a tiny little audio player. Not sure what to do about that, but that can't be good one way or the other right? How big of a problem is this really? Is it worth me going to our IT dept. and trying to change it? It sounds like it would be a pretty big deal to change, so I'll need a few voices to back me up if that's the case.
Intermediate & Advanced SEO | | DownPour0 -
Sub domain will not index - Next plan of action?
I'm not sure exactly what option i should take next. but i'll run you through a few points: The page is optimized to a rank "A" The page has 350 backlinks* a strong social presence Interlinking pages. High domain authority an OK page authority The domain ranks highly Every other sub domain rank highly. I make a search and the first page that ranks for this domain is a product page within the exact sub domain i'm trying to rank for, followed by some external blogs I've written and then the rest of the product pages. I've submitted the URL to web master tools twice and yet it still will not rank for that keyword. The only time i see the page index is if i copy the exact URL into Google. Any help on this would be greatly appreciated. Thanks
Intermediate & Advanced SEO | | Martin_Harris0 -
Problem of indexing
Hello, sorry, I'm French and my English is not necessarily correct. I have a problem indexing in Google. Only the home page is referenced: http://bit.ly/yKP4nD. I am looking for several days but I do not understand why. I looked at: The robots.txt file is ok The sitemap, although it is in ASP, is valid with Google No spam, no hidden text I made a request for reconsideration via Google Webmaster Tools and it has no penalties We do not have noindex So I'm stuck and I'd like your opinion. thank you very much A.
Intermediate & Advanced SEO | | android_lyon0 -
What to do with keyword specific domains
I have a few domain names with the keywords I'm trying to target for my website. My website currently has been in operations for a couple years, and while not hugely authoritative, has built some value. Now, are these domain names with keywords any use to me? Is there any point to forward them to my site? Do I try to build up a page (or a few of content) and then have a link to my main site? Any insight would be mucho appreciated! Thanks!
Intermediate & Advanced SEO | | gregalam0 -
Exact match domain or root domain for speedy SEO?
I am doing SEO for a website that has constantly rotating and only temporarily pertinent subjects on it. Let's say these information and subject cycles go for about 6 months. Assuming this would it be more effective to optimize exact match domains for each 6 month cycle or make a main domain with a few of the keywords and just target a page for each roaming subject? Advantage of the subject is I get domain authority to feed off of, advantage of the exact match is, of course exact match domains are a powerful tool to rank highly and it is only a medium competitive market, usually about 40 domain and page authority. What do you guys think? Do you have any techniques to dominate temporary and rotating markets?
Intermediate & Advanced SEO | | MarloSchneider0