Adding non-important folders to disallow in robots.txt file
-
Hi all,
If we have many non-important folders like /category/ in blog.....these will multiply the links. These are strictly for users who access very rarely but not for bots. Can we add such to disallow list in robots to stop link juice passing from them, so internal linking will me minimised to an extent. Can we add any such paths or pages in disallow list? Is this going to work pure technical or any penalty?
Thanks,
Satish
-
But as per the current SEO buzz, internal nofollow leads of waste of link juice and we cannot preserve it. Moreover some suggests not to use nofollow internally.
-
This is a great resource for all things robots.txt related: [http://www.robotstxt.org/robotstxt.html](http://www.robotstxt.org/robotstxt.html)
-
Hi,
Yes you can block in robots.txt. You can also use rel="nofollow" if you don't want to pass link juice.
[No Link Juice](https://www.example.com) Hope this helps. Thanks
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Indexed, though blocked by robots.txt: Need to bother?
Hi, We have intentionally blocked some of the website files which were indexed for years. Now we receive a message "Indexed, though blocked by robots.txt" in GSC. We can ignore as per my knowledge? Are any actions required about this? We thought of blocking them with meta tags but these are PDF files. Thanks
Algorithm Updates | | vtmoz1 -
What happens when non-relevant topic is getting more visitors?
Hi all, So we have a sub-domain which has user generated content like forums. Mostly the content is all about our product. Few times some spammy threads get posted and we delete them regularly. I have noticed that a non-relevant thread has been posted which about a movie. But this page got hundreds of clicks. I just wonder will this hurts being off topic and movie torrent thread or helps being receiving hundreds of visitors? Thanks
Algorithm Updates | | vtmoz0 -
Homepage title tag: "Keywords for robots" vs "Phrases for users"
Hi all, We keep on listening and going through the articles that "Google is all about user" and people suggesting to just think about users but not search engine bots. I have gone through the title tags of all our competitors websites. Almost everybody directly targeted primary and secondary keywords and few more even. We have written a very good phrase as definite title tag for users beginning with keyword. But we are not getting ranked well comparing to the less optimised or backlinked websites. Two things here to mention is our title tag is almost 2 years old. Title tag begins with secondary keyword with primary keyword like "seo google" is secondary keyword and "seo" is primary keyword". Do I need to completely focus on only primary keyword to rank for it? Thanks
Algorithm Updates | | vtmoz0 -
How important is Social Media for building domain authority / Google rankings? Are there any cases?
I really would like to know if someone tested the importance of Social Media for Google rankings.
Algorithm Updates | | Seeders
Are there some sites who build authority only by doing good social media?
Ofcourse, I know it is all about the mix (content, linkbuilding, social media, etc.) but how important is it?
I know many sites who rank good without any form of social media, but I do not know any sites who do only social media and rank high. I hope there are some good cases which give good insight. ps. I know it becomes more and more important...0 -
Google Unable to Access Robots.txt
We haven't made any changes to the robots.txt file and suddenly Google claims they can no longer access the file. The site has been up and active for well over a year now. What are my next steps? I have included a screenshot of the top half of the file. See anything wrong? D3H5tgE.png
Algorithm Updates | | rhoadesjohn0 -
URL Importance In Search
This may have been addressed before. If it is, please link me to the thread. I'm trying to SEO for local surrounding cities my client services. It was suggested I purchase domains relevant to those cities and create separate pages optimized for those local keywords. Wondering if this is a good tactic. For example my client's business is located in Chicago, but services the surrounding suburbs of Chicago. Whats the current, best way to SEO?
Algorithm Updates | | severitydesign0 -
Major Slipping of highly important keywords in a few days
Realized some major slipping on some of my most important keywords- mn realtors and minnesota homes for sale- my site is joeandcindy.com After months of working on traffic, blogs etc, wondering what could slap me 10-25 spots in just a few days. There were no errors showing up on the report that I can see. Just looking for some quick advice on what I might be missing and some quick action steps I might take to reverse the trend. Thanks!
Algorithm Updates | | jjwelu0 -
Importance of Product Review Syndication?
Greetings everyone I have been tasked to do research on just how important it is to have product reviews syndicated with Google's (star rating found in Google Shopping). I am unable to find any research reports or studies on this nor any quantitative data on it's impact, beneficial or otherwise. If any of you folks have any first hand experiences, perhaps some before and after figures, that would be great. Thanks
Algorithm Updates | | airnwater0