Meta Robots Tag - What's it really mean?
-
I used on a handful of pages recently and noticed that they're still popping up in the Google search index. I'd like to keep these from appearing, so I figured I needed a directive statement with stronger semantic meaning.
From what I understand, is what I'm looking for. Using this will keep Google from not only crawling the page, but indexing the page, as well.
I decided to see what the official robotstxt.org website said about it, so I checked (link here):
the NOFOLLOW directive only applies to links on this page. It's entirely likely that a robot might find the same links on some other page without a NOFOLLOW (perhaps on some other site), and so still arrives at your undesired page.
So, is their explanation saying that the page itself will be indexed, but the content / links on it won't be followed / indexed? Let me hear your thoughts, mozzers.
-
You can find out your desired meta robots setting by asking yourself two questions:
noindex or index: do you want this particular page to show up as a listing in the Google results for a query? Yes: index, No: noindex.
nofollow or follow: do you want the links on this page to be crawled (followed) by the search engine robots, thereby allowing them access to the deeper pages it links to (even though that particular page might even be noindexed). Yes: follow, No: nofollow
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Google's Not Provided - What can I see and what can't I?
Hi Guys, I've been looking into my company's analytics's data recently to establish where most of our traffic is coming from. More so, I want to get an indication of the percentage of organic traffic that is coming from branded and none branded terms. Not provided takes up 80% of my organic traffic and the vast majority of keywords that are provided all mention the brand name. Does analytics's provide you with all of your branded traffic but just block others that it doesn't want you to see? Or is it just coincidence that the majority of the terms I can see are all branded? I am just trying to establish how strong our brand is and how much traffic the brand name brings against none brand terms. All help is appreciated! Thank you!
Reporting & Analytics | | Sandicliffe1 -
Backlink Tool Finding Links That Aren't Visible
I'm using a variety of backlink toolsl; OSE, SEM Rush, Link Research Tools and Google Webmaster Tools. On some occasions the tools are telling me there is a link to my site on a certain page, however when I open that page I can't see any mention of my company. I have run all these reports today, so I think it is unlikely that Google is using old data. Does anyone know why this happens and if I should still be concerned about links that I cannot see but backlink tools are telling me are there? Thanks guys.
Reporting & Analytics | | AAttias0 -
How to safely exclude search result pages from Google's index?
Hello everyone,
Reporting & Analytics | | llamb
I'm wondering what's the best way to prevent/block search result pages from being indexed by Google. The way search works on my site is that search form generates URLs like:
/index.php?blah-blah-search-results-blah I wanted to block everything of that sort, but how do I do it without blocking /index.php ? Thanks in advance and have a great day everyone!0 -
Why should I use Google Tag Manager and will it help rankings?
hi all I have been reading the documentation here; http://www.google.co.uk/tagmanager/ But cannot find a real GREAT reason for using this and how it will help my fairly small (500/600 visitors/month) hobby website. Any suggestions help most welcome! Thanks Andy
Reporting & Analytics | | andystorey0 -
Does anyone know what's happened to google analytics -> traffic sources -> SEO -> queries many of my accounts are showing a drop to zero in the laste few days
Howdy mozzers It's in the question title really. Zero impressions showing for the last few days on. Multiple accounts Any thought out there
Reporting & Analytics | | Big_Partnership0 -
What's the best enterprise analytic solution for a website with 100+ Million Visits/Month
Hi Guys, I'm looking for an enterprise solution for my companies website that currently gets 100+ Million visits a month? We use the free version of Google Analytic but the sampling levels we get are just too small. We have the budget to get something substantial -- the question is what solution should we go with? Thanks, Nicolas
Reporting & Analytics | | Nicolas_Seattle0 -
Keyword Diversity: What Does it Mean?
I recently read this awesome article by Ian Lurie on the Portent blog: http://www.portent.com/blog/analytics/seo-analytics-middle-earth-style.htm However, I keep getting stumped by what he means under the "Grade Yourself" section by "keyword diversity." Of course, I've tried to ask him, but he hasn't yet responded. Besides, I like to get the opinion of the SEOMoz crowd anyway. So what is "keyword diversity"? Is it the total number different link texts out there linking to my site? The total number of keywords I'm actively tracking and optimizing for? The total number of phrases for which I rank in a Google search engine (if it's even possible to know that)? Thanks, Benjamin
Reporting & Analytics | | 1000Bulbs0 -
Haven't seen anything like this
I personally haven't seen anything like this before. I am optimizing my first worldwide page. The rank checker at seomoz and another rankchecker as well says that I achieve rankings in the Us and in the UK as well for my 2-3 word terms. However if I copy a paste a whole sentence from either of my pages (8-10 words) google can not find my site. If I put the terms in quotes than it is ok, but it still cannot find the home page. Not any sentence with or without quotes from the home page, although this page has the most incoming links. Anybody any idea how can it be?
Reporting & Analytics | | sesertin0