Some web 2.0 sites blocked by robot
-
I had created some web2.0 sites, google also indexed those sites but those sites robots.txt are disallow, this mean Google will not give any credit on ranking ? I have seen in google, those sites meta description was written - A description of this site is not available due to the robot.txt file. I checked that file, it is written disallow. Can google still count those sites for the ranking purpose ?
-
Hi,
Pages blocked by robots.txt file will not be considered for ranking. You still see those pages in Google's index is because of their mentions on other websites. Google has been doing link discovery from websites other than these Web2.0 sites of yours. So to stop Google completely from indexing these pages, you should go in for page-levelrobots meta tag. Here you go for more: https://support.google.com/webmasters/answer/93710?hl=en
Once you implement the page-level robots meta tag to block those pages, Google will remove them from the index after the next crawl. You can expedite this process by using the link removal procedure in webmaster tools account.
Here you go for more: https://support.google.com/websearch/troubleshooter/3111061?rd=1
Good Luck to you my friend.
Best regards,
Devanur Rafi
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Block Links From Spam sites
can you block links from other websites?ie: links backlinking to your site, causing a high spam score.
Link Building | | Socialdom0 -
Migrating blog posts to new site
I'm in the process of setting up a new site for a client, moving them over to WordPress from Joomla. They've got 50ish blog posts on their old site, but none of them have accumulated any external links. Is it worth it to copy them over to the new site for the sake of retaining all that content, or better just to start from scratch?
Link Building | | mtwelves0 -
Networking sites / paid links
A national networking company charges its members, say, a few of hundred pounds to become part of their network, which involves offline networking events and online in forums and a directory. All the links of the directory and forum sigs etc are all do-follow. While it's not just a directory, how beneficial a link is this likely to be? The site itself has a DA of 60 and a PR rank of 4. 1k likes on their cnnected FB page and 21 likes on the G+. At the networking meetings they tell new recruits that being a member gives them a very valuable backlink and everytime they participate in the forums they get another do follow backlink. Ive checked and they are dofollow. Is this likely to be a great value link?
Link Building | | littlesthobo0 -
I have created 5 model specific blog sites which deliver links to my core site.
I post about 500 words of unique relevant content weekly to each model blog site. Each week, seo smartlinks delivers keyword anchor text links to my core site with a 3% keyword density. I have been doing this for 3 months and my core site traffic is stagnant or slightly down. Is this a good practice since its relevant content, or am I writing for nothing? Also, am I in danger of over optimized anchor text?
Link Building | | SEOQuest720 -
Targeting high Page Authority sites vs high Pagerank sites for backlinks?
For many years I've been working on seo/backlinks for my website. When doing analysis in opensiteexplorer I notice that the highest listed backlinks for my site are sites with high page authority and domain authority, rather than pagerank. For example one of the highest backlinks for my website has page authority/domain authority of 72/96 but the site itself is only a PR2, while my other backlinks have PR4, 5, or 6 with lower page authority. For a while I've been trying to partner with websites for backlinks from high pagerank sites, as I've always believed this is the #1 metric in relaying link juice. But OSE's metrics seem to not follow that train of thought -- it believes page authority/domain authority is a more important measure. Is it? Should I change my strategy to try to partner with websites that have high page authority rather than focusing so much on pagerank?
Link Building | | DiamondJewelryEmpire0 -
How should I promote my local service site?
I am in the process of promoting my local service site at http://winecountrycarpet.com and I was wondering what you guys would recommend? i have submitted to a lot of directories and get any backlink I can. I have also started writing articles and submitting them to sooper articles and Ezine articles, but I feel like I am doing something wrong. I am open to any suggestions.
Link Building | | ayetti0 -
Where are all the sites that are linking to me?
I need to compile a list of all the siters linking to my site, but my open site explorer analysis shows very few links. I know for certain that there are many many more sites linking to it (it's an academic site and there are links to it from a lot of academic directories). What am I doing wrong?
Link Building | | michalseo0