Some web 2.0 sites blocked by robot
-
I had created some web2.0 sites, google also indexed those sites but those sites robots.txt are disallow, this mean Google will not give any credit on ranking ? I have seen in google, those sites meta description was written - A description of this site is not available due to the robot.txt file. I checked that file, it is written disallow. Can google still count those sites for the ranking purpose ?
-
Hi,
Pages blocked by robots.txt file will not be considered for ranking. You still see those pages in Google's index is because of their mentions on other websites. Google has been doing link discovery from websites other than these Web2.0 sites of yours. So to stop Google completely from indexing these pages, you should go in for page-levelrobots meta tag. Here you go for more: https://support.google.com/webmasters/answer/93710?hl=en
Once you implement the page-level robots meta tag to block those pages, Google will remove them from the index after the next crawl. You can expedite this process by using the link removal procedure in webmaster tools account.
Here you go for more: https://support.google.com/websearch/troubleshooter/3111061?rd=1
Good Luck to you my friend.
Best regards,
Devanur Rafi
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Linking to Your Site: Search Console Update
After links have been removed from site a to site b. How long will it take until site b will see it in the webmaster tools that the links to his site are no longer there?
Link Building | | FusionMediaLimited0 -
Looking for critical review of site
I am looking for a lot of insight into my gaming site hiddentriforce.com We have been growing a ton on our social networks, but the site is not growing as quickly as we would like. We have a pretty decent back link portolio from being the first to break news, some unique pieces, a scholarship, etc. But I would love another set of eyes on things.What could I do to drastically improve the site? To most improve its seo?
Link Building | | Atomicx0 -
How Does Google Treat Scapper Sites?
I have seen several sites that have data or some type of information about a website. Often the site appears to be trying show the value of a site. How does Google treat the links this scrapper type sites give? Should these types of links be ignored or should they be disavowed? Here is an example: http://www.sitetracer.com/www.tourexperience.com
Link Building | | Firestarter-SEO0 -
Network of sites
Hi guys, Wanted to get your opinion. Ran a backlink profile of a client and discovered there is a number of sites that linked to the main site. The number of sites are owned by the client and seems to be built on the purpose of just backlinking, there is footer links (exact match keyword links) The website aren't linked together in analytics or webmasters but shows up in whois under the same company. I think the best bet is get all those links removed from footer and let the domains expire once it finishes - seems to serve no purpose. But the bigger question is what are good reasons I can feed back to the client that it's has a negative affect?
Link Building | | GetApp0 -
How do I remove bad web directory listings?
I am starting SEO for an E commerce website. I guess like 1 year or two ago they had another SEO company working for them. After looking in Site explorer I realized that they have like 2000 links (almost all from website directories) that have the correct anchor text but are all in the wrong categories, and most from countries like china and india. Many of the Titles are even in Chinese. This company sells packaging supplies and they are in categories like real estate, animals, and so on. I am changing the domain name, so I guess any links to internal pages will be lost, however I have to forward the main domain to my new domain, so any links to the home page will still be there. Does anyone know how I can remove these links??
Link Building | | DTOSI0 -
Are links from flash sites worth anything?
I'm building some links right now and spotted an opportunity with a voiceover artists that we used for a marketing video. He posted our testimonial on his site and I plan to ask him to provide a link back. Thing is -- his site is entirely composed of flash content. Does this matter at all? Will this link still count? Thanks!
Link Building | | kylesuss0 -
Is it even worth getting a link from PR0-2 , unrelated themed sites?
Is it even worth getting a link from PR0-2 , unrelated themed sites like http://www.area-rug-news.com/ or http://www.denvercohomerentals.com/ to my PR4 health training site that has been around since 2007? Can getting a sitewide blogroll link do more harm than good?
Link Building | | gundogs0 -
New PDF Guide. On My site or linked by blogs?
Hi experts, I created a new worth guide about food. Its purpose it to improve backlink by adding website's URL on PDF's footer (spider crawls that one, is it true?). I want send my guide to trusted blogs so users can download new pdf guide on the web. Is it the best way to gain popularity and let my backlinks grow? I've seen that seomoz published is guide such as html pages.
Link Building | | Greenman
Could it be the worth way for me? Thanks a bunch in advance! G.0