What's name of SEOmoz and Open Site Explorer robots?!
-
I would like to exclude in robots.txt SEOmoz and Open Site Explorer bots to don't let them index my sites… what's their names?
-
The information you've requested is found on the following link: http://www.seomoz.org/dp/rogerbot
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Does anyone have an SEO strategic plan template for a beginning SEOmoz'r?
I'm fairly new to the SEO world and am going to be creating an SEO strategic plan for my boss (with his help). I was wondering if anyone had any recommendations on a template to use, outline to follow, must have's/don't need, etc. Anything you're willing to share would be greatly appreciated!
Moz Pro | | kyle21ct0 -
Is there anything SEMRush Guru or Enterprise level has that I can't do with SEOMoz Pro?
Okay fellow in-house SEOs, I need some advice please. We are considering an upgrade from SEOMoz Pro to Pro Elite. For a business our size, this is a major investment. I need some compelling reasons why we should go with this upgrade in lieu of simply adding an upgraded membership at SEMRush. Aside from more keywords tracked and more pages crawled (We only have about 5,000 pages, so I'm not sure more pages crawled is even something we need). Right now, it seems the only benefit to us would be the ability to track 2500 more keywords. We don't need more campaigns and we don't need more pages crawled. An extra $300/month is a lot to pay just for the sole benefit of adding more keywords. The reason we are considering this is because we have 6-7 product lines that are all quite different from each other, different keywords, different competitors. All of these products lines are enormously competitive, so of course we want to track each (with competitors) separately so that when I build a Ranking Index (which I learned how to do beautifull thanks to this post by AJ Kohn a few days ago), that my Ranking Index is a truer picture of how we are doing for keywords related to specific product lines, against the right specific competitors. Because of the keyword limitations in SEOMoz Pro (1,000 max), we can't come close to covering everything. Is increasing our level at SEOMoz really the best, most affordable option to do what we want to do? I realize I might get some bias here, but we are really trying to research cost-effective options, as $4,790 is a huge investment for us. Thoughts?
Moz Pro | | danatanseo0 -
Here's a hard one! Why isn't my profile picture displaying as an avatar iin forums and blogs?
My profile pic is updated and displays on my profile but I still have the default avatar beside all forum and blog posts... This is life or death... I must know the answer. 😉 Thanks guys.
Moz Pro | | Anthony_NorthSEO0 -
How can you set SEOmoz to work with your dev site behind an htpasswd?
All sites need to be developed from the small to the grand - and this takes time. Development usually takes place on a subdomain different from our live domain. It is locked down behind an htpasswd during development so its not picked up by searching engines - that may create duplicate content issues if when the site goes live it has already scanned our site on the development server. Its also a security implementation to keep the site away from prying eyes before its ready for launch There could be security holes that have not been tweaked. Whats the best strategy to get SEOmoz involved in this scenario. Its tools are invaluable to the SEO part of the build - but the seomoz crawler bot has a different IP address (being cloud based) - so we cannot just let a single IP address through our htpasswd. Also is there a way to link the dev and live site in seomoz - so when it goes live to maintain all teh same logs without having to create two seperate site campaigns? Thanks!
Moz Pro | | dseo2410 -
So many problems with my site.
Hi all.I was shocked when when i run a campaign and the warnings and recommendations about my site are so many.I know nothing about web design and the person who design it is asking me what are these problems and where did i get all these? any solution this are the problems 1.5XX (Server Error)
Moz Pro | | jubba
2.Duplicate Page Content(875)
3.Duplicate Page Title(875)
4.Overly-Dynamic URL(1048)
5.Too Many On-Page Links(60) and this is just a few of the problems.0 -
Why won't scheduled crawl of my site begin?
I currently have a campaign running on SEOMoz for over a month. It has been showing that a crawl was scheduled to start on 12/21. Now it's 12/23 and there has not been a new crawl, and it still says scheduled for 12/21.. Anyone know why this is happening or how to fix it? Thanks
Moz Pro | | Prime850 -
It won't let me print the secon or third pages of site errors.
When I place the site errors page in pdf format it won't let me print the second or any of the other webpages containing content about my site. Does any one know why?
Moz Pro | | ibex0