SEO Web Crawler IP addresses
-
What are the IP addresses for the SEO Web Crawler?
There is a firewall on my clients website before it goes live, I would like to crawl the site before it goes live, but need to provide the web crawlers IP addreses.
Thank you for your time
-
Hi Jason,
This is Megan from the SEOmoz Help Team. Unfortunately, since we crawl from the cloud, RogerBot's IP address is changing all of the time so we cannot specify a particular IP address. Also, we do need the site to be live before we can crawl it, but you could remove the firewall and block all other bots except rogerbot so it won't get indexed anywhere else before it's ready.
I hope this helps! Please let me know if you have any other questions.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Unsolved Ooops. Our crawlers are unable to access that URL
hello
Moz Pro | | ssblawton2533
i have enter my site faroush.com but i got an error
Ooops. Our crawlers are unable to access that URL - please check to make sure it is correct
what is problem ?0 -
What Moz reports would you suggest running when pitching SEO services to a client?
What do you think the best Moz reports are when presenting SEO services to a client? I need to share reports that show where the opportunity is and where we will be prioritizing our effort. I'd like to hear what you would suggest given your experience presenting SEO to clients. Thanks in advance for your help!
Moz Pro | | mrupert1 -
QUESTION. Keyword Stuffing reduction while maintaining SEO optimal density?
Optimizing a keyword for a page on MOZ is telling me with a red exclamation mark to avoid keyword stuffing but if I remove any more of the keyword i will have none left in the content but titles etc. The moz message doesn't go away no matter how many keywords are removed. I am using wordpress i have the keyword the title element, the image alt text, the meta description/title, can't take anymore out of the content nothing seems to change but I can't figure out why?
Moz Pro | | 247mobileservices0 -
SEO best practices and online store?
Hey guys, I'm just starting a company and had a few questions regarding how we should structure our online store. The store is currently selling skins for consoles, phones - and we have wall decals too, as well as fridge wraps. I was wondering if anyone had advice on the best structure of things? Should I, for instance, have a single "Xbox One Wrap" product page with multiple variations as an option? Or should I have individual product pages for each different style? I feel like putting all the weight on a single Xbox One Wrap page is great, but I also feel like having more content out there for each product probably isn't terrible either? Suggestions? The site is www.FapWrap.com so you can check it out - it's original photos we are taking of adult stars, but eventually will be for "Sexy" people in general. Heh.
Moz Pro | | JohnnyRoq0 -
Fresh Web Explorer explorer doesnt seem to work properly
How do I get Fresh Web Explorer explorer to work properly. The feedback I’m getting shows that my brand, Health 2000 had over 4000 mentions on Monday the 13th of January. However when I check out the links that supposedly mention our brand, they bring up general terms related to Health and make no reference to our brand. How can I refine this?
Moz Pro | | Hardley1110 -
Identify business pain points using SEO
Hi, can I use SEO research techniques to identify what kind of services businesses are searching for? Is it possible to find out pain points? I have been using tool like MicroNicheFinder to do such a research but I am not getting any where. Is SEO only used to outrank my competition? Do I need to first know what business I need to be in and then use SEO techniques to research the demand? Do I make sense? You can tell that I am very new at the internet marketing thing. Please let me know. Thanks.
Moz Pro | | zsyed0 -
In alt tag of a image can we use #hashtag or domain.com ? Is that good SEO or not allowed ?
Some of the Google Search shows a title has a hashtag of an article, which contain keyword and while tweeting them, the title which has a hashtag automatically very good used for getting traffic to the blog. And other one, can we use the hash tag inside the alt attribute ? Or our domain name with .com in it. Like Google.com or #Google ?
Moz Pro | | Esaky0 -
Why are we no longer ranking #1 for our brand on the SEOMoz web app?
Been noticing these anomalies for some time now. I'm from eVenues.com and we've found the rank tracker extremely useful to see how our campaigns are doing. I noticed however that we no longer show up in the app as ranking for our brand? I know that results differ according to location and a myriad other variables but I think we're pretty strong as far as our brand name is concerned. I did a quick double check in incognito and, yep, we're still ranking... Any ideas on this?
Moz Pro | | eVenuesSEO0