We would like to know where googlebots search from - IP location?
-
We have a client who has two sites for different countries, 1 US, 1 UK and redirects visitors based on IP. In order to make sure that the English site is crawable, we need to know where the googlebot searches from. Is this a US IP or a UK IP for a UK site / server?
-
Yeah - thats what we thought, we were surprised not to be able to find any links or anything on it!
-
Can't find the reference now, but I'm 99% certain googlebot only crawls from US IP addresses.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Crediting a second website when I have 2 setup depending on location
Hello Moz Community! I'm a bit stuck with this one and have read a few varying answers! Basically I have an eCommerce website on a .com domain name selling to the UK and Europe currently. I have recently created a very similar selling the same products but solely to the US with a .US domain name. What is the best practice with this, will the 2 separate sites be okay left as they are, or do I need to credit the UK site from the US site as they are incredibly similar? The sites are: www.rhinox-group.com www.rhinox-group.us Thanks in advance!
Intermediate & Advanced SEO | | josh.sprakes0 -
How do internal search results get indexed by Google?
Hi all, Most of the URLs that are created by using the internal search function of a website/web shop shouldn't be indexed since they create duplicate content or waste crawl budget. The standard way to go is to 'noindex, follow' these pages or sometimes to use robots.txt to disallow crawling of these pages. The first question I have is how these pages actually would get indexed in the first place if you wouldn't use one of the options above. Crawlers follow links to index a website's pages. If a random visitor comes to your site and uses the search function, this creates a URL. There are no links leading to this URL, it is not in a sitemap, it can't be found through navigating on the website,... so how can search engines index these URLs that were generated by using an internal search function? Second question: let's say somebody embeds a link on his website pointing to a URL from your website that was created by an internal search. Now let's assume you used robots.txt to make sure these URLs weren't indexed. This means Google won't even crawl those pages. Is it possible then that the link that was used on another website will show an empty page after a while, since Google doesn't even crawl this page? Thanks for your thoughts guys.
Intermediate & Advanced SEO | | Mat_C0 -
How do I know if I am correctly solving an uppercase url issue that may be affecting Googlebot?
We have a large e-commerce site (10k+ SKUs). https://www.flagandbanner.com. As I have begun analyzing how to improve it I have discovered that we have thousands of urls that have uppercase characters. For instance: https://www.flagandbanner.com/Products/patriotic-paper-lanterns-string-lights.asp. This is inconsistently applied throughout the site. I directed our website vendor to fix the issue and they placed 301 redirects via a rule to the web.config file. Any url that contains an uppercase character now displays as a lowercase. However, as I use screaming frog to monitor our site, I see all these 301 redirects--thousands of them. The XML sitemap still shows the the uppercase versions. We have had indexing issues as well. So I'm wondering what is the most effective way to make sure that I'm not placing an extra burden on Googlebot when they index our site? Should I have just not cared about the uppercase issue and let it alone?
Intermediate & Advanced SEO | | webrocket0 -
How to Submit My new Website in All Search Engines
Hello Everyone, Can Any body help to suggest Good software, or Any other to easily Submit my website , to All Search Engines ? ? Any expert Can help please, Thanx in Advance
Intermediate & Advanced SEO | | falguniinnovative0 -
Unnatural Links Warning Disappeared from Search Console Account
Hello all, In 2013 I had an Unnatural Links Warning message in my GWT account. I believe that it was a result of the work of an old SEO company. When I received the warning I was working with an SEO. He helped me clean up some links. He also uploaded a disavow file for me. He did not file a reconsideration request. He told me that it was not necessary at the time. The message disappeared from my account. A few months ago a similar message appeared in the manual accounts section of my account. I gathered inbound links from GWT, Majestic, etc. I went through them myself and tried to contact lots and lots of webmasters. I got many links cleaned up. I spent several months on this project. I just logged into my Search Console account this afternoon and clicked through everything and guess what... that manual penalty message is gone. So... what does that mean? I assume that I should still upload the disavow file for the sites that did not respond to me that are spammy. Should I still try to file a reconsideration request even though there doesn't seem to be a manual penalty? How should I proceed? Thanks. Melissa
Intermediate & Advanced SEO | | pajamalady0 -
Google + Listings in Paid Search Area (with screenshot)
Hi Forum! How do I replicate how this company (Eloqua) has placed their Google+ page on the right side of SERPs where normally paid ads are? (see attached image) I took this screenshot earlier this morning, but for some reason I cannot re-create it. Thanks for all your help! googleplus-1.png
Intermediate & Advanced SEO | | Travis-W0 -
High search volume keywords
The problem is that our index is not in serps anymore with the high volume keywords (Pfizer, Roche, johnson & johnson).
Intermediate & Advanced SEO | | bele
We still keep these keywords in title, but it brings not much results. We made page www.domain.com/pfizer , added there Pfizer products with unique descriptions.
Product pages started to drive visitors, but not the www.domain.com/pfizer page. If we add a blog to the top of this page and add unique posts about Pfizer company news, would it help?
In this case this page would be unique, refreshed with new info, and have rotating pfizer products. Maybe some other suggestions?0