Allowing correct crawlers for GeoIP Redirect
-
Hi All,
I am working on an international site and we have started running into issues with crawlers successfully crawling the site.
GeoIPEnable On
Redirect one country
RewriteEngine on
RewriteCond %{ENV:GEOIP_COUNTRY_CODE} ^US$
RewriteCond %{HTTP:X-Host} !.nexcesscdn.net$ [NC]
RewriteRule ^(.)$ https://us.website.com/ [R,L]The main reason for working on a hard GEOIP redirect would be that we are unable to show certain products in certain regions, the customer should not be given the option which is best practice.
Can anyone advise?
Thanking in advance.
-
Actually, geo-basedIP redirects are still a very bad idea from a user and bot perspective.
- While Google has said it is testing crawling from other areas, they still primarilycrawl from the US. If you do Geo-basedredirects, they will only ever see the US content.
- Users travel. People travel. Assuming a user should only see a certain set of content based on their physical location is assuming too much.
- Use case in the consumer field: While attending a friend's wedding in London, I could not get to the US version of a site where I wanted to buy furniture to be delivered in a few weeks.
- Use case in business: Users travel for business all the time. If they are visiting a headquarters in another country but researching a topic for use in their home country, they might be seeing the "wrong content."
Rather than assuming, use IP detection to ask the user to set their location. "We see you are in the UK, do you want to set that as your preferred location?" Once they choose their location, a cookie is set and that is all that user sees from then on out, until they change that setting in the footer or in their account.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
batch 301 redirects with an external tool
Hi, I am migrating my e-commerce to another platform of a internet company in Brazil (Tray) that has no way to redirect 301 urls in batch, I also do not have access to files and ftp of it. Anyway, as I have hundreds of urls, I would like to know if there is any way to do batch redirects with an external platform tool? Thank you very much in advance
Intermediate & Advanced SEO | | didi090 -
Did We Implement Structured Data Correctly?
Our designer/developer recently implemented structured data on our pages. I'm trying to become more educated on how it works since I'm the SEO marketing specialist on the team and the one that writes and publishes the majority of our content. I'm aware it's extremely important and needs to be done, I just don't know how to do it yet. The developer was on our team for over a year, we recently let him go. Now, I'm going through all the pages to make sure it's done correctly. I'm using the structured data testing tool to look at the pages and have been playing with the structured data markup helper. I would REALLY appreciate it if one of my fellow MOZ fans & family can help me determine if it's done correctly. We do not currently have any schema plugs installed that I know of. So I'm not sure how he implemented the Schema code. I would like to know what I need to do moving forward to the additional content we publish as well as what to do to correctly implement Schema if not already. When I manually look at one of our FAQ pages I see multiple schema data formats detected... I'm not sure if we're supposed to have multiple or just one----> https://www.screencast.com/t/TjHphL7jsI I also noticed in the Question schema data for that same page... the accepted answer is empty. I would image that should have the short version of the answer to the question in it?--->https://www.screencast.com/t/e6ppXkhXd7QS Here's a screenshot of our structured data info from Google search console---> https://www.screencast.com/t/KHj4BGgdrZ4m HELP please! Our website consists of 25-30 "product" pages https://www.medicarefaq.com/medigap/ https://www.medicarefaq.com/medicare-supplement/ https://www.medicarefaq.com/medigap/plan-f/ https://www.medicarefaq.com/medicare-supplement/plan-f/ We currently have about 75 FAQ pages and adding 4-6 per month. This is what brings in most our traffic. https://www.medicarefaq.com/faqs/2018-top-medicare-supplement-insurance-plans/ https://www.medicarefaq.com/faqs/2018-medicare-high-deductible-plan-f-changes https://www.medicarefaq.com/faqs/medicare-guaranteed-issue-rights We have 100 state specific pages (two for each state) https://www.medicarefaq.com/medicare-supplement/florida/ https://www.medicarefaq.com/medigap/florida/ https://www.medicarefaq.com/medicare-supplement/California/ https://www.medicarefaq.com/medigap/California/ We have 20ish carrier specific pages https://www.medicarefaq.com/medicare-supplement/humana/ https://www.medicarefaq.com/medicare-supplement/mutual-of-omaha/ Then we have about 30 blog pages so far and are publishing new blog posts weekly https://www.medicarefaq.com/blog/average-age-retirement-rising/ https://www.medicarefaq.com/blog/social-security-benefit-increase-announced-2018 https://www.medicarefaq.com/blog/new-california-bill-force-drugmakers-explain-price-hikes
Intermediate & Advanced SEO | | LindsayE0 -
Is it worth redirecting?
Hello! Is there any wisdom or non-wisdom in taking old websites and blogs that may not be very active, but still get some traffic, and redirecting them to a brand new website? The new website would be in the same industry, but not the same niche as the older websites. Would there be any SEO boost to the new website by doing this? Or would it just hurt the credibility of the new website?
Intermediate & Advanced SEO | | dieselprogrammers0 -
Blog subdomain not redirecting
Over the last few weeks I have been focused on fixing high and medium priority issues, as reported by the Moz crawler, after a recent transition to WordPress. I've made great progress, getting the high priority issues down from several hundred (various reasons, but many duplicates for things like non-www and www versions) to just five last week. And then there's this weeks report. For reasons I can't fathom, I am suddenly getting hundreds of duplicate content pages of the form http://blog.<domain>.com</domain> (being duplicates with the http://www.<domain>.com</domain> versions). I'm really unclear on why these suddenly appeared. I host my own WordPress site ie WordPress.org stuff. In Options / General everything refers to http://www.<domain>.com</domain> and has done for a number of weeks. I have no idea why the blog versions of the pages have suddenly appeared. FWIW, the non-www version of my pages still redirect to the www version, as I would expect. I'm obviously pretty concerned by this so any pointers greatly appreciated. Thanks. Mark
Intermediate & Advanced SEO | | MarkWill0 -
Is a 301 Redirect and a Canonical Tag on Uppercase to Lowercase Pages Correct?
We have a medium size site that lost more than 50% of its traffic in July 2013 just before the Panda rollout. After working with a SEO agency, we were advised to clean up various items, one of them being that the 10k+ urls were all mixed case (i.e. www.example.com/Blue-Widget). A 301 redirect was set up thereafter forcing all these urls to go to a lowercase version (i.e. www.example.com/blue-widget). In addition, there was a canonical tag placed on all of these pages in case any parameters or other characters were incorporated into a url. I thought this was a good set up, but when running a SEO audit through a third party tool, it shows me the massive amount of 301 redirects. And, now I wonder if there should only be a canonical without the redirect or if its okay to have tens of thousands 301 redirects on the site. We have not recovered yet from the traffic loss yet and we are wondering if its really more of a technical problem than a Google penalty. Guidance and advise from those experienced in the industry is appreciated.
Intermediate & Advanced SEO | | ABK7170 -
301 Redirect from unused domain
Hi All First question here so go easy.. I have a property site which is working well so far considering it;s early days, unfortunately some of my earlier efforts did not go so well and one in particular I pretty much destroyed in my attempts to improve the site SEO. Lucky enough my SEO skills have improved quite a bit lately, largely thanks to the great tools, tutorials and experts here at Moz 🙂 My question is whether I can use a 301 redirect to pass the domain authority and any link equity from an unused site to the one that ive done a better job on? it would seem a little sketchy to me and I would prefer not to get slapped and penalized "again" for doing something dodgy... Thanks everyone and thanks for all the help over the last 6 months or so.. Wes Dunn
Intermediate & Advanced SEO | | wesdunn19771 -
Problem with redirects in coldfusion
How to redirect pages in cold fusion? If using ColdFusion and modrewrite, the URL will never be redirected from ModRewrite.
Intermediate & Advanced SEO | | alexkatalkin0 -
Redirecting, then redirecting back
Hey, mozzers! My first question ever... I have a client who has (fictitionally) WickerPatioHomeStore.com, which features wicker home decor. Not too long ago, they wanted a shorter, easier URL, so they redirected to another domain they own, WickerPatio.com (again, fictional). They saw somewhat of a drop in traffic, and wonder if there's a correlation with the words "home store" not being in their domain any more. When considering the two, I figure that relevant factors would be age of domains, history of content of the domains, and inbound links to each domain. Any thoughts on other things to consider? Thanks very much!! ~ Scott
Intermediate & Advanced SEO | | GRIP-SEO0