IP address URLs being indexed, 301 to domain?
-
I apoligize if this question as been asked before, I couldnt' find in the Q&A though.
I noticed Google has been indexing our IP address for some pages (ie: 123.123.123.123/page.html instead of domain.com/page.html). I suspect this is possibly due to a few straggler relative links instead of absolute, or possibly something else I'm not thinking of.
My less-evasive solution a few months back was to ensure canonical tags were on all pages, and then replaced any relative links w/ absolutes. This does not seem to be fixing the problem though, as recently as today new pages were scooped up with the IP address.
My next thought is to 301 redirect any IP address URL to the domain, but I was afraid that may be too drastic and that the canonical should be sufficient (which it doesn't seem to be). Has anyone dealt with this issue? Do you think the 301 would be a safe move, any other suggestions?
thanks.
-
KT I think you are telling us that you have a static domain. As in your domain is the only domain on that IP address here is an example of what I'm talking about http://www.whatismyip.com/faq/difference-between-static-ip-address-and-dynamic-ip-address.asp if that is what you meant "by some sites (who do things well) 301 on the IP, others don't so I wasn't sure if I was missing something"
I would say the only chance of any site doing well in the search engine world is if it is a static domain obviously gone over that still there are very many security reasons to have a DHCP over static IP if somebody decides to attack your site for whatever reason you are a sitting duck with a static IP at least a DHCP can change it and the way all the search engines are set up now a virtual IP domain name or DHCP is treated just as if it were a static IP to Google there is no difference the DNS domain name service has to take those numbers and turn them into a readable user friendly word we can remember I think you're confused about the difference between an IP and a domain regardless of what you do your site will suffer greatly if you do not do a 301 redirect or some sort of mapping as I suggested and please understand that is a guess I don't know that a robot.txt would be sufficient I would strongly suggest because you're putting so much time and effort into making a website that you want to rank well on the search engine's using a 301 redirect whether or not use static IP or domain on a DHCP here is some more info as well http://en.wikipedia.org/wiki/URL_redirection
I wish you the best with this please do inform me of any way that you have of knowing you will not be victim to the same issues everyone else's when it comes to duplicate the links duplicated content. I do know Google bots don't just stop when they see no follow they go on and they indexed everything then they decide what they wanted for you to rank well. I think it would be more than confusing when you type site:example.com and site: www.example.com into Google only to find you spent time building links for one of your two websites.
Regardless I wish you the best on your endeavor,
Thomas
-
-
Hi Ryan,
Unfortunately English is not my first language I am a German (I live in the states as well but primarily English is not my strong point) I am telling you this because when I had written that reply I used voice recognition system and unfortunately have not been able to find the data I will reinvestigate where I was saying so that it makes more sense. I do know this 301 redirects to slow things down and I am saying this without expert knowledge so please take what I'm saying with a grain of salt. My understanding is the reason you need a 301 redirect is to eliminate the double content issue Google will from what I understand punish you for trying to use your same old content more than once especially if it is in a setting that is absolutely identical. I have been told blogs are held to different standards. The main problem I can definitely understand is most people I believe don't think www. is a subdomain when in fact it is much like three days www.example.com and blog.example.com are very much alike in fact one could make the argument if it wasn't for what the W. stands for World Wide Web and people just getting used to typing them in me might be better off as almost every hosting platform/webmaster platform or tools allows you to redirect your personal preference. For instance http://twitter.com has no www.and that makes sense for them they are trying to use the least amount of keys and is a web app. Where someone like Acme huge corporation would never dream of not having the address be written with www.acme-huge-corporation.com because the average web user believes website start with four things www. and unless you're using a CMS or CDN (that essentially does what the 301 redirect does) you will create duplicate content and be penalized when you build links because some will go to the non-WW W. and others to the root by making them more in the same all year SEO efforts go towards the same thing and don't forget by duplicating pages Google will most likely punish you. I do have a theory about how to get around using a 301 redirect and still keep the speed you deserve and not be punished for the things I spoke about earlier.I would like this to be confirmed before any of you spend your time trying what I'm guessing might work in the situation. You would design your robot.txt file to only include URLs ending with / so when you run your sightmap.xml or sightmap.aspx believe it or not they both use XML overall ASP just hangs out on server-side. You will see that there are two of every page like http://www.ColdFusionisstillmyfavorite.com/ Then under it or above you should see http://www.ColdFusionisstillmyfavorite.com the way I theorize you can make this work is tell the robots.txt to no follow the links without / it is my opinion they will follow them anyway but relay to Google that the information you're site map I wanted to take allowing for Google to hopefully not include your duplicate content and all is right in the world. This time to let everyone know fire host is a fantastic host however if the price is steep which if you're running one site or two obviously it's more than you need to pay I want to share with you a couple alternatives first media Temple V.E very fast but I'm not a lie media Temple gets bad rap from their GS server primarily and having been a customer of theirs only on the DV & VE I can assure you there still is a lot of bugs in GS because every time I would log in there were something about GS being down or worse. Having said that I do like media Temple as a company I know they are replacing GS with CS that has been in work the works for while and I believe it will fix the problems I know most of you guys here unless thinking of VE or DV our saying thanks a lot for the tip, well I did my best and I would strongly suggest http://vps.net/ they have everything media Temple has including a larger CDN in addition to having a full data center in England and the United States and an excellent uptime rating were talking the same service better speed and uptime of rack space there cost is around $20 and up but they offer huge at least to myself good reason to try them out one being cloud VPS Beta with unheard of speed okay I'll tell you outside their network according to them there over 1 Gb if that's not enough the owner of woohoo templates is a investor and you guessed it you get a free professional WordPress template with all the bells and whistles along with SEO as an option. I do know the high-end word press templates are extremely well optimized so my recommendation for the is out right now is if you don't have a good host and please feel free to correct me if I'm wrong I'm not stating anything meant to offend but I do believe you get what you pay for and I would pay for this http://vps.net/ is going to give you I believe the best thing for your buck where else can you get the elasticity of Amazon with excellent free service 24 seven cloud backup and an interface just as pretty as media temples that's saying a lot. Just to let you know I have nothing to do with any of these companies I see no profit by telling you what I know. ◦ Smart Hosting - The latest Cloud technology packaged up in an easy to understand web hosting or VPS package.
- 100% Uptime - Auto-healing and auto-scaling for your website or VPS ensures 100% availability.
- Ready to Run Templates - Deploy one of the 100's of ready rolled VPS templates or create your own in minutes.
- No contracts - Pay daily or monthly and only for what you want to use, be in control of your billing.
Try us for $1 - Sign up for a daily VPS node now!
In the near future we will introduce the ability for users to download/upload these templates (for local testing and modifications), and migrate/copy them to another Cloud, also at the moment all accounts are limited to 1 FREE custom template slot, the ability to purchase additional slots will also be added soon.
. I think you can get it the same or better performance out of mediatemple.net/ V.E it has solid state hard drive standard but you must be very comfortable with out a GUI you login using SS H. that's it and there's not much support but it's probably the fast site for $30 a month and if you want to add Media Temple'sPro CDN it is in fact hosted by edge network and I believe that $29 month an outstanding deal. However I know I mentioned I would bring this up my last post I am glad I'm able to give it to you here CloudFlare keep in mind they are company that allows for basic domestic US only CDN you are in no way forced to use media Temple you can add it for free to any web host you can control the DNS on at no cost at all unless like there their higher packages ( I think it uses openDNS.com which is another fantastic program that is free I highly recommend to everyone) so much like OpenDNS.com you get it free virus, spam bots you name it protection along with faster overall download speeds especially to people using slower connections. Remember just because somebody isn't running fiber does not mean they're not worth giving the best experience to and advertising just as much to. Most people run somewhere in the middle of what the fastest possible ISP provides for their area of the world. I'm running fiber at 40 Mb symmetrical right now but that's new and for the past five years I paid more money just to get 25 Mb download and nearly 3 Mb up. What I'm saying is if you optimize your site correctly then either use Google to rewrite your site for speed or not you are going to get in much quicker website than taking something that you bought that is not optimized at all and paying Google to magically rewrite then pushed the site. You only get a 10% improvement in less the site is fundamentally sound. If you need to rewrite depending on your side of course some of these high-end WordPress templates are free with http://vps.net/I hope I've hope someone. I am extremely sorry if I got off track a little bit I am chemical engineering on German time so I must go thank you all so much for taking my opinion into consideration please leave me feedback about your thoughts on my theories or if you do turn out how they went I will do the same. I do ask if you don't like what my opinion is you can just say it's not your thing I am not opposed to hearing anything that gets to the bottom line having said that I have years of this under my belt have worked with many companies Web trends Adobe Omniture & HubSpot. Please don't think I am ranking companies as SEOMOZ is the backbone of some of the best SEO's in the world.
Hope this helps people also check out http://builtwith.com/ their free services ability to tell you exactly what's running on your website is amazing. I also would like to tell every one at SEO moz thank you for the new keyword tip it has not hurt been my raking not having them in addition you are very right all I can really do with them is show my competitors what I've been working on.
Respectfully,
Thomas
PS
http://mediatemple.net/cloudflare/#about
Whats is CloudFlare?
It’s a free CDN (content delivery network) with a security layer that ’just works‘ in conjunction with your existing hosting service. When we learned about it, we knew our customers had to have it.
-
How does it work?
CloudFlare re-routes your sites’ traffic through its global network; blocking threats and caching content. This saves your bandwidth & resources while speeding up load times.
-
Will it work for any of my services?
It will work for any (mt) hosting service. Not a customer yet? Get started with Media Temple web hosting.
-
How do I enable it on my (mt) service?
Quick & simple set-up via the AccountCenter will have you up and running in 5 minutes! Step-by-step instructions can be found in the How do I enable CloudFlare? article.
-
Does CloudFlare support SSL?
Yes, however, in order to use SSL (https://) you’ll need to upgrade to a paid service through CloudFlare.
-
Where do I put my files?
You upload all your files to your (mt) hosting service as usual.
-
What happens when I update my website?
(mt) will serve any new files while CloudFlare updates its global network. You also have control over your cache settings.
-
Can I turn CloudFlare off?
That’s simple. Just disable it in your AccountCenter. Step-by-step instructions here: How do I disable the CloudFlare service?
-
-
mtipolyexe, your reply seems very thought out and helpful, but I can't tell for sure as something went wrong when you added it and it breaks the horizontal frame of a normal Q&A reply. Can you please fix your response so we can all read it?
-
I feel like a lot of people are told 301 redirects are a must. There is a downside most of it involves slowing your page response time. I do believe firmly though at this time we must use 301 redirects or risk putting all of our work into what could amount to only one half before we did as it is split between the two pages created when we make a domain. The other huge problem without 301 redirects is Google will bring down the hammer so to say for duplicate content. You can have a good amount of duplicate content special in a blog but exact is going to hurt you. I dealt with this same issue I strongly strongly suggest making up for the speed difference with two Links I’m adding that have different ways that should be applied to everyone’s site elements one be and compensate http://code.google.com/speed/articles/ next is an excellent tool to tell you what you can improve under site http://developer.yahoo.com/yslow/ this is were my personal favorites as people around the world don’t always have the same Internet connection speeds I can tell you with absolute certainty the money is just as green from a person who uses dial up as it is for a person using fiber http://www.webpagetest.org/
my most valuable thing I can probably gift to you is this link http://www.readwriteweb.com/archives/15_tools_to_help_speed_up_your_website.php
they are nothing short of true wealth of information on how to handle 301 redirects and the speed difference I have for sites and currently use CDN's include Akamai, Limelight Networks their goals our as fast as you can there are others listed in the readwriteWeb.com above and
now if you are thinking God Tom you just told me a lot of stuff that could be very expensive and a lot of work and you would be right. So if you want the totally turnkey option please been introduced Google's new system http://code.google.com/speed/pss/index.html FYI Google uses http://tools.pingdom.com/ so should you it's free media Temple is an excellent host that offers a free CDN in addition to a proceed in for $25 a month. I use http://www.firehost.com and they come with a free CDN that is excellent it handles video overall worst-case scenario you have a poorly written website is and effect and might need it to be completely rewritten with. I think that readwriteweb.com is your best bet. Sorry I was so long-winded I really hope this is viable information to somebody hopefully you and best of luck to you.
Don't let this happen to you
Every day, more than 99 human years are wasted because of uncompressed content. Although support for compression is a standard feature of all modern browsers, there are still many cases in which users of these browsers do not receive compressed content. This wastes bandwidth and slows down users' interactions with web pages.
One of the great things about using a popular JavaScript library like JQuery or Dojo is that Google offers a content distribution network and loading architecture, which means the scripts load very quickly. But what about smaller JavaScript libraries?
That’s where CDN JS comes in. The newish site offers CDN hosting for less popular, but still useful JavaScript libraries. The site uses Amazon CloudFront, along with Amazon S3 for DNS, making it, in all likelihood, faster than serving the same scripts off your own server. You can check out the uptime stats for CDN JS on Pingdom.
CDN JS doesn’t have everything, but they do have one script many developers use all the time these days — Modernizr. If there’s a library you’d like to see hosted, be sure to let CDN JS know.
We’d like to see the site make it possible to combine scripts — say, load Modernizr and respond.js (not currently available at all) — into a single, minified script, but even as it stands, loading two scripts from a CDN is often faster than a single script from your own server.
[edited by KeriMorgret so it won't scroll horizontally]
-
I typically use this in an .htaccess file:
RewriteCond %{HTTP_HOST} ^[0-9]+(.[0-9]+){3} [OR]
RewriteCond %{HTTP_HOST} !^www.yourdomain.com$ [OR]
RewriteCond %{HTTP_HOST} ^yourdomain.com [NC]
RewriteRule ^(.*)$ http://www.yourdomain.com/$1 [L,R=301]Explanation: If it is an ip, doesn't start with www, or doesn't have the www, rewrite it to the http://www.
-
Thanks Ryan, not too concerned about the process of performing a 301, just looking more for agreement on if it's the best practice in this scenario. Some sites (who do things well) 301 on the IP, others don't so I wasn't sure if I was missing something.
thanks again.
-
A 301 is definitely preferable over a canonical. I would recommend a simple regex expression to 301 redirect any IP related traffic to the relative page on your chosen domain.
Example: 123.123.123.123/welcome would be redirected to mysite.com/welcome
This can be achieved with a single rule. The code for the rule would vary based on your server setup. If you are on managed hosting, your host can set this up for you.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
301 Re-directing 'empty' domains
Hello, My client had purchased a few domains and 301 re-directed them, pointing to our main website. As far as I am aware the 'empty domains' are brand related but no content has ever been displayed on them, and I doubt they have much authority. The issue here is that we took a dive in ranking for our main keyword, I had a look on ahrefs and found the below: | www.empty-domain/our-keyword | 30 | 19 | 1 | fb 0
Technical SEO | | SO_UK
G+ 0
in 4 | REDIRECT 301 TO www.main-domain/our-keyword | 8 Feb '175 d | The ranking dip happened at the same time as the re-direct was re-discovered / re-crawled. Could the 'empty' URL in question been causing us any issues? I understand that this is terrible practice for 301 redirects, I was hoping someone in the community could shed light on any possible solution for this.0 -
301 Redirects, Sitemaps and Indexing - How to hide redirected urls from search engines?
We have several pages in our site like this one, http://www.spectralink.com/solutions, which redirect to deeper page, http://www.spectralink.com/solutions/work-smarter-not-harder. Both urls are listed in the sitemap and both pages are being indexed. Should we remove those redirecting pages from the site map? Should we prevent the redirecting url from being indexed? If so, what's the best way to do that?
Technical SEO | | HeroDesignStudio0 -
Migrating domains from a domain that will have new content.
We have a new url. The old url is being taken over by someone else. Is it possible to still have a successful redirect/migration strategy if we are redirect from our old domain, which is now being used by someone else. I see a big mess, but I'm being told we can redirect all the links to our old content (which is now used by someone else) to our new url. Thoughts? craziness? insanity? Or I'm just not getting it:)
Technical SEO | | CC_Dallas0 -
How can I see the SEO of a URL? I need to know the progress of a specific landing-page of my web. Not a keyword, an url please. Thanks.
I need to know the evolution on SEO of a specific landing-page (an URL) of my web. Not a keyword, a url. Thanks. (Necesito saber si es posible averiguar el progreso de una URL específica en el posicionamiento de Google. Es decir, lo que hace SEOmoz con las palabras clave pero al revés. Yo tengo una url concreta que quiero posicionar en las primeras posiciones de Google pero quiero ver cómo va progresando en función a los cambios que le voy aplicando. Muchas gracias)
Technical SEO | | online_admiral0 -
When to 301 a No1 ranking site to the new domain?
I have a site [company.com] that ranks number one for the products of my brand but I'm moving all the efforts to a dedicated brand domain. The old site covered a number of small brands and we had no dedicated brand sites, but we now focus on just this one brand and it doesn't belong on the old company domain name. BRAND belongs on the new brand.com Because of the age of the old company site and because it had the first copy about the brand, it's still ranking well for the brand product names, and the new site has some duplicate content issues that I'm in the throws of resolving. RANKS Company.com : number one for all product names Brand.com : nowhere for product brand names but top for the brand name (as I say, the product pages on this site have duplicate content issues which is likely keeping them ranked low - Hades low. I would rather not maintain two websites and I want to give brand.com every bit of available oomph , so should I at some point 301 the old company site to the new one? If so, is now the time? Thanks
Technical SEO | | Brocberry0 -
Domains
My questions is what to do with old domains we own from a past business. Is it advantages to direct them to the new domain/company or is that going to cause a problem for the new company. They are not in the same industry.
Technical SEO | | KeylimeSocial0 -
Google , 301 redirects, and multiple domains pointing to the same content.
Google, 301 redirects, and multiple domains pointing to the same content. This is my first post here. I would like to begin by thanking anyone in advance for their help. It is much appreciated. Secondly, I'm posting in the wrong place or something please forgive me simply point me in the right direction I'm a quick learner. I think I'm battling a redirect problem but I want to be sure before I make changes. In order to accurately assess the situation a little background is necessary. I have had a site called tx-laws.com for about 15 years. It was a site that was used primarily by private resource and as such was never SEO'd. The site itself was in fact quite Seo unfriendly. despite a complete lack of marketing or SEO efforts, over time, SEO aside, this domain eventually made it to page one of Google Yahoo and Bing under the keywords Texas laws. About six months ago I decided to revamp the site and create a new resource aimed at a public market. A good deal of effort was made to re-work the SEO. The new site was developed at a different domain name: easylawlook up.com. Within a few months this domain name surpassed tx-laws in Google and was holding its place in position number eight out of 190 million results. Note that at this point no marketing has been done, that is to say there has been no social networking, no e-mail campaigns, no blogs, -- nothing but content. All was well until a few weeks ago I decided to upgrade our network and our servers. During this period there was some downtime unfortunately. When the upgrade was complete everything seemed fine until a week or so later when our primary domain easy law look up vanished off Google. At first I thought it was downtime but now I'm not so sure. The current configuration reroutes traffic from tx-laws to easylawlookup in IIS by pointing both domains to the same root directory. Everything else was handled through scripting. As far as I know this is how it was always set up. At present there is no 301 Redirect in place for tx-laws (as I'm sure there probably should be). Interestingly enough the back links to easylaw also went away. Even more telling however is that now when I visit link: easylawlookup.com there is only one link, and that link is to a domain which references tx-laws not easy law. So it would appear that I have confused Google with regards to my actual intentions. My question is this. Right now my rankings for tx-laws remain unchanged. The last thing I want to have happen is to see those disappear as well. If easy law has somehow been penalized and I redirect tx-laws to easy through a 301 will I screw up my rankings for this domain as well? Any comments or input on the situation are welcome. I just want to think it through before I start making more changes which might make things worse instead of better. Ultimately though, there is no reason that the old domain can't be redirected to the new domain at this point unless it would mean that I run the risk of losing my listings for tx-laws, ending up with nothing instead of transferring any link juice and traffic to easy law. With regards to the down time, it was substantial over a couple of weeks with many hours off-line. However this downtime would have affected both domains the only difference being that the one domain had been in existence for 15 years as opposed to six months for the other. So is my problem downtime, lack of proper 301 redirect, or something else? and if I implement a 301 at this point do I risk damaging the remaining domain which is operational? Thanks again for any help.
Technical SEO | | Steviebone0 -
How to remove a sub domain from Google Index!
Hello, I have a website having many subdomains having same copy of content i think its harming my SEO for that site since abc and xyz sub domains do have same contents. Thus i require to know i have already deleted required subdomain DNS RECORDS now how to have those pages removed from Google index as well ? The DNS Records no more exists for those subdomains already.
Technical SEO | | anand20100