Launching Website
-
We are developing a new website and thinking google would not find it because of the directory we put it in (no homepage yet) and because there are no links to it. For example, we are building it in this directory example.com/wordpress/ but somehow google found it and indexed pages not ready to be indexed.
What should we do to stop this until we are ready to launch? Should we just use a robots.txt file with this in it?
User-agent: *
Disallow: /Will this create repercussions when we officially launch?
-
Thank you
-
Thanks!
-
You are correct with your approach.
And as Paddy states, once you launch, remove the disallow and the crawlers will find you.
I would also suggest that once you launch that you submit a sitemap to all of the major search engines to be found even quicker and to help ensure that all of your site pages are crawled.
Mike
-
yes, use the robots file to deindex, once your ready to launch remove the disallow, and the next time google crawls your site you should get indexed.
you must have been linked from somewhere for google to find you, so it means google will find you quicker once you ready to launch ( you already have a backlink)
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Big drop in organic traffic after new site launched
Hi There, I have had a drop of around 40% in site traffic since we migrated our site from Magento to Woocommerce. The products were migrated across and kept the same title tags, meta descriptions, copy etc... I set up 301's on the top 100 landing pages and submitted a new site map using Google Web Master Tools. It looked like the traffic was coming back to where it was but the gap has widened again. Can anyone advise me on what I may have missed or how to go about diagnosing the problem and fixing it
Technical SEO | | JonesBros0 -
UK rankings disappeared after US website launch
Hi all, I had a client that recently released a US version of their UK website and put it live without informing me first! Once I saw it (about 3/4 days later) I immediately asked them to include the rel=alternate tag onto both websites. However, in the meantime our UK rankings have all gone and it seems as if Google has just kicked the UK website. How long will it take for our rankings to return to normal? Thanks for the advice, Karl
Technical SEO | | KarlBantleman0 -
How long does it take to reindex the website
Generally speaking, how long does it take for Google to recrawl/reindex an (ecommerce) website? After changing a number of product subcategories from 'noindex' back to 'index', I regenerated the sitemap and have fetched as Google in WMT. This was a couple of weeks ago and no action yet. Second question: Does Google treat these pages as if they're brand new? I 'noindexed' them back in April, and they were ranking ok then. (I had noindexed them on the back of advice from my SEO, due to concerns about these pages being seen as duplicate content). Help!
Technical SEO | | Coraltoes770 -
Does Google see the connection between our 2 websites?
We have a main website and we created a satellite site to support the original one with backlinks. Can I add both sites to the same Google Analytics profile? My programmer said that there is no reason to use a new GA profile for the satellite site, since Google will see the connection between the 2 websites via scripts, Google Plus buttons and other programmed solutions. So, is there a reason to use a new GA account for the satellite site (and later the new satellite sites) as well?
Technical SEO | | Romaine0 -
301 redirect + new website copy
Hi There, We are currently redeveloping our website and we're rewriting and optimising our many of our service pages. I think I may already know the answer but should we apply 301 redirects from our old services pages to the new versions? The content subject matter will be the same on the new versions, they will just be completely reworded. I would be interested to hear your views. Thanks, Stu
Technical SEO | | Stuart260 -
Duplicate Page Title for a Large Listing Website
My company has a popular website that has over 4,000 crawl errors showing in Moz, most of them coming up as Duplicate Page Title. These duplicate page titles are coming from pages with the title being the keyword, then location, such as: "main keyword" North Carolina
Technical SEO | | StorageUnitAuctionList
"main keyword" Texas ... and so forth. These pages are ranked and get a lot of traffic. I was wondering what the best solution is for resolving these types of crawl errors without it effecting our rankings. Thanks!0 -
2 websites 1 Google account?
quick question, I have set up my second website purely for seasonal stock so getting it online early ready for when the time is right. But i only have a single web master tools & ad words account, would there be any problem with the single accounts having the details for both websites? or would it be wise to have separate accounts for each site?
Technical SEO | | GarethEJones0 -
How to attach at text to image that other websites use from my website
I often have other websites link to my website. They will do this with an image that they pull off of my website. (actually my website continues to serve the image). These inbound links are great, but they don't have alt text. Is there a way for me to attach alt text to the images, or is this something the other website needs to code themselves?
Technical SEO | | EugeneF0