Why is the Site indexed?
-
Hi,
I'm trying to test a few things for which I've registered and set up new domains.
For the set up I used Wordpress.
Each Site has about three articles in it but no links pointing to them. Also I didn't take any measures to get my site indexed.
However, one week later all my sites were indexed. Why is that and how can it be?
I'm thankful for any answer since the problem is really ruining my test environment.
The only clue I have, as to why this could be happening, is that I didn't remove the ping sites.Is that the reason? Or are there also other reasons?
Thanks
-
I'd defiinitely recommend a password protect or IP included list at .htaccess. From experience I've found that Google tends to ignore no index when you're trying to keep a test environment under wraps. Even worse, if your site is large you can end up with visitors accessing this in error. Maybe add it to GWT but ensure that it is clearly marked to be excluded from the index. Add the .htaccess with an IP allowed list only and add the no-index clearly to each page.
-
What we do for our test environments is password protect the root directory with .htaccess, this can be a test directory on a live domain, or it can be the whole domain depending on needs. This works great when its just you and a handful of people who need access to the site.
-
It'll be because, as you say, you didn't stop them from being pinged. You should have set up the websites robot.txt to prevent any premature crawling. You can also do this in the WP dashboard, under settings, I believe.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Non ecommerce site with high DA, being outranked by lower DA sites with ecommerce - help?
I have a website that we look after, up until January this year the rankings were really strong - the site has a much higher domain authority than the competitors, much more links and much more relevant content (all measured with moz's tools). About 6 months ago the rankings started to dive for national search terms. Now one thing ive noticed is that nearly all of the other sites in the search sell products online where we have no such function - could this be correlated - has anyone else experienced this?
Competitive Research | | rhysc1 -
Our site is slow..
We have noticed that our site is much slower than many of our competitors and expect that this is affecting our organic ranking. We are on dedicated UK Fast server with [20/08/2013 16:44:35] Tony Jackson: Operating System: CentOS 6 64-bit
Competitive Research | | seanmccauley
CPU: 1x Intel Xeon E5-2620 @ 2.0GHz
Memory: 8x 8GB DDR3 RDIMM
Hard Drive: 4x 128GB SSD RAID10
[20/08/2013 16:46:28] Tony Jackson: Nginx, percona, tomcat/solr, Magento CE, cat: 25200 products I could really do with your thoughts on this page for example http://www.pretavoir.co.uk/sunglasses/ray-ban-sunglasses.html0 -
How much time takes Google to Index a page in the search?
Hello all, I have created a page and published it 2 days ago and it does not appear in the Google Search.How much time can usually/on average take to index a page by Google in order to appear in the search results of a web search? I have check the Google Webmaster tools and neither no urls have been reported to be blocked nor the content should be blocked. Thank you very much, Best regards, Antonio
Competitive Research | | aalcocer20030 -
How can stale, poor quality sites rank above fresh, high quality sites?
Dear Community, How is it that a Google search for temperature sensors shows the second result as site **A **(http://goo.gl/zRS1L) in a higher positionthan site B (http://goo.gl/3Xy2O) which is on the 2nd page of the SERPs. Site A blatantly does not follow Google's webmaster guidelines and recommendations for design, content or code. Site B scores an 'A' for on page analysis using SEOmoz, it also has a much higher number of root domains in and Moz rank, we have checked that site B has only quality inbound links, and anchor text is natural, it follows Google's guidelines for content and code diligently, and it is on an older domain. We are satisfied that site B has not been penalised by Google, e.g Penguin algorithm updates. We have also done a website verification with Google. Site B has fresher content compared to site A. Site B also has a sitemap yet site A doesn't. We're satisfied that we can rule out the following Algorithm Factors: Penguin algorithm updates Google Notified penalties Dodgy Inbound links Dodgy Anchor text Website verification with Google Fresh vs. static content Sitemap present Server Speed Server location Domain age and about 170 other algorithm factors Does anyone have any ideas as to why site A is ranking higher than site B in Google.co.uk? Thanks in advance. CD.
Competitive Research | | chichesterdesign0 -
Manta inbound link in OSE - competitor site yes, my site no, why?
Our site has had a link back to our site from Manta for a long time, but it's not appearing in our OSE results. One of our competitors similarly has an inbound link from Manta and that link DOES appear in their OSE results. I'm not certain whether that matters for us. Does it? But in any event, why would the one link appear but not the other? Thanks! Tim
Competitive Research | | tcolling0 -
Free SEO tools appearing in SERPS for a site
Hi there, I've just taken over a site and it doesn't have a huge amount of shelfspace on the SERPs for it's brand name. Looking at the results that are there are a lot of free SEO tools that are coming up. They haven't had an SEO before so it's not coming from their side. There's such a lot of them I was wondering if anyone had come across this before - is it simply a competitor looking at the seo, could it be one of the seo analytics packages using free sites or is there anything else to be aware of. I can start knocking the sites down the SERPs but just wondering if anyone has a good solution for this. thanks Shiv
Competitive Research | | Shivvyt0 -
Search shows site links, but not hyperlinked?
2 of our competitors on Google have site links show in their results which brings you to that specific page. In our listing we show up with the same results a few spots behind them with our site links visible showing very similar content, but are not actually hyper linked. Is there a way to fix the issue and let people actually be able to click on our site links instead of just reading them?
Competitive Research | | sknott0 -
How many Page Rank 8 sites are there?
Anyone have any estimate of how many Page Rank 8 sites are out there? Best, Steve
Competitive Research | | Aggie0