Changes in Sitemap Indexation in GWT?
-
I've noticed some significant changes in the number and percentage of indexed URLs for the sitemaps we've been submitting to Google. I've been tracking these numbers directly from Google Webmaster Tools>Site Configuration>Sitemaps. We've made some changes that could be causing the changes we're seeing, but I want to confirm that this wasn't just a change in the way Google reports the indexation.
Has anyone else noticed major changes, greater than a 30% change, in the indexation of your sitemaps in the past week?
Thanks,
Joe
-
Hey Joe,
I noticed the same thing (large drop in indexed number/percentage of pages) a few days ago and thought that was related to a ranking drop I have experienced. All I did was resubmit all (tag, category, posts) sitemaps via GWT and the next day Google had almost 100% of my submitted URLs back in the index. However, that didn't fix my apparent Google penalty issue so I'm still searching for a solution:
http://www.seomoz.org/q/help-with-diagnosing-google-penalty
Oh, this was with a wordpress site utilizing Yoast's WP SEO plugin to create XML sitemaps.
-
I use the same manual approach, manually dumping into Excel on a regular basis. I'll usually increase the frequency if we are making changes that should effect indexation.
-
Just the past week i am not too sure. Out of curiosity, how do you track your indexed pages? Right now i dump manually into excel for historical records and tracking, which lends to not doing it more than every month or two. You just eyeballing weekly and notice changes?
-
Sorry I forgot to specify that this has been over the past week.
Thanks for the reply, Ryan.
-
What time frame are you talking here?
Edit: I manage about 25 different sites, and I have seen a large fluctuation (increase for the most part) since April/May.I have seen upwards of 50%. Most of my flucuation i think was due do some good site/url structure and SEO work i did a while ago, and i gather that panda & google have liked some of the changes (about freakin time). It has not been due to an increased content.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Google Search Console Not Indexing Pages
Hi there! I have a problem that I was hoping someone could help me with. On google search console, my website does not seem to be indexed well. In fact, even after rectifying problems that Moz's on-demand crawl has pointed out, it still does not become "valid". There are some of the excluded pages that Google has pointed out. I have rectified some of the issues but it doesn't seem to be helping. However, when I submitted the sitemap, it says that the URLs were discoverable, hence I am not sure why they can be discovered but are not deemed "valid". I would sincerely appreciate any suggestions or insights as to how can I go about to solve this issue. Thanks! Screenshot+%28341%29.png Screenshot+%28342%29.png Screenshot+%28343%29.png
Algorithm Updates | | Chowsey0 -
How long does Google indexes the website after algorithm update?
I've noticed that the page ranks for some queries were improved unexpectedly, without any actions from my side. Is it possible that this improvement is connected with with Google algorithm update Sep, 4-5?
Algorithm Updates | | AurigaPR0 -
Have you ever seen or experienced a page indexed which is actually from a website which is blocked by robots.txt?
Hi all, We use robots file and meta robots tags for blocking website or website pages to block bots from crawling. Mostly robots.txt will be used for website and expect all the pages to not getting indexed. But there is a condition here that any page from website can be indexed by Google even the site is blocked from robots.txt; because crawler may find the page link somewhere on internet as stated here at last paragraph. I wonder if this really the case where some webpages have got indexed. And even we use meta tags at page level; do we need to block from robots.txt file? Can we use both techniques at a time? Thanks
Algorithm Updates | | vtmoz0 -
How To Index Backlinks Easily?
I have already pinged my backlinks, While pinging individual urls but all the same backlinks are not indexed. How to index my backlinks?
Algorithm Updates | | surabhi60 -
How to keep damage low on Google after the change of URL's
Hi Peeps, Hope someone can shed a light on this and show a guidance if possible. We are going to move our sites to shopify and shopify's URL's cannot be customized to match exactly like our current URLs. What steps do I need to take so google knows the URL's are changed. Domain will be the same. Thank you in advanced.
Algorithm Updates | | cemalcebi0 -
50% of my keywords just had a significant drop for no reason no changes?
I just looked at a report for one of my sites in moz pro and Improvement: 35 slots 35/75 keywords just dropped on google, I didn't make any changes recently Ranking Changes Improvement: 12 slots 12 Improved Improvement: 35 slots 35 Declined Many dropping 5 - 22 places! Any ideas on whats up, thank fully it didn't effect traffic, its pretty low anyways, but it has stayed the same... But still dropped to page 5 for lots of stuff. Strange. Did google just update or something? Thanks for any ideas.
Algorithm Updates | | syndicate0 -
Google and Content at Top of Page Change?
We always hear about how Google made this change or that change this month to their algorithm. Sometimes it's true and other times it's just a rumor. So this week I was speaking with someone in the SEO field who said that this week a change occurred at Google and is going to become more prevalent where content placed at the "top of the fold" on merchant sites with products are going to get better placement, rather than if you have your products at top with some content beneath them at the bottom of the page. Any comments on this?
Algorithm Updates | | applesofgold0 -
Changing Wordpress Permalink Structure, 301s, and Possibility of Rank Loss?
I have to change the permalink structure in wordpress, as using /%postname%/ in conjunction with a couple thousand pages triggers verbose rewrite rules, which further triggers about 5,000 requests per page load. The permalink structure must change as wordpress development probably won't change this in the near future. Now, changing the permalink structure worries me quite a bit, as about 25% of my traffic is attributed to my blog posts -- the rest is covered through CMS-like-use of pages (75%). blog posts will change permalink/url structure, pages won't The website is very respected in my niche and has quite a few links going to most of my posts and pages, as well as the homepage I've noticed in the last year that anything I post starts ranking on page 1 of Google for very competitive kws in 1-3 days, often with top 3 rankings PR4 / decent Alexa / Moz ranks not too shabby either / quality content / decent social media linking (mainly Facebook) / no penalties I provided the factors as to not gloat, but rather to get the best answer from those who have fairly established websites and perhaps had to change their URLs and noticed some or no changes to their rankings. How long of a hit am I going to take / how much my posts might drop down in SERPs if I change the permalink structure, properly 301 them, and implement all changes in one swoop? Info for WordPress users Benefits of changing the permalink structure to /%post_id%/%postname%/ -- for example -- include: way faster load times, not having 5,000 requests per page load, avoiding verbose rewrite rules trigger, finally modify the site without worrying about crashing the website and using a local server to make changes on thousands of pages (the database backups, the ritual of changing the settings in the local database, changing the post/page, saving the local database, loading the locally saved db on live server, and crossing fingers and pray it works -- just takes so darn long.) Ahh..yes, huge time saver. ** this issue occurs when using WP as a CMS with several hundred pages + and using the /%postname%/ or /%category%//%postname%/ or /somethingstatic/%postname%/ -- IF USING the date based way /%year%/%postname%/ or /%post_id%/%postname%/ you should be fine.
Algorithm Updates | | pepsimoz0