Spring is here and so is our May Index Update!
-
Happy Index Release Day!
For the second month in a row, our hard-working, supremely dedicated Big Data team has delivered our Index Update EARLY! Beyond being punctual, the May Index is one of our most comprehensive and largest update of the year for Moz.
Let’s dig into the details:
-
162,225,495,455 (162 billion) URLs.
-
1,135,327,420 (1.1 billion) subdomains.
-
194,346,505 (194 million) root domains.
-
1,168,465,575,815 (1.1 Trillion) links.
-
Followed vs nofollowed links
-
2.84% of all links found were nofollowed
-
65.80% of nofollowed links are internal
-
34.20% are external
-
Rel canonical: 28.89% of all pages employ the rel=canonical tag
-
The average page has 92 links on it
-
76 internal links on average.
-
16 external links on average..
Go have fun with your new data!
PS - For any questions about DA/PA fluctuations (or non-fluctuations) check out this Q&A thread from Rand: https://mza.seotoolninja.com/community/q/da-pa-fluctuations-how-to-interpret-apply-understand-these-ml-based-scores
-
-
Thank you for this update. I have Tumblr, Blogspot etc. that I use as part of my strategy and it is quite disconcerting this morning to see an individual post on a Tumblr blog with a PA of 94. It's like looking in your bank and seeing a balance of 100K.
-
Thanks Ian. I wanted to add on that we've got a little bit of strange issue with some domains in this index that may affect some sorting and link lists.
Basic story: We blacklist domains that have more than 10,000 subdomains and have other features that we've observed make them, almost always, webspam. Since they can adversely impact metrics and scores, we just don't include them in the index. The last 6 months, this process has gone really well, but this index, we hit a bug, and accidentally excluded ~750 domains that aren't all spam, including big ones like Etsy.com, Wikia.com, Blogspot.com, Quora.com, and others.
Initially, folks noticed because the PA/DA scores for these sites were all 1. That part has been fixed, and the metrics should now be more accurate. But, we don't have the link lists for these sites, and we don't have PA scores for the interior pages on these domains. As such, if you're sorting your link lists or if you're researching links that point to a page on Etsy.com or Blogspot.com or Wikia.com or a few others, you'll see no data. This will be fixed in our next index, but we couldn't fix it in this one. The bug was caught, but caught too late, and thus the next 28(ish) days will have some of these sorting and link list issues on these ~750 domains (of which, I estimate, only ~150 or so are actually legit sites - most of the others are, indeed, spam).
If you've got any additional questions I can answer about this, please let me know. Apologies for the error from me and from the team - we'll make sure to get this right in the future, and we've set up new kinds of tests to prevent any similar issues from going unnoticed.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Location Data Batch Updates via the MOZ API
According to the MOZ API documentation, I am able to update multiple Locations in a batch in order to create or update their location data, currently 130 locations. I have successfully created a batch and the API returned the $id, as I expected. Yet, it doesn't make clear how the multiple locations I want to update are supposed to be sent back to the API. I was expecting an upload of a CSV file or JSON data, and not Query Parameter as noted in the docs. When including a JSON file, properly formatted, as a binary upload, the response is still expecting a locations parameter. See error here: { "status":"MISSING_PARAMETER", "message":"locations missing. ", "response": { "locations":"MISSING_PARAMETER" } } https://mza.seotoolninja.com/developers/docs/local/api#_api_batch__id-PATCH
API | | yuca.pro1 -
Why does OSE show old data (Previous update results)?
Moz api started to show July 13 update results for my website. I checked it 2 days ago and saw all new established links and updated DA PA for July 27 update. But last 2 days both Moz Api and OSE main page show July 13 update results. Is there a maintenance or mismatching error between old and new databases?
API | | cozmic0 -
Is everybody seeing DA/PA-drops after last MOZ-api update?
Hi all, I was wondering what happend at the last MOZ-update. The MOZ-health page has no current errors and i've checked a lot of websites probably about 50 a 60 from our customers and from our competitiors and everybody seems to have a decrease in DA's / PA's. Not just a couple went up and down like normally would happen, but all seems to have dropped.... Is anyone seeing the same in their campaigns? Greetings,
API | | NielsVos
Niels3 -
/index.php causing a few issues
Hey Mozzers, Our site uses magento. Pages within the site (not categories or products) are set to display as www.domain.co.uk/page-url/ The hta access is set to redirect all version such as www.domain.co.uk/page-url to a url ending in a / However in google analytics and in moz landing page tracker these urls are being represented by www.domain.co.uk/page-url/index.php When visiting www.domain.co.uk/page-url/index.php a 404 is displayed. I know that by default when directed to a directory it automatically finds and displays the index file. So i understand why this is happening to some degree. However, when manually visiting this link does not exist. This poses a problem when trying to view the landing pages information in moz pro. I have 20 keywords being tracked in relation to www.domain.co.uk/page-url/ but because moz is recording it as www.domain.co.uk/page-url/index.php the keywords are unrelated so not showing information in relation to the page. Any ideas?
API | | ATP0 -
Why did the April Index Raise DA?
All of our websites DA raised dramatically, including the competitors we track Any idea why this may have happened across the board?
API | | Blue_Compass0 -
Two days since the supposed update
And still no update. Less a question, more a comment. Feeling a bit of deja vu here.
API | | pfrance3 -
Oct 14 2015 MOZScape update: none of DA are changed?
Hello, everybody. Today I noticed that finally the latest release of mozscape update has been posted. Now, I noticed that NONE of 25 campaigns websites NOR any of their competitors DA has changed. I do understand that DA can stay the same, but 25+25*3=100 websites domain authorities hasn't changed at all since August 4th (the date of previous mozscape release)? Or is this happening only to me? Please advise.
API | | DmitriiK2