Crawling and Links - Showing Links
-
Hello
I have a campaign in Moz that shows a new site as having no domain authority and no links.
The site does have links to it, but they don't show up on OSE.
Does Moz count links in the comments section of blogs (or is this counted as social, when the commenting system is one that requires facebook login?) I know blog comments are not great for SEO, I just use them when the post/link is 100% genuinely relevant. The site does have actual links on websites not just comment links, so it isn't showing any type of link.
What is the best way to see the links the site has?
Thanks!
-
Hey Radi,
The link metrics section of your campaign pulls from our Mozscape index, which updates about once a month.
Most new sites and links will be indexed by our spiders and available in Mozscape and Open Site Explorer within 60 days, but some take even longer for a variety of reasons, including the crawl-ability of sites, the amount of inbound links to them, and the depth of pages in subdirectories.
Just so you know, here's how we compile our index:
- We grab the most recent index
- We take the top 10 billion URLs with the highest MozRank (with a fixed limit on some of the larger domains)
- We start crawling from the top down until we've crawled 180,000,000,000 pages (which is about 35% the amount in Google's index)
Therefore, if the site is not linked to by one of these seed URLs (or one of the URLs linked to by them in the next update), then it won't show up in our index.
We update our Mozscape Index every 4-8 weeks. Crawling the entire Internet to look for links takes ~2-4 weeks, but our crawlers are always collecting data. When we need to put the index together, we grab all the data they have collected and start processing, which can take up to 3 weeks to determine which of those links are the most important.
Mozscape focuses on a breadth-first approach. This means that we almost always have content from the homepage of websites, externally linked-to pages, and pages higher up in a site's information hierarchy. But deep pages that are buried beneath many layers of navigation are sometimes missed and it may be several index updates until we catch all of these.
If our crawlers or data sources are blocked from reaching those URLs, they may not be included in our index (though links that point to those pages will still be available). Finally, the URLs seen by Mozscape must be linked to by other documents on the web, or our index will not include them.
I hope this information helps! While the site and links may not be indexed yet, give it some time - maybe we'll see them in OSE next month!
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Unsolved Thousands of links with same IP address found in backlinks
Hey, While researching the backlinks of a client's website I found around 3000 links with the structure: http://54.201.231.138/page. The IP doesn't seem to be of their website and the MOZ Spam score for the domain is 1%. Wondering what these links are and if they're a big problem? Thank you in advance. Warmly,
Link Explorer | | JoePen1010
Joe Screenshot 2022-09-30 at 10.58.12.png0 -
Moz show me that my backlinks lost every day in my some important keywords
hi, moz show me that my backlinks lost every day in my some important keywords like: ثبت تغییرات شرکت ، ثبت شرکت ، .... but , i think that's not correct. can you explain to me that is for what? my website is: https://vanak.org thank you....
Link Explorer | | alirezatrade01230 -
Why my website Backlinks not getting Crawl by Moz?
Hi, I've the query related to backlinks of my website. Some of the high authority sites give backlinks to my website but these links are still not showing in Moz. My website is 6 months old and also continuously getting backlinks from high authority sites but still these are not showing on Moz and also not improving DA and PA of my website. I've also attached the screenshot of Moz link explorer results please check and guide me what to do with website so Moz will consider it and give some authority. And also guide me How much Moz takes time to crawl website backlinks and shown in their link explorer. Website URL: https://www.welderexpert.com Moz Expert Suggestions needed. Thanks, overview?site=welderexpert.com⌖=domain
Link Explorer | | KOidue0 -
What steps should I follow after submitting disavow link list?
Hey Moz Team, This is Devesh Srivastava, you can call me Dev.
Link Explorer | | nikh26
Recently there was an update from your side and that was pretty good. I have analyzed model factors regarding Moz 2.0. Though my DA score has been down to 36 from 52, I would still say that an update was really necessary. I have some questions which require some clarification or you can say a proper solution.
As of now, I have removed all the Spam links which were coming to my website (https://edugorilla.com) and I have submitted the disavow list to GSC but I would like to know how should I begin my link building strategy keep everything in mind. And now that, I have removed those spam links how would Moz or how should I tell Moz or Google that those have been removed so how soon can I get back to my previous DA score? I am very much confused with the link building strategy now. What steps should I follow after submitting a disavow list and would Moz stats will change after Google Disavowing those links? Can anyone answer my question?1 -
Why are Internal Equity-Passing Links so low?
I am looking at "Internal Equity-Passing Links" for my website in the competitor link metrics tab of OSE, and it says that my website only has 7 internal links on the site. I know that I have more internal links that this, so I am wondering why this number is so low. Does anyone know where the discrepancy is coming from? Is the Moz crawler unable to access these? I appreciate any insights you can provide.
Link Explorer | | aperez0 -
I need to know about Just Discovered Links
Hi I have 2 websites, 1)www.abc.com DA 20 PA 29 RD 6 Total Links 226 and 2)www.123.com DA35 PA 46 RD 34 Total links 11,075 Every post i published on my 1st website shown in Just discovered links, whereas in 2nd website, it is not appeared. Now, my question is, what i do to have my all posts shown in just discovered links for my second website. From every aspect my second website is stronger than first one. Awaiting answer.
Link Explorer | | Abdul_Majid0 -
Why does OSE show different link equity for homepage with and without trailing slash?
Hi all, I am working with a developer who believes OSE (Open Site Explorer) is flawed. His reasoning is that OSE shows completely different link equity and domain authority for these two URLs [company name is purposely withheld]: http://www.mydomain.com/us/ and http://www.mydomain.com/us NOTE: http://www.mydomain.com/us has been properly 301-redirecting to http://www.mydomain.com/us/ for years. The developer's argument is that the URL that is being 301-redirected shouldn't have any link equity at all, therefore OSE is flawed. Here is the response I would like to give him. Please feel free to poke holes, provide feedback or flat out correct me if I am wrong: Dear inquisitive developer, Any URL that is being linked to by another site that has link equity will get link equity passed to it. This is true even if the URL is a page that doesn't exist. What it can't do (if it doesn't exist) is then pass that link equity on to another page. Moz's OSE is showing separate link equity for the two versions of this URL because other sites have linked to both versions. The fact that one 301-redirects to the other is good and ensures that link equity from one is passing to the preferred URL. The 301-redirect does not, however, remove link equity from the first URL, but rather passes the existing link equity from one to the other. Consequently, Moz's OSE is not flawed, but rather is displaying the link equity of one URL that is benefiting the other via a 301-redirect. Sincerely, Dana
Link Explorer | | danatanseo3 -
Open Site Explorer Not Showing Full Pro Version
Um, could someone please let me know why OpenSiteExplorer is treating me like I don't pay $200 for a Moz Pro Membership? See screenshot attached VdCrxzY
Link Explorer | | RickyShockley0