OSE not picking up all internal links?
-
Hi! I've been checking a few pages in OSE. For example:
https://www.holidayhypermarket.co.uk/holidays/last-minute
This, according to the tool, has only 6 internal links. However, a Screaming Frog crawl picks up 700+, which is about right seeing as there is a link in the footer. What do you think could be behind the discrepancy?
-
Doubtful. Running a site:holidayhypermarket.co.uk search in Google returns 10,700 results, plus from the help documentation on OSE it says, "The second thing to keep in mind that the exported data will only include the top 25 pages per linking root domain," from: http://moz.com/help/guides/research-tools/open-site-explorer/top-pages-ose
So by design it's not really a tool that's trying to duplicate Google, rather make an actionable scaled down copy of what's going on.
-
Thanks. I guess my point though is if that OSE is struggling to find the links, could the search engines? These aren't buried links - they are easy to see on the page. It would be good to know if there is a glitch or if something else is going on.
-
I wouldn't use OSE as an onsite crawler. That's what a tool like Xenu Link Slueth or Screaming Frog is for.
-
Hi! I understand that OSE isn't 100% accurate, but I'm wondering if something else is going on. It picks up internal links for competitors fairly accurately. It would be good to know though why it isn't picking up the footer links - could the code be difficult to crawl etc? It may be hinting at a problem that I've missed.
-
OSE also clusters by domain, so for a given link you're not going to get near the 700+ which are internal. As a general practice OSE is great for getting at link diversity, goal setting, and seeing where the competition has gotten links in the past. It should give you plenty of ideas that way. Cheers!
-
OSE is not an end all be all for links. They only gather a certain number links and data.
You're already using screaming frog to get this data, so that should be accurate. You can also check Google Webmaster Tools, which has a section called "Internal Links".
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Unsolved Large discrepancy in number of links using compare links tool
Hi there, I’m trying to understand the large discrepancy in number of links among websites. For instance, I am comparing landing pages among two different colleges. One college has over 7 million links, while the other has only 72,000 links. Meanwhile, these colleges are fairly comparable in terms of population and prestige. Could anyone help me understand why this metric is wide ranging, and how a college could have so many links? Specifically looking at total links, internal links, external links, and linking domains.
Link Explorer | | HanoverianHE0 -
How can i download all inbound links.
Currently i can only download 50K links, but we have around 350K links, how can i download all the inbound links.
Link Explorer | | ITWEBTEAM0 -
Sudden surge in discovered links
Hi everyone, Recently Moz discovered a lot of old backlinks to my url. Some of them don't even exist anymore. I don't understand how Moz has found these links, even if they don't exist? And why did Moz find them suddenly all at once? Can anyone help me with this question? Thanks!
Link Explorer | | Online_Marketing_Monkey0 -
Disavow 60% of the external links?
Hi guys, We just discovered that our website got a 16% Spam Score based on MOZ reports, while less than 1 year ago we had a good 1% if I'm not mistaken. Therefore we ran an audit of the external links to our website and discovered that about 60% of them are irrelevant such as: referral page not available anymore (or not found, or domain not accessible) irrelevant web directories for our business Impossible to contact the owner of these pages or remove the links towards our website.
Link Explorer | | Andreea-M
Is the Disavow tool an acceptable option in this case? Could this lower our Spam Score and make a better impression in "Google's eyes"? 60% seems quite a lot of backlinks, but they are also not relevant, and we want to focus on creating better quality referrals in the next months. I would really appreciate an opinion on this, and how would you proceed in this case.0 -
My site links to my clients not showing in Moz
I've got a web design business with a site that's been out there for 17 years - www.biztoolsone.com. I've got links to my clients' sites in my portfolio page. The backlinks list for my clients, when I check them in Moz, don't show the links from this site. They always showed in the list until a few months ago. The site has a DA of 59 & PA (for home page) of 50. The spam score is 0/17. I'm having a tough time telling my clients that the Moz backlinks list is accurate when that site doesn't show in the list. The same is true for www.fayettevillenc.biz - this is one I created years ago to generate backlinks. It's got a spam score of 4/17, so I'm a little more understanding of that one. Thanks for any guidance!
Link Explorer | | wcksmith10 -
What is the difference between - This page v this subdomain v this root domain in OSE
What is the difference between - This page v this subdomain v this root domain in OSE, while checking website backlinks See inbound links to the page, subdomain, or root domain you've entered and analyze the linking pages.
Link Explorer | | Green.landon0 -
SEO Benefit from Moz Profile link?
Hi all Excuse the rookie question, but do the website links in Moz profile give positive SEO benefits? If so how long should it take to start seeing improvements or have the linking domain in Open explorer and is there a way to speed things up? Thanks in advance
Link Explorer | | IsaCleanse0 -
Open Site Explorer and Expired Links?
Hi guys, I've been checking a few domains for SEO purposes and it appears that OSE is indexing a lot of links which no longer exist, this has been the case for over 6 months - does OSE cleanse expired links? As I'm sure they will be contributing to authority in the eyes of Moz?
Link Explorer | | lotterybase0