Open Site Explorer.. Bit of a let down?
-
Hi, not too sure if this is a discussion or rant!?
I’ve been following SEOMoz for a couple of years now. Testing their tools, reading their blogs, sharing their content, and watching the whiteboard Friday videos (massive thumbs up to that one!). They are at the top of the game, no argument there.
Although I should have done so much earlier, I have eventually signed up to the pro version and am about to migrate all my clients over. But there is one major caveat which I’m not sure should exist.. Open Site Explorer.
Don’t get me wrong, OSE provides invaluable metrics, some that no other ‘crawler’ provides, but it is far from perfect, there are things that we SEO’s need, and are hoping to get!
Some feature SEOMoz could add;
- Ability to view a chart of ‘link types’ (i.e. blog post, social media, Press Release etc..) – Linkdex do this!
- Utilise a ‘fresh‘ backlink index as Majestic SEO do. ( we do use majestic alongside SEOMoz)
- Crawl more frequently – enough said!
- Index all ‘not so good’ backlinks – this will help identify what backlinks AREN’T helping.
I realise this is a lot easier said than done, and I’m sure SEOMoz are working on solutions.. just can’t wait till they launch!
What do you think? IS OSE more than it’s cracked up to be? Could it be improved? Let me know
Lee
-
Wow Rand, thanks for such a detailed and frank answer, I now have a better understanding of the issues you face.. it's much more complex than I imagined. Great to see that you''re doing all you can, look forward to the improvements.
Have a great week! Lee
-
Hi Lee - thanks for bringing these up! I'll try to answer with regards to each of the items you've mentioned:
#1 - This is very tough at our scale (literally 1 trillion+ links, and in the latest index about to launch, 150 billion+ pages across nearly 200 million domains). However, you're correct that we're working towards a classification system that will lean on some seeding + machine learning + user input. I'd suspect 12-18 months before we can launch it, though.
#2 - This is not currently in the plans, at least not at full web scale. We will have Blogscape back up and running soon, and that crawls ~10mm+ fresh sources daily, so if you have a link/mention on a blog/forum/news site with any notoriety, we should be catching those and updating hopefully every 6-8 hours. Mozscape (aka Linkscape, our full web index), will continue to be at least 2-4 weeks between updates and will require 3-4 weeks of processing. We're trying some new things on the technology side, but it's a huge challenge to get to Google's scale and keep our metrics, sorting, views, etc. Majestic can do this with their index because they simply export links directly into the consummable portion of the app, but it limits the sorting/views/filters and ability to generate high quality metrics like PA/DA/mozRank/etc.
#3 - Yup. Definitely agree and working on it. We're trying some new hardware stuff, new parallelization of processing and everything under the sun to make it work.
#4 - Our next index will probably have a lot more of this (and we'll be watching carefully to see how this performs for our customers). We're also working to build a spam score that maps against what we've seen Google penalize/ban over time (currently doing a bunch of research there), so you can get a good sense of what things are likely to be hit over time.
Mozscape/OSE is a huge priority for us and we have 7 extremely talented folks working night and day (and a lot of weekends) to improve this. In the next 3-6 months, it will get massively better than it is today - the next new index is only a few days away now, and after that, we shouldn't ever have such a long period without an update (this round was an impossibly hard-to-fathom confluence of problems that we've taken many steps to prevent from ever happening again).
Thanks for your patience and the good questions.
-
Ignore the last reply John, have just tested Link Detective on a site that I know the link backlink profile of.. it's massively inaccurate! The tool simply isn't able to identify correct link types as they suggest. Dissapointing!
-
I've read they would be indexing 2 x the data Anthony, not 3 x. Suppose there must be some confusion out there, fingers crossed it's 3 x the data!
-
Cheers John, will take a look when I get the chance.. have you used it before? Is it accurate?
Enjoy the weekend! Lee
-
Thanks for all the feedback guys, would be good to hear SEOMoz's official stance on this!
-
You might find this tool helpful to analyse your downloaded report from OSE http://www.linkdetective.com/
-
I have to agree with Kevin on this one...
Items 2,3,and 4 are days away.
Does it suck that OSE's Linkscape Index hasn't been updated since the end of February? YEP!
Will it be worth the wait next week when it is updated and contains three times the data as the previous crawls? YEP!
I consider SEOMoz a community, and though Linkscape's stagnant data is causing some issues, I realize that once those issues are resolved that I'll be getting more bang for my buck than I did before, and I'm totally willing to struggle for a month in order to have better tools at my disposal for many months to come.
Rand and SEOMoz are drastically improving the volume of data that we will have at our disposal. That takes time and resources. They aren't raising prices or making excuses, they're working out bugs and improving the service. I'll take it.
Anthony
-
Lee,
First, I need to say I OSE - it's invaluable in my forensic audit work. Having said that, I would LOVE to see the "link types" chart. The biggest challenge I expect they'd face in that is properly detecting where a link is on a page, or what class to put it in due to how unspectacular code consistency really is across the vast web. For example, I've seen others attempt this and fail miserably ( what should be identified as a sidebar (blogroll type) link is often seen as something else, and what should be seen as a main content area link is often seen as a sidebar link (too many WP themes for example, label their main content area divs as "sidebar2" for example).
And that just gets worse / more challenging when the need comes in identifying if a site is really a blog, or some other site that happens to use WordPress as it's platform.
Having said all that, I would be in heaven if the Moz team could get that data into OSE
-
From following all the talk, I'm pretty sure they are working on points 2, 3 & 4.
While all that is good, I personally feel they should concentrate on updating more often first, then move towards giving those extra features. The two month stretch between updates has been a real pain in the ass. But I'm sure they know that.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Can check my site
can you please tell me what should I do with this site I trying a lot to solve its issues. the link is here https://alazharquranteaching.com/
Moz Pro | | saharali150 -
Need advise/strategy for cleaning up backlinks to my site
I recently redesigned my website (studio35design.com), and with that, I'm finally paying attention to SEO. I used a few different tools to find the amount of backlinking domains I've built up through the 7 or so years. The numbers are the following: 52 Total Backlinking Domains (800+ links):
Moz Pro | | rubennunez
• 17 of those are from blog commenting - they are pretty much all NF
• 20 of those are from sitewide footer credits on websites I've built. They are all old, as I stopped adding sitewide links to my client sites over a year ago.
• 7 of those are from spam. My site was hacked last year which contributed to alot of it. I've since then completely scrapped my old site and built this one on webflow (Not self-hosted like my old WP site).
• The other 10 or so are from forums, and the odd photo credit. As you can tell, almost none of these backlinks links are really any good. I'm surprised that my DA is 27 really. So moving forward, I need to know the best strategy dealing with these "bad" links. For the spam, I'm going to disavow in google webmasters. As for the rest, here are my questions... QUESTION 1:
As for the sitewide links, would the best thing be to remove the link altogether from the footer of each one of those sites? Some I can't because they are really old, and I don't have access to them (I'll probably disavow), but the rest I can still go in and update. QUESTION 2:
Will removing a ton of links at once hurt my DA and my google ranking? I can probably eliminate 500-600 links within a few days just by removing the sitewide links. How quickly can I expect those links to drop off? A few months? QUESTIONS 3:
Should I disavow blog commenting links even though they are NF? Does it matter at all? QUESTION 4:
I noticed 5 or so of the domains I have links one aren't working domains anymore. How quickly can I expect those links to drop off? Thanks in advance for your help.0 -
We have a Wix site but I wonder if we would be better suited with square space
Our SEO has taken a hit in moving our website from homestead website builder to Wix this last year. 1,500 unique visitors a month to 400 on our website www.bestlifeint.com using much of the same SEO and content. I think 2 of our main issues now (site speed and SEO friendliness) would be addressed in the switch to squarespace. But I guess is it worth it? I do not think google likes the whole hash bang html5 ajax thing wix uses and our website relies heavily on good seo. Any advice? I am starting link building but it might be a waste if we switched the site and in turn changed all the page url's as wix uses ?! for it's pages. Just need some clarification ideas on getting traffic to our website, also SEO MOZ software is hard to use report card with wix. We also switched our ecommerce from homestead to shopify and this has been a good move. Shopify (our ecommerce actually gets more traffic than our website now. But the problem I feel is wix hurts our seo just by being on their platform. Seriously thinking of squarespace but feel we would have to start from scratch and just match some of the elements on current site. Any insight, ideas? Am I on the right path in my thinking? Should I just stick it out with Wix? Thanks. -Brian
Moz Pro | | SammisBest0 -
Why would my site return an error when using Open Site Explorer to crawl it?
I have built several new sites over the last few months for others, but recently built a new one for myself. I have gone through most of the checklists from this site to address on-page SEO, and now I am looking at link building. When using Open Site Explorer, I receive an error saying that no information about the URL is available, even when I add competitor sites. Wondering if this is a common issue and if there is a convenient remedy? thanks!
Moz Pro | | MindSpark0 -
Can we add sites to the crawl queue for OSE?
Is it possible to request that Open Site Explorer crawls a new URL on its next run? This tool is the first place I go to when working on a new site, and when there is "No Data Available" this is a little frustrating. I fully appreciate that this lack of data is usually a signal that the website is either very new or of low quality, however that if often the reason that I am brought in and would very much like to benchmark and provide initial analysis using this tool. It would make sense that OSE crawls the sites that Moz members are working on wouldnt it? Scott.
Moz Pro | | eseyo0 -
What analysis exists for Out Bound Links (OBL) from your site
Hi Maybe I am missing this but I can''t seem to see it. I am doing some analysis on a client's site and want to get a csv list of links from the client's site to external sites. So what I am looking for is a list of Out Bound Links (OBL) from the client's site. I want to run these past a black list / bad link neighborhood checking script I have. This would actually be a nice feature in SEO Moz Pro, unless it actually already does and I am just missing it or not setting filters correctly. Thanks Trevor
Moz Pro | | tstolber10 -
SEOmoz PRO campaign fot HTTPS site
Hi all, I'm trying to configure a PRO campagin for a https website. Butt it won't work. The software says it found a one redirect (for http to https I guess), and that's it. So now I don't have any data.... Can anybody help me? Thnx! Martijn
Moz Pro | | Men4Media0 -
Why aren't DMOZ links showing up in Open Site Explorer?
I have a page that is listed in DMOZ.org, but when I run an OSE Link Analysis, that link doesn't show up. I'm currently doing the free trial for SEOMoz Pro and I'm concerned that other links might not be showing up as well. Has anyone had any similar experiences and/or do you know why DMOZ links specifically might not appear in the results?
Moz Pro | | JoyceScott0