Open Site Explorer.. Bit of a let down?
-
Hi, not too sure if this is a discussion or rant!?
I’ve been following SEOMoz for a couple of years now. Testing their tools, reading their blogs, sharing their content, and watching the whiteboard Friday videos (massive thumbs up to that one!). They are at the top of the game, no argument there.
Although I should have done so much earlier, I have eventually signed up to the pro version and am about to migrate all my clients over. But there is one major caveat which I’m not sure should exist.. Open Site Explorer.
Don’t get me wrong, OSE provides invaluable metrics, some that no other ‘crawler’ provides, but it is far from perfect, there are things that we SEO’s need, and are hoping to get!
Some feature SEOMoz could add;
- Ability to view a chart of ‘link types’ (i.e. blog post, social media, Press Release etc..) – Linkdex do this!
- Utilise a ‘fresh‘ backlink index as Majestic SEO do. ( we do use majestic alongside SEOMoz)
- Crawl more frequently – enough said!
- Index all ‘not so good’ backlinks – this will help identify what backlinks AREN’T helping.
I realise this is a lot easier said than done, and I’m sure SEOMoz are working on solutions.. just can’t wait till they launch!
What do you think? IS OSE more than it’s cracked up to be? Could it be improved? Let me know
Lee
-
Wow Rand, thanks for such a detailed and frank answer, I now have a better understanding of the issues you face.. it's much more complex than I imagined. Great to see that you''re doing all you can, look forward to the improvements.
Have a great week! Lee
-
Hi Lee - thanks for bringing these up! I'll try to answer with regards to each of the items you've mentioned:
#1 - This is very tough at our scale (literally 1 trillion+ links, and in the latest index about to launch, 150 billion+ pages across nearly 200 million domains). However, you're correct that we're working towards a classification system that will lean on some seeding + machine learning + user input. I'd suspect 12-18 months before we can launch it, though.
#2 - This is not currently in the plans, at least not at full web scale. We will have Blogscape back up and running soon, and that crawls ~10mm+ fresh sources daily, so if you have a link/mention on a blog/forum/news site with any notoriety, we should be catching those and updating hopefully every 6-8 hours. Mozscape (aka Linkscape, our full web index), will continue to be at least 2-4 weeks between updates and will require 3-4 weeks of processing. We're trying some new things on the technology side, but it's a huge challenge to get to Google's scale and keep our metrics, sorting, views, etc. Majestic can do this with their index because they simply export links directly into the consummable portion of the app, but it limits the sorting/views/filters and ability to generate high quality metrics like PA/DA/mozRank/etc.
#3 - Yup. Definitely agree and working on it. We're trying some new hardware stuff, new parallelization of processing and everything under the sun to make it work.
#4 - Our next index will probably have a lot more of this (and we'll be watching carefully to see how this performs for our customers). We're also working to build a spam score that maps against what we've seen Google penalize/ban over time (currently doing a bunch of research there), so you can get a good sense of what things are likely to be hit over time.
Mozscape/OSE is a huge priority for us and we have 7 extremely talented folks working night and day (and a lot of weekends) to improve this. In the next 3-6 months, it will get massively better than it is today - the next new index is only a few days away now, and after that, we shouldn't ever have such a long period without an update (this round was an impossibly hard-to-fathom confluence of problems that we've taken many steps to prevent from ever happening again).
Thanks for your patience and the good questions.
-
Ignore the last reply John, have just tested Link Detective on a site that I know the link backlink profile of.. it's massively inaccurate! The tool simply isn't able to identify correct link types as they suggest. Dissapointing!
-
I've read they would be indexing 2 x the data Anthony, not 3 x. Suppose there must be some confusion out there, fingers crossed it's 3 x the data!
-
Cheers John, will take a look when I get the chance.. have you used it before? Is it accurate?
Enjoy the weekend! Lee
-
Thanks for all the feedback guys, would be good to hear SEOMoz's official stance on this!
-
You might find this tool helpful to analyse your downloaded report from OSE
http://www.linkdetective.com/
-
I have to agree with Kevin on this one...
Items 2,3,and 4 are days away.
Does it suck that OSE's Linkscape Index hasn't been updated since the end of February? YEP!
Will it be worth the wait next week when it is updated and contains three times the data as the previous crawls? YEP!
I consider SEOMoz a community, and though Linkscape's stagnant data is causing some issues, I realize that once those issues are resolved that I'll be getting more bang for my buck than I did before, and I'm totally willing to struggle for a month in order to have better tools at my disposal for many months to come.
Rand and SEOMoz are drastically improving the volume of data that we will have at our disposal. That takes time and resources. They aren't raising prices or making excuses, they're working out bugs and improving the service. I'll take it.
Anthony
-
Lee,
First, I need to say I
OSE - it's invaluable in my forensic audit work. Having said that, I would LOVE to see the "link types" chart. The biggest challenge I expect they'd face in that is properly detecting where a link is on a page, or what class to put it in due to how unspectacular code consistency really is across the vast web. For example, I've seen others attempt this and fail miserably ( what should be identified as a sidebar (blogroll type) link is often seen as something else, and what should be seen as a main content area link is often seen as a sidebar link (too many WP themes for example, label their main content area divs as "sidebar2" for example).
And that just gets worse / more challenging when the need comes in identifying if a site is really a blog, or some other site that happens to use WordPress as it's platform.
Having said all that, I would be in heaven if the Moz team could get that data into OSE
-
From following all the talk, I'm pretty sure they are working on points 2, 3 & 4.
While all that is good, I personally feel they should concentrate on updating more often first, then move towards giving those extra features. The two month stretch between updates has been a real pain in the ass. But I'm sure they know that.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Cleaning Up Bad 301 External Links From Old Site
A relatively new site I'm working on has been hit really hard by Panda, due to over optimization of 301 external links which include exact keyword phrases, from an old site. Prior to the Panda update, all of these 301 redirects worked like a charm, but now all of these 301's from the old url are killing the new site, because all the hyper-text links include exact keyword matches. A couple weeks ago, I took the old site completely down, and removed the htaccess file, removing the 301's and in effect breaking all of these bad links. Consequently, if one were to type this old url, you'd be directed to the domain registrar, and not redirected to the new site. My hope is to eliminate most of the bad links, that are mostly on spammy sites, that aren't worth linking to. My thought is these links would eventually disappear from G. My concern is that this might not work, because G won't re-index these links, because once they're indexed by G, they'll be there forever. My fear is causing me to conclude I should hedge my bets, and just disavow these sites using the disavow tool in WMT. IMO, the disavow tool is an action of last resort, because I don't want to call attention to myself, since this site doesn't have a manual penalty inflected on it. Any opinions or advise would be greatly appreciated.
Moz Pro | | alrockn0 -
Get into Google : New Sites
I have a brand new website. It was created 10 days ago. How long would it take for it to show up in search results? I understand that since the site is new, there are no sites sending it backlinks. Also, i have optimized the page for my keyword "xyz" and it received an A grade. The site does not figure even in the top 50 results. Please help me out. It is a one page web application that needs to drive traffic to survive.
Moz Pro | | dl_s0 -
When do the "just discovered" links on Open Site Explorer count?
I have been working hard to get follow backlinks but they have all been in the Just Discovered part of Open Site Explorer for a long time. So they don't count in my stats for Domain Authority and such. When do they move OUT of Just Discovered?
Moz Pro | | dealblogger0 -
SEOmoz PRO: How to manage a Site with 2 languages on the same domain - without mixing up data?
I want to track a "rootdomain" that has two languages on it, the english version is in a subfolder /en/ 1. http://website.de
Moz Pro | | inlinear
2. http://website.de/en/ I want to manage and track each language-version isolated. So I will setup:
1. http://website.de as campaign DE - german
= as Root Domain
But as there are links to the /en/ Subfolder these data will also be included in all reports. And there is still no option in SEOmoz PRO to exclude folders or even urls.?! This will be bad when wanting a clear report of just one Language Version. 2. http://website.de/en as campaing EN - english
To track as "Subfolder" will not work beacause this option will only consider exactly this subfolder... So is there a way to see data just only for one language Version?0 -
Open Site Explorer WAY Off in Terms of Link Profiles?
Hey, One of our websites is www.inspireeducation.net.au. I have noticed although tools like Raventools capture our links well, Open Site Explorer is doing a terrible job... For example the following page >>> http://www.inspireeducation.net.au/courses/training-and-assessment-courses/certificate-iv-in-training-and-assessment/ has many many more than 8 root domains linking, however Open Site Explorer only presents 8? We are finding the same problem for almost any page we review through Open Site. Does anyone have any idea why the numbers would be so out? The new links are NOT fresh links. Many are well-established (been there for years), and even many newer ones have been there for more that 60 days. I find the same thing when reviewing competitor sites.. is Open Site Explorer working properly at all at the moment?
Moz Pro | | love-seo-goodness0 -
How can a site have a backlink from Barclays website?
Hi, I have entered a competitiors website www.my-wardrobe.com into Open Site to see who they get links from and to my surprise they have a load from Barclays Business Banking. When I visit the page I can not see the links. But if I search the pages source code for my-wardrobe, there I have it, a link to my-wardrobe.com. How have they done this? Surely Barclays haven't sold them it? And more so, why are they receiving link juice when you cant even see the link on the Barclays page in question - http://www.barclays.co.uk/BusinessBanking/P1242557952664 Thanks | |
Moz Pro | | YNWA
| | <a <span="">href</a><a <span="">="</a>http://www.my-wardrobe.com" class="popup" title="Link opens in a new window" rel='' onmousedown="dcsMultiTrack('DCS.dcsuri','BusinessBankingfromBarclays/Footer/wwwmywardrobecom', 'WT.ti', '','WT.dl','1');"> |
| | www.my-wardrobe.com |
| |
|
| | |0 -
Why does Open Site Explorer show less inbound links than yahoo site Explorer?
Hello, We have a question regarding inbound link measurement. We used to measure our inbound links with yahoo site explorer. Now that it's been shut down we use opensiteexplorer.org. However, Open Site Explorer only shows a fraction of inbound links compared to yahoo site explorer. For our website www.theprintspace.co.uk yahoo site explorer measured approx. 14,000 inbound links, whereas open Site Explorer only counts approx. 3,000. This is more than 10,000 links less. For our other website www.theprintspace.de Open Site Explorer also shows 3000 links less than Yahoo. How can this be? Does Open Site Explorer count the links in a different way to Yahoo? Please explain. It would be great if you could help us with this. Thank you!
Moz Pro | | Waplington0