Links counted in Google Webmaster Tools vs. OpenSiteExplorer
-
Hi all SEOmozzers,
site: http://f8phototravel.pl
I have (in my GMT profile) 43 domains linking. Among them one of the biggest Polish like: onet.pl (5/187), gazeta.pl (8/393), grono.net.pl, canon-board.info, eturystyka.org and other.
They are not present in OpenSiteExplorer.
Any ideas why?
Thanks,
Marek
*/ Alexa rank (Poland/Global)
-
Thanks Cyrus,
I need explanation how OSE works. Now know it and can wait for next results and work on good link connections. I will try to "flow to surface" with links from good sites in which I have buried links
Marek
-
Marek,
In the past, each Linkscape index started with the top 10 billion urls from the previous index, based on authority, and links were discovered outward from their. Today the process is similar, but the crawling proceeds on a more continuous basis.
Basically, Linkscape still has to discover URL through links. If there are not many linked paths from the top 10 billion URLs to a particular page (even if that page is on a high authority site) then Linkscape won't consider it a priority to crawl.
On the other hand, if there are short, clear routes to a URL, this means even if the page is on a low authority site, it might get included in the index. This is a more natural crawling system that, although not perfect, mimics the way authority is passed in the real world.
-
Thank you Ryan,
Great explanation. My idea is to make sure how it works and thanks to you i'm enlightened. I always try to understand mechanisms and rules of tools actions.
Thank you again:-)
Marek
-
OSE is based upon Linkscape's crawl of the web. The Linkscape crawl cycle is roughly a month. It takes 2-3 weeks to crawl the web, and then 1-2 weeks to process the large amount of data and provide it in a readily usable format.
When working with OSE it's important to know the Linkscape update schedule. OSE was last updated Jan 17th and will be updated again Feb 29th.
It's also important to understand how the crawler works. If you create a link during a period, you will often need to wait until the next period until the link is visible in OSE. I find OSE to be a fantastic tool for analyzing a site's backlinks. It takes time for OSE, Majestic or any other tool to crawl trillions of web pages and process the data. The tools will always be behind in the foreseeable future.
OSE is being adjusted to crawl deeper. In the past, it only crawled the top 25% of web pages. For the most part, if OSE does not see the link, the link likely has no value.
**I have (in my GMT profile) 43 domains linking. Among them one of the biggest Polish like: onet.pl (5/187), gazeta.pl (8/393), grono.net.pl, canon-board.info, eturystyka.org and other. **
Where is the linking page located within these sites? When were these links created? Those are the most relevant questions.
DMOZ is a PR 10, DA 10 site. Some pages are buried so deeply that neither Google or OSE crawls them.
In most cases, if a link is not discovered in OSE it is either two new or too weak (including buried links). If you feel neither is the case, you can submit the link information to help@seomoz.org and the help desk team will assist you.
-
Yes I know majesticseo and I wrote about it some time ago in Q&A What do you use Majestic SEO for?
Frankly speaking my question was a little bit provoking. It's a large number of tools ... each of them cost a money - that can be a problem, not big but...
My question is also about how the OSE crawl the pages/links, how accurate it is and in the end how long it take to crawl e.g. 50% of links?
And still I'm wonder why it crawls low ranked pages and not to crawl high ranked pages on specific market/country?
I really want to understand what is the scheme of OSE crawling work.
-
Besides SEOmoz, I would recommend Majestic SEO http://www.majesticseo.com/
-
I would wait and see what OSE says on their next update on the 29th. It looks like OSE crawls those sites, so either they don't crawl deep enough (as deep as Google does), or your links are newer and just not updated yet.
As for a reliable crawl tool, I believe OSE is great, but here is a nice post on a few other international tool. (based on OSE data)
-
Hi Brent,
I know that, already read lots of Q&A and other stuff ... but the thing is that OSE indexed links from my few domains (C Blocks) and other links from very low ranked sites.
I wonder why it doesn't index links from e.g. Google +1 and other high ranked sites?
It's a second month of campaign and few crawls behind...
It can be an issue for other campaign I want to perform for my clients ... should I use different tool for link tracking?
On the other hand my mR = 5.1, mT = 5.69, PA = 33, DA = 20 and all factors increased heavily last 2 months. At the same time my PR = 3 (from PR=0, 2 months ago)
Thanks
-
Google's crawler has a separate larger database, crawl rate ect, than OSE.
OSE indexes monthly where as Google's index is updated more often than that.
In short, OSE is just a different "snapshot" of the net then Google's much larger database of the web
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Tool recommendation for Page Depth?
I'd like to crawl our ecommerce site to see how deep (clicks from home page) pages are. I want to verify that every category, sub-category, and product detail page is within three clicks of the home page for googlebot. Suggestions? Thanks!
Moz Pro | | Garmentory0 -
What are the factors that have an impact on the google search results?
When I compare the ranking of my keywords with the Moz Rankings and my own search results I get different results even I use the google chrome incognito browser (not logged in, no cookies, no cache) and it's definitely the same country-setting (google.de) where the search is run. I double checked it with several browsers and computers, and I still get a different result as the Moz Ranking Tracker. The keyword is "schafkopf" and the site is www.sauspiel.de. The relevant country is Germany (www.google.de). Does anyone know the reason why the results differ? Could it be the search query was made from different countries/IPs? Any ideas, hints?
Moz Pro | | sauspiel0 -
OK I'll try again.... Linking root domains and external links
I'm new to the crawl test tool, I think I know what is meant by external links and linking root domains but I need to check. If there are 500 external links and 50 linking root domains does that suggest the essentially those 500 links are coming from 50 root domains? If yes, then what would 1000 linking root domains and 100 links mean? Or am I completely wrong in my assumptions and if so, can somebody point me in the right direction? Thank you.
Moz Pro | | JemRobinson0 -
ETA On the Keyword Research Tool?
I'm trying to do some keyword research on Google UK but it hasn't been working for a couple of days now. I have a client waiting on a proposal that features this research heavily and might lose them if I can't use it soon! Is there any estimated time for the return of the service? Is the keyword tool down for everybody?
Moz Pro | | EssexGirl0 -
Rankings in Google.be - 3 languages
As the site of my customers is in 3 languages, I also want to monitor the rankings in 3 languages. I do have the possibility to monitor them in seomoz: google.be english google.be dutch google.be french However, in the report (http://pro.seomoz.org/campaigns/227154/rankings) I do see the 3 columns, but the title is only google.be, WITHOUT the language selection. Not really helpfull... Any advice? oNDu9
Moz Pro | | nans0 -
Google Hiding Indexed Pages from SERPS?
Trying to troubleshoot an issue with one of our websites and noticed a weird discrepancy. Our site should only have 3 pages in the index. The main landing page with a contact form and two policy pages, yet google reports over 1,100 pages (that part is not a mystery, I know where they are coming from.....multi site installations of popular CMS's leave much to be desired in actually separating websites) Here is a screen shot showing the results of the site command: http://www.diigo.com/item/image/2jing/oseh I have set my search settings to show 100 (the max number of results) results per page. Everything is fine until I get to page three where I get the standard "In order to show you the most relevant results, we have omitted some entries very similar to the 122 already displayed." But wait a second, I clicked on page three, now there are only two pages of results and the number of results reported has dropped to 122 http://www.diigo.com/item/image/2jing/r8c9 When I click on the "show omitted results" I do get some more results, and the returned results jumps back up to 1,100. However I only get three pages of results. And when I click on the last page the number of results returned changes to 205 http://www.diigo.com/item/image/2jing/jd4h Is this a difference between indexes (same thing happens when I turn instant search back on, Shows over 1,100 results but when I get to the last page of results it changes to 205). Any other way of getting this info? I am trying to go in and identify how these pages are being generated, but I have to know what ones are showing up in the index for that to happen. Only being able to access 1/5th of the pages indexed is not cool. Anyone have any idea about this or experience with it? For reference I was going through with SEOmoz's excellent toolbar and exporting the results to csv (using the Mozilla plugin). I guess google doesn't like people doing that so maybe this is a way to protect against scraping by only showing limited results in the Site: command. Thanks!
Moz Pro | | prima-2535090 -
Toolset Q.) Re. Linkscape - How is the External Links (link juice) calculated in the API?
Re. External Links (link-juice) - I really need to know what this reflects.Ie. linkdiagnosis.com divides the PR by external link factors to get an idea of link juice or power - how does Moz calculate this scoring?
Moz Pro | | Turkey0 -
What is the difference between the link count on OSE and Linkscape?
We notice a huge difference in the number of inbound links . Site explore shows 1,200 as an example and linkscape shows over 100,000 for the same site.
Moz Pro | | JamesBarry0