How effective is OSE in crawling press release links?
-
How effective is OSE in crawling press release links?
We have released a few press releases recently (over the last couple of months) and OSE doesn't seem to have found them.
-
Hey There,
That could be a possibility. It is hard to say definitively given the nature of web crawlers. They just crawl links as they see them in random succession, so a lot of factors come into play.
Best,
Nick
SEOmoz -
Our releases have appeared on big sites like the Financial Post.
Is it possible they just get buried under other news so OSE can't find them? I know Google indexes these pages, we get the alerts.
-
Hey there,
Just so you know, here's how we compile our index: - We grab the most recent index. - We take the top 10 billion URLs with the highest MozRank (with a fixed limit on some of the larger domains). - We start crawling from the top down until we've crawled 59,000,000,000 pages (which is about 25% the amount in Google's index).
Therefore, if the site is not linked to by one of these seed URLs (or one of the URLs linked to by them in the next update) then it won't show up in our index. Sorry!
We update our Linkscape Index every 4 weeks. Crawling the entire Internet to look for links takes 2-3 weeks, but our crawlers are always in motion. When we need to start processing, we grab all the data they have collected and start processing which can take up to 3 weeks to determine which of those links are the most important. You can see our most recently updated schedule here: http://seomoz.zendesk.com/entries/345964-linkscape-update-schedule
Linkscape focuses on a breadth-first approach. Therefore we almost always have content from the homepage of websites, externally linked-to pages, and pages higher up in a site's information hierarchy. However, deep pages that are buried beneath many layers of navigation are sometimes missed and it may be several index updates before we catch all of these.
If our crawlers or data sources are blocked from reaching those URLs, they may not be included in our index (though links that point to those pages will still be available). Finally, the URLs seen by Linkscape must be linked-to by other documents on the web or our index will not include them.
For now, the best thing you can do to help your domain become indexed is to work on link building for links from sites with high mozrank.
Best,
Nick
SEOmoz -
This all depends on where the press releases have been posted.
If you've got the urls of the sites they're on it may be worth looking at these in OSE to see if SEOmoz has them indexed. However, don't forget that the SEOmoz index is not the same as google's. Just because it's not showing on OSE doesn't mean that G hasn't seen it.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Will noindex pages still get link equity?
We think we get link equity from some large travel domains to white label versions of our main website. These pages are noindex because they're the same URLs and content as our main B2C website and have canonicals to the pages we want indexed. Question is, is there REALLY link equity to pages on our domain which have "noindex,nofollow" on them? Secondly we're looking to put all these white label pages on a separate structure, to better protect our main indexed pages from duplicate content risks. The best bet would be to put them on a sub folder rather than a subdomain, yes? That way, even though the pages are still noindex, we'd get link equity from these big domains to www.ourdomain.com/subfolder where we wouldn't to subdomain.ourdomain.com? Thank you!
Reporting & Analytics | | HTXSEO0 -
When I click an outgoing link from Analytics - why are they all broken?
On one of my websites, if I visit the Behavior > Site Content section of Anayltics any link I try to open is broken. Google Analytics is appending the domain before every URL causing it to open in a popup but as a broken link. Example: Trying to click a link to a page on the website at this URL: http://www.thisisanexample.com/test.html But in the Analytics popup browser this is what it tries to load: www.thisisanexample.comhttp://www.thisisanexample.com/test.html So I can't preview any of the content within Google Analytics. I feel like this is a settings issue somewhere... Any ideas?
Reporting & Analytics | | ShawnW0 -
Www.google-analytics.com/analytics.js what is this link doing on my website?
Hello Expert, I am using google tag manager and google analytic is already configured in that now i just want to confirm when i do inspect element of my home page in that i can see this link - http://www.google-analytics.com/analytics.js where as if i do view source of my page then it is not visible. so what is this link - www.google-analytics.com/analytics.js and what role it play? Do we really need this link to be present on website? Regards, Raghuvinder
Reporting & Analytics | | raghuvinder0 -
Disavow links.??.Any One
Hi There, Just checking Google webmasters for one website. I have download a list links that was show in webmasters under "Links to Your Site". And found that there are few not found urls that or expired domain. May be that belongs to very old links building on bookmarking websites. I am thinking to submit all these links list in disavow links. Your thoughts.?
Reporting & Analytics | | lucidsoftech0 -
Large recent drop in "Domain Authority" and backlinks through OSE
Hello, I've noticed that our sites domain authority has dropped enormously this past week according to Open Site Explorer. It also shows us as having lost about half of our backlinks. Google webmaster tools doesn't show a corresponding drop in links and we haven't done anything to our domain recently. Anyone have any ideas what might have happened? Our site is at: http://www.GoldMaxUSA.com Thanks!
Reporting & Analytics | | JFritton0 -
No Link Data Available for this URL appears often. Are my sites too small to show up?
I am on the trial until Mar 5, 2012. I seldom get the info I want. Is it because my sites are too narrow a niche? I don't seem to be getting the data I'd like from your service. I'm trying to like it, but when I keep getting messages like this, it makes it hard to justify: "No Link Data Available for this URL appears often" Sample sites that I am unable to get data. I especially would like to know how many backlinks exist for each site. I paid someone to help me with them and I'd like to verify their work.: http://costaricadentistreview.com/ http://costaricadentistreviews.com/ http://costaricadentalimplants.org Any suggestions? Thanx Kurt Gross
Reporting & Analytics | | kurtray0 -
Want to link to GA profile, but the one I want is not showing in drop-down
How can I manually add the correct Google Analytics data in to my account? The two options I see on the drop-down are not the ones I want to select and I don't see a way to do it manually. Help!
Reporting & Analytics | | Uniqueson0 -
No Internal Followed Links on My Site?
I just ran the Site Explorer on my site (myeyedr.com) and it reported that there are no internal links on www.myeyedr.com or myeyedr.com. However, there were 20 internal followed links on www.myeyedr.com/index.aspx. I'm guessing this is hurting my SEO. Any suggestions?
Reporting & Analytics | | lance-1744490