How effective is OSE in crawling press release links?
-
How effective is OSE in crawling press release links?
We have released a few press releases recently (over the last couple of months) and OSE doesn't seem to have found them.
-
Hey There,
That could be a possibility. It is hard to say definitively given the nature of web crawlers. They just crawl links as they see them in random succession, so a lot of factors come into play.
Best,
Nick
SEOmoz -
Our releases have appeared on big sites like the Financial Post.
Is it possible they just get buried under other news so OSE can't find them? I know Google indexes these pages, we get the alerts.
-
Hey there,
Just so you know, here's how we compile our index: - We grab the most recent index. - We take the top 10 billion URLs with the highest MozRank (with a fixed limit on some of the larger domains). - We start crawling from the top down until we've crawled 59,000,000,000 pages (which is about 25% the amount in Google's index).
Therefore, if the site is not linked to by one of these seed URLs (or one of the URLs linked to by them in the next update) then it won't show up in our index. Sorry!
We update our Linkscape Index every 4 weeks. Crawling the entire Internet to look for links takes 2-3 weeks, but our crawlers are always in motion. When we need to start processing, we grab all the data they have collected and start processing which can take up to 3 weeks to determine which of those links are the most important. You can see our most recently updated schedule here: http://seomoz.zendesk.com/entries/345964-linkscape-update-schedule
Linkscape focuses on a breadth-first approach. Therefore we almost always have content from the homepage of websites, externally linked-to pages, and pages higher up in a site's information hierarchy. However, deep pages that are buried beneath many layers of navigation are sometimes missed and it may be several index updates before we catch all of these.
If our crawlers or data sources are blocked from reaching those URLs, they may not be included in our index (though links that point to those pages will still be available). Finally, the URLs seen by Linkscape must be linked-to by other documents on the web or our index will not include them.
For now, the best thing you can do to help your domain become indexed is to work on link building for links from sites with high mozrank.
Best,
Nick
SEOmoz -
This all depends on where the press releases have been posted.
If you've got the urls of the sites they're on it may be worth looking at these in OSE to see if SEOmoz has them indexed. However, don't forget that the SEOmoz index is not the same as google's. Just because it's not showing on OSE doesn't mean that G hasn't seen it.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Using Canonicals on category or link pages
Hey, If a site has category or tag pages showing in search results for a particular keyword - sometimes higher than the page you would like to rank - could using canonical redirects on categories and tags be a solution? Thanks
Reporting & Analytics | | wearehappymedia0 -
URL open with double domain names when click on visit URL link in Google Analytics
I have configured Advance Filter to track the sub-domains traffic as follow : Filter
Reporting & Analytics | | gamesecure
Type: Custom filter > Advanced Field A: Hostname Extract A: (.*) Field B: Request URI Extract B: (.*) Output To: Request URI Constructor: $A1$B1 After that, I am able to see sub-domains record and View Full Page URL In Reports. But when I check reports in All page (e.g. Behavior >> All Pages) or selecting Landing Page as a Primary Dimension. Further I click on Icon given next to displayed Full URL to visit to same domain page, in browser the page
opened but the double domain name comes so page not open successfully. For example : In landing page list following URL given : www.sitegeek.com/compareHosting/arvixe_vs_hostgator If I click on icon given next the displayed URL, in browser following URL will
open https://sitegeek.comwww.sitegeek.com/compareHosting/arvixe_vs_hostgatorIs this First Domain with HTTPs, coming from Google Analytic 'View' where this is taken ? How Can I remove double domains? Thanks, Rajiv
0 -
Difference between External Followed Links and Total External Links?
Hello, could someone please elaborate on what is meant by "External Followed Links" vs. "Total External Links"? Does "External Followed Links" mean the number of links that are generating traffic to the site? Or is there some other way to conceptualize it? Any help would be appreciated! Thank you in advance.
Reporting & Analytics | | lincolndigitalgroup1 -
How can I see what Google sees when it crawls my page?
In other words, how can see the text and what not it sees from start to finish on each page. I know there was a site, but I can't remember it.
Reporting & Analytics | | tiffany11030 -
How to get metrics on Home page image link to youtube video in lightbox
My home page has a explainer video. Is there a way to get metrics or analytics data about who watch or don't watch the video? http://www.furnacefilterscanada.com For example, if I have 100 unique visitors on this page and my video get 33 views, 33% saw the video! I think the data provide by youtube are not accurate, my site has a avarage of 40 visitors/day and my video was saw 84 times sinces it is online, 14 days ago. On that 84 clicks, I most have click 30 times!!! When you lend on my home page, you can't miss it! http://screencast.com/t/ZbIWYl0W I don't believe only a few visitors saw it. Conversation rate has increase. I use Google Analytics, is there a code or something that can be done to get metrics or data more accurate then the .Ananalytics" provide in my youtube control panel? Please HELP! thank you, BigBlaze
Reporting & Analytics | | BigBlaze2050 -
Total Linking Root Domins
I'm still very new to link building and SEO, (only one month in!) I have a reasonable starting point as our web site is fairly well designed but I have a long way to go to catch up in what is a very competitive market! (Music Retail). My question is regarding Open Site explorer and its ability to accurately reflect back links. Looking at total quantity of unique back link domains Open Site currently has me at 36 domains, Google webmaster tools has me at 187!! The one site that all my 'watched' competitors has is DMOZ, this gives them a great boost on the SEOmoz and open site rankings. I have 3 links on DMOZ and they all show up on my Webmaster tools yet don't show on either SEOmoz or open site. I've left it for a couple of months to see if it caught up but no real change. My worry is that there seems little value in the SEOmoz tools if their not at least as complete as Google webmaster is to allow me a fair comparison! Is there anything wrong with my setup on SEOmoz??
Reporting & Analytics | | rattleanddrum0 -
Any thoughts on why Nextag and MonsterMarketPlace are linking to our site?
I'm looking in WMT at the crawl errors and I noticed that our website has gotten a lot of Not Found crawl errors that seem strange. A lot of these not found pages are Display URLs that I use in PPC advertising, but not actual redirects (i.e. explorica.com/EducationalTrips). When I looked at how these links were being found, the inbound links were coming from Nextag.com and monstermarketplace.com, two sites that our company has never had a relationship with. We're an educational travel company, so we'd have no reason to. When I followed the links, it looks like it's coming from their "Sponsored Links," but these aren't Google or Bing Ads. We don't even advertise on the content network. Example link: http://www.monstermarketplace.com/starters-and-alternators/alternator-motorola-style-12v-51a-10376 (the ads do rotate so my site might not appear when you check it out). Anyone ever had experience with this type of issue?
Reporting & Analytics | | Explorica0 -
No Internal Followed Links on My Site?
I just ran the Site Explorer on my site (myeyedr.com) and it reported that there are no internal links on www.myeyedr.com or myeyedr.com. However, there were 20 internal followed links on www.myeyedr.com/index.aspx. I'm guessing this is hurting my SEO. Any suggestions?
Reporting & Analytics | | lance-1744490