Open Site Explorer Recently Discovered Links Question

[evan89]

Hey Mozzers,

I have a question regarding the Open Site Explorer Recently Discovered Links.

I know that I have receive follow link from a few sites that have more DA than my site. I am wondering why it is taking so long for OSE to discover these links? I double checked the sites to make sure that they don't have NOFOLLOW (sorry for the double negative), and the sites have linked to my site for over a month now.

Any ideas? I'm not concerned about it because Search Engines have discovered those links. I am just curious why this is, or if it is normal.

Cheers!

[evan89]

Hey Erin,

Thanks for the further explanation and clarification. I really appreciate it!

[ErinMcCaul]

Hi! My name is Erin, and I'm on the Moz Help Team. Great answer by the way, Paddy! I just want to throw in a little more information about Just Discovered Links (JDL).

All of the links that end up in JDL come from tweeted bit.ly links. We get our data for that tool from bit.ly and they can provide us with what the associated full link is, which is how we show the full link in the tool (because the bit.ly version of the link wouldn't be very informative), but all of the Just Discovered Links come from URLs that were tweeted as a bit.ly.

Basically, if someone tweeted the page http://www.squaresocial.co/site-isnt-ranking-google-anymore/ as http://bit.ly/1jyxEpX, bit.ly would see the tweet and let our system know that A. the URL http://bit.ly/1jyxEpX was tweeted and B. that that bit.ly URL redirects to http://www.squaresocial.co/site-isnt-ranking-google-anymore. Our system then crawls the page http://www.squaresocial.co/site-isnt-ranking-google-anymore to see where that page is linking and we can see there is a link to moz.com on that page, so we include it in the Just Discovered link index for moz.com as the full URL, rather than the shortened version: http://screencast.com/t/fVs59BsYE6rT

I hope that helps!

Erin

[evan89]

Thanks Paddy,

I wasn't aware of the cycles. Thanks for the quick response!

[PaddyDisplays]

Hi Evan

It can take 5-8 weeks for a link to show in OSE, its just depends when in the OSE crawl cycle you got the link. The last update was on the 21st april but that is based on data gathered from the 4+ weeks before that date so if that link appeared in the middle of that craw it could have been missed.  Also there is a chance it just missed that page during the last crawl.

The next update is on the 19th of May, so hopefully your link will show then.

Btw if the link is showing under "Just-Discovered Links" is OSE then you know it will be picked up.  (

more info http://moz.com/products/api/updates