Open Site Explorer
-
I have entered my site (patioenjoyment.com) a few different times into the OSE and it never seems to find it, MOZ has found it because it has done the crawl test for me a few times, found some issues and I have been working on those. But I assume that if it is able crawl my site it should find it to run the OSE. It has come back with "**It looks like we haven't discovered established link data for this URL yet." everytime. **
Thanks,
Julie
-
Hey Julie,
Thanks for writing in and sorry for the confusion. Our link index is not created using our crawl test or campaign crawls of a site. The index is actually a completely separate database compiled by crawling the web and following the links we find there. Your site will only be included in Open Site Explorer if we find links to your site from outside sources.
Just so you know, here's how we compile our index:
- We grab the most recent index.
- We take the top 10 billion URLs with the highest MozRank (with a fixed limit on some of the larger domains).
- We start crawling from the top down until we've crawled 90,000,000,000 pages (which is about 35% the amount in Google's index).
Therefore, if the site is not linked to by one of these seed URLs (or one of the URLs linked to by them in the next update) then it won't show up in our index. Most new sites and links will be indexed by our spiders and available in Mozscape and Open Site Explorer within 60 days, but some take even longer for many of reasons, including the crawl-ability of sites, the amount of inbound links to them, and the depth of pages in subdirectories.
As Pixelbypixel mentioned, Majestic SEO and Ahrefs often have a larger index than we do because their tools are exclusively focused on links, while we have a wide variety of tools with an overview of a site rather than on one specific aspect of SEO or marketing.
I hope this helps! Please let me know if I can help you with anything else.
Chiaryn
Help Team Ninja -
Hi Julie,
Rogerbot isn't as big as other bots so it takes him a little while to get about. did you make sure you gave him enough time?
Now if you really need to you can also try other sites like Majestic SEO & ahrefs to find links but again they will also need a bit of time (though i tend to find them a bit faster than OSE). Other things to remember is the more you links to a page the easier it is for it to be crawled so if you don't have any links on it it can take a bit longer too.
Hope that helps.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Solved Moz Link Explorer slow to find external links
I have a site with 48 linking domains and 200 total links showing in Google Search Console. These are legit and good quality links. Since creating a campaign 2 months ago, Moz link explorer for the same site only shows me 2 linking domains and 3 total links. I realise Moz cannot crawl with the same speed and depth as Google but this is poor performance for a premium product and doesn't remotely reflect the link profile of the domain. Is there a way to submit a sitemap or list of links to Moz for the purpose of crawling and adding to Link Explorer?
Link Explorer | | mathewphotohound0 -
Drop in DA across multiple sites
Hi I monitor and track few Top sites that are Industry leaders. I got -1 to -3 in DA across this month. Has anyone else experienced this and the matter of fact is there has been rare or no change in the sites but the moz backlink data experienced a major drop "more then 100K backlinks were dropped for them in yesterday's report as compared to a 20 day old report". Has anyone at Moz or anyone in the community experienced the same
Link Explorer | | mr.ankit.manocha0 -
Open Site Explorer is finding old html Files that havn't been on my site in two years... even after a 301 Redirect. HELP!
Hello!
Link Explorer | | morganlindsaycole
My problem started when I became aware that when I checked my backlinks for the past two years, it states that no backlinks have been found. When I ran a site analysis on SEMrush - No backlinks are found on the URL, or Domain. There are 7 Backlinks on the Root Domain and those were configured in 2012. I made a second domain www.columbusweddingphotographersreviews.comwhere I linked to my domain at www.morganlindsayphotography.com so I could test that google had crawled both websites and after, still no backlink was found. I have also been published on a dozen or so wedding websites that has linked to my website where they are follow links and still nothing. (http://www.brendasweddingblog.com/blogs/2015/2/23/an-elegant-fall-wedding-in-ohio-with-morgan-lindsay-photography) **Website Background- **
In 2012 I had two separate websites - One for Seniors that was an HTML website I build in Dreamweaver at www.morganlindsayphotography/seniors and another for Wedding Clients found at www.morganlindsayphotography.com/Wedding - (wordpress) I had a Splash page wish was found atwww.morganlindsayphotography.com. Two years ago when I became aware splash pages were frowned upon in Google, I combined the two websites and stayed with the Wordpress which was www.morganlindsayphotography.com/Wedding
Because I did not want users to have to go to www.morganlindsayphotography.com/Wedding to view my url, Godaddy moved my wordpress site from thewww.morganlindsyphotography.com/Wedding directory towww.morganlindsayphotography.com When I ran the Open Site Explorer with Moz I found after runningwww.morganlindsayphotography.com the TOP pages on this domain according to Page Authority are old HTML files from my senior website, as well as old Posts from when my wordpress site was found atwww.moragnlindsayphotography.com/Weddings
No current pots or pages are showing up besideswww.morganlindsyphotography.com I do run a cache management system to speed up my system and recently cleaned out my .htcacess folder and still had no luck. This is difficulty something **Last night I made a 301 Redirect in my htaccess for all the old links pointing to the new links as best as I could. My htacess folder looks like this.. BEGIN WordPress <ifmodule mod_rewrite.c="">RewriteEngine On
RewriteBase /
RewriteRule ^index.php$ - [L]
RewriteCond %{REQUEST_FILENAME} !-f
RewriteCond %{REQUEST_FILENAME} !-d
RewriteRule . /index.php [L]</ifmodule> END WordPress Permanent URL redirect - generated by www.rapidtables.com Redirect 301 /Wedding http://www.morganlindsayphotography.com/ Permanent URL redirect - generated by www.rapidtables.com Redirect 301 /Wedding/ http://www.morganlindsayphotography.com/ Permanent URL redirect - generated by www.rapidtables.com Redirect 301 /about.html http://www.morganlindsayphotography.com/about-morgan-lindsay/ Permanent URL redirect - generated by www.rapidtables.com Redirect 301 /app.html http://www.morganlindsayphotography.com/blog/ Permanent URL redirect - generated by www.rapidtables.com Redirect 301 /experience.html http://www.morganlindsayphotography.com/senior-sessions/ Permanent URL redirect - generated by www.rapidtables.com Redirect 301 /index.html http://www.morganlindsayphotography.com/ Permanent URL redirect - generated by www.rapidtables.com Redirect 301 /senior.html http://www.morganlindsayphotography.com/ohio-senior-photographer/ Permanent URL redirect - generated by www.rapidtables.com Redirect 301 /seniorsconstruction.html http://www.morganlindsayphotography.com/ohio-senior-photographer/ Permanent URL redirect - generated by www.rapidtables.com Redirect 301 /Wedding/2012/06/22/brittany-reis-jason-mcclaflin-tiffin-ohio-wedding/ http://www.morganlindsayphotography.com/holy-family-church-columbus-wedding/ After I ran the open site moz explorer and the www.morganlindsayphotography/Wedding was still there..0 -
Open Site Explorer Top Pages https Title tag issue
Hello, everybody. I've noticed this strange thing in Top Pages reporting of Open Site Explorer. If i do a report for any website which doesn't have security certificate installed, such as http://www.hyperlinksmedia.com I get normal results, with title tag shown for every page, but, if i do a report for website with Security certificate, such as https://www.hyperlinksmedia.com, report is coming back for non-secure URL version (http:...), so, it says "No Title" for any pages. I wonder, if it influence PA and DA scores. Although, if i run full crawl test, then i shows all meta and title tags for SSL version of a website's url. Thanks!
Link Explorer | | seomozinator0 -
Why do I not see any data in Open site Explorer for my site www.mtg-sg.com
The PA and DA shows as one. The message is "It looks like we haven't discovered established link data for this URL yet." But its shows me that there are facebook shares. Therefore, it can't be the reasons stated below.
Link Explorer | | Dineshr840 -
Facebook "likes" not showing up in Open Site Explorer
Hi All: I'm dealing with a company that has 299 Facebook likes, but Open Site Explorer only shows three. I checked the NAP on Facebook and it's correct. Anyone know why this might be happening? I'm worried if Open Site Explorer is not seeing the likes, Google might not as well, for whatever reason. Thanks! Wes
Link Explorer | | wrconard0 -
Does Open Site Explorer recognise nofollow links?
In the backlink profile for my site on OSE, I'm seeing a lot of links that are paid advetorials and I know go through DoubleClick. I was informed that links going through Doubleclick automatically become NoFollow links. If the above is true, should I ignore these links? If they are NoFollow, they don't really contribute to my backlink profile? THANKS!
Link Explorer | | whis0 -
OnPage Grader double counting keywords on responsive site (hidden vs visible)
FYI - it appears that if you have a responsive site that has blocks of text that are duplicated, but Hidden or Visible depending on the screen width, that On-Page Grader will count any keywords in that text twice. I have text shown in one location to Desktop users that needed to be re-located to a different part of the page for Tablet and Phone users to keep the layout nice. And my OP Grader keyword count doesn't match what I saw on the page doing Ctrl-F to find the keywords, unless you count the Hidden text. (not hidden like cloaking or some black hat thing - just not displayed on certain devices) I guess On Page Grader just reads the source code and ignores whether the text is hidden or visible. It would be nice if it read the code as if it was a Desktop device. (suggestion for Moz staff) Does anybody know if Google also ignores device dependent Hidden vs Visible areas???
Link Explorer | | GregB1230