Moz Q&A is closed.
After more than 13 years, and tens of thousands of questions, Moz Q&A closed on 12th December 2024. Whilst we’re not completely removing the content - many posts will still be possible to view - we have locked both new posts and new replies. More details here.
Crawling and Links - Showing Links
-
Hello
I have a campaign in Moz that shows a new site as having no domain authority and no links.
The site does have links to it, but they don't show up on OSE.
Does Moz count links in the comments section of blogs (or is this counted as social, when the commenting system is one that requires facebook login?) I know blog comments are not great for SEO, I just use them when the post/link is 100% genuinely relevant. The site does have actual links on websites not just comment links, so it isn't showing any type of link.
What is the best way to see the links the site has?
Thanks!
-
Hey Radi,
The link metrics section of your campaign pulls from our Mozscape index, which updates about once a month.
Most new sites and links will be indexed by our spiders and available in Mozscape and Open Site Explorer within 60 days, but some take even longer for a variety of reasons, including the crawl-ability of sites, the amount of inbound links to them, and the depth of pages in subdirectories.
Just so you know, here's how we compile our index:
- We grab the most recent index
- We take the top 10 billion URLs with the highest MozRank (with a fixed limit on some of the larger domains)
- We start crawling from the top down until we've crawled 180,000,000,000 pages (which is about 35% the amount in Google's index)
Therefore, if the site is not linked to by one of these seed URLs (or one of the URLs linked to by them in the next update), then it won't show up in our index.
We update our Mozscape Index every 4-8 weeks. Crawling the entire Internet to look for links takes ~2-4 weeks, but our crawlers are always collecting data. When we need to put the index together, we grab all the data they have collected and start processing, which can take up to 3 weeks to determine which of those links are the most important.
Mozscape focuses on a breadth-first approach. This means that we almost always have content from the homepage of websites, externally linked-to pages, and pages higher up in a site's information hierarchy. But deep pages that are buried beneath many layers of navigation are sometimes missed and it may be several index updates until we catch all of these.
If our crawlers or data sources are blocked from reaching those URLs, they may not be included in our index (though links that point to those pages will still be available). Finally, the URLs seen by Mozscape must be linked to by other documents on the web, or our index will not include them.
I hope this information helps! While the site and links may not be indexed yet, give it some time - maybe we'll see them in OSE next month!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Unsolved How To Check Outbound Links Of wesite?
I have a competitor website name Richmond Locksmith 24/7 How can i check its outbound links on moz??
Link Explorer | | Anjana96380 -
Unsolved how do I check the outbound links?
Hello everyone,
Link Explorer | | ZeonAley
I have a question about the links explorer: how do I check the outbound links? I have a website that I want to know its outbound links. Do I have to buy the Moz Pro method for that?0 -
How do you check for .gov and .edu backlinks using the new link explorer?
I'm trying to do an audit but I can't seem to figure out how to find .edu and .gov backlinks from the new link explorer. Can someone please help? I'm trying to learn how as open site explorer will be replaced by the link explorer. Thank you!
Link Explorer | | AFARiva1 -
How to download full list of internal links properly with OSE?
Hi Moz Community, I am having issues getting a full list of my internal links when I go to the Open Site Explorer. When I export the internal links into excel, I am getting half of my URLs and 80% of what I am getting is absolutely crazy URLs that are super super old. Plus, these old URLs are not even showing in my campaign crawls. So the crawls themselves are different. Any help on this would be greatly appreciated, since I am trying to get a full picture on the internal link structure of my site. Thanks!
Link Explorer | | RyanRhodesGW0 -
Spam Score and crawling of my site
Hello, I'm trying to analyze the spam score of my site which is 9/17 Actually I have few backlinks and all of them have a low spam score (max 4/17, just one). I think there's some kind of issue with the crawler since I get strange spam factors: Large Site with Few Links (likely true, I recently deleted a lot of tags used once) Low Number of Pages Found (wasn't it a "Large Site"??) Low Number of Internal Links (I got a considerable number) No Contact Info (I have a link to my facebook in the menu and a "contacts" page) Thin Content (It's just a blog with min 300 words per post, why thin?) Site Link Diversity is Low (likely true) Ratio of Followed to Nofollowed Subdomains (likely true) Low MozTrust or MozRank Score (true) Ratio of Followed to Nofollowed Domains (likely true) Can you please help me to understand it, is it a crawling problem or similar? If needed I will post the url of the website. Thank you so much Marco
Link Explorer | | MarcoBP0 -
How to force moz to crawl my backlinks?
I have some good number number of backlinks in my webmaster tools. But, open site explorer is showing very few backlinks. How to force moz to crawl all the backlinks? Or is there any way to submit backlinks to moz?
Link Explorer | | sankar7890