Local listings aren't being crawled?
-
Hello, SEO brainiacs. Here is the problem I can't figure out:We have a lot of clients and all of them have local listings, such as Insider Pages, Yahoo local, Bing locals, Yelp, Yellow Pages etc etc etc.
And all of those local listing have company's website link. But none of those links are considered (found) in reports, such as opensite explorer or in Link Analysis Section of Moz PRO.I do know that MOZ crawl considers only high DA websites, but all of local listing domains have above 80-90 DA score, so they can't be NOT crawled.
I will say that some local listings do appear on very few reports, but far not all of them.
So, what can be the problem?
-
Hi Charles. I don't work for Moz, so my recommendations are my own.
Also, I pay for a pro subscription here as well, and also combine resources from multiple sources when I'm really trying to get into the minutae of each and every back link. Ultimately it's a lot cheaper than creating my own crawler and index to try and duplicate Google. In your example with clients on local, you were likely involved in developing those links so why not keep track of them in-house versus 3rd party tools? Personally my only need I have for trying to get 100% of backlinks reported is if I run into a situation with a manual action client and need as robust as a disavow list as possible. Often times you can find these sorts of links via Google searches alone due to repetitive exact match keyword usage.
The most value I get out of OSE is when I'm comparing the back link profiles of my sites versus those of the competition that are appearing in the rankings. I can usually come up with more than enough work to keep myself busy when using the tool in this manner.
If you're specifically trying to manage local listings, Moz Local may be a better tool for your purposes. Cheers!
-
Thanks for a response.
Your answer does make sense, besides one thing:
We are paying MOZ for PRO subscription and instead of providing fully operational tool, I am being referred to other services?!
That's nice...
Everybody knows that GWT is very incorrect on many-many-metrics, ahrefs and majestic are not free (or at least not full versions of their tools). Hoping to get the most relevant results and SEO picture, we go with MOZ and that's what we get?! "Go check out other services"?
Shame... shame...
-
Hi Charles. It could be that due to Mozscape going after a wider diversity of domains, they're not crawling as deeply where your clients have local links. Here's Rand's explanation from the Jan 27 update:
The second is that we crawled a massively more diverse set of root domains than ever before. Whereas our previous index topped out at 192 million root domains, this latest one has 362 million (almost 1.9X as many unique, new domains we haven't crawled before). This means that DA and PA scores may fluctuate more than usual, as link diversity are big parts of those calculations and we've crawled a much larger swath of the deep, dark corners of the web (and non-US/non-.com domains, too). It also means that, for many of the big, more important sites on the web, we are crawling a little less deeply than we have in the past (the index grew by ~31% while the root domains grew by ~88%).
Bolded for my emphasis. If you cross link from your client sites to their local review listings to help / prompt users to fill out reviews you're likely to see more of those pages indexed in OSE. However, they could still be not counted if they're not considered important enough for that domain, i.e. if they're not in the top 1000 Yelp pages on yelp.com (numbers are just for example purposes of the idea... not accurate). Make sense?
Google however still likely knows about the links and is applying the related associations. And feel free to use other tools (GWT, aHrefs, Majestic) when trying to create a complete backlink profile for clients. Cheers!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Does the Moz Pro site crawl, crawl password protected sites?
So i asked Moz Pro site crawl to crawl my page, and a lot of issues came up - but for password protected sites. Does the Moz Pro site crawl do this? A lot of the issues, are not relevant for a site that is password protected.
Link Explorer | | Minlaering.dk0 -
Can i Force opensiteexplorer to crawl a url?
Hello. I check the QA and didnt find an answer to this. I've check one link on my site which is indexed by google but not by mozopensite explorer. If i search the url i find it on google but not i nopen site explorer. This only means that open site explorer havent find it. IF google index that page this means i'm getting the juice? My question is if google index a page for sure it follow one of the links (follow link). This is importan for me since this is my best DA link, probably a game changer for us. Also, Is there a Way to force opensiteexplorer to crawl this page? Thank you.
Link Explorer | | ebest.cl0 -
Moz's Spam Score - WWW v Non-WWW
Given that going with a www or non-www TLD is a coin-toss in Google's eyes, I'm curious as to how this relates to Moz's spam score (if at all)? Specifically, we've got a client who has several sites across a number of industry verticals, and for some of them, the www and the non-www versions of their websites are both in play (sigh). Obviously we'll sort that out shortly, but my question is why, when we put both TLDs into Open Site Explorer does the www and the non-www version of the sites get different spam scores? With some of their sites (www v non-www) the difference in the spam score might be a 2 for the www v a 3 for the non-www. But in others it might be 0 for the www v 8 for the non-www! And it's unclear which one is the 'real' spam score, as there seems no rhyme or reason to the results. Anyway, any thoughts from the room would be appreciated.
Link Explorer | | SEO-NS0 -
Where can I see the list of the new backlinks reported?
In my dashboard I see a +875 in external links. Now they are 1,130. This sounds worrying rother than good news! I'd like to get an explaination but how can I see where these links come from? And when? How can be explained a steep increase in the link count from the last index? Also, a minor question, where can I find the increase percentage? I am able to see only the absolute count.
Link Explorer | | 2mlab0 -
Open Site Explorer is finding old html Files that havn't been on my site in two years... even after a 301 Redirect. HELP!
Hello!
Link Explorer | | morganlindsaycole
My problem started when I became aware that when I checked my backlinks for the past two years, it states that no backlinks have been found. When I ran a site analysis on SEMrush - No backlinks are found on the URL, or Domain. There are 7 Backlinks on the Root Domain and those were configured in 2012. I made a second domain www.columbusweddingphotographersreviews.comwhere I linked to my domain at www.morganlindsayphotography.com so I could test that google had crawled both websites and after, still no backlink was found. I have also been published on a dozen or so wedding websites that has linked to my website where they are follow links and still nothing. (http://www.brendasweddingblog.com/blogs/2015/2/23/an-elegant-fall-wedding-in-ohio-with-morgan-lindsay-photography) **Website Background- **
In 2012 I had two separate websites - One for Seniors that was an HTML website I build in Dreamweaver at www.morganlindsayphotography/seniors and another for Wedding Clients found at www.morganlindsayphotography.com/Wedding - (wordpress) I had a Splash page wish was found atwww.morganlindsayphotography.com. Two years ago when I became aware splash pages were frowned upon in Google, I combined the two websites and stayed with the Wordpress which was www.morganlindsayphotography.com/Wedding
Because I did not want users to have to go to www.morganlindsayphotography.com/Wedding to view my url, Godaddy moved my wordpress site from thewww.morganlindsyphotography.com/Wedding directory towww.morganlindsayphotography.com When I ran the Open Site Explorer with Moz I found after runningwww.morganlindsayphotography.com the TOP pages on this domain according to Page Authority are old HTML files from my senior website, as well as old Posts from when my wordpress site was found atwww.moragnlindsayphotography.com/Weddings
No current pots or pages are showing up besideswww.morganlindsyphotography.com I do run a cache management system to speed up my system and recently cleaned out my .htcacess folder and still had no luck. This is difficulty something **Last night I made a 301 Redirect in my htaccess for all the old links pointing to the new links as best as I could. My htacess folder looks like this.. BEGIN WordPress <ifmodule mod_rewrite.c="">RewriteEngine On
RewriteBase /
RewriteRule ^index.php$ - [L]
RewriteCond %{REQUEST_FILENAME} !-f
RewriteCond %{REQUEST_FILENAME} !-d
RewriteRule . /index.php [L]</ifmodule> END WordPress Permanent URL redirect - generated by www.rapidtables.com Redirect 301 /Wedding http://www.morganlindsayphotography.com/ Permanent URL redirect - generated by www.rapidtables.com Redirect 301 /Wedding/ http://www.morganlindsayphotography.com/ Permanent URL redirect - generated by www.rapidtables.com Redirect 301 /about.html http://www.morganlindsayphotography.com/about-morgan-lindsay/ Permanent URL redirect - generated by www.rapidtables.com Redirect 301 /app.html http://www.morganlindsayphotography.com/blog/ Permanent URL redirect - generated by www.rapidtables.com Redirect 301 /experience.html http://www.morganlindsayphotography.com/senior-sessions/ Permanent URL redirect - generated by www.rapidtables.com Redirect 301 /index.html http://www.morganlindsayphotography.com/ Permanent URL redirect - generated by www.rapidtables.com Redirect 301 /senior.html http://www.morganlindsayphotography.com/ohio-senior-photographer/ Permanent URL redirect - generated by www.rapidtables.com Redirect 301 /seniorsconstruction.html http://www.morganlindsayphotography.com/ohio-senior-photographer/ Permanent URL redirect - generated by www.rapidtables.com Redirect 301 /Wedding/2012/06/22/brittany-reis-jason-mcclaflin-tiffin-ohio-wedding/ http://www.morganlindsayphotography.com/holy-family-church-columbus-wedding/ After I ran the open site moz explorer and the www.morganlindsayphotography/Wedding was still there..0 -
How can I use Open Site Explorer to Identify why my own URL's are appearing as inbound links
I'm a new member of Moz, and am trying to understand why I am seeing my sites URL's in my Inbound Link results in Open Site Explorer. There are quite a few, and they are all product category URL's that are generated by my stores database. This is not happening with .html URL's. Any thoughts?
Link Explorer | | Artfx0 -
Why Moz doesn't offer tool similar like SEOprofiler Link Disinfection?
Hi Moz, As I have been your member & using pro tool for more than an year, it's been amazing experience working and using your each tool's function tool, wehther to check on-page grader, rank tracking, on-page crawling issue, keyword difficulty and the one my best for link analysis is Open Site Explorer etc. I came here to ask about something which I didn't find here than other providers is most popular Bad Link Detection Tool. As **SEOprofiler Link Disinfection **offers their customers to use this to get all of their bad or spammy links harming them to rank high or getting away from ranking goal. Let me know, are you planning anything similar to this to bring soon in your tools and provide your members to take benefits of such type function as well OR should i go to SEOprofiler for this? Best,
Link Explorer | | Futura
Teginder Ravi0 -
A simple count (with list if possible) of the external and internal links on a website
Dear Moz Community, I am trying to find a way to easily analyse a website (http://uk.chm-cbd.net) to determine the number of internal and external hyperlinks throughout the (roughly) 490 webpages within the site. It would also be extremely helpful to have a list of all the links with their url. Does anyone know of a tool, methodology to do this? If it requires a lot of programming then that does not help me very much as I am not very computer literate!! So a software to download or an online service would be very helpful. Open Site Explorer seems to be limited, such that I would have to do an analysis on each page within the website. BUT, if anyone knows how I can do using OSE, then please tell me. Thanks in advance to anyone who may be able to help Hugh
Link Explorer | | HLConsulting0