KW Explorer is Working to Disambiguate Keywords Google Merges Together
-
Hey gang,
Russ Jones from Moz has been doing a ton of heavy lifting work to try to get around the new problem posed by Google AdWords recent change to merged-keyword volume data. But, we're fighting back against this obfuscation in Keyword Explorer. I'm sharing two emails (slightly edited) from Russ about what we're doing here:
Introduction to the Problem:
Google Adwords Keyword Planner is the primary source for keyword search volume (how often a keyword is searched monthly on Google) for much of the search marketing industry. While Google has grouped together highly-similar terms for a while (especially misspellings), in June of 2016 they dramatically increased this keyword-grouping. This means similar phrases like "keyword rank", "keyword ranking" and "keyword rankings" would all be reported as having the same, combined search volume, rather than their individual search volumes. If you were to take Google's numbers at face value, you might think there are 3,000 searches per month for these 3 terms, when in reality there is only 1,000, divided amongst the 3 terms.
How we are addressing it:
Moz's Keyword Explorer uses a blend of data sources, not just Keyword Planner, to build our volume metrics. This gives us a distinct advantage in that we can adjust the volume of words that deviate dramatically in one data set verses another. Take for example the phrases "keyword rank", "keyword ranking", and "keyword rankings". While Google Keyword Planner might report all of these as having 1,000 searches per month, Moz Keyword Explorer can detect that these numbers are significantly higher than what our models would predict given our other data sets. We can then adjust the volume accordingly. Moreover, given our huge keyword data set, we can also identify grouped phrases (like these 3) and divide the volume proportionally to what we see in our other data sets. Thus, we address the grouping problem from multiple directions.
Here's email #2 from Russ, detailing more of how we're attacking this:
I have been working pretty much non-stop on this keyword volume disambiguation problem (finding the real search volume of individual keywords when Google clumps several together). I think I have settled on a pretty good solution and am working on getting it all in. For example...
Google Keyword Volume for the phrases "briefcase for women" and "briefcases for women" are both at 3600 because they have been lumped together. My disambiguation script says the singular (briefcase for women) should be 2731 and the plural should be 869. Google Trends roughly agrees with this, showing that the singular is searched more than 2x the plural: https://www.google.com/trends/explore#q=briefcase%20for%20women%2C%20briefcases%20for%20women&cmpt=q&tz=Etc%2FGMT%2B4
Basically, Keyword Explorer should already be providing some more accurate/segmented numbers than AdWords, and in the future, we'll get even better thanks to our clickstream data and our evolving models.
Any questions, let us know!
-
Thank you, Russ!
Google confirmed me that this change is due to an update, it won't be rolled back and there's no way to fetch data for each variant individually. Details are here.
Your tool will help us a lot.
-
Thanks for taking the time to come up with a 'solution' to the problem
-
The bug has been fixed but it will take 24 hours for the caches to clear! Thanks again!
-
That is a weird bug, because our database is showing 18k+ for that term! I will investigate!
-
Thank you, Rand and Russ!
I found a weird result. "bag" in US is reported to have 0-10, while "bags" in US is 11.5k-30.3k.
Considering KW planner and Google trend, "bag" in US seems to be outlier.
-
You're working in the right direction, guys. It seems a little scammy on the part of search engines to show these search volumes, as if they prompt you to bid on those keywords because they have a high search volume. While they do show the same SERP for this keyword, I believe a page optimized with "Buy a car in Orlando" will have a better score and a lower bid than a page optimized for "Buys a cars in Orlandos".
-
Thanks!
-
You're welcome for our efforts. I am really excited as we roll out this volume fix. I think it is going to offer a real improvement for SEOs everywhere.
-
Thanks Russ and Rand! I've used many tools for getting to the bottom of estimated volume and have high hopes for your evolving KW Explorer. It's definitely needed.
-
This has a HUGE HISTORICAL impact.
-
Thanks for touching upon this topic which is seriously impacting all marketers who rely on google data. Even the core definition of "Search Volume" is now NOT correct. It's THAT bad as pointed out here http://bit.ly/29MvvvK. Thanks for your efforts.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Is there an automated way to import Keyword Rank Tracker data in Google Data Studio?
I am creating an SEO Dashboard in Google Data Studio.
Moz Bar | | Lvet
While it's easy to import data from Google Search Console, I have troubles in importing data from Mozzarellas tools. I thought about uploading a CSV file with the ranking to a Google Sheet Document, but I cannot find a way to do this at regular intervals with manual intervention.0 -
Should keywords found in a keyword tool (eg. Keyword explorer) be implemented on a page in the exact order?
Hi guys, I have a question about adding keywords found directly from a keyword tool onto a webpage. I see a keyword opportunity from Moz's Keyword Explorer, for example, "dog giardia treatment natural" and was wondering if it should be worked into the page exactly in that order? For example, I've modified the question on the page to now read "Are there any other dog Giardia treatments that are natural?" Is this good practice? Should it be exactly in the order of the keyword found in the tool? Is what I've done too spammy? Appreciate any help! Thanks
Moz Bar | | marktheshark101 -
"Keywords Showing" total doesn't match "Tracked Keywords" total
My "Tracked Keywords" total under "Add & Manage Keywords" does not match the total for "Keywords Showing" on the main "Rankings" tab. Why is there a difference? For example, I have 453 tracked keywords attached to my campaign, but under the "Tracked Keywords Overview," there are only 254 listed. I'm sure there's a simple explanation but I can't find it anywhere!
Moz Bar | | MSoleski0 -
Exporting KW Lists
Hi all, I am confused about the new Moz layout. Is there a way for me to export the list of keywords that I'm tracking to an Excel document. My client would like me to start tracking the avg. monthly searches and since I can't seem to find a way to do that in Moz, I need to export the list to an Excel doc and then drag and drop them into the Keyword Ad Planner. I've tried to 'download the csv' using the 'export csv' function, but when I do it's not pulling the data how I want it. I basically just want to create a copy of the existing keyword list, but when I try to do it here, it's pulling a bunch of historical data and stuff I really don't need. If anyone knows of an easier solution to achieve as much, I would love to hear it. Please let me know.
Moz Bar | | maxcarnage0 -
Use of Keyword Analysis Tool (espcially regarding search volume)
Hello! I am fairly new to Moz and just starting to explore the available Research Tools. At first glance, I was very excited about the Keyword Analysis tool, but I quickly realized that (a) I wasn't receiving the information I needed and (b) I didn't know what to do with the information it gave me. So... Two specific questions: Is there any way to see the Google Search Volume instead of the Bing Search Volume? The overwhelming majority of our organic site traffic comes from Google, so it seems silly to look at the Bing search volume. How do you deal with the fact that this tool only returns search volume based on an exact match? As we know, there are some many ways the same general query could be entered, but it seems ridiculous for me to sit there and run the tool against every iteration I can think of just to get a general sense of the search volume. Two general questions: What do you find helpful about the Keyword Analysis tool and how does it inform your SEO work? What other tools do you recommend to help determine Google search volume for keywords? Thanks in advance for your help and advice!
Moz Bar | | Marketing_Dept0 -
Open Site Explorer classic view is gone??! where is it?
I used to use open site explorer classic view a lot for pitching clients - it was great for comparing a few competitors at once. Now it seems to have disappeared - any idea where i can find it, or find similar functionality?
Moz Bar | | miguelitomana0 -
Keyword Analysis: Limited to 400 Keywords per day?!
I needed to do keyword research, but to my absolute horror I see this: "Currently we are only able to offer results for 400 keywords per user per day." I need to check more than 400 today, how can I use more? I don;t want to have to pay for 10 accounts or something!! PLEASE PLEASE PLEASE remove this limit! I would be willing to pay more than $99 per month!!
Moz Bar | | Zovi0