Whitehat site suffering from drastic & negative Keyword/Phrase Shifts out of the blue!
-
I am the developer for a fairly active website in the education sector that offers around 30 courses and has quite an actively published blog a few times a week and social profiles.
The blog doesn't have comments enabled and the type of visitor that visits is usually looking for lessons or a course.
Over the past year we have had an active input in terms of development to keep the site up to date, fast and following modern best practises. IE SSL certificates, quality content, relevant and high powered backlinks ect...
Around a month ago we got hit by quite a large drop in our ranked keywords / phrases which shocked us somewhat.. we attributed it to googles algorithm change dirtying the waters as it did settle up a couple of weeks later.
However this week we have been smashed again by another large change dropping almost 100 keywords some very large positions.
My question is quite simple(I wish)... What gives?
I don't expect to see drops this large from not doing anything negative and I'm unsure it's an algorithm change as my other clients on Moz don't seem to have suffered either so it's either isolated to this target area or it's an issue with something occurring to or on the site?
-
Snowflake,
When you migrate to HTTP's i believe you have to add the new protocol to Search Console. Google looks at HTTP and HTTPs as 2 different sites, which is why you might be seeing your index count going down under your HTTP account in SC. If you add the HTTPs version of your website to search console, you may see that those pages have been indexed under the HTTPs protocol. Check it out, wait a few weeks and see what happens.
Secure Your Site With HTTPS - Search Console Help
https://support.google.com/webmasters/answer/6073543?hl=en -
That is a very good shout!
-
Thanks Don,
I had read that article initially actually which is why I thought a few weeks was enough for it all to have settled back out but maybe I'm expecting a bit much for a 600 page site.
Many thanks for your help I'll maybe just be patient if there is nothing glaringly wrong
-
Also a quick point, if you still have your Google search console setup for HTTP, even though you use HTTPS now, I'd suggest looking at what is being reported as indexed in there. That maybe the missing link.
Cordialement,
Don
-
So I'm not seeing anything blocking crawling on your site which is good. But I did notice that you have at one time used URL types "http" and "https" which leads me to believe you may have recently switched to HTTPS. In such case you should know that it may take Google sometime to adjust. On a technical level, https and http are 2 different domains.
It is highly likely that Google has index the HTTP version of some of these pages which is why your index count maybe lower then normal for the HTTPS version.
I do see you properly 301 redirected these pages and your sitemaps are reflecting the https as well, if again this was a recent change it just looks like its going to take a bit of time for Google to catch up.
This is worth a quick look, https://support.google.com/webmasters/answer/6073543?hl=en (scroll to the bottom) and see the section "Migrating from HTTP to HTTPS".
I sent you additional info in PM.
Hope this helps,
Don
-
We did go from http to https about a month ago but we were careful that all the redirects and sitemaps were reflected correctly. I dont think there is an issue with the robots text (it is present and nothing weird blocking).
I'll take a look at those links and send you a pm - many thanks Don
-
Hi,
There are several reasons.
If you have recently changed your url structure. IE (went from using www to not, or https or not, or trailing / or not). In these cases Google could have indexed the pages already under the "other" version.
Google could be having a crawling error, like in a robots.txt or lack there of. Improper canonical tags, blocked access, improper redirects, or a manual penalty.
If you would like to post a link (or pm me) I will take a look and see if I can spot a potential problem for you.
Here are a couple links on Google that should help:
Why Pages Drop From Index
Overview Pages Not Being CrawledHope this helps,
Don
-
Checking Webmaster Tools it looks like Google has unindexed 500 out of our 630 pages in the last 2 weeks.
Is there any reason for why this maybe?
-
Thanks for your input Donford,
I've had a look in OSE again and I can't see any spam links (all the genuine links are rated 0 through to 3) which looks very good. So it doesn't appear to be a negative campaign against me.
I may try Majestic for peace of mind... it makes it even more the stranger that we are being penalised so much
-
Hi Snowflake,
You can use the OSE (Open Site Explorer) here on Moz to check the links they found. You can download that report to CSV to easily sort and see if you have a possible negative campaign running against you.
You could also use, Majestic, or SEMRush. to find more links. Just note there is no tool, free or paid that is going to be able to get all the links pointing to your site.
If you don't find a lot of spam links to your site, chances are there isn't somebody trying to target you with a negative campaign.
Hope it helps,
-
Thanks Eric,
There are a few languages of the site but as far as I'm aware no duplicate content in the same language but I will check with Siteliner just to be sure.
For disavowing backlinks - is this just via webmaster tools you are recommending to do that? If so we haven't done that yet but it seems sensible to try. When I last checked back links there were a few random sites that we certainly hadn't submitted to and looked spammy but when I went onto them we couldn't see our links.
Do you have a recommendation for a better backlink testing tool?
-
I know this is frustrating. There are a few areas that I would look into that could be causing this: duplicate content issues and links. First, look to see if you have any duplicate content issues on the site. There could be a duplicate copy of the site (perhaps a dev version that should not be indexed) or even certain content on your site that's causing issues. You might try Siteliner's crawler to identify if there are any issues you can fix.
Another possible reason is the links to the site. The site could have been hit by negative SEO, and a lot of "low quality" links or off-topic links could be pointing to your site. I've seen this in the past, and the only thing you can do is identify the links and disavow them. Sometimes you can get them removed, but disavowing them should work.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
The Importance of Bold Keywords in SEO?
Hi all, Recently I came cross an RV lifestyle blog named RVing Trends. The website features high-quality contents about handy RV camping tips & guides, and in-depth RV product reviews. They seem to spend a lot of effort on the content quality. I've followed this website for a few months and can see they've been producing 3,000-5,000 word length contents regularly. One thing I notice is that they emphasize the main keyword as bold in almost the posts. You can check 1 sample here about RV mattress reviews. Just want to ask for your opinions about the efficiency of this technique and is the keyword density still important for blog content to rank well in Google. Thanks!
White Hat / Black Hat SEO | | TungNM1930 -
Spam Score & Redirecting Inbound Links
Hi, I recently downloaded a spreadsheet of inbound links to my client sites and am trying to 301 redirect the ones that are formatted incorrectly or just bad links in general (they all link to the site domain, but they used to have differently formatted urls on their old site, or the link URL in general has strange stuff on it). My question is, should I even bother redirecting these links if their spam score is a little high (i.e. 20-40%)? it already links to the existing domain, just with a differently formatted URL. I just want to make sure it goes to a valid URL on the site, but I don't want to redirect to a valid URL if it's going to harm the client's SEO. Also not sure what to do about the links with the --% spam score. I really appreciate any input as I don't have a lot of experience with how to deal with spammy links.
White Hat / Black Hat SEO | | AliMac260 -
1st Ecommerce site got penalized, can we start a 2nd one?
Hello, A client's first site got penalized by Goolge Penguin. It has recovered through cleaning up backlinks, but not to where it was before. It is 2nd and 3rd for several money keywords, but is far less successful than before penalization. We are starting a second site. Here's the important steps to mention The new site shows up first for it's domain name, and it has 30 pages indexed. It shows up NOWHERE for our leading search term. Out other site has a blog post that is 3rd for that search term. We are using new categories and new organization. We are using a different cart solution We are adding all unique content The home pages and some of the product pages are very thorough. We are adding comprehensive products like nothing else in the industry (10X) We plan on adding a very comprehensive blog, but haven't started yet. We've added the top 100 products so far. Our other store has 500. There's a lot of spam in the industry, so sites are slow to rank. Our category descriptions are 500 words Again, all unique content. No major errors in Moz Campaign tools Just a few categories so far, we're going to add many more. Same Google Analytics account as our other site It looks like we should eventually be on page 3 for our major search term. Again, we're nowhere for anything right now. ... Have you seen that Google will not rank a second site because it's from the same company and Google Analytics account, or does Google let you rank 2 sites in the same industry? We are hoping it's just slow to rank. If you can rank 2 sites, what are your best recommendations to help show up? Thanks.
White Hat / Black Hat SEO | | BobGW0 -
Traffic going down in all sites in a niche
Hello, A client has three Ecommerce sites in a niche. Because of competition and a (possibly) non manual penalty due to doorways and paid links (though I think it's mainly competition too) our traffic is going down. What are the keys to increasing traffic at this point. Feel free to include tricks that cost money. A Hrefs (I love Moz though!) has some neat content tricks. Please give me the best tricks in the industry to increase traffic. We're adding content to the main site of the three and maybe that's what to focus on, but we're having trouble driving serious traffic with the content. We need serious traffic. We are experts in our field and capable of almost anything as far as information goes in our field. Thanks.
White Hat / Black Hat SEO | | BobGW0 -
Recovering from Black Hat/Negative SEO with a twist
Hey everyone, This is a first for me, I'm wondering if anyone has experienced a similar situation and if so, what the best course of action was for you. Scenario In the process of designing a new site for a client, we discovered that his previous site, although having decent page rank and traffic had been hacked. The site was built on Wordpress so it's likely there was a vulnerability somewhere that allowed someone to create loads of dynamic pages; www.domain.com/?id=102, ?id=103, ?id=104 and so on. These dynamic pages ended up being malware with a trojan horse our servers recognized and subsequently blocked access to. We have since helped them remedy the vulnerability and remove the malware that was creating these crappy dynamic pages. Another automated program appears to have been recently blasting spam links (mostly comment spam and directory links) to these dynamically created pages at an incredibly rapid rate, and is still actively doing so. Right now we're looking at a small business website with a touch over 500k low-quality spammy links pointing to malware pages from the previously compromised site. Important: As of right now, there's been no manual penalty on the site, nor has a "This Site May Have Been Compromised" marker in the organic search results for the site. We were able to discover this before things got too bad for them. Next Steps? The concern is that when the Penguin refresh occurs, Google is going to notice all these garbage links pointing to those malware pages and then potentially slap a penalty on the site. The main questions I have are: Should we report this proactively to the web spam team using the guidelines here? (https://www.google.com/webmasters/tools/spamreport?hl=en&pli=1) Should we request a malware review as recommended within the same guidelines, keeping in mind the site hasn't been given a 'hacked' snippet in the search results? (https://support.google.com/webmasters/topic/4598410?hl=en&ref_topic=4596795) Is submitting a massive disavow links file right now, including the 490k-something domains, the only way we can escape the wrath of Google when these links are discovered? Is it too hopeful to imagine their algorithm will detect the negative-SEO nature of these links and not give them any credit? Would love some input or examples from anyone who can help, thanks in advance!
White Hat / Black Hat SEO | | Etna0 -
Domain.com/XXX or domain.com/blog/XXX ?
i have a business and a side blog on the website. is it fine to turn my blog to domain.com/XXX instead of domain.com/blog/XXX? does it in anyway of these affect the SEO?
White Hat / Black Hat SEO | | andzon0 -
Non Manual penalties, should I trash my site?
My URL is: www.adserve.com.au I get no traffic from google and I am convinced that I have penalties from the links that point to my page. I have written to google previously and they told me that there are no manual penalties on the site. I give up... I am shelving my ENTIRE brand and starting again with a new site, http://www.trusignage.com, I do not want to do this but... If I do a search for
White Hat / Black Hat SEO | | AdAdam
"Using and implementing the AdServe digital menu board system couldn’t be easier! Just get any screen installed by a tradesman or electrician, plug the digital menu board device" two pages from within my site come up but my homepage does not, it comes up when you click on "In order to show you the most relevant results, we have omitted some entries very similar to the 2 already displayed" A search for
"The AdServe system comprises of only one tiny component that can plug directly into the HDMI port of a screen. Traditional digital signage systems require drilling into walls, running cables, a bunch of valuable space and the installation of several pieces of costly"
Brings up another 2 pages from my site, when clicking on "In order to show you the most relevant results, we have omitted some entries very similar to the 2 already displayed."
My homepage does not even come up... but the homepage of my new site http://www.trusignage.com comes up. My new site is at http://www.trusignage.com there is only 2 pages of duplicate content, the about us and the buy now page.
Is google going to penalise my new site? I WILL NOT DO ANY SEO, only on page......... I wont hire any SEO firm at all. My old site has a few great links to it
http://www.sixteen-nine.net/2013/06/24/android-digital-signage-closer-adserve/
http://www.crunchbase.com/company/adserve-digital-signage
I also have many of my REAL youtube videos that link to my site, maybe about 15
If I 301 redirect my penalised site to my new one am I just poisoning my new site as well? I could get the links changed instead. I will have to keep my old site www.adserve.com.au as I have customers who go to that site to lookup my contact details for support etc. will google see the same phone number and address etc and think I am trying to fill google up with duplicate websites? I would really prefer to keep www.adserve.com.au for Australian clients and usewww.trusignage.com for international clients, if the site layout is the same but all of the site passes copyscape then will I get hurt by duplicate content?
Google is ruining me.. I have no money to spend on adwords right now. I have a new highly inovative software product that has taken almost 2 years to develop and I think I deserve more than 4 visits per month. My actual business has been around for 7 years.
I invented SaaS digital signage in 2007 http://youtu.be/-YpyjLALoBU find me some web based digital signage system that was around prior to 2010?
This is me and my product http://youtu.be/ClXSiIA5DRY
Why should my site be treated as trash by google? I have in the past employed a SEO firm and if I search for "If you are looking for the top provider of digital signage in Australia, visit today" I find 70 absolute crap links to my site. I have disvowed them, there must be more links somewhere but I have no money or time to chase down site owners to remove them when I do not even know if I can get them all and have no guarantee that this will even help.. So bottom line, do I need to junk my www.adserve.com.au site? There is no getting away from what some SEO company has spammed in the past?
And again, using a tool to hunt down these spam links and try to get them removed will tie up my own time that needs to be spent on developing my software and I have no cash to pay people to do this for me. [edited by staff because line breaks weren't showing]0 -
Removing/ Redirecting bad URL's from main domain
Our users create content for which we host on a seperate URL for a web version. Originally this was hosted on our main domain. This was causing problems because Google was seeing all these different types of content on our main domain. The page content was all over the place and (we think) may have harmed our main domain reputation. About a month ago, we added a robots.txt to block those URL's in that particular folder, so that Google doesn't crawl those pages and ignores it in the SERP. We now went a step further and are now redirecting (301 redirect) all those user created URL's to a totally brand new domain (not affiliated with our brand or main domain). This should have been done from the beginning, but it wasn't. Any suggestions on how can we remove all those original URL's and make Google see them as not affiliated with main domain?? or should we just give it the good ol' time recipe for it to fix itself??
White Hat / Black Hat SEO | | redcappi0