Penalized and how to recover
-
Hey guys
One of our sites was penalised from a while ago and we use to rank page 1 for our keywords and now w can't be found. Is there a way to recover from this?
Also, I came across Rands video about site architecture whilst google were teaching us to generate backlinks, and spammy anchor text what would your suggestion be to recover from this? Any ideas?
Here is the site http://free-love-psychic.com/
Any suggestions?
-
It looks like your robots.txt is missing. If you upload one and Google can read it, they will crawl your site. As the message says, further crawls of your site are "postponed" until Google can read a robots.txt file (which is odd, I've never had this on sites without robots.txt before.)
I would suggest uploading & checking your robots file and then requesting a recrawl through WMT.
-
Hi Matt,
Going through google web masters tools, and finding the messages that were sent to me are as follows:
Over the last 24 hours, Googlebot encountered 30 errors while attempting to access your robots.txt. To ensure that we didn't crawl any pages listed in that file, we postponed our crawl. Your site's overall robots.txt error rate is 100.0%.
You can see more details about these errors in Webmaster Tools.
Recommended action If the site error rate is 100%:
Using a web browser, attempt to access http://lovepsychicmary.com/robots.txt. If you are able to access it from your browser, then your site may be configured to deny access to googlebot. Check the configuration of your firewall and site to ensure that you are not denying access to googlebot. If your robots.txt is a static page, verify that your web service has proper permissions to access the file. If your robots.txt is dynamically generated, verify that the scripts that generate the robots.txt are properly configured and have permission to run. Check the logs for your website to see if your scripts are failing, and if so attempt to diagnose the cause of the failure.
If the site error rate is less than 100%:
Using Webmaster Tools, find a day with a high error rate and examine the logs for your web server for that day. Look for errors accessing robots.txt in the logs for that day and fix the causes of those errors. The most likely explanation is that your site is overloaded. Contact your hosting provider and discuss reconfiguring your web server or adding more resources to your website. If your site redirects to another hostname, another possible explanation is that a URL on your site is redirecting to a hostname whose serving of its robots.txt file is exhibiting one or more of these issues.
After you've fixed the problem, use Fetch as Google to fetch http://lovepsychicmary.com/robots.txt to verify that Googlebot can properly access your site.
So not too sure if this could be the issue?
Learn more in our Help Center.
-
There are a number of different penalties so without specifics this can be hard to answer but by far the most common we see is a partial link penalty. Basically, you built some "crap" so Google chooses to ignore it and not give you the value. Usually results in what looks like a full page, 2 page or 5+ page drop. (Keywords that were page 1 drop to 2 or 3, keywords on 2 drop to page 5, etc.)
You would need a link clean up, maybe disavow & reconsideration request if you have this (or the full link based manual penalty.) If you don't have a message in Webmasters Tools, you may also be talking about Penguin - an "algorithmic penalty" (not a true penalty.) If this is what you mean, similar steps will be taken. In either case you will also need to find a way to continue gaining authority. Disavow / recon without authority building won't get you very far.
-
Hi Alec, recovering from a Google penalty is not an easy process unfortunately. And the Q&A section here wouldn't be enough to explain everything as well. I would suggest going over this article on Moz. It is a very thorough article explaining every steps you need to take to remove manual penalties associated with your website. I hope this helps
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Recovering from an open redirect
From a previous company we have inherited a domain which once contained an open redirect redirect.magnet.me. Even though this domain has been returning a 410 for every single request directed at it for the last few months, we continue to see new links popping up in Google which refer to this domain https://www.google.com/search?safe=off&q=%22redirect.magnet.me%22 Currently we just keep disavowing these links, but at the same time they keep appearing in our Moz.com tooling, being unable to disavow those links here. Does anybody have any successful tips how to deal with this scenario, compared to only disavow new links after the fact?
Intermediate & Advanced SEO | | rogier_slag0 -
How to avoid getting penalized for having same website in 2 languages
Hi, I have a price comparison website in English with .com domain. Now as we are expanding, we want to localize our website and target different markets in their local languages. The first market we are targetting is France. For that purpose we have a different domain name in French .fr domain The website however, will have the exact same content & mostly translated in French. My question is what is the best way to avoid getting penalized by Google for having duplicate content? Thanks,
Intermediate & Advanced SEO | | kh-priyam0 -
Positions dropped and do not recover
Hi all, Site: https://www.fascinators.com.au k/w: fascinators (this is the main one I am looking at) About 2 years ago, I redesigned the site. It used to be on first positions in Google Australia. After redesign, positions dropped and never recovered. No matter what I do, I can not get them back. I even involved professional SEO agency for the last 6 month to help build links, but nothing works. (old site used really old non mobile-friendly engine) As far as I know site is technically sound with no issues. In the last few month position for my main keyword 'fascinators' jumps really wildly. From position 9 to not being in Google first 100. And jump can happen overnight. As of today it disappeared from first 100 again. I am really tearing my hair out on what can be wrong. Link building is underway. This is one area I am aware of. Thinking of keyword spamming, i removed lots of 'fascinators' from URL, but that did not seem to help much. Any ideas will be greatly appreciated! Thanks, Rudolf
Intermediate & Advanced SEO | | rudolfl1 -
I'm I being penalize? I fell off SERP for main keyword
I have been making minor changes to my site like fixing 404 pages and adding site maps etc. I have ranked as high as 3rd for the query 'private equity firms' but now Im showing the site around the 10th page and some times never. any ideas what could be going on?
Intermediate & Advanced SEO | | Nicktaylor10 -
To recover from Penguin update, shall i remove the links or disavow links?
Hi, One of our websites hit by Penguin update and I now know where the links are coming from. I have chance to remove the links from those incoming links but I am a little confused whether i should just remove the links from incoming links or disavow the links? Thanks
Intermediate & Advanced SEO | | Rubix0 -
Does duplicate content penalize the whole site or just the pages affected?
I am trying to assess the impact of duplicate content on our e-commerce site and I need to know if the duplicate content is affecting only the pages that contain the dupe content or does it affect the whole site? In Google that is. But of course. Lol
Intermediate & Advanced SEO | | bjs20100 -
My traffic dropped over 60% - was I penalized?
Hi all, We launched a major update of our site in the middle of June. We have lots of pages and were indexed very quickly, and started ranking well for long tail terms. Last week, our organic traffic suddenly dropped over 60% as our pages started ranking much lower. One issue we discovered was that our site was responding to all subdomains, not just www, and Google did seem to be crawling two alternate subdomains -- Webmaster Tools shows crawl activity, but no pages indexed on these. We fixed that problem a couple days ago (all subdomains 301 to the www). Is that something that would have caused a sudden drop like we saw? This would have been an issue since the relaunch, though one of the subdomains only started getting crawled (~1,000 pages/day) in August. We have investigated a few other things that may have been a factor: We sent out a press release via iReach a few weeks ago which makes up the majority of our recent backlinks. Our site occasionally returns a 502 no gateway error when under heavy load, Google sees this 3-10 times at day. GA shows a page load spike the day before the drop, but we had worse spikes in the past that did not seem to have an impact. Did we just get lucky with a "honeymoon" phase with Google? This is the site: http://goo.gl/3DCbl Indexing continues -- we now have over 500k pages indexed and Google is crawling faster than ever, about 30,000 pages per day. Thanks!
Intermediate & Advanced SEO | | tact0 -
SEO - Why variation in Google positioning? Are we penalized?
Our webiste is made of 2 different parts hosted in 2 different directory on the same domain: 1. The website itself, which can be seen as a catalog. 2. A blog on WP. Sometimes we lose 50% of our traffic and 5 to 10 days later the traffic goes up again. When looking at position in Google it appears that when losses of traffic happen, the Google positions of pages from the website become bad. The blog pages themselves keep their good position. Suddenly after few days we find our previous good postioning and we have a good traffic again. Here at the questions we have: 1. Why do we have variation on our Google positioning? Which parameters can influence? Bounce rate? Speed? 3. Why only the website is penalized and never the WP blog whereas they are on same domain? If someone has experienced it before or has a idea, your expertise is welcome... Thanks.
Intermediate & Advanced SEO | | ZOD0