Getting spam Links pointing to our wrong url, what to do?
-
Hey Mozzers,
Looking in my Google Search Console (Webmaster Tools), I'm getting links pointing to bogus pages on my website that result in a 404. What does one do so you can tell Google that it has been "fixed"?
Do i just 301 it to another website?
If I add it to my disavow list, does Google remove the error in my webmaster tools?
Thank you!
-
Hey Shawn,
1. If GWT is showing a 404 without a "Linked from," I wouldn't worry about it too much. Sometimes Google tries to recrawl URLs it crawled once in the past, but that doesn't mean it's causing a problem. I would double check that you don't have any internal or external links to "blog/blog," then just "mark as fixed." There's no point to disallow Google from crawling a page that isn't there in the first place.
2. Nope. The only danger of having a long robots.txt is that you may get lost while checking your rules and accidentally disallow a page you want in the index. Whenever you add a rule to robots.txt, make sure you go to Google Search Console and use the robots.txt Tester to check if you've disallowed any important pages.
Good luck!
Kristina
-
Thank you Kristina. I went ahead and disavowed some of those links. Other bogus links are still showing in GWT, such as "blog/blog/"...we only have one /blog category but Google just weirdly finds more bogus ones. When I select "Linked from", it doesn't show any sources. So my additional questions are:
1. If I add "blog/blog" to my robots.txt, do I mark the /blog/blog links in GWT "mark as fixed"?
2. Does it matter if my robots.txt is long or short?
Thank you
-
Hi Shawn,
If these are from crappy scraper sites (which it looks like they are), then I'd add it to your disavow list, yes. I don't think that'll get Google to remove your error in GWT, but remember: GWT is a separate algorithm from the actual algorithm because Google doesn't want us to see how sophisticated they are. If GWT sees "errors" in links, but you've properly disavowed, I'm fairly confident the actual Google algorithm won't penalize you.
For anyone else finding this thread: make sure that you check the sites that are linking to your broken pages before disavowing! If they're good links but out of date or mistyped, just update them.
Best,
Kristina
-
Joe,
Thanks for the update. Our website doesn't have any malware, but sucuri.net seems ideal to those who need it. Reading your article, I read:
- "Someone else from another site links to you but has a typo in their link"
In our case, these are crappy scraping sites that have bogus links pointing to us. Here's an example: Let's say you're nba.com and have a page on kobe bryant - nba.com/kobe-bryant
The link that Google is picking up from these crappy sites show a link to "nba.com/kobe-bry". If you notice, the link is incorrect and I don't want to see another 404 piling in webmaster tools.
What would you do?
-
I've seen this happen several times and the first thing to do is really clean out your site first. I'd recommend Sucuri.net to do a thorough malware cleanup. Their free plugin isn't enough, you need to go with the paid version. Are you on WordPress? I've seen this happen to 4 sites already I've helped.
Then, let all the errors 404. If you 301 them then the bad pages and links will stay alive longer. Even better to let them 410, but 404 should do the trick. I wrote about some of the reasons behind those in a post here on Moz a few years ago that still applies.
Matt Cutts has a good reply on disavowing spam links in his video here, and says:
"If you're at all stressed, if you're worried, if you're not able to sleep at night because you think Google might have something, or might see it, or we might get a spam report about you, or there might be some misunderstanding or an algorithm might rank your site lower, I would feel free to just go ahead and disavow those links as well,"
I went ahead and disavowed the DOMAINS of the most recent site, just to be extra sure. Let me know if you have follow up questions!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Replacement for Juicy link finder?
Hi, Juicy link finder was really handy to help uncover websites, what is the alternative tool/s people would recommend? Thanks Simon
Moz Pro | | simonsw0 -
Crawlers crawl weird long urls
I did a crawl start for the first time and i get many errors, but the weird fact is that the crawler tracks duplicate long, not existing urls. For example (to be clear): there is a page: www.website.com/dogs/dog.html but then it is continuing crawling:
Moz Pro | | r.nijkamp
www.website.com/dogs/dog.html
www.website.com/dogs/dogs/dog.html
www.website.com/dogs/dogs/dogs/dog.html
www.website.com/dogs/dogs/dogs/dogs/dog.html
www.website.com/dogs/dogs/dogs/dogs/dogs/dog.html what can I do about this? Screaming Frog gave me the same issue, so I know it's something with my website0 -
Does Google Reward Bad Links in Some Industries?
This week I've been diving into competitive research again for several clients in different industries, and unless the data in Open Site Explorer is wrong, it really does appear that Google continues to reward sites with unnatural links in certain industries, especially industries that are less tech-savvy (agriculture, finance, manual labor). I've combed through all the links carefully, to ensure there aren't some secret high-quality links lurking, and for some of these sites that are showing up in the top ten for search they do not even one real, high-quality link. Also, their onsite optimization is often way over the top and the user experience is nothing less than nauseating. Could it be a MozScape issue, or does Google continue to reward terrible sites and link structures in certain industries? I'd love to hear your thoughts.
Moz Pro | | newwhy0 -
Advanced Link Report Different Link # than Total Links??
Hi, I've downloaded a csv report for links in "advanced reports" section. At the very top in blue OSE lists overall metrics, i.e. Domain Auth, Page Auth, Linking Root Domains, and then it lists "Total Links" at 1,769. When I download the advanced report in csv I have 505 total links in Excel. Why is there a difference between Total Links and what I have downloaded? What makes up the Total Links? The report I created included, "inbound links/linking pages, Types of Links: any; Links that come from: Any Page, Any IP; Links that link to: any page on subdomain; links with properties: any; Thanks!
Moz Pro | | toby-020 -
How long will it take for the link analysis to be updated?
In an effort to evaluate SEOmoz I started off my free trial with a fresh website that I am going to get to rank on the first page and hopefully to the #1 spot. I have been link building and changing the website around a lot. When I created the website hosted by HostGator with wordpress installed I marked down where it showed up the first time. After checking for many days to about the 100th spot I found it in spot 65. I have since then been spending some time (not a ton of time, but enough) guest posting, some bookmarking, press release creation and some other odds and ends stuff. The page has gone up to 23rd but there have been no signs of any work done on the link analysis. So, How long does it take?
Moz Pro | | DLRISM0 -
OSE High Domain Link Total
Why does OSE report such a high domain link total in the SERP overlay underneath each result? I'm looking at at site that I know has about 90 links domain wide and the OSE overlay in SERP reports 610
Moz Pro | | waynekolenchuk0 -
HUGE LINK!PR9 Not showing up
Hi ,My site is ranking very well.Although lacking large numbers of links ,Im only able to grasp the bottom page of First Page, Im in the position #6 through Position #10 with approximately 44 keywords. Its been about a year now so i think im doing well .. ** Here is my problem,** I recently was able to pick up a few very good High ranking backlinks ,They are in the Range of pr8 & 9 they have huge amounts of links pointing to them,One of them is a Dot Edu back link..Niether one of these are showing up..In fact , In the open site explorer i had a couple very high domain rank backlinks showing as my top link. This been there for 7 months They are gone...Now i have these 2 new backlinks both pr8 and pr9 not showing up in the top of the list..They are both cached .I can see them in the cached links .. ** But where the heck is my new links ??? been about 1-2 months ..shoudnt these show up in the top of open site exploreer?? Very aggrevating...Could this be open site explorer reading the site differently month after month??**
Moz Pro | | herrie0 -
Link Count Per Page Including JavaScript Links - Should We Worry About Them?
With large ecommerce sites, we usually have more than 100 links per page and many times have more than 200 links on each page due to links and images in the header, footer, guided navigation and then the body product grid and content. When I use most on-page link counting tools like SEO x-ray and the SEO Moz Pro crawl report, I notice that every visible link on the page gets counted. This includes and javascript based links that expand the product grid to 30, 60 or view all, javascript sorting links, javascript links to view customer reviews for each product. etc. There was a QA post here http://www.seomoz.org/q/should-i-nofollow-the-main-navigation-on-certain-pages about nofollowing and page rank sculpting and it seems pretty unanimous that most don't think that page rank sculpting is very valuable. So my question is, are the javascript links on pages that don't link to another page viewed differently by search engines? If so, shouldn't there be a way to see on-page link count minus javascript call links that don't actually link to another page? To expand a bit on my question, we also use nofollow attributes on the text links in the left navigation that are meant for refining products just as the javascript links in the product grid are meant to refine the products, sort them, allow for product comparison, allow for viewing customer reviews, etc. So should it be ok to have 300 links on a page if the unimportant ones that you don't want crawled like the left navigation refinements and product grid javascript links all have rel="nofollow" applied to them? I know that would basicly be PageRank sculting, but it seems like the best options for shopping sites that have a lot of navigation links.
Moz Pro | | abernhardt0