Disallow a spammed sub-page from robots.txt
-
Hi,
I have a sub-page on my website with a lot of spam links pointing on it. I was wondering if Google will ignore that spam links on my site if i go and hide this page using the robots.txt
Does that will get me out of Google's randar on that page or its useless?
-
Does it rank for anything worthwhile?
Does it have any legitimate / valueable links pointing to it?
If the answer is no to both of those questions, just delete the page and recreate it at a new URL and request a removal of the old URL from Google's index (and obviously don't 301 redirect it).
-
Hi, my personal opinion is that if they were unintentional or not done by you then Google will ignore these and not penalise site (see Rans Whiteboard Friday video on Negative SEO).
However if it is a page that is not very important to you then maybe you should consider removing this page from Googles index (use GWT for this) and then getting Google to re-index a new page that has no spam links pointing to it?
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Inserting Keywords in Web Pages
Hello! Question: When I add chosen keywords to my site (in urls, title tags, meta description, page content, headers, etc), do I need to put the words on my webpage exactly as they appear in my keyword research? So if I searched "therapist bay area" and I want to include these keywords, for example, must I use those words in that order in a sentence or header on my homepage? Or is it enough to include each word somewhere on the page?
On-Page Optimization | | LPantell0 -
Understanding why our new page doesn't rank. Internal link structure to blame? + understand canonical pages more.
Hi guys. Sorry it's an essay...BUT, i think a lot of you will find this an interesting question. This question is in 2 (related) parts, and I imagine it would be an 'advanced' SEO question. Hoping you guys can help bring some real insight 🙂 Always amazed at the quality for this forum/ community. **Context... ** We had a duplicate content issue caused by this page and it's product permutations, so we placed canonical tags on all the product permutations to solve it. Worked a treat. However, we now have more **product ranges. **We now sell Diaries, Notebooks & Music books, which are clearly different from one another. So...we've placed canonical tags on all the product permutations leading back to the 'parent' theme. In other words, all the diary permutations 'lead back' to the diary page. All the notebooks permutations 'lead back' to the main notebook page. So on and so forth. Make sense so far? Context end..... Issue. Amazingly our Diary page outranks our notebook pagefor the search term 'Design your own Notebook'. The notebook page is well optimised for this search term, and the diary page avoids the word 'notebook' altogether (so no keyword cannibalisation going on). Possible reason? Our Diary page has a vast amount of internal links to it throughout our site. The notebook page has only a few. Could this be the issue? If so, what reading/ blogs/ content/ tools would you recommend to help understand and solve this problem? i.e) Better understanding internal link structure for SEO. 2nd part of the question (in the context of internal linking for SEO). When there are internal links to a page with a conical tag does that 'count' towards the 'parent page', or simply towards that specific page? I really hope that makes sense. If it's clear as mud just shout. Isaac. EDIT: All pages in question have been indexed since we added these changes to the site.
On-Page Optimization | | isaac6630 -
Webs Pages not correct
First of all I am a beginner but that will show with this question. I have moved my website from Wix to Web.com. I had the dns I think that is correct re-direct my site to web.com. Since then some of the pages from wix still show up even though they are no long apart of my site. Secondly when I go to google and type in cestoday.com some of the pages gives me a 401 or 404 error code, and others do not link to the proper page on my website. They go to my web-site but not the correct page. What do I do. Thank you Dave
On-Page Optimization | | redsman944
cesyes@hotmail.com In reference to my last question about moz not being able to see my pages and giving me an "F" I thought you might find it interesting to know that that same page once moved got an A amazing.0 -
New CMS system - 100,000 old urls - use robots.txt to block?
Hello. My website has recently switched to a new CMS system. Over the last 10 years or so, we've used 3 different CMS systems on our current domain. As expected, this has resulted in lots of urls. Up until this most recent iteration, we were unable to 301 redirect or use any page-level indexation techniques like rel 'canonical' Using SEOmoz's tools and GWMT, I've been able to locate and redirect all pertinent, page-rank bearing, "older" urls to their new counterparts..however, according to Google Webmaster tools 'Not Found' report, there are literally over 100,000 additional urls out there it's trying to find. My question is, is there an advantage to using robots.txt to stop search engines from looking for some of these older directories? Currently, we allow everything - only using page level robots tags to disallow where necessary. Thanks!
On-Page Optimization | | Blenny0 -
Duplicate page content,
Hi, in my campaign crawls diagnostic, I have a lot of Duplicate page content, but we use canonicalization and I used webmastertool to make sure the campaign parameters are not consider by the Google bot. Can you see what could be my problem, or do you have a tip for me or things to look at ? Thank You VB
On-Page Optimization | | Vale70 -
Should H1s be used in the logo? If they are and it is dynamic on each page to relate to the page content, is this detrimental to the site rather than having it in the page content?
On some sites, the H1 is contained within the logo and remains consistent throughout the site (i.e. the company name is in the of the logo). If the h1 in a logo is dynamic for each page (i.e. on the homepage it is company name - homepage) is this better or worse to have it changed out on the logo rather than having it in the page content?
On-Page Optimization | | CabbageTree0 -
Canonical home page
I have a site that shows duplicate page content for: www.autoserviceexpertsonline and www.autoserviceexpertsonline/index.html When looking at the files using the cms (intuit) file manager, I only see the /index.html version. I added the Caononical tag referencing/pointing to both the domain name only and then changed to .../index.html No matter how I code this, the seomoz On-Site SEO Grader still has a problem with it. Is this a bug with the Grading program or am I doing something wrong? Please help as I think this is causing me problems with Google and I'd like to get this right for future sites I will be working on. Thanks, Bill
On-Page Optimization | | Marvo0 -
The SEOmoz crawler is being blocked by robots.txt need help
SEO moz is showing me that the robot.txt is blocking content on my site
On-Page Optimization | | CGR-Creative0