Some web 2.0 sites blocked by robot
-
I had created some web2.0 sites, google also indexed those sites but those sites robots.txt are disallow, this mean Google will not give any credit on ranking ? I have seen in google, those sites meta description was written - A description of this site is not available due to the robot.txt file. I checked that file, it is written disallow. Can google still count those sites for the ranking purpose ?
-
Hi,
Pages blocked by robots.txt file will not be considered for ranking. You still see those pages in Google's index is because of their mentions on other websites. Google has been doing link discovery from websites other than these Web2.0 sites of yours. So to stop Google completely from indexing these pages, you should go in for page-levelrobots meta tag. Here you go for more: https://support.google.com/webmasters/answer/93710?hl=en
Once you implement the page-level robots meta tag to block those pages, Google will remove them from the index after the next crawl. You can expedite this process by using the link removal procedure in webmaster tools account.
Here you go for more: https://support.google.com/websearch/troubleshooter/3111061?rd=1
Good Luck to you my friend.
Best regards,
Devanur Rafi
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
What will the SECOND link from a site do for me
Say I have an opportunity to get another link from a high authority site that has already linked an important article from me (a page I REALLY want to rank well). Now a month later, they are interviewing me and asking what I'd like to link. I have plenty of good content I can offer, but I really want that page they already linked to to climb a bit in the rankings. So my question is, how is that second link best spent? Would linking to the same page give it a boost? Or does Google see it as "oh. Another link from the same domain. Yippee." Would that link do more for a different page on my site at this point?
Link Building | | cbrant7770 -
At a Loss With What to do With This Site
Hi people, a friend of mine runs a payday loan site with a very valuable domain name: http://bit.ly/1lyJgME The site was penalised by Google about 18 months ago, up until then it ranked #1 for payday loan and on the 1st page for the plural, payday loans in the UK. Now the website is nowhere in the top 200 results for either of the phrases, but he has not received any notification from Google and if he checks in webmaster tools in the manual actions section there is nothing there. He has gone through all of the links to his site several times and attempted to remove any unnatural links, those that he could not get rid of after emailing twice he disavowed - about 800, a lot were not even built by him. He has sent 2-3 reconsideration requests to Google and every time they said that the site had not been penalised, or something to that affect. The site does have lots of quality organic links from websites like Wired Magazine and the National Geographic, more then enough decent links to rank somewhere on Google for its keywords. I feel that the site may have been held to a higher standard because a lot of people think that payday loan websites are unethical. What do you think he should do? Can you spot anything on site that is wrong? He has definitely tried to remove every single unnatural link and the ones he could not he disavowed.
Link Building | | Eavesy1 -
The No of Sites linking to www.apollopowersystems.com is 50 as per Alexa, but Moz shows that the no of sites linking is 23\. The no has increased in Alexa but in Moz the no is 23 since 3 months. Why is this Difference?
Hi There, As I am new to SEO, so the problem that I am listing below may seem very naive. Please help me out. Please explain me the difference between the no of backlinks of the website, www.apollopowersystems.com as per the websites below. The nos are completely different as per the websites below: As per www.moz.com the no is 23 As per www.ahrefs.com the no currently is 586 As per www.alexa.com the no is 50 Please tell me why these nos are different. Looking forward to hear from you at the earliest. Thanks in advance.
Link Building | | KDKini0 -
How do I distributing Articles to the correct sites
I'm relatively new to the SEO world, however, I've landed myself a SEO job for a mobility bath, shower and wetroom company.
Link Building | | desktop_nev
I've optimize the pages and added links to directories BUT I would like to start gaining quality links. I've wrote articles, including keyword links, but I would like to know the best strategy to get articles distributed to generic/industry specific sites.
Any help will be greatly appreciated! Thanks in advance1 -
Press Release Sites
I don't do that many press releases, but I need to do one soon. I had been using PRweb.com and I see they raised their prices. Are they considered the best online PR site or are there sites people have used that have gotten similar results for less money?? Thanks
Link Building | | ClickIt0 -
Directory sites in 2013
Are there any directory sites or article/press relies sites that are worth getting links on in the post panda/penguin worked of 2013?
Link Building | | mark_baird0 -
Best Way to Analyse Linking Structure of My Site
My site http://www.taxproblem.org is now undergoing many changes due to bad report card scores from this site. I've had people tell me that my linking structure was obviously artificial, especially if most of my links are from "Mr. Wong - social site" O.K. stop laughing 🙂 Yes we use bookmarking demon and rss feed wp plug ins, etc. But haven't discovered how to best get links yet, although reading a lot and waiting on seomoz's DVD's I ordered. 1. What is the best way to analyse our sites linking structure to determine if Google will consider it bad (my site was trashed by Google twice in the last two years) probably for link farms and the like. I know the obvious, but I was looking for a program with guidelines to judge by. 2. The best source to review the many strategies for getting back links so I am not a victim of rehashed b/s based on someones fears of Google, but actually good methods that work. We offer something of value. (CPA firm doing IRS rep. and we have a free download so people can do their own IRS rep and save thousands, and know it's done right) I need to know the bast way to market this. I need good souces for info and for keeping up. Thanks in advance to all that can help.
Link Building | | joemas990 -
Submitting to directories all at once? i.e. within the same week or 2?
I have found a bunch of around maybe 20-30 directories that we seem not to be in, and that seem like they might be worth it from what I am reading… My question is - is it a problem to submit to this number of directories all at once – i.e. within the same week or 2? Or should I think about spreading the submissions around a month or 2? Just worried that Google etc might through a flag with a bunch of submissions all at once… Thanks
Link Building | | inhouseninja0