Some web 2.0 sites blocked by robot
-
I had created some web2.0 sites, google also indexed those sites but those sites robots.txt are disallow, this mean Google will not give any credit on ranking ? I have seen in google, those sites meta description was written - A description of this site is not available due to the robot.txt file. I checked that file, it is written disallow. Can google still count those sites for the ranking purpose ?
-
Hi,
Pages blocked by robots.txt file will not be considered for ranking. You still see those pages in Google's index is because of their mentions on other websites. Google has been doing link discovery from websites other than these Web2.0 sites of yours. So to stop Google completely from indexing these pages, you should go in for page-levelrobots meta tag. Here you go for more: https://support.google.com/webmasters/answer/93710?hl=en
Once you implement the page-level robots meta tag to block those pages, Google will remove them from the index after the next crawl. You can expedite this process by using the link removal procedure in webmaster tools account.
Here you go for more: https://support.google.com/websearch/troubleshooter/3111061?rd=1
Good Luck to you my friend.
Best regards,
Devanur Rafi
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Getting site ready for outreach for guest posting
Hello, We've decided to focus on guest posting for my client's site. What do we need to do to my client's website to be ready for guest posting. I assume those providing guest posting opportunities will look at our site and evaluate how good it is and how good our writing is. Here's what we're doing, and I'm wondering what's important 1. We went from a junky design to a pretty good one. 2. The logo is still average - we're thinking of upgrading it 3. all of the buttons for the store are still bad looking - we're going to make them pretty 4. All the category text was keyword stuffed and not good, we're rewriting all category text which is a huge effort 5. There was 20 short OK articles. We're making 5 long good ones to take their places. What are they going to look at to make their decision?
Link Building | | BobGW0 -
My best links not showing in Open Site Explorer
Why is it that OSE does not display my strongest backlinks, including those from Wikipedia, a legitamite .edu, Squidoo, etc.? Some of those links have been live for a long time, and some (not all) are "dofollow". Impossible to do a thorough backlink analysis in this situation.
Link Building | | veezer0 -
Content Strategy - High Value on Lots of Sites vs. High Value on One Site
Good afternoon Mozzers. I have a discussion based question and I'd be interested to know your thoughts. I currently implement a content strategy where we create a series of high value How-to written articles, relevant to our audience and then work at getting them placed on multiple high value websites. I have just been offered an opportunity with a PR6 domain to create a similar series of content but place it all on their site with links back to ours through a dedicated section. So my question is would I gain more value from small amounts of great content in lots of places vs. a lot of great content in on place? Effectively 1 link from 20 sites vs. 20 links from 1 site.
Link Building | | RobertChapman0 -
Pr web help
I am interested doing a press release with PRweb but for the price I wanted to know if there is a way to see if your press release has been picked up by other news sources. is there a way to track people that pick up your release and provide a backlink?
Link Building | | greasy0 -
Looking for good legal web directories
Hi, I am looking for some good legal web directories. I looked at the seomoz list but I didn't see any categorized as legal/law. Are there some good legal directories you can recommend? Any thoughts on Justia.com? Thanks, Scott
Link Building | | slangdon0 -
Link Buildinf for new sites
Hello friends, I would like to know what link building strategies you recommend for a newly created websites? Thanks a lot!
Link Building | | pasape0 -
How to Add Content to a Product-Focused Site
I recently took over management of the SEO work for the following site: http://www.grovercorp.com/rings-and-seals/. I want to do link building, but don't have a ton of experience with it. From what I've read, offering linkable content is the best way to get links. However, this site -- like many in industrial B-2-B -- is focused primarily on promoting their products. I'd like tto offer an article or add an infographic, but am not sure where I would put it? It doesn't seem like the architecture offers a good place to add linkable content. Anyone have thoughts or suggestions?
Link Building | | EricVallee340 -
Links from multiple sites coming from the same server?
Hi SEO Mozers, As I structure my link building campaign I come across alot of directories some of which are located on the same server. If I am to place links on these sites is this is negative signal for big G? The reason I ask is because I see that a competitor has used these various directories and is ranking on the no 1 spot for a moderately competetive keyword. I am able to place links on the sites with almost no effort at all therefore even if it does not pass alot of link juice is it still worth it for me. But if this is seen as a negative I would not persue it. What is your thoughts on this? Thanks in advance, Ross
Link Building | | rtavs0