Some web 2.0 sites blocked by robot
-
I had created some web2.0 sites, google also indexed those sites but those sites robots.txt are disallow, this mean Google will not give any credit on ranking ? I have seen in google, those sites meta description was written - A description of this site is not available due to the robot.txt file. I checked that file, it is written disallow. Can google still count those sites for the ranking purpose ?
-
Hi,
Pages blocked by robots.txt file will not be considered for ranking. You still see those pages in Google's index is because of their mentions on other websites. Google has been doing link discovery from websites other than these Web2.0 sites of yours. So to stop Google completely from indexing these pages, you should go in for page-levelrobots meta tag. Here you go for more: https://support.google.com/webmasters/answer/93710?hl=en
Once you implement the page-level robots meta tag to block those pages, Google will remove them from the index after the next crawl. You can expedite this process by using the link removal procedure in webmaster tools account.
Here you go for more: https://support.google.com/websearch/troubleshooter/3111061?rd=1
Good Luck to you my friend.
Best regards,
Devanur Rafi
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Accidentally generated navigation links that point to American site from Australian site.
Somehow we ended up getting hundreds-of-thousands of links coming from our .au (Australia site) to our .com (America site). We believe that something happened during a change that turned a handful of our example.com.au navigational and footer links into back links pointing to example.com and sub-domains of the American version. We are currently fixing this, but we are wondering if this could potentially be problematic in terms of a penguin penalty due to an unnatural linking campaign or back link scheme. Could this error create major problems for us in the near future if we have corrected the issue? Your thoughts are welcome! Thanks!
Link Building | | tdawson090 -
Link building for a non-linkable site?
Hello, I am trying to zone in on a link building strategy for a non-linkable site. What I mean by non-linkable is I have a construction site. It's a family owned and operated small business. Our clients are farmers and older people usually. We go do a job, do it right the first time, and leave. Basically even if a couple of people who link to me for some weird reason, this is no way in the realm of 6,000 that my main competition has. I have tried to get as many quality citation resources as possible by using get listed, and white spark. My domain authority is only 16 though, so I must be able to increase this somehow. I have listed with Google +, Bing, Yahoo and every other major citation I could find. So now with trying too increase links with other ideas. I read somewhere to donate to charitable organizations, but if they link back to me as a donor, in an unrelated field, isn't that spammy like? So a construction site donating to a disease website, and then getting a backlink in return, does that look weird. It just seems like there are so many rules that I do not want to mess something up. I do not want get spammy links, but not sure if citations count as links so I am doing a win-win thing? Thanks for any tips Chris
Link Building | | asbchris0 -
Link building for a product review site
I'm doing SEO for a product review website, and I'm curious what link building opportunities are best for this category. Assume only the following: The website is basically a blog Most of the articles are reviews on cosmetic products, though there are also articles regarding news, product roundups, tips&tricks and similar content The website is in a local, non-english language Disregarding low-value opportunities such as directories, what kind of websites should I aim for outreach purposes? So far, I'm thinking the following: Product manufacturers (very low success chance, as the review site is fairly new and in a localized language) E-commerce sites selling the products (average to low success chance, since a lot of them use CMSes that might not allow integration of a review) Other cosmetic blogs, particularly for guest blogging (average to low success chance, since the website is fairly new) Any ideas would be appreciated, thanks!
Link Building | | mihaiaperghis0 -
Content Strategy - High Value on Lots of Sites vs. High Value on One Site
Good afternoon Mozzers. I have a discussion based question and I'd be interested to know your thoughts. I currently implement a content strategy where we create a series of high value How-to written articles, relevant to our audience and then work at getting them placed on multiple high value websites. I have just been offered an opportunity with a PR6 domain to create a similar series of content but place it all on their site with links back to ours through a dedicated section. So my question is would I gain more value from small amounts of great content in lots of places vs. a lot of great content in on place? Effectively 1 link from 20 sites vs. 20 links from 1 site.
Link Building | | RobertChapman0 -
Link to my site not showing up in Open Site Explorer
If a link to my site on another domain does not appear in the list of links gathered by the Open Site Explorer, does that mean that this backlink will not be crawled by search engine bots? Is there anything I should do to make sure that this link IS crawled and/or recognized by search engines coughGooglecough?
Link Building | | robgleslie0 -
Does it hurt your site to syndicate content on other sites?
Does publishing an article from your site on other sites hurt your site if you require a link back to your site? If website B, C, and D publish an article found site A, but they link back to site A, does that hurt or help site A?
Link Building | | nicole.healthline0 -
How Does Google connect Owners of Several Sites?
let's say I own 20 sites, all non duplicate content and Google sees that some of them has linked to sites that they consider a "farm" or other violation. So they give penalties to those sites. What happens with the other sites and how can I keep sites the most independent? For ex: These are my questions... Will google follow no follow links to see that they are connected to the good sites and penalize them? If they are all part of google anaylitics with good and bad sites, will google attack them all? Will google look at the owner of all the sites and connect them that way/ I need to know the extent Google connect site owners for penalizing. please only answer with knowledge, and if you can supply specific links, that would be great too, thanks.
Link Building | | joemas990 -
What are the best tactics for SEO on a brand new site?
What is on everyones to do list when starting SEO work on a brand new site that has had no SEO work done in the past?
Link Building | | MediaBazooka0