Some web 2.0 sites blocked by robot
-
I had created some web2.0 sites, google also indexed those sites but those sites robots.txt are disallow, this mean Google will not give any credit on ranking ? I have seen in google, those sites meta description was written - A description of this site is not available due to the robot.txt file. I checked that file, it is written disallow. Can google still count those sites for the ranking purpose ?
-
Hi,
Pages blocked by robots.txt file will not be considered for ranking. You still see those pages in Google's index is because of their mentions on other websites. Google has been doing link discovery from websites other than these Web2.0 sites of yours. So to stop Google completely from indexing these pages, you should go in for page-levelrobots meta tag. Here you go for more: https://support.google.com/webmasters/answer/93710?hl=en
Once you implement the page-level robots meta tag to block those pages, Google will remove them from the index after the next crawl. You can expedite this process by using the link removal procedure in webmaster tools account.
Here you go for more: https://support.google.com/websearch/troubleshooter/3111061?rd=1
Good Luck to you my friend.
Best regards,
Devanur Rafi
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
What to do with expired domains waiting to create web site
Hi users MOZ:
Link Building | | NachoRetta
I bought a couple of expired domains to create a private blog network but I can't create the sites yet. While i prepare the sites, it is good idea to do a 301 redirect with them?1 -
Linking root domains to your own site
I have been using the moz open site explorer tool and glancing at my competition. I noticed most sites if not all in the linking domains section have a link to there own site. How do i do this? On my site i have no established links and my score is only 1/1. Even with lower ranking sites that have there own site linking to there self have a 16/16. Any help would be appreciated I am pretty new to all of this. thanks
Link Building | | unlimitedairbrush0 -
2 backlinking questions
I've got 2 questions regarding backlinking. 1 - I recently watched a webinar saying I should never get backlinks from any sites lower than a PR 3. However, I have found some relevant websites to our niche that are lower than that. We have recently set-up a new website that currently has a PR 0. Bearing that in mind do you think it was still be good for SEO to try and get links from the lower PR sites to build up our own PR? 2 - Has anyone found out what Google thinks of gaining links from domains hosted in other countries? For example, our websites are hosted in the UK, does it look suspicious to search engines if we have links from USA or other countries? Thanks
Link Building | | AAttias0 -
First links for a new site?
What would be the first links you get for a new site? Yahoo and BOTW directory links? What are your favorites?
Link Building | | Mozzin0 -
Are hosting Web badges still worth it?
Hi, I would like to ask you about a really specific case: hosting company web badges. I'm working for a web hosting company, and in order to increase the number of incoming links we were considering providing web badges to our customers, so they could link back to us. Some customers would be glad to show they host their website with us placing one web badge in their website, but after the last penguin update I'm not sure if it's still a good idea. As the company is hosting several thousand websites it could be a really good opportunity to get some back links, but I would like to hear your suggestions. Shall we use "nofollow" on the links? (But that way we would be missing all the link juice that we could get) Would it be better to just show the web badge on the home page of each domain and keep the dofollow attribute? Are there some terms that we should use or avoid in the links? Maybe "Hosted at <company name="">" would be a good anchor text, or shall we just use the company name? </company> So, I would love to hear your advice about doing or not doing it. Or any advice about how to do it properly in order to get the desired result. Thanks! 🙂 Xavier.
Link Building | | xtrill0 -
Links not showing up in Site Explorer?
Why aren't some backlinks showing up in Site Explorer? I have links to my home page (www.mortgagesbymark.com) from Trulia at http://www.trulia.com/blog/mortgagesbymark/ but they're not showing up in Site Explorer. Thanks for your help!
Link Building | | MortgagesByMark0 -
How to Add Content to a Product-Focused Site
I recently took over management of the SEO work for the following site: http://www.grovercorp.com/rings-and-seals/. I want to do link building, but don't have a ton of experience with it. From what I've read, offering linkable content is the best way to get links. However, this site -- like many in industrial B-2-B -- is focused primarily on promoting their products. I'd like tto offer an article or add an infographic, but am not sure where I would put it? It doesn't seem like the architecture offers a good place to add linkable content. Anyone have thoughts or suggestions?
Link Building | | EricVallee340 -
Link building and directory links to a new site
I have three new sites all hosted on the same server in the same public html folder and each site is in a different folder inside the public html folder. These sites are a listing of live music venues in different cities in Texas. Should I link these sites together to increase page rank to each other and also put key search phrases in the anchor text and place these links in the text in the center of each page of each site to make the links more effective? Also, because the sites are about a year old they don't have many inlinks yet. If i submit them to about 50 directories will Google not like this because there are way more directory links than natural links? I've been told that it is trouble to have more than about 50% directory links compared to natural links. Thanks in advance for your answers! Take care,
Link Building | | Ron10
Ron0