Need suggestion: Should the user profile link be disallowed in robots.txt
-
I maintain a myBB based forum here. The user profile links look something like this http://www.learnqtp.com/forums/User-Ankur
Now in my GWT, I can see many 404 errors for user profile links. This is primarily because we have tight control over spam and auto-profiles generated by bots. Either our moderators or our spam control software delete such spammy member profiles on a periodic basis but by then Google indexes those profiles.
I am wondering, would it be a good idea to disallow User profiles links using robots.txt?
Something like
Disallow: /forums/User-*
-
Maybe you should noindex user profile pages until they've been active on the site long enough that a) you're sure they're not a spam bot and b) they're actually active users, with some interesting information to share on their user page?
Like Shaliendra said, this is your call. It's really about your website goals, and what those user pages do for the site. Are you getting much organic traffic from user pages? If you aren't, it's probably easiest to just noindex all user pages. But if some profiles are bringing in organic traffic, I'd recommend that you add a noindex tag immediately, but remove it once someone has commented a few times.
Does that help?
-
I am only talking about user profile pages not the links inside them. I have already taken care of them.
Request others to please come up with suggestions.
-
If you are talking about user profile pages, it is your call.
If you are talking about links that users post in profile pages, use as signatures or use in threads, make sure to mark them nofollow.
Regards
-
Let me re-phrase my question a bit. Would it be a good idea to get the user profile links noindexed in the first place? or should we keep them indexed in Google?
-
Use meta="noindex" tag for the user profile pages. It is more effective.
Regards
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
How to block index of link and content
Hi, We have pages where articles are shown and in the sides we have small snippets of Articles which shows the title and close to 25 words and a image. When i search for something in Google the snippet image and content is shown and in Google when clicked it redirects to a page which is not meant to be shown for the keyword the visitor is querying Is there a way i can block all the links and content shown in the right and left side of the page so Google does not get confused with the page content thats not related to that page? thanks
On-Page Optimization | | AlexisWithers0 -
Need SEO Advice for different languages and How to optimize the page
Hello. Currently we have an ecommerce site that sells shoes online in France. The site is in English. Say the keyword is shoes and our page is example.com/shoes it;s perfectly fine to optimize that page for keyword of "shoes". Now, what about french keyword of shoes "chaussures" ? How do i optimize it? Should i create a different page or just edit the same page with keyword of "chaussures" in title tag etc? What is the best way to go about doing this? Thanks
On-Page Optimization | | WayneRooney0 -
Does the link title attribute benefit seo?
Hello, Anyone could tell me the benefit SEO of link title attribute. Is **Link Title **ranking factor? Thanks
On-Page Optimization | | JohnHuynh0 -
Too many on page links in sitemap.html
My crawl report is flagging an issue with too many links to one of my pages, this page is my sitemap.html. However, I have coded the page so that if required is specified it generates an .xml version of the page and if not then the html version is displayed. What is the best way to stop the crawl finding the html version whilst maintaining it on the site for clients navigation?
On-Page Optimization | | SamPenno0 -
Site wide 301 or canonical links.
Hi guys, I'd like add code to my header file to specify www. as opposed to just http:// for the canonical links across my entire site. How can I do this? I'd like it to be site wide code that I can just add to my header.php file which is included across the site.
On-Page Optimization | | absoauto0 -
Do anchor links pointing to bottom/top of page count as link?
As the title says: Do anchor links pointing to bottom/top of page count as link? This page: http://www.betxpert.com/forum/bookmakere/vis/ladbrokes-kommentar I has over 300 links, but I don't see that many links. Is it the "#15" and the top/bottom of page anchors that count? Is this harmful in terms of link juice? -Rasmus
On-Page Optimization | | rasmusbang0 -
Internal Followed Links:
Ran Open site explorer on my site: www.psbsperakers.com It is saying that I only have "1" Internal followed link could somebody tell me what that means... and maybe take a look at my site and see it this is a quick fix?
On-Page Optimization | | kevin48030 -
Do external links drain PageRank?
Example: A page has 100 links, 90 internal links and 10 external links. The page has a Google internal PR of 1000. The question is: Is the pagerank that flows to the internal links being calculated taking into account all links on the page (internal + external) or only the 90 internal links? E.g. is the PR that flows to the internal links 1000/100 or 1000/90? Are links to external sites "votes" that do not affect the internal PR flow? Disclaimer: I understand that the maths behind the PR algo are more complex. This simplified example only serves to explain my question.
On-Page Optimization | | Florakel0