Need suggestion: Should the user profile link be disallowed in robots.txt
-
I maintain a myBB based forum here. The user profile links look something like this http://www.learnqtp.com/forums/User-Ankur
Now in my GWT, I can see many 404 errors for user profile links. This is primarily because we have tight control over spam and auto-profiles generated by bots. Either our moderators or our spam control software delete such spammy member profiles on a periodic basis but by then Google indexes those profiles.
I am wondering, would it be a good idea to disallow User profiles links using robots.txt?
Something like
Disallow: /forums/User-*
-
Maybe you should noindex user profile pages until they've been active on the site long enough that a) you're sure they're not a spam bot and b) they're actually active users, with some interesting information to share on their user page?
Like Shaliendra said, this is your call. It's really about your website goals, and what those user pages do for the site. Are you getting much organic traffic from user pages? If you aren't, it's probably easiest to just noindex all user pages. But if some profiles are bringing in organic traffic, I'd recommend that you add a noindex tag immediately, but remove it once someone has commented a few times.
Does that help?
-
I am only talking about user profile pages not the links inside them. I have already taken care of them.
Request others to please come up with suggestions.
-
If you are talking about user profile pages, it is your call.
If you are talking about links that users post in profile pages, use as signatures or use in threads, make sure to mark them nofollow.
Regards
-
Let me re-phrase my question a bit. Would it be a good idea to get the user profile links noindexed in the first place? or should we keep them indexed in Google?
-
Use meta="noindex" tag for the user profile pages. It is more effective.
Regards
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Optimizing shop content for desktop and mobile users
When arranging content on a shop category page I place a descriptive optimized opening paragraph of text above products. On desktop this shows both the opening text and the products above the fold (visible here https://www.scamblermusic.com/royalty-free-music-downloads/ - also shown on the screen grab below). The text may well be ignored by most visitors (who will likely be drawn straight to product images) but it still serves a purpose. dekstop.png When it comes to smaller mobile screens I have started to disable the opening paragraph of text (above the products) and instead place a copy of it below the products, (screen grab below). This keeps the optimized text on the page, but it means that mobile users instantly see products rather than having to scroll past text that they may see as inconvenient. mobile.png I'm conscious of the fact that Google indexes mobile content first, and it also doesn't like duplicate content. I therefore have three questions relating to this: Will moving the optimized text content below all the products to the bottom of the page devalue it (I understand important content should be as near to the top of page as possible)? Although the optimized paragraph of text only displays once on desktop (at the top of the page) and once on mobile (at the bottom of the page) it is actually visible twice in the source code - does this count as duplication, and could it therefore hurt the performance of the page in SERPs? If this practice does cause issues, is there an ideal way to optimize content on pages (especially shop category pages) that doesn't require mobile users to scroll through text before seeing products? Lastly, on topic optimized landing pages that feature product promotions such as this one - https://www.scamblermusic.com/royalty-free-music-downloads/music-licensing-scotland/ - I wonder if it is best to lead with an optimized text introduction above product images, or better to place the products right at the top of the page for immediate impact, then follow this with the content/article/blog post? Many thanks for any advice offered.
On-Page Optimization | | JCN-SBWD0 -
Too much internal linking?
Hi everyone, Too much of anything is not good. In terms of internal linking, how many are too many? I read that the recommended internal links are about 100 links per page otherwise it dilutes the page's link equity. I have a concern about one of our websites - according to search console, the homepage has 923 internal links. All the pages have a corresponding /feed page added to the page URL, which is really weird (is this caused by a plugin?). The site also has an e-com feature, but it is not used as the site is essentially a brochure and customers are encouraged to visit the shop. I assume the e-com feature also increases this number. On the other hand, one of the competitors we are tracking has 1 internal link site-wide. Ours is at 45,000 site-wide. How is it possible to only have 1 internal link? Is this a Moz bug? I know we also need to reduce our internal links badly, however, I'm not sure where to start. I don't know how these internal links are linked together - some aren't in the copy or navigation menu. When I scan the homepage links using 'check my links', the total links identified for the homepage is only 170. kAeYlTM
On-Page Optimization | | nhhernandez0 -
Should an internal link open in a new tab or in the same window?
Should an internal link open in a new tab or in the same window? Seems like this is an issue that has never had a definitive answer one way or the other. But I couldn't find any recent articles from reliable sources taking a stance and answering this question. Does anyone know if user engagement metrics (time on site, bounce rate, pages per visit) are impacted if a user clicks a link that opens in a new tab? Thanks!
On-Page Optimization | | NicheSocial0 -
Navigational Links in Dropdown Menus
Hi Mozzers will navigational links in dropdown menus carry the same weight for Google, just as navigational links that are always visible to the user do? Thx, Chris
On-Page Optimization | | Diderino0 -
Internal link text
Hi With internal links, should I make sure to always use the same anchor text im trying to rank the page for? For example im having a tidy up and have realised im linking to the same page in multiple blog posts using different anchor text. Whats the rule of thumb here? Thanks Chris
On-Page Optimization | | mrcsleonard1 -
Need professional SEO help for onpage analysis and advice
Hi guys, I am not sure if here is the right place to ask for this, but we really need help with one of our projects, especially for the site analysis. We dont need link building tips etc, we just need help regarding our site structure, code etc etc. Do you have any ideas where I can find some real professionals on this topic? Thank you a lot !
On-Page Optimization | | commissionshare0 -
Not sure if I need to be concerned with duplicate content plus too many links
Someone else supports this site in terms of making changes so I want to make sure that I know what I am talking about before I speak to them about changes. We seem to have a lot of duplicate content and duplicate titles. This is an example http://www.commonwealthcontractors.com/tag/big-data-scientists/ of a duplicate. Do I need to get things changed? The other problem that crops up on reports is too many on page links. I am going to get shot of the block of tags but need to keep the news. Is there much else I can do? Many thanks.
On-Page Optimization | | Niamh20 -
Disallow a spammed sub-page from robots.txt
Hi, I have a sub-page on my website with a lot of spam links pointing on it. I was wondering if Google will ignore that spam links on my site if i go and hide this page using the robots.txt Does that will get me out of Google's randar on that page or its useless?
On-Page Optimization | | Lakiscy0