What is the best way to block http://www.site.com/members/...
-
How do i block http://www.site.com/members/....name/activity/3202 and many more like this from getting spider
showing up as duplicate in moz
Regards Tai
-
Thanks for the answer and for endorsing the question.
Regards Tai
-
I would block those pages within the robots.txt file and with a Meta Noindex tag. Moz has a good article explaining the robots.txt file and how to block access to certain pages.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Site Wide Links
Howdy Moz! So our agency has been around for long enough to have a few sites we've built that have our credit in their footer resulting in a site wide link. Mostly just our name. We've heard that Google does not particularly like site wide links, should we go through and remove some of these old links?
On-Page Optimization | | wearehappymedia0 -
Need help in understanding why my site does not rank well for our best content?
Hi, We are a technology site from India (Digit.in) and we create a lot of original product review content (http://www.digit.in/mobile-phones/nokia-lumia-830-review-24655.html) but don't seem to rank even in the first 4 pages on Google results. Please let me know the reason for this and how to get this fixed. Thanks Arun
On-Page Optimization | | 9dot90 -
Keyword/phrase proximity
I'm curious about opinions regarding how the search algorithms treat multiple key phrases that may reside in one long tail key phrase. So for example: If I'm optimizing for "New York Litigation Lawyer", would that also give me rankings for "New York Lawyer"? My thought is that the former will be considered the primary keyword and rankings will improve mostly for that, but that the latter keyword could also possibly see some lift as well. Thanks!
On-Page Optimization | | nickturner9221 -
What is the best way to have two online stores, each focusing on a specific country?
The dilemma here of course is that the stores will be very similar in content, with the domains only being different in that the store targeting the US will be a .com domain and the Canadian store is a .ca domain.
On-Page Optimization | | absoauto0 -
How do i block an entire category/directory with robots.txt?
Anyone has any idea how to block an entire product category, including all the products in that category using the robots.txt file? I'm using woocommerce in wordpress and i'd like to prevent bots from crawling every single one of products urls for now. The confusing part right now is that i have several different url structures linking to every single one of my products for example www.mystore.com/all-products, www.mystore.com/product-category, etc etc. I'm not really sure how i'd type it into the robots.txt file, or where to place the file. any help would be appreciated thanks
On-Page Optimization | | bricerhodes0 -
Contact Form On Homepage - Best Practices
How important is it to have a contact form on the homepage of a service-based business? I am trying to decide if having a form on front page will increase the number of people filling it out.
On-Page Optimization | | TheSEODR0 -
Www vs "non" www site addresses and SEO
I first apologize for the lame question title - didn't really know how to word it... I'm having a bit of a conundrum and cannot figure out whats going on, but in the mean time I thought I would ask to see if its hurting my ranking. My site at www.ap-mg.com is built on WordPress using the Thesis them by DIY (just a little upfront info). I am very careful to make sure that all my links are in a particular format i.e. http://www.ap-mg.com - on my site, as well as other sites I have my profile on. My site also used to be hosted on the /home directory until about a month ago. My problem is that when I click on the DA MoxBar link while at my sites homepage, it takes me to Open Explorer, but to ap-mg.com and shows no results - I then add the www to the front of the address and vuala - results. But then the second issue I'm having is then it tells me that my site is redirecting the the /home directory, which its not and I'm still trying to figure that one out. So with all the craziness with my site, www, no www, /home....is this killing any chance of real ranking?
On-Page Optimization | | apmgsmith0 -
Site Stucture Advice - Keyword Dillema
I am creating a new site and am looking for some advice on how to structure the site Using Google's keyword search tool it seems like I have a dilemma in that about 50% of the keyword pairs are contained in 10 keyword pairs that are similar The first two pairs have about 49% of the traffic and only differ between plural / singular, not quite sure how to handle that, or if google has a method to make these more or less synonomous The last 8 pairs are roughly similar in distribtuion As an example (not my case, just for visualization) Mountain Bike Classes Mountain Bike Instruction Mountain Bike Workshops Mountain Bike Training Etc ... which all more or less give the same results (yes some difference but they all deal with learning how to ride a mountain bike, again this is not my exact case, don't care a whit about mountain bikes 😉 I don't see giving each of those kinds of pairs their own page since the content would be pretty much the exact same, making it substantially different would also be problematic (if I am thinking about this correctly) I have a clean slate to work with from a site perspective so I am wondering how people here would, or better yet have handled similar situations
On-Page Optimization | | bThere0