Should our social network put all of our member profiles in the site map?
-
We're working on some changes to our site and want to add a site map file to give some hints to search engines on our member profiles. Our site has millions of member profiles. I want to ensure that Google indexes them.
Is there a benefit to submitting millions of profiles across multiple site maps?
Is it better to pick a sample of those and submit them? Most member profiles have links to other member profiles.
Is there any benefit to taking a single site map of 50k links and then changing it at some frequency so that all of the member profiles are eventually indexed?
Thanks.
-
This was the approach we were considering. However, what gave me pause was looking at other social networks are doing.
- LinkedIn only has 50k profiles.
- Meez has multiple index files and looks like they are indexing many of their profiles
- Facebook and MySpace don't appear to use Sitemaps (although they do have a crawlable member directory)
- WeeWorld has 500 links
The point is there doesn't seem to be any consistency.
If we end up creating a human readable directory ala Facebook does that achieve the same thing?
-
Totally agree with mike and john.
-
I would definitely do this. Since you have so many profiles, you'll want to have one main sitemaps linking to smaller sitemaps with the profile URLs. One of the sites I work on has several million activities created by users that we put into sitemaps. We automatically generate our sitemaps files frequently and add the new activities created. We include a last modified date for each activity as well so the search bot will know if anything has changed since the last time it's indexed it.
I would create a sitemap system where all of your profiles could be found, and by including the last modified date, you can leave it up to the searchbot as to whether or not a profile has been updated and needs to be re-indexed. There are a couple other properties you could use listed on http://www.sitemaps.org/protocol.php as well.
-
Yes, we have the concept of public / private profiles. Private profiles aren't included in the index.
-
Benefiting or not, make sure users have the ability to turn this off to avoid privacy problems.
It might create a mess though if they link back and forth.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Putting content behind 'view more' buttons
Hi I can't find an upto date answer to this so was wondering what people's thoughts are. Does putting content behind 'view more' css buttons affect how Google see's and ranks the data. The content isn't put behind 'view more' to trick Google. In actual fact if you see the source of the data its all together, but its so that products appear higher up the page. Does anyone have insight into this. Thanks in advance
On-Page Optimization | | Andy-Halliday0 -
Duplicate content issue, across site domains (blogging)
Hi all, I've just come to learn that a client has been cross-posting their blog posts to other blogs (on higher quality domains, in some cases). For example - this is the same post on 3 different blogs. http://thebioethicsprogram.wordpress.com/2014/06/30/how-an-irb-could-have-legitimately-approved-the-facebook-experiment-and-why-that-may-be-a-good-thing/
On-Page Optimization | | ketanmv
http://blogs.law.harvard.edu/billofhealth/2014/06/29/how-an-irb-could-have-legitimately-approved-the-facebook-experiment-and-why-that-may-be-a-good-thing/
http://www.thefacultylounge.org/2014/06/how-an-irb-could-have-legitimately-approved-the-facebook-experimentand-why-that-may-be-a-good-thing.html
And, sometimes a 4th time, on an NPR website. I'm assuming this is doing no one any favors and Harvard or NPR is going to earn the rank most every time. I'm going to encourage them to publish only fresh content on their real blog, would you agree? Can this actually harm the ranking of their blog and website - should we delete the old entries when migrating the blog? They are going to move their Wordpress Blog to hosting on their real domain soon:
http://www.bioethics.uniongraduatecollege.edu/news/ The current set up is not adding any value to their domain. Thank you for any advice! Ketan0 -
Integrate a blog within an existing site
Hello everyone! I work on a website of a very small company and so far no one has ever implemented (not even thought about) a proper content strategy. The only content on the site are products description. Through Analytics I discovered lots of opportunities and topics to be covered which would massively increase the traffic, increase the engagement and (hopefully) sales. Problem is that I don't really know how to integrate a blog into the existing site; my first thought was wordpress What is the best way to do it?
On-Page Optimization | | PremioOscar0 -
Is there a way to tell Google a site has duplicated content?
Hello, We are joining 4 of our sites, into 1 big portal, and the content from each site gonna be inside this portal and sold as a package. We don't wanna kill these sites we are joining at this moment, we just wanna import their content into the new site and in a few months we will be killing them. Is there a way to tell Google to not consider the content on these small sites, so the new site don't get penalised? Thanks,
On-Page Optimization | | darkmediagroup0 -
Keyword distribution in the whole site
I've been taught during a SEO course that the whole site has to contain the chosen keywords with a fixed proportion of optimized pages, that should be like this: 50% of pages optimized on the most relevant keyword (just one keyword) 25% of pages optimized on secondary kewords (depending on the size of the site, could be a few pages for each secondary keywords) 25% of pages on long tail keywords. the teachers was a very respected SEO professional, but I've never seen this strategy anywhere in other articles or SEO guides. what do you think about it?
On-Page Optimization | | DavideM
It's true that it brings visibility for the top keyword?
does it lead to cannibalization?
what others strategy do you use?0 -
Altering site structure
I work for a business that operates several sites that were developed a very long time ago. We've been making many different changes over the past 12-18 months to improve these sites in several different ways. One area that we've never discussed or attempted is general site structure. Its pretty obvious that when the business was started they had never heard of information architecture or usability design. To make matters worse, the internal linking strategy appears to have been link everything to everything. Well after being told that it couldn't be done - I'm getting our team to say we must focus on this, if for no other reason that to help consumers figure out how to navigate through our site. Today we essentially have a series of category / information pages. In some cases, we hang more detailed topical content related to a category /informational page in a hub and spoke manner. Although remember what I said about linking everything to everything. In reality there are a series of subtopics that should been designed for every category / informational area. Instead, what happened is in some cases the subtopic is integrated into the hub or category page, in other situations is hung off the page as a spoke page and in others the subtopic isn't even covered. The plan is to standardize - each category will have 'n' subtopics (~10-12, we're still working this out). From a navigational standpoint users will be able to easily navigate both across categories as well as subtopics within a category as well as between categories within adjacent/similar subtopics. This is essentially a grid if that makes sense. The question is this - we have some keywords that do well in SEO and many many more that do not and the trend has not been our friend. We're considering keeping the URLs of the pages associated with strong keywords the same within the nav structure, even though this might mean the URL for a spoke page will be inconsistent with the spoke page name from a different category. I don't see any real danger for pages that either are not associated with any ranking keywords or only very weak keywords. Maybe I'm wrong. What things should we consider in this change? We believe that this standardization should help consumers find the information they are looking for in a much more efficient manner, so page views/visit should go up. Additionally, this prepares us for category and subtopic comparison pages and other added functionality being added in a logical manner. We also think that as we add depth about a subtopic, it will be easier for us to acquire links to our site because the subtopics within a category will appeal to different websites. This is by no means a small project. We have hundreds and hundreds of pages. Do folks think this is a worthwhile endeavor? We've spent a lot of time cleaning up H1 tags, structure of our pages, anchor tags, page load order and speed, image caching, etc. Site structure, URL length and internal link structure are essentially what is left. Once these are done we intend to really get going on better and more organized content on our site. Thoughts?
On-Page Optimization | | Allstar1 -
Can embedding videos from other sites help SEO?
I work for an eCommerce site and many of the vendors we get our products from have videos our their site that explain how the products work and the different features of them, ect. We really have done nothing with video marketing, and would like to create some of our own unique videos, but this will be impossible for the vast majority of the products on our site. We know from a content standpoint embedding videos from our vendors to our product pages will be beneficial, but at the same time it shows our competitors and other site visitors where we are getting our products from which we would rather not do. How will this effect us from an SEO standpoint though? Will it help us to have new content, even though it is embedded from another site? Or will it hurt us because it is not unique? Or will it have no effect at all? Thanks for you help!
On-Page Optimization | | ClaytonKendall0 -
Major update to site architecture (outline)-Is Google going to drop?
I'm working with a lawyer client who has a table-based, outdated site. Her nav links consist of a jumble of topics and static pages in one long sidebar list on the home page. I'm moving her site to Wordpress and I've recommended that she organize the site based on categories that roughly match the topics/keywords she wants to rank highest for in Google. The site will be much better organized and coded and the URLs for the new launch will be much stronger for SEO by being targeted and coded properly. So the site should rank better after, right? Right??? I know that when Google crawls the new architecture, it's not going to find the expected long sidebar list of internal nav links. It'll find better, more keyword targeted internal nav links. But will that keep the site from getting dropped off page 1? I'm speaking w/ the client tomorrow and if she's going to drop or get bounced around, I feel like I should prepare her and let her know roughly what might happen. I'm thinking based on my current understanding that I should tell her to expect to be bounced around for a few weeks, but in the end she should rank higher than before. What would you do/say?
On-Page Optimization | | bvrob0