Should our social network put all of our member profiles in the site map?
-
We're working on some changes to our site and want to add a site map file to give some hints to search engines on our member profiles. Our site has millions of member profiles. I want to ensure that Google indexes them.
Is there a benefit to submitting millions of profiles across multiple site maps?
Is it better to pick a sample of those and submit them? Most member profiles have links to other member profiles.
Is there any benefit to taking a single site map of 50k links and then changing it at some frequency so that all of the member profiles are eventually indexed?
Thanks.
-
This was the approach we were considering. However, what gave me pause was looking at other social networks are doing.
- LinkedIn only has 50k profiles.
- Meez has multiple index files and looks like they are indexing many of their profiles
- Facebook and MySpace don't appear to use Sitemaps (although they do have a crawlable member directory)
- WeeWorld has 500 links
The point is there doesn't seem to be any consistency.
If we end up creating a human readable directory ala Facebook does that achieve the same thing?
-
Totally agree with mike and john.
-
I would definitely do this. Since you have so many profiles, you'll want to have one main sitemaps linking to smaller sitemaps with the profile URLs. One of the sites I work on has several million activities created by users that we put into sitemaps. We automatically generate our sitemaps files frequently and add the new activities created. We include a last modified date for each activity as well so the search bot will know if anything has changed since the last time it's indexed it.
I would create a sitemap system where all of your profiles could be found, and by including the last modified date, you can leave it up to the searchbot as to whether or not a profile has been updated and needs to be re-indexed. There are a couple other properties you could use listed on http://www.sitemaps.org/protocol.php as well.
-
Yes, we have the concept of public / private profiles. Private profiles aren't included in the index.
-
Benefiting or not, make sure users have the ability to turn this off to avoid privacy problems.
It might create a mess though if they link back and forth.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Best site structure for us?
Hey guys, I have a somewhat silly question that I probably know the answer to - but would still like to hear your POV's. We're a WP theme making company but we also build other stuff. Context: 1. All demos for themes currently go under domain.com/Theme_A/ The demo is lorem ipsum so is marked noindex nofollow. That being said we get rocking analytics data usually (not sure if it's still valuable for G after the noindex). 2. Currently we need landing pages for themes and we're running them under domain.com/Theme_A/optimized-landing-page-title.php dofollow and indexed ofc. My question is...Would we be better off to include all landing pages under a domain.com/wordpress-themes/ category/tax and then go for the optimized-landing-page-title.php page? Does it make any difference either or? Right now we're not REALLY running them on subdomains (though the structure seems like it), they're just folders. We're thinking that more seo juice would flow through the different pages if we have them all under the same category, rather than basically starting from scratch each time under a new folder. Right? Thanks!!!
On-Page Optimization | | andy.bigbangthemes1 -
Aggregator/comparitor site outranking us
Hi I would like to know if anyone has experience with trying to outrank an aggregator/comparitor website. We are being beat by one that also includes our range of products in their comparisons and I was wondering if there was a smart way around this?
On-Page Optimization | | Discovery_SA2 -
Does the follow link from the moz Profile really count after first with nofollow?
Hey all, I discovered that the link from the public profile might not count. To my knowledge Google "counts" the first link to another page on any given page. The public profile has a nofollow link before your follow link:
On-Page Optimization | | Sebes
linktodomain.tld linktodomain.tld Doesn't this invalidates all the public profile links? What is your stance on this? Regards Sebastian2 -
How to use canonical with mobile site to main site
I am pretty sure that the mobile version of the main site needs to be the same canonical link from what I understand. I am trying to find good docuementation that supports this. Even better if its from Google or Matt Cutts. I have a main domain like http://www.mydomain.com the mobile version of this is http://www.mydomain.com/m/ Should my canonical be rel="canonical" href="http://www.mydomain.com"/> for both these pages?
On-Page Optimization | | cbielich0 -
Schema.org for a rental site with more than one apartment per address
I am looking for advices on how to best start adopting schema.org for an apartment rental site with more than one apartment per address. I would like to get feedback and suggestions on my initial thoughts. Here are the obvious ones: http://schema.org/Place for the address of the building an apartment is in. http://schema.org/ApartmentComplex for the unique page for each apartment. Any thoughts or experiences you would like to share? Thanks, Adrien O'Leary
On-Page Optimization | | AdrienOLeary0 -
Is it ok to put a strapline on every website page or does it confuse the bots?
We have just started doing SEO for a new client. Their web design agency has built a cms website for them and in the footer area of each page there is some global content which contains: a) the company's address b) a strapline, ie "family law specialists" I have 2 questions: I have understood from previous SEO classes I've been to, that putting the same keywords on each page of a site is a no-no as then Google won't know what page to bring up for that keyword. However, is it ok to put an address on every page and can Google tell that it is just an address? What about the strapline? Family law specialists isn't actually a keyword I'm currently tracking but I could add it to SEOMoz. however is it a problem having on every page or is it ok because it's in the footer?
On-Page Optimization | | mfrgolfgti0 -
Is there any benefit in on-site duplicate content?
I have about 50 internal pages on my site that I want to add a "Do it yourself tutorial" to in an effort to build the quality of the pages. Is this going to de-value the content if I put it on all 50 pages? It's difficult to write similar content 50 different ways.
On-Page Optimization | | BradBorst0 -
Top navigation bar vs. left side - site archetecture
we do eCommerce on BigCommerce platform, I'm using the top navigation menu for: home about policy faq and other standard informations all my products are list in the left navigation Categories menu. What is your advise about this? Should we have the products at the top? The top menu are web pages, not categories. Also, if you have a better ideas about our site archetecture, you are welcome to comment. domaine is: http://www.furnacefilterscanada.com/ Thank you, BigBlaze
On-Page Optimization | | BigBlaze2050