Should our social network put all of our member profiles in the site map?
-
We're working on some changes to our site and want to add a site map file to give some hints to search engines on our member profiles. Our site has millions of member profiles. I want to ensure that Google indexes them.
Is there a benefit to submitting millions of profiles across multiple site maps?
Is it better to pick a sample of those and submit them? Most member profiles have links to other member profiles.
Is there any benefit to taking a single site map of 50k links and then changing it at some frequency so that all of the member profiles are eventually indexed?
Thanks.
-
This was the approach we were considering. However, what gave me pause was looking at other social networks are doing.
- LinkedIn only has 50k profiles.
- Meez has multiple index files and looks like they are indexing many of their profiles
- Facebook and MySpace don't appear to use Sitemaps (although they do have a crawlable member directory)
- WeeWorld has 500 links
The point is there doesn't seem to be any consistency.
If we end up creating a human readable directory ala Facebook does that achieve the same thing?
-
Totally agree with mike and john.
-
I would definitely do this. Since you have so many profiles, you'll want to have one main sitemaps linking to smaller sitemaps with the profile URLs. One of the sites I work on has several million activities created by users that we put into sitemaps. We automatically generate our sitemaps files frequently and add the new activities created. We include a last modified date for each activity as well so the search bot will know if anything has changed since the last time it's indexed it.
I would create a sitemap system where all of your profiles could be found, and by including the last modified date, you can leave it up to the searchbot as to whether or not a profile has been updated and needs to be re-indexed. There are a couple other properties you could use listed on http://www.sitemaps.org/protocol.php as well.
-
Yes, we have the concept of public / private profiles. Private profiles aren't included in the index.
-
Benefiting or not, make sure users have the ability to turn this off to avoid privacy problems.
It might create a mess though if they link back and forth.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
site speed
i use mid-quality pic and... but my site speed is low
On-Page Optimization | | zlbvasgabc
any suggestion?
my site is:
https://bandolini.ir/0 -
Old domain to new domain what happens to the old site?
Hello We rebranded 5 months ago, and set up a new domain for the new brand name which sits on different hosting to the old. We still have the old hosting running with the old site still on it. We have set up redirects to the new domain and wondered when/if we can turn off the old site hosting?
On-Page Optimization | | Scivisum0 -
"Turning off" content to a site
One site I manage has a lot of low quality content. We are in the process of improving the overall site content but we have "turned off" a large portion of our content by setting 2/3 of the posts to draft. Has anyone done this before or had experience with doing something similar? This quote from Bruce Clay comes to mind: “Where a lot of people don’t understand content factoring to this is having 100 great pages and 100 terrible pages—they average, when the quality being viewed is your website,” he explained. “So, it isn’t enough to have 100 great pages if you still have 100 terrible ones, and if you add another 100 great pages, you still have the 100 terrible ones dragging down your average. In some cases we have found that it’s much better, to improve your ranking, to actually remove or rewrite the terrible ones than add more good ones.” What are your thoughts? Thanks
On-Page Optimization | | ThridHour0 -
How to use canonical with mobile site to main site
I am pretty sure that the mobile version of the main site needs to be the same canonical link from what I understand. I am trying to find good docuementation that supports this. Even better if its from Google or Matt Cutts. I have a main domain like http://www.mydomain.com the mobile version of this is http://www.mydomain.com/m/ Should my canonical be rel="canonical" href="http://www.mydomain.com"/> for both these pages?
On-Page Optimization | | cbielich0 -
Flickr v. On-Site Images
My apologies in that I have searched for this, have seen discussions on it and haven't seen a definitive answer on the question of hosting & displaying on-domain images v. using a source like flickr to host all of your images. I have a client that is mostly a local search play in a very tourism heavy area. I'm investigating this option for a few reasons. 1. Ease of use. The new flickr app is brilliant. So if he's out giving a tour, takes a picture, it can be seamlessly integrated to his account & then shot off to all of his portals (website, facebook, twitter, etc.). It's a small client & he's not tech savvy, so this option suits him very well. 2. SEO. With all of the tagging, geo components, and it playing nice with Google Images search, I thought this was a viable option in hosting the majority of his on-site images. I've seen opinions on this before. But I was wondering if there any further opinions on the subject. Not sure if there's anything 'definitive', but any help or insight would be appreciated.
On-Page Optimization | | BrianWhitaker0 -
Duplicate Content - Site Wide or Internet Wide?
Hello... I am creating a new website and i was wondering how you guys would define duplicate content? If my new site had the same page titles and descriptions as my existing site, would that be duplicate content? Or does duplicate content mean same titles and descriptions in the same site? I'm wondering if i can upload the same database (with page titles and descriptions and alt tags) to my new site or if that would be looked at as duplicate... Thanks
On-Page Optimization | | Prime850 -
What is wrong with this site
Hello, I need advice regarding design ( current design as well as any changes ) and seo advice as to what we should do to promote the site. The site in question is - Allkindofessays.com Thanks
On-Page Optimization | | seoug_20050 -
Site structure for services and blog articles
Hi, looking for some advice on the structure for a relatively small site (around 200 pages). I'd like a structure where we can talk about our services as well as write blog articles on topics that relate to our services. We'll have loads more content in the blog area than in the services area. I was thinking of this: option 1: /services /services/copywriting
On-Page Optimization | | JaspalX
/services/social-media
/services/press-releases etc. and categories for articles where we'd give tips, talk about trends etc. /copywriting
/social-media
/effective-press-releases
etc. would it be better to have a different structure, say: option 2: /copywriting
/copywriting/services
/copywriting/articles OR option 3: /copywriting-services
/copywriting-blog OR option 4: /services/copywriting
/blog/copywriting OR is there another, better way perhaps? Of course the internal anchor text links to the services/blog articles pages will be tuned to try and make it clear what each section is about i.e. our services vs. industry trends/comments/tips for the blog.0