Should our social network put all of our member profiles in the site map?
-
We're working on some changes to our site and want to add a site map file to give some hints to search engines on our member profiles. Our site has millions of member profiles. I want to ensure that Google indexes them.
Is there a benefit to submitting millions of profiles across multiple site maps?
Is it better to pick a sample of those and submit them? Most member profiles have links to other member profiles.
Is there any benefit to taking a single site map of 50k links and then changing it at some frequency so that all of the member profiles are eventually indexed?
Thanks.
-
This was the approach we were considering. However, what gave me pause was looking at other social networks are doing.
- LinkedIn only has 50k profiles.
- Meez has multiple index files and looks like they are indexing many of their profiles
- Facebook and MySpace don't appear to use Sitemaps (although they do have a crawlable member directory)
- WeeWorld has 500 links
The point is there doesn't seem to be any consistency.
If we end up creating a human readable directory ala Facebook does that achieve the same thing?
-
Totally agree with mike and john.
-
I would definitely do this. Since you have so many profiles, you'll want to have one main sitemaps linking to smaller sitemaps with the profile URLs. One of the sites I work on has several million activities created by users that we put into sitemaps. We automatically generate our sitemaps files frequently and add the new activities created. We include a last modified date for each activity as well so the search bot will know if anything has changed since the last time it's indexed it.
I would create a sitemap system where all of your profiles could be found, and by including the last modified date, you can leave it up to the searchbot as to whether or not a profile has been updated and needs to be re-indexed. There are a couple other properties you could use listed on http://www.sitemaps.org/protocol.php as well.
-
Yes, we have the concept of public / private profiles. Private profiles aren't included in the index.
-
Benefiting or not, make sure users have the ability to turn this off to avoid privacy problems.
It might create a mess though if they link back and forth.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Site IA considering a "Resources" section
I'm working on a resources section for our website and I'm wondering the best way to handle my sites information architecture. The resources section houses things like webinars (both upcoming and recorded), case studies, ebooks, etc. Should things like webinars and case studies be considered supporting content to our main topics? For example we have a product that manages Rebates. So we have a page on our site dedicated to "Rebates". Would a webinar or case study about our Rebates software be grouped with "Rebates" or would it be grouped by content/resource type? So for example a breadcrumb could look like this: Home > Rebates > Rebates Webinar or Home > Webinars > Rebates Webinar Thanks in advance!
On-Page Optimization | | Brando160 -
Stolen Content reposted on other sites. How does this affect ranking?
Visitors often copy and paste my content and post it elsewhere... on Facebook, on Tumblr, on forums and sometimes on competing websites... but they don't link to me. How does Google treat this duplicated content? What is the best way to handle it? File DCMA claims or ask them for a link?
On-Page Optimization | | brianflannery0 -
Duplicate content on partner site
I have a trade partner who will be using some of our content on their site. What's the best way to prevent any duplicate content issues? Their plan is to attribute the content to us using rel=author tagging. Would this be sufficient or should I request that they do something else too? Thanks
On-Page Optimization | | ShearingsGroup0 -
One site, one location, multiple languages - best approach?
Hey folks, Has anyone created a multilingual site targeted at a single location? I have a site that I need to create which is targeting users in Spain. There are going to need to be English and Spanish versions of the text. My thoughts would be to handle it this way: 1. Geolocate the entire site to spain 2. Have the english content in a folder /en/ 3. Have the spanish content in a folder /es/ As far as I am aware the same content in another language is not considered duplicate content and Google should handle folks searching in spanish or english and show them the correct landing page. Sounds easy enough in principle but I also have these other options to seemingly solidify the approach: 4. Add: rel="alternate" hreflang="x" (3) 5. Add language information to a sitemap (4) Again, none of that seems terribly difficult but would welcome any feedback and particularly experience of multilingual sites targeting a single location. Thanks all Marcus References and info 1. Multi Regional:
On-Page Optimization | | Marcus_Miller
http://googlewebmastercentral.blogspot.co.uk/2010/03/working-with-multi-regional-websites.html 2. Multi Language:
http://googlewebmastercentral.blogspot.co.uk/2008/08/how-to-start-multilingual-site.html 3. http://support.google.com/webmasters/bin/answer.py?hl=en&answer=189077 4. http://support.google.com/webmasters/bin/answer.py?hl=en&answer=26208650 -
Can you have more than 1 site on the first page if site look and content is completely different but keywords are the sam.
I have a client that wants to build another completely different site than his main site and optimize it to have 2 websites on the first page for his keywords. The content and look and feel of the website would be completely different. One of his competitors is doing it and getting away with it. What is your advice.
On-Page Optimization | | Roots70 -
What is the best way to handle small business site architecture?
I do allot of work for small businesses with around 15-20 total pages. What is the best site architecture? For example if its a landscaping website, should there be a services category page and pages under that (domain.com/services/lawn-mowing.html) or should it be flatter (domain.com/lawn-mowing.html) They offer about 10 different services.
On-Page Optimization | | JohnWeb120 -
Non-linked product short descriptions bad on ecommerce sites?
Hi, I have a question regarding SEO for ecommerce: Do you guys think it could be a bad thing to display non-linked short product descriptions of products on the home page and category pages? Can that cause cannibalism between different pages and non-optimal keyword targeting? I have a shop of which it's homepage tend to rank for some unintended phrases. Thank you, E
On-Page Optimization | | mrlolalot0 -
Best site structure for SEO
Hi, I'm currently in the process of redesigning/rebuilding a well ranking but a dated looking and structured website. Using analytics info I'm trying to put togerther an optimied site map plan for the site based on keywords. Currently the site is structured like this (a few examples) for some of its best ranking keywords / landing pages www.companyname.co.uk/frames/software/companyname-software/keyword/overview.php www.companyname.co.uk/frames/software/companyname-software/keyword/keyword.php I'd like to simplfy this as part of the re build so url's look like this www.companyname.co.uk/companyname-software/softwarecatogry/keyword Obviously I would 201 the old urls. My question is : A. is this a good idea? (From what I've read it is?) B. is there any benifit from having the company name repeated in the url (ie www.companyname.co.uk/companyname-software). My thinking before this is that companyname-software currently ranks well and brings a good amount of traffic. Or should I just go with www.companyname.co.uk/software/softwarecatogry/keyword as opposed to www.companyname.co.uk/companyname-software/softwarecatogry/keyword? Many thanks in advance!
On-Page Optimization | | JamesJacobs0