Should our social network put all of our member profiles in the site map?
-
We're working on some changes to our site and want to add a site map file to give some hints to search engines on our member profiles. Our site has millions of member profiles. I want to ensure that Google indexes them.
Is there a benefit to submitting millions of profiles across multiple site maps?
Is it better to pick a sample of those and submit them? Most member profiles have links to other member profiles.
Is there any benefit to taking a single site map of 50k links and then changing it at some frequency so that all of the member profiles are eventually indexed?
Thanks.
-
This was the approach we were considering. However, what gave me pause was looking at other social networks are doing.
- LinkedIn only has 50k profiles.
- Meez has multiple index files and looks like they are indexing many of their profiles
- Facebook and MySpace don't appear to use Sitemaps (although they do have a crawlable member directory)
- WeeWorld has 500 links
The point is there doesn't seem to be any consistency.
If we end up creating a human readable directory ala Facebook does that achieve the same thing?
-
Totally agree with mike and john.
-
I would definitely do this. Since you have so many profiles, you'll want to have one main sitemaps linking to smaller sitemaps with the profile URLs. One of the sites I work on has several million activities created by users that we put into sitemaps. We automatically generate our sitemaps files frequently and add the new activities created. We include a last modified date for each activity as well so the search bot will know if anything has changed since the last time it's indexed it.
I would create a sitemap system where all of your profiles could be found, and by including the last modified date, you can leave it up to the searchbot as to whether or not a profile has been updated and needs to be re-indexed. There are a couple other properties you could use listed on http://www.sitemaps.org/protocol.php as well.
-
Yes, we have the concept of public / private profiles. Private profiles aren't included in the index.
-
Benefiting or not, make sure users have the ability to turn this off to avoid privacy problems.
It might create a mess though if they link back and forth.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
How to check code to text ratio of Mobile Site?
Hello All, How to check code to text ratio of Mobile Site? Thanks!
On-Page Optimization | | adamjack0 -
Robot.txt file issue on wordpress site.
I m facing the issue with robot.txt file on my blog. Two weeks ago i done some development work on my blog. I just added few pages in robot file. Now my complete site seems to be blocked. I have checked and update the file and still having issue. The search result shows that "A description for this result is not available because of this site's robots.txt – learn more." Any suggestion to over come with this issue
On-Page Optimization | | Mustansar0 -
Panda 4.1 - Regained rankings by making changes on my site
So thought I would share this with others as it 'might' help. So I got around 40 pages, all of them have taken a dive in rankings so on average from Pg1/2 to Pg5/6. I took one page and started working on content upgrades, I had around 50 words of boiler plate content above the fold and 750 words of unique content way down the page so maybe 600px below the fold before you hit it. I removed the boiler plate content and produced 75 words of unique content to replace it, I shuffled things around and managed to get the 750 words maybe 250px below the fold then chucked another 100 unique words into the mix. Fetched the page in GWMT's and resubmitted the URL - hour later that page alone, the page I upgraded had recovered its rankings back to the original position before Panda 4.1 hit. Will the rankings for this page drop back down again, not sure but interesting this page was Pg6/7 since the 23rd and doing the above within an hour regained rankings back to Pg2 middle.
On-Page Optimization | | followuk1 -
Is there a guide to best practices for site content and blogs?
We have been working hard producing good content for our sites and now we need to know what are the most current best practices regarding placing and organizing content. We do the usual social media blast with Twitter, FB, G+ with each blog post. But it seems there is more that can and should be done. What about authorship and schema tags?
On-Page Optimization | | devonkrusich0 -
ECommerce Site Breadcrumbs Best Practice
I'm working on an Ecom website and I was wondering - For breadcrumbs - is there an SEO and/or UEx preference when it comes to taking them back to the homepage? I have the option of going CATEGORY > SUB CATEGORY > SUB CATEGORY or HOME > CATEGORY > SUBCATEGORY > SUBCATEGORY Each example is hyperlinked except for the lowest level. Thanks
On-Page Optimization | | Blenny0 -
Add Rel Canonical to all pages on my site (Magento)
Can anyone guide me as to how to add the REL CANONICAL feature to every page on my website (Magento shopping cart) Thanks
On-Page Optimization | | lacx.com0 -
Best practice for franchise sites with duplicated content
I know that duplicated content is a touchy subject but I work with multiple franchise groups and each franchisee wants their own site, however, almost all of the sites use the same content. I want to make sure that Google sees each one of these sites as unique sites and does not penalize them for the following issues. All sites are hosted on the same server therefor the same IP address All sites use generally the same content across their product pages (which are very very important pages) *templated content approved by corporate Almost all sites have the same design (A few of the groups we work with have multiple design options) Any suggestions would be greatly appreciated. Thanks Again Aaron
On-Page Optimization | | Shipyard_Agency0 -
Site wide internal links in footer
What is your take on site wide inernal links in the footer, e.g. for the most competitive keywords? Do you think those links are still useful or are those links of little value from your experience? It is an old school tactic but I still see many sites doing it.
On-Page Optimization | | Florakel0