Should our social network put all of our member profiles in the site map?
-
We're working on some changes to our site and want to add a site map file to give some hints to search engines on our member profiles. Our site has millions of member profiles. I want to ensure that Google indexes them.
Is there a benefit to submitting millions of profiles across multiple site maps?
Is it better to pick a sample of those and submit them? Most member profiles have links to other member profiles.
Is there any benefit to taking a single site map of 50k links and then changing it at some frequency so that all of the member profiles are eventually indexed?
Thanks.
-
This was the approach we were considering. However, what gave me pause was looking at other social networks are doing.
- LinkedIn only has 50k profiles.
- Meez has multiple index files and looks like they are indexing many of their profiles
- Facebook and MySpace don't appear to use Sitemaps (although they do have a crawlable member directory)
- WeeWorld has 500 links
The point is there doesn't seem to be any consistency.
If we end up creating a human readable directory ala Facebook does that achieve the same thing?
-
Totally agree with mike and john.
-
I would definitely do this. Since you have so many profiles, you'll want to have one main sitemaps linking to smaller sitemaps with the profile URLs. One of the sites I work on has several million activities created by users that we put into sitemaps. We automatically generate our sitemaps files frequently and add the new activities created. We include a last modified date for each activity as well so the search bot will know if anything has changed since the last time it's indexed it.
I would create a sitemap system where all of your profiles could be found, and by including the last modified date, you can leave it up to the searchbot as to whether or not a profile has been updated and needs to be re-indexed. There are a couple other properties you could use listed on http://www.sitemaps.org/protocol.php as well.
-
Yes, we have the concept of public / private profiles. Private profiles aren't included in the index.
-
Benefiting or not, make sure users have the ability to turn this off to avoid privacy problems.
It might create a mess though if they link back and forth.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Do Google Know What People Are Doing On My Site?
I run an ecommerce site and am keep to increase the time on site and reduce bounce rate. I have had some good results from writing good articles and advertising them on Outbrain and Twitter; both of these metrics have improved. However, I am wondering if Google will see this. Clearly if people land on the pages from the SERPS and return there they will know what is happening but will they know if people get there from an advert?
On-Page Optimization | | T0BY0 -
Does my site just need a tweak, or should it be rebuilt from the ground up?
My wedding photography website has grown organically over the last 4 years or so.
On-Page Optimization | | chuckstar_za
Each year it's been fiddled with, changed, tweaked, prodded - in short it's been mucked about with a lot.
To the point now where I think it's become a hodge potch of mucky code (theme installed on theme in stalled on theme and numerous plugins) and no real 'structure' to it. At the moment it hovers around #12 for my main area of focus - people looking for a wedding photographer in Essex, England. So 'wedding photographer Essex'. I try to write blog posts regarding venues in Essex where I've photographed weddings. Despite trying to follow best practice, and with weak/low competition, these posts very rarely crack top 10. Last year when I was top 2 for wedding photographer Essex I was victim of a spam link attack. At the time I asked for advice and was told not to worry as Google didn't count these links. Now I'm feeling that along with the bloated website, lack of proper site architecture and other little issues, these links are contributing to restricting my pages from ranking in top 10 spots. Backlinking, while always helpful, doesn't seem to play a major role when trying to rank for venue related searches according to backlink reports on competitors. I'm thinking that it might be an idea to rebuild the site and content from the ground up. This time with a proper site structure in place and conforming to best practice. Obviously this is probably the most extreme course of action. Or does my site just need a little TLC to get it ranking better?
The site in question is:
www.alexkilbeephotography.co.uk Thanks1 -
Site Maps / Robots.txt etc
Hi everyone I have setup a site map using a Wordpress pluggin: http://lockcity.co.uk/site-map/ Can you please tell me if this is sufficient for the search engines? I am trying to understand the difference between this and having a robots.txt - or do I need both? Many thanks, Abi
On-Page Optimization | | LockCity0 -
Working on this site...
and wondering what is wrong in terms of on page SEO (basically just want some feedback on tips/changes to make) http://www.stevenholmesstudio.com/ I'm assuming that the title shouldn't be just the img file name..any suggestions for what it should be?
On-Page Optimization | | callmeed0 -
Is my H1 and H2 site structure proper?
If I have an h1 tag on the page that describes the purpose of the page, is it a bad idea to make all of the sub-headings h2 tags? A designer mentioned that it was frowned upon to make all of the secondary headings into h2 tags, or to use CSS to selectively style the heading tags.
On-Page Optimization | | dbuckles0 -
Numbers above actual site content
Most pages on my website contain many numbers above the actual text on the page. This is useful for users and looks good on an actual view of the page. However, when a bot reads the page it appears as rows of numbers with a few sentences at the bottom of the page. Does having these number have a negative SEO effect? If so, should I change them to something such as an image so they aren't readable by search engines?
On-Page Optimization | | theLotter0 -
Internal link structure for large site
I am working on a very large directory site which is undergoing a complete redesign. I am considering the internal link structure from first principles. When a site has over 100,000 pages, how do you ensure that each page is linked to from somewhere so that there are no orphans? Trying to get my head around the structure makes my brain hurt. Any tips?
On-Page Optimization | | mascotmike0 -
Top navigation bar vs. left side - site archetecture
we do eCommerce on BigCommerce platform, I'm using the top navigation menu for: home about policy faq and other standard informations all my products are list in the left navigation Categories menu. What is your advise about this? Should we have the products at the top? The top menu are web pages, not categories. Also, if you have a better ideas about our site archetecture, you are welcome to comment. domaine is: http://www.furnacefilterscanada.com/ Thank you, BigBlaze
On-Page Optimization | | BigBlaze2050