Getting pages indexed by Google
-
Hi SEOMoz,
I relaunched a site back in February of this year (www.uniquip.com) with about 1 million URL's.
Right now I'm seeing that Google is not going past 110k indexed URL's (based on sitemaps).
Do you have any tips on what I can do to make the site more likeable by Google and get more indexed URL's?
All the the part pages can be browsed to by going to: http://www.uniquip.com/product-line-card/suppliers/sw-a/p-1
I've tried to make the content as unique as possible by adding random testimonials and random "related part numbers" see here: http://www.uniquip.com/id/246172/electronic-components/infineon/microcontrollers-mcu/sabc161pilfca
Do I need to wait more time and be more patient with Google? It just seems like I'm only getting a few thousand URL's per day at the most.
Would it help me if I implemented a breadcrumb on all part pages?
Thanks,
-Carlos
-
Carlos
Actually, it is in the index but if you do: site:www.uniquip.com as a search in Google it is not the first result, which it should be. If you do "site:www.uniquip.com" (with the quotes) as a search in Google, it is still only the second result, it should be the first, which is a sign that something is weird, which would require some more investigation.
-Dan
-
Thanks for both tips Dan, I will look into them althought number 2 may be a bit tough.... since there are hundreds of suppliers/categories (bit tough to put in a menu).
as for the page not being indexed I'm showing that it is. http://webcache.googleusercontent.com/search?sourceid=navclient-ff&ie=UTF-8&q=cache%3Ahttp%3A%2F%2Fwww.uniquip.com%2F
is this not the case for you?
-
Thanks for the feedback Brent.
I already my sitemaps setup in groups of 30k with a master sitemap file. http://www.uniquip.com/sm/smindex.xml
I will talk to the developer so we can look into regrouping them and perhaps pickup an indexing pattern.
-
Hi Carlos
It appears there are two major issues with your site not getting indexed.
1. Off-Site - Go to opensiteexplorer and type in your URL. You will see there are many suspicious looking links pointing back to your domain. No matter what you do on-site, if you have really low quality backlinks pointing to your domain (and no good ones to balance things out), nothing you do on-site will help. You'll want to do whatever you can to clean these up (get them removed). You'll also want to work on getting some GOOD backlinks in conjunction with cleaning out the bad ones. There are many resources here on SEOmoz on backlinking strategies.
2. On-site - Your product pages are 4 or more clicks away from the homepage. You really want this to be 3 or less (ideally 1 if possible for some products and categories).
I also noticed that your homepage does not appear to be indexed in Google.
We could go WAY more in depth with this, but in general those seem to be the two major issues.
-Dan
-
Carlos,
There is a great thread you should read about this topic: http://www.seomoz.org/q/can-you-push-too-many-urls-via-sitemaps
As for me, I would recommend creating multiple XML sitemaps where you can track which urls are bing indexed and to also control the submission quantity. You don't want to publish a ton of urls at one time. For the urls that aren't in Google's index, I would no index them for now and slowly submit a small group on a monthly basis, along with different XML sitemaps for tracking.
You have to think as if you were Google, is the content you're submitting valuable and new information? There is no way that 1 million new pages is so valuable or new that isn't already out there. A nice steady submission stream will give you the best results in the long run.
I hope this helps.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Will Google Count Links Loaded from JavaScript Files After the Page Loads
Hi, I have a simple question. If I want to put an image with a link to another site like a banner ad on my page, but do not want it counted by Google. Can I simply load the link and banner using jQuery onload from a separate .js file? The ideal result would be for Google to index a script tag instead of a link.
On-Page Optimization | | CopBlaster.com1 -
Combine poorly ranking pages into a single page?
I'm doing on-page optimizations for an apartment management company, and they have about seven apartments listed on their site. Rather than include everything on the same page - /apartments/apartment-name/ - they have the following setup: /apartments/apartment-name/contact /apartments/apartment-name/features /apartments/apartment-name/availability /apartments/apartment-name/gallery /apartments/apartment-name/neighborhood With very few exceptions, none of these pages appear to rank for anything, and those that do either rank very poorly for seemingly random keywords or for keywords like the apartment complex name (alongside the main landing page for the complex). I'm of the mind to recommend combining the pages into a single one that contains all the info, eliminates the chances for duplicate content (all of the neighborhood pages contain the same content verbatim), and prevents keyword cannibalization. Thoughts? Thanks.
On-Page Optimization | | Alces1 -
Understanding why our new page doesn't rank. Internal link structure to blame? + understand canonical pages more.
Hi guys. Sorry it's an essay...BUT, i think a lot of you will find this an interesting question. This question is in 2 (related) parts, and I imagine it would be an 'advanced' SEO question. Hoping you guys can help bring some real insight 🙂 Always amazed at the quality for this forum/ community. **Context... ** We had a duplicate content issue caused by this page and it's product permutations, so we placed canonical tags on all the product permutations to solve it. Worked a treat. However, we now have more **product ranges. **We now sell Diaries, Notebooks & Music books, which are clearly different from one another. So...we've placed canonical tags on all the product permutations leading back to the 'parent' theme. In other words, all the diary permutations 'lead back' to the diary page. All the notebooks permutations 'lead back' to the main notebook page. So on and so forth. Make sense so far? Context end..... Issue. Amazingly our Diary page outranks our notebook pagefor the search term 'Design your own Notebook'. The notebook page is well optimised for this search term, and the diary page avoids the word 'notebook' altogether (so no keyword cannibalisation going on). Possible reason? Our Diary page has a vast amount of internal links to it throughout our site. The notebook page has only a few. Could this be the issue? If so, what reading/ blogs/ content/ tools would you recommend to help understand and solve this problem? i.e) Better understanding internal link structure for SEO. 2nd part of the question (in the context of internal linking for SEO). When there are internal links to a page with a conical tag does that 'count' towards the 'parent page', or simply towards that specific page? I really hope that makes sense. If it's clear as mud just shout. Isaac. EDIT: All pages in question have been indexed since we added these changes to the site.
On-Page Optimization | | isaac6630 -
301 to Intermediate Page then Rel=Canonical from Intermediate to target page
Hi I'm working on an eCommerce site and don't have direct access to the CMS. I had requested developers to provide me a facilty to 301 via htaccess however this is working slight differently. I need guidance from experts whether it's okay or not: Old Page: example.com/old Target New Page: example.com/new After Implementing the redirect, It redirects to an intermediate page or in other words, The same target URL with a question mark added: example.com/new? (notice the question mark in the new URL) This intermediate page has a canonical tag for the exact target URL. So, if I 301 redirect example.com/old to example.com/new? (Intermediate page) and If the intermediate page example.com/new? has a canonical tag for the exact target URL (example.com/new), Will I be able to pass the link juice and authority of old page to the new page?
On-Page Optimization | | Ankkesh0 -
Does 'XXX' in Domain get filtered by Google
I have a friend that has xxx in there domain and they are a religious based sex/porn addiction company but they don't show up for the queries that they are optimized against. They have a 12+ year old domain, all good health signs in quality links and press from trusted companies. Google sends them adult traffic, mostly 'trolls' and not the users they are looking for. Has anyone experienced domain word filtering and have a work around or solution? I posted in the Google Webmaster help forums and that community seems a little 'high on their horses' and are trying to hard to be cool. I am not too religious and don't necessarily support the views of the website but just trying to help a friend of a friend with a topic that I have never encountered. here is the url: xxxchurch.com Thanks, Brian
On-Page Optimization | | Add3.com0 -
How to improve On-Page Grades for Top Ranking Pages
please help me - i dont know or understand how to improve on-Page Grades for Top Ranking Pages
On-Page Optimization | | pwwukpw0 -
Jquery in top of page vs text on bottom page
Is it the best way to use jquery sliders on the top of your page to still get all your text above the fold and score in search engines? for example: http://www.wolf-howl.com/wp-conte... is much better to score high ranks in search engines than http://www.wolf-howl.com/wp-conte... ?? Thanks!
On-Page Optimization | | HMK-NL0 -
Why would my homepage be ranked lower (Page Rank 2) than my other pages on the site (PR3) ?
Why would my homepage be ranked lower (Page Rank 2) than my other pages on the site (PR3) ?
On-Page Optimization | | dmurtagh0