In Index but not in Serps
-
Hi,
I have a situation with a client site which is quite frustrating.
Basically, most "recent" (by that I mean for the last couple of months) blog posts are failing to reach the SERPS (actually, one has and a couple have from the early days but it's taken months for them to arrive).
Previously the blog posts were indexed very quickly - often instantly.
Now, I've checked WMT etc and I've submitted each post manually but still nothing. The Sitemap is valid etc.
However, pages (not blog posts) seem to be getting into the serps very quickly.
Another complication is that if I search:
site:www.domainname.com and set the date filter to a month I can see some of the earlier blog posts in that result set.
However, if I scrape a bit of unique content from one of those posts and search - nothing in the SERPS. And my Moz report tells me that the page is not to be found in the top 50 either (so I'm confident these pages are not in the SERPS).
Any ideas why this would happen to just blog posts? Is it something to do with the parent blog landing perhaps being too strong in the rankings?
Any ideas appreciated.
Thanks.
-
Thanks Matt - appreciate the reply.
Robots.txt are fine and I've check with other tools that the individual posts are not being blocked by robots.
WMT checks out fine too though the Crawl Rate is set to : Your site has been assigned special crawl rate settings. You will not be able to change the crawl rate.
Though the craw chart is indicating lots of crawling each day.
I do wonder about that crawl rate setting though. The site is using CloudFlare for speed optimisation and I believe that is a common occurrence when using CloudFlare.
I'll check out Screaming Frog though.....good idea.
Thanks again.
-
Really hard to say without knowing the site. However my first place to look would be at technical issues. Are they crawl-able and indexable?
- Check robots text, metatags etc - are you allowing googlebot to crawl?
- Log in to webmaster tools and see if any URLs are being blocked/unreachable
- Point a crawler, such as Xenu or screaming frog at the home page. WIth all settings set to mimic Google, does it find the posts?
If it passes all of those it should be technically indexable. If that doesn't turn up anything I would start looking at when Google is crawling the site (webmaster tools) and see if that is the problem.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Google won't index my website because "certain conditions" weren't met
I found the answer on this -- interestingly, I had changed registrars and they didn't pull over the DNS information correctly. This caused the above issues. Once I identified this, I updated the DNS correctly -- at registrar and server -- and things worked fine.
Content Development | | newbyguy0 -
Loads of Blog Search Results showing up in SERPs - What's the best way to remove?
Our client has a good number of results showing up in SERPs that are search results pages produced by Blog posts. Unfortunately all these results have exactly the same Title tag and it has nothing to do with the blog content which means they are unlikely to help us much. We can’t create a 301 redirect because there is no page to redirect. There is no blog page we can re=canonical to either. The content on these pages is a short list of blog posts by each author. They are not true “Author” pages that would have a URL structure like this: your company.com/author/joeblow Our plan is to use GWMT's URL removal tool to request remove of these pages. (and then try to stop new results from being created) We are doing this to get low-value content out of the SERP. Is there a better way to remove these search results? Any drawback in removing them in GWMTs? Thanks.
Content Development | | RosemaryB1 -
Multiply pages of similair subject not showing up in serps?
Hi, I have a website with a lot of similair subjects. Its a website with around 1000s pages.
Content Development | | vulonl
For example this website is about "cars" so I wrote a pages about: Green classy cars
Green cars for the summer
Green car show 2013 What happens is that on the query of "Green car show". The page green classy cars shows up. I have the feeling that google takes one page about a similair subject and only put on in the serps. I checked this on multiply pages and this seems the case. If I search on exact "Green car show 2013" + MY URL, still then its shows indexed but only position 4. Places 1,2,3 shows again other pages of my website with similair subject. Now my feeling says the other pages have more authority and thats why they show up higher. But then...again now all the content Im adding it isnt showing up.. The last months I added around 300 pages and I did not got one visitor more daily and I have the feeling it is because it are all similair pages and google does not want to show them. My question is: Is their something I can still make them show up? Because they do have all 100% unique content and 100% unique images they only have similair subjects. or Is their some way I can tell Google that his are really different pages, so this would maybe help?0 -
Smaller Index
Hi guys, We are a price comparison website with thousands of webpages. Most of them are product webpages with not so good quality content. Only price information and product image, no product details nor costumers reviews. We are planing to focus on less product categories by adding reviews, details, better images etc... and I would like to know if I should maintain the other "not-so-good" products in other categories or if I should remove it from index to leverage domain average content quality. Our index size is 200k pages and we are planning to focus on 10k pages max. Thanks for your help.
Content Development | | Kuantokusta0 -
I started a Wordpress blog, google indexed it...
How long before I can see those links show up in SEO Moz for my website? What elements is SEO Moz looking for before they add the wordpress site to my linking domains report? Regards, Jeff
Content Development | | biggieshaws0 -
How to make new content Indexed faster by google
I would like to know what can I do. Normally it takes google around 3 days to index my content. I got a site map, swiched the crawling rate to the fastest in my webmaster tools. I also tried crawling my homepage as google bot and sending it to the index with all linked pages but even if I do so my content takes around 3 days if not more to get indexed. I publish around 20 posts a week. My SEOmoz page authority is 48. Some sites of my competition seem to be getting their content indexed in the same day. What else can be done?
Content Development | | sebastiankoch0 -
Our blog is indexed by "google web" but does not show up in "google blogs". Why not and how can I fix this?
We have a pretty simple blog http://www.aviawest.com/blog I've noticed our articles arn't showing up in Google blogs on "web", we've submitted to http://blogsearch.google.com/ping a month ago. Anyone have some insight here?
Content Development | | Aviawest0 -
Index pdf files but redirecto to site
Hi, One of our clients has tons of PDFs (manuals, etc.) and frequently gets good rankings for the direct PDF link. While we're happy about the PDFs attracting users' attention, we'd like to redirect them to the site where the original PDF link is published and avoid that people open the pdf directly. In short, we'd like to index the PDFs, but show to users the pdf link within a site - how should we proceed to do that? Thanks, GM
Content Development | | gmellak0