In Index but not in Serps
-
Hi,
I have a situation with a client site which is quite frustrating.
Basically, most "recent" (by that I mean for the last couple of months) blog posts are failing to reach the SERPS (actually, one has and a couple have from the early days but it's taken months for them to arrive).
Previously the blog posts were indexed very quickly - often instantly.
Now, I've checked WMT etc and I've submitted each post manually but still nothing. The Sitemap is valid etc.
However, pages (not blog posts) seem to be getting into the serps very quickly.
Another complication is that if I search:
site:www.domainname.com and set the date filter to a month I can see some of the earlier blog posts in that result set.
However, if I scrape a bit of unique content from one of those posts and search - nothing in the SERPS. And my Moz report tells me that the page is not to be found in the top 50 either (so I'm confident these pages are not in the SERPS).
Any ideas why this would happen to just blog posts? Is it something to do with the parent blog landing perhaps being too strong in the rankings?
Any ideas appreciated.
Thanks.
-
Thanks Matt - appreciate the reply.
Robots.txt are fine and I've check with other tools that the individual posts are not being blocked by robots.
WMT checks out fine too though the Crawl Rate is set to : Your site has been assigned special crawl rate settings. You will not be able to change the crawl rate.
Though the craw chart is indicating lots of crawling each day.
I do wonder about that crawl rate setting though. The site is using CloudFlare for speed optimisation and I believe that is a common occurrence when using CloudFlare.
I'll check out Screaming Frog though.....good idea.
Thanks again.
-
Really hard to say without knowing the site. However my first place to look would be at technical issues. Are they crawl-able and indexable?
- Check robots text, metatags etc - are you allowing googlebot to crawl?
- Log in to webmaster tools and see if any URLs are being blocked/unreachable
- Point a crawler, such as Xenu or screaming frog at the home page. WIth all settings set to mimic Google, does it find the posts?
If it passes all of those it should be technically indexable. If that doesn't turn up anything I would start looking at when Google is crawling the site (webmaster tools) and see if that is the problem.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
In my website all the pages are not indexed by google..what to do for the same
In my website http://www.dubins.ae, all the pages are not indexed by google. How to make sure that all the pages are indexed by google?
Content Development | | Muna0 -
I started a Wordpress blog, google indexed it...
How long before I can see those links show up in SEO Moz for my website? What elements is SEO Moz looking for before they add the wordpress site to my linking domains report? Regards, Jeff
Content Development | | biggieshaws0 -
Page hidden in SERPs
As well as unique content, we carry press releases (contracts with PR companies) Some pages don't show up in SERPs - but sometimes a few or even hundreds of other sites do. At the end of the search, google shows this: In order to show you the most relevant results, we have omitted some entries very similar to the 109 already displayed.
Content Development | | loopyal
If you like, you can repeat the search with the omitted results included. When the search is repeated, using that link, the page often shows up in the top 10 or top 20. I believe this is a site problem, not a page problem. We are often one of the first to publish the release.0 -
Blog Posts Not Getting Indexed by SERP's
Our blog posts are typically indexed rather quickly, sometimes within 10 minutes or so. Lately it seems like it is taking much longer, and a post from yesterday afternoon isn't appearing in any of the search engines. Can anyone give me an idea why this may be happening? http://www.360dwellings.com/2011-denver-parade-of-homes-luxury-home-tour/
Content Development | | 360ryan0 -
Our blog is indexed by "google web" but does not show up in "google blogs". Why not and how can I fix this?
We have a pretty simple blog http://www.aviawest.com/blog I've noticed our articles arn't showing up in Google blogs on "web", we've submitted to http://blogsearch.google.com/ping a month ago. Anyone have some insight here?
Content Development | | Aviawest0 -
Why is this store getting hurt in SERPs when they removed duplicate content?
I work with an e-commerce client who got hit hard by Panda. They are very cautious, and want small-scale tests to prove each hypothesis before committing to larger changes. Recently, we reworked content on 30 product detail pages. Before, these product pages featured some original content mixed with some manufacturer content. The change we made was to remove the manufacturer content completely from the product page, leaving about 300 words of high-quality, original content--all of which was written by subject matter experts. I assumed that Google viewed this manufacturer text as duplicate content. However, when these 30 modified pages were compared to the control, they performed significantly worse. Question 1: Does any have any idea why these pages would perform worse than the control?
Content Development | | merch_zzounds
Question 2: Do you have any tips for convincing this client to try another test or get the buy-in to make the larger changes that--in theory--need to happen? FWIW, this client has about 10,000 product detail pages--the vast majority of which contain just manufacturer content. I appreciate your thoughts.0 -
Should I Have No Index, No Follow On Blog Category & Tag Pages?
At some point in the past I read or was told that No Index, No Follow tags on category and tag pages were a good thing on a standard WordPress blog in order to prevent duplicate content issues. Is this still true or was it ever true?
Content Development | | eTundra0 -
Please help me stop google indexing https pages on my wordpress site
I added SSL to my wordpress blog because that was the only way to get a dedicated IP address for my site at my host. Now I am noticing Google has started indexing posts both as http and https. Can some one please help how to force google not to index https as I am sure its like having duplicate content. All help is appreciated. So far I have added this to top of htaccess file: RewriteEngine on Options +FollowSymlinks RewriteCond %{SERVER_PORT} ^443$ RewriteRule ^robots.txt$ robots_ssl.txt And added robots_ssl.txt with following: User-agent: Googlebot Disallow: / User-agent: * Disallow: / But https pages are still being indexed. Please help.
Content Development | | rookie1230