Website Crawl problems
-
I have a feeling that Google doesn't crawl my website.
E.g. this blogpost - I copy a sentence from it and paste it to Google. The page that shows up in search results is www.silvamethodlife.com/page/9/ - which is just a blog page with all the articles listed, not the link to the article itself!
Did anyone ever have this problem? It's definitely some technical issue.
Any advice will be deeply appreciated
Thanks
-
When i use the same tactic as you defined in your question’s explanation i was able to see your page in the search results...
Use this common in search bar to see how many pages are indexed in Google ‘site:example.com’.
May be not all the pages are indexed, for that try and check the following two things:
- Make sure all pages of the website are follow,index for Google and other search engines
- Update your sitemap and submit it to Google webmaster tool and you will see the efficiency in website page index.
Hope this helps!
-
I noticed that your category pages specify noindex,follow and index,follow. Might want to make a decision there.
Google has indexed 676 pages of the 817 on your site and, since their are quite a few URLs that specify nofollow correctly without the additional index like mentioned above, I'd say that is about right.
Did not see the issue you spoke of when I checked some random sentences.
Wouldn't be concerned unless you notice this is coupled with a decrease in organic traffic. If so start looking at off page factors.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Bing seriously hitting our website
Hi I have a strange query, Bing in the last four weeks have been seriously crawling our site, and while at the moment this isn't affecting our servers, coming into the busy time of the year I am just wondering if anyone else is seeing this. They are basically crawling the entire site (including nofollow pages) even though according to Bing Webmaster tools, they know our sitemap. Is anybody else seeing any unusual activity with the Bing bot. Thanks Andy
Intermediate & Advanced SEO | | Andy-Halliday0 -
60 countries, 1 website. How to develop this?
I've been asked to rank the website of an international association under the same keywords but in multiple languages (they rank very highly for English speaking countries), however they only have the one website with 1 .com domain. Question: Is the better approach to translate the site in multiple languages and then allow people to select the language they desire? OR Buy ccTLD and run the site multiple times in different languages as separate entities?
Intermediate & Advanced SEO | | MassivePrime0 -
4 websites with same content?
I have 4 websites (1 Main, 3 duplicate) with same content. Now I want to change the content for duplicate websites and main website will remain the same content. Is there any problem with my thinking?
Intermediate & Advanced SEO | | marknorman0 -
Need Reviews on my new website
Hi, I recently developed this website: http://goo.gl/fl5a5 And started link building to that website and getting some very good links so far. So far ok, but i would request some experienced guys here to post some reviews and help me with your suggestions so that i can rank better. Its been a month since i started link building to this site. . PS: I have cloned my competitors site with unique content. Will this becomes an issue? You can check my competitors site by Google'in my site entire title. Please let me know your thoughts on this.
Intermediate & Advanced SEO | | Vegit0 -
Merging two websites to one...
Hi all. Could do with a second opinion on this please... At present a client of ours owns two shops (both doing the same but in towns about 20 miles apart - they sell flooring, but using different names) and has a website for each. The plan is to rebrand both of these stores the same and merge both websites into one. The problem comes that both of the individual websites rank very well in their respective Google Local search results and I fear that killing one of the sites will mean that one store will vanish from the local listings. One domain is a DA 45 and the other a DA 11 so the plan is to use the stronger of the two domains. The question I would like to ponder with people wiser than myself is how can we ensure that the new single domain ranks for both locations in the local? Would the easiest solution be to have pages such as domain.com/store1 and domain.com/store2 with full listings for that store inc name, address, phone number, customer reviews etc? At present the DA 45 domain ranks very well in it's Google local so we need to find a way to change the homepage of that to have both the stores phone numbers but without affecting the local listing. I was considering adding the second phone number as a text based image so that it's visible for people but not for bots Finally, would 301 redirecting the now unused store to domain.com/store2 help with ensuring that we do not lose any local listing for that keyword? If not, are there any suggestions people could offer up Many thanks for any help and sorry for the very long question Carl
Intermediate & Advanced SEO | | GrumpyCarl0 -
Unable to Crawl my Website
Hi all, I have a website that I am trying to promote, but tried to add it here in SEOMoz and got the following message: We have detected that the root domain evolving-networks.co.uk does not respond to web requests. Using this domain, we will be unable to crawl your site or present accurate SERP information. Does anyone know why this website cannot be crawled? Please help. Thank you in advance!
Intermediate & Advanced SEO | | LSDigital0 -
Content Marketing: Should we build a separate website or built in site within the Website itself?
Hi Mozzers, Client: Big carpet cleaner player in the carpet cleaning industry Main Goal: Creating good content to Get more organic traffic to our main site Structure of the extra content: It will act like a blog but will be differentiated from the regular site by not selling anything but just creating good content. The look and design will be different from the client's site. SEO question: In terms of SEO, what would be the most beneficial for us to do, should we built in this new section/site outside or inside the client's site? I personally think that it should be separated from the main site because of the main reasons: A followed link to the main site Anchor texts implementation linking back to our service pages If we would to choose to build in this content, it would be highly beneficial for getting organic traffic within the main site but I am afraid this will not provide us any link juice since anchor texts won't be accounted the same since all of those would be located in the Nav bar of the main site. Can someone tell me what would be the best in terms of SEO? P.S: My boss doesn't agree with me and would rather go the second option (build in within the main site) that's why i am asking you guys what would be the most beneficial? Thank you Guys
Intermediate & Advanced SEO | | Ideas-Money-Art0 -
How the hell do you find good PR websites?
Hi Guys Can someone please help! How do you find high relevant PR sites that can be easiliy located using the SEO MOZ tools? How can I best use the SEO MOZ tools to locate good websites that will help me with linking building? Are the SEO MOZ tools any good?? Please can you help guys..?? Thanks Gareth
Intermediate & Advanced SEO | | GAZ090
