Can anyone tell me why the bot has only picked up one page?
-
www.namebadgesinternational.co.nz
After the 2nd week, I changed the robots.txt file to allow ALL robots on the website, but it still hasn't gone through any pages after another crawl
Any help would be hugely appreciated.
-
Hi again,
Since there are a lot of directives in this that are specific to certain conditions in your site that we cannot see, you should leave them alone.
Your redirect should appear at the beginning of the .htaccess anyway, so your best course of action is:
- Make a copy of your existing .htaccess file with a different name so that you cannot accidentally lose it by overwriting
- Place your redirect code at the beginning of the .htaccess (remembering that "RewriteEngine On" should appear only once)
- Save and upload your new .htaccess file
- Check in your browser to see if the redirect works (as many known pages as possible)
- If it works, CELEBRATE!
- It it breaks, replace your file with your copy of the original and ask the original developer, or one with access to the detail of your site to sort it out for you.
Incidentally, the rule you have above will redirect from www to non-www...just to be sure that is what you intended.
Hope that helps,
Sha
-
This post by the help desk about why a full crawl isn't being done may also be helpful.
-
Hi designsecrets,
I'm assuming that you are referring to the SEOmoz bot (Roger) and seeing only one page of your site crawled.
If this is correct, then there has been a similar known issue in the past.
You will need to go to SEOmoz Help and ask the Help Team to look at the campaign and sort out the problem for you. Make sure that you provide them with your campaign number and/or domain to make it easy for them to locate the problem.
You can also access the Help area by clicking the Help link at the top right of any page on the site.
Hope that helps,
Sha
-
Hi,
A quick search on Google for site:namebadgesinternational.co.nz shows other pages are being indexed.
I can see a few other issues too, for instance the canonicalization of your domain and homepage, your homepage can be accessed via www, non-www, index.php and though root /
It may be a good idea to log into your Google Webmaster tools account (assuming you have one) and check Diagnostics for crawl errors and similar.
Also our robots blocks /cgi-bin but leaves 404 and login pages open to indexation (i would personally block these as i don't want my visitors landing on them).
Check out http://www.seomoz.org/learn-seo/canonicalization for more info on canonicals.
best of luck...
Aran
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
I am trying to generate GEO meta tag for my website where on one page there are multiple locations My question is, Can I add GEO tagging for every address?
Am I restricted to 1 geo tag per page or can i add multiple geo tags ?
Technical SEO | | lina_digital0 -
Getting high priority issue for our xxx.com and xxx.com/home as duplicate pages and duplicate page titles can't seem to find anything that needs to be corrected, what might I be missing?
I am getting high priority issue for our xxx.com and xxx.com/home as reporting both duplicate pages and duplicate page titles on crawl results, I can't seem to find anything that needs to be corrected, what am I be missing? Has anyone else had a similar issue, how was it corrected?
Technical SEO | | tgwebmaster0 -
Can iFrames count as duplicate content on either page?
Hi All Basically what we are wanting to do is insert an iframe with some text on onto a lot of different pages on one website. Does google crawl the content that is in an iFrame? Thanks
Technical SEO | | cttgroup0 -
Off-page SEO and on-page SEO improvements
I would like to know what off-page SEO and on-page SEO improvements can be made to one of our client websites http://www.nd-center.com Best regards,
Technical SEO | | fkdpl2420 -
Can I optimize two different pages with very similar keywords without hurting SEO?
Hi there, I have often heard that you cannot have multiple pages rank for the same keyword. My question here is more about long tail keywords who have the same keyword phrase repeated on different pages. For Example: I have two webpages with different content. I want to have one page (Homepage) rank for the more generic term such as "innovation management" and another supporting page rank for "innovation management software". Will Google see these two different webpages as competing? Should I avoid repeating the more general term in the phrase? Has anyone ever seen your SEO results decline when doing this? I don't believe this is duplicate content since the pages hold completely different copy and assets but I am not sure if the repeating phrase in the title tags will flag anything to the search engines.
Technical SEO | | Scratch_MM0 -
I am trying to correct error report of duplicate page content. However I am unable to find in over 100 blogs the page which contains similar content to the page SEOmoz reported as having similar content is my only option to just dlete the blog page?
I am trying to correct duplicate content. However SEOmoz only reports and shows the page of duplicate content. I have 5 years worth of blogs and cannot find the duplicate page. Is my only option to just delete the page to improve my rankings. Brooke
Technical SEO | | wianno1680 -
Page Over-optimized?
I read over this post on the blog tonight: http://www.seomoz.org/blog/lessons-learned-by-an-over-optimizer-14730 & it's got me concerned that I might be having a similar issue on our site? Back in March & April of last year, we ranked fairly well for a number of long tail keywords, here is one in particular 'Mio Drink' for this page: http://www.discountqueens.com/free-mio-drink-from-kraft-facebook-offer The page is still indexed, but appears back on page #3 for the search term. During this time we had made a number of different updates to our site & I can't seem to put an exact finger on what might have caused the problem? Can anyone see any issues that might have caused this to drop? Thanks, BJ
Technical SEO | | seointern0 -
Has anyone used Micrositez? Or can recommend them?
Hi all, After using SEOmoz for a while (and I have learnt alot - it's a fantastic resource) I think it's about time our website is given the nudge by a professional, who unlike me isn't learning the ropes and trying to compete with the big boys! So easy question, has anyone used/can vouch for http://www.micrositezdigital.co.uk/ I've been in contact with them alot recently and spent hours on the phone. 1 side of me is impressed, the other is scared to death of the monthly price. Any help would be appreciated with this, It would nice to know how good they are especially in regards to their bespoke campaigns. Thanks, Allan
Technical SEO | | allan-chris0