Can anyone tell me why the bot has only picked up one page?
-
www.namebadgesinternational.co.nz
After the 2nd week, I changed the robots.txt file to allow ALL robots on the website, but it still hasn't gone through any pages after another crawl
Any help would be hugely appreciated.
-
Hi again,
Since there are a lot of directives in this that are specific to certain conditions in your site that we cannot see, you should leave them alone.
Your redirect should appear at the beginning of the .htaccess anyway, so your best course of action is:
- Make a copy of your existing .htaccess file with a different name so that you cannot accidentally lose it by overwriting
- Place your redirect code at the beginning of the .htaccess (remembering that "RewriteEngine On" should appear only once)
- Save and upload your new .htaccess file
- Check in your browser to see if the redirect works (as many known pages as possible)
- If it works, CELEBRATE!
- It it breaks, replace your file with your copy of the original and ask the original developer, or one with access to the detail of your site to sort it out for you.
Incidentally, the rule you have above will redirect from www to non-www...just to be sure that is what you intended.
Hope that helps,
Sha
-
This post by the help desk about why a full crawl isn't being done may also be helpful.
-
Hi designsecrets,
I'm assuming that you are referring to the SEOmoz bot (Roger) and seeing only one page of your site crawled.
If this is correct, then there has been a similar known issue in the past.
You will need to go to SEOmoz Help and ask the Help Team to look at the campaign and sort out the problem for you. Make sure that you provide them with your campaign number and/or domain to make it easy for them to locate the problem.
You can also access the Help area by clicking the Help link at the top right of any page on the site.
Hope that helps,
Sha
-
Hi,
A quick search on Google for site:namebadgesinternational.co.nz shows other pages are being indexed.
I can see a few other issues too, for instance the canonicalization of your domain and homepage, your homepage can be accessed via www, non-www, index.php and though root /
It may be a good idea to log into your Google Webmaster tools account (assuming you have one) and check Diagnostics for crawl errors and similar.
Also our robots blocks /cgi-bin but leaves 404 and login pages open to indexation (i would personally block these as i don't want my visitors landing on them).
Check out http://www.seomoz.org/learn-seo/canonicalization for more info on canonicals.
best of luck...
Aran
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Pages with Duplicate Content
When I crawl my site through moz, it shows lots of Pages with Duplicate Content. The thing is all that pages are pagination pages. How should I solve this issue?
Technical SEO | | 100offdeal0 -
Can slow mobile page speed affect desktop search results?
I heard recently from an SEO friend that with Google's recent update, mobile page speed now affects desktop results. Our site is relatively slow on mobile, and I wanted to check! Thank you!
Technical SEO | | lauraballer1 -
One more redirect question
If there are two URLs like below: example.com/toys/batman-toys
Technical SEO | | IceIcebaby
example.com/birthday/batman-toys Both have the exact same everything, except URL key. The first example ranks for all KWs and search terms in the SEs. Does having the second page hurt my ranking potential for the first page? Should I redirect the 2nd page to the first or just leave it? As always, thanks for your help.0 -
Banned Page
I have been using a 3rd party checker on indexed pages in google. It has shown several banned pages. I type the page in and it comes up. But it is nowhere to be found for me to delete it. It is not in the wordpress pages. It also shows up in the duplicate content section in my campaigns in moz.com. I can find the page to delete it. If it is banned then I do not want to redirect it to the correct page. Any ideas on how to fix this?
Technical SEO | | Roots70 -
Why are the bots still picking up so many links on our page despite us adding nofollow?
We have been working to reduce our on-page links issue. On a particular type of page the problem arose because we automatically link out to relevant content. When we added nofollows to this content it resolved the issue for some but not all and we can't figure out why is was not successful for every one. Can you see any issues? Example of a page where nofollow did not work for... http://www.andor.com/learning-academy/4-5d-microscopy-an-overview-of-andor's-solutions-for-4-5d-microscopy
Technical SEO | | tonykelly0 -
Making one landing page rank higher than another
I have a website which uses an individual landing pages to greet traffic for each suburb in our service area. For a long time we had one landing page which covered a region of suburbs but we've since added individual pages for those suburbs as well. However, Google will always display results for the old regional page, even though the new pages are optimized for searches in that area. Is there anything I can do to get Google to display the pages I want?
Technical SEO | | mark.schad0 -
Can anyone tell me where my site can be improved
My website is www.theradiatorgallery.com I have been trying to get on 1st page for designer radiators. I am currently ranked 21st just dropped to the 3rd page within the past hour, i was 20th before this. There are some sites that i would think i would rank better than due do i have better on page optimization, higher PA, DA and PR based on seo moz reports. Is there something wrong with my site that i am missing? the sites i feel i should rank better than are; radsnrails.co.uk, warmrooms.co.uk and a couple others Any help would be great! Thanks Guys
Technical SEO | | myloseo0 -
Keywords Ranking Dropped from 1st Page to Above 5th Page
Hello, My site URL is http://bit.ly/161NeE and our site was ranked first page for over hundred keywords before March, 30. But all of a sudden, all the keywords on first page dropped to 5th or 6th page. When we search for our site name without ".com", the results appeared on first page are all from other sites. And our page can only be seen on 6th page. We think we have been penalized by Google. But we don't know the exact reason. Can anyone please help? Some extra info on our site: 1. We have been building links by posting blog, articles and PR. All the articles are unique, written by the writers we hire. It has been working fine all the time. We also varied the anchor text a lot. 2. We didn't make any change to the website. But one real problem with our site is that the server is very slow recently and when google crawl our website, many errors were found, mostly 503, 404 errors. And the total number of errors have reach to over 50,000. Do you think this might be a problem for Google not displaying us on first page? Our technicals are working hard to solve server problem. And if it is solved, shall our rankings be back? Please advise. Thanks.
Technical SEO | | Milanoocom0