Number of pages crawled in dropping from 4 to 2
-
The report on our campaign shows that up to 2 pages are being crawled now from 4. However, our site has more pages than this.
We recently inserted code to allow crawlers. what can we do to resolve this? please assist.v
-
Hi there,
Thank you for reaching out! I took a look at the issue, it looks like what went on is that you have a few 302 redirects in place on your site where it formed a series that took Roger to a place where he is having trouble crawling your site. Here's what the interaction looks like:
Initial homepage ---302---> intermediary index page ---302----> final landing index page.
This interaction is not an idea situation with Roger crawling your site, since it has a traditional problem crawling redirects in the first place, this is an issue with the site structure that caused this issue.
In regards to your site having more pages, it looks like to get to those pages, you would have to register or log in, at this time roger does not the ability to fill out forms in a crawl. Unfortunately I am not a web developer, so I don't know the exact way to implement changes on your end to allow our crawler to crawl your site.
Hope that helps, I will keep this thread open to allow others to chime in.
Best,
Peter
SEOmoz Help Team.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
2 Similar Pages
Hello, I have two very similar pages. The first page is an apartment rental page with a map, rental listings and some neighborhood data below. The neighborhood data includes useful info about the area with photos, text about the area, crime rates, avg. rental rates, etc. The second page is a neighbourhood guide that includes virtually the same data as the rental page, but in longer form ie. more photos, more text, etc. I want the rental page to rank, while ranking the neighborhood page is not important as it would be used more for link bait. But since the information on the two pages is the same, I don't want them to compete with each other. I'm thinking of putting a cannonical tag on the neighborhood page pointing back to the rental page. Is that the correct thing to do in this instance? Thanks for your help. J
On-Page Optimization | | torontojon0 -
Duplicate Page Titles
It seems as though we are being flagged for duplicate page titles when really they are slightly different. Is it better to remove the "dart board" or "dart board backboard" from all the product titles? We were doing this for optimal SEO - to rank for the search of "dart board" - but is it really hurting us? for example, our product titles are: Obama dart board backboard, Texas dart board backboard, Oklahoma dart board backboard, etc. Yet they are being flagged as duplicate titles.
On-Page Optimization | | DartsDecor0 -
Should I set paramters to maximize the number of producs on all category pages for a retail website?
We have a retail website with over 20K products and do many things to reduce duplicate content including canonicals & parameters. In setting up parameters in Google Search Console, we have told Google to ignore the option to list more products, so the category pages that are indexed have only the default 12 products on them. I don’t want to create too much duplicate product content by doing this, but if there are only 12 products on a category page, the content is very thin Is it better to have as much product content as possible? My question: Should we set the parameter to follow the default (12 products) or should set it to 200 so there are more products associated with the category page?
On-Page Optimization | | apsltd1 -
Will changing my home page cause rankings to drop?
We are looking at doing a major change with our website. Upper management is wanting to have our home page be our store page, instead of just a landing page. So basically we would be eliminating our current home page, and replacing it with our store page. This is a very large site and our current home page gets a lot of traffic. Issues to deal with will be ranking of the current page content; Internal links to both pages; external links (backlinks) pointing to the two pages, and of course, a potential drop in rankings and traffic. Any ideas on how to best do this? Or not do it at all. 301 redirect? Thanks, Brad
On-Page Optimization | | tdawson090 -
Help with the indexation of my page
Hi all, I have a problem with my website. When writing site:www.pinesapiensa.com there're no pages indexed although the webmaster tools tells me that the sitemap file has been processed in 13 May and the number of indexed paged are 21. ¿What could be happening? I have to mention that there are two domains "www.piensapiensa.es" and "www.piensapiensa.com" addressing the same website and there's a redirection from piensapiensa.com to piensapiensa.com but it doesn't work properly. Thanks
On-Page Optimization | | juanmiguelcr0 -
Home Page Content
Hello. i'm optimizing this website, > home page for one keyword phrase and i was wondering how many words article do i need with that keyword?and if i need it at all? as you can see if i add some content on my home page before the slider, it will ruin the look of the website, What is the right way to do it? Thank you!
On-Page Optimization | | KentR0 -
How much SEO value does a fashion site get from bolting text onto the bottom of home page? Does the value compensate for cluttering up a page focused on an iconic image?
Getting ready to launch a completely redesigned site for a fashion designer. Since it is a fashion site, visitors do not need text to describe what the site is about., We are weighing three options: 1) clean design with no text (just images and navigational links), 2) bolting on a couple of sentences of text at the bottom of the page to signal keyword terms to the search engines, 3) following the lead of the top ranking site in the category and adding lots of text to the bottom of the page. Do the SEO benefits justify cluttering up the design by bolting text onto the bottom of the home page, and if so, how many characters of text seem to be the minimum to be effective?
On-Page Optimization | | RandyP0 -
Old pages
I have a site where I have 5,000 new products each year, I never waned to deleted the old pages due to links pointing to them and keywords. But I now have 20,000 plus pages, does having that many pages spread out my link juice or does it effect me in any other ways over having a site with 5,000 pages or should I keep not deleting old pages so I dont loose any links? Along with that I currently do not link to my old pages from my site so Im guessing google does not get to them very often if at all, if you agree to still keep them should I link to them somewhere? Because the products are not that simiiar and they do bring added value I dont think canonical would work here
On-Page Optimization | | Dirty0