Number of pages crawled in dropping from 4 to 2
-
The report on our campaign shows that up to 2 pages are being crawled now from 4. However, our site has more pages than this.
We recently inserted code to allow crawlers. what can we do to resolve this? please assist.v
-
Hi there,
Thank you for reaching out! I took a look at the issue, it looks like what went on is that you have a few 302 redirects in place on your site where it formed a series that took Roger to a place where he is having trouble crawling your site. Here's what the interaction looks like:
Initial homepage ---302---> intermediary index page ---302----> final landing index page.
This interaction is not an idea situation with Roger crawling your site, since it has a traditional problem crawling redirects in the first place, this is an issue with the site structure that caused this issue.
In regards to your site having more pages, it looks like to get to those pages, you would have to register or log in, at this time roger does not the ability to fill out forms in a crawl. Unfortunately I am not a web developer, so I don't know the exact way to implement changes on your end to allow our crawler to crawl your site.
Hope that helps, I will keep this thread open to allow others to chime in.
Best,
Peter
SEOmoz Help Team.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Several Links in Some Pages
Dear all, Our main site is a bussiness directory, and following some SEO advices, we are creating landing pages for each category, in order to optimize them for the keywords. Those landing pages have links to the listings related to them. Using the same idea, we have created pages related to the regions, and those pages include links to the listings located in them. The only problem that I see with that, is the number of links that some categories or regions could have. Is there a limit of recomended number of links per page, from a SEO perspective? We also have a main category page, that includes a list of all categories, and this page could also have a relatively high number of links. The pages have around 300 to 500 words, some include also images, some include videos. Many thanks for your help, Daniel
On-Page Optimization | | te_c0 -
Canonical to the page itself?
Hello, I'd like to know what happens when you use canonical to the same page itself, like: Page "example.com" rel canonical="example.com" Does that impact in something? Bad or good? See ya!
On-Page Optimization | | seomasterbrasil1 -
Does Too Many On-Page Links on a Page Really Matters?
Does Too Many On-Page Links on a Page Really Matters? Especially if they are pointing to internal page?
On-Page Optimization | | AppleCapitalGroup1 -
My site has been dropping, not sure why!
My site has been dropping in the rankings, not sure - my metrics seem better than my competitors. Historically I have been a very stable #2 for my main term, but now it's down to 7! According to SEO Moz, my domain authority is 32, while my better performing competitors are are 26, 11, and 1! Have more links than they do. Trying to think it through, not sure what is happening. My home page bounces at a low 20%-ish, other Google Analytics are good. I have a company Facebook account, occasionally upload YouTube vids, do online press releases, etc. I do have to target several metros scattered across the state, while my competitors usually focus on one major metro. I do have some SEO Moz errors, which focus on dup content due to our web editor's naming system. An example would be domain.com/keyword-keyword-i-14 vs. domain/differnet keyword-different better keyword-i-14. 14 would be the actual page number. Our system lets me change the page title keywords, as I've added new links and pages over the years there are some dupes. The only major change is I've added a password protected section for sales rep materials. The hosting/web guru firm we use has assured me Google doesn't see pages behind the password portection. Not sure if Google is testing a new SERP formula. All social media or non-website results seem to have dropped out of search for my terms. Just local business sites like mine and some directory sites remain. Any advice or private consult would be greatly appreciated as I am a ... self taught 'OneManBand' for high tech marketing in our company. Thanks
On-Page Optimization | | OneManBand0 -
How to deal with tracking numbers in URLs
I am working on a site at the minute that has links like this: Jobs in London URL looks like: domain.com/jobs-in-london/ However, my developers insist that they need to use tracking codes, so everytime someone clicks on the above link, they are redirected (301) to a new URL that looks like: domain.com/search/1234567(unique search id) This is killing me when I am trying to get internal pages, like /jobs-in-london/ ranked. What to do?
On-Page Optimization | | MirandaP0 -
Should H1s be used in the logo? If they are and it is dynamic on each page to relate to the page content, is this detrimental to the site rather than having it in the page content?
On some sites, the H1 is contained within the logo and remains consistent throughout the site (i.e. the company name is in the of the logo). If the h1 in a logo is dynamic for each page (i.e. on the homepage it is company name - homepage) is this better or worse to have it changed out on the logo rather than having it in the page content?
On-Page Optimization | | CabbageTree0 -
Why some pages are not indexed?
I have a furniture´s ecommerce. When searching for "site: movstore.com.br" returned 1080 results, but if I search for "site: movstore.com.br / Product" returned 1020 results. I mean, that 1080 indexed pages, 1020 are products pages and the other 60 pages are irrelevant. Where are the category pages? "site: movstore.com.br / Categories" - 0 results
On-Page Optimization | | maisempresas
"site: movstore.com.br / Departments" - 0 results
"site: movstore.com.br / Marks" - 0 results What might be happening?0 -
Redirect and page ranking
We used to have a good page rank of Google, but now our page rank dropped to zero. A few months ago we did a redirect from our www.???.com to non-www.???.com, because non-www.???.com is now our main website. We also have a number of other domains which we redirect to our main website non-www.???.com Do you think these redirects are causing the problem, and if so what can we do to fix it? Thanks!
On-Page Optimization | | poupette0