Pages crawled
-
Hi
I've created a campaign for my own website and added 3 competitor sites. Under the campaign it says that 53 pages have been crawled but my site has less than 10 pages. Are the other pages from my competitor sites?
Thanks
James
-
Hi James,
Did you see the number of pages crawled reduced? Do you have any questions on this issue still?
-
I believe so, it should...
-
I'm going to make the change to my pages. Do you think I will see the number of pages crawled reduce?
Thanks
James
-
Hi James,
www and non-www are already 2 paths, www.example.com/ and www.example.com are another two. You can play with the idea
Also, you can focus more the link juice.
For ex. let's have Fritzy and Googgly, two visitors who would like to link you product page.
Fritzy will link to www.example.com/product/ -> with anchor text "product" (cool, eh'? We wish all of our links would look like this)
Then comes Googgly and links to the same product with the URL http://example.com/product/
Now you will have duplicate content linked separately and you wasted the link juice.
Just add a canonical to example.com/product/ which point the link juice to www.example.com/product/ -> you will transfer aprox 85% of link juice gained on example.com/product/ + it will not be duplicate content.
- another good part of canonicals is that you don't have two pages competing for the same keyword with same content.
I hope I didn't mass up here something
Another thing that you could do is just to 301 non-www to www or vice versa.
Gr., Istvan
-
Hi Istvan
Thanks for the information and the link to the blog article which I have read. I've got no problem adding the canonical link but I don't see why it should improve the situation becuase all my pages are linked using the same parameters. From what I understand from the blog article is that this fixes an issue when the search engines keep coming back to the same page but thinks it is a different page becuase the URL it uses to reach the page is different. Am I understanding this correctly?
Thanks
James
-
Hi James,
So I have just took a quick look at the code. You don't use the canonicals at all.
Maybe you should check the following article by Rand Fishkin http://www.seomoz.org/blog/canonical-url-tag-the-most-important-advancement-in-seo-practices-since-sitemaps
It will help you eliminate dup. content from the site. After you implement the to the site you should have less pages indexed.
Feel free to ask if something was not clear enough.
Cheers,
Istvan
-
-
Hi James,
Are you sure you don't have any duplicate content issue?
For ex.usage of canonicals can save you from having your pages as duplicate content.
example.com and www.example.com are the same, but in the "eyes" of Search Engines, bots, spiders, etc they are different pages with duplicate content.
Maybe you should provide a link to your site, and I will check on it later.
I hope this helps,
Istvan
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Seeing very few pages analysed re: Mobile usability, in Google Seach Console - why?
Hi Mozzers, Under Mobile Usability, in Google Search Console, I am seeing very few website pages getting analysed - 10 out of 40 static pages, on the website in question. Is this to be expected or does this indicated an indexing problem on mobile?
Reporting & Analytics | | McTaggart0 -
Google Web Master Tools show that my site has been crawled, but search results show old title tags, ect.
Does the index report reflect what will be displayed on Google results? Google seems to be indexing my site every Sunday...
Reporting & Analytics | | 928shopper0 -
What about this (google crawl)?
Recently we did a serious effort on SEO with SEO Yoast (Wordpress). And after a few months of tweaking old articles we get this impact on crawl search.. Is this graph normal? s1TQgv9.png
Reporting & Analytics | | noodweerbenelux0 -
2 days in the past week Google has crawled 10x the average pages crawled per day. What does this mean?
For the past 3 months my site www.dlawlesshardware.com has had an average of about 400 pages crawled per day by google. We have just over 6,000 indexed pages. However, twice in the last week, Google crawled an enormous percentage of my site. After averaging 400 pages crawled for the last 3 months, the last 4 days of crawl stats say the following. 2/1 - 4,373 pages crawled 2/2 - 367 pages crawled 2/3 - 4,777 pages crawled 2/4 - 437 pages crawled What is the deal with these enormous spike in pages crawled per day? Of course, there are also corresponding spikes in kilobytes downloaded per day. Essentially, Google averages crawling about 6% of my site a day. But twice in the last week, Google decided to crawl just under 80% of my site. Has this happened to anyone else? Any ideas? I have literally no idea what this means and I haven't found anyone else with the same problem. Only people complaining about massive DROPS in pages crawled per day. Here is a screenshot from Webmaster Tools: http://imgur.com/kpnQ8EP The drop in time spent downloading a page corresponded exactly to an improvement in our CSS. So that probably doesn't need to be considered, although I'm up for any theories from anyone about anything.
Reporting & Analytics | | dellcos0 -
Unexplained Crawl Diagnostic Errors & Opencart
Hi, I've been looking at the crawl diagnostics for my site and trying to fix the errors that are showing up but Seomoz is producing some strange results. It's saying pages are duplicated upto 16 times but those pages dont exist. It's adding "page=3", "page=4" to the end of the product URL but I don't see how it's finding those pages, nothing on the site(as far as I can tell) is linking to them. There is no "page=3", just the one product page. Again on the duplicate content it's saying under the "other URLs" there's URLs like "http:///product-a" but again I don't see where it's finding these URLs and obviously those URL's dont work. Those three slashes aren't a typo either. So far I've reduced the amount of errors from 2,005 to 543 but the rest of them I can't make sense of. Also, what does one do when you have two products, eg: "product-a-white" and "product-a-black" to prevent Seomoz from seeing duplicates? Canonical links wont work because there's no parent item, just those two. Google Webmaster tools doesn't seem to have a problem though. Using Opencart 1.5, if it helps. Cheers,
Reporting & Analytics | | AsOneDesign0 -
Why is the page title sometimes missing in the API results?
Why is the page title sometimes missing in the API results? It exists on the page and in the "keyword difficulty tool", but missing in the API. It is never returned when upa= 1For example:stdClass Object(
Reporting & Analytics | | kirza
[fmrp] => 7.05087881216
[fmrr] => 5.05983022077E-6
[pda] => 91.758307504
[ueid] => 0
[ufq] => www.yellowpages.com/
[uid] => 0
[umrp] => 0
[umrr] => 0
[upa] => 1
[upl] => yellowpages.com/
[us] => 0
[ut] =>
[uu] =>
) {"fmrp":5.679443875178763,"fmrr":2.052551993215746e-07,"pda":70.05750830306422,"ueid":0,"ufq":"education-portal.com/","uid":0,"umrp":0,"umrr":0,"upa":1,"upl":"education-portal.com/","us":0,"ut":"","uu":""}How to get the titles for these pages?0 -
Why Does This Page Rank Badly?
Hi, The page in question is: http://www.toymart.com/details.php?id=1764 The problem is that this and most of the other 10,000 pages used to rank well but now are really struggling.
Reporting & Analytics | | ToyMart3
I am begining to suspect that I have some sort of Google penalty but I cannot know for sure.
I believe I comply with all Google guidelines and I think the SEO is good.
Possibly the eBay affiliate links are the problem but they form a large part of the content and user experience.
The page gives a price guide for items in different conditions and has various other tools for the user. Any thought would be appreciated. Thanks for your time in advance. Alan0 -
For an optimized site, any available stats / guesstimates on what is avg % of traffic to homepage vs. second-level pages?
I'm interested in passing this info on to a client who experienced a period of time when an incorrect GA code was installed on their homepage. They were able to get Google stats on second level pages only. This is a site that gets 80 + % of visits from organic search engine referrals. They do minimal advertising. Thanks in advance.
Reporting & Analytics | | alankoen1230