Should I be running my crawl on our www address or our non-www address?
-
I currently run our crawl on oursitename.com, but am wondering if it should be run on www.oursitename.com instead.
-
It does make sense. Based on what you wrote, ours is not set up correctly. But now I have the language to better work with our provider.
You are very helpful!! Thank you!
-
There's really no way to avoid the existence of the two different addresses, THMCC - they're a byproduct of the way of the way web servers and domain names work. They both exists as soon as a website is created. And visitors tend to use them interchangeably.
They aren't "actually" two different sites, they are just two different addresses that refer to the same pages, causing the search engines to see them as duplicate content. Kind of like how your house's location can be described by the lot number on the city plan, or by the postal address. Same house - different ways of showing where it's located.
If the 301 redirect is done correctly, the search engines will understand that everything should be considered to be at the one primary address and they'll pass along the other version's authority to the primary version automatically. And therefore no second version to compete with.
You can easily tell if the redirect is working properly. Let's assume you decide for example that the www.thmedicalcallcenter.com version is the primary and redirect the non-www version to it. When you type in the non-www address into the browser's address bar and hit enter, you should actually see the URL in the address bar change to the www version of the address.
And yea, you absolutely must have both addresses taken care of. You have no way of controlling whether someone types in the address with or without the www. and you want either one to get forwarded on to the primary address.
Does that all makes sense?
Paul
-
Thanks so much, Paul!!
The SEO Moz helpdesk is who told me that I needed to have oursitename.com in addition to www.oursitename.com. Is this true? Creating oursitename.com and the redirect seems to have caused a lot of errors, mostly duplicates from the redirect probably not being done correctly. But overall, was/is it in our best interest to have both www.oursitename.com and oursitename.com?
-
Thanks again!! One more question if you don't mind. If the 301 redirect is done correctly will this fix the competition issue in all the search engines? If not, should I get rid of oursitename.com?
-
As far as the search engines are concerned, thmedicalcallcenter.com and www.thmedicalcallcenter.com are two separate sites that will compete against each other and dilute each others' authority and ranking unless one is 301-redirected to the other.
As SEO5 indicates, it's best to assess which version already has the most incoming links and use that version as the primary, redirecting the other one to it.
This is best done using a 301 redirect written into your site's .htaccess file. In addition, there is spot in Google Webmaster Tools (GWT or WMT) where you can also hint to Google which version of the site you want to be the primary.
It's not enough to only use the hint in GWT as that only applies to Google, it will do nothing to correct the problem in the other search engines.
Paul
-
I thought they were the same...with a 301 redirect from oursitename to www.oursitename.com so I am confused as to why one would have more inbound links than the other. Also, what is WMT?
Thanks!!!
-
Pick the one that has more inbound links associated with it and already has high pages in the index. Make sure you set the preferences in WMT to either the www. or the non www version.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Crawlers crawl weird long urls
I did a crawl start for the first time and i get many errors, but the weird fact is that the crawler tracks duplicate long, not existing urls. For example (to be clear): there is a page: www.website.com/dogs/dog.html but then it is continuing crawling:
Moz Pro | | r.nijkamp
www.website.com/dogs/dog.html
www.website.com/dogs/dogs/dog.html
www.website.com/dogs/dogs/dogs/dog.html
www.website.com/dogs/dogs/dogs/dogs/dog.html
www.website.com/dogs/dogs/dogs/dogs/dogs/dog.html what can I do about this? Screaming Frog gave me the same issue, so I know it's something with my website0 -
Order of urls in SEOMoz crawl report
Is there any rhyme or reason to the order of urls in the SEOMoz crawl report, or are the urls just listed in random order?
Moz Pro | | LynnMarie0 -
How to resolve Duplicate Content crawl errors for Magento Login Page
I am using the Magento shopping cart, and 99% of my duplicate content errors come from the login page. The URL looks like: http://www.site.com/customer/account/login/referer/aHR0cDovL3d3dy5tbW1zcGVjaW9zYS5jb20vcmV2aWV3L3Byb2R1Y3QvbGlzdC9pZC8xOTYvY2F0ZWdvcnkvNC8jcmV2aWV3LWZvcm0%2C/ Or, the same url but with the long string different from the one above. This link is available at the top of every page in my site, but I have made sure to add "rel=nofollow" as an attribute to the link in every case (it is done easily by modifying the header links template). Is there something else I should be doing? Do I need to try to add canonical to the login page? If so, does anyone know how to do it using XML?
Moz Pro | | kdl01 -
Seomoz crawling filtered pages
Hi, I just checked an seo campaign we started last week, so I opened seomoz to see the crawl diagnostics. Lot's of duplicate content & duplicate titles showing up, but that's because Rogerbot is crawling all of the filtered pages as well. How do I exclude these pages from being crawled? /product/brand-x/3969?order=brand&sortorder=ASC
Moz Pro | | nvs.nim
/product/brand-x/3969?order=popular&sortorder=ASC
/product/brand-x/3969?order=popular&sortorder=DESC&page=10
/product/brand-x/3969?order=popular&sortorder=DESC&page=110 -
Sub-domain not crawled
One of our sites was recently re-designed. The home page is a landing page (www.labadieauto.com) and I moved the blog to this domain (labadieauto.com/blog/) and put a link is the bottom left of the home page. Since the change the SEOMOZ campaign overview is showing only 1 page crawled. This is not setup as a sub-domain so why isn't it showing in the crawl? Help!
Moz Pro | | LabadieAuto0 -
Can I exclude pages from my Crawl Diagnostics?
Right now my crawl diagnostic information is being skewed because it's including the onsite search from my website. Is there a way to remove certain pages like search from the errors and warnings of the crawl diagnostic? My search pages are coming up as: Long URL Title Element Too Long Missing Meta Description Blocked by meta-robots (Which is how I want it) Rel Canonical Here is what the crawl diagnostic thinks my page URL looks like: website.com/search/gutter%25252525252525252525252525252525252525252525252525252525 252525252525252525252525252525252525252525252525252525252525252 525252525252525252525252525252525252525252525252525252525252525 252525252525252525252525252525252525252525252525252525252525252 52525252525252525252525252525252525252525252525252Bcleaning/ Thank you, Jonathan
Moz Pro | | JonathanGoodman0 -
Errors on my Crawl Diagnostics
I have 51 errors on my Crawl Diagnostics tool.46 are 4xx Client Error.Those 4xx errors are links to products (or categories) that we are not selling them any more so there are inactive on the website but Google still have the links. How can I tell Google not to index them?. Can those errors (and warnings) could be harming my rankings (they went down from position 1 to 4 for the most important keywords) thanks,
Moz Pro | | cardif0 -
How long does a crawl take?
A crawl of my site started on the 8th July & is still going on - is there something wrong???
Moz Pro | | Brian_Worger1