What is the best way to generate an automatic sitemap for google, bing and yahoo?
-
Hi guys,
So far I recieved a Sitemap that was generated by an seo company to use and submit to google, for our co.nz domain, I have been told to submit this also to bing and yahoo. Can anyone tell me if I can submit the same sitemap for the com.au and com or would i need to generate a new sitemap for each domain?
I have been told, everytime we change content we have to keep submitting, is there a way to do this autmatically as we will be writting alot of content daily.
Any recommendations or suggestions?
-
With Screaming Frog you would need to crawl, generate, and submit the sitemap (or upload it to your server) whenever it changes (you add/remove a page).
-
Thanks Ray, I could chat to my developer about generating a automated one as that would help out alot. With the screaming frog, would I just need to do it once? and submit this to google and bing only once?
-
Hi Alec,
It looks like your website is a custom built website, correct? No CMS like WordPress or similar. In this instance, you would want your developers to create an XML sitemap that auto-includes the new pages created for your site. If this is not possible, then you need to update the sitemap with the new pages as you create them.
Once you submit the sitemap link to Google / Bing they remember the URL to your sitemap and crawl the sitemap at their leisure (more popular sites get their sitemap crawled more frequently). So, once you submit a sitemap, as long as the URL remains the same, the bots will auto-crawl your sitemap for updates.
If you cannot have a sitemap autogenerated and do not want to always manually add the links (or do not know how to maintain an XML feed) then I suggest using Screaming Frog SEO Spider's sitemap feature. The tool will crawl your website and you can generate a sitemap for your site. Then, you can submit that sitemap as it changes to the proper search engines.
Since your websites are setup as unique domains, you would need to submit a sitemap with the unique URLs for each domain. Your other question about your 3 web properties raises some concerns, which I will try to address there.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Multistore Sitemap
I use Magento 2 Multistore and have 2 stores set up with identical products, one for the EU and one for the US. The best practice is to allow Google to crawl both sites, but what about the sitemap? Should I only include one store? The reason I ask is that Google has recently started ignoring canonicalized URLs, so even though the second store is canonicalized, it could affect my rank. My rank did drop with the last update when this was rolled out, I stopped some canonicalized URLs from generating and my rank went back up (albeit not as high as before).
International SEO | | moon-boots0 -
International SEO Two Subdomains Showing Up in Google Search Results
Hi I have a client that is having two subdomains showing up SERP when you Google their name. Here are the details. They have two subdomains us.companyname.com and en.companyname.com us.companyname.com is for the US and has completely different products and content than en.companyname.com en.companyname.com is the site designed for Europe and it is in English. How can I make it so that only the us. version shows up in the search results? Thanks in advance!
International SEO | | JohnWeb120 -
Google Analytics & Webmaster Tools Filtering
I've just set up a client who uses internationalization on Google Webmaster tools and Google Analytics. For easier management they opted to use subfolders rather than subdomains or cctlds. So I set up a Google Analytic Property, with one Unfiltered profile, and another 3 profiles filtered per language. With the main language English being exclude anything starting /fr/ /de/ as it resides on root. The filters seem to work fine; however after linking this to the Google Webmaster Account to be able to access Search Engine Optimization I do not seem to get any language filtered data. I was wondering if someone had any idea or possible solution to this problem. As I would expect to at least have the Landing Pages if not exactly the keywords filtered by the same criteria that the rest of the data is being filtered. I know there's also an option to create a separate webmaster tools account, however this way I still cannot filter just the English; and I cannot link it to all the separate profiles.
International SEO | | jonmifsud0 -
Blocking domestic Google's in Robots.txt
Hey, I want to block Google.co.uk from crawling a site but want Google.de to crawl it. I know how to configure the Robots.txt to block Google and other engines - is there a fix to block certain domestic crawlers? any ideas? Thanks B
International SEO | | Bush_JSM0 -
What is the best way to rank well on both Google.co.uk & Google.com?
I am working on a website that is primarily a UK based software company but is now expanding into the US. The website is a .com site and is not geo-targeted to any specific location. Currently the site ranks well on Google.co.uk for a number of the focus keywords. We are now targeting Google.com as well to increase visibility in the USA. The site is ranking number 1 for one of the focus terms on Google.co.uk but no where to be seen on Google.com but on another term the site ranks 3rd in both Google.co.uk and .com. There are a number of other terms that rank on the first page in Google.co.uk and on the 3rd or 4th page in Google.com. The server is located in Germany and I do not want to geotarget the site to the US as I am concerned this would have a negative impact on the .co.uk ranking. The site currently has a mix of .com and .co.uk links pointing back to the site, in actual fact possibly more links actually come from US sites already. My original plan was to just focus on building links back to the target pages from US sites rather than creating a US folder on the site and geotargeting that section of the site in WMT and having to build page authority for a completely new page with no existing backlinks. But now that I have a number 1 ranking on .co.uk and the same term not ranking at all in .com as well as a postion 3 ranking for a term in both .co.uk and .com I am slightly confused as to the best options. Any help, advice, opinions would be greatly appreciated.
International SEO | | PaulSimms0 -
How long does it take for google to realize there is a new language sub domain?
I have a global client who just launched new sub domains of their site in new languages (Spanish, Portuguese, Russian and Japanese). Example: es.client.com pt.client.com ru.amdocs.com ja.amdocs.com How long does it take for Google to recognize these new subdomains? Would submitting an XML sitemap be helpful? If so how long can we see them pick up the site? What is the best way to check that your new subdomains are showing in each countries SERPs? Thanks for your help!
International SEO | | Scratch_MM0 -
How to replace my .co.uk site with my .com site in the US Google results
My customer and I are based in the UK. My customer's site, www.blindbolt.co.uk has been around for years. Last year we launched their American site, www.blindboltusa.com. Searching on google.com (tested both via proxy and using the gl=us querystring trick), a search for blind bolt on the US Google returns our www.blindbolt.co.uk site. We would like it to show our www.blindboltusa.com website in US searches. Webmaster tools has the Geographic Target set correctly for each site. Does anyone have any ideas or suggestions please? Thanks.
International SEO | | OffSightIT0 -
Does publishing your physical company address increase your Google Trust?
The question is in the title: Does publishing your physical company address increase your Google Trust? I.e. on the contact page of the website, providing a physical address. The address would match the WHOIS entry for the domain, and allow customers to contact you via post.
International SEO | | Peter2640