Site Maps
-
I have provided a site maps for google but although it craws my site www.irishnews.com at 6:45AM the details in the site map are not seen on google for a few days - any ideas how to get this feature working better would be great.
example
<url><loc>http://www.irishnews.com/news.aspx?storyId=1126126</loc>
<priority>1</priority>
<lastmod>2012-01-23</lastmod>
<changefreq>never</changefreq></url>thanks
-
Hi Liam,
There is always a natural delay between crawling and indexing, and it's rarely instantaneous. Although I can see why you'd want a news site to be getting indexed pretty quickly.
The one thing that stands out is from the example is the <changefreq>tag, which you've got set on 'never'. This is essentially for archived pages, and tells crawlers that it's low importance (even though you've given it high priority). Even if you're not intending to change the article, I'd still recommend giving it a change frequency of 1 month so you're inviting the crawlers to come and check it more often. Saying that, this doesn't mean that if you set the frequency to hourly that the crawlers would come back every hour, as they'd soon figure out that nothings changing.</changefreq>
Really I'd have your home and catergory pages on daily, the articles on monthly, and the static pages on monthly or yearly.
In terms of getting them indexed quicker after the crawl, this is just a case of establishing trust and importance from the search engines. They need to know that you have news content that requires a quicker indexed. You can gain this trust by providing regular, high quality pages. When their crawlers pick up that there are new pages going live daily you will see the index get quicker.
Depending what CMS you are using, it is also worth getting a script or plugin that pings the search engines with an updated site map every time a new page or post is added. I've done this through Wordpress and articles get indexed within 4 hours. Again though, it didn't start this way and it only got this quick once I was putting up 4 posts a week like clockwork.
Good luck.
Cheers
David
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Somebody took an article from my site and posted it on there own site but gave it credit back to my site is this duplicate content?
Hey guys, This question may sound a bit drunk, but someone copied our article and re-posted it on their site the exact article, however the article was credited to our site and the original author of the article had approved the other site could do this. We created the article first though, Will this still be regarded as duplicate content? The owner of the other site has told us it wasn't because they credited it. Any advice would be awesome Thanks
White Hat / Black Hat SEO | | edward-may0 -
Site review
Can any one give me a quick site review, recently started work for the company on the seo, just want to asking if I am missing anything that may hinder SEO and SERPs etc www.teamac.co.uk
White Hat / Black Hat SEO | | TeamacPaints0 -
Why is this site not being punished!?
I guess this is the usual reaction to a seeing a domain rank above your own website is "They must be cheating"! However... in this case I feel more than justified. The website is aircon247.com they rank top 3 in the UK for "air conditioning" and other quite generic terms in the industry. I'm interested to know your thoughts and what (if any) action should be taken. Here are many of the links that I think contravene the Google Guidelines : Spammy Article Submissions with Inorganic Anchor Text: http://www.furniturearcade.com/decorative-furniture/decorative-accessories-lamps/ http://www.sys-con.com/node/2308271 http://www.bucksherald.co.uk/imagine-a-world-without-air-conditioning-units-7-112555 http://www.retail-digital.com/press_releases/appliances/diy-air-conditioning-installation-options http://www.livingwithwhite.com/three-fun-uses-for-antique-grates-and-floor-registers/ http://www.mcrjk2008.com/2009/04/best-air-conditioning-ever.html http://www.marketwire.com/press-release/comfort-your-business-needs-1682737.htm http://www.marketwire.com/press-release/diy-air-conditioning-installation-options-1677015.htm http://www.housetohome.co.uk/topical-advice/531054/regulating-your-home-environment http://homeklondike.com/2011/01/10/country-style-bedroom-design-ideas/ http://professorshouse.com/Building-a-house/Plumbing-Heating/Articles/Energy-Efficient-Air-Conditioners/ http://www.greenscenedebate.com/2009/04/take-good-luck-at-air-conditioning.html#.URzEmh17L5w http://www.harlynn.com/2009/04/wanna-chill-out.html http://www.loveshaven.com/2009/04/we-are-all-so-excited-for-my-sisters.html http://asiwaspassing.com/2009/05/ Spammy Links in External Website Footers / Side Bars with Inorganic Anchor Text: http://www.w-int.com/ http://www.g-dir.com/home/gardening/ http://www.s-dir.com/ http://www.sefdir.org/popular-listings.html http://www.ribcast.com/ http://rapidcoolsite.com/Home.html http://www.index-guide.org/ http://e-dir.org/ http://www.singaporerealestate.info/blog/?s=%27the+solitaire+call%27 http://www.onlinepureherbs.com/acidity.htm http://erostours.com/cheap-flights-Chicago.html http://www.search-way.com/ http://koolergazi.persianblog.ir/ Blog Spam Inorganic Anchor Text: http://edcel.net/2009/05/ http://www.bluehatseo.com/quick-answers-1-link-building/ Spammy (Link exchange etc.) Directories: http://ireland.accommodationforstudents.com/info/reciprocal_links_ad.asp http://baliscript.net/barter-links.php http://www.abacushosting.ca/linx.php http://www.whelphelper.com/links.php http://www.spectramedi.com/links_shopping.htm https://www.midwayautosupply.com/linkexchange.aspx? http://artsellart.com/links.html http://www.linkalizer.com/directory/39-1/ http://dogdir.com/region/NA.php http://www.easyezinearticles.com/ezineresources/Outsourcing.htm http://www.patchhomeinspections.com/Links.html http://autoharpusa.com/index.html?p=10 http://www.baliscript.net/webdesign-links.php
White Hat / Black Hat SEO | | trickshotric0 -
Build Backlinks on this site? - Advice Please
Hello, I am trying to build some backlinks to my E-Commerce site and was wondering how you all view sites like this: http://www.bookmark4you.com/ If I were to put a listing for my company/site on that site, would that be considered a good backlink or a bad backlink (in terms of Google's guidelines)... There are a bunch of sites like these, online directory or bookmark sites, and i was wondering what the general opinion is on using them for backlinking purposes. Any help or advice would be greatly appreciated. THANKS!!
White Hat / Black Hat SEO | | Prime850 -
Big Rank Drop - Is My Site Spammy?
Like many others one of our niche sites - aluminumeyewear.com got slammed in the recent algo updates (4/18). All of our pages dropped at least 40/50 places which seems like a penalty to me. The site still ranks for its name thankfully. I'm trying to figure out if this is an over-optimization penalty, or a devaluing of back links or both. I would be grateful if I could get some feedback as to whether you feel the site is over optimized and how I could check if sources of back links have been penalized which in turn has effected us? Thanks in advance!
White Hat / Black Hat SEO | | smckenzie750 -
Are there tools out there to determine when a link linked to your site? I want to know when a link farm was done a site.
In Webmaster Tools I discovered that a client of mine with signed up for or hired another company to get links. The links are poor quality and from other countries, so it looks like a link farm was done. I want to know when they links were linked to the site, and not sure how to find that information out. Does anyone know how to find this out?
White Hat / Black Hat SEO | | StrategicEdgePartners0 -
Competitors have local "mirror" sites
I have noticed that some of my competitors have set up "mirror" homepages set up for different counties, towns, or suburbs. In one case the mirror homepages are virtually identical escept for the title and in the other case about half of the content id duplicate and the other half is different. both of these competors have excellent rankings and traffic. I am surprised about these results, does anyone care to comment about it and is this a grey hat technique that is likely to be penalized eventually. thx Diogenes
White Hat / Black Hat SEO | | diogenes0 -
Beaten in SERP's by a site going 'all in' on 2 keywords in their anchor text profile.
I would like to get peoples thoughts on putting 80% of your anchor text links in just 2 keywords vs a nice spread of branded and longtail keywords.. like I am. recently fell off the first page for a key SERP.. and the site in P10 has gone nuts on just that two keyword's.. I know we have a good site onpage/ conversion / low bounce rate page views etc.. Pretty sure we get more traffic than them. Seems that this obvious bloated anchor text profiling has worked for them though.. What do you guys think/know?
White Hat / Black Hat SEO | | robertrRSwalters0