Site Maps
-
I have provided a site maps for google but although it craws my site www.irishnews.com at 6:45AM the details in the site map are not seen on google for a few days - any ideas how to get this feature working better would be great.
example
<url><loc>http://www.irishnews.com/news.aspx?storyId=1126126</loc>
<priority>1</priority>
<lastmod>2012-01-23</lastmod>
<changefreq>never</changefreq></url>thanks
-
Hi Liam,
There is always a natural delay between crawling and indexing, and it's rarely instantaneous. Although I can see why you'd want a news site to be getting indexed pretty quickly.
The one thing that stands out is from the example is the <changefreq>tag, which you've got set on 'never'. This is essentially for archived pages, and tells crawlers that it's low importance (even though you've given it high priority). Even if you're not intending to change the article, I'd still recommend giving it a change frequency of 1 month so you're inviting the crawlers to come and check it more often. Saying that, this doesn't mean that if you set the frequency to hourly that the crawlers would come back every hour, as they'd soon figure out that nothings changing.</changefreq>
Really I'd have your home and catergory pages on daily, the articles on monthly, and the static pages on monthly or yearly.
In terms of getting them indexed quicker after the crawl, this is just a case of establishing trust and importance from the search engines. They need to know that you have news content that requires a quicker indexed. You can gain this trust by providing regular, high quality pages. When their crawlers pick up that there are new pages going live daily you will see the index get quicker.
Depending what CMS you are using, it is also worth getting a script or plugin that pings the search engines with an updated site map every time a new page or post is added. I've done this through Wordpress and articles get indexed within 4 hours. Again though, it didn't start this way and it only got this quick once I was putting up 4 posts a week like clockwork.
Good luck.
Cheers
David
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Malicious links on our site indexed by Google but only visible to bots
We've been suffering from some very nasty black hat seo. In Google's index, our pages show external links to various pharmaceutical websites, but our actual live pages don't show them. It seems as though only certain user-agents see the malicious links. Setting up Screaming Frog SEO crawler using the Googlebot user agent also sees the malicious links. Any idea what could have caused this or how this can be stopped? We scanned all files on our webserver and couldn't find any of malicious links. We've changed our FTP and CMS passwords, is there anything else we can do? Thanks in advance!
White Hat / Black Hat SEO | | SEO-Bas0 -
Do I lose link juice if I have a https site and someone links to me using http instead?
We have recently launched a https site which is getting some organic links some of which are using https and some are using http. Am I losing link juice on the ones linked using http even though I am redirecting or does Google view them the same way? As most people still use http naturally will it look strange to google if I contact anyone who has given us a link and ask them to change to https?
White Hat / Black Hat SEO | | Lisa-Devins0 -
Many sites added some excerpts of my Blog post and linking back ? Most of them are Spamy site !
Many sites added some excerpts of my Blog post and linking back ? Most of them are Spamy site ! Some are great blogs, but some blogs just copy some excerpts and link back to them - which i never approve. Will it affect my blog. i ask them to remove it. no use. !
White Hat / Black Hat SEO | | Esaky0 -
Spam linking site how to report
I have a spam linking site that is generation thousans of links to my site. Even if i have a good link background, this is the only spammy i have, each week number of links comings from it increases by 500 , i know have 3000 links for that site and 1800 for other sites, but that one keeps growing What should i do, i dont want that link it is imposible to remove as webmaster does not respond
White Hat / Black Hat SEO | | maestrosonrisas0 -
Could a sitewide footer EXACT MATCH anchor text link hurt or potentially penalize a site?
I am pretty sure this would hurt rankings yet I just want another's opinion on it. Would a sitewide footer link with exact match keyword anchor text to the page you want to rank for your main keyword hurt you? Basically if it were a link to the homepage, yet you wanted to make the anchor text your main objective keyword, would it hurt to have this in the footer along with the logo link at the top of a page that is just "home" anchor text?
White Hat / Black Hat SEO | | jbster130 -
Not Sure Exactly How Penguin is Effecting My Site (looking for tuff love)
Hello Everyone, I own a small web design firm website. My site was for sure hit by Penguin, but not sure why they devalued my pages. I dont really do SEO or link building except for my own site. I normally turn clients down when they want SEO services. Mainly because we do web design really well, so I've chosen to invest my time doing that versus doing both. For most of my keywords I took a 5-10 spot drop. Nothing super major, but enough that its tanking my business. I've survived all of the panda stuff, so I assumed my content writing, and link building tactics were good, but I'm wrong. Here is my website: http://www.clikzy.com/ I will explain what I have been doing below, and I am looking for a little help/direction. I don't mind if you look at my site, links, and are brutally honest. I do have original content ( I just ran everything through copyscape a month prior), and I occasionally get duplicate pages as my CMS tends to create them automatically, but we do a fairly good job of redirecting those pages when they occur. My link building tactics have been a mixture of the following. I have used anchor text alot which could be my demise. Forum postings
White Hat / Black Hat SEO | | Juratovic
Blog Comments
Website Footers (roughly 20 over the course of a year)
Web Design Directories (explain below) I did start using directories in January. I would use OpenSite Explorer, and review some of my bigger competitors, and would occasionally get listed on a web design directory they were on. I think total I probably purchase 8-10 since Jan including botw, business.com, etc. I have some local pages which I create case studies for which ranked fairly well. For instance for the term Baltimore Web Design I used to rank #1, but not I'm 5-6. Here's the keyword: http://www.clikzy.com/reston-web-design.html One more note: I did redirect an older website I have (12 years) to my current site (3 years) in Jan. Mainly because it ranked well for terms in NYC. I've dropped for those terms around 5 spots. I have a few questions: 1. What would you suggest to fix something like this? Power Content? Better Links? (of course, we all want better links) 2. Remove links? I am not sure which ones are bad. One thought was to just kill my local pages (roughly 15 pages) which would also kill any bad links I may have point to them. 3. If I have a bad link pointing to a internal page, could that bring down my home page rankings? Any help would be appreciated. I am in the process of interviewing for a full time PR person to come on staff to help us with our content, and PR. I knew I should have invested in this person a year ago! ha! Thank you! Pete0 -
Does the site have duplicate, overlapping, or redundant articles on the same or similar topics with slightly different keyword variations?
Hi All, In relation to this thread http://www.seomoz.org/q/what-happend-to-my-ranks-began-dec-22-detailed-info-inside I'm still getting whipped hard from Google, this week for some reason all rankings have gone for the past few days. What I was wondering though is this, when Google says- Does the site have duplicate, overlapping, or redundant articles on the same or similar topics with slightly different keyword variations? I assume my site hits the nail on the head- [removed links at request of author] As you can see I target LG Optimus 3D Sim Free, LG Optimus 3D Contract and LG Optimus 3D Deals. Based on what Google has said, I know think there needs to be 1 page that covers it all instead of 3. What I'm wondering is the best way to deal with the situation? I think it should be something like this but please correct me along the way 🙂 1. Pick the strongest page out of the 3 2. Merge the content from the 2 weaker pages into the strongest 3. Update the title/meta info of the strongest page to include the KW variations of all 3 eg- LG Optimus 3D Contract Deals And Sim Free Pricing 4. Then scatter contract, deals and sim free throughout the text naturally 5. Then delete the weaker 2 pages and 301 redirect to the strongest page 6. Submit URL removal via webmastertools for the 2 weaker pages What would you do to correct this situation? Am I on the right track?
White Hat / Black Hat SEO | | mwoody0