Why does the crawl report say I should have meta description and title tags in my xml files?
-
Just had my first crawl report today which has been very useful in finding missing and duplicated title tags and meta descriptions but it has flagged up the fact that my xml files are missing these. Surely non HTML documents shouldn't have them (or need them) so why are they showing up in the report?
-
TBH it's a while ago I heard it and can't remember which site it was on. I've subscribed to so many SEO forums!!
Happy to get fresh advice on the matter as I have no particular desire to have the sitemaps crawlable or visible on the site. What are your feelings about ROR, RSS and OPML sitemaps?
-
Hi Pandy,
Could you give me a heads up on the resource that says you should link to your sitemap.xml? Interested in reading that
In my experience, search engines expect the sitemap to be at www.root.com/sitemap.xml so there would be no need to link to it from your site.
-
Thanks Yannick.
The site does link to sitemaps in XML, RSS, OPML, Text and HTML formats. This has been advised not for Google but for other search engines and bots which may be crawling the site. There are also links to RSS feeds which are showing in the report as well.
Highland - the XML files are generated by a third party so I would hope they are returning proper application type! The browser certainly renders them as XML.
-
Highland has a good suggestion. Otherwise:
You might have found a bug there
There shouldn't be any title tags and description tags in XML files. So I suggest you submit it as a bug.
Other thought that comes up: why does the crawler find XML files? That (probably?) means that you're linking to those files on your site? Which isn't really necessary
You only need to link to it in your robots.txt file or submit it to Google Webmaster Tools.
-
Are your XML files returning a proper application type? If it's being shown as "text/html" it's possible the bot got confused.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Is there a tool to crawl website meta tags to locate any in an incorrect language?
Example: I'm interested in crawling a regional site for Brazil to find any meta tags that are still in English with the goal being to fix any localization issues.
Moz Pro | | mattsolar0 -
Rankings Report - figures clarifiction
I've noticed a possible discrepancy with my data and the figures in the Ranking Report >> Rankings which leads to this question: In top 3 : 10 On first page: 19 Is this meant to mean 10 of the 19 are in the top 3, or after the 10 top 3 there are 19 more keywords on first page?
Moz Pro | | MickEdwards0 -
How to force SeoMoz to re-crawl my website?
Hi, I have done a lot of changes on my website to comply with SeoMoz advices, now I would like to see if I have better feedback from the tool, how can I force it to re-crawl a specific campaign? (waiting another week is too long :-))
Moz Pro | | oumma0 -
SEOMoz reports and 404 errors
My SEOMoz report shows a 404 error, found today for this url: http://globalheavyhaul.com/google.com i do not have this anchor text anywhere on my website. How did Roger figure out that somebody looked for that page? Do I need to worry about 404 errors that are the result of user mistakes, instead of actual bad links?
Moz Pro | | FreightBoy0 -
Seomoz crawling filtered pages
Hi, I just checked an seo campaign we started last week, so I opened seomoz to see the crawl diagnostics. Lot's of duplicate content & duplicate titles showing up, but that's because Rogerbot is crawling all of the filtered pages as well. How do I exclude these pages from being crawled? /product/brand-x/3969?order=brand&sortorder=ASC
Moz Pro | | nvs.nim
/product/brand-x/3969?order=popular&sortorder=ASC
/product/brand-x/3969?order=popular&sortorder=DESC&page=10
/product/brand-x/3969?order=popular&sortorder=DESC&page=110 -
Traffic reports
this may be a realy silly question to ask but when im trying to print off traffice report I can only see reports based on my keywords is their a way to show all traffic not just based on my keywords?
Moz Pro | | seoactivejames0 -
Only crawling one page
Hi there, A campaign was crawling fine, but at the last crawl, for some reason, SEOmoz can only crawl one page... any ideas? If I run a custom crawl I still access all of the site's pages.
Moz Pro | | harryholmes0070 -
Initial Crawl Questions
Hello. I just joined and used the Crawl tool. I have many questions and hoping the community can offer some guidance. 1. I received an Excel file with 3k+ records. Is there a friendly online viewer for the Crawl report? Or is the Excel file the only output? 2. Assuming the Excel file is the only output, the Time Crawled is a number (i.e. 1305798581). I have tried changing the field to a date/time format but that did not work. How can I view the field as a normal date/time such as May 15, 2011 14:02? 3. I use the ™ symbol in my Title. This symbol appears in the output as a few ascii characters. Is that a concern? Should I remove the trademark symbol from my Title? 4. I am using XenForo forum software. All forum threads automatically receive a Title Tag and Meta Description as part of a template. The Crawl Test report shows my Title Tag and Meta Description as blank for many threads. I have looked at the source code of several pages and they all have clean Title tags and I don't understand why the Crawl Report doesn't show them. Any ideas? 5. In some cases the HTTP Status Code field shows a result of "3". Why does that mean? 6. For every URL in the Crawl Report there is an entry in the Referrer field. What exactly is the relationship between these fields? I thought the Crawl Tool would inspect every page on the site. If a page doesn't have a referring page is it missed? What if a page has multiple referring pages? How is that information displayed? 7. Under Google Webmaster Tools > Site Configurations > Settings > Parameter Handling I have the options set as either "Ignore" or "Let Google Decide" for various URL parameters. These are "pages" of my site which should mostly be ignored. For example a forum may have 7 headers, each on of which can be sorted in ascending or descending order. The only page that matters is the initial page. All the rest should be ignored by Google and the Crawl. Presently there are 11 records for many pages which really should only have one record due to these various sort parameters. Can I configure the crawl so it ignores parameter pages? I am anxious to get started on my site. I dove into the crawl results and it's just too messy in it's present state for me to pull out any actionable data. Any guidance would be appreciated.
Moz Pro | | RyanKent0