XML Sitemap Question!
-
Hi All,
I know that the sitemaps.xml URL must be findable but what about the sitemaps/pageinstructions.xml URL?
Can we safely noindex the sitemaps/pageinstructions.xml URL?
Thanks!
Yael
-
In regards to an "XML site map"- it's essential to have a site-map on your company website, that's because it makes it much easier for a Google Bot, to find the pages/ blog posts to crawl and index these if you have a XML site map.
We added a Yoast SEO site map to our Bristol Garden Room company website, in Bristol to ensure that all the blog posts / main pages were getting indexed.
-
Yes, you can noindex practically anything using the robots.txt file
-
Hey
Yes, you can safely do that. In the end, you mostly want to make sure that the right pages are being Crawled > Indexed. If that requires certain (XML) files to be no-indexed, then that's the way you want to go.
Martijn.
-
Hey Yael,
You should be able to. If it's being indexed, you can request removal via Bing Webmaster Tools and Google Search Console. You can also update your robots.txt file to disallow the page "http://www.robotstxt.org/robotstxt.html"
I hope that helps!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Backlink Question
Hello. I have an eCommerce Flower Shop Website and I have created an Online Free Game so player can create flower arrangement and stuff like that. If I had this game directly on my website and provide Embed Code so other Online Gaming Portals can add the game to their website. Would it be good to create back links for my website and increase my domain authority and SEO of my Flower Shop website? I ask because I am also in the Gaming industry and when I release my games, they can be added to hundreds of other gaming portals. But I am just afraid that since this is not is the same domain activity, this might hurt my SEO for my flower website. What are your thoughts about that?
Intermediate & Advanced SEO | | 8860319canadainc0 -
A Really Specific Question about 301 Redirect Strategies
Hi there: As part of a site redesign project, we've been doing a lot of 301 redirects, as we retire old URLs or rename them. My question is: is it necessary to redirect ALL old URLS? What about URLs with no links and low authority? Are these really necessary to redirect, since they're not referenced on the web and there's obviously a global redirect happening at the level of the root domain? Just curious; I'm not sure I've ever really understood this...
Intermediate & Advanced SEO | | Daaveey0 -
Asking a natural question in H tags ?
Hello, I read that in H tags it is more natural to write the question a user would ask, does it really have any benefits in terms of seo For example instead of "Tour map" writing "what are the villages you visit ?" or instead of "Activity level" write " "what is the level like ?" Does it help in anyway ? Thank you,
Intermediate & Advanced SEO | | seoanalytics0 -
Slug construction question
Hi there, question about what constitutes an optimal slug. I work for a Theater news site. An article we recently wrote announced the opening of the musical "Holler if you hear me," which features the music of Tupac Shakur. We considered a few options, including holler-if-you-hear-me-opens-on-broadway and tupac-musical-opens-on broadway. Any suggestions? Also, if the full URL reads something like theatermania.com/broadway/news/06-2014/[slug], should we try to ensure that the term 'broadway' never appears in the slug to reduce redundancy? Keep in mind that the term 'broadway' is a pretty popular search term.
Intermediate & Advanced SEO | | TheaterMania0 -
YouTube hosting question
The "How it works" video that is embedded on my sites homepage is currently linked to an individual YouTube account not our company account. I would like to change the ownership so that the company profile can enjoy the added views (currently 13K +). Is there a way to move the video to a different account without losing the views it has already accumulated? Also, a related technical question - our R&D team says the video is slowing down the site. It links to YouTube but there is nothing in the source of our page about YouTube. Any suggestions for embedding it more effectively?
Intermediate & Advanced SEO | | theLotter0 -
Domain and Sitemap Question
Hi - I am hoping you can help me with this issue we are currently trying to solve. We are hosting our mobile site's content on a different domain than what the URL of the site is, though owned by same company. In Google Webmasters tool we have the mobile sitemap under "sitemaps.xyz.com", however the URL of the site is "m.xyz.com". We have submitted 60MM pages in the mobile sitemap, but only 1MM pages have been indexed. Do you think this set up causes confusion with the bots? Does this affect the crawlability of the site? Any thoughts would be greatly appreciated. Thank you!
Intermediate & Advanced SEO | | ladylana
Eva0 -
Sitemaps: Alternate hreflang
Hi, some time ago I have read that there is a limit of 50.000 URLs per sitemap file (So, you need to create a sitemap index and separate files with 50.000 urls each). [Source]. Now we are about to implement the link hreflang in the sitemap [Source], and we dont know if we have to count each alternate as a different url. We have 21 different well positioned domains (Same name, different cctlds, a little different content [varies in currencies, taxes, some labels, etc] depending in the target country) so the amount of links per url would be high. A) Shall we count each link alternate as a separate url, or just the original ones? For example, if we have to count the link alternates, that would make us have 2380pages per sitemap, each with one original url and 20 alternate links. (Always being aware of the 50mb maximum filesize) B) Actually we have one sitemap per domain. Using this, shall we generate one per domain using the matching domain as original url? Or it would be the same if we upload to every domain the same sitemap? Thanks
Intermediate & Advanced SEO | | marianoSoler980 -
Ask a Question
We use DNN and we have case studies ran from our CMS. This is so we can have them in lists by category on service/market pages and show specific ones when needed. Then there is the case study detail page, (this is where the problem exists)to where you read out the case study in full detail and see the images and story. We enter our Case Studies into the CMS and this determines which website they show, and it creates URLs from the titles. However, on the detail page, the case studies all share the same page, Case Study.aspx, and they resolve to that page with their respected URLs in place. As seen here, http://www.structural.net/case-study/1/new-marlins-stadium.aspx Because they all share the same page they are being pulled as duplicate pages. They do show in the SERPS with the right title and URL and it all looks great, but they get errors for having duplicate page content and titles. Is there a way to solve this, or is this something I should even worry about?
Intermediate & Advanced SEO | | KJ-Rodgers0