Moz Q&A is closed.
After more than 13 years, and tens of thousands of questions, Moz Q&A closed on 12th December 2024. Whilst we’re not completely removing the content - many posts will still be possible to view - we have locked both new posts and new replies. More details here.
Why Only Our Homepage Can Be Crawled Showing a Redirect Message as the Meta Title
-
Hello Everyone,
So recently when we checked our domain using a Moz Crawl Test and Screaming Frog only the homepage comes up and the meta title says “You are being redirected to…”. We have several pages that used to come up and when submitting them to GSC no issues come up. The robots.txt file looks fine as well.
We thought this might be ‘server’ related but it’s a little out of our field of expertise so we thought we would find out if anyone has any experience with this (ideas of reasons, how to check…etc.) or any potential suggestions.
Any extra insight would be really appreciated.
Please let us know if there is anything we could provide further details for that might.
Looking forward to hearing from all of you!
Thanks in advance.
Best,
-
Hello Kris,
Thank you very much for your help. We’ll contact the host to see if they could help. Is there any way to check if it’s the CMS and database structure or is that also something for the hosting company?
Also, we checked and there was an issue with the sitemap.xml. Could that have been a potential cause? - More just curious.
Please let us know if there are details we could provide that might help.
Looking forward to hearing from you!
Thanks again.
Best,
-
1- This may be accredited to your CMS and the database structure it relies on to function.
2- Ask your website host for support regarding this issue. Some issues like this are server level and cannot be corrected at the client level.
3- I would look into webmaster tools to make sure the sitemap is submitted properly and redirects are at a minimum. Also, conduct a few fetch as googlebot tactics.
-
Hi Ben,
Would you mind sharing the URL for the site?
Thanks,
Sal
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
WEbsite cannot be crawled
I have received the following message from MOZ on a few of our websites now Our crawler was not able to access the robots.txt file on your site. This often occurs because of a server error from the robots.txt. Although this may have been caused by a temporary outage, we recommend making sure your robots.txt file is accessible and that your network and server are working correctly. Typically errors like this should be investigated and fixed by the site webmaster. I have spoken with our webmaster and they have advised the below: The Robots.txt file is definitely there on all pages and Google is able to crawl for these files. Moz however is having some difficulty with finding the files when there is a particular redirect in place. For example, the page currently redirects from threecounties.co.uk/ to https://www.threecounties.co.uk/ and when this happens, the Moz crawler cannot find the robots.txt on the first URL and this generates the reports you have been receiving. From what I understand, this is a flaw with the Moz software and not something that we could fix form our end. _Going forward, something we could do is remove these rewrite rules to www., but these are useful redirects and removing them would likely have SEO implications. _ Has anyone else had this issue and is there anything we can do to rectify, or should we leave as is?
Moz Pro | | threecounties0 -
Should I set blog category/tag pages as "noindex"? If so, how do I prevent "meta noindex" Moz crawl errors for those pages?
From what I can tell, SEO experts recommend setting blog category and tag pages (ie. "http://site.com/blog/tag/some-product") as "noindex, follow" in order to keep the page quality of indexable pages high. However, I just received a slew of critical crawl warnings from Moz for having these pages set to "noindex." Should the pages be indexed? If not, why am I receiving critical crawl warnings from Moz and how do I prevent this?
Moz Pro | | NichGunn0 -
Crawlers crawl weird long urls
I did a crawl start for the first time and i get many errors, but the weird fact is that the crawler tracks duplicate long, not existing urls. For example (to be clear): there is a page: www.website.com/dogs/dog.html but then it is continuing crawling:
Moz Pro | | r.nijkamp
www.website.com/dogs/dog.html
www.website.com/dogs/dogs/dog.html
www.website.com/dogs/dogs/dogs/dog.html
www.website.com/dogs/dogs/dogs/dogs/dog.html
www.website.com/dogs/dogs/dogs/dogs/dogs/dog.html what can I do about this? Screaming Frog gave me the same issue, so I know it's something with my website0 -
Why are inbound links not showing?
I run the site http://www.eurocheapo.com and am finding that many inbound links are not showing up in OSE and on the toolbar. For example, check out this hotel review: http://www.eurocheapo.com/paris/hotel/hotel-esmeralda.html In OSE it shows only 2 links (from 1 domain), which is crazy. It has dozens of inbound links from many different domains (links:http://www.eurocheapo.com/paris/hotel/hotel-esmeralda.html). I notice this all over my site. Pages that we link between are also showing no internal links -- which is easy to disprove. Was there a problem with this crawl? Or is the problem in our code? Many thanks for your help, Tom
Moz Pro | | TomNYC0 -
How can I download all of my backlinks?
In Opensiteexplorer it shows 16700 backlinks, but as I tryied various ways including advance report, with no filter I am getting only 1000+ links. How can I download all of my 16700 backlinks?
Moz Pro | | KalpeshBPatel750 -
Meta keywords no longer in use
Can someone point me to the official article explaining why meta keywords are no longer taken into account by search engines please? I know Moz has indicated that search engines ignore them, but I would like to read a bit more about it - what was the reason behind it and since when.
Moz Pro | | coremediadesign0 -
Title tag on sitemap.xml
The SEO moz is showing an error on one of the sites within my SE Moz account campaign under Crawl Diagnostics: Title tag missing or empty. No problem here but the file associated with this issue is sitemap.xml and that just dose't look right as as far as I know xml files are title tag free. I've searched around and i've been able only to confirm my initial thought that sitemap.xml dose't use a title tag .. like any other xml. is this an issue ? (the error that is) or i should let it slide. can it be fixed ? if yes, how ? Thanks !
Moz Pro | | eyepaq1