The crawlers may be blocked inside of the robots.txt file. In Screaming Frog change the User Agent to Googlebot and recrawl the site. If that doesn't work you'll have to check the server log files inside of the hosting account for the site. Those may tell you what the crawl doesn't work.
- Home
- SEOchris1
Latest posts made by SEOchris1
-
RE: Site crawl only shows homepage
Best posts made by SEOchris1
-
RE: Site crawl only shows homepage
The crawlers may be blocked inside of the robots.txt file. In Screaming Frog change the User Agent to Googlebot and recrawl the site. If that doesn't work you'll have to check the server log files inside of the hosting account for the site. Those may tell you what the crawl doesn't work.
Looks like your connection to Moz was lost, please wait while we try to reconnect.