Can you recommend any suitable alternatives for web crawling our site while your new crawler is in development.
We already use screaming frog but it would be handy to have something that flagged up any problems like MOZ did with our other sites.
Cheers