Handling a Huge Amount of Crawl Errors
-
HI all,
I am faced with a crawl errors issue of a huge site (>1MiO pages) for which I am doing On-page Audit.
-
404 Erorrs: >80'000
-
Soft 404 Errors: 300
-
500 Errors: 1600
All of the above reported in GWT.
Many of the error links are simply not present on the pages "linked from". I investigated a sample of pages (and their source) looking for the error links footprints and yet nothing.
What would be the right way to address this issue from SEO perspective, anyway? Clearly. I am not able to investigate the reasons since I am seeing what is generated as HTML and NOT seeing what's behind.
So my question is: Generally, what is the appropriate way of handling this?
-
Telling the client that he has to investigate that (I gave my best to at least report the errors)
-
Engaging my firm further and get a developer from my side to investigate?
Thanks in advance!!
-
-
Usually an on page audit lists all of the problems and possible reasons why they are happening, not in depth info on how to fix all the issues. That is usually the next phase, "do you want me to work on the site or do you want your dev team to track down the cause of the issues and fix them"
It also depends what type of contract you have with him of course.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
I want to check which pages have been crawled
I would like to find out which pages have been crawled by seomoz on my site
On-Page Optimization | | seoworx1230 -
How to update a crawl
Hi I crawled my site, it found lots of errors and warning which i have fixed, I told seomoz to recrawl, and it says nothing has changed... It defiantly has though! How do I make it see these changes?
On-Page Optimization | | chrisleonard0 -
Waiting 3 days for Crawl Test to complete
Being new to seomoz Im not sure if I understand the crawl test completely. You setup a campaign, enter all your info, rogerbot goes out and crawls your site and gives you results as to what your doing right and what is wrong or could use looking into. So once I get my results, I make edits to my site pages. In my case Im getting lots of duplicate content and duplicate titles. So I go back and make adjustments and then submit a crawl test to see the change results. In other tools Ive used in past I was able to re run crawl immediately and fine tune results on the fly. seomoz crawl test is still pending after three days. is this normal? or is there another way to make changes and run reports to see results instantly? If your working on many sites and making changes, having to wait 3 or more days to see how your changes were received seems like a long time.
On-Page Optimization | | anthonytjm0 -
What is the best way to handle e-commerce Product title names?
Hello, I'm having a little bit of a conundrum, and I'm hoping someone will be able to help! We have an ecommerce site, and were trying to figure out what is the most SEO friendly way to handle product titles. With our ecommerce software, it currently sets the Product title as the H1 tag (which could be changed if needed). In addition, the product title is what is used as anchor text for any built in links that the ecommerce software builds from the category pages, etc (just like any other ecommerce site). Here's where I'm stuck. I'm trying to determine if it makes sense to use the specific keyword we are aiming for as the product title, or to put variations of the title that would be more descriptive. Here is an example: We have a Wizard of Oz Dorothy Deluxe Girls Shoes. According to all accounts, the best keyword to attack for this would be "dorothy shoes". However, it loses the more accurate description of "Wizard of Oz Dorothy Deluxe Girl Shoes". But, my thinking is that the H1 tag and anchor text would make more sense to use the term "Dorothy Shoes". The title tag could go something like this: "Wizard of Oz Dorothy Deluxe Girls Shoes | Dorothy Shoes" In a situation like this, what do you think would be the "best" way to handle the title tag, product name, H1 tag, and anchor text? I'm sure there will be many different opinions, so I would like to hear what you think is best - and why.
On-Page Optimization | | clickshipcommerce0 -
Handling Deleted Pages
The backstory: My site has a fantasy sportsbook where users can place "bets" on pretty much anything. Each game has a unique matchup page, where the odds are displayed and any conversation about the game takes place. Example here. About 95% of the games are automatically graded, but I have to manually grade the rest. Therefore, as soon as every game starts I check to see if any users have made a pick on it, and if not I delete it because it reduces my workload. The problem: About 15% of my search-driven traffic is queries for games that no longer exist, which makes sense because nobody bets on the super obscure games and these games are very easy to rank for. I am currently redirecting them to my 404 page but I'm worried that all of these hits are hurting my reputation with the big G. Would it be better to noindex all of these pages at first and take the noindex away as soon as I'm positive that the game will stay?
On-Page Optimization | | PatrickGriffith0 -
Getting 403 error in forum
Hi all, I am getting 403 error for my site where it is throwing error for the following url http://www.topuniversityforum.in/members/member id/ignore and it is showing 7 similar url for 7 user ids. I want to know how can i resolve it and if it is going to have any negative effect on its ranking.
On-Page Optimization | | akhilendra0 -
Huge rewrite and drop in ratings
Hi, My website provider made a huge rewrite of code to make the website more SEO friendly and add more functions. It absolutely was a big step forward and gave me more possiblities to improve our site seo wise. We were actually first webshop of 200-300 on the new platform - and thats not always a good idea i guess 😉 I need some help on the best way to solve 1 big problem for us. They changed the URL structure. Ive been building the brand pages and have 2-6 linking root domains to each brand page: for the brand ej sikke lej the catalogue used to be : http://www.epleskrinet.no/ej_sikke_lej/M_16 they changed it to http://www.epleskrinet.no/manufacturers/ej-sikke-lej . I told them the same day the new version was ot the the optimal URL would be http://www.epleskrinet.no/ej-sikke-lej . It wasnt utill i saw the crawl i understood what the URL change would mean to us. We have a decent amount of organic searches and now visitors come to an empty page with an error message. to the brand ej sikke lej i have 6 linking domains going to this page. The new brand pages are a lot weaker then the old one since they dont have the ingoing links. Our site was indexed yesterday and the result rankingwise wasent pretty. How do i go about to fix this. Is it possible to -301 redirect old brad catalogues to new one ? They are not even in the new site map i am sending in. Thanks
On-Page Optimization | | danlae0 -
Can my amount of internal linking seem spammy ?
Ecommerce site. I am optimizing for each producer of products on a separate page. Atm my provider does lack some functions(i cant put in H1 , title and can put text only product pictures) on the product pages - like here http://www.epleskrinet.no/smafolk/M_23 . The are updating within 1-2 months to allow me do this. This has led to actually some of the products themself ranking higher that the producer page. what Ive been doing is to put anchor text and link back to the producer page for all 9 products on this page. Is that a problem or should i just do it like this ? thanks
On-Page Optimization | | danlae0