Help with Roger finding phantom links
-
It Monday and Roger has done another crawl and now I have a couple of issues:
- I have two pages showing 404->302 or 500 because these links do not exist. I have to fix the 500 but the 404 is trapped correctly.
http://www.oznappies.com/nappies.faq & http://www.oznappies.com/store/value-packs/\
The issue is when I do a site scan there is no anchor text that contains these links. So, what I would like to find out is where is Roger finding them. I cannot see any where in the Crawl Report that tells me where the origin of these links is.
- I also created a blog on Tumblr and now every tag and rss feed entry is producing a duplicate content error in the crawl stats. I cannot see anywhere in Tumblr to fix this issue.
Any Ideas?
-
Thanks again Ryan, you have been very helpful answering al lot of my questions.
-
Someone else asked the same question regarding tag pages yesterday. I would suggest asking a separate Q&A on that topic.
Tag pages & forum category pages are both often used as containers. They don't have any content except links to articles. I would ask for feedback as to the best practice. I suspect noindex, following those pages would be best, but I don't have the experience to feel comfortable offering that advice.
-
I have been looking at the data that Roger is reporting for the duplicate content and in ALL cases there is either a 301 or a NoIndex. So now I do not know why Roger is reporting them as a duplicate, robots should not see the second entry.
-
I did not think of looking at the csv report. I see it now thanks Ryan. There should be a soft 404 handler in place to process the bad urls, I will have to see why it is not working.
With tumblr, I was looking for an easy way to add a blog to the site.
The RSS is coming from tumblr as is all the content.
When we specify Tags in tumblr it creates urls e.g. mypage.com/article/tag1 mypage.com/article/tag2 mypage.com/article/tag3 which all contain the content of mypage.com/article with out a canonical to the original. It is a really strange non-seo friendly approach, and so I wondered if anyone had similar problems.
-
The crawl report offers a "referrer" field. That field offers where Roger found the offending link. In my experience that field has always been accurate.
When I try to access www.oznappies.com/faq I receive a 302 redirect and a 500 error. I would recommend adjusting non-existant pages to a soft 404 page. Still provide a 404 response to browsers, but offer users a friendly way to find information (i.e. links / search) and stay on your site.
A great example of a soft 404 page is http://www.orangecoat.com/a-404-page.html
For the Tumblr issue, I am not clear on the problem. Are you writing content and publishing on both the oznappies.com site and your tumblr site? Then this content is being published again on your site via a RSS import?
-
I removed the links and just left the text so these will cut and paste now. It confuses me where Roger found the links.
Thanks for running the Xenu scan. I have tried other site scanner and come up blank.
-
That second link is anchored to the wrong place.
Regardless I also cannot find the .faq page. I just ran Xenu over it to see what it could find, but no broken links showed up.
Afraid I don't use Tumblr either, so eh, pretty useless post. Sorry.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
How can we get follow links from Pinterest and Instagram
While using Open Site Explorer from Moz I came across follow links from Instagram and Pinterest. Now my question is how can we get follow links from Pinterest and Instagram
Moz Pro | | rakesh10 -
Better link metrics, but lower rank??
Hello to all, new member here from Houston. I'm learning a lot! I've brought my site up some but my chief competitor is still at #1 position. I ran a full SERP report for my top keyword. My site appears to rank better on: Page Authority…Domain Authority…MozRank…MozTrust...DmT/DmR… Additionally, his on-page grade is F, mine is B! So, it appears sheer bulk incoming links are really where it's at. He beats me, somewhat, at URL Link Counts, also on Followed External Links. The real difference appears to be External Links to This Domain: I have 65, he has somehow managed to get 3500…I think his webmaster has a local directory where everybody links to each other…I can't imagine how a small biz like this, in a fairly non-competitive industry, could get that many. Anyway, thought I'd bring this up for comments/clarifications, if anyone has any---Also, is there a resource to understand these various parameters. Thanks--- John in Houston
Moz Pro | | vondoba0 -
How bad are poor link profiles for a website?
A client has recently switched to us for their SEO and is hugely concerned about their previous company's link building efforts.They say that they have recently removed over 300 links but OSE still lists 160 links.So three questions: How long will it take for OSE to recognise if the links have been removed? How great could the effects of this be on the site's rankings? If we continue to struggle with getting the links removed would Google's disavow tool make much of a difference or are there negatives that sould be considered first?
Moz Pro | | SoundinTheory0 -
Link from Gizmodo disappeared from Open Site Explorer
Hi, I have been using OSE to check competitor links, DA, PA etc. And recently noticed that an author at Gizmodo was kind enough to link us to a blog post of his. This is great news as Gizmodo has a DA of 94 and a PA of 50 (Which is pretty big compared to our DA of 30 and PA of 42). The link to the post is here: http://gizmodo.com/5956401/everything-you-need-for-the-best-trick+or+treating-house-in-the-neighborhood And the link to our website is: http://www.electromarket.co.uk/lighting-effects/lighting-effects/strobe/ffa0144 It was showing on OSE for the past few days but now it has vanished and it is showing channel5 (TV Channel in the UK) as the highest DA linking to us, which is still pretty good. But I just want to know why the link has stopped displaying on OSE 😞 Any help or insight is appreciated! Tom
Moz Pro | | tomhall900 -
Using api to find likes, tweets and shares
Hi all, I have a question regarding using the API to get data on a list of urls and not one by one. I am not a developer so I might not grasp the API so well. Basically I have a list of urls, what I need from each is the following information: <colgroup><col width="98"><col width="89"><col width="92"><col width="111"><col width="99"><col width="50"><col width="64"></colgroup>
Moz Pro | | rightmove
| Page authority | linking root domains | total links | Facebook Shares | Facebook likes | tweets | Google+1's | I found a google doc that gives me SOME of the data but not all (also it might be old as it uses the linkscape call (I dont know if thats changed)) Any idea how I can tune my googledoc spreadsheet to include the additional metrics? Thanks 🙂0 -
How do I collect all links through the SEOMoz API?
How do I collect all links through the SEOMoz API? Yes, I know how to pull url metrics info but want to pull the inbound links only via php script w/out having to go to the OSE page to pull. any suggestions would be great!
Moz Pro | | destdigi0 -
Does Google have a direct link with facebook and twitter?
Google monitor social media. What I'm wondering is do Google use the same tools we have on Facebook's API, Twitter's API etc to use in their SERPs Or do Facebook grant Google more detailed access to see who has liked links etc. I think it's quite an interesting point as surely I can push up my own count by repeatedly sharing my own links, which wouldn't be genuine. If Google had better access they could then determine what's been faked etc.
Moz Pro | | PhotoGazza0 -
Linking Building: Do I have to beat Linking Root Domains or Total Links?
Hello, When skoping for how to beat competitors, do I need to aim to beat the linking root domains number or the total links? Or do I need to think about both? Thanks!
Moz Pro | | BobGW0