Crawl Diagnostics saids a page is linking but I can't find the link on the page.
-
Hi
I have just got my first Crawl Diagnostics report and I have a questions.
It saids that this page: http://goo.gl/8py9wj links to http://goo.gl/Uc7qKq which is a 404. I can't recognize the URL on the page which is a 404 and when searching in the code I can't find the %7Blink%7D in the URL which gives the problems.
I hope you can help me to understand what triggers it
-
It's probably possible to block these url's from indexing using a regular expression in your robots.txt - however keep in mind that if bots encounter these links users will encounter them as well which leads to a degraded user experience.
If I was in your situation I would try to solve the problem at the root - avoiding that these strange links are created in the first place.
rgds,
Dirk
-
Thank you Dirk! I will look closer to this.
But what would you do to make Google stop indexing these pages? Hope you can help
-
Hi,
Can't find the link on the page you give as an example - but on other pages you have in the source a link of type
<a <span="" class="html-attribute-name">href</a><a <span="" class="html-attribute-name">="{link}"></a><a <span="" class="html-attribute-name">href="http://www.....dk/video-virtuelt-cockpit-i-ny-audi-a4/"</a>
<a <span="" class="html-attribute-name">Sourcepage: www......dk/bilmaerker/chevrolet/page/2/
In the browser the {link} is encoded as %7Blink%7D
Hope this helps,
Dirk</a>
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Spammy inbound links: Don't Fix It If It's Not Broken?
Hi Moz community, Our website is nearing the end of a big redesign to be mobile-responsive. We decided to delay any major changes to text content so that if we do suffer a rankings drop upon launch, we'll have some ability to isolate the cause. In the meantime I'm analyzing our current SEO strengths and weaknesses. There is a huge discrepancy between our rankings and our inbound link profile. Specifically, we do great on most of our targeted keywords and in fact had a decent surge in recent months. But Link Profiler turned up hundreds of pages of inbound links from spammy domains, many of which don't even display a webpage when I click there. (shown in uploaded image) "Don't fix it if it's not broken" is conflicting with my natural repulsion to these sorts of referrals. Assuming we don't suffer a rankings drop from the redesign, how much of a priority should this be? There are too many and most are too spammy to contact the webmasters, so we'll need to do it through a Disavow. I couldn't even open the one at the top of the list because our business web proxy identified it as adult content. It seems like a common conception is that if Google hasn't penalized us for it yet, they will eventually. Are we talking about the algorithm just stumbling upon these links and hurting us or would this be something we would find in Manual Actions? (or both?) How long after the launch should we wait before attacking these bad links? Is there a certain spam score that you'd say is a threshold for "Yes, definitely get rid of it"? And when we do, should we Disavow domains one domain at a time to monitor any potential drops or all at once? (this seems kind of obvious but if the spam score and domain authority alone is enough of a signal that it won't hurt us, we'd rather get it done asap) How important is this compared to creating fresh new content on all the product pages? Each one will have new images as well as product reviews, but the product descriptions will be the same ones we've had up for years. I have new content written but it's delayed pending any fallout from the redesign. Thanks for any help with this! d1SB2JP.jpg
Moz Pro | | jcorbo0 -
Rogerbot crawls my site and causes error as it uses urls that don't exist
Whenever the rogerbot comes back to my site for a crawl it seems to want to crawl urls that dont exist and thus causes errors to be reported... Example:- The correct url is as follows: /vw-baywindow/cab_door_slide_door_tailgate_engine_lid_parts/cab_door_seals/genuine_vw_brazil_cab_door_rubber_68-79_10330/ But it seems to want to crawl the following: /vw-baywindow/cab_door_slide_door_tailgate_engine_lid_parts/cab_door_seals/genuine_vw_brazil_cab_door_rubber_68-79_10330/?id=10330 This format doesn't exist anywhere and never has so I have no idea where its getting this url format from The user agent details I get are as follows: IP ADDRESS: 107.22.107.114
Moz Pro | | spiralsites
USER AGENT: rogerbot/1.0 (http://moz.com/help/pro/what-is-rogerbot-, rogerbot-crawler+pr1-crawler-17@moz.com)0 -
SeoMoz reporting 301 redirects I can't find
So I'm trying to find a bunch of redirects that SeoMoz is reporting that were created by Wordpress but I can't seem to find. I'm finding a bunch of redirects FROM pages like this: www.mysite.com/wp-content/themes/mimbo/page-name.com redirecting to www.mysite.com/page-name.com Anybody have any idea how I can track down the offending page that has a link to that url. I took a look at my templates and content with the pages and can't seem to find anything that would create it.
Moz Pro | | brandco0 -
Keyword Ranking weekly update didn't happen
A new campaign of mine is supposed to update its keyword rankings on Wednesdays but as of Thursday morning it didn't happen. I've got the original stats from the first few keywords I added when the campaign was set up, but nothing for the keywords that were added in the next day. Previous experience with this tool was pretty reliable so I'm just wondering if anyone is experiencing the same thing.
Moz Pro | | ninjaprecision0 -
On Page Optimisation rankings keep yo-yo'ing
Hi All Can you please clarify this for me as its getting a little frustrating. I get the weekly reports from the SEO Pro campaign tool and from one week to the next it keeps changing the ranking. For example cheap a boards For this page I have a on page score of A through the campaign: http://www.cheapsnapframes.co.uk/cheap-a-boards.html Last weeks report showed it was an A and then I get this weeks snapshot after the crawl and its saying its now an F but when I click on the link on the onpage tool it then is showing me an A and then changes the ranking again on the campaign. I am seeing this a lot - why is it happening? thanks Tracy
Moz Pro | | dashesndots0 -
Is it possible to create a report where per page only external links are shown?
Hi all, When I create a report on page level (links to pages per page), it seems that also internal links are included. Is it possible to create a report where per page only external links are shown? thnx Dennis
Moz Pro | | djingel10 -
Fetch googlebot for sites you don't own?
I've used the "fetch as googlebot" tool in Google webmaster tools to submit links from my site, but I was wondering if there was any type of tool or submission process like this for submitting links from other sites that you do not own? The reason I ask is, I worked for several months to get a website to accept my link as part of their dealer locator tool. The link to my site was published a few months ago, however I don't think google has found it and the reason could be because you have to type in your zip code to get the link to appear. This is the website that I am referencing: http://www.ranchhand.com/dealers.php?zip=78070&radius=20 (my website is www.rangeroffroad.com) Is there any way for Google to index the link? Any ideas?
Moz Pro | | texmeix0 -
How to find highest PR pages by search term?
is there a search operator in google to sort by highest PR, or an alternate search engine (besides Google directory) to find high PR sites by keyword? I am sending free product out to webmasters to use as a giveaway for their audience, and would like to find the highest PR sites/pages to partner with. I want the highest SEO value out of the products I send out. I'm trying to find outdoor sports related sites, etc, which have done contests/giveaways in the past and linked well to the supplier of the prize. I've been just googling phrases like "backpack giveaway", etc. and this has worked ok, but I'd like to find a tool to search for the highest PR sites around each of the phrases.
Moz Pro | | rakesh_patel0