How to detect where Google gets indexed URL's
-
Google index some kind of way some links that create duplicate content. We doesn't understand how these are created so we would like detect where Google robots find these links.
We tried:
- Moz Crawl Diagnostics but it shows 0 as Internal Link Count for these kind of links.
- Find some information from Google Analytics, that maybe there is trace (site content - all content) from visitors side. There wan't.
- We tried to find some information in Webmaster Tools under Internal link and HTML Improvements but didn't find any trace.
- Tried some search commands. Is there maybe some good one to search.
- TO search URL's form code with https://search.nerdydata.com.
-
It really isn't possible for an outsider to know why your website is generating those URLs in error; you would have to talk to your developer about that.
As far as canonicals, if your problem is page.com is getting duplicated by added parameters: page.com/?id=1, page.com/?id=2, page.com/?id=3, etc. as long as you have the canonical on page.com, all of the parameter pages will have the correct canonical on them as well. (But you are right, you should track down the source; your developer will know.)
-
Thanks you for your answer but yes I know that these are generated by our site. But problem is that I can use canonical tag for these that are indexed right now but later new ones will be created someway. Problem root isn't that we doesn't know how to use canonical, it's how to get to know where these URL's are find/indexed/detected by Google.
These kind of URL's have been there for months so we can't just hope that somehow these will be droped. We need to find some kind of solution and detect real problem.
-
If you found those URLs by doing a site: search, then those parameters are being generated by your site. (I am surprised that Google is even indexing them; I assume that pretty soon all but one will be dropped.) Here is an article that explains more about those types of duplicate pages: http://moz.com/blog/which-page-is-canonical
You can fix this by using a canonical tag on your homepage with the version that doesn't have the parameter.
-
Our front page has almost 50 duplicate versions. These are shown when we do site:oursite.com, there are /et?id=xx, /et?productId=xx, etc. In URL xx are different numbers.
-
Where are you seeing these duplicate content links? Does Webmaster Tools say that they are duplicate content? Or does this show up in your Moz crawl? What do these URLs look like?
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Email traffic tracking in Google Analytics
Hello! I have a question about how to assure email traffic is properly tracked in GA > Acquisition > All Traffic > Channels. **First, some background... ** Our company (Wisconsin's largest group dental practice) is about to revamp the way we try to re-capture patients who don't have a future appointment set with us. Part of that process will include emails. Those emails will point back to our website to request an appointment. Now to the question... Is there anything special we should do to assure that links coming to the website and the resulting appointment request goal conversions track appropriately and appear under "Email" in the Default Channel Group of Analytics > Acquisition > All Traffic > Channels area of GA? For example, should we use Campaign URL Builder to establish UTM links? Thanks in advance for any feedback. Erik
Reporting & Analytics | | SmileMoreSEO0 -
How To Stop Google's "Fetch & Render" From Showing Up In Google Analytics
Hi all, Within Google's "Fetch & Render" (found in Google Search Console) is the ability to index certain pages from my website on-demand. Unfortunately, every time I ask Google to index a page, it registers as a bounce in Google Analytics. Also, if it means anything, my website (www.knowtro.com) is a single-page application, functioning similarly to Google. If you guys know of any solution to this problem, please help! I originally thought that Google would know to block its own Fetch & Render crawler from Google Analytics but that doesn't seem to be the case. Thanks, Austin
Reporting & Analytics | | A_Krauss0 -
Query on Google Experiment?
Hello All, I am doing A/B testing via google analytic experiment now my query is for my ecommerce site homepage i am trying to add newsletter in 3 different way so it will be variation A, Variation B and Variation C. So my query is what should be then original page? Currently there is no newsletter form on homepage. Do I consider original page as Variation A? i.e. abcd.com?variation-A as original page? Then google will decide winner between original page i.e. variation A and Variation B & C Thanks!
Reporting & Analytics | | dsouzac0 -
Not many pages being indexed on google
Hi I am putting in to Google: site:www.mysite.com to see the pages listed on Google - the figure Google is coming back with is much lower than the actual pages, I have no crawer warning etc... What could the problem be? Thanks
Reporting & Analytics | | acumenadagency0 -
Google Analytics: Multi channel funnel
Hi 🙂 I have a little problem. In Multi-channel Funnel Overview I see 50 conversions from Paid Search (screenshot 1). But when I click on Assisted Conversion and then choose Paid Search, I see 31 Assisted Conversions and 32 Last Interaction Conversion. (screenshot 2) So my question is - why the number of converstions in overview (50) is different than number in Assisted Conversions (assisted or last interaction conversion, or both together)? Probably, the answer is so simply, but I can found out it! 🙂 thanks a lot. X6UihL7.png lCNsw4T.png
Reporting & Analytics | | visibilitysk0 -
Google Analytics and backlinking
Let say I have my main site and my secondary site that is optimized for a slightly different set of keywords (nonetheless still relevant to my main site). I have several links from a secondary site to my main site. Secondary site is on a different C-block. Do you ladies and gentlemen think that if I put both websites under the same google analytics account, Google is going to penalize me or remove some of the juice that is flowing from secondary site to the main site because it would detect through GA that both sites belong to the same entity?
Reporting & Analytics | | SirMax0 -
URL offline advertising
Hi there, I am in a bit of a dilemma, we are going to be doing some TV advertising and using the URL example.com/tv I want this to take the user to the product that we are advertising example.com/product For best practice should have a 301 redirect on /tv going to /product? We are also doing magazine, newspaper advertising also, so the same question applies. Kind Regards
Reporting & Analytics | | Paul780 -
Get Stats on Search Box Usage, Using Google Analytics?
Let me preface this by first saying I am NOT using the Google Adsense Search feature. The question I am asking is pertaining to the standard search box that comes already coded in most .php blogs. In the Google Analytics, is there a way to tell how many people are searching using the search box? I've looked through the navigation and pathway options in analytics and I don't seem to see anything that definitively points to the number of people using the search box but, perhaps, I am overlooking it. Any insight?
Reporting & Analytics | | ChristineCadena0