How can I remove parameters from the GSC URL blocking tool?
-
Hello Mozzers
My client's previous SEO company went ahead and blindly blocked a number of parameters using the GSC URL blocking tool. This has now caused Google to stop crawling many pages on my client's website and I am not sure how to remove these blocked parameters so that they can be crawled and reindexed by Google.
The crawl setting is set to "Let Google bot decide" but still there has been a drop in the number of pages being crawled. Can someone please share their experience and help me delete these blocked parameters from GSC's URL blocking tool.
Thank you Mozzers!
-
Hi Vincent,
My short answer is: don't let Googlebot decide. Tell Googlebot which parameters should or should not create new pages. This is something you should do if you ever have indexation problems with parameters.
Do a site: search for a handful of these URLs with parameters to double check that the drop in the number of pages being crawled is because of these pages or because of something else. If it is because of these pages, you can quickly add them back to the index by using the "Fetch as Googlebot" tool. Once you have Google fetch something, you have the option of submitting it to the index.
(If it turns out the drop in crawled pages is from something else, a good way to figure out which pages are being affected is by creating multiple XML sitemaps and organizing them by site section, so when Google reports on how many of your URLs are in its index, you quickly know which section of the site is being affected. This post is really old, but still incredibly useful here.)
Double check that these URLs with parameters are in the XML sitemap, and that you have a number of internal links on prominent pages pointing to them. Even if these can only be temporary, those links will really help the process.
Hope this helps!
Kristina
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Blocking Standard pages with Robots.txt (t&c's, shipping policy, pricing & privacy policies etc)
Hi I've just had best practice site migration completed for my old e-commerce store into a Shopify environment and I see in GSC that it's reporting my standard pages as blocked by robots.txt, such as these below examples. Surely I don't want these blocked ? is that likely due to my migrators or s defaults setting with Shopify does anyone know? : t&c's shipping policy pricing policy privacy policy etc So in summary: Shall I unblock these? What caused it Shopify default settings or more likely my migration team? All Best Dan
Reporting & Analytics | | Dan-Lawrence0 -
How can I overwrite previously imported cost data in Google Analytics?
I choose the overwrite option but it keeps adding the costs to the existing costs. When i select that radio button and click done, that option does not appear on the summary screen. That section next to Import Behavior is blank.
Reporting & Analytics | | JGB5550 -
How to find goo.gl/ URLs in Google Analytics
Hello! How does one go about finding the impact of goo.gl/ shortened URLs in Google Analytics? (I know I should be using Campaigns, but this was for an old project.) Thanks in advance! Erik
Reporting & Analytics | | SmileMoreSEO0 -
Regex Filter To Exlude lower case urls
Buon Pormeriggio from Wetherby 22 degrees the summer continues! I need to set up a regex filter to knock out lowecase versions of http://www.sandersonweatherall.co.uk/Sales/ Thing is Analytics is returning this lowercase version which i want to regex filter out.So if Regex filter /Sales/$ returns what i eant how do i knock out urls beginning with lowe case s. Grazie,
Reporting & Analytics | | Nightwing
David0 -
Webmaster tools traffic on one keyword dropped through the floor - ideas?
Hi there, We design and sell our own product range in a narrow niche, and we are also stocked by Amazon and a lot of other big retailers in the UK. During the first two weeks of Dec 2012 the position of one of our main keywords, which was in google SERPs on page 1 (8 or 9), dropped to page 4. The keyword describes the niche we're in. The drop is shown in the webmaster tools traffic report for that keyword. But it's the only one of our keywords where this has happened, and furthermore it hasn't happened for variations of the keyword. And in Adwords our quality score for the keyword is 10 For example say we were making and selling shopping trolleys - our keyword "shopping trolleys" has dropped through the floor, but "shopping trolleys (on) wheels" is just fine. Can anyone shed any light on what's going on here? Losing this one keyword has cost us some good organic traffic. i1uxSlB.png
Reporting & Analytics | | w1ll1am0 -
Is there a tool to automatically gather website SEO data?
I am looking for a tool that will crawl a website and create a spreadsheet listing out all key data such as title, meta description, etc. Anyone know of an available tool to do that?
Reporting & Analytics | | jfeitlinger0 -
Why is Webmaster Tools not Linking Correctly Google Analytics?
I have a global site with .com as the US site and then /country for all other markets i.e. .com/uk .com/de etc. Each site has it's own WMT profile. Each site has it's own GA profile. Since Google added Search Engine Optimization to the GA interface, I can't track these sites separately under this new feature. It seems to me that it can only be associated with a single WMT profile at a time or rather that WMT can only be associated with a single GA profile at a time. The numbers for the UK and US site are identical, but when I try and link the UK WMT account with GA it removes it from the US profile and vice versa.
Reporting & Analytics | | Red_Mud_Rookie0 -
Links and index missing from Google Webmaster Tools!
I've been using a wordpress blog and using google analytics and webmaster tools. I'd never done very much optimizing of my site, my strategy had always been to just keep writing relevant posts and let google do the rest. At some point I installed a SEO plugin to wordpress and did a tiny amount of tweaking, but I noticed that in my webmaster tools page, all my "links to this site" links are gone! My site map says 42 pages submitted, 42 pages indexed, but all the links that I've built over the past few years are missing, and I also notice that I can't find my main landing page in the index anymore. I know there are indexed sites out there that link to me, but they aren't being reflected anymore. Did I anger google by using SEO plugins within wordpress? I'm fairly certain I wasn't doing anything sketchy. Http://brodiegraphics.com RTOH6.png
Reporting & Analytics | | HELPeR0