undefined
Skip to content
Moz logo Menu open Menu close
  • Products
    • Moz Pro
    • Moz Pro Home
    • Moz Local
    • Moz Local Home
    • STAT
    • Moz API
    • Moz API Home
    • Compare SEO Products
    • Moz Data
  • Free SEO Tools
    • Domain Analysis
    • Keyword Explorer
    • Link Explorer
    • Competitive Research
    • MozBar
    • More Free SEO Tools
  • Learn SEO
    • Beginner's Guide to SEO
    • SEO Learning Center
    • Moz Academy
    • SEO Q&A
    • Webinars, Whitepapers, & Guides
  • Blog
  • Why Moz
    • Agency Solutions
    • Enterprise Solutions
    • Small Business Solutions
    • Case Studies
    • The Moz Story
    • New Releases
  • Log in
  • Log out
  • Products
    • Moz Pro

      Your all-in-one suite of SEO essentials.

    • Moz Local

      Raise your local SEO visibility with complete local SEO management.

    • STAT

      SERP tracking and analytics for enterprise SEO experts.

    • Moz API

      Power your SEO with our index of over 44 trillion links.

    • Compare SEO Products

      See which Moz SEO solution best meets your business needs.

    • Moz Data

      Power your SEO strategy & AI models with custom data solutions.

    NEW Keyword Suggestions by Topic
    Moz Pro

    NEW Keyword Suggestions by Topic

    Learn more
  • Free SEO Tools
    • Domain Analysis

      Get top competitive SEO metrics like DA, top pages and more.

    • Keyword Explorer

      Find traffic-driving keywords with our 1.25 billion+ keyword index.

    • Link Explorer

      Explore over 40 trillion links for powerful backlink data.

    • Competitive Research

      Uncover valuable insights on your organic search competitors.

    • MozBar

      See top SEO metrics for free as you browse the web.

    • More Free SEO Tools

      Explore all the free SEO tools Moz has to offer.

    NEW Keyword Suggestions by Topic
    Moz Pro

    NEW Keyword Suggestions by Topic

    Learn more
  • Learn SEO
    • Beginner's Guide to SEO

      The #1 most popular introduction to SEO, trusted by millions.

    • SEO Learning Center

      Broaden your knowledge with SEO resources for all skill levels.

    • On-Demand Webinars

      Learn modern SEO best practices from industry experts.

    • How-To Guides

      Step-by-step guides to search success from the authority on SEO.

    • Moz Academy

      Upskill and get certified with on-demand courses & certifications.

    • MozCon

      Save on Early Bird tickets and join us in London or New York City

    Unlock flexible pricing & new endpoints
    Moz API

    Unlock flexible pricing & new endpoints

    Find your plan
  • Blog
  • Why Moz
    • Small Business Solutions

      Uncover insights to make smarter marketing decisions in less time.

    • Agency Solutions

      Earn & keep valuable clients with unparalleled data & insights.

    • Enterprise Solutions

      Gain a competitive edge in the ever-changing world of search.

    • The Moz Story

      Moz was the first & remains the most trusted SEO company.

    • Case Studies

      Explore how Moz drives ROI with a proven track record of success.

    • New Releases

      Get the scoop on the latest and greatest from Moz.

    Surface actionable competitive intel
    New Feature

    Surface actionable competitive intel

    Learn More
  • Log in
    • Moz Pro
    • Moz Local
    • Moz Local Dashboard
    • Moz API
    • Moz API Dashboard
    • Moz Academy
  • Avatar
    • Moz Home
    • Notifications
    • Account & Billing
    • Manage Users
    • Community Profile
    • My Q&A
    • My Videos
    • Log Out

The Moz Q&A Forum

  • Forum
  • Questions
  • Users
  • Ask the Community

Welcome to the Q&A Forum

Browse the forum for helpful insights and fresh discussions about all things SEO.

  1. Home
  2. Research & Trends
  3. White Hat / Black Hat SEO
  4. Forcing Google to Crawl a Backlink URL

Moz Q&A is closed.

After more than 13 years, and tens of thousands of questions, Moz Q&A closed on 12th December 2024. Whilst we’re not completely removing the content - many posts will still be possible to view - we have locked both new posts and new replies. More details here.

Forcing Google to Crawl a Backlink URL

White Hat / Black Hat SEO
3
8
1.9k
Loading More Posts
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as question
Log in to reply
This topic has been deleted. Only users with question management privileges can see it.
  • Choice
    Choice Subscriber last edited by Dec 8, 2014, 2:49 PM

    I was surprised that I couldn't find much info on this topic, considering that Googlebot must crawl a backlink url in order to process a disavow request (ie Penguin recovery and reconsideration requests).

    My trouble is that we recently received a great backlink from a buried page on a .gov domain and the page has yet to be crawled after 4 months. What is the best way to nudge Googlebot into crawling the url and discovering our link?

    1 Reply Last reply Reply Quote 0
    • RangeMarketing
      RangeMarketing @Choice last edited by Dec 8, 2014, 7:42 PM Dec 8, 2014, 7:42 PM

      No problem!

      1 Reply Last reply Reply Quote 0
      • Choice
        Choice Subscriber @TheeDigital last edited by Dec 8, 2014, 7:22 PM Dec 8, 2014, 7:22 PM

        Appreciate the ideas. I am considering pointing a link at it, but this requires a little more thought and effort to do so ethically. But, at this point, it's probably my best option. Thanks!

        1 Reply Last reply Reply Quote 0
        • TheeDigital
          TheeDigital last edited by Dec 8, 2014, 6:31 PM Dec 8, 2014, 6:31 PM

          You might try pinging the site out or just building a link to the site.

          Choice 1 Reply Last reply Dec 8, 2014, 7:22 PM Reply Quote 3
          • Choice
            Choice Subscriber last edited by Dec 8, 2014, 4:21 PM Dec 8, 2014, 4:21 PM

            Both are good ideas. Thank you!

            RangeMarketing 1 Reply Last reply Dec 8, 2014, 7:42 PM Reply Quote 0
            • RangeMarketing
              RangeMarketing @Choice last edited by Dec 8, 2014, 4:17 PM Dec 8, 2014, 4:17 PM

              Ahhhh, that's a bummer.

              Well, you could try to submit a URL from the .gov site that isn't as buried but links to the URL you want crawled.

              You could try emailing someone that manages the website, giving them a helpful reminder that they have quality pages not being indexed regularly by Google 😉

              Good luck!

              1 Reply Last reply Reply Quote 1
              • Choice
                Choice Subscriber last edited by Dec 8, 2014, 3:10 PM Dec 8, 2014, 3:10 PM

                Thanks for the suggestion! But I should have mentioned in the original post that I've submitted twice via Submit URL form and the url has yet to show up in Latest Links in Webmaster Tools.

                RangeMarketing 1 Reply Last reply Dec 8, 2014, 4:17 PM Reply Quote 0
                • RangeMarketing
                  RangeMarketing last edited by Dec 10, 2014, 7:49 PM Dec 8, 2014, 3:00 PM

                  You could try the URL submit tool: https://www.google.com/webmasters/tools/submit-url

                  1 Reply Last reply Reply Quote 1
                  • 1 / 1
                  1 out of 8
                  • First post
                    1/8
                    Last post

                  Got a burning SEO question?

                  Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.


                  Start my free trial


                  Browse Questions

                  Explore more categories

                  • Moz Tools

                    Chat with the community about the Moz tools.

                  • SEO Tactics

                    Discuss the SEO process with fellow marketers

                  • Community

                    Discuss industry events, jobs, and news!

                  • Digital Marketing

                    Chat about tactics outside of SEO

                  • Research & Trends

                    Dive into research and trends in the search industry.

                  • Support

                    Connect on product support and feature requests.

                  • See all categories

                  Related Questions

                  • jogobicho

                    High Rank and Traffic of low DA and Backlinks

                    Hi guys, is a pleasure being a part of this community, hope in learning a lot with you guys, i just started a year learning about SEO and it been a big journey. I was looking at some competition of some websites that i been optmizing, and i found a website that called my attention and i cant figure out whats going on, it haves huge traffic but in terms of technicall SEO is really week, and not just this but also in terms of DA and backlinks (most of them spammy - 20 backlinks), the domain in question is bhnews.com.br I notice that doesnt have any social media, not analytics, etc. The only thing that i notice is that there is a website or a company called "BH news" (televesion), but its not related with it, since the type of information that bhnews.com.br presents is "lottery" results. So this kind of situation confuses me a lot, because is a lot of hard work in optmizing a website to rank in google, and than i come a across with this type of website with 20 backlinks (most of anchor or name of domain), and than haves like 2M visits per month and ranks for keywords related with the this type of sites of lottery. Can someone tell me if there is some kind of black seo, or something that is making this rank so high? regards

                    White Hat / Black Hat SEO | Apr 30, 2021, 8:00 PM | jogobicho
                    0
                  • xaviplabor

                    Malicious backlinks

                    Hello to everyone! We have identified some weird links that are pointing to our site and we are not sure if they are considered malicious backlinks and we should disavow them. Most of them are directories of websites, the most common one is called "Top million domains by alexa" (you can see an example here: www.besafe.in/domain-list-237). Have you ever seen these kind of links before? Are they causing harm to our site? Thank you so much!

                    White Hat / Black Hat SEO | Jun 20, 2024, 9:06 AM | xaviplabor
                    0
                  • CayenneRed89

                    Advice needed! How to clear a website of a Wordpress Spam Link Injection Google penalty?

                    Hi Guys, I am currently working on website that has been penalised by Google for a spam link injection.  The website was hacked and 17,000 hidden links were injected. All the links have been removed and the site has subsequently been redesigned and re-built.  That was the easy part 🙂 The problems comes when I look on Webmaster.  Google is showing 1000's of internal spam links to the homepage and other pages within the site.  These pages do not actually exist as they were cleared along with all the other spam links. I do believe though this is causing problems with the websites rankings.  Certain pages are not ranking on Google and the homepage keyword rankings are fluctuating massively. I have reviewed the website's external links and these are all fine. Does anyone have any experience of this and can provide any recommendations / advice for clearing the site from Google penalty? Thanks, Duncan

                    White Hat / Black Hat SEO | Oct 8, 2015, 10:26 PM | CayenneRed89
                    0
                  • carlystemmer

                    How/Why do I have so many Spam backlinks?

                    I was looking in GWT yesterday and found we have several thousand "spam" backlinks...I am curious why this happens and how this happens? There are some links from websites/domains that are not mine that appear to be spam. However, we own a large group of domains and have noticed some of the links are coming from 2 of those sites/domains we own to my main site. The sites/domains are not active, we just own them. I am wondering how someone could access these domains that are not active and create spammy backlinks to my main website? (They created about 20,000 links). Thanks.

                    White Hat / Black Hat SEO | Jun 9, 2015, 1:17 PM | carlystemmer
                    0
                  • Patrick_G

                    Ever seen this tactic when trying to get rid of bad backlinks?

                    I'm trying to get rid of a Google penalty, but one of the URLS is particularly bizarre. Here's the penalized site: http://www.travelexinsurance.com. One of the external links Google cited as not being natural that links to the penalized site is: http://content.onlineagency.com/index.aspx?site=6599&tide=769006&last=3111516 In the backlink profile of the penalized site, there are about 100 different backlinks pointing to www.travelexinsurance.com from content.onlineagency.com/... So when I visit  http://content.onlineagency.com/index.aspx?site=6599&tide=769006&last=3111516 it actually is displaying content from http://www.starmandstravel.com/787115_6599.htm, which you can see after clicking the "Home" button. That company is a legit travel agency who I assume knows nothing about content.onlineagency.com and is not involved in whatever is going on. And that's the case for every link from content.onlineagency.com. So I'm just wondering if someone can help me understand what sort of tactic  content.onlineagency.com is using. One of my predecessors I fear used some black hat tactics. I'm wondering if this is a remnant of that effort.

                    White Hat / Black Hat SEO | Nov 26, 2014, 7:56 PM | Patrick_G
                    0
                  • kirmeliux

                    Thumbtack Blatantly Violating Google TOS?

                    Hi, We have a business registered on Thumbtack so we receive their newsletters. I'm aware that review sites offering a "badge" or verification logo which links back to your profile is nothing new. But the email I received from Thumbtack is a fairly blatant attempt to game Google for popular keywords. I was just curious on your thoughts about this. I believe it was Overstock who did something like this and got slapped by Google pretty hard for a while. Could Thumbtack be heading down the same path? Image: http://i.imgur.com/FWPnmEP.jpg

                    White Hat / Black Hat SEO | Jun 12, 2015, 12:44 PM | kirmeliux
                    0
                  • k9byron

                    Finding and Removing bad backlinks

                    Ok here goes. Over the past 2 years our traffic and rankings have slowly declined, most importantly, for keywords that we ranked #1 and #2 at for years. With the new Penguin updates this year, we never saw a huge drop but a constant slow loss. My boss has tasked me with cleaning up our bad links and reshaping our link profile so that it is cleaner and more natural. I currently have access to Google Analytics and Webmaster Tools, SEOMoz, and Link Builder. 1)What is the best program or process for identifying bad backlinks? What exactly am I looking for? Too many links from one domain? Links from Low PR or low “Trust URL” sites? I have gotten conflicting information reading about all this on the net, with some saying that too many good links(high PR) can be unnatural without some lower level PR links, so I just want to make sure that I am not asking for links to be removed that we need to create or maintain our link profile. 2)What is the best program or process for viewing our link profile and what exactly am I looking for? What constitutes a healthy link profile after the new google algorithm updates? What is the best way to change it? 3)Where do I start with this task? Remove spammy links first or figure out or profile first and then go after bad links? 4)We have some backlinks that are to our old .aspx that we moved to our new platform 2 years ago, there are quite a few (1000+). Some of these pages were redirected and some the redirects were broken at some point. Is there any residual juice in these backlinks still? Should we fix the broken redirects, or does it do nothing?  My boss says the redirects wont do anything now that google no longer indexes the old pages but other people have said differently. Whats the deal should we still fix the redirects even though the pages are no longer indexed? I really appreciate any advice as basically if we cant get our site and sales turned around, my job is at stake. Our site is www.k9electronics.com if you want to take a look. We just moved hosts so there are some redirect issues and other things going on we know about.

                    White Hat / Black Hat SEO | Nov 27, 2012, 6:27 PM | k9byron
                    0
                  • tomypro

                    Interesting case of IP-wide Google Penalty, what is the most likely cause?

                    Dear SEOMOZ Community, Our portfolio of around 15 internationalized web pages has received a significant, as it seems IP-wide, Google penalty starting November 2010 and have yet to recover from it. We have undergone many measure to lift the penalty including reconsideration requests wo/ luck and am now hoping the SEOMoz community can give us some further tips. We are very interested in the community's help and judgement what else we can try to uplift the penalty. As quick background information, The sites in question offers sports results data and is translated for several languages. Each market, equals language, has its own tld domain using the central keyword, e.g. <keyword_spanish>.es <keyword_german>.de <keyword_us>.com</keyword_us></keyword_german></keyword_spanish> The content is highly targeted around the market, which means there are no duplicate content pages across the domains, all copy is translated, content reprioritized etc. however the core results content in the body of the pages obviously needs to stay to 80% the same A SEO agency of ours has been using semi-automated LinkBuilding tools in mid of 2010 to acquire link partnerships There are some promotional one-way links to sports-betting and casino positioned on the page The external linking structure of the pages is very keyword and main-page focused, i.e. 90% of the external links link to the front page with one particular keyword All sites have a strong domain authority and have been running under the same owner for over 5 years As mentioned, we have experienced dramatic ranking losses across all our properties starting in November 2010. The applied penalties are indisputable given that rankings dropped for the main keywords in local Google search engines from position 3 to position 350 after the sites have been ranked in the top 10 for over 5 years. A screenshot of the ranking history for one particular domain is attached. The same behavior can be observed across domains. Our questions are: Is there something like an IP specific Google penalty that can apply to web properties across an IP or can we assume Google just picked all pages registered at Google Webmaster? What is the most likely cause for our penalty given the background information? Given the drops started already in November 2010 we doubt that the Panda updates had any correlation t this issue? What are the best ways to resolve our issues at this point? We have significant history data available such as tracking records etc. Our actions so far were reducing external links, on page links, and C-class internal links Are there any other factors/metrics we should look at to help troubleshooting the penalties? After all this time wo/ resolution, should we be moving on two new domains and forwarding all content as 301s to the new pages? Are the things we need to try first? Any help is greatly appreciated. SEOMoz rocks. /T cxK29.png

                    White Hat / Black Hat SEO | Aug 12, 2011, 9:06 AM | tomypro
                    0

                  Get started with Moz Pro!

                  Unlock the power of advanced SEO tools and data-driven insights.

                  Start my free trial
                  Products
                  • Moz Pro
                  • Moz Local
                  • Moz API
                  • Moz Data
                  • STAT
                  • Product Updates
                  Moz Solutions
                  • SMB Solutions
                  • Agency Solutions
                  • Enterprise Solutions
                  Free SEO Tools
                  • Domain Authority Checker
                  • Link Explorer
                  • Keyword Explorer
                  • Competitive Research
                  • Brand Authority Checker
                  • Local Citation Checker
                  • MozBar Extension
                  • MozCast
                  Resources
                  • Blog
                  • SEO Learning Center
                  • Help Hub
                  • Beginner's Guide to SEO
                  • How-to Guides
                  • Moz Academy
                  • API Docs
                  About Moz
                  • About
                  • Team
                  • Careers
                  • Contact
                  Why Moz
                  • Case Studies
                  • Testimonials
                  Get Involved
                  • Become an Affiliate
                  • MozCon
                  • Webinars
                  • Practical Marketer Series
                  • MozPod
                  Connect with us

                  Contact the Help team

                  Join our newsletter
                  Moz logo
                  © 2021 - 2025 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
                  • Accessibility
                  • Terms of Use
                  • Privacy

                  Looks like your connection to Moz was lost, please wait while we try to reconnect.