How to make google crawl our repository to make our site rank but make sure users dont go to our repository ?
-
We have a website that has links to documents related to various sectors. But the challenge is we do not have the documents on the website itself and they are linked to our document repository that has been blocked to google. We have put nofollow and noindex to the repository. Since Google can not read those documents, it has resulted in an impact in our SEO ranking. What would be the best way to make Google crawl the PDF documents in the repository at the same time make it invisible the "repo" not appear in the search engines. Would dofollow and noindex sequence work ?
-
Playing with indexation tags can be dangerous (same goes for robots.txt). Google should still be able to read the repo even if it is no-indexed, as long as you haven't also blocked the repo in robots.txt. Robots.txt is telling Google what to crawl, no-index is telling Google what it can or can-not put in its search results
Of course, if your docs were ranking because of PageRank passed from the repo, the no-index tag will kill the PageRank of the repo (and thus all the docs which it links to, as they are not being 'fed' any more). If a page is no-indexed, it's seen as unimportant for Google and the PageRank is often nullified. Although Google can crawl no-indexed URLs, they crawl them WAY slower as they're seen as really unimportant with no PageRank (at the bottom of the internet)
Why not just put all your PDF docs in a PDF sitemap ans submit to Google in Search Console:
https://stackoverflow.com/questions/1072880/should-i-list-pdfs-in-my-sitemap-file
This will let Google see them all. But if their parent is no-indexed with no PageRank, they may still not rank as well as before...
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Setting up a remote business with their Google Business Account
Hi all, I have a client who operates a remote business and I need to get her Google business/ brand account set up. She doesn't want it listed under her home address (for obvious reasons) but that is where her business is based out of. Apart from getting a PO box and listing her business under that for Google, does anybody know of any other options or best practices? Thanks!
SEO Learn Center | | Zx30 -
Backlink From Different Language Sites Will Spoil My Ranking?
Hi there! Excited to joining this community. The main question is that if I get backlinks from different language sites then that backlink will be worthy or non-worthy in the eye of search engine? I know if I target international market by presenting my content in different languages then of course it will be worthwhile for me. But what will be happened if I do not represent content in different languages on my site but get the backlines from other language sites such as: Chinese, Russian or any other? Also I have seen many sites which are getting backlinks from different language sites and they are just getting high authority. Is there any expert?
SEO Learn Center | | mianarfan3331 -
Best practice to consolidate two Google accounts
Hello, I have two Google accounts. Account1 is XYZ@gmail.com - This account is used for Gmail, Blogger, Google Photo etc... Account2 is YXZ@companyname.com - This account is where Adword, Google Analytics, Webmaster etc.. I'd like to know the SEO best practice and how to use these two accounts. I know that Google currently don't have account consolidation feature. What are my options to merge these two account? I already have the blogger site in GA and webmaster.
SEO Learn Center | | LCEComm0 -
Index Page Dropped From Rankings
On average my site was getting ranked 3rd for "Tucson DUI Lawyer", Best Tucson DUI Lawyer, Tucson DUI attorney and etc. Recently my website fell for all of these keywords and I thought it is the best time to launch the new website. The problem is that my internal pages show up for some of the keywords on the third or fourth page but my index page doesn't show for any of them. Does it have anything to do with the site structure ? I have a lot of news excerpts on the homepage with links to the main posts. Here is the link: http://www.michaelharwinlaw.com/ Any help is sincerely appreciated.
SEO Learn Center | | yasinyaqoobi0 -
How much dev knowledge as an seo do I need to know in order to make small changes on websites?
Hi mozzers I am considering learning some dev just to be able to make minor changes on websites. I love seo but will never want to be a programmer. I get sometimes frustrated that I have to request my dev colleague to make minor changes such as adding a small piece of codes to a website for verification purposes or adding rich snippet or modifying the ga code to get more out of it. I know some HTML and understands the core elements and attributes. My first question would be: what should I learn without learning A-Z of programming? My guess would be some php and? My second question: based on your answer where can I learn about these programs? Any interactive learning services such as team treehouse ? Any online courses? Thanks!
SEO Learn Center | | Ideas-Money-Art1 -
How to ask Google to remove old pages that don't exist
I have moved a site to a new location. There are a number of pages that date back to 2012 and 2011 and we do not want them anymore. Is there a way to ask Google to remove these pages entirely.
SEO Learn Center | | mayanksaxena0 -
Google plus provides dofollow or nofollow backlinks?
I see my webmaster full of backlinks coming from sites like Google.com(plus) Twitter.com(tweets) Stumbleupon chime Scoop.it 1.Are these backlinks follow or nofollow? 2.Follow or nofollow backlinks surely do not pass PR effect but do the nofollow backlink helpful in rank or not?
SEO Learn Center | | csfarnsworth0 -
Are there any plans for a new SEOmoz ranking factors report?
The latest SEOmoz search ranking factors report I seem to find is dated 2011 http://www.seomoz.org/article/search-ranking-factors - any plans for an updated version at all?
SEO Learn Center | | Clicksjim2