Launching Website
-
We are developing a new website and thinking google would not find it because of the directory we put it in (no homepage yet) and because there are no links to it. For example, we are building it in this directory example.com/wordpress/ but somehow google found it and indexed pages not ready to be indexed.
What should we do to stop this until we are ready to launch? Should we just use a robots.txt file with this in it?
User-agent: *
Disallow: /Will this create repercussions when we officially launch?
-
Thank you
-
Thanks!
-
You are correct with your approach.
And as Paddy states, once you launch, remove the disallow and the crawlers will find you.
I would also suggest that once you launch that you submit a sitemap to all of the major search engines to be found even quicker and to help ensure that all of your site pages are crawled.
Mike
-
yes, use the robots file to deindex, once your ready to launch remove the disallow, and the next time google crawls your site you should get indexed.
you must have been linked from somewhere for google to find you, so it means google will find you quicker once you ready to launch ( you already have a backlink)
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Using one robots.txt for two websites
I have two websites that are hosted in the same CMS. Rather than having two separate robots.txt files (one for each domain), my web agency has created one which lists the sitemaps for both websites, like this: User-agent: * Disallow: Sitemap: https://www.siteA.org/sitemap Sitemap: https://www.siteB.com/sitemap Is this ok? I thought you needed one robots.txt per website which provides the URL for the sitemap. Will having both sitemap URLs listed in one robots.txt confuse the search engines?
Technical SEO | | ciehmoz0 -
Drop in keyword rankings with a multi-region website
Hi everyone, I know that variations if this question have been asked on this forum and have been answered by Google also. Google's response seems to be clear that "Websites that provide content for different regions and in different languages sometimes create content that is the same or similar but available on different URLs. This is generally not a problem as long as the content is for different users in different countries." This was our approach when launching a new .co.nz website recently to coincide with us opening a new office in Auckland. Our original site is still our .com.au site. We went with a new domain name over a sub directory or sub domain for the reasons in the same Google article. After launching the NZ site in February and steadily growing some rankings, we've noticed in the last week or so a drastic drop in our keyword rankings (and traffic) for no apparent reason. There are no apparent issues in Search Console or with the Moz Site Crawl, so I'm wondering what's going on? I know rankings can fluctuate widely, especially when you're not on page 1 (which we're not) but the sudden and drastic drop did concern me. Currently, our AUS site's content is basically being replicated on the NZ site (e.g. blog posts, about us, company history, etc.). I just wanted to bounce it off you all to see whether you think it could be the "duplicate content" on the NZ site, or could it be something else? I'd really appreciate your input! Cheers, Nathan
Technical SEO | | reichey0 -
How preproduction website is getting indexed in Google.
Hi team, Can anybody please help me to find how my preproduction website and urls are getting indexed in Google.
Technical SEO | | nlogix0 -
Launch of improved site
Hi, Just want to ask you guys if i have missed something in my planning. We have done a migration from Ithemes Exchange to woocommerce. The complete migration are done on our dev server. It has an exakt setup as our live one. My plan is to change our live version with a backup from our migrated and finished site from our dev site. All of our product links will be intact with accept from some that we have combined in to new ones, the ones that are changed has been redirected with a 301. Will this way of launching our site effect our ranking/seo in some way? Thankful for any thoughts about this one! // Jonas
Technical SEO | | knubbz0 -
Website redesign: impact on SEO rankings?
Hi We're redesigning a website for a client whose SEO rankings are fairly strong, and are driving a good volume of enquiries through their website. We would like to do our best to ensure the redesign has a minimal impact on the rankings but aren't sure if there's anything in particular we should be doing to avert a severe dip in results. The content will be similar on many pages, with the major updates being from 2013 products to the 2014 suite. Layouts and images will, of course be updated, and we're going to do our best to keep the inbound links going to the correct place - any advice here would be much appreciated, too. We'd be really grateful for any suggestions for how to avoid a ranking disaster, and any major pitfalls we should look out for. Many thanks.
Technical SEO | | Kal-SEO0 -
A website that will not load on a particular computer? Help Me Please!
We took on a new client about two weeks ago, took them off a proprietary CMS, placed them on a WordPress site, optimized the site, etc. and were finishing up small details three days ago. My PC in my personal office all of a sudden would not load the site from a Google search, from a direct url, etc.
Technical SEO | | RobertFisher
Our office was using a D-Link wireless router but my PC is hardwired in the office. I cranked up my MacBook Pro with solid state drive (6 months old), got on wireless, and....site would not load. PC's and Macs in offices around me would all load the site. A search online brought up a fix for the PC and tried it - did not work, had lead dev try it - did not work, called a server side friend and he had never heard of such a thing. Every fix revolved around changing IP addresses, etc. I uninstalled my antivirus programs on my PC, installed every update that was outstanding, there was no new software installed on either box prior to problem. Can you help??? Is there any chance someone not associated with us and just looking for my client or someone entering a direct url could experience?0 -
Why is my website banned?
IMy website is Costume Machine at www.costumemachine.com . My site has been banned for 1 year now. I have requested that google reconsider my site 3 times without luck. The site is dynamic and basically pulls in feeds from affiliate sites. We have added over 1,500 pages of original content. The site has been running great since 2008 without any penalties. I don't think I got hit with any linking penalty. I cleaned up all questionable links last November when the penalty hit. Am I being hit with a "thin" site penalty? If that is the issue what is the best way to fix the problem?
Technical SEO | | tadden0 -
Issue of my website Google Penalty or Recent Algorithm Changes only!
I recently faced issue of Google recent algo update on my main website. I found my ranks were all of 5th to 7th page even with website name without .com at end we have 5th page shown our biz website. It was a news portal and behind in subdomain i was running my web hosting website. 1. I removed all news content from my website since i thought the news agency send me content send same content to others may cause in the issue so i removed the NEWS AREA 2. I am turn off all of my old subscriptions or membership of blog networks etc. to make sure i get proper good backlinks with good research etc. Is there anybody who can suggest me what shall i take more action ? Mean any kind of further good suggestion i will highly appreciate if anyone can help me with any suggestions of SEO. I know there are many people who knows lots about it thus i thought to ask to community.. I am also unsure its a Google panelty or a Google recent update negative changes to my website ? However i have already filled reconsideration request as an possible alternative by explaining google that we are no more NEWS CONTENT Website. Will wait for responses...
Technical SEO | | anand20100