Launching Website
-
We are developing a new website and thinking google would not find it because of the directory we put it in (no homepage yet) and because there are no links to it. For example, we are building it in this directory example.com/wordpress/ but somehow google found it and indexed pages not ready to be indexed.
What should we do to stop this until we are ready to launch? Should we just use a robots.txt file with this in it?
User-agent: *
Disallow: /Will this create repercussions when we officially launch?
-
Thank you
-
Thanks!
-
You are correct with your approach.
And as Paddy states, once you launch, remove the disallow and the crawlers will find you.
I would also suggest that once you launch that you submit a sitemap to all of the major search engines to be found even quicker and to help ensure that all of your site pages are crawled.
Mike
-
yes, use the robots file to deindex, once your ready to launch remove the disallow, and the next time google crawls your site you should get indexed.
you must have been linked from somewhere for google to find you, so it means google will find you quicker once you ready to launch ( you already have a backlink)
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Spam: how to filter out direct website visitors from Ukraine and Germany
Hi there, I was reading this article: https://moz.com/blog/stop-ghost-spam-in-google-analytics-with-one-filter as I am experiencing a lot of visitors from Ukraine and Germany as direct website visitors with only 1 pageview, a huge bounce rate (of course) and little time spend, so I am convinced its spam. In the article, it explains how to find the hostname to set up a filter but if I do so, I see that the highest amount of website visitors with this behavior come from the hostname that has my own domain name in it, so I can't exclude this. What should I do?
Technical SEO | | MarketingRumors0 -
Some questions about URL structure and multi country website
Gajanand angela dayHi,
Technical SEO | | Shahjahaaan
I have a question from SEO experts and web developers.
I want to setup a job website for 5 countries. for each country i will provide daily jobs listing on the basis of
1. jobs by categories - for example : accounting jobs. IT jobs, Sales jobs
2. jobs by city - for example : jobs in boston, jobs in chicago
3. jobs by companies for example : jobs in facebook, jobs in emirates case :
a company name " emirates " located in "boston" having vacancy of "accounting job " having position of full time this case job will be present in following categories . 1. accounting jobs in boston
2. jobs in boston
3. jobs in emirates and open any above option there will be filter box on left side showing
position i.e full time
salary i.e 1000-1500
location i.e boston,chicago Q.1
i want to know when user search on google these terms "accounting jobs in boston " or "jobs in boston" or "jobs in emirates" same job will display which url structure is recommended in for each search term? Q.2 how we can do on page SEO for these terms because jobs listing will be changing daily because of new jobs addition and content is changing not Q.3 should i create website on separate domains for each country or same domain but with different folders in it
.co.uk or com/uk for UK and .ae OR .com/uae for UAE Note : i will also attach blog on it and each blog will focus on specific country knowledge for example for USA , how to find jobs in new york and for UAE how to find jobs in Dubai etc . Thanks in Advance0 -
Moz/Google does not recognize text on Wix website
My client's website was built on Wix and despite having substantial content on web pages, Moz is claiming that there is very little-to-no content: Sufficient Characters/Words in Content. Does anyone know how to fix this issue? I've run a word count tool and it gives the same results. Website: pesclinical.com
Technical SEO | | Perfect-Pixel1 -
Any SEO benefits of adding a Glossary to our website?
Hi all, I manage a website for a software company. Many terms can be quite tricky so it would be nice to add a Glossary page. Other than that, I have 2 questions: 1. What would be the SEO benefits? 2. How would you suggest to implement this glossary so we can get as much SEO benefit as possible (for example how would we link, where would we place the glossary in the terms of the sitemap, etc.). Any advice appreciated! Katarina
Technical SEO | | Katarina-Borovska2 -
Why is my website embedded inside this Iranian one?
I just did a search for something and my own website tured up at 1, but this other wbsite turned up at 2 with what looked like my content http://sport.aliexirs.ir/ASTM-A-Plate-Grades-HIC.html. so I clicked on it and it is my website running inside a frame. so what is this all about? Do I need to worry? And what should I do?
Technical SEO | | Zippy-Bungle0 -
Two websites with similar products
I have a website with similar products with different tld . I want to redirect a page for a keyword to another domain by using 301 redirect.Is it okay or google will consider as spam?Please help me out.
Technical SEO | | Alick3000 -
Transfer of website to maintain SEO
I am nearly finished building a new wordpress website to replace the old static HTML site which is currently doing very well in SERPs. My old site is currently hosted by a company who owns the site, my domain is registered with a different company and I have the nameservers pointed at Cloudflare. I have built my new site and have it hosted with a different company and I wish to keep the domain name registered with the company it is currently with.Is there an order that I should follow to move from the old site to the new site using my current domain name so that I minimize any impact on SEO. I built the new site with the same URL structure to maintain linking benefit. thanks
Technical SEO | | casper4340 -
When launching a site redesign, what is the best way to roll it out?
We are currently working on a site re-design and are getting close to launch. When launching the newly designed site, what is the best way to roll it out? 301 Redirects with an under construction page? Just upload the entire site at once? or al little of both? Thank You
Technical SEO | | ControlByWeb0