When you are beginning a new website, the best course of action is to block all bots until the site is complete. As a new domain is created, Google and many of the other search engines will begin to bring bots to your site and list all content. This is not good, as you are under construction, and may not be ready to be indexed yet. There are two solutions to this problem. The first solution is to create a robots.txt file and tell the search engines to not index your site. The second is a more powerful option: using a noindex meta tag.
Posts Tagged ‘meta tag’
Loading ...
