How to block search engines and remove your site from search engine results? You created your very own personal home on the web. However, the site turns up into search engines and web directories, revealing your personal details.
It is very simple to block search engines from indexing your website by adding a small META code in your web pages and adding a small text file called robots.txt. Protect your privacy.
1. NoIndex Meta Tag
Meta tags are small code snippets that you add in the HEAD section of your HTML file which instructs search robots to better understand your site content and webmaster directions
Add MERA tag to HEAD of your
<META NAME="ROBOTS" CONTENT="NOINDEX, NOFOLLOW">
This code will instruct that the search robots should not index and not follow the content on your website. So this effectively blocks search engines from indexing and displaying your website URLs and content online in search engine results.
2. Robots.TXT Disallow
The robots.txt file is a small text file that sits in the root of your server and is checked by the search engine bots for instructions if they can index your website.
Create a robots.txt (all lower-case) using any simple text editor like Notepad. Save it into the root directory of your domain to prevent search bots from accessing any page on your site. Type the details exactly as given below into the robots.txt file
To exclude all robots from the entire server
User-agent: *
Disallow: /
To allow all robots complete access
User-agent: *
Disallow:
Or create an empty “/robots.txt” file.
To exclude all robots from part of the server
User-agent: *
Disallow: /cgi-bin/
Disallow: /tmp/
Disallow: /private/
To exclude a single robot
User-agent: BadBot
Disallow: /
To allow a single robot
User-agent: WebCrawler
Disallow: User-agent: *
Disallow: /
That’s it. Now your site is blocked from search engines.