How to Remove Your Site from Search Engines Results

How to block search engines and remove your site from search engine results? You created your very own personal home on the web. However, the site turns up into search engines and web directories, revealing your personal details.

It is very simple to block search engines from indexing your website by adding a small META code in your web pages and adding a small text file called robots.txt. Protect your privacy.

stop search engines

1. NoIndex Meta Tag

Meta tags are small code snippets that you add in the HEAD section of your HTML file which instructs search robots to better understand your site content and webmaster directions

Add MERA tag to HEAD of your
<META NAME="ROBOTS" CONTENT="NOINDEX, NOFOLLOW">

This code will instruct that the search robots should not index and not follow the content on your website. So this effectively blocks search engines from indexing and displaying your website URLs and content online in search engine results.

2. Robots.TXT Disallow

The robots.txt file is a small text file that sits in the root of your server and is checked by the search engine bots for instructions if they can index your website.

Create a robots.txt (all lower-case) using any simple text editor like Notepad. Save it into the root directory of your domain to prevent search bots from accessing any page on your site. Type the details exactly as given below into the robots.txt file

To exclude all robots from the entire server

User-agent: *
Disallow: /

To allow all robots complete access

User-agent: *
Disallow:

Or create an empty “/robots.txt” file.

To exclude all robots from part of the server

User-agent: *
Disallow: /cgi-bin/
Disallow: /tmp/
Disallow: /private/

To exclude a single robot

User-agent: BadBot
Disallow: /

To allow a single robot

User-agent: WebCrawler
Disallow: User-agent: *
Disallow: /

That’s it. Now your site is blocked from search engines.

Share with friends

About the Author: P Chandra is editor of QOT, one of India's earliest tech bloggers since 2004. A tech enthusiast with expertise in coding, WordPress, web tools, SEO and DIY hacks.