{"id":44,"date":"2005-01-16T14:27:00","date_gmt":"2005-01-16T08:57:00","guid":{"rendered":"https:\/\/www.quickonlinetips.com\/archives\/2005\/01\/16\/ways-to-prevent-search-engines-from-indexing-your-private-site\/"},"modified":"2022-03-21T15:59:22","modified_gmt":"2022-03-21T10:29:22","slug":"ways-to-prevent-search-engines-from-indexing-your-private-site","status":"publish","type":"post","link":"https:\/\/www.quickonlinetips.com\/archives\/2005\/01\/ways-to-prevent-search-engines-from-indexing-your-private-site\/","title":{"rendered":"How to Remove Your Site from Search Engines Results"},"content":{"rendered":"

How to block search engines and remove your site from search engine results? You created your very own personal home on the web. However, the site turns up into search engines and web directories, revealing your personal details.<\/p>\n

It is very simple to block search engines<\/strong> from indexing your website by adding a small META code in your web pages and adding a small text file called robots.txt. Protect your privacy.<\/p>\n

\"stop<\/p>\n

1. NoIndex Meta Tag<\/h2>\n

Meta tags are small code snippets that you add in the HEAD section of your HTML file which instructs search robots to better understand your site content and webmaster directions<\/p>\n

Add MERA tag to HEAD of your
\n<META NAME=\"ROBOTS\" CONTENT=\"NOINDEX, NOFOLLOW\"><\/code><\/p>\n

This code will instruct that the search robots should not index and not follow the content on your website. So this effectively blocks search engines from indexing and displaying your website URLs and content online in search engine results.<\/p>\n

2. Robots.TXT Disallow<\/h2>\n

The robots.txt<\/a> file is a small text file that sits in the root of your server and is checked by the search engine bots for instructions if they can index your website.<\/p>\n

Create a robots.txt<\/strong> (all lower-case) using any simple text editor like Notepad. Save it into the root directory of your domain to prevent search bots from accessing any page on your site. Type the details exactly as given below into the robots.txt file<\/p>\n

To exclude all robots from the entire server<\/p>\n

User-agent: *\r\nDisallow: \/<\/code><\/pre>\n
To allow all robots complete access<\/p>\n
User-agent: *\r\nDisallow:<\/code><\/pre>\n
Or create an empty “\/robots.txt” file.<\/p>\n
To exclude all robots from part of the server<\/p>\n
User-agent: *\r\nDisallow: \/cgi-bin\/\r\nDisallow: \/tmp\/\r\nDisallow: \/private\/<\/code><\/pre>\n
To exclude a single robot<\/p>\n
User-agent: BadBot\r\nDisallow: \/<\/code><\/pre>\n
To allow a single robot<\/p>\n
User-agent: WebCrawler\r\nDisallow: User-agent: *\r\nDisallow: \/<\/code><\/pre>\n
That’s it. Now your site is blocked from search engines.<\/p>\n","protected":false},"excerpt":{"rendered":"
How to block search engines and remove your site from search engine results? You created your very own personal home…<\/p>\n","protected":false},"author":4,"featured_media":60367,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_kad_post_transparent":"","_kad_post_title":"","_kad_post_layout":"","_kad_post_sidebar_id":"","_kad_post_content_style":"","_kad_post_vertical_padding":"","_kad_post_feature":"","_kad_post_feature_position":"","_kad_post_header":false,"_kad_post_footer":false,"_kad_post_classname":"","footnotes":""},"categories":[41],"tags":[49],"class_list":["post-44","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-search-engine-optimization","tag-tutorials"],"_links":{"self":[{"href":"https:\/\/www.quickonlinetips.com\/archives\/wp-json\/wp\/v2\/posts\/44","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.quickonlinetips.com\/archives\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.quickonlinetips.com\/archives\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.quickonlinetips.com\/archives\/wp-json\/wp\/v2\/users\/4"}],"replies":[{"embeddable":true,"href":"https:\/\/www.quickonlinetips.com\/archives\/wp-json\/wp\/v2\/comments?post=44"}],"version-history":[{"count":0,"href":"https:\/\/www.quickonlinetips.com\/archives\/wp-json\/wp\/v2\/posts\/44\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.quickonlinetips.com\/archives\/wp-json\/wp\/v2\/media\/60367"}],"wp:attachment":[{"href":"https:\/\/www.quickonlinetips.com\/archives\/wp-json\/wp\/v2\/media?parent=44"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.quickonlinetips.com\/archives\/wp-json\/wp\/v2\/categories?post=44"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.quickonlinetips.com\/archives\/wp-json\/wp\/v2\/tags?post=44"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}