Add Sitemaps Autodiscovery in Robots.txt File
April 11th, 2007Sitemaps are essential to get all permalinks of your site well indexed by search engines. Recently Google, Microsoft and Yahoo! agreed to a standard Sitemaps protocol. I use the Google Sitemaps Generator Wordpress Plugin to easily generate my sitemap xml file and the latest plugin version lets you ping Google and Yahoo! each time you post. Now adding sitemap autodiscovery links in Robots.txt file just made this a lot easier.
Ask.com, Google, Microsoft Live Search and Yahoo! have announced support of “autodiscovery” of Sitemaps. The new open-format autodiscovery allows webmasters to specify the location of their Sitemaps within their robots.txt file, eliminating the need to submit sitemaps to each search engine separately.
This step is very useful as webmasters can easily submit their content to the search engines and benefit from reduced unnecessary traffic by the crawlers. The search engines get information with regards to pages to index as well as metadata with clues about which pages are newly updated and which pages are identified as the most important and search users get more fresh content.
Everyone webmasters ensures their site has a robots.txt file hosted on the root server, to guide search engine crawlers, spiders and bots about which parts of the website they want to get indexed and blocked. So just by adding a single line of code to the already existent robots.txt file, you can help search engines find your sitemaps file.
How to modify the robots.txt file?
Simply add the sitemap url following the word sitemap like this
Sitemap: http://www.quickonlinetips.com/sitemap.xml
Its simple. Update your robots.txt file today and help search engines index your site better.
Update: The correct way to add Sitemap link to robots.txt file
Liked it? Subscribe feed and keep reading our latest articles for free.Share: Digg Delicious Stumbleupon Twitter Email to friend
Related Posts
- The Correct Way to Add Sitemap Link to Robots.txt File
- Microsoft Robots Invasion Contest : Create Robots / BOTs
- Feedburner Smart Feed for Better Tracking & Autodiscovery
- Robots Welcome Humans in Firefox 3
- RobotStats : Tracks Web Robots Visits for Free
But, why have you put that under disallow section in your site?
I think I have done it right,.. at yelo24.com… please correct me… anyway I think content is king on the internet today. Thats why I have the largest PLR Article directory available on the internet, free to download of cource. Thanks for the tips thought. :-)
Thanks for that. Having 6 accounts on six different search engine sites trying to keep my sitemap up to date and also making sure the search engines have all my site maps was starting to get a headache. Thanks