Just creating a blog and keep on posting is not enough to grab visitors to your website. Nothing can beat search engine traffic and the best search engine is Google of course. So your blog need to be recognized by Google. Search engine companies like Google have bots to crawl new websites and index them. Not every crawled website will be indexed by Google. For your blog to be indexed it should contain quality and unique content. Today I will show you how to edit custom robots.txt file so that search engine bots crawl your blog very fast.
How to Edit Custom Robots.txt in Blogger?
1) Login to your Blogger account and in blogger dashboard select the blog whose robots.txt file is to be edited.
2) Then in left menu select settings and then in sub-settings select search preferences.
3) Then in right panel you will see custom robots.txt click edit and enable it.
4) After you enable it, a blank box appears, in that box copy and paste the following information
3) Then in right panel you will see custom robots.txt click edit and enable it.
4) After you enable it, a blank box appears, in that box copy and paste the following information
User-agent: *
Disallow: /search?q=*
Disallow:
/*?updated-max=*
Allow: /
Sitemap:
http://www.yourdmomain.com/feeds/posts/default?orderby=updated
NOTE: In the place of yourdomain.com copy your blog URL.
5) Then click save settings...That's all your blog will be crawled very fast by search engine bots.