robots.txt

Simple generating robots.txt file

Default settings

User-agent: *
Allow: /
Host: $domain
Sitemap: $domain/sitemap.xml

The '$domain' variable will be replaced with the domain of your site.