# http://en.wikipedia.org/wiki/Robots_exclusion_standard#Crawl-delay_directive User-agent: * Crawl-delay: 30 Disallow: /images/avatars/ Host: bcdairy.ca # Sitemap: https://bcdairy.ca/sitemap.xml # this version of EE has trouble adding the .xml to the end of the template Sitemap: https://bcdairy.ca/sitemap