# robots.txt entry where certain folders are not allowed for bots. User-agent: * Disallow: /maint/ Disallow: /logs/ Disallow: /payment/ Disallow: /update/ Disallow: /includes/ Disallow: /executable/