User-agent: Slurp Crawl-delay: 5 User-agent: * Disallow: /cgi-bin/ Disallow: /admin/ Disallow: /images/ Disallow: /includes/CaptchaSecurityImages.php