User-agent: * Crawl-delay: 10 User-agent: google Disallow: /admin Crawl-delay: 5 User-agent: yandex User-agent: bing Crawl-delay: 1.5