User-agent: * Disallow: /my User-agent: Yandex Crawl-delay: 0.5 User-agent: Dolphin crawl-delay: 10