User-agent: * Disallow: / User-agent: Googlebot User-agent: ZumBot User-agent: Bingbot User-agent: Daumoa User-agent: NaverBota User-agent: Twitterbot Crawl-delay: 1 Allow: /$ Allow: /Home/Main Allow: /Item Allow: /item