User-agent: * Disallow: /sitecore/ Disallow: /sitecore modules/ Disallow: /sitecore_files/ Disallow: /Layouts/ Disallow: /SubLayouts/ Disallow: /bin/ Disallow: /temp/ Disallow: /swf/ crawl-delay: 300