user-agent: sitebot disallow: / User-Agent: XoviBot Crawl-Delay: 30 User-agent: * Crawl-Delay: 30 Disallow: /home/activities/submitartwork.do Disallow: /home/activities/suggestion.do Disallow: /home/admin/ Disallow: /home/literature/viewLiterature.do?action=show&artCategoryId=33 Disallow: /home/literature/viewLiterature.do?action=show&artCategoryId=32