User-agent: * crawl-delay: 30 User-agent: VelenPublicWebCrawler Disallow: /