User-agent: * Crawl-delay: 30 Disallow: /search/ Sitemap: https://www.cryptonewsz.com/sitemap_index.xml Sitemap: https://www.cryptonewsz.com/news-sitemap.xml