User-agent: Scrapy Allow: / User-agent: * Disallow: *?s=* Sitemap: https://ciq.com/sitemap-index.xml Host: https://ciq.com