# Robots.txt file for www.cnb.com User-agent: * Disallow: /SitePages/ Disallow: /SiteCollectionDocuments/ Disallow: /style-library/ Disallow: /errors/ Disallow: /content/cnb/en/errors/ Disallow: /content/cnb/en/logoff.html Disallow: /content/cnb/en/search-results/ # Do not scan old content and assets Disallow: /content/dam/cnbcom/ Disallow: /content/cnbcom/ Sitemap: https://www.cnb.com/sitemap.xml