# See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file # # ALLOW ROBOTS User-agent: * Disallow: /search Disallow: /*?* Sitemap: https://en.oxforddictionaries.com/sitemap Crawl-delay: 1