# CrawlCharter by DEVAesia - https://crawl.devaesia.com # # Access rules and use rules are different questions. This file answers the first. # The AI-use policy for this site is at /.well-known/ai.json and /.well-known/ai.txt. # The rights reservation is at /.well-known/tdmrep.json. # # What the CrawlCharter crawler is, and how to stop it: https://crawl.devaesia.com/bot/ # # Crawling is permitted everywhere here. Training is permitted on /charter/ only, # because that page carries an explicit permission paired with a recognised licence, which # is the only combination this project treats as an attributable grant. User-agent: * Allow: / Crawl-delay: 2 Content-Signal: / search=yes, ai-input=yes, ai-train=no Content-Signal: /charter/ search=yes, ai-input=yes, ai-train=yes Sitemap: https://crawl.devaesia.com/sitemap.xml