# CrawlCharter by DEVAesia

> Permission-first crawling for traceable AI datasets. A DEVAesia research project.

This file is navigation context. It grants nothing. The AI-use policy for this site is at
/.well-known/ai.json and the rights reservation is at /.well-known/tdmrep.json.

## Pages

- [CrawlCharter by DEVAesia](https://crawl.devaesia.com/): Crawler that actually reads and respects policy. Not released.
- [The charter](https://crawl.devaesia.com/charter/): The rules this crawler follows, and what would stop the project.
- [How a verdict is reached](https://crawl.devaesia.com/how-it-works/): Six policy endpoints, thirteen signal kinds, a precedence ladder, and two independent verdicts.
- [The crawler](https://crawl.devaesia.com/bot/): What it requests, what it keeps, and how to make it stop.
- [How to stop this crawler](https://crawl.devaesia.com/owner-controls/): Four ways to stop it, what each does to collected content, and what a removal cannot reach.
- [What makes a source eligible](https://crawl.devaesia.com/sources/): The grant record, two collection modes, and the gates in front of a crawl.
- [What a dataset would carry](https://crawl.devaesia.com/datasets/): Export record shape, manifest shape, and the three gates an export must clear. Nothing published.
- [Open questions](https://crawl.devaesia.com/research/): Seven open questions, six lines of work, and a hypothesis that can fail.
- [Reference](https://crawl.devaesia.com/docs/): Enumerations, identifiers and defaults the rest of the site refers to.
- [Changelog](https://crawl.devaesia.com/changelog/): What this site claims, and when each claim changed. A correction gets its own entry.