Enforcement
Voluntary preference signal. Communicates a requested condition or restriction to automated systems.
It only affects actors that detect and honor the signal; it does not itself prevent reuse.
Catalog status describes public availability, not legal validity, adoption, or proven effectiveness.
What it is
The ai.txt approach from spawning.ai introduces an optional file to express commercial text-and-data-mining preferences to AI crawlers and tools.
Spawning ai.txt publishes or proposes a machine-readable preference signal for web content across the collection, training, and retrieval stages. Site operators publish the file at a predictable location for participating tools to find. The signal communicates requested conditions; compliance depends on discovery, interpretation, and voluntary support by downstream systems. Public materials describe an in-progress proposal or implementation; the newest dated source in this profile is “Improved crawler-control post published” (August 28, 2025). These details describe the published mechanism and evidence, not a finding about legal validity, adoption, or effectiveness.
Limitations
An ai.txt file does not itself block access. Spawning communicates preferences to organizations using its API; other data miners must discover, parse, and choose to respect the file.
Evidence trail
- Aug 28, 2025 · Primary sourceImproved crawler-control post published
- Mar 24, 2024 · Primary sourceUser guide post
Adoption signals
No public adoption figure found.