What it is
The ai.txt approach from spawning.ai introduces an optional file to express preferences specifically to AI crawlers and tools.
Evidence trail
- Aug 27, 2025 Improved crawler-control post published
- Mar 23, 2024 User guide post
Initiative profile
Spawning ai.txt
WIPA proposed convention for AI-specific crawler directives via an `ai.txt` file.