Spawning ai.txt

In progress

A proposed convention for AI-specific crawler directives via an `ai.txt` file.

Visit website Back to catalog

Website: site.spawning.ai/spawning-ai-txt
Latest update: Aug 28, 2025 Improved crawler-control post published
Primary approach: Preference signal

What it is

The ai.txt approach from spawning.ai introduces an optional file to express preferences specifically to AI crawlers and tools.

Evidence trail

Aug 28, 2025 Improved crawler-control post published
Mar 24, 2024 User guide post