robots.txt & llms.txt Generator
Generate robots.txt crawl rules and an llms.txt site summary for AI agents — private and downloadable.
100% In-Browser & Private — your data never leaves this device
Loading tool...
How to use the robots.txt & llms.txt Generator
- Choose robots.txt or llms.txt mode.
- Fill disallow paths / sitemap or site summary fields.
- Copy or download the generated file.
- Host it at your site root (/robots.txt or /llms.txt).
FAQ
- What is llms.txt?
- A proposed convention for giving AI crawlers a concise, curated summary of your site.
Related tools
More private, in-browser utilities you might need next.
Looking for more? Browse all developer tools · All tools