Generate a clean llms.txt plus the robots.txt AI-crawler rules that actually control access.
Enter your site, choose or add key pages, and choose how to treat AI crawlers. Add a short description if you want more control; otherwise we infer a conservative summary from public homepage metadata.
Optional, but helpful. If left blank, we infer a conservative summary from public homepage metadata and discovered pages.
Add the pages that best explain the site, ideally 10-20 total. Use one per line: URL - short description, or click Find pages after entering a site URL.
Results appear on this page, usually within 15-45 seconds. We store your submission, result, and email to operate and improve the tool; marketing emails are sent only if you opt in. Avoid pasting confidential customer, medical, or unreleased financial data.
Review the Terms and Privacy.