llms.txt Generator
Create an llms.txt file for your site: name, summary and sections of key links in the llmstxt.org format, imported from your sitemap, with checks and download.
Runs in your browser · Nothing uploaded · No sign-up
Something not working, or missing a feature? Send feedback
About the llms.txt Generator
The llms.txt Generator writes an llms.txt file in the format proposed at llmstxt.org: an H1 with the site name, a blockquote summary, optional details, and H2 sections of links with short notes, plus an "Optional" section an assistant can skip. Import your sitemap to start from your real pages grouped by section, keep the ones that matter, and download the file. It is checked for the required name and absolute URLs as you type.
The file is built in your browser. Only the optional sitemap import sends your site address to our server, which downloads the public sitemap and does not store it.
How to use the llms.txt Generator
- Optionally enter your site address and press Import to group your sitemap's pages into sections.
- Write the name and a one-sentence summary of what the site is and who it is for.
- Edit each section: one link per line as Title | URL | note; delete pages that do not help an assistant.
- Copy or download the file and upload it as /llms.txt at the root of your site.
Works well with the llms.txt Generator
- AI Crawler Checker: check that AI crawlers can reach the site.
- Sitemap Validator: make sure the sitemap you import is clean.
- Markdown Viewer: preview the Markdown before you upload it.
Frequently asked questions
Does llms.txt help SEO?
Not in Google: Google has said it does not use llms.txt for Search. It is a proposal (from Jeremy Howard of Answer.AI, September 2024) for giving AI assistants and coding tools a short, curated map of a site. Treat it as cheap documentation, not a ranking factor.
What is the difference between llms.txt and robots.txt?
robots.txt tells crawlers what they may fetch. llms.txt does not allow or block anything; it lists the pages worth reading, with a summary, so an assistant can find the right documentation quickly.
What is llms-full.txt?
A companion file some sites publish with the full text of their documentation in one Markdown file. llms.txt links to pages; llms-full.txt contains them.
Guides and tutorials
Related tools
AI Crawler Checker
Check which AI crawlers a site allows: GPTBot, ClaudeBot, PerplexityBot, Google-Extended and 12 more, split into AI training, AI search and search engines.
Website SEO Checker
Check any page for on-page SEO problems: title, meta description, headings, canonical, robots.txt, noindex, structured data, alt text, HTTPS and speed, with a score.
Broken Link Checker
Find broken links on any web page: every internal and external link (and optionally image) is checked for 404s, server errors, timeouts and redirects. Export a CSV.
Redirect Checker
Check the HTTP status code and full redirect chain of up to 100 URLs: 301, 302, 404 and 5xx, response headers, loops and HTTPS downgrades, with fixes and CSV.
Sitemap Validator
Validate an XML sitemap or sitemap index: format, URL limits, duplicates, lastmod dates, robots.txt blocks, and the status of every listed URL (404s, redirects, noindex).
Keyword Generator
Find hundreds of long-tail keyword ideas from Google, YouTube, Bing and DuckDuckGo at once, with intent, filters and your own Search Console data.