Skip to content
GEO & AI visibilityFree

llms.txt Generator: Create Your llms.txt for Free

llms.txt is a Markdown file that introduces your site's most important pages to AI tools. Enter your URL and we build an editable draft from your sitemap, and check the format of your current file if you have one.

Enter a domain or the full URL of a page.

Results will appear here.

We do not store the URL you enter or the results.

How to use it

  1. Enter your domain and press “Generate llms.txt”. We read the homepage, robots.txt and sitemap.

  2. Review the site name, summary and sections; untick the links you don't need and edit the descriptions.

  3. Copy or download the text in the preview and upload it to your site's root as /llms.txt.

What is llms.txt, and how is it different from robots.txt?

llms.txt is a Markdown file published at the root of a website that tells tools built on large language models what the site is about and which of its pages matter most. The format was proposed by Jeremy Howard on llmstxt.org in September 2024. It is not an official web standard; it is an open proposal adopted by the community.

The problem it addresses is simple: when an AI assistant reads your site, it has to dig the real information out of menus, scripts and repeated template text, and the amount of text it can read at once is limited. llms.txt gathers your most valuable pages, with short descriptions, in one place.

robots.txt, on the other hand, is an access file: it tells crawlers which paths they may or may not visit. sitemap.xml gives search engines the full list of URLs to crawl. llms.txt replaces neither of them; it does not grant or block access, and it does not try to list every URL. Think of it as a curated, annotated table of contents.

What should the llms.txt format look like?

The proposal asks for the file to be written in a specific order. This tool builds the draft in the same order, and if your site already has a file, it checks that file against these rules:

  • A single H1 heading: # Site name. This is the only required part of the format.
  • A short summary starting with >: one or two sentences on what the site offers and to whom.
  • Optional paragraphs of notes; no headings are used in this part.
  • Sections starting with ##, each with link lines in the form - [Page name](url): description.
  • A section named exactly Optional: secondary links that can be skipped when a shorter context is needed.

How does this tool build the draft?

The draft is generated from signals your site already publishes; no content is made up. Link titles and descriptions come from your pages' title and meta description tags, and you can edit every line.

  • It first looks at the Sitemap lines in robots.txt, or at /sitemap.xml if there are none, and follows up to five child sitemaps in a sitemap index. Internal links on the homepage are also taken into account.
  • It collects up to 500 same-site URLs from the sitemap and selects up to 60 pages. Short paths and pages linked from the homepage come first.
  • On multilingual sites, it uses the pages in the homepage's language. Image, feed, pagination, tag, search and cart URLs, paths that robots.txt closes to all crawlers, and pages marked noindex are skipped.
  • Pages are grouped into sections by the first part of their path; pages such as privacy, cookie and terms of use go into the Optional section.

Does llms.txt increase visibility?

The honest answer: its effect is limited today and hard to measure. Google has not announced that it uses llms.txt for search rankings or AI summaries, and it is not clear how the crawlers of the large AI companies use the file. It is most useful when a user or developer gives your site to an AI tool as context.

Even so, it takes little effort to prepare and carries low risk. On sites where services, products or documentation are spread across many pages, it can help assistants reach the right page. Real visibility still depends on server-rendered, crawlable HTML, clear headings and correct structured data; keep in mind that AI crawlers generally do not execute JavaScript.

Frequently asked questions

Where do I upload the llms.txt file?

Upload it to your site's root so that it opens at https://yourdomain.com/llms.txt. Serve it as plain text, preferably with the text/plain or text/markdown content type. On systems like WordPress you can place the file in the server's root folder or use a plugin that does it; in frameworks like Next.js, the public folder or a route is enough.

What is the difference between llms.txt and llms-full.txt?

llms.txt is a short link map: page names, URLs and one-line descriptions. llms-full.txt gathers the full text of your key pages in a single Markdown file, so a tool can read the content in one request. llms-full.txt is a practice that has become common, especially on documentation sites, but it is not a required part of the llmstxt.org proposal.

Does llms.txt affect my Google rankings?

There is no known effect. Google has not announced that it uses llms.txt for rankings or AI summaries. Search visibility is still determined by crawlable pages, clear titles and descriptions, internal links and correct structured data. Think of llms.txt not as a replacement for these, but as an extra convenience aimed at AI tools.

Does llms.txt block AI crawlers?

No. llms.txt contains no access rules; robots.txt decides which crawler may visit which path. If you want to allow or block the crawlers of companies such as OpenAI, Anthropic or Perplexity, you need to add the matching User-agent rules to your robots.txt file. You can see your current setup with our free robots.txt AI crawler checker.

Why are some of my pages missing from the draft?

The tool selects up to 60 pages and puts short paths and pages linked from the homepage first. Tag, author, search, cart and pagination URLs, paths that robots.txt closes to all crawlers, and pages that are marked noindex or return errors are skipped on purpose. You can add any missing page with the “Add link” button in the relevant section.

How often should I update my llms.txt file?

Update it when you add an important page, service or product group, or when you change URLs; broken links send the tools that read the file to the wrong place. On sites that change often, generating the file automatically from your content management system is safer. Codeativ's own llms.txt is generated from the same data as its pages, so the two stay in sync.

Next step

Let's fix the findings on your site together

The tools show where the gaps are; applying the fixes to your site is a separate job. Book a free initial consultation with our team for SEO, GEO and AI integration.