# Is anyone actually reading your llms.txt?

> The honest data on llms.txt adoption, why most AI crawlers still skip it, and the real reasons to ship one anyway.

Source: https://webpossible.com/blog/is-anyone-reading-your-llms-txt/
Format: Markdown version for AI agents. The canonical HTML page is at the source URL above.

---

There is a tidy story going around that if you add an [llms.txt](/llms-txt/) file to your site, AI systems will read it, understand you better, and cite you more. It is a nice story. The data does not support the strong version of it.

## What the logs actually show

When people check their server logs, the major training and search crawlers, GPTBot, ClaudeBot, PerplexityBot, Google-Extended, overwhelmingly fetch HTML directly and rarely request llms.txt. Adoption of the file across the web is real but modest, and there is no public commitment from the big AI labs to read it in production. Studies that look at large samples of domains find no clean correlation between having an llms.txt and getting cited.

So if someone is selling you llms.txt as a ranking lever, be skeptical. That is not where the file earns its keep today.

## Why ship it anyway

Three honest reasons, none of them magic.

**It helps the agents that do read it.** Coding agents like Claude Code and Cursor request clean, machine-friendly versions of content right now. They are a small slice of traffic, but they are a growing and influential one, and they are exactly the kind of agent that will multiply.

**Models train on the conventions that exist today.** The norms for how agents read the web are being set in this window. Being early and clean is cheap, and it positions you for where this is going rather than where it is.

**It forces clarity.** Writing an llms.txt makes you decide which of your pages actually matter and how to describe them in one line. That exercise is worth doing even if no machine ever reads the result.

## Where the real leverage is

If you have an hour to spend on agent legibility, llms.txt is not where most of it should go. The heavier levers are [structured data](/structured-data-for-ai/) that tells machines what your content means, and entity consistency that makes your claims trustworthy across the whole web. Those move citations. llms.txt is the cheap, sensible housekeeping you do alongside them.

We ship one on this site, and we publish it openly, because a site that sells agent legibility without an llms.txt would be a punchline. But we would rather tell you the truth about it than sell you a myth. If you want to build yours, use the [free template and generator](/resources/llms-txt-template/).