llms.txt adoption and generators, Web Almanac 2025
Version 1. 4 rows, 5 columns.
By Martin DejnickiUpdated
Short answer
The dataset gives the share of sites with a valid llms.txt file and the count of valid files, for desktop and mobile, from the HTTP Archive Web Almanac 2025 Generative AI and SEO chapters and its SEO results data. It also gives the share of llms.txt files the Almanac relates to two SEO plugins, All in One SEO and Yoast, from the comments the plugins leave in files they generate.
The Web Almanac traces 39.6% of llms.txt files to All in One SEO, 11 times the 3.6% for Yoast
Share of llms.txt files carrying each SEO plugin's default comment, web-wide, Web Almanac 2025; other files are not shown
- Valid llms.txt files were found on 2.13% of desktop sites and 2.1% of mobile sites in the Web Almanac 2025 crawl.
- Figures are web-wide; no Shopify-only share is claimed.
- Only these two plugins are reported, so the bars are not a full split: the dataset does not say which generator, if any, produced the other files.
Source: HTTP Archive, Web Almanac 2025, Generative AI and SEO chapters and SEO results data. Read on .
About this dataset
The dataset gives the share of sites with a valid llms.txt file and the count of valid files, for desktop and mobile, from the HTTP Archive Web Almanac 2025 Generative AI and SEO chapters and its SEO results data. It also gives the share of llms.txt files the Almanac relates to two SEO plugins, All in One SEO and Yoast, from the comments the plugins leave in files they generate. The figures are web-wide; no Shopify-only share is given.
- Version
- 1
- Coverage in time
- Web Almanac 2025 crawl
- Coverage in space
- Worldwide (websites on the open web; no country or platform split)
- Last updated
- October 18, 2026
- License
- CC BY 4.0. Deploi's compilation is CC BY 4.0. The underlying figures belong to the HTTP Archive and the Web Almanac authors and are cited to the sources listed.
Variables
The CSV header uses the column name.
| Column name | Label | Type | Unit | Meaning |
|---|---|---|---|---|
| rowKey | Row key | string | Stable key of the row; matches provenance rowKey. | |
| validSharePct | Sites with a valid llms.txt | number | % | Share of crawled sites with a valid llms.txt file, desktop or mobile, Web Almanac 2025 |
| validFiles | Valid files | number | files | Count of valid llms.txt files found in the crawl |
| generatorSharePct | Share of files related to the plugin | number | % | Share of llms.txt files carrying the plugin's default comment, which the plugin leaves in files it generates, Web Almanac 2025 |
| generator | Plugin | string | text | Display name of the llms.txt generator plugin, set by Deploi from the row key |
The data
| Row key | Sites with a valid llms.txt (%) | Valid files | Share of files related to the plugin (%) | Plugin |
|---|---|---|---|---|
| desktop | 2.13 | 258,357 | Not stated | |
| mobile | 2.1 | 324,184 | Not stated | |
| generator|all-in-one-seo | Not stated | Not stated | 39.6 | All in One SEO |
| generator|yoast | Not stated | Not stated | 3.6 | Yoast |
Where each value comes from
Every value, the document it was read from, the exact place in it and the date it was read. Computed values show their formula.
Show all 8 traced values
| Row | Field | Value | Source | Where in the source | Read on | Method |
|---|---|---|---|---|---|---|
| desktop | Sites with a valid llms.txt | 2.13 % | Web Almanac 2025 SEO results, llms.txt validity tab (gid 1895020036) | desktop,Valid LLMs,"258,357",2.13% | text | |
| desktop | Valid files | 258,357 files | Web Almanac 2025 SEO results, llms.txt validity tab (gid 1895020036) | desktop,Valid LLMs,"258,357",2.13% | text | |
| mobile | Sites with a valid llms.txt | 2.1 % | Web Almanac 2025 SEO results, llms.txt validity tab (gid 1895020036) | mobile,Valid LLMs,"324,184",2.10% | text | |
| mobile | Valid files | 324,184 files | Web Almanac 2025 SEO results, llms.txt validity tab (gid 1895020036) | mobile,Valid LLMs,"324,184",2.10% | text | |
| generator|all-in-one-seo | Share of files related to the plugin | 39.6 % | SEO | 2025 | The Web Almanac by HTTP Archive | 39.6% of llms.txt files are related to All in One SEO | html | |
| generator|yoast | Share of files related to the plugin | 3.6 % | SEO | 2025 | The Web Almanac by HTTP Archive | 3.6% of llms.txt files are related to Yoast SEO | html | |
| generator|all-in-one-seo | Plugin | All in One SEO | Computed by Deploi | …label set by Deploi from the row key: generator|all-in-one-seo = All in One SEO; generator|yoast = Yoast; display label set by Deploi from the row key | computed | |
| generator|yoast | Plugin | Yoast | Computed by Deploi | …label set by Deploi from the row key: generator|all-in-one-seo = All in One SEO; generator|yoast = Yoast; display label set by Deploi from the row key | computed |
Methodology
Caveats: llms.txt adoption and generators, Web Almanac 2025
- Figures are web-wide; no Shopify-only share is claimed.
- The dataset counts publication of a valid llms.txt file. It says nothing about whether any AI system reads or uses the files.
- The plugin shares are the share of llms.txt files carrying the plugin's default comment, which the plugin leaves in files it generates. The dataset does not break down the remaining files by generator.
- Desktop and mobile come from separate crawls with different site counts, so the two file counts are not added together.
Deploi's charts and compilation are licensed CC BY 4.0. The underlying facts belong to their sources, which are named on every page. How Deploi Shopify Data works.
Sources
Tier A sources are primary documents: filings, official releases and official price pages. How sources are ranked.
- Tier BGenerative AI | 2025 | The Web Almanac by HTTP Archive
HTTP Archive (Web Almanac) · HTML · Read on
- Tier BSEO | 2025 | The Web Almanac by HTTP Archive
HTTP Archive (Web Almanac) · HTML · Read on
- Tier BWeb Almanac 2025 SEO results, llms.txt validity tab (gid 1895020036)
HTTP Archive (Web Almanac) · TEXT · Read on
Cite and reuse
Deploi's charts and compilation are licensed CC BY 4.0. The underlying facts belong to their sources, which are named on every page.
APA
Deploi. (2026). llms.txt adoption and generators, Web Almanac 2025 (Version 1) [Data set]. https://deploi.ca/shopify/data/datasets/llms-txt-adoption Retrieved October 18, 2026.
BibTeX
@misc{deploi_llms_txt_adoption_2026,
author = {{Deploi}},
title = {llms.txt adoption and generators, Web Almanac 2025},
year = {2026},
version = {1},
url = {https://deploi.ca/shopify/data/datasets/llms-txt-adoption},
note = {Accessed 2026-10-18}
}Downloads
- Data: llms.txt adoption and generators, Web Almanac 2025 CSV
Changes
- · llms.txt adoption and generators, Web Almanac 2025
First release. Shares and counts read from the Web Almanac 2025 Generative AI and SEO chapters and its SEO results sheet on October 18, 2026.