How to Set Up llms.txt in WordPress for AI Agents

llms.txt is an emerging convention where websites publish a markdown file at /llms.txt listing the most valuable content for AI agents to consume. WordPress can serve llms.txt via dedicated plugins, manual file upload, or programmatic generation. This guide covers WordPress-specific implementation. Pair with llms.txt guide and agent compatibility.

Step 1: Decide what to include in llms.txt

Curated list of your most valuable, evergreen content. Not your full sitemap. Aim for 20-100 entries. Categories: documentation, key blog posts, FAQ pages, about/contact, pricing, integration pages.

Step 2: Choose an llms.txt approach

Three options: (a) plugin: 'LLMs.txt for WordPress' or 'Website LLMs.txt' — auto-generated from posts. (b) Manual: upload static llms.txt via FTP to /public_html/. (c) Programmatic: register custom rewrite via theme functions.php that serves dynamic content.

Step 3: Install and configure plugin (option a)

LLMs.txt for WordPress plugin → Settings → choose content types to include → choose post statuses → set max entries → save. Plugin auto-generates llms.txt at yoursite.com/llms.txt.

Step 4: Create static file (option b)

Use a markdown editor. Structure: H1 (site name), short H2 description, then sections (H2) with bullet links. Example: '# Acme Corp' / '## Documentation' / '- [API reference](https://...) - REST API docs'. Upload via FTP to public_html/llms.txt.

Step 5: Verify file is accessible

Visit yoursite.com/llms.txt. Should serve raw markdown text, content-type text/markdown or text/plain. If 404: rewrite rules not generated (Settings → Permalinks → Save), or file in wrong directory.

Step 6: Also serve llms-full.txt (optional)

Some AI agents look for llms-full.txt with complete content (not just links). Generate by concatenating full markdown of listed pages. Larger file but gives agents complete context without crawling links.

Step 7: Monitor AI agent traffic

Server logs: search for requests to /llms.txt. Track which AI agents fetch it. Useful tools: Cloudflare analytics, WP Activity Log, custom log filters via plugin like Simple History.

Frequently Asked Questions

Is llms.txt actually used by AI agents?

As of 2026, adoption is growing but inconsistent. Anthropic's ClaudeBot reads llms.txt. OpenAI's GPTBot does not explicitly but may crawl it incidentally. Perplexity has signalled support. Even where not yet supported, having a curated llms.txt costs nothing and positions you for future adoption.

Does llms.txt replace robots.txt or sitemap.xml?

No — they're complementary. robots.txt: tells bots what they can/can't crawl. sitemap.xml: comprehensive URL list for search engines. llms.txt: curated 'best of' content guide for AI agents. A complete setup has all three.

Should llms.txt be the same as sitemap.xml?

No. Sitemap is comprehensive (all URLs). llms.txt is curated (your best, evergreen content). A 5000-URL sitemap should probably have a 50-100 URL llms.txt. Quality over completeness.

Will llms.txt make my WordPress site rank better in ChatGPT?

Not directly — it doesn't influence ChatGPT's training. But for real-time-search ChatGPT and similar (Perplexity, You.com), pointing AI agents at your best content increases the chance they extract and cite it correctly. Indirect ranking benefit through citation rates.

How do I update llms.txt as my WordPress content changes?

If you use a plugin: auto-regenerates on schedule. If manual: update the file when major new content is published. Set a calendar reminder for quarterly review. Stale llms.txt pointing at deleted content is worse than no llms.txt.

🤖 Validate llms.txt

Check your llms.txt is accessible and well-structured.

Run llms.txt Check →