Skip to content

Publish canonical toolkit URLs in llms.txt#1067

Closed
jottakka wants to merge 2 commits into
split/validate-toolkit-doc-routesfrom
split/publish-canonical-toolkit-llms
Closed

Publish canonical toolkit URLs in llms.txt#1067
jottakka wants to merge 2 commits into
split/validate-toolkit-doc-routesfrom
split/publish-canonical-toolkit-llms

Conversation

@jottakka

@jottakka jottakka commented Jul 16, 2026

Copy link
Copy Markdown
Contributor

Summary

  • expand toolkit routes into concrete, category-grouped llms.txt entries
  • prevent llms regeneration from committing metadata-only loops
  • document the CI-backed llms.txt publishing path

Dependency

Depends on #1065 for canonical generated routes.

Test plan

  • pnpm exec vitest run tests/llmstxt.test.ts

Follow-up artifact

public/llms.txt is intentionally left to the automated generation workflow after this behavior lands; the version in #1060 contains pre-existing trailing whitespace and should not be hand-carried into a source PR.


Note

Low Risk
Changes affect docs indexing and automation only; no runtime auth or product API behavior.

Overview
llms.txt generation now includes concrete integration toolkit pages (from listToolkitRoutes / toolkit JSON) with category-grouped sections, instead of dynamic [toolkitId] MDX routes. Toolkit entries reuse on-disk summary/description so OpenAI runs only when authored MDX pages need new summaries.

The generator writes public/llms.txt only when the body changes (metadata-only diffs no longer trigger commits), and the Agentic development doc is updated to point agents at /llms.txt and Copy page Markdown rather than automatic HTML→markdown by User-Agent.

CI (llmstxt.yml) also runs on toolkit data changes, uses full git history (fetch-depth: 0), and skips fork PRs to avoid failed write attempts.

Reviewed by Cursor Bugbot for commit f7aa2f0. Bugbot is set up for automated code reviews on this repo. Configure here.

Expand generated toolkit routes into grouped concrete URLs and keep the publishing workflow idempotent to prevent regeneration loops.

Co-authored-by: Cursor <cursoragent@cursor.com>
@vercel

vercel Bot commented Jul 16, 2026

Copy link
Copy Markdown

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated (UTC)
docs Ready Ready Preview, Comment Jul 16, 2026 2:23pm

Request Review

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant