Repository navigation
Crawls: a crawl's webhook takes include, and the MCP tools stop saying spreadsheets are read - #22
Merged
Merged
Conversation
…g spreadsheets are read - crawl()'s docstring and the README describe `"include": ["markdown"]` on a crawl's webhook, which the API has accepted since 23 October 2026: each page's markdown in the crawl.page messages, up to about 1 MB a message, a page that does not fit (or was not stored) as `markdown: None` with `markdownOmitted` and a `contentUrl`, an API path read with the key (or `job.page(url)`); it needs crawl.page among the events, as it is when they are left out. The client already sent it. - The MCP settings guide names `webhook_include`, the project setting that puts added and modified pages' markdown in page.changed (not sent to subscriptions). - The MCP tools' parse_documents parameter, its helper's docstring and the settings guide said spreadsheets are read; PDFs (a scanned one by OCR) and Word (.docx) files are, other Office files are recorded as seen. - A test that the webhook is sent as given; CHANGELOG, Unreleased.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Changes
crawl()'s docstring and the README describe"include": ["markdown"]on a crawl's webhook, which the API has accepted since 23 October 2026:crawl.pagemessages, up to about 1 MB a message;markdown: NonewithmarkdownOmittedand acontentUrl, an API path read with the key (orjob.page(url));crawl.pageamong the events, as it is when they are left out.The client already sent the option as given; only the docs were missing.
MCP settings guide: it names
webhook_include, the project setting that puts added and modified pages' markdown inpage.changed(not sent to subscriptions).The spreadsheet claim: the MCP tools'
parse_documentsparameter, its helper's docstring and the settings guide said spreadsheets are read. In fact PDFs (a scanned one by OCR) and Word (.docx) files are read, and other Office files are recorded as seen.A test that the webhook is sent as given. The CHANGELOG has lines under Unreleased.
Checked
check_release.py,python -m buildandtwine check --strictall pass.No release: merging publishes nothing. A release is a separate step, because Unreleased also holds other entries.