Skip to content

fix: preserve large streaming helper results - #2449

Closed
apcha-oai wants to merge 1 commit into
mainfrom
apcha/large-response-payload-coverage
Closed

fix: preserve large streaming helper results#2449
apcha-oai wants to merge 1 commit into
mainfrom
apcha/large-response-payload-coverage

Conversation

@apcha-oai

Copy link
Copy Markdown
Contributor

Summary

Extend #2433's large HTTP payload protection to the public Responses and Chat Completions helpers. #2415 introduced new, unreleased limits that reject valid Responses events buffered by an async iterator and Chat Completions structured output above 16 MiB.

Revert #2415's helper queue/structured-parsing limit machinery and its associated serializer observer, restoring the prior behavior without changing longstanding limits. Keep the earlier privacy, prototype-safety, FIFO, and cleanup fixes, and the independent Responses/Assistant identity validation.

Add three sequential, synthetic 32 MiB-plus HTTP contract tests covering blocking Responses JSON, Responses streaming accumulation/structured output/finalResponse()/async iteration, and Chat Completions streaming content/structured output/finalChatCompletion(). The memory use is intentional; no live API calls, large captures, or WebSocket changes.

@apcha-oai
apcha-oai requested a review from a team as a code owner August 22, 2026 22:56
@chatgpt-codex-connector

chatgpt-codex-connector Bot commented Aug 22, 2026

Copy link
Copy Markdown

Codex Review Summary

This comment shows the latest Codex review activity on this pull request.

Review Status Commit Review trigger
📝 Code Review Completed 2026-08-22T22:59:51.403471Z cc13f6c PR opened
🔒 Security Review Completed 2026-08-22T23:00:29.245596Z cc13f6c PR opened
ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review" or "@codex security review".

Codex reacts with 👀 while any review is running, comments if it has suggestions, and reacts with 👍 once all reviews finish with no findings.

@openai-sdks

openai-sdks Bot commented Aug 22, 2026

Copy link
Copy Markdown
Contributor

OkTest Summary

237/237 SDK tests passed in 9.384s for Node SDK PR #2449.

Test results — 42 files
Test Result Time
tests/chat-completions-complex-body.test.ts ✅ Passed 141ms
tests/chat-completions-create.test.ts ✅ Passed 190ms
tests/chat-completions-stream.test.ts ✅ Passed 168ms
tests/files-content-binary.test.ts ✅ Passed 115ms
tests/files-create-multipart.test.ts ✅ Passed 116ms
tests/files-list-pagination.test.ts ✅ Passed 144ms
tests/initialize-config.test.ts ✅ Passed 135ms
tests/instance-isolation.test.ts ✅ Passed 106ms
tests/models-list.test.ts ✅ Passed 123ms
tests/responses-background-lifecycle.test.ts ✅ Passed 200ms
tests/responses-body-method-errors.test.ts ✅ Passed 289ms
tests/responses-cancel-timeout.test.ts ✅ Passed 193ms
tests/responses-cancel.test.ts ✅ Passed 191ms
tests/responses-compact-retries.test.ts ✅ Passed 252ms
tests/responses-compact.test.ts ✅ Passed 178ms
tests/responses-create-advanced-stream.test.ts ✅ Passed 106ms
tests/responses-create-advanced.test.ts ✅ Passed 138ms
tests/responses-create-disconnect.test.ts ✅ Passed 1.095s
tests/responses-create-errors.test.ts ✅ Passed 194ms
tests/responses-create-malformed-api-responses.test.ts ✅ Passed 156ms
tests/responses-create-retries.test.ts ✅ Passed 200ms
tests/responses-create-stream-failures.test.ts ✅ Passed 162ms
tests/responses-create-stream-timeout.test.ts ✅ Passed 2.139s
tests/responses-create-stream-wire.test.ts ✅ Passed 2.194s
tests/responses-create-stream.test.ts ✅ Passed 65ms
tests/responses-create-terminal-states.test.ts ✅ Passed 238ms
tests/responses-create-timeout.test.ts ✅ Passed 180ms
tests/responses-create.test.ts ✅ Passed 118ms
tests/responses-delete.test.ts ✅ Passed 107ms
tests/responses-input-items-errors.test.ts ✅ Passed 167ms
tests/responses-input-items-list.test.ts ✅ Passed 158ms
tests/responses-input-items-options.test.ts ✅ Passed 100ms
tests/responses-input-tokens-count-timeout.test.ts ✅ Passed 234ms
tests/responses-input-tokens-count.test.ts ✅ Passed 237ms
tests/responses-malformed-inputs.test.ts ✅ Passed 1.85s
tests/responses-not-found-errors.test.ts ✅ Passed 211ms
tests/responses-parse.test.ts ✅ Passed 174ms
tests/responses-retrieve-retries.test.ts ✅ Passed 213ms
tests/responses-retrieve.test.ts ✅ Passed 186ms
tests/responses-stored-method-errors.test.ts ✅ Passed 583ms
tests/retry-behavior.test.ts ✅ Passed 2.999s
tests/sdk-error-shape.test.ts ✅ Passed 248ms

View OkTest run #32603853828

SDK merge (4d269e07c019) · head (cc13f6c7369e) · base (7b7d6ca71130) · OkTest (2b1bdfd25e98)

@github-actions

Copy link
Copy Markdown
Contributor

Castiron custom code

✅ No new custom-code files detected.

32 mixed files remain; 0 existing customizations changed.

Compared 7b7d6ca71130cc13f6c7369e. Generated baselines verified.

32 existing customizations unchanged
  • api.md
  • scripts/castiron/README.md
  • scripts/castiron/custom_code_report.py
  • scripts/castiron/test_custom_code_report.py
  • src/client.ts
  • src/resources/audio/transcriptions.ts
  • src/resources/audio/translations.ts
  • src/resources/beta/assistants.ts
  • src/resources/beta/beta.ts
  • src/resources/beta/index.ts
  • src/resources/beta/responses/internal-base.ts
  • src/resources/beta/responses/responses.ts
  • src/resources/beta/threads/index.ts
  • src/resources/beta/threads/runs/index.ts
  • src/resources/beta/threads/runs/runs.ts
  • src/resources/beta/threads/threads.ts
  • src/resources/chat/completions/completions.ts
  • src/resources/chat/completions/index.ts
  • src/resources/conversations/index.ts
  • src/resources/embeddings.ts
  • src/resources/files.ts
  • src/resources/fine-tuning/checkpoints/permissions.ts
  • src/resources/images.ts
  • src/resources/responses/internal-base.ts
  • src/resources/responses/responses.ts
  • src/resources/skills/skills.ts
  • src/resources/skills/versions/versions.ts
  • src/resources/vector-stores/file-batches.ts
  • src/resources/vector-stores/files.ts
  • src/resources/webhooks/index.ts
  • src/resources/webhooks/webhooks.ts
  • tests/lib/data-residency.test.ts

A changed generated baseline means this report cannot reliably identify which handwritten lines changed.

Inspect the custom-code diff

Download the exact patch produced by this run (requires repository access):

gh run download 32603868879 --repo openai/openai-node \
  --name castiron-custom-code-32603868879-1 --dir /tmp/castiron-custom-code-32603868879-1
git apply --stat /tmp/castiron-custom-code-32603868879-1/custom-code.patch
cat /tmp/castiron-custom-code-32603868879-1/custom-code.patch

Or reproduce it from an SDK checkout containing the vendored reporter:

git fetch --no-tags origin 7b7d6ca71130d37ec09792c50056b47861f2eccf cc13f6c7369ec81f707ec608ecee99387eb2e8de
python3 scripts/castiron/custom_code_report.py report \
  --base 7b7d6ca71130d37ec09792c50056b47861f2eccf \
  --head cc13f6c7369ec81f707ec608ecee99387eb2e8de --fetch --require-head-hash --public \
  --out /tmp/castiron-custom-code-cc13f6c7369e
cat /tmp/castiron-custom-code-cc13f6c7369e/custom-code.patch

This is the current full custom patch for mixed files, not an attribution of only the handwritten lines changed by this PR.

Full report and patch

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: cc13f6c736

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

Comment thread src/lib/ChatCompletionStream.ts
Comment thread src/lib/ChatCompletionStream.ts
Comment thread src/lib/ChatCompletionStream.ts
Comment thread src/lib/ChatCompletionStream.ts

@jbeckwith-oai jbeckwith-oai left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

P1 — Preserve Chat Completions tool-call identity while removing payload caps. The current target base binds each streamed tool-call index to its original function identity, but this rollback removes that security invariant: ChatCompletionStream.ts:819 can replace an established function name while retaining arguments accumulated for another tool, and runTools() then dispatches the newly named callback with those mixed arguments. Historical released behavior does not eliminate this regression against current main. Preserve immutable per-index function type/name validation independently of size limits and add a public runTools regression. Existing discussion: #2449 (comment)

@apcha-oai apcha-oai closed this Aug 26, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants