Skip to content

docs: pipeline: inputs: opentelemetry: document worker log processing and busy responses - #2805

Merged
eschabell merged 1 commit into
fluent:masterfrom
eschabell:erics_in_opentelemetry_updates
Nov 9, 2026
Merged

eschabell merged 1 commit into
fluent:masterfrom
eschabell:erics_in_opentelemetry_updates

Conversation

@eschabell

@eschabell eschabell commented Nov 2, 2026 •

Copy link
Copy Markdown
Collaborator
  • Add HTTP workers section describing the deferred ingress queue
  • Document which log processors run inside HTTP workers and the fallback
  • Document 503 / gRPC status 14 responses when the ingress queue is full

Signed-off-by: Eric D. Schabell eric@schabell.org

@eschabell eschabell added waiting-on-review Waiting on a review from mainteners waiting-on-release 5.2 labels Nov 2, 2026
@eschabell
eschabell requested review from a team and patrick-stephens as code owners November 2, 2026 16:56
@coderabbitai

coderabbitai Bot commented Nov 2, 2026 •

Copy link
Copy Markdown
Contributor

Review in Change Stack →

Walkthrough

The OpenTelemetry input documentation describes processor execution when multiple HTTP workers are enabled. It also documents deferred ingress queue limits, rejection responses, and retry guidance for HTTP and gRPC clients.

Changes: OpenTelemetry HTTP worker behavior

Layer / File(s) Summary
Worker processing and queue responses
pipeline/inputs/opentelemetry.md
Documents when the processor chain runs in an HTTP worker or after queueing. Describes queue limits, HTTP 503 and gRPC UNAVAILABLE responses, and when clients should retry.

Estimated code review effort: 1 (Trivial) | ~5 minutes

Change: Other

Possibly related PRs

  • fluent/fluent-bit-docs#2801: Documents related Fluent Bit 5.2 ingestion and HTTP-worker changes in release and upgrade documentation.
Merge Risk: Low · up to 4175f

The documentation accurately distinguishes oversized events from temporary queue saturation, but clients cannot distinguish those causes from the documented responses. Clarify retry guidance; the remaining risk is limited to documentation.

Pre-merge checks: Passed 4

Check name Status Explanation
Description Check Passed Check skipped - CodeRabbit’s high-level summary is enabled.
Title check Passed The title names the documentation change for the OpenTelemetry input: worker log processing and busy responses. The summary confirms the added text covers which processors run in HTTP workers, the fal…
Linked Issues check Passed Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check Passed Check skipped because no linked issues were found for this pull request.
Full details: Title check

Explanation

The title names the documentation change for the OpenTelemetry input: worker log processing and busy responses. The summary confirms the added text covers which processors run in HTTP workers, the fallback to the full chain, and the 503 and UNAVAILABLE responses when the queue is full. The title is specific to the main change and matches the objectives.

Finishing Touches

Generate unit tests (beta)

  • Create a new PR
  • Autofix · Keep fixing CodeRabbit findings and required CI, and resolving merge conflicts

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

Share

Recent review info

Run configuration

  • Source mode: Auto
  • Repository: Unavailable
  • Branch: Unavailable
  • File: No configuration file from this repository applied
  • Commit: Unavailable
  • Layers: defaults
  • Review profile: CHILL
  • Plan: Advanced
  • Run ID: fdb38a72-7280-499b-b621-00919c5d8aca
Commits

Reviewing files that changed from the base of the PR and between 96b1d22 and 4175f8a.

Files selected for processing: 1

  • pipeline/inputs/opentelemetry.md

Included review availability: This review used your included allowance. Your plan provides up to 2 included reviews per hour; 0 remain after this review.

@eschabell eschabell self-assigned this Nov 2, 2026

@coderabbitai coderabbitai Bot left a comment •

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

  • Fix comments: Fix CodeRabbit comments on this PR

Comment thread pipeline/inputs/opentelemetry.md Resolved
@eschabell
eschabell force-pushed the erics_in_opentelemetry_updates branch from 2e49449 to 96b1d22 Compare November 2, 2026 20:03

@coderabbitai coderabbitai Bot left a comment •

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

  • Fix comments: Fix CodeRabbit comments on this PR

Comment thread pipeline/inputs/opentelemetry.md Resolved
@eschabell

Copy link
Copy Markdown
Collaborator Author

@coderabbitai review

@coderabbitai

coderabbitai Bot commented Nov 3, 2026 •

Copy link
Copy Markdown
Contributor
Action performed

Review finished.

Note: CodeRabbit is an incremental review system and does not re-review already reviewed commits. This command is applicable only when automatic reviews are paused.

@coderabbitai coderabbitai Bot left a comment •

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

  • Fix comments: Fix CodeRabbit comments on this PR

Comment thread pipeline/inputs/opentelemetry.md Resolved
… and busy responses

  - Add HTTP workers section describing the deferred ingress queue
  - Document which log processors run inside HTTP workers and the fallback
  - Document 503 / gRPC status 14 responses when the ingress queue is full
  - clarify retry guidance for ingress queue rejections
  - Explain that mem_buf_limit can lower the effective ingress queue byte limit
  - Separate the temporary queue-full rejection from the oversized-request rejection
  - Recommend retrying only when the queue is full; oversized requests need smaller requests or a higher limit
  - Compare the effective byte limit against each queued event instead of the whole request
  - Note that one request can add several events to the ingress queue
  - Align the retry guidance with the per-event limit
  - Note that clients can't distinguish a full queue from an oversized event in the response
  - Recommend retrying with backoff and explain that repeated failures point to an event exceeding the effective byte limit

Signed-off-by: Eric D. Schabell <eric@schabell.org>
@eschabell
eschabell force-pushed the erics_in_opentelemetry_updates branch from 4175f8a to 1065eda Compare November 3, 2026 15:39
@eschabell

Copy link
Copy Markdown
Collaborator Author

@patrick-stephens ready for review!

@eschabell eschabell removed waiting-on-review Waiting on a review from mainteners waiting-on-release labels Nov 9, 2026
@eschabell

Copy link
Copy Markdown
Collaborator Author

Going with ai review for release today.

@eschabell
eschabell merged commit fec0f03 into fluent:master Nov 9, 2026
10 checks passed
@eschabell
eschabell deleted the erics_in_opentelemetry_updates branch November 9, 2026 15:14
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant