Repository navigation
sync with open source how - #118
Draft
lesterhaynes wants to merge 10000 commits into
Draft
lesterhaynes wants to merge 10000 commits into
lesterhaynes wants to merge 10000 commits into
Conversation
njeevan233-spec
approved these changes
Feb 1, 2026
…in ReadFromKafkaDoFn (#40840)
) Accept a space between date and time when writing a STRING value to a timestamp or timestamptz column, as allowed by RFC 3339 section 5.6. Fixes #40860
AddFiles: widen a promoted column's bound to the table type's width
…ution, cancel() returns the observed state (#40787) * [Spark] Resolve the structured streaming pipeline state from the execution, cancel() returns the observed state
* [Prism] Drop elements for windows whose trigger has finished Once a window's root trigger has finished, Prism kept accepting new elements and emitted them in an extra pane at end of window. Drop them instead, as Java's ReduceFnRunner and Python's trigger driver do. - Re-enable the TestTrigger* and TestPanes integration tests on Prism. - Move TriggerElementCount and TriggerOrFinally to TestImplemented. - Expect only 6.0 from TriggerAfterProcessingTime: the trigger fires once, then 4.0 arrives in the closed window and is dropped. * [Python] Update Prism AfterCount streaming test for closed windows AfterCount(3) isn't repeated, so it finishes after its first firing and closes the window. Prism now drops later elements for that window instead of emitting them in an extra pane.
* Update ONNX extras * Trigger postcommits * Fix py311-ml onnx bounds * add onnxscript to tox environment * Add onnxscript to ml_base
Run ProcessFn through DoFnRunners.simpleRunner, the same runner the DirectRunner uses, instead of the deprecated DoFnTester. The ProcessFnTester helper keeps its API, so the test bodies don't change. Fixes #18691
* initial * more * Add fieldorder * trigger tests * comments * comments
* [RunInference] Import resource independently of ModelManager `import resource` shared a try block with the ModelManager import, so when ModelManager's optional dependencies (torch) were missing, resource was set to None too and RunInference reported 0 for model memory. Fixes #40854 * Replace subprocess test with a RunInference warning test
* update pr review code flow when assigning reviewer ahead of bot * fix gemini comments
Bumps [google.golang.org/api](https://github.com/googleapis/google-api-go-client) from 0.308.0 to 0.309.0. - [Release notes](https://github.com/googleapis/google-api-go-client/releases) - [Changelog](https://github.com/googleapis/google-api-go-client/blob/main/CHANGES.md) - [Commits](googleapis/google-api-go-client@v0.308.0...v0.309.0) --- updated-dependencies: - dependency-name: google.golang.org/api dependency-version: 0.309.0 dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
…t-builds [CI] Avoid duplicate Python snapshot builds
…g deterministic (#40880) Fix two sources of map-iteration non-determinism in the Go SDK pipeline construction and cross-language expansion paths: 1. In pipelinex.computeRoots, sort the collected root transform IDs using sort.Sort(idSorted(roots)) before passing them to TopologicalSort. While TopologicalSort already sorts its internal frontier (ret.next) and output keys for deterministic traversal, the initial roots slice was populated by ranging over the xforms map in random order. 2. In xlangx.HandlerParams.Inputs() and Outputs(), sort the returned []PCol slice by PCol.Index (breaking ties by PCol.Local) after collecting entries from InputsMap and OutputsMap. Retaining append + slices.SortFunc (rather than indexing directly into a preallocated slice by index) also safely handles sparse index maps such as when xlang.SetOutputCoder rewrites OutputsMap to a single entry at index > 0.
* [Python] Support Protobuf 7.x (#40580) * docs: add Protobuf 7.x support to CHANGES.md
Drop legacy options from HF Inference api
* [Python] Preserve argument binding for defaulted DoFn elements Ignore the ordinary default on the implicitly supplied first input when all positional parameters have defaults. This keeps injected parameters and side inputs in their intended positions for process and process_batch. Cover implicit and explicit element parameters, scalar and deferred side inputs, and the existing FnApiRunner batch execution configurations. Fixes #19631 Assisted-by: OpenAI Codex * fixup! [Python] Preserve argument binding for defaulted DoFn elements Skip the default-argument loop when no defaults remain, avoiding the negative-zero slice noted in review. Assisted-by: OpenAI Codex
* fix readFromKafka schema error * fix kafka managed test and format yaml * skip if expansion jar not present * update examples to match issue * add json example for write
* [YAML] Clean up BigQuery datasets when fixtures fail * [YAML] Clarify integration fixture dependency skip
* [CI] Fix Go dependency cache path * [CI] Honor the Go cache opt-out
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Please add a meaningful description for your change here
Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily:
addresses #123), if applicable. This will automatically add a link to the pull request in the issue. If you would like the issue to automatically close on merging the pull request, commentfixes #<ISSUE NUMBER>instead.CHANGES.mdwith noteworthy changes.See the Contributor Guide for more tips on how to make review process smoother.
To check the build health, please visit https://github.com/apache/beam/blob/master/.test-infra/BUILD_STATUS.md
GitHub Actions Tests Status (on master branch)
See CI.md for more information about GitHub Actions CI.