Skip to content

Multi-worker TPU training setups require aggregated host-level metrics across multiple isolated worker processes without inter-process lock contention or high CPU serialization overhead. - #777

Merged
copybara-service[bot] merged 1 commit into
mainfrom
test_970337171
Aug 29, 2026

Conversation

@copybara-service

@copybara-service copybara-service Bot commented Aug 25, 2026

Copy link
Copy Markdown

Multi-worker TPU training setups require aggregated host-level metrics across multiple isolated worker processes without inter-process lock contention or high CPU serialization overhead.

Define 64-byte aligned, lock-free POSIX shared memory layout (ShmHistogramSlot and ShmSegmentLayout) for atomic counter, gauge, and histogram metric updates.

@copybara-service copybara-service Bot changed the title tpu_sync: add POSIX shared-memory layout for telemetry Multi-worker TPU training setups require aggregated host-level metrics across multiple isolated worker processes without inter-process lock contention or high CPU serialization overhead. Aug 26, 2026
@copybara-service
copybara-service Bot force-pushed the test_970337171 branch 2 times, most recently from 5e5397b to 56db248 Compare August 29, 2026 10:48
…s across multiple isolated worker processes without inter-process lock contention or high CPU serialization overhead.

Define 64-byte aligned, lock-free POSIX shared memory layout (ShmHistogramSlot and ShmSegmentLayout) for atomic counter, gauge, and histogram metric updates.

PiperOrigin-RevId: 973055845
@copybara-service
copybara-service Bot merged commit 9c7311b into main Aug 29, 2026
4 checks passed
@copybara-service
copybara-service Bot deleted the test_970337171 branch August 29, 2026 10:51
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant