Skip to content

feat(jax): implement TensorBoard training output #5872

Open

Description

@njzjz-bot

Summary

The common schema exposes training.tensorboard* options, and the JAX trainer stores related configuration, but training does not currently emit TensorBoard events.

Scope

  • Implement writer creation, metric emission, flushing, and cleanup.
  • Honor the enable flag, frequency, and log-directory options independently of console display frequency.
  • Emit stable tags for learning rate, training/validation metrics, timing, and task identity.
  • Ensure only the designated rank writes a shared event stream.
  • Avoid per-step host transfers or imports when no event is due or TensorBoard is disabled.
  • Continue global step numbering correctly after restart.

Acceptance criteria

  • No event file is created when TensorBoard is disabled.
  • Enabled training emits scalars at the configured frequency and global step.
  • Multi-task metrics use unambiguous stable tag names.
  • Distributed training has a documented chief-only or rank-separated policy without collisions.
  • Writers flush and close on normal and exceptional exits.
  • Tests cover enablement, frequency, restart, and cleanup.

Refs #5756.

Coding agent: Codex
Codex version: codex-cli 0.144.4
Model: gpt-5.6-sol
Reasoning effort: xhigh

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions