Repository navigation
Add kitless teleoperation and replay with SO101 support - #8788
Draft
hougantc-nvda wants to merge 9 commits into
Draft
hougantc-nvda wants to merge 9 commits into
hougantc-nvda wants to merge 9 commits into
Conversation
6 of 7 tasks
hougantc-nvda
force-pushed
the
hougantc/kitless-live-recorded-teleop
branch
2 times, most recently
from
October 26, 2026 17:12
e933899 to
4d7c54f
Compare
6 of 7 tasks
6 of 7 tasks
Consolidate the reviewed PR boundary before rebasing onto current main. Previous cumulative head: 12208c4 Signed-off-by: Hougant Chen <hougantc@nvidia.com>
Signed-off-by: Hougant Chen <hougantc@nvidia.com>
Consolidate the reviewed PR boundary before rebasing onto current main. Previous cumulative head: 48f8b49 Signed-off-by: Hougant Chen <hougantc@nvidia.com>
Signed-off-by: Hougant Chen <hougantc@nvidia.com>
Signed-off-by: Hougant Chen <hougantc@nvidia.com>
Signed-off-by: Hougant Chen <hougantc@nvidia.com>
hougantc-nvda
force-pushed
the
hougantc/kitless-live-recorded-teleop
branch
from
October 27, 2026 16:08
48f8b49 to
e118cbc
Compare
This branch has not been deployed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Description
Connect live Capture tracking and recorded MCAP input to kitless simulation through the OVXR adapter from #8787. SO101 gains CPU OvPhysX selection and the current Capture home-transform, clutch and gripper integration.
isaaclab_teleopowns control events, target-frame rebasing, input policy and session cleanup; task-specific action preparation remains with the task.--xrpath; kitless uses--ovxr.Shared fixes address empty CPU Warp arrays, Newton graph capture overlapping legacy-stream uploads, and simulation-context ownership after a failed asynchronous drain. Kit fixes defer native USD imports until runtime launch and keep headless XR updating without changing ordinary headless on-demand capture.
See the live/replay runtime guide.
Builds on #8787. This draft targets main and includes its predecessors; review the incremental diff.
Dependencies: compatible Capture OVXR packages and the provider upgrade in #8627. Native-provider defaults are unchanged; use the source-build setup until matching packages and metadata are released.
The CloudXR.js push-device default remains
0. Rootpyproject.tomlanduv.lockretain upstream policy; NumPy compatibility for the source-built OVXR environment is explicit local setup, not a project-wide pin.Type of change
Testing
Results cover the cumulative stack, not an independent full-suite run of this PR.
Formatting, changelog, incremental warning-as-error Sphinx and the kitless dependency check passed. The clean Sphinx check was blocked by external-inventory DNS failures.
Open limits: cold attach over 300 seconds, intermittent GR1T2 first-Play/Reset recovery, SO101 cube retention and eight Kit SDK metadata mismatches remain unresolved. Full-repository, hosted-CI, arm64 and full task-success coverage are not claimed. See #8791 for the exact validation checkpoint, performance samples and limitations.
Checklist
pre-commitchecks withuv run isaaclab --formatsource/<pkg>/changelog.d/for every touched package (do not editCHANGELOG.rstor bump package versions — CI handles that)CONTRIBUTORS.mdor my name already exists thereThe warnings checkbox remains open: dependency warnings and the separate Kit metadata audit are unresolved.