Skip to content

fix(computer-use): refine virtual cursor appearance - #3433

Merged
bobleer merged 1 commit into
GCWing:mainfrom
bobleer:codex/refine-computer-use-cursor
Oct 17, 2026
Merged

bobleer merged 1 commit into
GCWing:mainfrom
bobleer:codex/refine-computer-use-cursor

Conversation

@bobleer

@bobleer bobleer commented Oct 17, 2026

Copy link
Copy Markdown
Collaborator

Summary

Make the Computer Use virtual cursor smaller, with a dark gray fill, a fixed 3px white outline, and a downward shadow in the macOS/Windows native overlays and Web preview. Scale the contour around its existing hotspot so visual feedback stays aligned with input coordinates. On macOS, correct the shadow direction for the flipped view and cast one shadow from the outlined silhouette.

Type and Areas

Type: UI/UX, bug fix

Areas: desktop Computer Use (macOS/Windows), Web UI preview

Motivation / Impact

The previous cursor was large and light gray, with no contrasting edge; the macOS shadow was offset upward. The smaller outlined cursor remains visible against both light and dark captured content. The preview keeps its outline at 3px when scaling the SVG contour.

Verification

  • node scripts/test-macos-control-pointer.mjs — passed; native cursor persists, follows its target, respects occlusion, and does not take focus. Inspected the rendered production cursor on light/dark backgrounds and confirmed the shadow falls below it.
  • pnpm --dir src/web-ui run test:run src/app/components/ComputerUseControlCard.test.tsx src/app/components/computer-use src/infrastructure/api/adapters/peer-device-adapter.test.ts — 79 passed.
  • pnpm run check:web and pnpm run theme:color-audit:all — passed.
  • cargo test --locked -p openbitfun-desktop --features devtools --lib computer_use — 163 passed, 9 opt-in native tests ignored.
  • cargo build --locked -p openbitfun-desktop --features devtools — passed after the final native shadow correction.
  • node scripts/test-windows-computer-use-native.mjs --check --target x86_64-pc-windows-msvc — passed. Also executed the production rasterizer's updated pixel test in isolation on macOS.
  • pnpm run fmt:rs, git diff --check, and the introduced Git object-size check — passed.

Reviewer Notes

AI-assisted, with focused automated testing and local visual verification. Windows native rendering was cross-compiled but not exercised on a Windows desktop; remote end-to-end behavior was not exercised. No protocol, persisted data, control routing, or cursor animation changes.

Checklist

  • This PR is focused and does not include secrets, temporary prompts, generated scratch files, or unrelated artifacts.
  • Relevant verification is recorded above, or skipped checks are explained.
  • User-facing strings, docs, and locales are updated where applicable (no string changes).

@bobleer
bobleer merged commit b972dd5 into GCWing:main Oct 17, 2026
13 checks passed
@bobleer
bobleer deleted the codex/refine-computer-use-cursor branch October 18, 2026 09:45
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant