Skip to content
woolimiPublic

About

A wall-mounted, bimanual 6-DoF robot and Hermit, the handheld UMI gripper that teaches it. Collect demonstrations by hand, train with LeRobot, run the policy on the arms.

Topics

Resources

Stars

0 stars

Watchers

0 watching

Forks

Latest commit

 

History

5 Commits

Folders and files

Repository files navigation

Two pink Pinkrab arms on a pegboard, with a left-hand and a right-hand Hermit on the desk in front of them

Pinkrab

A wall-mounted, bimanual 6-DoF robot and Hermit, the handheld gripper that teaches it.
Collect demonstrations by hand, train with LeRobot, run the policy on the arms.

English · 한국어

License: Apache-2.0 ROS 2 Jazzy Python 3.12+ LeRobot 0.6.1 MuJoCo

Documentation · Bill of materials · Print files · MakerWorld · Install


Pinkrab (Pink + Crab) is a pair of 6-DoF arms bolted to an IKEA SKÅDIS pegboard on the wall behind a desk. Each arm is an SO-ARM 101 with an extra printed wrist yaw joint and a new L-shaped base. A crab keeps its body still and works with its claws, and so do these arms.

Hermit is the claw of the arm with a handle on it, a UMI-style handheld gripper. It has the same claw, jaw and wrist camera as the arm, so a policy trained on video recorded with Hermit sees the same picture when it runs on the robot. Demonstrations are collected without the robot in the loop.

Everything from printing the parts to running a policy is in the documentation.

Highlights

  • Six joints per arm. The added wrist yaw gives every arm a full 6-DoF tool pose, so all motion is solved with inverse kinematics from the URDF. No leader arm.
  • Hermit for data and teleoperation. A head-worn top camera tracks the UMI marker on each Hermit against a table marker, giving each tool's pose in the desk frame every frame. The same tracking drives the arms live.
  • Pinkrab Studio. One browser workbench over a MuJoCo model of the rig: teleoperation, Collect, Curate, Train and Policy pages, driven by a three-pedal foot switch.
  • ROS 2 safety gate. Every command to a servo passes one gate that checks joint bands, contact with the desk, board and the other arm, and speed, acceleration and jerk limits.
  • LeRobot native. The pair is registered as the robot type bi_pinkrab_follower, and policies train and run as LeRobot's ACT.
  • Corrections while running. Take over a running policy with Hermit, fix the motion and add it to the dataset (HG-DAgger).

Workflow

Workflow: Collect with Hermit and the top camera, Curate, Train ACT, Run Pinkrab behind the safety gate, and take over with Hermit to add corrections back to Collect

Step Docs
Buy, print and assemble BOM · Print · Arm · Hermit
Install the software Install
Set up and calibrate Setup · First run
Collect demonstrations Collect
Build a dataset Curate
Train a policy Train · Policies
Run and correct Run · Corrections
Try it without hardware Simulation
Find your way in the code Repository layout

Hardware

A Pinkrab arm with its claw, wrist camera and L-shaped base on the pegboard Hermit held in one hand, with the UMI marker on the handle and the camera above the claw
Pinkrab arm Hermit
Joints 6 per arm + gripper
Servos Feetech STS3215 (12 V), 7 per arm
Reach about 570 mm from the board to the tool tip
Payload about 0.45 kg, arm fully stretched (calculated)
Pose accuracy joint error ≤ 0.8°, tool tip 1 mm on average (measured)
Cameras ELP AR0234 global-shutter fisheye on each wrist and each Hermit, one AR0234 top camera
Power and bus one 12 V 6 A adapter for both arms, one Seeed XIAO bus servo board per arm over USB
Printer every part is printed; Bambu Studio projects for the Bambu Lab P2S are included and also on MakerWorld

The full list, with screws and quantities, is the bill of materials.

Acknowledgements

Pinkrab builds on the ideas, designs and code of these projects:

License

Apache-2.0, with one exception: wrist_yaw_bracket_left.stl and wrist_yaw_bracket_right.stl are derived from ahb's SO-ARM100 additional wrist joint and are CC BY-SA, so anything derived from them carries the same license. SAM 3, used for background randomisation, is installed separately under Meta's SAM License and is not part of this repository. See NOTICE.

About

A wall-mounted, bimanual 6-DoF robot and Hermit, the handheld UMI gripper that teaches it. Collect demonstrations by hand, train with LeRobot, run the policy on the arms.

Topics

Resources

Stars

0 stars

Watchers

0 watching

Forks

Releases

Packages

Contributors

Languages