Gantry

Evaluation report, FreeTacMan

We fine-tuned the same policy twice on FreeTacMan, once on all 6,428 episodes as released and once with the 799 that write position, gripper and orientation on a different scale from the rest removed together with one episode under a second long, and the edited run scored 29.6% against 24.7%, a gain of 4.9 points over 1,100 rollouts.

Fine-tuned on full
24.7%
Task success trained on all 6,428 episodes.
CI 22.3 to 27.4 · n=1,100
Fine-tuned on edited
29.6%
Task success with the 799 off-scale episodes and one short episode removed.
CI 27.0 to 32.4 · n=1,100
Lift
+4.9 pp
From training on less data.
95% range +1.2 to +8.6
Removed
12.4%
800 of 6,428 episodes, 1.89 of the 18.20 hours recorded.
1,601 of the 18,484 video files
Scale gap
333x
Peak TCP position tops out at 0.594 across the off-scale episodes and starts at 197.92 across the rest.
no episode lands in between

Success rate by task

fine-tuned on full FreeTacMan fine-tuned on edited FreeTacMan

A same-size random cut scored 24.2%, so the gain is from which episodes were removed, not from removing episodes.

Gain per task

UsbPlug and WipeBoard move most at 9.1 and 8.2 points, and neither lost a single episode, so what they gain is a shared action head that is no longer being pulled toward a scale three orders of magnitude smaller. TextureClassify and Write gain 6.4 each from a low base even though the cut took every episode they had, because the full run learned a command size for them that the gripper reads in millimetres. Stamp is flat and ArrangeFruit moves 0.9. The pooled lift clears zero, most single tasks at 110 rollouts do not, and the chart says so.

What the edited version had removed

Measured on the release. Every one of the 6,428 episodes reduces to a single number, the largest absolute TCP position value its own trajectory file writes. Across 5,629 episodes that number runs from 197.92 to 542.91. Across the other 799 it runs from 0.271 to 0.594, and nothing at all lands in between, so 799 episodes, 12.4 percent of the release, record position and gripper in metres and orientation in radians while every other episode records millimetres and degrees. The other channels split the same way, gripper distance peaks between 0.026 and 0.333 on those 799 against 22.43 to 125.84 everywhere else, and the euler columns peak between 3.025 and 3.142 against 144.15 to 1,383.68, while the quaternion columns carry unit norm on both sides, so the rotation itself is stored correctly and only the euler copy disagrees. Column names, folder layout and the dataset card are identical for the two, and the clearest visible marker is a capital letter, since those 799 episodes name their video files _Camera and the other 5,629 name them _camera, 1,598 files against 16,886. They also ship two camera views where all but one of the other 5,629 ship three, and the view they drop is one of the two tactile fingertips on a release whose subject is contact-rich visuo-tactile manipulation. Every one of them was recorded on 6 or 15 April 2025 UTC, and every episode that stays was recorded between 22 August and 8 September 2025. One further episode goes, ScrewInTheBulb_70, whose trajectory covers 0.05 seconds in 1,033 bytes against a 10.14 second and 54,064 byte median and whose three videos are four frames each. What stays includes the tasks that look flat and are not, since WipeBoard_46 opens its gripper by 3.45 mm across the whole take while the arm travels 1,082 mm, and holding an eraser at a fixed opening is the task rather than a fault. It also includes every episode whose clock repeats, 1,171 of the 5,628 kept episodes carry at least one non-increasing timestamp and CutTofu_6 runs 89 of its 390 rows on a frozen clock, because the pose keeps moving through them and the trajectory is recoverable.

Removedepisodesshare of the release
TextureClassify, metres and radians, peak position 0.538 to 0.5942003.1%
FragileCup, metres and radians, peak position 0.348 to 0.4302003.1%
Stamp, metres and radians, peak position 0.271 to 0.4462003.1%
Write, metres and radians, peak position 0.422 to 0.5551993.1%
ScrewInTheBulb_70, 0.05 s of trajectory and four frames of video10.02%
Removed80012.4%
Kept5,62887.6%

The removed media

Measured on the release. Each clip is the wrist camera of one episode, the view that shows both tactile fingertips. The number in every caption is that episode's peak absolute TCP position value as written in its own trajectory file, against 214.04 to 542.91 across the 5,628 episodes that stay.

TextureClassify . classifyredtac_22removed
a textured sample gripped between the two fingertips
240 rows in 7.98 s · peak TCP position 0.594, the largest in the off-scale set · peak gripper 0.085 · 2 camera views · 6 April 2025
TextureClassify . classifybluetac_106removed
the same task under the other TextureClassify prefix
240 rows in 7.97 s · peak TCP position 0.592 · peak gripper 0.086 · 100 bluetac and 100 redtac, all 200 removed
Write . Write_16removed
a pen held at a fixed opening while the arm draws
300 rows in 10.17 s · peak TCP position 0.556 · gripper opens 0.0014 across the whole take · 15 April 2025
FragileCup . FragileCup_34removed
a transparent cup and a white bowl on the mat
300 rows in 9.97 s · peak TCP position 0.430 · gripper travels 0.066 · 6 April 2025
FragileCup . FragileCup_38removed
the same grasp, four episodes later, on the same day
300 rows in 9.98 s · peak TCP position 0.425 · gripper travels 0.066 · 200 of 200 episodes in this task removed
Stamp . Stamp_163removed
a stamp pressed onto a card at a fixed grip opening
180 rows in 5.97 s · peak TCP position 0.446 · gripper opens 0.0009 · all 200 Stamp episodes are 180 rows
CutTofu . CutTofu_6kept
89 of its 390 rows sit on a frozen clock and it stays
390 rows in 10.04 s · peak TCP position 334.75 · peak gripper 84.10 · 89 rows on a frozen clock, kept
WipeBoard . WipeBoard_46kept
an eraser held at a fixed opening, which is the task
240 rows in 8.02 s · peak TCP position 454.22 · gripper opens 3.45 mm while the arm travels 1,082 mm · kept
FreeTacMan · 6,428 episodes · 46 tasks · 18,484 videos · GR00T N1.6 · 10 tasks × 110 rollouts × 2 arms Wilson 95% · cut = peak TCP position under 1, plus one episode under a second long