Gantry
Gantry · dataset evaluation · 16 September 2026

All twelve arm joints are zero for every frame of widowxai episode 3, and the episode is marked a success

ExylosAi/bimanual-table-cleanup-cross-embodiment-rich-modality-sample, measured from the public release on 16 September 2026.

trajectory lost, episode still marked a success

The episode, as published

episode 3 of the widowxai split, the release's own top camera, all 101 seconds of it. The arms work and the spill goes away. The action column for these frames is zero throughout. Nothing here is sped up or re-rendered.

What is in the release

Every row is read out of the release. Nothing here is estimated and nothing is rounded up.

frames in episode 33,037, which is 101.2 seconds at 30 fps
value of all twelve arm joints, frame 11 to frame 30360.0
total range of any joint across the whole episode0.0036 radians, about a fifth of a degree
the same figure on episodes 0, 1, 2 and 42.41, 2.54, 2.56 and 3.04 radians
observation.state range across the episode0.0039 radians, so the state agrees with the action
next.success on episode 3True
video published for episode 3six cameras, each 101.23 seconds
what the video showsboth arms working and the spill being cleaned, start to finish

Why this matters

The video and the trajectory cannot both be describing this episode. The six camera video runs the full 101 seconds and shows the task being done. The recorded joint command is the zero vector from frame 11 onward, and observation.state agrees with it, so the log is internally consistent and simply does not contain the take that was filmed. It is still flagged a success, so it passes any filter keyed on that flag and lands in training as 101 seconds of real manipulation video paired with a constant zero action.

How to check this without taking our word for it

Read robots/widowxai/data/chunk-000/episode_000003.parquet and take the min and max of the action column. Then open robots/widowxai/videos/chunk-000/observation.images.top_cam/episode_000003.mp4 and watch it. No credentials.

What a full grading adds

This page is what the release tells you on its own. A full grading removes the part that scores worst, retrains on what is left, and reports whether the smaller corpus scores higher, with rollout counts and intervals. The one result measured on physical hardware is Stera-10M, two arms on a four arm SO-ARM101 bench, 21.9% against 36.9% task success across 1,270 rollouts. The Stera-10M report.