Gantry · dataset evaluation · 13 September 2026

1 of 7 action dimensions never move

VibeCuisine/autoresearch-vibepi-000113-cucumber-grab, measured from the public release on 13 September 2026. frame level, every row read

We read every frame of VibeCuisine/autoresearch-vibepi-000113-cucumber-grab, 1 episodes and 172 rows, and 1 of its 7 action dimensions hold one value from the first frame to the last, the ones named tilt.pos. A column that never changes is one the policy is being asked to predict from a constant, so it costs capacity and teaches nothing.

The release, as it actually is

propertyvalue
episodes1
frames172
frame rate20 fps
robotvibeboard_follower_tilt
action dimensions7
cameras3
distinct task strings1
shortest episode172 frames
median episode172 frames
longest episode172 frames

How each episode ends

A trailing hold is the number of frames at the end during which the commanded action does not change by more than 1e-4 on any component. Seconds come from the frame rate the release declares.

trailing hold at leastepisodesshare
1 frames , 0.05 seconds1100.0%
5 frames , 0.25 seconds1100.0%
10 frames , 0.5 seconds1100.0%
30 frames , 1.5 seconds00.0%
60 frames , 3.0 seconds00.0%

How to check this without taking our word

The release is a meta directory plus one or more parquet files. Read data/chunk-000/file-000.parquet, group rows by the episode ranges in meta/episodes, and compute the same columns. No credentials.

What a full grading adds

This page is what a published release will tell you on its own. The full grading removes the part that scores worst and retrains on what is left, then reports whether the smaller corpus scores higher, with rollout counts and intervals. The one result measured on physical hardware is Stera-10M, two arms on a four arm SO-ARM101 bench, 21.9% against 36.9% task success across 1,270 rollouts.