Gantry

Evaluation report, Minus Zero Indian Driving v2

1,469 drives through Bangalore, seven cameras each, 3.2 TB. We fine-tuned an end-to-end driving policy twice, once on the corpus as released and once on an edited version with 213 recordings removed, and ran both through the same ten closed-loop scenarios, 100 runs each. The edited version won.

Fine-tuned on full
58.2%
Scenarios completed without a safety-driver intervention.
CI 55.1 to 61.2 · n=1,000
Fine-tuned on edited
64.7%
Same scenarios, 213 recordings removed from training.
CI 61.7 to 67.6 · n=1,000
Lift
+6.5 pp
From training on less data.
95% range +2.2 to +10.7
Removed
14.5%
213 recordings, 11.9 of 89.8 hours. Mostly a car that was not moving.
128 stationary · 41 no fix · 44 other
Scenarios up
8 of 10
Largest gains where the removed data was worst, low-speed lanes.
largest, narrow lane +13

Intervention-free runs by scenario

fine-tuned on full corpus fine-tuned on edited corpus

A same-size random cut scored 58.9%, so the gain is from which recordings were removed, not from removing recordings. U-turn is the one scenario that slipped, and it is the one where standing-still footage was doing some work.

Gain per scenario

Edited minus full, with its 95% range. The pooled lift clears zero. No single scenario does at 100 runs, and the chart says so rather than rounding it away.

What the corpus covers, and what it does not

Measured from the release manifest. Every recording carries a timestamp, so the clock is the one label the corpus has. 1,431 of 1,469 drives were recorded between 11:00 and 17:00. Thirty-eight are after 18:00, none are at night, none are before 08:00. A policy trained on this corpus has never seen a headlight. 356 recordings are also missing the front-tilted camera, which the edit leaves alone since the other six are intact.

Release
recordings1,469
cameras per recording7
video1280×720 HEVC, 10 fps
GNSS with RTK60 Hz
recordedMay to Nov 2025
median recording33 s
longest recording3 h 25 min
front-tilted camera missing356
payload3.20 TB

What the edited version had removed

Every recording was scored on whether its cameras predict its own GNSS motion better than a shuffled pairing does. A drive where the car is not moving has nothing to predict, and a drive whose position fix has drifted has the wrong answer. 213 recordings scored at or near zero. 128 of them are a stationary car, at a signal, at a kerb, or behind something. That is not a bad recording, it is just not driving, and a policy trained on it learns to sit.

Why it was removedrecordingshours
stationary for more than 70% of the recording1286.4
RTK fix lost, position drifting412.9
duplicate of another recording, same route, same minute221.1
never leaves the depot171.3
camera gap longer than one second50.2
Removed21311.9
Kept1,25677.9

The removed media

Front camera, twelve seconds each. Six that the cut removed, two that it kept, for contrast.

2025-05-20 12:50kept
Divided road, overcast, light traffic. The kind of drive the corpus is mostly made of.
14.2 m/s mean · 0% stationary · RTK fixed throughout
2025-06-13 16:22removed
Standing behind a vendor cart for eleven of the twelve seconds. The recording is 78% stationary.
0.4 m/s mean · 78% stationary · longest stop 31 s
2025-07-04 14:17kept
Residential lane behind a scooter, parked cars both sides. Slow, but moving, and the cameras predict the motion.
6.1 m/s mean · 4% stationary · RTK fixed throughout
2025-07-30 12:28removed
Crawling behind a two-wheeler onto a dirt shoulder. The RTK fix drops for nine seconds and the position wanders 3 m while the car barely moves.
0.7 m/s mean · RTK lost 9 s · drift 3.1 m
2025-08-13 17:00removed
Parked at the kerb with the engine on. Nothing moves for the whole recording except the GNSS estimate.
0.0 m/s mean · 100% stationary · drift 3.8 m
2025-09-11 11:33removed
Narrow lane, ambulance ahead, stop-and-go. Stationary for most of the recording.
1.1 m/s mean · 61% stationary · longest stop 24 s
2025-09-02 13:18removed
Stopped for a pedestrian, then stays stopped. Ten of twelve seconds at zero speed.
0.3 m/s mean · 71% stationary · longest stop 19 s
2025-10-01 11:07removed
Lane blocked by construction sand. The car edges forward and waits.
0.3 m/s mean · 84% stationary · longest stop 27 s
gagandeepreehal/minuszero-indian-autonomous-driving-dataset-v2 · 1,469 recordings · 7 cameras · CC BY-NC 4.0 Wilson 95% · closed loop, 10 scenarios × 100 runs × 2 arms