NVIDIA 发布 Alpamayo 2 Super：面向 Robotaxi 与自动驾驶的 34B 开源视觉-语言-动作模型

NVIDIA has released Alpamayo 2 Super, a 34B-parameter vision-language-action (VLA) model for autonomous driving, under an open commercial license. The stated design target is the long-tail events: rare, multi-agent situations that conventional detection-and-prediction stacks handle poorly. The model pairs a 32B VLM backbone, built on NVIDIA Cosmos 3 Super Reasoner and post-trained with reinforcement learning, with a 2.3B diffusion-based action decoder. From one pass over full-surround camera video it emits a planned trajectory, a causal explanation of that trajectory, and a meta-action.

Is it deployable

Yes, and for commercial use from day one. The weights are released under OpenMDW-1.1, the Linux Foundation’s permissive license for open model distributions; source code is Apache 2.0. The license covers fine-tuning, derivative models and commercial redistribution. NVIDIA is applying OpenMDW across the entire Alpamayo family, so earlier releases introduced for R&D are now deployable commercially without additional permission.

Inputs, outputs and training data

Inputs are multi-camera RGB video, text, and egomotion history with timestamps. The validated public notebook profiles use six cameras and four historical frames per camera. Egomotion is 3D translation plus a 3×3 rotation matrix, multi-timestep.

The trajectory API returns 64 waypoints spanning 0.1 to 6.4 seconds at 0.1-second intervals. Each waypoint carries ego-frame XYZ and a 3×3 rotation matrix.

Training data is roughly 115,000 hours of multi-camera driving video with egomotion and trajectory annotations. It includes about 3,700,000 Chain-of-Causation (CoC) traces — structured, causally linked explanations of driving decisions. Image training data exceeds one billion images.

Benchmarks

On LingoQA, Alpamayo 2 Super records a Lingo-Judge score of 79.2 and ranks first among nearly 40 models evaluated. In NVIDIA’s testing it beat Qwen2.5-VL 72B by 17.0 points, Gemini 2.5 Pro by 15.1, and GPT-4o by 23.2.

Two more numbers matter for planning work. Closed-loop evaluation with AlpaSim on 910 scenarios from the PhysicalAI-AV-NuRec dataset gives an AlpaSim score of 1.50 ± 0.13. Open-loop evaluation on 937 challenging samples from the PhysicalAI-AV dataset gives minADE₆ at 6.4s of 0.911m.

Five outputs from one model

For each driving situation, the model produces a trajectory, a CoC trace explaining the decision, a meta-action such as yield or lane change, reasoning auto-labels, and visual question answering with 2D grounding.

That combination is what makes the release interesting operationally. Developers can tie what the model observed to the action it chose. CoC traces integrate with NVIDIA Halos safety-validation workflows and support AI safety aligned with ISO/PAS 8800.

Used as an autolabeler on proprietary fleet data, NVIDIA says the model compresses annotation cycles from months to days.

Interactive explainer

Key Takeaways

• 34B VLA model — 32B Cosmos 3 Super Reasoner backbone plus a 2.3B diffusion action expert.
• OpenMDW-1.1 weights and Apache 2.0 code; commercial use and redistribution allowed, no extra permission needed.
• LingoQA Lingo-Judge 79.2, first among nearly 40 models; AlpaSim 1.50 ± 0.13; minADE₆ 0.911m at 6.4s.
• One pass yields trajectory, Chain-of-Causation trace, meta-action, auto-labels, and grounded VQA.
• Cloud-scale model tested on 1× H100 80GB at 72,115 MiB peak; distill it for in-car inference.

Check out theNVIDIA blog and Hugging Face model card. Also, feel free to follow us on Twitter and don’t forget to join our 150k+ML SubReddit and Subscribe to our Newsletter. Wait! are you on telegram? now you can join us on telegram as well.