Paper

Solve Vision with Code

Coding Agents Are Stronger Visual Reasoners Than Video Models

—
best coding agent
 
VS
—
best video model
 

Leaderboard

coding agentcoding agent, open weightsvideo model
Rank Model Agent Overall ID OOD Videos
Loading leaderboard…

Examples

First frame 
G-222 first frame
Codex1.000
Claude Code1.000
Gemini CLI1.000
VBVR-Pro-Wan2.2-I2V-A14B (RL)0.000

G-222 · mark tangent point of circles

First frame 
G-273 first frame
Codex0.925
Claude Code0.960
Gemini CLI1.000
VBVR-Pro-Wan2.2-I2V-A14B (RL)0.376

G-273 · high density liquid

First frame 
O-60 first frame
Codex1.000
Claude Code1.000
Gemini CLI1.000
VBVR-Pro-Wan2.2-I2V-A14B (RL)0.154

O-60 · symbol substitute

First frame 
G-47 first frame
Codex0.996
Claude Code0.996
Gemini CLI0.996
VBVR-Pro-Wan2.2-I2V-A14B (RL)0.436

G-47 · multiple keys for one door

First frame 
O-85 first frame
Codex0.935
Claude Code0.935
Gemini CLI0.933
VBVR-Pro-Wan2.2-I2V-A14B (RL)0.548

O-85 · 2d object rotation

First frame 
O-65 first frame
Codex1.000
Claude Code1.000
Gemini CLI1.000
VBVR-Pro-Wan2.2-I2V-A14B (RL)0.146

O-65 · animal size sorting

First frame 
O-47 first frame
Codex1.000
Claude Code1.000
Gemini CLI1.000
VBVR-Pro-Wan2.2-I2V-A14B (RL)0.253

O-47 · sliding puzzle

First frame 
O-34 first frame
Codex1.000
Claude Code1.000
Gemini CLI1.000
VBVR-Pro-Wan2.2-I2V-A14B (RL)0.300

O-34 · dot to dot task

First frame 
O-53 first frame
Codex0.982
Claude Code0.994
Gemini CLI0.981
VBVR-Pro-Wan2.2-I2V-A14B (RL)0.422

O-53 · clock

First frame 
G-45 first frame
Codex1.000
Claude Code1.000
Gemini CLI1.000
VBVR-Pro-Wan2.2-I2V-A14B (RL)0.627

G-45 · key door matching

First frame 
G-24 first frame
Codex1.000
Claude Code1.000
Gemini CLI1.000
VBVR-Pro-Wan2.2-I2V-A14B (RL)0.995

G-24 · separate objects no spin

Categories & efficiency