GPT-6.1 Sol vs Visual Jev (Qwen3-VL 8B Backbone)

A direct, empirical evaluation of GPT-6.1 Sol (OpenAI) against Visual Jev (Qwen3-VL 8B Backbone) (Independent AI Systems Lab (Guanxu Yu & Yuhang Yao)).

GPT-6.1 Sol

Developed by OpenAI · Proprietary Frontier Workhorse Engine parameters

Near-Astra reasoning at 1/5th price ($1.25/$5.00), SWE-bench Verified 74.8%, OSWorld 2.0 desktop agent automation, and sub-80ms Ultrafast Mode.

Visual Jev (Qwen3-VL 8B Backbone)

Developed by Independent AI Systems Lab (Guanxu Yu & Yuhang Yao) · 8.2 Billion Vision-Language Parameters parameters

Sub-20ms multi-query image verification, automated rejection sampling in generative diffusion pipelines (FLUX / SD3), robotics perception routing, and high-frequency visual software inspection.

Metric GPT-6.1 Sol Visual Jev (Qwen3-VL 8B Backbone)
SWE-bench Verified 74.8% 62.1%
MMLU-Pro 92.4% 86.4%
MATH-500 96.2% 89.2%
Context Window 1,000,000 tokens 32,768 tokens (Visual prefix + batched question suffixes)
Input Pricing (per 1M) $1.25 $0.05
Output Pricing (per 1M) $5.00 $0.10