Arena 宣布 DeepSeek-V4.1-Flash-20261017 (Max) 成为 Agent Arena 第一开源模型,总排名第 11,基于超 7.5K 真实会话净提升 +5.1%。其中位任务成本 $0.20,约为 GPT-6.1 Sol 提升幅度的 37%、成本的 27%;Confirmed Success 提升 +11.5%,且无 Tool Hallucination 问题。
Arena 用 7.5K 真实会话的数据说明该模型以约 27% 的成本拿下开源第一,读者可据此权衡 Agent 场景的性价比。
Big news: DeepSeek-V4.1-Flash-20261017 (Max) by @deepseek_ai is now the #1 open model in Agent Arena! It just landed at #11 overall with +5.1% net improvement across +7.5K real-world sessions.
This performance also reshapes the Agent Arena Pareto frontier! All models above V4.1-Flash 20261017 in performance are proprietary at much higher cost. At $0.20 median cost per task, that’s ~37% of GPT-6.1 Sol’s improvement for about 27% of the cost.
By signal, this release achieves:
- #8 in Confirmed Success with +11.5% (#1 open)
- #11 in Praise vs. Complaint with +5.9% (#1 open)
- #12 in Bash Reliability with +5.4% (#1 open)
- #13 in Steerability with +2.5% (#1 open)
- No issues with Tool Hallucination
Find more info on signals at the link in thread on Agent Arena.
Congrats to the @deepseek_ai team on this release!
Exciting news: DeepSeek-V4.1-Flash-20261017 (Max) by @deepseek_ai is now the #1 open model in Code Arena: WebDev, surpassing Kimi K3 (Max) at 10x lower cost! Highlights: - #1 open model, ahead of Kimi K3 (Max) - #12 overall with 1670 pts, ahead of Claude Opus 5 (High) and within ~10 pts of GPT-6 Sol (Max) - Shifts the Pareto frontier at $0.3/$1.2 per million input/output tokens - +52 pts vs. the previous DeepSeek-V4.1-Flash-20260910 Congrats to the @deepseek_ai team on another strong contribution to the open source ecosystem!在 X 查看被引用的帖子
来源:Arena.ai · x.com