Sherwin Wu· @sherwinwu · X·· 26 天前精选AI 评分66
AI 导读
Sherwin Wu 表示自己曾觉得 ARC-AGI-3 很难,如今该基准已被 Astra 饱和。引用 François Chollet 的话称,ARC 3 发布时他预计前沿模型约一年才能饱和,实际只用了 6 个月,约为预期的 2 倍速度,新一代模型的能力将挑战人们基于旧模型形成的 AI 观点。
推荐理由
结合 Arc Prize 负责人的预估与半年即饱和的结果,读者可以借此对照自己对前沿模型进展速度的预期。
正文 · 原文
Progress continues to surprise even the best of us. ARC-AGI-3 was the first ARC-AGI benchmark that I struggled with myself (it is so confusing!). Now it's saturated.
When we released ARC 3, I got asked, "when do you think a frontier model will saturate it?", and I answered "in about a year, though it depends on how much it gets explicitly targeted" That was 6 months ago, so the progress that Astra represents happened about 2x faster than I anticipated. I think the speed of progress will surprise a lot of people, and what the new models can do will challenge the views of AI that people developed by using prior generations of models.在 X 查看被引用的帖子
来源:Sherwin Wu · x.com