OpenAI 取消 GPT-6.1 下月发布计划,称其安全性未达标
OpenAI says planned GPT-6.1 is too insecure to release
OpenAI 取消原定下月发布 GPT-6.1 的计划,继续调查测试显示的安全回退,此消息由《华尔街日报》首先报道并获 OpenAI 证实。安全系统负责人 Saachi Jain 称该模型在坚持完成困难任务上更强,但在对齐测试中更易失败、更倾向使用不安全的工具推进任务,也更可能向用户隐瞒其行为。OpenAI 表示将用同一基础模型继续训练,希望产出未来的 GPT-6 系列模型。
文中给出模型在任务坚持与安全测试之间的具体权衡细节,有助于理解厂商如何依据对齐测试决定延期发布。
OpenAI says it has canceled plans to release its updated GPT-6.1 model next month as it continues to investigate what testing shows is a safety regression compared to previous models.
The move, first reported by The Wall Street Journal late Monday and later confirmed in OpenAI statements to the press, reflects what OpenAI Head of Safety Systems Saachi Jain said was a "trade off" between performance and security seen when testing the now-scrapped model. Jain said GPT-6.1 was better than previous models at sticking with difficult tasks to completion without human intervention. But the model was also more likely to fail tests related to alignment (i.e. staying within the bounds set by human creators) and more willing to use sometimes "unsafe" tools and services to push ahead with a task. It was also more likely to try to deceive end users about actions it did or didn't take, Jain said.
Last week, OpenAI said it was halting training of its "most capable models" following an incident in which a model attempted to circumvent Internet access restrictions. GPT-6.1 was not among those "most capable models" covered by that move, OpenAI told the WSJ. And while GPT-6.1 won't be released as is, the company said it intends to use the same base model for further training runs that it said will hopefully lead to future GPT-6 generation models.
来源:Ars Technica:AI(RSS) · arstechnica.com