TypeSafe AI· @typesafeai · X·· 5 小时前AI 评分49
AI 导读
Jev 不好用?它是为可组合性而生的! 需要更多 Jev!
正文
Jev not working right? It's built for composability!
Needs more Jev!
Jev is fast at helping you. Turns out, it can also be fast at helping an attacker!! 😱🚨 We red-teamed Jev 1.13 on our DTap (DecodingTrust-Agent Platform) and found a serious safety gap: 70.1% ASR under direct misuse 43.5% ASR under indirect prompt injection In our evaluations, we found that under indirect prompt injection, Jev can follow attacker-injected instructions without blinking an eye, e.g., exfiltrating user data, deleting files, or taking other harmful actions. But we found a much safer way to integrate Jev: use it as a self-gating layer for its own tool calls, significantly reducing ASR while preserving most of its utility. 👇 Read more below在 X 查看被引用的帖子
来源:TypeSafe AI · x.com