Tibo· @thsottiaux · X·· 3 小时前精选AI 评分65
AI 导读
OpenAI 开发者账号宣布 API 现已可选 12 小时 prompt 缓存,持续运行的智能体可在请求间隔数小时的情况下继续以更低的缓存输入费率复用指令、工具和上下文。Tibo 补充称,Codex 与 Work 中已登录用户的缓存会永久保留,返回旧对话或数小时后恢复会话保证命中缓存,且无额外惩罚。
推荐理由
作者亲述 API 12 小时缓存与 Codex、Work 侧持久缓存策略,可直接判断对长时间运行 Agent 成本和体验的影响。
正文 · 原文
Day 16/
You can now cache for 12h in the API and for logged in users across Codex & Work we keep cache forever and you don’t have any penalty for coming back to an old conversation or resuming after a few hours and are now guaranteed to hit the cache.
You can now choose 12-hour prompt caching in the API. Persistent agents, like dots, reuse context throughout the day. You can keep shared instructions, tools, and context cached longer and pay the lower cached-input rate, even when requests are hours apart.在 X 查看被引用的帖子
来源:Tibo · x.com