跳到正文
北京时间
原文
OpenAI:官网动态·· 3 小时前精选AI 评分67

OpenAI 正式发布 Decisions API,面向低延迟低成本小决策

Build more responsive apps with the Decisions API

AI 导读

OpenAI 宣布基于 GPT-6 Luna 的 Decisions API 正式可用,用于分类、路由、评分等有界答案问题,速度最高比通过 Responses API 使用 GPT-6 Luna 快 10x。

推荐理由

官方宣布 Decisions API 正式可用,给出与 GPT-6 Luna 的速度对比、定价和 GPT-Live 集成,便于评估路由分类类场景的收益。

正文 · 原文

Build more responsive apps with the Decisions API

Fast, focused, low-cost decisions for any application.

Share

Introducing the Decisions API

Video 1

Image 1: Decisions API — Video poster

00:00 05:25

Applications and agents make many small decisions throughout a workflow: how to classify an input, where to route a request, or which action to take next. Individually, they are simple. At scale, their latency and cost add up.

Today, we’re making the Decisions API generally available. Built with GPT‑6 Luna, the Decisions API focuses Luna’s intelligence on questions with bounded answers, helping applications and agents make near real-time decisions from text, images, and structured inputs up to 10x faster than GPT‑6 Luna through the Responses API.

Since public beta, we’ve added a native GPT‑Live integration, prompt caching for reused context, and inference residency in the US and EU. Developers can also pass native JSON inputs, include images in question instructions, and ask up to 400 questions per request, twice the previous limit. We’ve also continued to improve latency, including additional capacity in several regions in Asia.

How teams are using the Decisions API

Early adoption of Decisions has shown its applicability across a variety of use cases.

Across OpenAI, teams are applying the Decisions API across product and business workflows. The dots team is using it to reduce response times and improve interactivity. Our Personal Finance team is using it to categorize transaction descriptions, while our Communications team is using Decisions to classify coverage by the themes and scores whether it reinforces or challenges key narratives—helping identify what warrants closer review.

These early examples show how fast, structured decision-making can turn incoming information into useful action across a wide range of use cases. Customers are applying the Decisions API just as broadly, from accurately attributing AI costs to making language-learning experiences more interactive.

1 of 5

“_With Box Extract and__the__Decisions API, we classify business documents and route them to the right next step. In our evaluation,_the__Decisions API delivered ~5x faster route selection on 30 certificate of insurance cases, with the same accuracy as__the__Responses API—automating routine work and sending lower-confidence cases to reviewers.”

—Biswaroop Palit, VP, Product Management Platform and Integrations, Box

“The__Decisions API is helping us score the risk of agent-generated [ rshell commands⁠(opens in a new window)] before executing them to autonomously remediate issues. Compared with available frontier models, it delivered 40x faster p95 with comparable accuracy—making it possible to place Decisions__in the hot path of a remediation action.”

—AJ Stuyvenberg, Staff Engineer, Datadog

“The Decisions API has made it 4x faster and 30% cheaper to attribute our AI costs to the actual work when compared to GPT‑6 Luna, without sacrificing accuracy.”

—René Sultan, Research Engineer, Ramp

“At Sierra, we use__the__Decisions API to choose the right next action during parts of our orchestration in live customer conversations. It runs at under 280 ms p95, about 3× faster and 90% lower cost per call than our previous approach, with no drop in customer outcomes.”

—Ajeet Grewal, Engineer, Sierra

“For language learners, timing matters. In our testing, the Decisions API integration in GPT‑Live was able to reduce the time to next action by over 90%, from 1.4s to 0.13s, creating a much more interactive learning experience.”

—Andrew Hsu, CTO, Speak

  • Box

  • Datadog

  • Ramp

  • Sierra

  • Speak

  • Box

  • Datadog

  • Ramp

  • Sierra

  • Speak

Select the type of decision your application needs

Using the Decisions API is simple: developers define a question and its allowed answers, then provide context as text, images, or native JSON. The API returns one of three supported answer types—a probability, choice, or score—that applications can use to determine what happens next. The variety of answer types allows Decisions to be applicable across a wide variety of use cases.

Decisions API supports three answer types:

Type Use it to Main result
predicate Estimate the probability that a condition is true, such as whether a product has visible damage. probability: an estimate from 0 to 1 that the condition is true.
choice Select one of your predefined options, such as whether an agent should continue, retry, or ask for clarification. choice: one of your supplied values. The response also includes probabilities and confidence.
score Rate an input against ordered levels in a rubric, such as the severity of damage. score: the probability-weighted average of the level indices.

Build real-time voice experiences with the Decisions API and GPT‑Live

With GPT‑Live, you can bring natural, expressive conversation to your voice applications, with smooth interruption handling that keeps conversations flowing. Decisions API now integrates natively with GPT‑Live⁠(opens in a new window), helping applications make fast, focused decisions during live conversations. A customer support agent can decide whether to ask a clarifying question, route a request, or escalate an issue. An avatar can adjust its facial expressions as a user speaks to it, and based on the user’s words, respond with a wink or a smile to create a more interactive experience.

The example below uses transcript updates to select an avatar’s expression. Add this configuration to session.triggers in an existing GPT‑Live session.

JSON

1{2 "type": "decisions",3 "event_type": "session.input_transcript.delta",4 "decisions": {5 "questions": [{6 "type": "choice",7 "name": "reaction",8 "instructions": "Choose an appropriate reaction for the avatar based on the user's latest message.",9 "choices": [10 { "value": "neutral" },11 { "value": "happy" },12 { "value": "sad" },13 { "value": "concerned" }14 ]15 }]16 }17}

Live emits a decision.event; the application reads the selected reaction and animates the character accordingly. Learn more about connecting voice to Decisions API. ⁠(opens in a new window)

Try Decisions with GPT‑Live for yourself

Audio 1

Mic off

Image 2

Image 3

Start session

Microphone off until you start

Connecting

Session ends in 0:00

Session ended. Start again if you'd like to keep talking.

Microphone off until you start

Expression palette

Tap a face to preview it.

Image 4CuriousImage 5DelightedImage 6SurprisedImage 7PensiveImage 8TenderImage 9CheekyImage 10At ease

Live decisions

Watch as the Decisions API chooses a facial expression based on what each of you says.

Your words

Watch the reaction as you speak.

Assistant’s words

Watch the face as the assistant replies.

Try saying

I rehearsed my audition for my cat. She walked out halfway through.

I have a secret. Lean in a little closer.

Actually, my sister got the part. It’s her first show!

I’m nervous about tomorrow. Can you sit with me?

I just got the part! Can you celebrate with me?

Look surprised, then tell me what you saw.

Could you search the web for the next meteor shower?

I rehearsed my audition for my cat. She walked out halfway through.

This demo is time-limited. By using it, you agree to OpenAI's Terms⁠ and acknowledge our Privacy Policy⁠.

Build and evaluate your first decision

Decisions API is generally available today with GPT‑6 Luna through the dedicated Decisions endpoint. See the pricing and availability guide⁠(opens in a new window) for current rates and caching details.

Start with one recurring decision your application makes often. Define the question, the possible answers, and the context needed to distinguish them. Test it on examples that reflect real usage, in the Decisions Playground⁠(opens in a new window) with your own text or images, or follow the developer guide⁠(opens in a new window) to make your first request.

Decisions API costs $0.10 per million input tokens. Cached input costs $0.01 per million tokens. For 30-minute and 12-hour cached writes, read our pricing guide.⁠(opens in a new window) You only pay for input tokens: there are no output-token charges. Regional processing is available in the US and EU, and Zero Data Retention⁠(opens in a new window) is available to eligible customers. See pricing and caching⁠(opens in a new window) and data controls ⁠(opens in a new window)for details.

Author

OpenAI

来源:OpenAI:官网动态 · openai.com