Model inference¶
Choose an API for the resource you need to operate on, then prepare the identity, IDs, and parameters listed on its action page.
Choose a task¶
Task |
Page |
Description |
|---|---|---|
Invoke a workspace chat model |
Generate responses through workspace models and routing, with ordinary JSON or SSE streaming responses. |
|
Invoke a workspace embedding model |
Convert text or model-supported input into vectors through a workspace embedding model. Large inputs may require multiple upstream calls. |
|
Workspace inference request fields |
The current gateway does not fully validate messages’ roles/content. The type table does not guarantee provider acceptance. |
|
Workspace inference results and streaming protocol |
This is a compatibility shape. Raw providers and adapters may return extra fields; examples are not a universal complete required schema. |
|
Product model invocation common objects |
In-product model invocation uses workspace and product identity. |