Model backends¶
Configure LLM and Embedding backends and maintain their available models and capabilities.
Choose a task¶
Task |
Page |
Description |
|---|---|---|
Create an embedding backend through the root-level API |
||
Create an embedding endpoint through the root-level API |
||
Delete an embedding backend through the root-level API |
||
Get an embedding backend through the root API |
||
Get embedding routing through the root-level API |
||
List embedding backends through the root API |
||
List embedding endpoints through the root API |
||
Update embedding routing configuration (root endpoint) |
||
Set embedding endpoint status through the root API |
||
Update an embedding backend through the root API |
||
Create an LLM backend through the root API |
||
Create an LLM endpoint through the root API |
||
Delete an LLM backend through the root-level API |
||
Get an LLM backend (root endpoint) |
||
Get LLM routing configuration (root endpoint) |
||
List LLM backends (root endpoint) |
||
List LLM endpoints through the root API |
||
Write LLM routing configuration through the root API |
||
Set LLM endpoint status through the root API |
||
Update an LLM backend (root endpoint) |
||
Model backend administration objects and rules |
||
Root and workspace update differences |
||
Create an embedding backend through the workspace API |
||
Create an embedding endpoint (workspace endpoint) |
||
Delete an embedding backend (workspace endpoint) |
||
Get an embedding backend (workspace endpoint) |
||
Get embedding routing configuration through the workspace API |
Get embedding routing configuration through the workspace API |
|
List embedding backends (workspace endpoint) |
||
List embedding endpoints (workspace endpoint) |
||
Write embedding routing configuration through the workspace API |
Write embedding routing configuration through the workspace API |
|
Set embedding endpoint status through the workspace API |
||
Update an embedding backend through the Workspace API |
||
Create an LLM backend (workspace endpoint) |
||
Create an LLM endpoint (workspace endpoint) |
||
Delete an LLM backend (workspace endpoint) |
||
Get an LLM backend through the Workspace API |
||
Get LLM routing through the Workspace API |
||
List LLM backends through the Workspace API |
||
List LLM endpoints through the Workspace API |
||
Write LLM routing through the Workspace API |
||
Set LLM endpoint status through the workspace API |
||
Update an LLM backend through the workspace API |