Model backends

Configure LLM and Embedding backends and maintain their available models and capabilities.

Choose a task

Task

Page

Description

Create an embedding backend through the root-level API

Create an embedding backend through the root-level API

Create an embedding endpoint through the root-level API

Create an embedding endpoint through the root-level API

Delete an embedding backend through the root-level API

Delete an embedding backend through the root-level API

Get an embedding backend through the root API

Get an embedding backend through the root API

Get embedding routing through the root-level API

Get embedding routing through the root-level API

List embedding backends through the root API

List embedding backends through the root API

List embedding endpoints through the root API

List embedding endpoints through the root API

Update embedding routing configuration (root endpoint)

Update embedding routing configuration (root endpoint)

Set embedding endpoint status through the root API

Set embedding endpoint status through the root API

Update an embedding backend through the root API

Update an embedding backend through the root API

Create an LLM backend through the root API

Create an LLM backend through the root API

Create an LLM endpoint through the root API

Create an LLM endpoint through the root API

Delete an LLM backend through the root-level API

Delete an LLM backend through the root-level API

Get an LLM backend (root endpoint)

Get an LLM backend (root endpoint)

Get LLM routing configuration (root endpoint)

Get LLM routing configuration (root endpoint)

List LLM backends (root endpoint)

List LLM backends (root endpoint)

List LLM endpoints through the root API

List LLM endpoints through the root API

Write LLM routing configuration through the root API

Write LLM routing configuration through the root API

Set LLM endpoint status through the root API

Set LLM endpoint status through the root API

Update an LLM backend (root endpoint)

Update an LLM backend (root endpoint)

Model backend administration objects and rules

Model backend administration objects and rules

Root and workspace update differences

Root and workspace update differences

Create an embedding backend through the workspace API

Create an embedding backend through the workspace API

Create an embedding endpoint (workspace endpoint)

Create an embedding endpoint (workspace endpoint)

Delete an embedding backend (workspace endpoint)

Delete an embedding backend (workspace endpoint)

Get an embedding backend (workspace endpoint)

Get an embedding backend (workspace endpoint)

Get embedding routing configuration through the workspace API

Get embedding routing configuration through the workspace API

List embedding backends (workspace endpoint)

List embedding backends (workspace endpoint)

List embedding endpoints (workspace endpoint)

List embedding endpoints (workspace endpoint)

Write embedding routing configuration through the workspace API

Write embedding routing configuration through the workspace API

Set embedding endpoint status through the workspace API

Set embedding endpoint status through the workspace API

Update an embedding backend through the Workspace API

Update an embedding backend through the Workspace API

Create an LLM backend (workspace endpoint)

Create an LLM backend (workspace endpoint)

Create an LLM endpoint (workspace endpoint)

Create an LLM endpoint (workspace endpoint)

Delete an LLM backend (workspace endpoint)

Delete an LLM backend (workspace endpoint)

Get an LLM backend through the Workspace API

Get an LLM backend through the Workspace API

Get LLM routing through the Workspace API

Get LLM routing through the Workspace API

List LLM backends through the Workspace API

List LLM backends through the Workspace API

List LLM endpoints through the Workspace API

List LLM endpoints through the Workspace API

Write LLM routing through the Workspace API

Write LLM routing through the Workspace API

Set LLM endpoint status through the workspace API

Set LLM endpoint status through the workspace API

Update an LLM backend through the workspace API

Update an LLM backend through the workspace API

Last updated on