Model discovery and settings

Query available models, inspect capabilities, and maintain invocation settings.

Choose a task

Task

Page

Description

List embedding routing models

List embedding routing models

Workspace declarations enter this list only with at least one ONLINE endpoint having a nonempty address.

List routed models

List routed models

Combines currently readable Workspace declarations with system/deployment models allowed by the permission scope.

List workspace embedding models

List workspace embedding models

Set BASE_URL to the product API prefix https://api.moi.matrixorigin.cn/v5; use the corresponding product API URL for a dedicated deployment.

Model discovery and probe objects

Model discovery and probe objects

Use BASE_URL, MOI_KEY, and WORKSPACE_ID from the same target environment. BACKEND_ID comes from that environment’s backend list.

Probe models on a configured embedding backend

Probe models on a configured embedding backend

Requires model_backend.read on the specified backend.

Probe embedding models

Probe embedding models

Requires regular access to the current workspace.

Probe models on a configured LLM backend

Probe models on a configured LLM backend

Requires model_backend.read on the specified backend.

Probe LLM models

Probe LLM models

Requires regular access to the current workspace.

Configure an LLM backend and endpoint

Configure an LLM backend and endpoint

Requires Workspace model_backend.create.

Last updated on