Models and Providers API¶
Provider APIs configure the model backends used inside AI Studio by workflows, knowledge bases, and agents. They do not perform OpenAI-compatible inference. For application inference with a Genesis API key, use the Model API.
Provider types¶
The product contract separates three provider families:
Family |
Root |
Typical role |
|---|---|---|
LLM |
|
Generation, reasoning, extraction, and agent chat |
Embedding |
|
Build vectors for knowledge and retrieval |
Parser |
|
Convert supported documents into processable content |
Each enabled family can expose backends, backend detail, endpoints, endpoint status, and router configuration. LLM and embedding providers also expose model discovery and probe operations.
Backends and endpoints¶
For LLM backends:
Method and route |
Purpose |
|---|---|
|
List configured backends |
|
Create a backend |
|
Read a backend |
|
Update it |
|
Delete it |
|
Create an endpoint |
|
List backend endpoints |
|
Change endpoint status |
|
Probe models through that backend |
Embedding and parser use the same resource pattern under their respective root paths. Fields differ by provider type: for example, parser configuration can describe supported MIME types, while model providers can expose model IDs and credential references. Use the deployed schema and never copy fields between provider kinds merely because their routes look alike.
Probe before enabling an endpoint. A successful probe verifies the submitted connection at that moment; it does not guarantee future availability, model quota, compatible vector dimensions, or permission for every workspace user.
Routers and available models¶
GET and PUT /newmoi/{family}/router read and update routing configuration.
LLM and embedding model lists are available through /newmoi/models and
/newmoi/embedding/models; probe routes are also available at the family or
backend level.
Router strategies and their fields are deployment-defined. Update a router only with backend and endpoint IDs returned by the same workspace. After an update, read the router again and perform a representative probe before moving production traffic.
Initial setup and secrets¶
POST /newmoi/llm/setup provides the product setup operation for an LLM
backend; it can orchestrate more than a single low-level create. Prefer it when
the deployment documents the setup flow.
Provider API keys and credentials are secrets. Send them only in fields explicitly marked for credentials, do not return them to browsers, and do not expect list/detail responses to reveal them. Rotating a provider key can affect agents, workflows, and knowledge indexing at once; inventory those consumers and retain rollback information before changing it.
Deleting a backend or disabling its last healthy endpoint can interrupt active work. Check endpoint health and downstream bindings, then confirm the impact. For failures inside a workflow, correlate the provider probe with the workflow execution ID rather than repeatedly rerunning the job.