Data processing

Use these APIs to manage workflow-based processing, custom operators, data lineage, SQL execution, and data dashboards. Select the group that matches the processing resource or execution task you need to handle.

Choose a task

Task	Page	Description
Configure workflows	Workflow	Create and update workflow definitions, or pause, resume, and delete workflows.
Work with workflow templates	Workflow templates	Inspect template definitions or create, replace, and delete templates.
Run and track workflow jobs	Workflow jobs	Start jobs, inspect results and node status, and control existing jobs.
Rerun from a node	Workflow reruns	Inspect a node rerun plan, then create, inspect, or cancel a rerun branch.
Retry workflow executions	Workflow retries	Retry a workflow job or batch-retry selected or failed executions.
Create custom workflow operators	Custom operators	Maintain Python operators or built-in bindings, and test, enable, or disable operators.
Choose workflow operators	Workflow operator catalog	Inspect available operators, versions, and input and output definitions.
Expose operators through APIs	Operator API services	Publish an operator version and inspect, invoke, enable, or disable its service.
Trace files and processing results	Data lineage	Inspect lineage, nodes, and outputs, and manage versions for versioned outputs.
Run SQL and retrieve results	SQL execution	Submit SQL, inspect execution status, and read or download successful results.
Inspect database objects	SQL metadata	Inspect database, table, and view definitions, or delete unused objects.
Save and version SQL	SQL workbooks	Save SQL drafts and finalized versions without executing the SQL.
Configure dashboards and charts	Data dashboard	Create dashboards and charts, run charts, and read or download results.

Last updated on Sep 9, 2026