Import task object fields

This page defines data.task in the response of Query task details and data.tasks[] in the response of Query task list. The same field has the same type and meaning in both interfaces. Fields marked “structured loading only” may only be returned if config_type is 3.

Basic fields

Field

Type

Description

id

string

Task ID.

name

string

Task name.

config_type

integer

Task configuration type: 1 file import, 2 database import, 3 structured loading.

source_connector_id

string

Source connector ID.

source_connector_type

integer

Source connector type code.

connector_name

string

Source connector name.

volume_id

string

Target volume ID. Structured data tables may be empty when imported.

volume_name

string

The name of the target data volume.

volume_path

object

The directory tree path of the target data volume.

volume_path.id_list

string[]

The ID of each level of the path.

volume_path.name_list

string[]

The names of each level of the path.

creator

string

The user ID that created the task.

status

integer

Task status: 0 Unknown, 1 In Progress, 2 Paused, 3 Paused, 4 Completed, 5 Failed.

source_config

object

Type-specific source configuration.

start_at

integer

Unix timestamp of the start time.

end_at

integer

Unix timestamp of the end time.

created_at

integer

Unix timestamp of creation time.

updated_at

integer

Unix timestamp of last updated time.

file_types

integer[]

File type filtering code.

path_regex

string

File path filtering regular; if not set, it is an empty string.

unzip_keep_structure

boolean

Whether to keep the directory structure when decompressing.

dedup

object or null

Deduplication configuration.

dedup.by

string[]

Basis for determining duplicate files.

dedup.strategy

string

Duplicate file handling strategy.

table_path

object

Single table target path.

table_path.id_list

string[]

The ID of each level of the single table target path.

table_path.name_list

string[]

The names of each level of the single table target path.

table_paths

object[]

Multi-table target path; may be omitted if there is no multi-table configuration.

table_paths[].id_list

string[]

The ID of each level of each multi-table target path.

table_paths[].name_list

string[]

The name of each level of each multi-table target path.

source_files

string[][]

Source file information. Each item is the connector name, followed by the file URI.

load_type

integer

Loading method code.

load_results

object[]

The loading results of each file or table.

load_results[].lines

integer

The number of lines corresponding to the result.

load_results[].reason

string

The failure reason of the corresponding result.

total_rows

integer

The total number of rows processed by the task.

imported_rows

integer

The number of imported rows.

success_file_count

integer

Number of successful files.

failed_file_count

integer

Number of failed files.

latest_rows

object

Row statistics of the latest run; may be omitted if not collected.

latest_rows.read_rows

integer or null

Number of rows read in the most recent run.

latest_rows.succeeded_rows

integer or null

The number of rows in the latest successful run.

latest_rows.failed_rows

integer or null

Number of rows that failed in the most recent run.

latest_rows.skipped_rows

integer or null

Number of rows skipped in the most recent run.

latest_rows.complete

boolean

Whether the statistics of the latest run are complete.

cumulative_rows

object

Cumulative row statistics; may be omitted when not collected.

cumulative_rows.read_rows

integer or null

The cumulative number of rows read.

cumulative_rows.succeeded_rows

integer or null

The cumulative number of successful rows.

cumulative_rows.failed_rows

integer or null

The cumulative number of failed rows.

cumulative_rows.skipped_rows

integer or null

The cumulative number of skipped rows.

cumulative_rows.complete

boolean

Whether the cumulative statistics are complete.

error_code

string

Current error code; may be empty if there is no error.

error_summary

string

Current error summary; may be empty if there are no errors.

target_path_state

string

Target path state.

target_path_error_code

string

Error code for target path parsing or verification; may be omitted if there is no error.

target_path_error_summary

string

Error summary of target path parsing or verification; may be omitted if there is no error.

In this document, [] after a type means an array; for example, string[] is an array of strings. In field paths, [] means each item in an array.

Structured loading fields

The following fields may be returned only by structured load tasks.

Field

Type

Description

structured_load_config

JSON object

Complete structured load configuration.

structured_load_summary

object

Structured load summary.

structured_load_summary.source_type

string

Source type.

structured_load_summary.source_object

string

The source object.

structured_load_summary.target_database_id

string

Target database ID.

structured_load_summary.target_table_id

string

Target table ID.

structured_load_summary.target_table_name

string

Target table name.

structured_load_summary.source

object

Source summary.

structured_load_summary.source.connector_id

string

Source connector ID.

structured_load_summary.source.connector_name

string

Source connector name.

structured_load_summary.source.source_type

string

Source type.

structured_load_summary.source.database

string

Source database name.

structured_load_summary.source.schema

string

Source schema name; may be omitted if not applicable.

structured_load_summary.source.table

string

Source table name; may be omitted if not applicable.

structured_load_summary.source.collection

string

Source collection name; may be omitted if not applicable.

structured_load_summary.source.object

string

Source object name; may be omitted if not applicable.

structured_load_summary.target

object

Target summary.

structured_load_summary.target.mode

string

Target table mode.

structured_load_summary.target.database_id

string

Target database ID.

structured_load_summary.target.database_name

string

Target database name.

structured_load_summary.target.table_id

string

Target table ID.

structured_load_summary.target.table_name

string

Target table name.

structured_load_summary.mapping_count

integer

Number of mappings.

structured_load_summary.mapping

JSON

Mapping configuration.

structured_load_summary.schedule

JSON

Scheduling configuration.

structured_load_summary.backfill

JSON

Backfill configuration.

structured_load_summary.run_mode

string

Run mode.

structured_load_summary.sync_strategy

string

Synchronization strategy.

structured_load_summary.backfill_enabled

boolean

Whether to enable backfill.

structured_load_summary.backfill_phase

string

Backfill phase.

structured_load_summary.backfill_progress_percent

integer

Backfill progress percentage.

structured_load_summary.runtime_init_status

string

Runtime initialization status.

structured_load_summary.priority

string

Calculation priority.

structured_load_summary.config_hash

string

Configuration hash.

structured_load_summary.progress

object

Loading progress; may be omitted if there is no progress.

structured_load_summary.progress.total_rows

integer

The total number of rows in progress.

structured_load_summary.progress.imported_rows

integer

Number of imported rows in progress.

structured_load_summary.progress.progress_percent

integer

Progress percentage.

structured_load_summary.checkpoint

object

Checkpoint summary; may be omitted if there is no checkpoint.

structured_load_summary.checkpoint.source_object_hash

string

Source object hash.

structured_load_summary.checkpoint.structured_config_hash

string

Structured configuration hash.

structured_load_summary.checkpoint.source_schema_hash

string

Source schema hash.

structured_load_summary.checkpoint.capability_profile_hash

string

Source capability configuration hash.

structured_load_summary.checkpoint.order_policy_hash

string

Order policy hash.

structured_load_summary.checkpoint.consistency_proof_hash

string

Consistency proof hash.

structured_load_summary.checkpoint.lock_owner_run_id

string

The run ID of the checkpoint lock.

structured_load_summary.checkpoint.lock_phase

string

Checkpoint lock phase.

structured_load_summary.checkpoint.lock_expires_at

integer

The Unix timestamp of the checkpoint lock expiration time.

structured_load_summary.reconcile

object

Reconciliation summary; may be omitted if there is no reconciliation information.

structured_load_summary.reconcile.id

string

Reconciliation record ID.

structured_load_summary.reconcile.run_id

string

Reconciliation run ID.

structured_load_summary.reconcile.phase

string

Reconciliation phase.

structured_load_summary.reconcile.status

string

Reconciliation status.

structured_load_summary.reconcile.error_code

string

Reconciliation error code.

structured_load_summary.reconcile.error_message

string

Reconciliation error message.

structured_load_summary.reconcile.created_table_id

string

The ID of the newly created table in the reconciliation.

structured_load_summary.reconcile.updated_at

integer

The Unix timestamp of the reconciliation record update time.

structured_load_summary.reconcile.resolved_at

integer

The Unix timestamp of the time the reconciliation record was resolved.

Structured loading runtime fields

The following fields are also exclusive to structured loading tasks.

Field

Type

Description

structured_runtime

object

Structured loading runtime information.

structured_runtime.runtime_init_status

string

Runtime initialization status.

structured_runtime.config_hash

string

Configuration hash.

structured_runtime.run_status

string

Running status.

structured_runtime.checkpoint_status

string

Checkpoint status.

structured_runtime.backfill

JSON

Backfill runtime information.

structured_runtime.schema_snapshot

JSON

Source schema snapshot.

structured_runtime.mapping

JSON

The current mapping.

structured_runtime.progress

object

Runtime progress; may be omitted if there is no progress.

structured_runtime.progress.total_rows

integer

The total number of rows in progress.

structured_runtime.progress.imported_rows

integer

Number of imported rows in progress.

structured_runtime.progress.progress_percent

integer

Progress percentage.

structured_runtime.checkpoint

object

Runtime checkpoint.

structured_runtime.checkpoint.source_object_hash

string

Source object hash.

structured_runtime.checkpoint.structured_config_hash

string

Structured configuration hash.

structured_runtime.checkpoint.source_schema_hash

string

Source schema hash.

structured_runtime.checkpoint.capability_profile_hash

string

Source capability configuration hash.

structured_runtime.checkpoint.order_policy_hash

string

Order policy hash.

structured_runtime.checkpoint.consistency_proof_hash

string

Consistency proof hash.

structured_runtime.checkpoint.lock_owner_run_id

string

The run ID of the checkpoint lock.

structured_runtime.checkpoint.lock_phase

string

Checkpoint lock phase.

structured_runtime.checkpoint.lock_expires_at

integer

The Unix timestamp of the checkpoint lock expiration time.

structured_runtime.reconcile

object

Runtime reconciliation information.

structured_runtime.reconcile.id

string

Reconciliation record ID.

structured_runtime.reconcile.run_id

string

Reconciliation run ID.

structured_runtime.reconcile.phase

string

Reconciliation phase.

structured_runtime.reconcile.status

string

Reconciliation status.

structured_runtime.reconcile.error_code

string

Reconciliation error code.

structured_runtime.reconcile.error_message

string

Reconciliation error message.

structured_runtime.reconcile.created_table_id

string

The ID of the newly created table in the reconciliation.

structured_runtime.reconcile.updated_at

integer

The Unix timestamp of the reconciliation record update time.

structured_runtime.reconcile.resolved_at

integer

The Unix timestamp of the time the reconciliation record was resolved.

structured_runtime.last_run

object

The most recent run; may be omitted if there is no run record.

structured_runtime.last_run.id

string

The last run ID.

structured_runtime.last_run.status

integer

The status code of the last run.

structured_runtime.last_run.run_status

string

The status of the last run.

structured_runtime.last_run.error_message

string

The error message of the last run.

structured_runtime.last_run.row_count

integer

The number of rows processed by the last run.

structured_runtime.last_run.file_count

integer

The number of files processed by the last run.

structured_runtime.last_run.source_schema_hash

string

The source schema hash of the last run.

structured_runtime.last_run.source_object_hash

string

The source object hash of the last run.

structured_runtime.last_run.structured_config_hash

string

The structured configuration hash of the last run.

structured_runtime.last_run.trigger_id

string

Trigger ID.

structured_runtime.last_run.trigger_source

string

Trigger source.

structured_runtime.last_run.workflow_execution_id

string

Workflow execution ID.

structured_runtime.last_run.mowl_task_id

string

Workflow task ID.

structured_runtime.last_run.moi_case_id

string

The associated case ID.

structured_runtime.last_run.current_phase

string

The current execution phase.

structured_runtime.last_run.scheduled_fire_at

integer

The Unix timestamp of the scheduled fire time.

structured_runtime.last_run.started_at

integer

The Unix timestamp of the start time.

structured_runtime.last_run.ended_at

integer

The Unix timestamp of the end time.

structured_runtime.last_run.created_at

integer

Unix timestamp of creation time.

structured_runtime.last_run.updated_at

integer

The Unix timestamp of the last update time.

mapping

JSON

Structured loading of mapping configuration.

schedule

JSON

Structured loading schedule configuration.

backfill

JSON

Structured loading backfill configuration.

runtime_init_status

string

Structured loading initialization status.

priority

string

Structured loading priority.

config_hash

string

Configuration hash.

structured_config_hash

string

Structured configuration hash.

Last updated on