Skip to content

Batch import overview

MatrixOne supports inserting a large number of rows into MatrixOne data tables using the LOAD DATA command. For instances of MatrixOne Intelligence, you can use the LOAD DATA LOCAL command, and also supports importing table structure and data into the entire database using the SOURCE command.

LOAD DATA LOCAL

MatrixOne Intelligence supports batch import of csv files and jsonline files from local file systems or S3 object storage service using the LOAD DATA LOCAL command.

Import different data formats

Depending on the data file type, MatrixOne Intelligence supports importing csv and jl* formats using the LOAD DATA LOCAL command.

  • Supports importing data in csv format. For specific import methods, please refer to [Insert csv file] (load-csv.md).
  • Supports importing data in jl format, that is, jsonlines format. For the specific import method, please refer to [Insert jsonlines file] (load-jsonline.md).

Import from different storage locations

Depending on the data storage location, MatrixOne Intelligence supports importing from local and importing* from object storage services (Simple Storage Service, S3) using the LOAD DATA LOCAL command.

SOURCE

MatrixOne supports using the SOURCE command to execute SQL statements from an external SQL script file to import the entire database structure (including table structure and data). The SOURCE command may not be as good as the LOAD DATA command when processing large amounts of data, because it requires parsing and executing each SQL statement.

More import capabilities

  • MatrixOne supports parallel loading of data files: When the data files are large, in order to improve loading speed, MatrixOne also supports parallel loading. See the parameter description of LOAD DATA import data.