Load multiple files and compressed files

Create two CSV files on the MatrixOne server, with two rows each:

mkdir -p /tmp/mo-cookbook-load
printf '1,one\n2,two\n' > /tmp/mo-cookbook-load/part-01.csv
printf '3,three\n4,four\n' > /tmp/mo-cookbook-load/part-02.csv
zstd -q -f /tmp/mo-cookbook-load/part-01.csv -o /tmp/mo-cookbook-load/part-01.csv.zst
zip -j /tmp/mo-cookbook-load/part-02.zip /tmp/mo-cookbook-load/part-02.csv

Install the zstd and zip commands first. The wildcard is expanded by the server on the Stage; LOAD DATA LOCAL does not expand wildcards.

CREATE DATABASE cookbook_load;
CREATE STAGE cookbook_load_stage URL='file:///tmp/mo-cookbook-load/';
CREATE TABLE cookbook_load.events(id INT, label VARCHAR(50));
LOAD DATA INFILE {'filepath'='stage://cookbook_load_stage/part-*.csv','format'='csv'}
INTO TABLE cookbook_load.events;
SELECT COUNT(*) AS loaded_rows FROM cookbook_load.events;
LOAD DATA INFILE {'filepath'='stage://cookbook_load_stage/part-01.csv.zst','format'='csv'}
INTO TABLE cookbook_load.events;
LOAD DATA INFILE {'filepath'='stage://cookbook_load_stage/part-02.zip','format'='csv'}
INTO TABLE cookbook_load.events;
SELECT COUNT(*) AS rows_after_compressed_load FROM cookbook_load.events;
DROP DATABASE cookbook_load;
DROP STAGE cookbook_load_stage;

Expect loaded_rows=4, then rows_after_compressed_load=8 after loading the two compressed files. .zst, .zstd, and .zip can be recognized by extension. For zip, only the first non-hidden, non-directory entry is read. See the source regression test for compressed inputs and error cases. Remove the test files from the Stage.