The user's data can be imported into the data mart system (including local cloud and distributed cloud) through automatic operation.

Start the Client node in the system, enter the scheduling task interface on the Client node access page, add a job, and define the task of the job to import data incrementally. This task is specifically responsible for extracting the data in a Data Set (data set) into the market system. Option indicators:

[Data set]: Select a data set, and the data of the data set will be extracted.

[Folder]: Which folder to put the extracted data block under.

[Append]: Whether to append files, otherwise the historical files will be deleted. If there is already an aa file, you can add another bb file. If the file name to be appended already exists, the appending will stop.

Script: You can execute this script before running query. This script can modify the value of folder and append, and can also modify metadata through setMeta/getMeta; it can also assign values ​​to parameters.

When a job is successfully executed, you can access the data in the folder by creating a data mart dataset. The value of filtering metadata can also be used to access various data blocks across granularities.

The user can specify the plan, how often to extract the data, and when extracting, by adding metadata attributes to tag the data block. If you add a date tag, you can control access to only a certain period of time data.

For specific instructions on scheduling tasks, see related documents.