Import Data to Data Mart

<< Click to Display Table of Contents >>

Current:  Data Mart > VooltDB > Data Extraction 

Import Data to Data Mart

Previous pageReturn to chapter overviewNext page

Import Data to Data Mart : Periodically import a data set to a data mart on certain conditions.

"Import Data to Data Mart" will materialize current data set. When we call the data set once more, materialized data set can be called. When there is a large amount of data in the database, use the materialized data set can greatly improve the data set speed.

When the user performs Materialize Data Set, data mart should be configured in bihome\bi.properties file. Add the following statements in bi.properties.

 

The steps to create "Import Data to Data Mart" are as follows:

1. New "Import Data to Data Mart" task. In the task area of the new job or the new task interface, select the task type as "Import Data to Data Mart", as shown in the figure below.

同步数据类型

Select the data set that needs to be materialized. The user clicks "Add" to select one or more data sets that need to be synchronized in the existing data set. As shown below.

 

添加1

 

2.In version 8.5, we update the data precision so that there is no precision problem when calculated large amounts of data,  the number of precision bits supprot setting. Click the "Edit Format" button on the right side of the data set to display the double, float type data columns in the data set, and set the storage precision on the market folder. Different market folders can have different precisions, Double, float type data column default value is 4,as shown in the figure below.

编辑格式TB1

3.Setting parameters. The user clicks on the Collect button to collect all the parameters of the currently selected dashboard or dataset, including the name of the parameters (required), the parameter data type, and the parameter values. When the user needs to add a parameter, click the Add button to pop up the parameter dialog box. The user can set the name of the parameter, the data type of the parameter, and the parameter value.

参数1

When the user selects multiple items, multiple parameter values can be set, as shown in the following figure.

参数N

4.When a user adds a data set to the current page, the recommended number of columns for the data into the market is 100, it will be prompted that entering the market may be slow when saving beyond this value, as shown in the figure below.

推荐行数