<< Click to Display Table of Contents >> MPP |
Yonghong Z-Data Mart is a data mart product integrating data storage and processing that is researched and developed by its own technology. Targeting at different scale of demand data that need to be proceed by the user, the different IT system structure and storage system, two solutions are provided for the customer to choose: one is local mode, and the other is MPP mode. When the scale of data that requires processing is under TB, or the ordinary storage structure is adopted, or the personal computer has met the performance demand, we suggest the user to choose the local mode. While facing the Heterogeneous Database storage system, the data scale that requires processing is on TB, PB and beyond, or the IT system and storage system adopt distributed mode, or only MPP mode can meet the performance demand, the parallel processing mode based on distributed structure will better fulfill the customer's demands.
It totally abandoned Scale-up, and is all for Scale-out.
•In-Database Computing
Z-Suite supports all common summaries, and almost all professional statistical functions. Benefiting from Cross Granular Computing technology, Z-Suite data analysis engine will search the most optimized computing scheme, then transfer the computing which is expensive and relative large cost to the place of data storage, which is what we called In-Database Computing. This technology significantly reduces the data movement, decreases the burden of communication and ensures the high performance of data analysis.
•MPP Computing
Z-Suite is the Business Intelligent Platform based on MPP architecture, who can distribute the computing into multiple computing nodes, and then appoint node to summarize and output the computing results generate calculated results at a specified node
. Z-Suite is able to fully utilize all computing and storage resources, not matter server or regular PC, who does not have strict requirements to the network conditions. As the Scale-Out big data platform, Z-Suite is able to give full play of computing ability of each node, so that to realize the second response to TB/TB data analysis.
•Column-based storage
Z-Suite is the column-based storage. Data Mart which is based on the column-based storage, do not read any irrelevant data, which can decrease the cost of read and write, at the same time, increase I/O effectiveness, so as to significantly improve the query performance. In addition, the column-based storage can better compress the data, and its general compression ratio is between 5-10 times. In this way, the space took up by data is decreased by 1/5 to 1/10 of traditional storage. The good data compression technology saves the cost of storage device and internal storage, but significantly improves the computing performance.
•Memory calculation
Benefiting from column-based storage technology and parallel computing technology, Z-Suite can largely compress data, and use the computing ability and memory capacity of multiple nodes. Generally, the memory access speed is faster for hundreds of times than disk access speed. Through the memory computing, CPU directly reads data from the memory rather than the disk, and computes the data. Memory computing is a speed-up for the traditional data processing mode, which is the key application technology to realize the big data analysis.