CN102354277A - Data storage method and device - Google Patents

Abstract

The invention provides a data storage method and device. The data storage method comprises that: a storage controller of the data storage device acquires a data storage command; the storage controller controls an infrastructure layer of the data storage device to store infrastructure data; the storage controller controls an intermediate layer of the data storage device to extract intermediate data corresponding to at least one application from the infrastructure data of the infrastructure layer and store the intermediate data into an intermediate summary information table; and the storage controller controls an application layer of the data storage device to extract the universal summary data of the application from the intermediate data of the intermediate layer, store the universal summary data into a universal summary information table, extract the data mart data of the application from the intermediate data and universal summary information table of the intermediate layer and store the data mart data into at least one application data mart. By the data storage method and device provided by the invention, data access efficiency can be improved.

Description

Data storage method and device

technical field

Embodiments of the present invention relate to data storage technologies, and in particular, to a data storage method and device.

Background technique

At present, the data storage technology of the data warehouse using the Financial Service Logic Data Model (FS-LDM) is widely used in the banking industry. The data storage technology of the data warehouse using FS-LDM is independent of any physical database platform, so it has wide applicability.

The data warehouse of the FS-LDM adopts a two-tier architecture, and correspondingly, the data storage device based on the FS-LDM data warehouse also adopts a two-tier architecture, that is, the data storage device includes a base layer and a summary layer. Among them, the base layer strictly follows the standard third normal form. Specifically, in the base layer using the third normal form: a record in the source business system table needs to be split into several target tables for storage, and the business data is scattered and split; the parent table includes the common information of all sub-type businesses, The amount of data in the parent table covering many subclasses is extremely large, and the complete access of subclass business data needs to be associated with the huge parent table with the subtable; all kinds of relationships between any two entities are recorded in the associated entity In , the relationship type is used to distinguish different relationship types, and the relationship table is very large. In the existing data storage device of the data warehouse based on FS-LDM, the summarization layer is above the base layer. The summary layer stores the derived data for each application. For the common parts of different applications, the summary layer repeatedly summarizes the basic layer data.

In a word, according to the above-mentioned characteristics of the existing data storage device, the data storage device adopts the data storage device, and the response speed of the data access operation is slow and the efficiency is low.

Contents of the invention

An embodiment of the present invention provides a data storage method, which is used to solve defects in the prior art and improve data access efficiency.

The embodiment of the present invention also provides a data storage device, which is used to solve the defects in the prior art and improve data access efficiency.

An embodiment of the present invention provides a data storage method, including:

The storage controller of the data storage device obtains the data storage command;

The storage controller controls the base layer of the data storage device to store basic data;

The storage controller controls the middle layer of the data storage device to extract at least one intermediate data corresponding to the application from the basic data of the basic layer and store it in an intermediate summary information table;

The storage controller controls the application layer of the data storage device to extract the general summary data of the application from the intermediate data of the middle layer and store it in the general summary information table, from the intermediate data of the middle layer and the general summary information table The data mart data of the application is extracted from and stored in at least one application data mart.

The method as described above, wherein the storage controller controlling the basic layer of the data storage device to store basic data includes:

The storage controller controls the protocol information table to store at least one protocol number and protocol type code; the storage controller controls at least one type information table as a sub-table of the protocol information table to store the corresponding type of protocol number and protocol type code; The storage controller controls at least one data table as a sub-table of the type information table to store data corresponding to the protocol;

And/or, the storage controller controls the attribute history table to classify and store the attribute information of at least one protocol according to the protocol type.

In the above method, wherein the storage controller controls the middle layer of the data storage device to extract at least one intermediate data corresponding to the application from the basic data of the basic layer and store the intermediate data in the intermediate summary information table comprising:

The storage controller controls the middle layer to extract the data corresponding to the account-level summary information from the basic data of the base layer and store it in the account-level summary information table;

And/or, the storage controller controls the middle layer to extract the data corresponding to the voucher-level summary information from the basic data of the base layer and store it in the voucher summary information table;

And/or, the storage controller controls the middle layer to extract the data corresponding to the IOU level summary information from the basic data of the base layer and store it in the IOU summary information table;

And/or, the storage controller controls the middle layer to extract the data corresponding to the customer deposit level summary information from the basic data of the base layer and store it in the customer deposit summary information table;

And/or, the storage controller controls the middle layer to extract data corresponding to customer loan level summary information from the basic data of the base layer and store it in the customer loan summary information table.

The method as described above, wherein the storage controller controlling the intermediate layer of the data storage device to store the intermediate data in the intermediate summary information table includes:

Using the primary key of the data table of the base layer with the prefix added as the primary key of the intermediate summary information table, or using the primary key of the data table of the base layer and preset supplementary fields to form the primary key of the intermediate summary information table;

And/or, according to the type of the common field in the data table of at least one base layer, determine the type of the common field in the intermediate summary information table, when the types of the common field in the data table of at least one base layer are different, The type of the common field of the intermediate summary information table is a variable type;

And/or, using the combination of the currency field and the value type code field of the data table of the basic layer as the primary key of the intermediate summary information table, converting the data of different currencies in the data table of the basic layer into the specified currency and storing to said intermediate summary information table;

And/or, calculate derived attribute data according to the basic data and store it in the intermediate summary information table;

And/or, storing the intermediate data within a preset time period in the intermediate summary information table.

The method as described above, wherein after the storage controller controls the application layer of the data storage device to extract the general summary data of the application from the intermediate data of the intermediate layer, it further includes: the storage controller controls the data storage device The application layer extracts the general summary data of the application from the basic data of the basic layer;

After the storage controller controls the application layer of the data storage device to extract the application data mart data from the intermediate data of the middle layer and the general summary information table, the method further includes: the storage controller controls the data storage device The application layer extracts the data mart data of the application from the basic data of the base layer.

The embodiment of the present invention also provides a data storage device, including: a storage controller, a base layer, an intermediate layer, and an application layer;

The storage controller acquires data storage commands, controls the base layer to store basic data, controls the middle layer to extract at least one intermediate data corresponding to an application from the basic data of the base layer and stores it in an intermediate summary information table, and controls the application layer to store the intermediate data from the intermediate data. The general summary data of the application is extracted from the intermediate data of the middle layer and stored in the general summary information table, and the data mart data of the application is extracted from the intermediate data of the intermediate layer and the general summary information table and stored in at least one application data set city.

In the above-mentioned data storage device, wherein, the base layer is specifically used to store at least one protocol number and protocol type code in the protocol information table according to the control of the storage controller, and store at least one protocol number and protocol type code in the protocol information table as a sub-table of the protocol information table. At least one type information table stores the protocol number and the protocol type code of the corresponding type, and stores the data of the corresponding protocol in at least one data table as a sub-table of the type information table;

And/or, the base layer is specifically configured to, according to the control of the storage controller, classify and store at least one protocol attribute information in the attribute history table according to the protocol type.

The data storage device as described above, wherein,

The middle layer is specifically configured to extract the data corresponding to the account-level summary information from the basic data of the base layer according to the control of the storage controller and store it in the account-level summary information table;

And/or, the intermediate layer is specifically configured to, according to the control of the storage controller, extract the data corresponding to the voucher-level summary information from the basic data of the basic layer and store it in the voucher summary information table;

And/or, the intermediate layer is specifically configured to extract the data corresponding to the IOU level summary information from the basic data of the basic layer according to the control of the storage controller and store it in the IOU summary information table;

And/or, the middle layer is specifically configured to extract the data corresponding to the customer deposit level summary information from the basic data of the base layer according to the control of the storage controller and store it in the customer deposit summary information table;

And/or, the middle layer is specifically configured to, according to the control of the storage controller, extract data corresponding to customer loan level summary information from the basic data of the base layer and store it in the customer loan summary information table.

The data storage device as described above, wherein,

The intermediate layer is specifically configured to use the primary key of the data table of the base layer with the prefix added as the primary key of the intermediate summary information table according to the control of the storage controller, or use the primary key of the data table of the basic layer and the preset The supplementary fields of constitute the primary key of the intermediate summary information table;

And/or, the intermediate layer is specifically configured to determine the type of the common field in the intermediate summary information table according to the type of the common field in the data table of at least one base layer according to the control of the storage controller, when When the types of the common fields in the data tables of at least one base layer are different, the type of the common fields in the intermediate summary information table is a variable type;

And/or, the intermediate layer is specifically configured to use the combination of the currency field and the value type code field of the data table of the basic layer as the primary key of the intermediate summary information table according to the control of the storage controller, and convert the basic layer The data in different currencies in the data table is converted into the specified currency and stored in the intermediate summary information table;

And/or, the intermediate layer is specifically configured to calculate derived attribute data according to the basic data and store it in the intermediate summary information table according to the control of the storage controller;

And/or, the intermediate layer is specifically configured to store the intermediate data within a preset time period in the intermediate summary information table according to the control of the storage controller.

The data storage device as described above, wherein,

The storage controller is also used to control the application layer of the data storage device to extract the general summary data and data mart data of the application from the basic data of the basic layer;

The application layer of the data storage device is also used to extract the general summary data and data mart data of the application from the basic data of the basic layer according to the control of the storage controller.

It can be seen from the above technical solutions that in the embodiment of the present invention, an intermediate layer is added to the data storage device, and the storage controller controls the intermediate layer to extract basic data from the base layer and summarize them into intermediate data, and store the intermediate data in the intermediate layer. The storage controller controls the application layer to extract data from the data stored in the middle layer. Due to the preliminary summary of the data in the base layer in the middle layer, the application layer can obtain data from the storage tables in the middle layer without having to search for a large number of storage tables in the base layer one by one, and avoid the existing two-tier architecture technology In the scheme, the application layer repeatedly summarizes the data of the base layer, thereby improving the efficiency of data access operations.

Description of drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the following will briefly introduce the drawings that need to be used in the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description These are some embodiments of the present invention. Those skilled in the art can also obtain other drawings based on these drawings without creative work.

FIG. 1 is a flowchart of a data storage method according to Embodiment 1 of the present invention;

FIG. 2 is a schematic structural diagram of a data storage device according to Embodiment 2 of the present invention.

Detailed ways

In order to make the purpose, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments It is a part of embodiments of the present invention, but not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of the present invention.

FIG. 1 is a flowchart of a data storage method according to Embodiment 1 of the present invention. As shown in Figure 1, the method includes the following processes.

Step 101: A storage controller of a data storage device acquires a data storage command.

Step 102: the storage controller controls the base layer of the data storage device to store basic data.

Step 103: the storage controller controls the middle layer of the data storage device to extract at least one intermediate data corresponding to the application from the basic data of the basic layer and store it in the intermediate summary information table.

Step 104: the storage controller controls the application layer of the data storage device to extract the general summary data of the application from the intermediate data of the middle layer and store it in the general summary information table, and extract the application data from the intermediate data of the middle layer and the general summary information table Mart data and store in at least one application data mart.

In Embodiment 1 of the present invention, an intermediate layer storage process is added to the data storage process. After the basic data is stored in the base layer, the intermediate data corresponding to the application is extracted from the base layer and stored in the middle layer, and the data stored in the application layer is extracted from the data stored in the middle layer. Since the middle layer is added between the base layer and the application layer, the data of the base layer is initially summarized in the middle layer, thereby enhancing the hierarchical level of data granularity. The storage table of the application layer is associated with the storage table of the middle layer for the preliminary summary of data, reducing the association with various storage tables of the basic layer. When reading data, the application layer can obtain data from the storage table of the middle layer, without having to look up a large number of storage tables of the base layer one by one like the existing technology, and through the preliminary summary of the middle layer, the existing binary data is avoided. In the technical solution of layer architecture, the application layer repeatedly summarizes the data of the base layer, thereby improving the efficiency of data access operations.

On the basis of the above technical solution, specifically, in step 101, the user using the data storage device sends a data storage command to the storage controller of the data storage device through the client, and the data storage command includes basic data to be stored. After step 104, step 105 may also be included: the storage controller returns a data storage completion message. Specifically, the storage controller returns a data storage completion message to the client of the user.

On the basis of the above technical solution, further, in the above step 103, the storage controller can also control the application layer of the data storage device to extract the general summary data of the application from the basic data of the basic layer, and the storage controller can also The application layer controlling the data storage device extracts the data mart data of the application from the basic data of the base layer. Specifically, the application layer of the data storage device can be subdivided into two parts, namely: the general summary part and the data mart part. The specific process of step 103 includes: the first step, the storage controller controls the general application layer of the data storage device The summary part extracts general summary data of the application from the intermediate data of the middle layer and the basic data of the base layer and stores it in at least one application summary information table; in the second step, the storage controller controls the data mart part of the application layer of the data storage device The application data mart data is extracted from the application summary information table, the intermediate data of the middle layer and the basic data of the base layer and stored in at least one application data mart table. Among them, in the first step, the general summary part first extracts the required general summary data from the intermediate data in the middle layer. Extract from the data. In the second step, the data mart part preferentially extracts the required data mart data from the general summary information table and the intermediate data of the middle layer, if neither the general summary information table nor the intermediate data of the middle layer can satisfy the data mart data According to the needs, the data mart part is extracted from the basic data of the basic layer. This step increases the flexibility of data storage by jointly extracting the data of the application layer from the middle layer and the base layer.

The following describes in detail the storage processes of the base layer, the middle layer, and the application layer under the control of the storage controller through specific examples.

base layer

In the above step 101, under the control of the storage controller, when the base layer of the data storage device stores the basic data, the following processing method is adopted for the storage of the protocol subject: first, the storage controller controls the protocol information table to store at least one protocol number and protocol type code; then, the storage controller controls at least one type information table as a sub-table of the protocol information table to store the protocol number and the protocol type code of the corresponding type; finally, the storage controller controls as the sub-table of the type information table At least one data table stores data corresponding to the protocol.

The following describes the method for storing the base layer under the control of the storage controller proposed by the present invention through a specific embodiment. The basic layer covers the basic data of the business system. For example, the basic layer can include the data of the following systems: core system, personal loan system, corporate risk system, online banking system, fund system, tripartite depository system, bill system, international settlement system , foreign exchange trading system, credit card system, large payment system, small payment system, etc. In the data storage method proposed by the present invention, the data storage of the base layer is classified according to the business characteristics and business logic corresponding to the protocol according to business requirements and data query and usage frequency. An agreement is a contractual relationship signed between a financial institution and a customer for a specific product or service. The data content of an agreement can include: bank deposit accounts, loan accounts, internal accounts, loan notes, contracts, insurance policies of insurance companies wait. Taking the source business system as an example, Table 1 is the data table of various protocols in the source business system. Referring to Table 1, the source business system includes but is not limited to the protocols recorded in Table 1. Specifically, the data content of each protocol is shown in Table 1.

Table 1 is the data table of various protocols in the source business system

In the embodiment of the present invention, for the above-mentioned various protocols, the above-mentioned protocols are classified according to different service characteristics, and the data of each protocol is stored according to the classification. For example, among the various agreements recorded in Table 1: deposit account agreements, loan account agreements, and internal account agreements are all account agreements; personal loan IOU agreements and corporate loan IOU agreements are all data IOU agreements. The tables stored in the base layer include a protocol information table, a type information table and a data table, wherein the protocol information table is used as a super parent table, and at least one type information table is subordinate to the protocol information table, and the type information table is used as a child table of the protocol information table . The type information table serves as a parent table, the type information table has at least one data table under it, and the data table serves as a child table of the type information table. Wherein, the protocol information table stores at least one protocol number and protocol type code. The type information table stores the protocol number and protocol type code of the corresponding type. According to various agreements recorded in Table 1, the type information table can be divided into account information table and IOU information table. The account information table stores the agreement number and agreement type code of the account agreement, and the IOU information table stores the IOU information table. Protocol number and protocol type code of the protocol. The data table stores the data corresponding to the protocol. According to the various agreements recorded in Table 1, the data tables under the account information table may include deposit account data tables, loan account data tables, internal account data tables, and so on. The data tables under the IOU contract information table can include personal loan IOU data tables, corporate loan IOU data tables, and so on. Wherein, each data table stores the relevant data of the corresponding protocol. Taking the deposit account data table as an example, the deposit account data table stores the agreement number, agreement type code, institution number, agreement status code, currency, agreement start date, agreement termination date, interest rate, account code, bank remittance Data such as logo, deposit balance, last financial transaction date and account manager. Furthermore, for agreements that are inconvenient to be classified, such as the cards and contracts recorded in Table 1, the corresponding card data table and contract data table can be directly used as sub-tables of the agreement information table.

A preferred implementation manner is that, in practical applications, the above-mentioned protocol information table as a super parent table and the type information table as a parent table are only logical tables, and are not actually physicalized.

In the above technical solution, when storing the basic data of the basic layer, the protocols are classified according to the business characteristics, and the data corresponding to different protocols are classified and stored, so that it is convenient to quickly and accurately obtain the required data according to the classification when reading the data, and improve improved data access efficiency.

In the above step 101, under the control of the storage controller, when the base layer of the data storage device stores the basic data, the following processing method is adopted for the storage of the attribute history table: the storage controller controls the attribute history table according to the protocol type, and classifies and stores Attribute information of at least one protocol. By classifying and storing the attributes of different protocol types, the data access operation for a certain type of protocol only involves the corresponding attribute history table of the protocol. Compared with the existing basic layer that does not distinguish the protocol type and directly stores each protocol attribute in the attribute history table set of the protocol master table, the above-mentioned method for classifying and storing protocol attributes in the embodiment of the present invention can significantly improve the data access process of the user. Efficiency of access location.

middle layer

In the data storage method of the embodiment of the present invention, an intermediate layer is added between the base layer and the application layer.

In practical applications, using the data stored in the basic layer, the actual business needs to implement a variety of applications, for example, may include but not limited to the following applications: customer single view, customer relationship management, profit contribution analysis, customer points management, retail account manager Assessment, financial general ledger report, etc. The data involved in these applications all come from the basic data stored in the basic layer, and the basic data needs to be processed according to the specific requirements of the application. For example, the customer single-view application needs to extract basic customer information, various deposit accounts, card and IOU balances of each loan, monthly average daily balance, quarterly daily average balance, and annual daily average balance from the basic data. Data on deposit and loan balances and various daily average balances. The customer relationship management application needs to extract the basic information of the customer, the holding status of various products of the customer, the summary of customer transaction preferences and other data from the basic data. The customer points management application needs to extract various account and loan balances, summary of transaction classification, basic customer information and other data from the basic data. The assessment application of retail account managers needs to extract the assets, liabilities, intermediary business information and other data of each customer developed or promoted by the account manager from the basic data. The financial general ledger report application needs to extract the account balance data under each subject from the basic data and summarize them so that the general ledger and the sub-accounts are consistent.

According to the analysis of the data required by the above applications and other applications, in the embodiment of the present invention, before extracting data at the application layer, the basic data is initially extracted and summarized at the middle layer. On this basis, the application layer directly applies the data extracted by the above-mentioned middle layer or summarizes the data extracted by the middle layer to more coarse-grained data such as customer level, subject level and institution level.

Specifically, in the above step 102, the intermediate summary information table may include one or any combination of the following tables: account-level summary information table, voucher summary information table, IOU summary information table, customer deposit summary information table and Customer Loan Summary Information Sheet. Correspondingly, under the control of the storage controller, when the middle layer of the data storage device extracts the intermediate data corresponding to at least one application from the basic data of the base layer and stores it in the intermediate summary information table, one of the following processing methods or Any combination of several types: first, the storage controller controls the middle layer to extract the data corresponding to the account-level summary information from the basic data of the base layer and store it in the account-level summary information table; second, the storage controller controls the middle layer to extract the data corresponding to the account-level summary information from the basic data The data corresponding to the voucher-level summary information is extracted from the basic data of the basic layer and stored in the voucher summary information table; third, the storage controller controls the middle layer to extract the data corresponding to the IOU-level summary information from the basic data of the basic layer and store it in the IOU summary information table; fourth, the storage controller controls the middle layer to extract the data corresponding to the customer deposit level summary information from the basic data of the base layer and store it in the customer deposit summary information table; fifth, the storage controller controls the middle layer The data corresponding to the customer loan-level summary information is extracted from the basic data and stored in the customer loan summary information table.

Taking the middle layer extracts the data corresponding to account-level summary information from the basic data of the base layer as an example, the middle layer extracts account-level attributes, balances, and average data of each frequency from the base layer. Taking the various protocols shown in the above Table 1 and the storage methods of the above-mentioned base layer as examples, according to the specific needs of various applications, under the control of the storage controller, the middle layer extracts the basic data that needs to be accounted for from the base layer, That is, the middle layer extracts the basic layer data with the subject code and business code from the basic layer. For example, among the data stored in the base layer using the above method, the middle layer extracts the data in the deposit account data table, loan account data table and internal account data table from the base layer.

After the intermediate layer extracts the data from the base layer, the above data is stored in the intermediate summary information table. Specifically, in the above step 102, under the control of the storage controller, when the intermediate layer of the data storage device stores the intermediate data in the intermediate summary information table, the following processing method is adopted:

First, use the primary key of the data table of the base layer with the prefix added as the primary key of the intermediate summary information table, or use the primary key of the data table of the base layer and preset supplementary fields to form the primary key of the intermediate summary information table.

According to the data to be extracted, if the primary keys in the data tables of the required multiple base layers are set in one table, each primary key is still unique, then the primary keys in the data tables of the base layer can be used as an intermediate summary The primary key of the info table. Otherwise, if the primary key in the data tables of the required multiple base layers is set in one table, the primary key is not unique, you can use any of the following two methods to set the intermediate summary information The primary key of the table. Method 1: Different prefixes are added before the primary keys of the data tables of each base layer to distinguish them, and the primary keys of the data tables of the base layer to which the prefixes are added are used as the primary keys of the intermediate summary information table. Method 2: The primary key of the intermediate summary information table adopts a combined primary key, and the primary key of the data table of the base layer is used as a part of the combined primary key, and another field for distinguishing the primary key of the data table of the base layer is added as the intermediate summary information table Supplementary field, the combination of the primary key and supplementary field of the data table of the basic layer is used as the combined primary key of the intermediate summary information table. The second method does not change the primary key record of the original table, which is not only conducive to fast and accurate search, but also improves the efficiency of the association between the tables in the middle layer and the base layer.

Second, according to the type of the common field in the data table of at least one base layer, determine the type of the common field in the intermediate summary information table. When the type of the common field in at least one data table of the base layer is different, the type of the common field in the intermediate summary information table is a variable type.

In the intermediate summary information table, when setting the type of the common field, it is necessary to consider the type of the field in the data table of each basic layer at the same time, and further consider the expansion needs of other data sources in the future. For example, the type of a common field in the first data table of the basic layer is a 4-bit character type, which is recorded as CHAR(4); the type in the second data table of the basic layer is a 5-bit character type, which is recorded as is CHAR(5); the type in the third data table of the basic layer is a 6-bit character type, which is recorded as CHAR(6), then the type of the common field in the intermediate summary information table can be set as a 6-bit variable Character type, denoted as VARCHAR(6). Further, the length of this field can be extended by considering the needs of data sources required by other businesses in the future, and the type of the common field in the intermediate summary information table is set to 8 Bit variable character type, denoted as VARCHAR(8). Setting the types of the common fields in the intermediate summary information table in the above manner can ensure accurate storage of the data extracted from the data table of the base layer, and can also save storage space. Further, by extending the field length, the scalability of the intermediate summary information table in the intermediate layer is improved.

Third, the combination of the currency field and the value type code field of the data table of the basic layer is used as the primary key of the intermediate summary information table, and the data of different currencies in the data table of the basic layer are converted into the specified currency and stored in the middle Summary information table.

In the basic data stored in the base layer, different accounts may use different currencies. Because different currencies cannot be directly calculated at the application layer, the situation of different currencies is summarized at the middle layer, so that the application layer can obtain customer-level, account-level, Institutional level and other fine-grained summary results. In the intermediate summary information table of the middle layer, the combination of the currency field and the value type code field in the data table of the base layer is used as a part of the primary key of the intermediate summary information table. In the middle layer, the data in different currencies in the data table of the basic layer is converted into the specified currency and stored in the intermediate summary information table. For example, the data of the balance attribute stored in the base layer data table is converted to the data corresponding to RMB and/or US dollars, and the data of the original currency, converted RMB and converted US dollars are stored respectively in the intermediate summary information table. The currency and corresponding data are converted in the middle layer, so as to provide convenience for the application layer to extract summary data, save the time for the application layer to extract data, and improve the efficiency of data access.

Fourth, calculate the derived attribute data based on the basic data and store it in the intermediate summary information table.

According to the specific needs of various applications in the application layer, the derived attributes required by each application layer calculated based on the data of the basic layer are calculated in the middle layer. For example, the balance data of the day is extracted from the balance history table stored in the base layer, and according to the specific business rules of the application, the monthly average data of the balance, the quarterly average data of the balance, the annual average data of the balance, and the balance of the past three months For data corresponding to derived attributes such as daily average data, daily average balance data in the past year, etc., store the above derived attributes and corresponding data in the intermediate summary information table. When the application layer needs to extract the above-mentioned derived data, it is not necessary to extract and calculate the basic data of the base layer. It is only necessary to extract the data corresponding to the required derived attributes from the middle layer, thereby improving the speed of reading data at the application layer. Improved data access efficiency.

Fifth, the intermediate data within a preset time period is stored in the intermediate summary information table.

In the middle layer, the data of the base layer needs to be summarized, and the data summarized in the middle layer is required to support the specific needs of various applications in the application layer. Therefore, the intermediate summary information table of the middle layer needs to store the intermediate data. If the preset time period is too long, storage space will be wasted, and if the preset time period is too short, specific requirements of all applications at the application layer cannot be met. A preferred implementation manner is that the time period is preset as 13 months, that is, the data at the end of the last 13 months is kept in the intermediate summary information table of the middle layer. Moreover, on this basis, the preset time period can also be adjusted according to the specific conditions of the application.

Specifically, the above-mentioned method of extracting, summarizing, and storing intermediate data is adopted in the middle layer, and various intermediate summary information tables can be stored in the middle layer, specifically including but not limited to the following tables: account-level summary information table, card summary information table , Other certificate summary information table, IOU summary information table, customer deposit summary information table and customer loan summary information table.

In the above technical solution, by setting an intermediate layer between the base layer and the application layer, an inheritance function is played between the base layer and the application layer. For the base layer, the middle layer stores the processed and summarized data of the base layer, which is closer to the needs of the application; while for the application layer, the middle layer extracts and calculates various applications that support the application layer from the base layer. summary data. Before the application layer extracts data, the basic data is initially extracted and summarized in the middle layer. When the application layer needs to extract data, it is preferred to extract the intermediate data from the middle layer. When the middle layer does not save the data required by the application layer, the application layer extracts the basic data from the base layer. Therefore, by increasing the storage in the middle layer, the aggregation level and granularity of the application layer data are enriched, making the granularity of data aggregation more refined. Moreover, by setting the middle layer, it avoids storing common data satisfying various applications in multiple tables in the application layer, reduces redundancy, effectively reduces repeated summarization of common applications, and improves the access response speed of data access operations.

application layer

Under the control of the storage controller, the application layer extracts and summarizes the data stored in the base layer and the middle layer according to the specific needs of various applications, and stores the summarized data in a general summary data table and at least one specific application-oriented in the application data mart table.

Among them, the application data mart table is directly related to the specific application. For example, according to the business line and business type, it can be divided into the following application data mart tables, but not limited to the following tables, including: customer single view mart, customer relationship management mart, business index express mart, anti-money laundering Bazaar, Retail Extraordinary Points Bazaar, Retail Assessment Bazaar, Electronic Banking Data Mart, Multidimensional Data Mart, Corporate and Business Department Bazaar, etc. Specifically, the data granularity and time period of different bazaars are set according to the specific needs of the bazaars. For example, for the comprehensive risk management data mart, to meet the requirements of the new Basel Accord, it is necessary to retain the detailed data of the last five years; for the retail assessment data mart of each branch, it is necessary to retain the assessment of the account manager and each team at the end of the last two years Summary results; for data marts without special requirements, the summary data at the end of the last year is retained.

Taking the customer summary information table in the customer single-view bazaar as an example, under the control of the storage controller, the application layer extracts data from the middle layer or from the middle layer and the base layer and summarizes the specific process as follows.

The application layer extracts the data of the same statistical date from the account summary information table, IOU summary information table, customer deposit summary information table and customer loan summary information table of the middle layer, and uses the core customer number primary key, currency and value type code primary key associated. The customer summary information table stores data such as customer account opening institution number, party classification code, number of products held, monthly average deposit balance, quarterly daily average deposit balance, annual average deposit balance, deposit balance, and total loan amount. Among them, extract the data of customer account opening institution number in the customer summary information table from the customer account opening institution number field in the customer deposit summary information table in the middle layer; extract the customer summary from the party classification code field in the customer deposit summary information table in the middle layer The data of the classification code of the party in the information table; by summarizing the different product number fields in the account summary information table and the IOU summary information table of the middle layer according to the core customer number attribute, the data of the number of products held in the customer summary information table is obtained ;According to the attributes of the core customer number, the monthly average balance, quarterly average balance, annual average balance, and balance fields in the customer deposit summary information table in the middle layer are respectively summarized to obtain the monthly average daily deposit balance, deposit Data such as quarterly daily average balance, annual average deposit balance, and deposit balance; obtain the total loan data in the customer summary information table by summarizing the remaining principal field in the customer loan summary information table in the middle layer according to the core customer number attribute . The data in the customer summary information table of the application layer is all extracted from the data stored in the middle layer; further, in other summary information tables stored in the application layer, the data stored in some summary information tables need to be extracted from the data stored in the middle layer at the same time And extract from the data stored in the base layer. In the above technical solution, by setting an intermediate layer when storing data, the application layer preferably extracts data from the intermediate layer when extracting data, so that the operation of the application layer is simpler and faster.

The data storage method proposed by the present invention has been introduced above, and the data storage device adopting the above data storage method will be introduced below through Embodiment 2 of the present invention.

FIG. 2 is a schematic structural diagram of a data storage device according to Embodiment 2 of the present invention. As shown in FIG. 2 , the data storage device includes: a storage controller 20 , a base layer 21 , an intermediate layer 22 and an application layer 23 .

Among them, the storage controller 20 obtains the data storage command, controls the base layer 21 to store the basic data, controls the intermediate layer 22 to extract at least one application-corresponding intermediate data from the basic data of the base layer 21 and stores it in the intermediate summary information table, and controls the application layer 23 Extract the general summary data of the application from the intermediate data of the middle layer 22 and store it in the general summary information table, and extract the data mart data of the application from the intermediate data of the middle layer and the general summary information table and store it in at least An application data mart.

The base layer 21 is used to store basic data under the control of the storage controller 20 . The intermediate layer 22 is configured to extract at least one intermediate data corresponding to an application from the basic data of the basic layer 21 under the control of the storage controller 20 and store it in an intermediate summary information table. The application layer 23 is used to extract the general summary data of the application from the intermediate data of the middle layer 22 under the control of the storage controller 20 and store it in the general summary information table, and to extract the application general summary data from the middle layer 22 under the control of the storage controller 20. The application data mart data is extracted from the intermediate data and the above general summary information table and stored in at least one application data mart.

On the basis of the above scheme, specifically, the base layer 21 is used to store at least one protocol number and protocol type code in the protocol information table under the control of the storage controller 20, and store at least one protocol number and protocol type code in the protocol information table as at least one of the sub-tables of the protocol information table. The type information table stores the protocol number and the protocol type code of the corresponding type, and at least one data table which is a sub-table of the type information table stores the data of the corresponding protocol. On the basis of the above solution, specifically, the base layer 21 can also be used to classify and store attribute information of at least one protocol in the attribute history table under the control of the storage controller 20 according to the protocol type.

On the basis of the above solution, specifically, the middle layer 22 is specifically configured to extract data corresponding to the account-level summary information from the basic data of the base layer 21 under the control of the storage controller 20 and store it in the account-level summary information table. And/or, the middle layer 22 is specifically configured to extract the data corresponding to the voucher-level summary information from the basic data of the base layer 21 under the control of the storage controller 20 and store it in the voucher summary information table. And/or, the middle layer 22 is specifically configured to extract the data corresponding to the IOU level summary information from the basic data of the base layer 21 under the control of the storage controller 20 and store it in the IOU summary information table. And/or, the middle layer 22 is specifically configured to extract the data corresponding to the customer deposit level summary information from the basic data of the base layer 21 under the control of the storage controller 20 and store it in the customer deposit summary information table. And/or, the middle layer 22 is specifically configured to extract the data corresponding to the customer loan level summary information from the basic data of the base layer 21 under the control of the storage controller 20 and store it in the customer loan summary information table.

On the basis of the above scheme, specifically, the intermediate layer 22 is used to adopt the primary key of the data table of the base layer 21 with the prefix added as the primary key of the intermediate summary information table according to the control of the storage controller 20, or, adopt the primary key of the base layer 21 The primary key of the data table and the preset supplementary fields form the primary key of the intermediate summary information table. The intermediate layer 22 is also used to determine the type of the common field in the intermediate summary information table according to the control of the storage controller 20 and according to the type of the common field in the data table of at least one base layer 21. When the data of at least one base layer 21 When the types of the common fields in the tables are different, the type of the common fields in the intermediate summary information table is a variable type. The middle layer 22 is also used to use the combination of the currency field and the value type code field of the data table of the base layer 21 as the primary key of the intermediate summary information table according to the control of the storage controller 20, and convert different currencies in the data table of the base layer 21 The data in the specified currency is converted into the specified currency and stored in the intermediate summary information table. The middle layer 22 is also used to calculate the derived attribute data according to the basic data and store it in the middle summary information table according to the control of the storage controller 20 . The intermediate layer 22 is also used to store intermediate data within a preset time period in the intermediate summary information table according to the control of the storage controller 20 .

On the basis of the above solution, specifically, the storage controller 20 is further configured to control the application layer 23 of the data storage device to extract general summary data and data mart data of the application from the basic data of the basic layer 21 . The application layer 23 of the data storage device is also used to extract general summary data and data mart data of the application from the basic data of the base layer 21 according to the control of the storage controller 20 .

In the above data storage device, the storage controller 20 controls the data storage method of the base layer 21, the middle layer 22 and the application layer 23 to execute according to the data storage method described in Embodiment 1 of the present invention, which will not be repeated here.

On the basis of the above technical solutions, in practical applications, a storage controller 20 can be used to comprehensively control the base layer 21, the middle layer 22 and the application layer 23, and can also control the base layer 21, the middle layer 22 and the application layer 23 Three storage controllers are used for control respectively, that is, the base layer 21, the middle layer 22 and the application layer 23 are respectively controlled by using the base layer storage controller, the middle layer storage controller and the application layer storage controller. The control method is the same as the above-mentioned technical solution. When new data needs to be stored in the data storage device, the base layer storage controller controls the base layer 21 to perform a storage operation. After the base layer storage controller controls the base layer 21 to complete the storage operation, the base layer storage controller sends a notification message to the intermediate layer storage controller. After the middle layer storage controller controls the middle layer 22 to complete the storage operation, the middle layer storage controller sends a notification message to the application layer storage controller. After the application layer storage controller controls the application layer 23 to complete the storage operation, the application layer storage controller returns a data storage completion message to the user's client.

In the second embodiment of the present invention, an intermediate layer is added in the data storage device, thereby enhancing the hierarchical level of data granularity. The middle layer extracts the basic data from the base layer and summarizes them, acquires the intermediate data and stores them, and the application layer extracts data from the intermediate data stored in the middle layer, without having to look up a large number of storage tables of the base layer one by one like the existing technology, thus improving improved data access efficiency. Moreover, through the preliminary summarization of data by the middle layer, repeated summarization of the data of the base layer by the application layer in the technical solution of the existing two-tier architecture is avoided, and the efficiency of data access is improved.

The data storage method and data storage device proposed by the present invention adopt a three-layer structure, transforming from a traditional single rigid data storage device structure to a layered structure that can reflect the division of labor at different levels. Compared with the existing two-tier architecture, the data storage device of the three-tier architecture proposed by the present invention has a clear hierarchy and a clear structure, which not only improves the scalability of the data storage device, but also improves the efficiency of data access and the efficiency of data storage. The efficiency with which storage devices are managed and maintained. In the specific application of the banking industry, various information applications and business needs are increasing day by day. The advanced nature, applicability and high efficiency of the data storage device will play a role in maximizing the subsequent functions of the data storage device in decision support, marketing support and management support. to a decisive role. The three-layer architecture of the data storage device proposed by the present invention is innovated on the basis of inheriting the existing data storage device architecture in the industry. The middle layer is set up for the first time in the data storage device architecture, and the multi-layer data storage device architecture constructed can enhance the layering and diversification of data granularity, comprehensively and quickly meet the needs of various applications, and effectively solve the traditional data storage device architecture. Existing problems such as repeated summarization, redundant storage, low degree of sharing, inconsistent standards, and poor consistency have created conditions for the logical concentration of management information across the bank and greatly improved the efficiency of storage, processing, and use of business management data across the bank. Efficiency and reduced management costs. Moreover, the architecture of the data storage device proposed by the present invention can shorten the data modeling cycle and data loading time, and improve the overall operation and maintenance efficiency of the data storage device. The novel framework of the present invention designs bank data in layers, minimizes the interference and impact between data layers, makes the data storage device more scalable, and can flexibly adapt to the rapid and rapid development of banking business under the new situation. It is especially suitable for For the banking industry to set up enterprise-level data storage devices.

It should be noted that, for the foregoing method embodiments, for the sake of simple description, they are expressed as a series of action combinations, but those skilled in the art should know that the present invention is not limited by the described action sequence. Because of the present invention, certain steps may be performed in other orders or simultaneously. Secondly, those skilled in the art should also know that the embodiments described in the specification belong to preferred embodiments, and the actions and modules involved are not necessarily required by the present invention.

In the foregoing embodiments, the descriptions of each embodiment have their own emphases, and for parts not described in detail in a certain embodiment, reference may be made to relevant descriptions of other embodiments.

Those of ordinary skill in the art can understand that all or part of the steps for realizing the above-mentioned method embodiments can be completed by hardware related to program instructions, and the aforementioned program can be stored in a computer-readable storage medium. When the program is executed, the It includes the steps of the above method embodiments; and the aforementioned storage medium includes: ROM, RAM, magnetic disk or optical disk and other various media that can store program codes.

Finally, it should be noted that: the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit them; although the present invention has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that: it can still be Modifications are made to the technical solutions described in the foregoing embodiments, or equivalent replacements are made to some of the technical features; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the various embodiments of the present invention.

Claims (10)

1. A data storage method, characterized in that, comprising: The storage controller of the data storage device obtains the data storage command; The storage controller controls the base layer of the data storage device to store basic data; The storage controller controls the middle layer of the data storage device to extract at least one intermediate data corresponding to the application from the basic data of the basic layer and store it in an intermediate summary information table; The storage controller controls the application layer of the data storage device to extract the general summary data of the application from the intermediate data of the middle layer and store it in the general summary information table, from the intermediate data of the middle layer and the general summary information table The data mart data of the application is extracted from and stored in at least one application data mart. 2. The method according to claim 1, wherein the storage controller controlling the base layer of the data storage device to store basic data comprises: The storage controller controls the protocol information table to store at least one protocol number and protocol type code; the storage controller controls at least one type information table as a sub-table of the protocol information table to store the corresponding type of protocol number and protocol type code; The storage controller controls at least one data table as a sub-table of the type information table to store data corresponding to the protocol; And/or, the storage controller controls the attribute history table to classify and store the attribute information of at least one protocol according to the protocol type. 3. The method according to claim 1 or 2, wherein the storage controller controls the intermediate layer of the data storage device to extract at least one intermediate data corresponding to the application from the basic data of the basic layer and store it in the intermediate The summary information table includes: The storage controller controls the middle layer to extract the data corresponding to the account-level summary information from the basic data of the base layer and store it in the account-level summary information table; And/or, the storage controller controls the middle layer to extract the data corresponding to the voucher-level summary information from the basic data of the base layer and store it in the voucher summary information table; And/or, the storage controller controls the middle layer to extract the data corresponding to the IOU level summary information from the basic data of the base layer and store it in the IOU summary information table; And/or, the storage controller controls the middle layer to extract the data corresponding to the customer deposit level summary information from the basic data of the base layer and store it in the customer deposit summary information table; And/or, the storage controller controls the middle layer to extract data corresponding to customer loan level summary information from the basic data of the base layer and store it in the customer loan summary information table. 4. The method according to claim 1 or 2, wherein the storage controller controlling the intermediate layer of the data storage device to store the intermediate data in an intermediate summary information table comprises: Using the primary key of the data table of the base layer with the prefix added as the primary key of the intermediate summary information table, or using the primary key of the data table of the base layer and preset supplementary fields to form the primary key of the intermediate summary information table; And/or, according to the type of the common field in the data table of at least one base layer, determine the type of the common field in the intermediate summary information table, when the types of the common field in the data table of at least one base layer are different, The type of the common field of the intermediate summary information table is a variable type; And/or, using the combination of the currency field and the value type code field of the data table of the basic layer as the primary key of the intermediate summary information table, converting the data of different currencies in the data table of the basic layer into the specified currency and storing to said intermediate summary information table; And/or, calculate derived attribute data according to the basic data and store it in the intermediate summary information table; And/or, storing the intermediate data within a preset time period in the intermediate summary information table. 5. The method according to claim 1 or 2, characterized in that, After the storage controller controls the application layer of the data storage device to extract the general summary data of the application from the basic data of the base layer and the intermediate data of the intermediate layer, the method further includes: the storage controller controls the data storage device The application layer extracts the general summary data of the application from the basic data of the basic layer; After the storage controller controls the application layer of the data storage device to extract the application data mart data from the intermediate data of the middle layer and the general summary information table, the method further includes: the storage controller controls the data storage device The application layer extracts the data mart data of the application from the basic data of the base layer. 6. A data storage device, comprising: a storage controller, a base layer, an intermediate layer, and an application layer; The storage controller obtains a data storage command, controls the base layer to store basic data, controls the middle layer to extract at least one intermediate data corresponding to an application from the basic data of the base layer and stores it in an intermediate summary information table, and controls the application layer to store the intermediate data from the intermediate data. The general summary data of the application is extracted from the intermediate data of the middle layer and stored in the general summary information table, and the data mart data of the application is extracted from the intermediate data of the middle layer and the general summary information table and stored in at least one application data set city. 7. The data storage device according to claim 6, wherein: The base layer is specifically used to store at least one protocol number and protocol type code in the protocol information table according to the control of the storage controller, and store the corresponding type of protocol in at least one type information table that is a sub-table of the protocol information table. No. and protocol type code, store the data of the corresponding protocol in at least one data table as a sub-table of the type information table; And/or, the base layer is specifically configured to, according to the control of the storage controller, classify and store at least one protocol attribute information in the attribute history table according to the protocol type. 8. The data storage device according to claim 6 or 7, characterized in that, The middle layer is specifically configured to extract the data corresponding to the account-level summary information from the basic data of the base layer according to the control of the storage controller and store it in the account-level summary information table; And/or, the intermediate layer is specifically configured to, according to the control of the storage controller, extract the data corresponding to the voucher-level summary information from the basic data of the basic layer and store it in the voucher summary information table; And/or, the intermediate layer is specifically configured to extract the data corresponding to the IOU level summary information from the basic data of the basic layer according to the control of the storage controller and store it in the IOU summary information table; And/or, the middle layer is specifically configured to extract the data corresponding to the customer deposit level summary information from the basic data of the base layer according to the control of the storage controller and store it in the customer deposit summary information table; And/or, the middle layer is specifically configured to, according to the control of the storage controller, extract data corresponding to customer loan level summary information from the basic data of the base layer and store it in the customer loan summary information table. 9. The data storage device according to claim 6 or 7, characterized in that, The intermediate layer is specifically configured to use the primary key of the data table of the base layer with the prefix added as the primary key of the intermediate summary information table according to the control of the storage controller, or use the primary key of the data table of the basic layer and the preset The supplementary fields of constitute the primary key of the intermediate summary information table; And/or, the intermediate layer is specifically configured to determine the type of the common field in the intermediate summary information table according to the type of the common field in the data table of at least one base layer according to the control of the storage controller, when When the types of the common fields in the data tables of at least one base layer are different, the type of the common fields in the intermediate summary information table is a variable type; And/or, the intermediate layer is specifically configured to use the combination of the currency field and the value type code field of the data table of the basic layer as the primary key of the intermediate summary information table according to the control of the storage controller, and convert the basic layer The data in different currencies in the data table is converted into the specified currency and stored in the intermediate summary information table; And/or, the intermediate layer is specifically configured to calculate derived attribute data according to the basic data and store it in the intermediate summary information table according to the control of the storage controller; And/or, the intermediate layer is specifically configured to store the intermediate data within a preset time period in the intermediate summary information table according to the control of the storage controller. 10. The data storage device according to claim 6 or 7, characterized in that, The storage controller is also used to control the application layer of the data storage device to extract the general summary data and data mart data of the application from the basic data of the basic layer; The application layer of the data storage device is also used to extract the general summary data and data mart data of the application from the basic data of the basic layer according to the control of the storage controller.

Images