CN112765168A - Star data management and storage method and device, terminal equipment and storage medium - Google Patents
Star data management and storage method and device, terminal equipment and storage medium Download PDFInfo
- Publication number
- CN112765168A CN112765168A CN202110025481.1A CN202110025481A CN112765168A CN 112765168 A CN112765168 A CN 112765168A CN 202110025481 A CN202110025481 A CN 202110025481A CN 112765168 A CN112765168 A CN 112765168A
- Authority
- CN
- China
- Prior art keywords
- fact
- data
- governance
- star
- business
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/22—Indexing; Data structures therefor; Storage structures
- G06F16/2282—Tablespace storage structures; Management thereof
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/28—Databases characterised by their database models, e.g. relational or object models
- G06F16/283—Multi-dimensional databases or data warehouses, e.g. MOLAP or ROLAP
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/28—Databases characterised by their database models, e.g. relational or object models
- G06F16/284—Relational databases
- G06F16/285—Clustering or classification
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Abstract
The invention discloses a star-shaped data governance storage method, a star-shaped data governance storage device, a terminal device and a storage medium, wherein a dimension table and a fact table are preset, business contents and corresponding governance means are set in the dimension table, business facts and corresponding metric values are set in the fact table, the business facts are correspondingly confirmed with the business contents in the dimension table after being obtained, when the business facts reach the corresponding metric values in the fact table, the governance means corresponding to the corresponding business contents are called for data quality governance, and data in the governance means are stored. The expansion of the dimension table set by the invention does not influence the existing and historical results stored in the fact table, and high robustness is realized. The problems of poor expansibility, poor robustness and poor usability of the storage method in the prior art when a user manages and stores data are solved.
Description
Technical Field
The invention relates to the technical field of big data storage, in particular to a star data management and storage method, a star data management and storage device, terminal equipment and a storage medium.
Background
With the development of computer and network technologies, especially the rapid development of mobile network technologies, the big data era comes, and all organizations pay attention to the acquisition of various data, the total amount of data information in all organizations increases in geometric progression, and how to analyze, process and store the massive data information and improve the utilization efficiency of the information becomes a critical affair for all organizations, so that the data quality control is highly paid attention to all organizations. The existing data quality management system has various storage schemes, uneven storage efficiency, extremely disordered storage structures, poor flexibility and weak service expansion capability, a large amount of table structures need to be modified only by modification, the development period is long, the maintenance cost is high, and the problems of poor expansibility, poor robustness and poor usability of a storage method generally exist.
Thus, there is a need for improvements and enhancements in the art.
Disclosure of Invention
The technical problem to be solved by the present invention is to provide a method, an apparatus, and a storage medium for controlling star-shaped data quality, aiming at solving the problems of poor expansibility, poor robustness, and poor usability of the storage method when a user manages and stores data in the prior art.
In order to solve the technical problems, the technical scheme adopted by the invention is as follows:
in a first aspect, the present invention provides a star-shaped data governance storage method, which is used for performing data quality storage management on big data through a data governance system, and includes the following steps:
presetting a dimension table and a fact table;
setting business content and a corresponding treatment means in the dimension table;
setting a business fact and a corresponding metric value in the fact table;
after the business fact is obtained, correspondingly confirming the business fact and the business content in the dimension table;
and when the business fact reaches the corresponding measurement value in the fact table, calling a treatment means corresponding to the corresponding business content to treat the data quality, and storing the data in the treatment means.
As an improvement, the dimension tables include a business line table, an abatement dimension table, and an execution engine table. The fact table comprises an execution list table, a quality result detail table and a quality history detail table.
As an improved technical scheme, the setting of the business content and the corresponding treatment means in the dimension table comprises the following steps:
recording items needing data management in the service line table, and corresponding the items to primary classification and secondary classification of different service lines;
recording the dimensionality of data governance in the governance dimension table, and displaying according to the parent dimensionality and the child dimensionality;
and recording the adopted calculation execution engine and the basic information of the calculation execution engine in the execution engine table.
As an improved technical solution, the step of setting the service fact and the corresponding metric value in the fact table includes the following steps:
recording details of abatement indicators in the execution list table, the data abatement system executing according to the recorded details of the execution list table, comprising: the management project, management dimension and management execution engine in the service line;
recording the value calculated by the treatment index in the quality result detail table, and recording the value by date;
and recording the historical detailed information of the treatment indexes in the quality history list.
As an improved technical scheme, the main key in the dimension table is set as the external key in the fact table.
As an improved technical scheme, the method further comprises the following steps:
and the data management system also outputs detailed data of the data quality for storage after calling a management means corresponding to the corresponding service content to manage the data quality.
In a second aspect, an embodiment of the present invention further provides a star-shaped data governance storage device, where the star-shaped data governance storage device includes a management table presetting module, a dimension table setting module, a fact table setting module, a business fact confirmation module, and a data governance storage module;
the management table presetting module is used for presetting a dimension table and a fact table;
the dimension table setting module is used for setting the service content and the corresponding treatment means in the dimension table;
the fact table setting module is used for setting the business fact and the corresponding metric value in the fact table;
the service fact confirmation module is used for correspondingly confirming the service fact and the service content in the dimension table after the service fact is obtained;
and the data governance storage module is used for calling a governance means corresponding to the corresponding service content to carry out data quality governance when the service fact reaches the corresponding metric value in the fact table.
In a third aspect, the present invention further provides a star data governance storage terminal device, where the memory, the processor, and a star data governance storage program of the terminal device, which is stored in the memory and is capable of running on the processor, are implemented when the processor executes the star data governance storage program of the terminal device, so as to implement the steps of the star data governance storage method according to any one of the schemes.
In a fourth aspect, an embodiment of the present invention further provides a computer-readable storage medium, where a star-shaped data governance storage program is stored on the computer-readable storage medium, and when the processor executes the star-shaped data governance storage program, the steps of the star-shaped data governance storage method in any one of the foregoing schemes are implemented.
Has the advantages that: compared with the prior art, the star-type data governance storage method has the advantages that the star-type data table is adopted to support the rear-end storage of the data governance system, the dimension table is continuously expanded at a service line level, a governance dimension level and an execution engine level, dimension information is recorded and provided for the fact table to use, high expansibility and high usability are achieved, the expansion of the dimension table does not influence the existing and historical results in the fact table, and high robustness is achieved. Therefore, the invention solves the problems of poor expansibility, poor robustness and poor usability of the storage method in the prior art when the user manages and stores the data quality.
Drawings
Fig. 1 is a flowchart of a specific implementation of the star data governance storage method according to the embodiment of the present invention.
Fig. 2 is a data flow diagram of data storage in the star data governance storage method provided by the embodiment of the present invention.
Fig. 3 is a structural diagram of a star-shaped data governance storage device provided in the embodiment of the present invention.
Fig. 4 is a structure diagram of a dimension table in the star data governance storage device according to the embodiment of the present invention.
Fig. 5 is a structure diagram of a fact table in the star data governance storage device provided in the embodiment of the present invention.
Fig. 6 is a schematic diagram of an internal structure of a terminal device according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and effects of the present invention clearer and clearer, the present invention is further described in detail below with reference to the accompanying drawings and examples. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
Today, with the rapid development of computer technology and network technology, especially the development of smart phones and mobile internet, people's life is highly dependent on the network from the information acquisition to the entertainment and shopping. In order to better meet the needs of people, the collection and utilization of various data become important matters of various organizations and departments, and a big data era is created. With the advent of the big data age, the total amount of data for each organization and department grows in a geometric progression. How to screen, process and store the data becomes a big matter for each organization and department, so the data quality management is highly concerned by each organization and department. However, the existing data quality management system has various storage schemes, different levels, poor flexibility and poor service expansion capability, and a large amount of table structures need to be modified once modification is performed, so that the development period is long, the maintenance cost is high, and the existing storage method of each organization and department has poor expansibility, robustness and usability.
In order to solve the problems in the prior art, the embodiment provides a star data governance storage method, and the problems of poor expansibility, poor robustness and poor usability of the existing storage method can be solved through the method of the embodiment. In specific implementation, the embodiment adopts two tables, namely a dimension table and a fact table, wherein the dimension table comprises a service line table, an administration dimension table and an execution engine table, the fact table comprises an execution list table, a quality result detail table and a quality history detail table, data administration is stored in execution, service data, administration dimensions and an execution engine are firstly defined, then the service data needing to be administered is configured in the execution list, finally a program is scheduled, data quality detail data is output, a main key in the dimension table is a foreign key in the fact table, and dimension table expansion does not influence the existing and history results in the fact table. Therefore, the invention continuously expands the three dimension tables (the service line table, the governing dimension table and the execution engine table) at the service line level, the governing dimension level and the execution engine level, records dimension information and provides the dimension information for the fact table to use, thereby achieving high expansibility and high usability, and achieving high robustness of storage through the three fact tables (the execution list table, the quality result detail table and the quality history detail table).
Exemplary method
The star data governance storage method of the embodiment can be applied to terminal equipment, and specifically as shown in fig. 1, the star data governance storage method includes the following steps:
step S100, a preset dimension table and a fact table.
The dimension table contains textual description content for the service. In the setting of the dimension table, in order to make the dimension table have high extensibility on the data storage, specifically, the setting of the dimension table includes a business line table, an administration dimension table and an execution engine table, which are used for recording dimension information and providing the dimension information for the fact table to use, and how the dimension information of the dimension table is used by the fact table is described in the following. The dimension table can be continuously expanded at a service line level, a governing dimension level and an execution engine level, so that the storage problem of big data cannot be limited in the storage process. The fact table includes an execution list table, a quality result list table and a quality history list table.
And step S200, setting the service content and the corresponding treatment means in the dimension table.
Specifically, the setting of the business content and the corresponding administration means in the dimension table includes the following steps:
recording items needing data management in the service line table, and corresponding the items to primary classification and secondary classification of different service lines;
recording the dimensionality of data governance in the governance dimension table, and displaying according to the parent dimensionality and the child dimensionality;
and recording the adopted calculation execution engine and the basic information of the calculation execution engine in the execution engine table.
The business line table is shown in the following table 1, specifically records items of each organization and department needing data governance, the items need to correspond to primary classification and secondary classification of different business lines so as to be used when governing calculation indexes, and simultaneously, English table names and Chinese table names are unique.
Table 1 service line table
The service line table comprises fields of self-increment ID value, service line, primary classification, secondary classification, table Chinese, table English, description, creator, newly-increased time, modification time and the like, wherein the self-increment ID value is a sequence value field for recording the content automatically increased by personnel on the service line.
The treatment dimension table is shown in the following table 2, and the treatment dimension table specifically records the dimensions of each organization and department for data treatment, but most of the dimensions are displayed according to parent dimensions and child dimensions so as to facilitate expansion later.
TABLE 2 administers dimension table
As can be seen from the administration dimension table, the administration dimension table comprises three fields of a self-increment ID value, a father dimension and a son dimension, and similarly, the self-increment ID value is a sequence value field for recording the self-increment content of personnel on a service line. For example, when the parent dimension is a dimension feature of "consistency", the dimension feature of the child dimension of "format valid" is a subordinate feature of "consistency".
The execution engine table is shown in table 3 below, and the execution engine table specifically records calculation execution engines to be adopted by each organization and department, and includes: clickhouse, hive, mysql, etc., as well as basic information of the compute engine.
Table 3 execution engine table
As seen from the execution engine table, the execution engine table includes fields such as the value of the auto-ID, the engine name, the database connection url, the driver, the user name, the password, the library name, the file path, and the execution type. Similarly, the self-increment ID value is a sequence value field for recording self-increment content of personnel on the service line.
And step S300, setting the business fact and the corresponding metric value in the fact table.
Specifically, a fact table is established, one row of the fact table corresponds to a measurement value, which is equivalent to that after a certain business fact actually occurs, the data quality of the business fact corresponds to a quantifiable numerical value, and whether the business fact needs to be subjected to data governance is determined through the measurement value. The fact table includes an execution list table, a quality result list table, and a quality history list table. When the dimension table is continuously expanded at a service line level, a governing dimension level and an execution engine level, the existing and historical results of the fact table are not influenced, and because the main key in the dimension table is the external key in the fact table, the expansion of the fact table is not influenced.
The execution list table is shown in the following table 4, the execution list table records the detailed details of the treatment indexes of each organization and department, and the data treatment system executes the treatment according to the records of the execution list table. The method comprises the following steps: what the governance in the business line has, what dimensions are needed, what execution engines are needed, or what SQL statements or scripts are needed for computation.
Table 4 executive list table
As can be seen from the execution list table, the execution list table includes fields such as self-increment ID, service line ID, detection dimension, execution statement, field name, governance dimension ID, task description, execution engine ID, task execution state, creator, addition time, modification time, and the like. And after the execution list records that the business fact reaches a certain measurement value, the execution list records the execution process of the data management task.
The quality results list shown in Table 5 below records the calculated scores and corresponding date records for each agency and department management index. Wherein the execution ID corresponds to a self-increment ID in the execution list table.
TABLE 5 detailed table of quality results
As seen from the quality structure detail table, the quality structure detail table records the content of the credit value of the executed task of the data governance after the business fact occurs.
The treatment history list, as shown in table 6 below, specifically records all detailed information of treatment indicators of each organization and department, and is convenient for display and traceable upstream configuration. Wherein the execution ID corresponds to a self-increment ID in the execution list table.
TABLE 6 management History statement
The treatment history list is a history data record list of the whole process after recording the business fact and performing data treatment, and history tracing can be performed on the whole treatment process by recording the treatment history.
And S400, after the business fact is obtained, correspondingly confirming the business fact with the business content in the dimension table.
After the established dimension table and the fact table are used, when the enterprise big data are in the operation process and various business facts in the corresponding fact table occur, the data management system configures the business data needing to be managed according to the business facts, and the business facts are corresponding to the business contents in the dimension table so as to be convenient for follow-up confirmation.
And S500, when the business fact reaches the corresponding measurement value in the fact table, calling a treatment means corresponding to the corresponding business content to treat the data quality, and storing the data in the treatment means.
In step S400, after the generated business fact is confirmed to correspond to the business content in the dimension table, the data management system calls a corresponding management means in the fact table, that is, performs data quality management through the execution engine corresponding to the execution list, when the business fact in the fact table reaches the corresponding measurement value, and the preset measurement value is reached.
In addition, as an improved implementation manner, the data governance system also outputs data quality detail data for storage after invoking governance means corresponding to the corresponding service content to carry out data quality governance.
In summary, in the star data governance storage method provided in this embodiment, two tables, namely, a dimension table and a fact table, are pre-established, and a service line table, a governance dimension table and an execution engine table are correspondingly set in a dimension table; and the fact table is correspondingly provided with three tables of an execution list table, a quality result list table and a quality history list table. Fig. 2 shows a data flow diagram in the star data governance storage method provided by this embodiment, which is used to explain the data flow direction of the business fact data in each table. In the data management and storage operation, firstly, service data, management dimensionality and an execution engine are defined, then the service data needing to be managed is configured in an execution list, and finally, a program is scheduled to output detailed data of data quality, so that high expansibility, high robustness and high usability are achieved.
Exemplary devices
As shown in fig. 3, an embodiment of the present invention provides a star-shaped data governance storage device, where the star-shaped data governance storage device includes a management table presetting module 10, a dimension table setting module 20, a fact table setting module 30, a business fact confirmation module 40, and a data governance storage module 50.
The management table presetting module 10 is used for presetting two management tables, namely a dimension table and a fact table.
The dimension table setting module 20 is configured to set the service content and the corresponding administration means in the dimension table.
The fact table setting module 30 is configured to set the business fact and the metric value corresponding to the business fact in the fact table.
And the service fact confirmation module 40 is configured to obtain a service fact and then correspondingly confirm the service fact and the service content in the dimension table.
And the data governance storage module 50 is configured to, when the business fact reaches the corresponding metric value in the fact table, invoke a governance means corresponding to the corresponding business content to perform data quality governance.
Specifically, as shown in fig. 4, the dimension table setting module 20 includes a business line table 21, an administration dimension table 22, and an execution engine table 23, which are respectively used for continuously expanding at a business line level, an administration dimension level, and an execution engine level.
Specifically, as shown in fig. 5, the fact table setting module 30 sets a list including an execution list table 31, a quality result list table 32, and a quality history list table 33 for storing an execution task list, an execution task result, and a history list result, respectively.
The specific working process among the modules refers to the steps in the star data management and storage method, and the working principle of the method is the same as that of the star data management and storage method, which is not described herein again.
Exemplary terminal device
As shown in fig. 6, an embodiment of the present invention provides a star-type data governance storage terminal device, and in an embodiment, a terminal device is provided, where the terminal device includes a memory, a processor, and a computer program of the terminal device that is stored in the memory and can be run on the processor, the computer program is a star-type data quality program, and when the processor executes the computer program of the terminal device, the following operation instructions are implemented:
presetting a dimension table and a fact table;
setting business content and a corresponding treatment means in the dimension table;
setting a business fact and a corresponding metric value in the fact table;
after the business fact is obtained, correspondingly confirming the business fact and the business content in the dimension table;
and when the business fact reaches the corresponding measurement value in the fact table, calling a treatment means corresponding to the corresponding business content to treat the data quality, and storing the data in the treatment means.
In this embodiment, a specific operation instruction implementation method is the same as the star data governance storage method, and details are not described here.
Those skilled in the art will appreciate that all the processes of the methods of the embodiments described above can be implemented by a computer program, which can be stored in a non-volatile computer-readable storage medium, and can include the processes of the embodiments of the methods described above when the computer program is executed. Any reference to memory, storage, databases, or other media used in embodiments provided herein may include non-volatile and/or volatile memory. Non-volatile memory can include read-only memory (ROM), Programmable ROM (PROM), Electrically Programmable ROM (EPROM), Electrically Erasable Programmable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in a variety of forms such as Static RAM (SRAM), Dynamic RAM (DRAM), Synchronous DRAM (SDRAM), Double Data Rate SDRAM (DDRSDRAM), Enhanced SDRAM (ESDRAM), Synchronous Link DRAM (SLDRAM), Rambus Direct RAM (RDRAM), direct bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).
In summary, the invention discloses a star-type data governance storage method, a star-type data governance storage device, a terminal device and a storage medium, the method supports the back-end storage of a data governance system by adopting the star-type storage method, records dimension information and realizes information expansion by establishing a dimension table (comprising a service line table, a governance dimension table and an execution engine table) and a fact table (comprising an execution list table, a quality result detail table and a quality history detail table), achieves high expansibility and high usability, and uses the fact table, so that the existing and history results stored on the fact table are not influenced by the expansion of the service line level, the governance dimension level and the execution engine level of the dimension table, and realizes high robustness.
Finally, it should be noted that: the above examples are only intended to illustrate the technical solution of the present invention, but not to limit it; although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions of the embodiments of the present invention.
Claims (10)
1. A star-shaped data governance storage method is used for carrying out data quality storage management on big data through a data governance system, and is characterized by comprising the following steps:
presetting a dimension table and a fact table;
setting business content and a corresponding treatment means in the dimension table;
setting a business fact and a corresponding metric value in the fact table;
after the business fact is obtained, correspondingly confirming the business fact and the business content in the dimension table;
and when the business fact reaches the corresponding measurement value in the fact table, calling a treatment means corresponding to the corresponding business content to treat the data quality, and storing the data in the treatment means.
2. The star data governance method according to claim 1, wherein the dimension tables include a business line table, a governance dimension table, and an execution engine table.
3. The star data governance method according to claim 1, wherein the fact tables include an execution list table, a quality result table, and a quality history table.
4. The star-shaped data governance method according to claim 2, wherein setting the business content and the governance means corresponding thereto in the dimension table comprises the steps of:
recording items needing data management in the service line table, and corresponding the items to primary classification and secondary classification of different service lines;
recording the dimensionality of data governance in the governance dimension table, and displaying according to the parent dimensionality and the child dimensionality;
and recording the adopted calculation execution engine and the basic information of the calculation execution engine in the execution engine table.
5. The star data governance method according to claim 3, wherein the step of setting the business facts and their corresponding metric values in the fact table comprises the steps of:
recording details of abatement indicators in the execution list table, the data abatement system executing according to the recorded details of the execution list table, comprising: the management project, management dimension and management execution engine in the service line;
recording the value calculated by the treatment index in the quality result detail table, and recording the value by date;
and recording the historical detailed information of the treatment indexes in the quality history list.
6. The star-shaped data governance method according to any one of claims 1 to 5, wherein a primary key in the dimension table is set as a foreign key in the fact table.
7. The star data governance method according to claim 6, further comprising the steps of:
and the data management system also outputs detailed data of the data quality for storage after calling a management means corresponding to the corresponding service content to manage the data quality.
8. A star-shaped data governance storage device is characterized by comprising a management table presetting module, a dimension table setting module, a fact table setting module, a business fact confirmation module and a data governance storage module;
the management table presetting module is used for presetting a dimension table and a fact table;
the dimension table setting module is used for setting the service content and the corresponding treatment means in the dimension table;
the fact table setting module is used for setting the business fact and the corresponding metric value in the fact table;
the service fact confirmation module is used for correspondingly confirming the service fact and the service content in the dimension table after the service fact is obtained;
and the data governance storage module is used for calling a governance means corresponding to the corresponding service content to carry out data quality governance when the service fact reaches the corresponding metric value in the fact table.
9. A star-shaped data governance storage terminal device, which is characterized in that the memory, the processor and a star-shaped data governance storage program of the terminal device stored on the memory and capable of running on the processor are used for realizing the steps of the star-shaped data governance storage method according to any one of claims 1 to 7 when the processor executes the star-shaped data governance storage program of the terminal device.
10. A computer readable storage medium having stored thereon a star data governance storage program which, when executed by a processor, implements the steps of the star data governance storage method of any one of claims 1-7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110025481.1A CN112765168B (en) | 2021-01-08 | 2021-01-08 | Star-shaped data management storage method and device, terminal equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110025481.1A CN112765168B (en) | 2021-01-08 | 2021-01-08 | Star-shaped data management storage method and device, terminal equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112765168A true CN112765168A (en) | 2021-05-07 |
| CN112765168B CN112765168B (en) | 2023-08-29 |
Family
ID=75701105
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110025481.1A Active CN112765168B (en) | 2021-01-08 | 2021-01-08 | Star-shaped data management storage method and device, terminal equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112765168B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113360489A (en) * | 2021-06-04 | 2021-09-07 | 浪潮软件科技有限公司 | Normalized data management method based on fine granularity |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8311975B1 (en) * | 2011-02-28 | 2012-11-13 | Allan Michael Gonsalves | Data warehouse with a domain fact table |
| US20130124241A1 (en) * | 2011-11-15 | 2013-05-16 | Pvelocity Inc. | Method And System For Providing Business Intelligence Data |
| CN104182544A (en) * | 2014-09-05 | 2014-12-03 | 北京国双科技有限公司 | Dimensionality analyzing method and device for analytic database |
| CN104317936A (en) * | 2014-10-31 | 2015-01-28 | 北京思特奇信息技术股份有限公司 | ROLAP (relational on-line analysis processing) analysis engine design method and device on basis of star models |
| US20160110396A1 (en) * | 2014-10-21 | 2016-04-21 | Macrodata, Inc. | Data processing apparatuses, methods, and non-transitory tangible machine-readable medium thereof |
| CN106021486A (en) * | 2016-05-18 | 2016-10-12 | 广东源恒软件科技有限公司 | Big data-based data multidimensional analyzing and processing method |
| CN108415990A (en) * | 2018-02-12 | 2018-08-17 | 苏州朗动网络科技有限公司 | Data quality monitoring method, device, computer equipment and storage medium |
| US20180253474A1 (en) * | 2017-03-01 | 2018-09-06 | Mckesson Corporation | Methods and apparatuses for improved database design |
| US20180300362A1 (en) * | 2015-04-11 | 2018-10-18 | Entit Software Llc | Dimension data insertion into a dimension table |
| CN111125266A (en) * | 2019-12-24 | 2020-05-08 | 中国建设银行股份有限公司 | Data processing method, device, equipment and storage medium |
-
2021
- 2021-01-08 CN CN202110025481.1A patent/CN112765168B/en active Active
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8311975B1 (en) * | 2011-02-28 | 2012-11-13 | Allan Michael Gonsalves | Data warehouse with a domain fact table |
| US20130124241A1 (en) * | 2011-11-15 | 2013-05-16 | Pvelocity Inc. | Method And System For Providing Business Intelligence Data |
| CN104182544A (en) * | 2014-09-05 | 2014-12-03 | 北京国双科技有限公司 | Dimensionality analyzing method and device for analytic database |
| US20160110396A1 (en) * | 2014-10-21 | 2016-04-21 | Macrodata, Inc. | Data processing apparatuses, methods, and non-transitory tangible machine-readable medium thereof |
| CN104317936A (en) * | 2014-10-31 | 2015-01-28 | 北京思特奇信息技术股份有限公司 | ROLAP (relational on-line analysis processing) analysis engine design method and device on basis of star models |
| US20180300362A1 (en) * | 2015-04-11 | 2018-10-18 | Entit Software Llc | Dimension data insertion into a dimension table |
| CN106021486A (en) * | 2016-05-18 | 2016-10-12 | 广东源恒软件科技有限公司 | Big data-based data multidimensional analyzing and processing method |
| US20180253474A1 (en) * | 2017-03-01 | 2018-09-06 | Mckesson Corporation | Methods and apparatuses for improved database design |
| CN108415990A (en) * | 2018-02-12 | 2018-08-17 | 苏州朗动网络科技有限公司 | Data quality monitoring method, device, computer equipment and storage medium |
| CN111125266A (en) * | 2019-12-24 | 2020-05-08 | 中国建设银行股份有限公司 | Data processing method, device, equipment and storage medium |
Non-Patent Citations (3)
| Title |
|---|
| PRAJWOL SANGAT ET AL.: "Distributed ATrie Group Join: Towards Zero Network Cost", 《IEEE ACCESS》, pages 111598 - 111613 * |
| 廖飒等: "数据仓库维度建模设计原则及应用", 《宜春学院学报》, pages 89 - 91 * |
| 张军;王芬芬;: "高校数据仓库多维数据建模分析", 智能计算机与应用, no. 05, pages 218 - 223 * |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113360489A (en) * | 2021-06-04 | 2021-09-07 | 浪潮软件科技有限公司 | Normalized data management method based on fine granularity |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112765168B (en) | 2023-08-29 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11163731B1 (en) | Autobuild log anomaly detection methods and systems | |
| US10824758B2 (en) | System and method for managing enterprise data | |
| CN110489313B (en) | Operation log recording method and device based on block chain and storage medium | |
| KR101013810B1 (en) | An excel-based management system for updating db tables and the method thereof | |
| US20210081358A1 (en) | Background dataset maintenance | |
| CN110147365B (en) | Method, device, equipment and medium for checking business data and financial data | |
| CN109800278A (en) | Data assets map application method, device, computer equipment and storage medium | |
| CN113158233A (en) | Data preprocessing method and device and computer storage medium | |
| US20140310715A1 (en) | Modeling and Consuming Business Policy Rules | |
| CN112765168A (en) | Star data management and storage method and device, terminal equipment and storage medium | |
| CN113220777B (en) | Service data processing method, device, computer equipment and storage medium | |
| CN108415990B (en) | Data quality monitoring method and device, computer equipment and storage medium | |
| CN112580319A (en) | Data processing method, device, equipment and computer readable storage medium | |
| US8417594B2 (en) | Dimension-based financial reporting using multiple combinations of dimensions | |
| CN114860759A (en) | Data processing method, device and equipment and readable storage medium | |
| CN115409014A (en) | Document template generation method and device, computer equipment and storage medium | |
| CN113868138A (en) | Method, system, equipment and storage medium for acquiring test data | |
| KR20220057721A (en) | System and method for providing office ERP solution based on document form big data | |
| CN110795451B (en) | SQL fingerprint restoring method, SQL fingerprint restoring device, SQL fingerprint restoring computer equipment and storage medium | |
| US11831490B1 (en) | Systems, methods, and media for performing information technology service management correlation for infrastructure environment functions | |
| US20240119030A1 (en) | Managing and providing a rule independent data model | |
| CN117892705A (en) | Report processing method, system and storage medium | |
| CN114298749A (en) | Access method, device and medium for cost data source | |
| CN117830014A (en) | Financial document information batch modification method and device and electronic equipment | |
| CN112633839A (en) | Automatic tax declaration method and device based on NoSql and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |