CN102385629B - Application method of extending father and son model to network model in data warehouse - Google Patents
Application method of extending father and son model to network model in data warehouse Download PDFInfo
- Publication number
- CN102385629B CN102385629B CN 201110370048 CN201110370048A CN102385629B CN 102385629 B CN102385629 B CN 102385629B CN 201110370048 CN201110370048 CN 201110370048 CN 201110370048 A CN201110370048 A CN 201110370048A CN 102385629 B CN102385629 B CN 102385629B
- Authority
- CN
- China
- Prior art keywords
- model
- data
- father
- node
- son
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
- 238000000034 method Methods 0.000 title claims abstract description 42
- 238000003672 processing method Methods 0.000 claims abstract description 4
- 230000006855 networking Effects 0.000 claims description 13
- 238000004364 calculation method Methods 0.000 claims description 5
- 238000013500 data storage Methods 0.000 description 4
- 230000008520 organization Effects 0.000 description 4
- 150000001875 compounds Chemical class 0.000 description 2
- 241000533950 Leucojum Species 0.000 description 1
- 238000012423 maintenance Methods 0.000 description 1
- 230000001568 sexual effect Effects 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
Images
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses an application method of extending a father and son model to a network model in a data warehouse, which belongs to the application technology of a data structure and a data processing method of converting a single channel into multiple channels, i.e. in a data warehouse system, the structured data of the father and son model is converted into the structured data of the network model. Compared with the prior art, the application method of extending the father and son model to the network model in the data warehouse has the advantages of solving the problem of logic complexity in the summarizing and inquiring process of the structured data of the father and son model, reducing the complexity of a realization process and the occupied system space and increasing the flexibility of system application and the convenience in terms of data authority control.
Description
Technical field
The present invention relates to a kind of data structure application technology, specifically father and son's model is extended to the application process of network model in a kind of data warehouse.
Background technology
In data warehouse, father and son's dimension is common dimension model, but in Star Model or snowflake model, often faces following problem for the factual data of this type when processing:
1, the data of each superior node need Recursion process when generating, and have increased the complicacy of data process method.Particularly in the data warehouse applications of not using the Cube technology, such as gathering and inquiry etc. of organizational structure, staff relationship, subject, product data, often must generate in advance the data of each node, this processing often brings increasing substantially that data space takies, and has increased the complexity that data are processed.
2, use the mode of anticipating data, also face when this type of relation need to be adjusted because of mistake, then generated data needs the again problem of processing, namely increased the cost of system maintenance, reduce again the available sexual type of system, brought bad impression to the client, affected corporate image.
3, aspect data query and control of authority, particularly under the institutional framework of multi-layer, the client is because aspect of living in is different, be concerned about and the data plane of having the right to check also different.The way in past often needs repeatedly using-system relation table, to organize complicated query logic to satisfy this kind requirement, has significantly increased the complexity of processing, and system maintainability reduces.
Summary of the invention
Technical assignment of the present invention provide a kind of father and son's of solution model structural data gather, logic challenge in the query script, reduce the complicacy of implementation procedure, reducing system space takies, the dirigibility that elevator system is used, and improve the application process that father and son's model in a kind of data warehouse of the convenience aspect data permission control is extended to network model.
Technical assignment of the present invention is realized in the following manner, and single channel is converted into multichannel data processing method; Namely in data warehouse, father and son's model data is converted into the network model data, gathers in data, improve availability aspect the data query, data permission control, specifically:
(1), with the structural network of father and son's model, pass through Recursion process, with arbitrary node by its node of directly quoting, all superior nodes that this node is relevant and all downstream sites are set up direct relation, keep simultaneously this node in this relation and concern all properties of node, such as code name, name attribute, keep in case of necessity node itself and concern the node degree of depth or level separately, and to identify this kind pass be non-self relation, i.e. the node retrospective; Embody simultaneously each historical record that father and son's relationship model is brought because of slow dimension variation;
(2), keep the corresponding relation of all nodes self, and all properties, and identify this kind relation not for self relation, to be different from the relation of the superior and the subordinate's node, i.e. node reflexivity; Embody simultaneously each historical record that father and son's relationship model is brought because of slow dimension variation;
(3), networking relation comes from father and son's relationship model all the time, networked process is processed generation automatically by system; In case father and son's relationship model changes, then network model also regenerates simultaneously;
(4), during the data handling utility network model, in processing procedure, only calculate the business datum of the actual generation of each node self, data are not carried out any type of gathering;
(5), during data query application network model, in query script, use network model to substitute former father and son's model, filtercondition uses the superior node attribute, and Correlation Criteria uses this node attribute, the dimension date effectively after, calculate in real time the data of each superior node; When the present querying condition of the control volume of data authority is organized, use at most twice network model can satisfy nearly all rational control mode;
(6), the process of the networking depth ﹠ wideth that can look father and son's model generates some data; But these class data take up room and compare the true class data of data warehouse, can ignore;
(7), after the networking, use this structure when organizing data query, the data display end need to be done simple calculations.In the vast majority of circumstances, this processing brings customer experience to postpone substantially can ignore.
Father and son's model data is converted into the network model data, and networked step process is:
(1) behind the every attribute with the additional father node of the Direct-type set membership in father and son's model, storage becomes network model, and direct relation is set up complete;
(2), the superior node of each node in the network model is sought its superior node in father and son's model data, and after replenishing its every attribute, be stored in network model;
(3), suppose that the degree of depth of father and son's model is P, after then recurrence was carried out (2) step P time, indirect relation was set up complete;
(4), each node in father and son's model is set up self corresponding relation, and storage become network model;
(5), network model is set up complete;
(6) in case father and son's model data changes, then since the execution of (1) step, rebuild network model.
The application of network model:
(1), can see from network model, can pass through any one superior node, find its all downstream sites, comprise in father and son's model directly and relation indirectly, and can directly find the attribute information of this downstream site.So, can simply set up its multiple inquiry purposes by this relation and attribute information collocation.
(2), when data handling utility network model structure, in the processing procedure of each fact table data, only calculate the business datum of the actual generation of each node self, data are not carried out any type of gathering or other simple operations in this dimension.
(3), when data query application network model, in the query script, use network model to substitute former father and son's model, filtercondition uses the superior node attribute, Correlation Criteria uses this node attribute, the dimension date effectively after, calculate in real time the data of each superior node.When the present querying condition of the control volume of data authority is organized, use at most twice network structure can satisfy nearly all rational control mode.
The application process that father and son's model is extended to network model in a kind of data warehouse of the present invention has the following advantages:
1, with the structural network of father and son's model, can directly quote all superior nodes relevant with this node and all downstream sites, i.e. node retrospective by arbitrary node.
2, keep the corresponding relation of all nodes self, and be different from the relation of the superior and the subordinate's node, i.e. node reflexivity.
3, networking relation comes from father and son's relationship model all the time, and networked process is processed generation automatically by system.
4, only calculate the business datum of the actual generation of each node self in the data handling procedure; Use network model simply to organize querying condition in the data query process, calculate in real time each father node data.
5, the process of the networking depth ﹠ wideth that can look father and son's model generates some data, but this class data space takies the true class data of comparing data warehouse, can ignore.
6, after the networking, use this structure when organizing data query, the data display end need to be done simple calculations.In the vast majority of circumstances, this processing brings customer experience to postpone substantially can ignore.
Description of drawings
The present invention is further described below in conjunction with accompanying drawing.
Accompanying drawing 1 is the relational data storage organization commonly used of father and son's model structure of the application process that father and son's model is extended to network model in a kind of data warehouse;
Accompanying drawing 2 is the relational data storage organization of the network model structure of the application process that father and son's model is extended to network model in a kind of data warehouse.
Embodiment
The application process that father and son's model in a kind of data warehouse of the present invention is extended to network model with reference to Figure of description and specific embodiment explains below doing.
Embodiment:
Father and son's model is extended to the application process of network model in a kind of data warehouse of the present invention, and single channel is converted into multichannel data processing method; Namely in data warehouse, father and son's model data is converted into the network model data, gathers in data, improve availability aspect the data query, data permission control, specifically:
(1), with the structural network of father and son's model, pass through Recursion process, with arbitrary node by its node of directly quoting, all superior nodes that this node is relevant and all downstream sites are set up direct relation, keep simultaneously this node in this relation and concern all properties of node, such as code name, name attribute, keep in case of necessity node itself and concern the node degree of depth or level separately, and to identify this kind pass be non-self relation, i.e. the node retrospective; Embody simultaneously each historical record that father and son's relationship model is brought because of slow dimension variation;
(2), keep the corresponding relation of all nodes self, and all properties, and to identify this kind pass be self relation, to be different from the relation of the superior and the subordinate's node, i.e. node reflexivity; Embody simultaneously each historical record that father and son's relationship model is brought because of slow dimension variation;
(3), networking relation comes from father and son's relationship model all the time, networked process is processed generation automatically by system; In case father and son's relationship model changes, then network model also regenerates simultaneously;
(4), during the data handling utility network model, in processing procedure, only calculate the business datum of the actual generation of each node self, data are not carried out any type of gathering;
(5), during data query application network model, in query script, use network model to substitute former father and son's model, filtercondition uses the superior node attribute, and Correlation Criteria uses this node attribute, the dimension date effectively after, calculate in real time the data of each superior node; When the present querying condition of the control volume of data authority is organized, use at most twice network model can satisfy nearly all rational control mode;
(6), the process of the networking depth ﹠ wideth that can look father and son's model generates some data; But these class data take up room and compare the true class data of data warehouse, can ignore;
(7), after the networking, use this structure when organizing data query, the data display end need to be done simple calculations.In the vast majority of circumstances, this processing brings customer experience to postpone substantially can ignore.
Father and son's model data is converted into the network model data, and networked step process is:
(1) behind the every attribute with the additional father node of the Direct-type set membership in father and son's model, storage becomes network model, and direct relation is set up complete;
(2), the superior node of each node in the network model is sought its superior node in father and son's model data, and after replenishing its every attribute, be stored in network model;
(3), suppose that the degree of depth of father and son's model is P, after then recurrence was carried out (2) step P time, indirect relation was set up complete;
(4), each node in father and son's model is set up self corresponding relation, and storage become network model;
(5), network model is set up complete;
(6) in case father and son's model data changes, then since the execution of (1) step, rebuild network model.
Its relational data storage organization commonly used of father and son's model data, as shown in Figure 1, K represents major key, compound primary key (node number, Start Date); P represents foreign key reference, and " superior node number " quotes " node number " field of this table.Each arrow represents a set membership, and is recorded in the relationship type structure.
Network model data and relational data storage organization thereof, as shown in Figure 2, K represents major key, compound primary key (node number, Start Date, superior node number).Each solid arrow represents a direct set membership, and each dashed curve shape arrow represents an indirect set membership, and each dashed circle arrow represents that one self concerns, every kind of relation record is in relational data structure.
The application of network model:
(1), can see from network model, can pass through any one superior node, find its all downstream sites, comprise in father and son's model directly and relation indirectly, and can directly find the attribute information of this downstream site.So, can simply set up its multiple inquiry purposes by this relation and attribute information collocation.
(2), when the data handling utility network model, in the processing procedure of each fact table data, only calculate the business datum of the actual generation of each node self, data are not carried out any type of gathering or other simple operations in this dimension.
(3), when data query application network model, in the query script, use network model to substitute former father and son's model, filtercondition uses the superior node attribute, Correlation Criteria uses this node attribute, the dimension date effectively after, calculate in real time the data of each superior node.When the present querying condition of the control volume of data authority is organized, use at most twice network model can satisfy nearly all rational control mode.
Can find out from the process of network model and networking, the data of network model are from father and son's model, and its data volume can be decided on the depth ﹠ wideth of father and son's model.But these class data take up room and compare the true class data of data warehouse, can ignore.
Can find out from network model and using method, when using network model to organize data query, the data display end need to be done the simple calculations such as some gather.Through the actual use situation, in the vast majority of circumstances, this processing brings customer experience to postpone substantially can ignore.
Father and son's model is extended to the application process of network model in a kind of data warehouse of the present invention, except the described technical characterictic of instructions, is the known technology of those skilled in the art.
Claims (1)
1. father and son's model is extended to the application process of network model in the data warehouse, it is characterized in that single channel is converted into multichannel data processing method; Namely in data warehouse, father and son's model data is converted into the network model data, specifically:
(1), with the structural network of father and son's model, pass through Recursion process, with arbitrary node by its node of directly quoting, all superior nodes that this node is relevant and all downstream sites are set up direct relation, keep simultaneously this node in this relation and concern all properties of node, keep node itself and reach and concern the node degree of depth or level separately, and to identify this kind pass be non-self relation, be i.e. the node retrospective; Embody simultaneously each historical record that father and son's relationship model is brought because of slow dimension variation;
(2), keep the corresponding relation of all nodes self, and all properties, and to identify this kind pass be self relation, to be different from the relation of the superior and the subordinate's node, i.e. node reflexivity; Embody simultaneously the historical record that father and son's relationship model is brought because of slow dimension variation;
(3), networking relation comes from father and son's relationship model all the time, networked process is processed generation automatically by system; In case father and son's relationship model changes, then network model also regenerates simultaneously;
(4), during the data handling utility network model, in processing procedure, only calculate the business datum of the actual generation of each node self, data are not carried out any type of gathering;
(5), during data query application network model, in query script, use network model to substitute former father and son's model, filtercondition uses the superior node attribute, and Correlation Criteria uses this node attribute, the dimension date effectively after, calculate in real time the data of each superior node;
(6), the process of the networking depth ﹠ wideth that can look father and son's model generates some data;
(7), after the networking, use this structure when organizing data query, the data display end need to be done simple calculations;
Father and son's model data is converted into the network model data, and networked step process is:
(1) behind the every attribute with the additional father node of the Direct-type set membership in father and son's model, storage becomes network model, and direct relation is set up complete;
(2), the superior node of each node in the network model is sought its superior node in father and son's model data, and after replenishing its every attribute, be stored in network model;
(3), suppose that the degree of depth of father and son's model is P, after then recurrence was carried out (2) step P time, indirect relation was set up complete;
(4), each node in father and son's model is set up self corresponding relation, and storage become network model;
(5), network model is set up complete;
(6) in case father and son's model data changes, then since the execution of (1) step, rebuild network model.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 201110370048 CN102385629B (en) | 2011-11-21 | 2011-11-21 | Application method of extending father and son model to network model in data warehouse |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 201110370048 CN102385629B (en) | 2011-11-21 | 2011-11-21 | Application method of extending father and son model to network model in data warehouse |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102385629A CN102385629A (en) | 2012-03-21 |
| CN102385629B true CN102385629B (en) | 2013-04-03 |
Family
ID=45825045
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN 201110370048 Expired - Fee Related CN102385629B (en) | 2011-11-21 | 2011-11-21 | Application method of extending father and son model to network model in data warehouse |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102385629B (en) |
Families Citing this family (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102938111A (en) * | 2012-11-27 | 2013-02-20 | 山东黄金矿业（莱州）有限公司 | Enterprise electric energy consumption apportioning method |
| CN104216932B (en) * | 2013-09-29 | 2017-11-07 | 北大方正集团有限公司 | The measure and its system of a kind of knowledge point relationship strength |
| CN104391948B (en) * | 2014-12-01 | 2017-11-21 | 广东电网有限责任公司清远供电局 | The data normalization construction method and system of data warehouse |
| CN104361134B (en) * | 2014-12-10 | 2018-10-19 | 用友网络科技股份有限公司 | Relational hierarchy computing device and method |
| CN110796532B (en) * | 2018-08-02 | 2021-08-24 | 马上消费金融股份有限公司 | Credit risk processing method, terminal equipment, server and system |
| CN116204554B (en) * | 2023-05-04 | 2023-08-08 | 浙江康勒工业软件有限公司 | Data processing method, system, electronic device and storage medium |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8244747B2 (en) * | 2006-12-05 | 2012-08-14 | International Business Machines Corporation | Middleware for query processing across a network of RFID databases |
| CN101609986B (en) * | 2008-06-20 | 2012-11-21 | 上海申瑞电力科技股份有限公司 | Multilevel joint coordination automatic voltage control method based on decision trees |
-
2011
- 2011-11-21 CN CN 201110370048 patent/CN102385629B/en not_active Expired - Fee Related
Also Published As
| Publication number | Publication date |
|---|---|
| CN102385629A (en) | 2012-03-21 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102385629B (en) | Application method of extending father and son model to network model in data warehouse | |
| CN105446991B (en) | Date storage method, querying method and equipment | |
| CN105183735B (en) | The querying method and inquiry unit of data | |
| EP2932370B1 (en) | System and method for performing a transaction in a massively parallel processing database | |
| CN104899295B (en) | A kind of heterogeneous data source data relation analysis method | |
| CN102270225A (en) | Data change log monitoring method and device | |
| CN102945240A (en) | Method and device for realizing association rule mining algorithm supporting distributed computation | |
| CN108763234A (en) | A kind of real time data synchronization method and system | |
| CN102917009B (en) | A kind of stock certificate data collection based on cloud computing technology and storage means and system | |
| US10733186B2 (en) | N-way hash join | |
| CN101216911A (en) | Dynamic workflow model subdivision method supporting distributed execution | |
| CN102081656A (en) | Data acquisition and distribution system of cross-platform heterogeneous database | |
| CN107102995B (en) | Method and device for determining SQL execution plan | |
| US20130132911A1 (en) | Client-Side Generation and Filtering of Hierarchy Information | |
| CN105868196A (en) | Method for generating industrial data report in server | |
| CN103092997A (en) | Linkage query system and linkage query method used for statement analysis | |
| CN111177244A (en) | Data association analysis method for multiple heterogeneous databases | |
| CN103838781A (en) | Database access method and system | |
| CN103605732A (en) | Data warehouse, data warehouse system and data warehouse construction method based on Infobright | |
| US20190108256A1 (en) | System for scalable database security | |
| CN103034681A (en) | Report generation device and report generation method | |
| US8521699B2 (en) | Tracking changes across collection of data tables | |
| CN107729410A (en) | A kind of database engine suitable for power equipment big data | |
| CN103020139B (en) | Tables of data expanding system and tables of data extended method | |
| WO2021195285A1 (en) | Systems and methods for tracking features in a development environment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20130403 Termination date: 20141121 |
|
| EXPY | Termination of patent right or utility model |