CN107341253B - Method for updating main data according to data grade - Google Patents
Method for updating main data according to data grade Download PDFInfo
- Publication number
- CN107341253B CN107341253B CN201710559044.1A CN201710559044A CN107341253B CN 107341253 B CN107341253 B CN 107341253B CN 201710559044 A CN201710559044 A CN 201710559044A CN 107341253 B CN107341253 B CN 107341253B
- Authority
- CN
- China
- Prior art keywords
- updating
- data
- source data
- time
- priority
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/28—Databases characterised by their database models, e.g. relational or object models
- G06F16/283—Multi-dimensional databases or data warehouses, e.g. MOLAP or ROLAP
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/23—Updating
- G06F16/235—Update request formulation
Landscapes
- Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Mathematical Physics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention relates to a method for updating main data according to data grades, which comprises the steps of firstly setting data in a data warehouse as a plurality of main data latitude units, classifying source data into a plurality of source data units, then setting an updating priority grade, and updating the main data according to the updating priority grade, thereby solving the problem of updating and integrating in the main data processing process, and simultaneously having the characteristics of selective updating and high updating speed.
Description
Technical Field
The present invention relates to a data updating method, and more particularly, to a method for updating main data according to data class.
Background
In enterprise-level applications, the main data of an enterprise, which is the basis of all information applications, is the core of the informatization of the whole enterprise, and therefore, the optimization processing of the main data is extremely important.
In the traditional main data processing, the updating processing of the main data dimension data is always a difficult problem of main data processing, and particularly, under the environment that the data source is complicated and changeable, the quick and accurate updating processing of the main data is difficult to realize. With the explosive growth of business and data volume, the difficulty of solving the problem is increased under the current mass data environment. In the concrete practice, if a method for completely updating and replacing the main data of an enterprise without screening is adopted, the updating speed is very low, and the method can be realized only by configuring a server with a very high price, the updating mode is obviously not applicable in the coming era of big data, and in addition, if the main data and the updating method are not innovated, the phenomena of multiple data, untimely data updating, data chaos and the like are inevitably generated, so that the normal operation of the enterprise is influenced, which is the main defect of the traditional technology.
Disclosure of Invention
The invention provides a method for updating main data according to data grade, which carries out induction grading on source data and selectively updates the main data according to the data grade, solves the problem of update integration in the main data processing process, and has the characteristics of selective update and high update speed, thereby being the main purpose of the invention.
The technical scheme adopted by the invention is as follows: a method of updating primary data according to data rank, comprising the steps of.
The data in the data warehouse is set as a plurality of main data latitude units, and each main data latitude unit comprises a plurality of pieces of field information.
And secondly, classifying the source data into a plurality of source data units, wherein each source data unit comprises a plurality of source data fields, and establishing an updating relation between one source data field in one source data unit and one field information in one main data latitude unit so as to form a plurality of updating relations.
And thirdly, simultaneously setting updating priority levels for a plurality of updating relations in the second step, wherein the updating relations correspond to the updating priority levels one to one, and the updating priority levels are respectively provided with different updating levels.
And fourthly, when any source data field in any source data unit is checked to be updated, reading the updating priority level of the updating relation corresponding to the source data field at this time, wherein the updating relation points to field information of a main data latitude unit, reading the updating priority level of the source data field in other source data units at the last time on the field information, comparing the updating priority level at this time with the updating priority level at the last time, if the updating priority level at this time is less than the updating priority level at the last time, abandoning the updating operation at this time, and if the updating priority level at this time is greater than the updating priority level at the last time, covering the source data field at this time into the field information corresponding to the source data field at this time to update the main data latitude unit.
In the second step, an update relationship is established between one source data field in one source data unit and the field information in a plurality of primary data latitude units at the same time. And in the third step, the updating level of each updating priority level is set according to the updating time of the source data unit, the data source department level and other factors, and the more timely and accurate the updating of the source data unit is, the higher the updating priority level is set.
And in the fourth step, if the current updating priority is equal to the last updating priority, comparing the updating time of the current updating priority with the updating time of the last updating priority, abandoning the current updating operation if the updating time of the current updating priority is later than the updating time of the last updating priority, and covering the current source data field in the field information corresponding to the current source data field to update the main data latitude unit if the updating time of the current updating priority is earlier than the updating time of the last updating priority. Recording the field information of the updated main data latitude unit, the updated source data field, the updated update relationship, the updated update priority and the update time information when the update operation of the fourth step is performed.
The invention has the beneficial effects that: the invention carries out induction grading on the source data and selectively updates the main data according to the data grade, solves the problem of updating and integrating in the main data processing process, and has the characteristics of selective updating and high updating speed.
Drawings
Fig. 1 is a schematic block diagram of the principle of the present invention.
FIG. 2 is a schematic block diagram illustrating the principles of the present invention in an exemplary embodiment.
FIG. 3 is a diagram illustrating an update configuration table according to the present invention.
Detailed Description
As shown in fig. 1-3, a method for updating main data according to data rank includes the steps of:
in the first step, data in the data warehouse is set as a plurality of main data latitude units 10.
Each of the primary data latitude units 10 includes several field information 11.
For example, data in the data warehouse are set as a main data latitude unit Z1, a main data latitude unit Z2, and a main data latitude unit Z3, where the main data latitude unit Z1 is human information, the main data latitude unit Z2 is vehicle information, and the main data latitude unit Z3 is property information.
The main data latitude unit Z1 includes several field information 11, and the several field information 11 may be name field information a1, age field information a2, death field information A3, and the like.
The main data latitude unit Z2 includes several field information 11, and several field information 11 may be purchase time field information B1, violation field information B2, and transit time field information B3.
In a second step, the source data is classified into source data units 20, and each of the source data units 20 includes source data fields 21.
In practical implementation, the update relationship 30 can also be established between one source data field 21 in one source data unit 20 and the field information 11 in a plurality of primary data latitude units 10 at the same time.
And thirdly, simultaneously setting the updating priority levels 40 for a plurality of the updating relations 30 in the second step, wherein the updating relations 30 correspond to the updating priority levels 40 one by one, and the updating priority levels 40 have different updating levels respectively.
In practical implementation, the update level of each update priority level 40 is set according to the update time of the source data unit 20, the data source department level, and other factors, and the update priority level of the source data unit with higher accuracy is set to be higher in time.
For example, several of the update priority levels 40 are set to update levels S1-S9, and the update relationship 30 between the source data field C1 in the source data unit C and the death field information A3 in the primary data latitude unit Z1 is level S1.
The updated relationship 30 between the source data field C2 in the source data unit C and the violation field information B2 in the primary data latitude unit Z2 is level S4, and so on.
Fourth, when it is checked that any one of the source data fields 21 in any one of the source data units 20 has an update.
First, the update priority 40 of the current time of the update relationship 30 corresponding to the current source data field 21 is read, and the update relationship 30 points to a field information 11 of a main data latitude unit 10.
While reading the last update priority level 40 of the source data field 21 of the last other source data unit 20 to this field information 11.
Comparing the updating priority 40 with the updating priority 40 last time, and if the updating priority 40 this time is less than the updating priority 40 last time, abandoning the updating operation this time.
If the update priority 40 is higher than the last update priority 40, the source data field 21 is covered into the field information 11 corresponding to the current update priority, so as to update the main data latitude unit 10.
If the update priority level 40 of this time is equal to the update priority level 40 of the last time, the update time of the update priority level 40 of this time is compared with the update time of the update priority level 40 of the last time.
If the update time of the current update priority level 40 is later than the update time of the previous update priority level 40, the current update operation is abandoned.
If the update time of the current update priority level 40 is earlier than the update time of the last update priority level 40, the source data field 21 is covered in the field information 11 corresponding to the current update time, so as to update the latitude unit of primary data 10.
The field information 11 of the updated primary data latitude unit 10, the updated source data field 21, the updated update relationship 30, the updated update priority 40, the update time, etc. are recorded when the update operation of the fourth step is performed.
In a specific implementation, the method of the present invention may set the update configuration table 100, that is, the update relationship and the update level corresponding to the primary data dimension field and the source data field are configured in the update configuration table.
Claims (4)
1. A method for updating main data according to data rank, characterized by: comprises the following steps of (a) carrying out,
firstly, setting data in a data warehouse as a plurality of main data latitude units, wherein each main data latitude unit comprises a plurality of field information,
secondly, classifying the source data into a plurality of source data units, wherein each source data unit comprises a plurality of source data fields, establishing an updating relation between one source data field in one source data unit and one field information in one main data latitude unit to form a plurality of updating relations,
third, setting updating priority levels for a plurality of updating relations in the second step, wherein the updating relations correspond to the updating priority levels one by one, the updating priority levels are respectively provided with different updating levels,
fourthly, when any source data field in any source data unit is checked to be updated, firstly, reading the updating priority level of the updating relation corresponding to the source data field of the current time, wherein the updating relation points to field information of a main data latitude unit, simultaneously reading the updating priority level of the source data field in other source data units of the last time on the field information, comparing the updating priority level of the current time with the updating priority level of the last time, if the updating priority level of the current time is less than the updating priority level of the last time, abandoning the updating operation, if the updating priority level of the current time is more than the updating priority level of the last time, covering the source data field of the current time into the field information corresponding to the source data field of the current time to update the main data latitude unit,
in the fourth step, if the updating priority is equal to the updating priority of the last time, the updating time of the updating priority of the current time is compared with the updating time of the updating priority of the last time,
abandoning the updating operation when the updating time of the updating priority is later than the updating time of the updating priority last time,
and if the updating time of the current updating priority is earlier than the updating time of the last updating priority, covering the source data field into the field information corresponding to the source data field for updating the main data latitude unit.
2. A method of updating main data according to data hierarchy as claimed in claim 1, characterized by: in the second step, an update relationship is established between one source data field in one source data unit and the field information in a plurality of primary data latitude units at the same time.
3. A method of updating main data according to data hierarchy as claimed in claim 1, characterized by: and in the third step, the updating level of each updating priority level is set according to the updating time of the source data unit, the data source department level and other factors, and the more timely and accurate the updating of the source data unit is, the higher the updating priority level is set.
4. A method of updating main data according to data hierarchy as claimed in claim 1, characterized by: recording the field information of the updated main data latitude unit, the updated source data field, the updated update relationship, the updated update priority and the update time information when the update operation of the fourth step is performed.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710559044.1A CN107341253B (en) | 2017-07-11 | 2017-07-11 | Method for updating main data according to data grade |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710559044.1A CN107341253B (en) | 2017-07-11 | 2017-07-11 | Method for updating main data according to data grade |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107341253A CN107341253A (en) | 2017-11-10 |
| CN107341253B true CN107341253B (en) | 2020-07-07 |
Family
ID=60217934
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710559044.1A Active CN107341253B (en) | 2017-07-11 | 2017-07-11 | Method for updating main data according to data grade |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107341253B (en) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1889501A (en) * | 2006-07-25 | 2007-01-03 | 杭州华为三康技术有限公司 | Method and system for deciding bridge role |
| CN102289519A (en) * | 2011-09-14 | 2011-12-21 | 成都软智科技有限公司 | Application server and method for coordinating data of same and database |
| CN103530311A (en) * | 2012-07-05 | 2014-01-22 | 汤姆逊许可公司 | Method and apparatus for prioritizing metadata |
| CN103544323A (en) * | 2013-11-08 | 2014-01-29 | 中国农业银行股份有限公司 | Data updating method and device |
| CN106790549A (en) * | 2016-12-23 | 2017-05-31 | 北京奇虎科技有限公司 | A kind of data-updating method and device |
| US9779129B1 (en) * | 2013-09-11 | 2017-10-03 | Express Scripts, Inc. | Systems and methods for integrating data |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20170270210A1 (en) * | 2016-03-16 | 2017-09-21 | Sysomos L.P. | Data Infrastructure and Method for Ingesting and Updating A Continuously Evolving Social Network |
-
2017
- 2017-07-11 CN CN201710559044.1A patent/CN107341253B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1889501A (en) * | 2006-07-25 | 2007-01-03 | 杭州华为三康技术有限公司 | Method and system for deciding bridge role |
| CN102289519A (en) * | 2011-09-14 | 2011-12-21 | 成都软智科技有限公司 | Application server and method for coordinating data of same and database |
| CN103530311A (en) * | 2012-07-05 | 2014-01-22 | 汤姆逊许可公司 | Method and apparatus for prioritizing metadata |
| US9779129B1 (en) * | 2013-09-11 | 2017-10-03 | Express Scripts, Inc. | Systems and methods for integrating data |
| CN103544323A (en) * | 2013-11-08 | 2014-01-29 | 中国农业银行股份有限公司 | Data updating method and device |
| CN106790549A (en) * | 2016-12-23 | 2017-05-31 | 北京奇虎科技有限公司 | A kind of data-updating method and device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107341253A (en) | 2017-11-10 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2018077039A1 (en) | Community discovery method, apparatus, server, and computer storage medium | |
| CN110110244B (en) | Interest point recommendation method integrating multi-source information | |
| US9251173B2 (en) | Place-based image organization | |
| CN103810212A (en) | Automated database index creation method and system | |
| US20170091245A1 (en) | Index management | |
| CN106708891A (en) | Network management data synchronizing method and device | |
| CN111159428A (en) | Method and device for automatically extracting event relation of knowledge graph in economic field | |
| CN107015987B (en) | Method and equipment for updating and searching database | |
| US11853279B2 (en) | Data storage using vectors of vectors | |
| US9606997B2 (en) | Inferred operations for data analysis | |
| CN106649602A (en) | Way, device and server of processing business object data | |
| US9612941B1 (en) | Live data fabrication | |
| CN110019111A (en) | Data processing method, device, storage medium and processor | |
| CN116166849A (en) | Data management method, device, equipment and storage medium | |
| US20160132543A1 (en) | Automatically aggregating data in database tables | |
| JP6450865B2 (en) | Aggregate large amounts of time data from many overlapping sources | |
| US20190197630A1 (en) | Populating a new community for a social network | |
| CN107391533A (en) | Generate the method and device of graphic data base Query Result | |
| US9779118B2 (en) | Live database schema tree change | |
| CN107341253B (en) | Method for updating main data according to data grade | |
| US11138247B2 (en) | Systems and methods for a full text search engine implemented using object storage techniques | |
| AU2023201306A1 (en) | Systems and methods for a multi-hierarchy physical storage architecture for managing program and outcome data | |
| US9852166B2 (en) | Task handling in a multisystem environment | |
| US10558668B2 (en) | Result set output criteria | |
| US20190325395A1 (en) | Skill Analyzer |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CP01 | Change in the name or title of a patent holder |
Address after: 518000 zone a, 4th floor, building r1-a, 021 Gaoxin industrial village, South 4th Road, Gaoxin, Nanshan District, Shenzhen City, Guangdong Province Patentee after: Shenzhen Radio & TV Xinyi Technology Co.,Ltd. Address before: 518000 zone a, 4th floor, building r1-a, 021 Gaoxin industrial village, South 4th Road, Gaoxin, Nanshan District, Shenzhen City, Guangdong Province Patentee before: SHENZHEN XINYI TECHNOLOGY Co.,Ltd. |
|
| CP01 | Change in the name or title of a patent holder |