CN105868361A - Data updating method and device - Google Patents
Data updating method and device Download PDFInfo
- Publication number
- CN105868361A CN105868361A CN201610188807.1A CN201610188807A CN105868361A CN 105868361 A CN105868361 A CN 105868361A CN 201610188807 A CN201610188807 A CN 201610188807A CN 105868361 A CN105868361 A CN 105868361A
- Authority
- CN
- China
- Prior art keywords
- data
- monitoring project
- incremental
- current basic
- updated
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/21—Design, administration or maintenance of databases
- G06F16/219—Managing data history or versioning
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/21—Design, administration or maintenance of databases
- G06F16/215—Improving data quality; Data cleansing, e.g. de-duplication, removing invalid entries or correcting typographical errors
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q40/00—Finance; Insurance; Tax strategies; Processing of corporate or income taxes
- G06Q40/02—Banking, e.g. interest calculation or account maintenance
Abstract
The invention relates to a data updating method and device. The data updating method comprises the steps of receiving data sent by a source system to be updated, acquiring current baseline data which is obtained according to all newest data stored in the source system, and comparing data to be updated with the current baseline data according to pre-allocated monitoring items so that an incremental data set corresponding to the monitoring items can be acquired and outputting the incremental data set. According to the data updating method and device, invalid and redundant data can be effectively removed, acquired incremental data is effective data needed by a target system, and the data processing accuracy is guaranteed.
Description
Technical field
The present invention relates to technical field of data processing, particularly relate to a kind of data-updating method and device.
Background technology
In banking system, relate to substantial amounts of data and update with mutual.In prior art, when origin system
When data occur to update, can send, to purpose system, the data updated.Due to origin system self Functional Design
And the restriction of disposal ability, it is impossible to gather data for the processing of each purpose system customization.When origin system
When in Data source table, the arbitrary data item in certain data changes, origin system can using overall data as
Incremental data is sent to purpose system.But, purpose system is concerned only with part data item.So, in source
In the incremental data that system sends, exist for substantial amounts of redundant data.Due to origin system cannot for the purpose of be
System customization incremental data purely, result in the transmission of mass of redundancy data, wastes the data money of preciousness
Source.On the other hand, purpose system needs in mass data, filters out the data oneself needed and rejects
Redundant data, adds the processing load of purpose system, and is susceptible to mistake.
Summary of the invention
For solving above-mentioned technical problem, the invention discloses a kind of data-updating method and device, can obtain
Take incremental data purely, remove redundant data, improve the accuracy that data process.
Technical scheme is as follows:
First aspect according to embodiments of the present invention, discloses a kind of data-updating method, described method bag
Include:
Receive the data to be updated that origin system sends；
Obtain current basic line data；The up-to-date full dose that described current basic line data store according to described origin system
Data obtain；
According to the monitoring project being pre-configured with, relatively described data to be updated and described current basic line data,
Obtain the incremental data set corresponding with described monitoring project；
Export described incremental data set.
Further, described method also includes:
Utilize described incremental data set to update described current basic line data, generate up-to-date base-line data conduct
Current basic line data.
Further, the monitoring project that described basis is pre-configured with, relatively described data to be updated are with described
Current basic line data, it is thus achieved that the incremental data set corresponding with described monitoring project includes:
According to the monitoring project being pre-configured with, obtain in described data to be updated corresponding with described monitoring project
The first data；
According to the monitoring project being pre-configured with, obtain in described current basic line data with described monitoring project pair
The second data answered；
Relatively described first data and described second data, it is thus achieved that incremental data set.
Further, described method also includes:
According to the purpose system banner being pre-configured with and monitored item purpose corresponding relation, obtain and described purpose
The monitoring project that system banner is corresponding；Wherein, described origin system and one or more purpose systems have number
According to connection.
Further, described method also includes:
The up-to-date full dose data that described up-to-date base-line data and purpose system store are compared, it is thus achieved that
Delta data set；Described delta data set includes increasing data, minimizing data, key assignments is identical but counts
According to one or more in the data that item is different.
Second aspect according to embodiments of the present invention, discloses a kind of data update apparatus, described device bag
Include:
Receive unit, for receiving the data to be updated that origin system sends；
Base-line data acquiring unit, is used for obtaining current basic line data；Described current basic line data are according to institute
The up-to-date full dose data stating origin system storage obtain；
Comparing unit, for according to the monitoring project being pre-configured with, relatively described data to be updated are with described
Current basic line data, it is thus achieved that the incremental data set corresponding with described monitoring project；
Output unit, is used for exporting described incremental data set.
Further, described device also includes:
Base-line data updating block, is used for utilizing described incremental data set to update described current basic line data,
Generate up-to-date base-line data as current basic line data.
Further, described comparing unit includes:
First data capture unit, for according to the monitoring project being pre-configured with, obtaining described number to be updated
The first data corresponding with described monitoring project according to；
Second data capture unit, for according to the monitoring project being pre-configured with, obtaining described current basic line
The second data corresponding with described monitoring project in data；
Incremental data obtains unit, for relatively described first data and described second data, it is thus achieved that increment
Data acquisition system.
Further, described device also includes:
Monitoring project obtains unit, for according to the purpose system banner being pre-configured with and monitored item purpose pair
Should be related to, obtain the monitoring project corresponding with described purpose system banner；Wherein, described origin system and
Individual or multiple purpose systems have data cube computation.
Further, described device also includes:
Delta data obtains unit, for described up-to-date base-line data is up-to-date with what purpose system stored
Full dose data compare, it is thus achieved that delta data set；Described delta data set include increase data,
Reduce data, key assignments is identical but one or more in data that data item is different.
Having the beneficial effect that of one aspect of the embodiment of the present invention is receiving the to be updated of origin system transmission
After data, i.e. obtain current basic line data according to the full dose data of origin system storage；According to pre-set
Monitoring project, relatively data to be updated and current basic line data, to obtain incremental data set, and export
Incremental data.In embodiments of the present invention, owing to pre-setting monitoring project, and by data to be updated
Comparing with base-line data, can effectively reject invalid, redundant data, the incremental data of acquisition is equal
It is the valid data of purpose system needs, is effectively increased the accuracy that data process.
Accompanying drawing explanation
In order to be illustrated more clearly that the embodiment of the present invention or technical scheme of the prior art, below will be to reality
Execute the required accompanying drawing used in example or description of the prior art to be briefly described, it should be apparent that below,
Accompanying drawing in description is only some embodiments described in the present invention, for those of ordinary skill in the art
From the point of view of, on the premise of not paying creative work, it is also possible to obtain other accompanying drawing according to these accompanying drawings.
The data-updating method exemplary application scene schematic diagram that Fig. 1 provides for the embodiment of the present invention
The data-updating method schematic flow sheet that Fig. 2 provides for one embodiment of the invention；
The data-updating method schematic flow sheet that Fig. 3 provides for another embodiment of the present invention；
The data-updating method schematic flow sheet that Fig. 4 another embodiment of the present invention provides；
The data update apparatus schematic diagram that Fig. 5 provides for the embodiment of the present invention.
Detailed description of the invention
For solving above-mentioned technical problem, the invention discloses a kind of data-updating method and device, can obtain
Take incremental data purely, remove redundant data, improve efficiency and accuracy that data process.
First the thought of the present invention is illustrated.In the prior art, occur more when the data of origin system
Time new, can send, to purpose system, the data updated.Due to origin system self Functional Design and process energy
The restriction of power, it is impossible to gather data for the processing of each purpose system customization.When in the Data source table of origin system
When arbitrary data item in certain data changes, overall data can be sent out by origin system as incremental data
Give purpose system.But, purpose system is concerned only with part data item.So, send at origin system
In incremental data, exist for substantial amounts of redundant data.Due to origin system cannot for the purpose of system customization purely
Incremental data, result in the transmission of mass of redundancy data, waste preciousness data resource.The opposing party
Face, purpose system needs in mass data, filters out the data oneself needed and rejects redundant data,
Add the processing load of purpose system, reduce data-handling efficiency, and be susceptible to mistake.
Illustrating, in banking system, it is assumed that origin system is core system, purpose system is FARS
Foreign exchange account system.Described FARS foreign exchange account system from described core system receive 505 files (
Account increment is sent in report) carry out incremental update and report and submit.When RMB, foreign currency interest adjust, due to core
Feeling concerned about system is adjusting interest rate a large amount of data to be updated can be sent to the FARS foreign exchange account system next day.Due to
Overall data is sent to FARS foreign exchange account system as data to be updated by core system, here
There are the data not occurring data item to change in a large number, cause FARS foreign exchange account system to update in a large number not
The data on stock of data item change occurs, and data processing amount is big, and has processed substantial amounts of invalid data.By
In core system as the centring system of banking system, the increment day of a design data sheet level at the beginning of design
Phase, can only screen equal to the condition on date on the same day by the increment date when extracting incremental data, it is impossible to
Meet FARS Accounting system requirement and pass down the data service request of field level incremental data.Therefore, need badly
A kind of data-updating method, can remove redundant data, retains incremental data purely, improves data more
New efficiency and accuracy rate.
Inventor finds during realizing the present invention, in order to solve the problems referred to above, can have following solution
Certainly scheme: a kind of method is to be set up the change mark of each contingency table field level by origin system, and only field is sent out
The data more that change could as qualified incremental data under pass.A kind of method is by purpose system
The data on stock of data to be updated with purpose system is compared, discrepant is re-used as incremental data more
Newly in the data on stock of purpose system.But, first method needs origin system is carried out substantial amounts of changing
Make, the data processing performance of origin system will be badly influenced.In the second approach, it is by number to be updated
Compare according to the data on stock with purpose system, owing to the data on stock of purpose system is owing to increasing newly, repairing
Change, the operation such as deletion can change, at this moment through comparing the incremental data of acquisition, some data
The data that item is likely due to the operation of purpose system and changes, are not the renewal that sends of origin system
Data, if the data using origin system to send update described data item, it will cause corrupt data.
Based on this, inventor provide a kind of new method, can origin system and purpose data system it
Between set up an intermediate layer, using origin system store full dose data as data baseline, by this data baseline
The data to be updated sent with origin system compare, monitoring required for system for the purpose of the content compared
Project, thus obtain incremental data set purely.Described data baseline, just as in origin system and purpose
Establish a filter screen between system, thus filter out redundant data, it is thus achieved that purely, purpose system needs
The effective incremental data wanted, thus in the case of not changing origin system, improve the efficiency that data update
And accuracy rate.
For the technical scheme making those skilled in the art be more fully understood that in the present invention, below in conjunction with
Accompanying drawing in the embodiment of the present invention, clearly and completely retouches the technical scheme in the embodiment of the present invention
State, it is clear that described embodiment is only a part of embodiment of the present invention rather than whole enforcement
Example.Based on the embodiment in the present invention, those of ordinary skill in the art are not before making creative work
Put the every other embodiment obtained, all should belong to the scope of protection of the invention.
See Fig. 1, the data-updating method exemplary application scene schematic diagram provided for the embodiment of the present invention.
As it is shown in figure 1, origin system 100 and purpose system 200 data cube computation, in origin system 100 and purpose system
The data update apparatus 500 that the embodiment of the present invention provides is connected between system.Described origin system 100 is for mesh
System 200 send data to be updated, described data update apparatus 500 can receive described origin system 100
The data to be updated sent, and data are carried out filtration treatment acquisition incremental data set, and export to mesh
System 200.It should be noted that described data update apparatus 500 can exist as independent device,
Data cube computation is set up respectively with origin system 100, purpose system 200.At this moment, described data update apparatus is also
Can be connected with one or more purpose systems, thus filter to the distribution of the one or more purpose system
After the incremental data set corresponding with described purpose system.Certainly, described data update apparatus 500
Can also exist, such as one module or built-in unit etc. as a part for purpose system 200.This
This is not limited by invention.Certainly, it is only the adaptable scene of the present invention shown in Fig. 1, this
Invention is also applied to other scenes, is not defined at this.
It should be noted that in the embodiment of the present invention, the technical term " data on stock " related to is used for table
The full dose data stored in bright origin system or purpose system.Described full dose data can be referred to as again entirely
Portion's data.
Technical term " data to be updated " is for showing that origin system is to changing of sending of purpose system
Data, the whole piece data changed including arbitrary data item.
Technical term " incremental data " for show with the monitoring project of purpose system corresponding to, purely
, effective, the data that change.
Technical term " redundant data " is used for showing as data down transmission to be updated or transmission, but purpose
Monitoring project corresponding to system does not changes, unnecessary, invalid data.
Technical term " origin system " is for showing to send the system of data, and " purpose system " is for receiving data
System.Described " origin system " can be referred to as again up-stream system, foreground system, described purpose system
Down-stream system, rear wire system can be referred to as again.
Technical term " base-line data " is for showing what the full dose data stored according to described origin system obtained
Reference data, for as the basic data comparing, filtering, can be referred to as again reference data.
See Fig. 2, the data-updating method schematic flow sheet provided for one embodiment of the invention.
S201, receives the data to be updated that origin system sends.
When data item a certain in the tables of data of origin system 100 changes, origin system 100 will will be sent out
The whole piece data at the data item place of changing are sent to purpose system 200 as data to be updated.The present invention
The data update apparatus 500 that embodiment provides can receive the data to be updated that described origin system 100 sends.
S202, obtains current basic line data；Described current basic line data according to described origin system store complete
Amount data obtain.
Described data update apparatus 500 can disposably obtain described origin system 100 from origin system 100 and deposit
The full dose data of storage, and obtain current base-line data based on described full dose data.Current base-line data
It is corresponding with the up-to-date full dose data of origin system storage.
Wherein, S201 and S202 there is no inevitable sequencing, can perform concurrently or reversedly.
S203, according to the monitoring project being pre-configured with, relatively described data to be updated and described current basic line
Data, it is thus achieved that the incremental data set corresponding with described monitoring project.
In embodiments of the present invention, each purpose system all has unique system banner.Can be according to purpose
The configuration of system, the monitoring project required for configuration purpose system.Described monitoring project can include waiting to supervise
The title of tables of data of control, the title of data item, the title of data field, one in data type or
Person is multiple.Owing to pre-setting the monitoring project corresponding with purpose system, purpose system therefore can be obtained
More new data required for system, thus eliminate bulk redundancy, invalid data.
When implementing, if described updating device 500 is connected with multiple purpose system datas, then can root
According to the purpose system banner being pre-configured with and monitored item purpose corresponding relation, obtain and described purpose system mark
Know corresponding monitoring project.
Obtaining after monitoring project, i.e. can according to described monitoring project obtain in described data to be updated with
The first data that described monitoring project is corresponding；According to the monitoring project being pre-configured with, obtain described current base
The second data corresponding with described monitoring project in line data；Relatively described first data and described second number
According to, it is thus achieved that incremental data set.
S204, exports described incremental data set.
Data update apparatus 500 can provide user interface, exports described incremental data on a user interface
Set.Described incremental data set can also be exported, described incremental data set is sent to the mesh of correspondence
System.
In some embodiments, after obtaining incremental data set, it is also possible to utilize described incremental data
Collection updates described current basic line data, generates up-to-date base-line data as current basic line data.With increasing
When amount data acquisition system updates described current basic line data, can be merely with the data item changed or word
Current basic line data described in Duan Gengxin.The whole of the data item changed or field place can also be used
Data updates described current basic line data.
In embodiments of the present invention, data update apparatus 500 is utilized to build between origin system and purpose system
Found a filter screen, thus filtered out redundant data, it is thus achieved that pure, purpose system needs effective increasing
Amount data, thus in the case of not changing origin system, improve efficiency and accuracy rate that data update.
See Fig. 3, the data-updating method schematic flow sheet provided for another embodiment of the present invention.
S301, for the purpose of system configuration monitoring project, set up purpose system banner corresponding with monitored item purpose
Relation.
Monitoring project according to the configuration of purpose system, required for configuration purpose system.Described monitoring project
The title of tables of data to be monitored, the title of data item, the title of data field, data class can be included
One or more in type.When purpose system has multiple, be respectively each purpose system configuration with
The monitoring project of its correspondence, sets up purpose system banner and monitored item purpose corresponding relation.
S302, sets up data baseline.
The current up-to-date full dose data of described origin system storage are disposably obtained from origin system, and based on described
Current up-to-date full dose data obtain base-line data.
S303, receives the data to be updated that origin system sends.
S304, according to the monitoring project corresponding with purpose system, by described data to be updated and described data
Baseline compares, it is thus achieved that incremental data set.
S305, exports described incremental data set.
Send described incremental data set to purpose system, purpose system described incremental data is carried out
Reason.The process to incremental data set of the purpose system, does not affect described data update apparatus and origin system
Flow chart of data processing.
S306, generates new data baseline.
Utilize described incremental data set to update described current basic line data, generate up-to-date base-line data conduct
Current basic line data, use for comparison next time.
S307, it is thus achieved that delta data set.
In order to obtain the difference of origin system and the data on stock of purpose system, make for verification of data, processing
With, the up-to-date full dose data that described up-to-date base-line data and purpose system store can be compared,
Obtain delta data set.Described delta data set includes that increase data, minimizing data, key assignments are identical
But one or more in the data that data item is different.Concrete, up-to-date base-line data is deducted purpose
The data on stock of system, it is thus achieved that increase data acquisition system.The data on stock of purpose system is deducted up-to-date base
Line data, it is thus achieved that reduce data acquisition system.Further, it is also possible to obtain base-line data and the storage of purpose system
In up-to-date full dose data, key assignments is identical but data that data item is different.These delta data set, Ke Yiwei
Purpose operation system improves the quality of data provides help.
It should be noted that in the embodiment shown in fig. 3, priority the most inevitable between each step
Execution sequence, some step can concurrently or reversed order ground perform.
See Fig. 4, the data-updating method schematic diagram that another embodiment of the present invention provides.In the diagram, for
One concrete example schematic.First data U to be updated are obtained, then by data U to be updated and baseline
Data A1 compare, it is thus achieved that incremental data set U1.It is then possible to utilize incremental data set U1,
Update base-line data A1, generate new base-line data A2.After described incremental data set U1 may be used for
Line data process.When comparison data on stock, can be by the data on stock of base-line data A2 Yu purpose system
F2 compares, it is thus achieved that variance data, including set X, set Y, set Z.Wherein, X=A2-F2；
Y=F2-A2；Z is the record that in A2 and F2, key assignments is identical, data item is different.
In embodiments of the present invention, between origin system and purpose system, construct an intermediate data layer,
For filtering the redundant data in origin system data to be updated, and it is iterated updating, to origin system increment
Data can play effective filtration.Furthermore, it is possible to origin system and purpose system data on stock with
Time compare, for improve the quality of data provide basis.The method that the embodiment of the present invention provides, it is not necessary to source
System is significantly transformed, and reduces the requirement to origin system.Additionally, in the embodiment of the present invention,
Purpose system does not affect the filtration of the present invention, update method to use, the maintenance of data on stock.Further
Ground, the present invention may be provided for the comparison of origin system and purpose system data, improves data matter for follow-up
Amount provides basis.
See Fig. 5, the data update apparatus schematic diagram provided for the embodiment of the present invention.
A kind of data update apparatus 500, described device includes:
Receive unit 501, for receiving the data to be updated that origin system sends；
Base-line data acquiring unit 502, is used for obtaining current basic line data；Described current basic line data according to
The up-to-date full dose data of described origin system storage obtain；
Comparing unit 503, for according to the monitoring project being pre-configured with, compares described data to be updated and institute
State current basic line data, it is thus achieved that the incremental data set corresponding with described monitoring project；
Output unit 504, is used for exporting described incremental data set.
Further, described device also includes:
Base-line data updating block, is used for utilizing described incremental data set to update described current basic line data,
Generate up-to-date base-line data as current basic line data.
Further, described comparing unit includes:
First data capture unit, for according to the monitoring project being pre-configured with, obtaining described number to be updated
The first data corresponding with described monitoring project according to；
Second data capture unit, for according to the monitoring project being pre-configured with, obtaining described current basic line
The second data corresponding with described monitoring project in data；
Incremental data obtains unit, for relatively described first data and described second data, it is thus achieved that increment
Data acquisition system.
Further, described device also includes:
Monitoring project obtains unit, for according to the purpose system banner being pre-configured with and monitored item purpose pair
Should be related to, obtain the monitoring project corresponding with described purpose system banner；Wherein, described origin system and
Individual or multiple purpose systems have data cube computation.
Further, described device also includes:
Delta data obtains unit, for described up-to-date base-line data is up-to-date with what purpose system stored
Full dose data compare, it is thus achieved that delta data set；Described delta data set include increase data,
Reduce data, key assignments is identical but one or more in data that data item is different.
Wherein, the setting of apparatus of the present invention each unit or module is referred to the method shown in Fig. 1 to Fig. 4
And realize, it is not repeated herein.
It should be noted that in this article, the relational terms of such as first and second or the like is used merely to
One entity or operation are separated with another entity or operating space, and not necessarily requires or imply
Relation or the order of any this reality is there is between these entities or operation.And, term " includes ",
" comprise " or its any other variant is intended to comprising of nonexcludability, so that include a series of wanting
Process, method, article or the equipment of element not only include those key elements, but also include the most clearly arranging
Other key elements gone out, or also include want intrinsic for this process, method, article or equipment
Element.In the case of there is no more restriction, statement " including ... " key element limited, it is not excluded that
Other identical element is there is also in including the process of described key element, method, article or equipment.
The present invention can described in the general context of computer executable instructions,
Such as program module.Usually, program module includes performing particular task or realizing specific abstract data class
The routine of type, program, object, assembly, data structure etc..Can also be in a distributed computing environment
Put into practice the present invention, in these DCEs, by by communication network connected remotely
Reason equipment performs task.In a distributed computing environment, program module may be located at and includes storage device
In interior local and remote computer-readable storage medium.
Each embodiment in this specification all uses the mode gone forward one by one to describe, identical between each embodiment
Similar part sees mutually, and what each embodiment stressed is different from other embodiments
Part.For device embodiment, owing to it is substantially similar to embodiment of the method, so retouching
Stating fairly simple, relevant part sees the part of embodiment of the method and illustrates.Dress described above
Putting embodiment is only schematically, and the wherein said module that illustrates as separating component can be or also
Can not be physically separate, the parts shown as module can be or may not be physics mould
Block, i.e. may be located at a place, or can also be distributed on multiple mixed-media network modules mixed-media.Can be according to reality
The needing of border selects some or all of module therein to realize the purpose of the present embodiment scheme.This area
Those of ordinary skill, in the case of not paying creative work, is i.e. appreciated that and implements.
The above is only the detailed description of the invention of the present invention, it is noted that general for the art
For logical technical staff, under the premise without departing from the principles of the invention, it is also possible to make some improvement and profit
Decorations, these improvements and modifications also should be regarded as protection scope of the present invention.
Claims (10)
1. a data-updating method, it is characterised in that described method includes:
Receive the data to be updated that origin system sends；
Obtain current basic line data；The full dose data that described current basic line data store according to described origin system
Obtain；
According to the monitoring project being pre-configured with, relatively described data to be updated and described current basic line data,
Obtain the incremental data set corresponding with described monitoring project；
Export described incremental data set.
Method the most according to claim 1, it is characterised in that described method also includes:
Utilize described incremental data set to update described current basic line data, generate up-to-date base-line data conduct
Current basic line data.
Method the most according to claim 1, it is characterised in that the monitoring that described basis is pre-configured with
Project, relatively described data to be updated and described current basic line data, it is thus achieved that corresponding with described monitoring project
Incremental data set include:
According to the monitoring project being pre-configured with, obtain in described data to be updated corresponding with described monitoring project
The first data；
According to the monitoring project being pre-configured with, obtain in described current basic line data with described monitoring project pair
The second data answered；
Relatively described first data and described second data, it is thus achieved that incremental data set.
Method the most according to claim 1, it is characterised in that described method also includes:
According to the purpose system banner being pre-configured with and monitored item purpose corresponding relation, obtain and described purpose
The monitoring project that system banner is corresponding；Wherein, described origin system and one or more purpose systems have number
According to connection.
Method the most according to claim 2, it is characterised in that described method also includes:
The up-to-date full dose data that described up-to-date base-line data and purpose system store are compared, it is thus achieved that
Delta data set；Described delta data set includes increasing data, minimizing data, key assignments is identical but counts
According to one or more in the data that item is different.
6. a data update apparatus, it is characterised in that described device includes:
Receive unit, for receiving the data to be updated that origin system sends；
Base-line data acquiring unit, is used for obtaining current basic line data；Described current basic line data are according to institute
The up-to-date full dose data stating origin system storage obtain；
Comparing unit, for according to the monitoring project being pre-configured with, relatively described data to be updated are with described
Current basic line data, it is thus achieved that the incremental data set corresponding with described monitoring project；
Output unit, is used for exporting described incremental data set.
Device the most according to claim 6, it is characterised in that described device also includes:
Base-line data updating block, is used for utilizing described incremental data set to update described current basic line data,
Generate up-to-date base-line data as current basic line data.
Device the most according to claim 6, it is characterised in that described comparing unit includes:
First data capture unit, for according to the monitoring project being pre-configured with, obtaining described number to be updated
The first data corresponding with described monitoring project according to；
Second data capture unit, for according to the monitoring project being pre-configured with, obtaining described current basic line
The second data corresponding with described monitoring project in data；
Incremental data obtains unit, for relatively described first data and described second data, it is thus achieved that increment
Data acquisition system.
Device the most according to claim 6, it is characterised in that described device also includes:
Monitoring project obtains unit, for according to the purpose system banner being pre-configured with and monitored item purpose pair
Should be related to, obtain the monitoring project corresponding with described purpose system banner；Wherein, described origin system and
Individual or multiple purpose systems have data cube computation.
Device the most according to claim 7, it is characterised in that described device also includes:
Delta data obtains unit, for described up-to-date base-line data is up-to-date with what purpose system stored
Full dose data compare, it is thus achieved that delta data set；Described delta data set include increase data,
Reduce data, key assignments is identical but one or more in data that data item is different.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610188807.1A CN105868361A (en) | 2016-03-29 | 2016-03-29 | Data updating method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610188807.1A CN105868361A (en) | 2016-03-29 | 2016-03-29 | Data updating method and device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN105868361A true CN105868361A (en) | 2016-08-17 |
Family
ID=56626736
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610188807.1A Pending CN105868361A (en) | 2016-03-29 | 2016-03-29 | Data updating method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105868361A (en) |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107329998A (en) * | 2017-06-09 | 2017-11-07 | 广州虎牙信息科技有限公司 | User's increment class data capture method, device and equipment |
| CN108089879A (en) * | 2016-11-21 | 2018-05-29 | 广州市动景计算机科技有限公司 | Increment updating method, equipment and programmable device |
| CN108268497A (en) * | 2016-12-30 | 2018-07-10 | 北京国双科技有限公司 | The method of data synchronization and device of relevant database |
| CN108959009A (en) * | 2018-07-26 | 2018-12-07 | 郑州云海信息技术有限公司 | A kind of server failure analysis method and its fail analysis device |
| CN110046982A (en) * | 2018-11-28 | 2019-07-23 | 阿里巴巴集团控股有限公司 | A kind of interest-bearing data processing method and device |
| CN110147380A (en) * | 2019-05-23 | 2019-08-20 | 腾讯科技(成都)有限公司 | Data-updating method, device, server and storage medium |
| CN112580094A (en) * | 2020-12-14 | 2021-03-30 | 京东数字科技控股股份有限公司 | Data processing method, electronic device, and storage medium |
| CN113177053A (en) * | 2021-05-21 | 2021-07-27 | 滨州职业学院 | Computer data updating method and related device |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101808133A (en) * | 2010-03-16 | 2010-08-18 | 青岛海信移动通信技术股份有限公司 | Method and terminal for synchronizing dynamic content distribution business data |
| CN102607577A (en) * | 2011-01-25 | 2012-07-25 | 北京四维图新科技股份有限公司 | Method, device and system for updating increment of navigation electronic map |
| CN103595807A (en) * | 2013-11-20 | 2014-02-19 | 中国银行股份有限公司 | Data synchronous updating method and device |
| CN103645905A (en) * | 2013-12-20 | 2014-03-19 | 北京中电普华信息技术有限公司 | Incremental data acquisition method and device |
| CN103699580A (en) * | 2013-12-03 | 2014-04-02 | 中铁程科技有限责任公司 | Database synchronization method and database synchronization device |
| US20150074061A1 (en) * | 2013-09-09 | 2015-03-12 | Lsis Co., Ltd. | Data management apparatus and method of energy management system |
-
2016
- 2016-03-29 CN CN201610188807.1A patent/CN105868361A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101808133A (en) * | 2010-03-16 | 2010-08-18 | 青岛海信移动通信技术股份有限公司 | Method and terminal for synchronizing dynamic content distribution business data |
| CN102607577A (en) * | 2011-01-25 | 2012-07-25 | 北京四维图新科技股份有限公司 | Method, device and system for updating increment of navigation electronic map |
| US20150074061A1 (en) * | 2013-09-09 | 2015-03-12 | Lsis Co., Ltd. | Data management apparatus and method of energy management system |
| CN103595807A (en) * | 2013-11-20 | 2014-02-19 | 中国银行股份有限公司 | Data synchronous updating method and device |
| CN103699580A (en) * | 2013-12-03 | 2014-04-02 | 中铁程科技有限责任公司 | Database synchronization method and database synchronization device |
| CN103645905A (en) * | 2013-12-20 | 2014-03-19 | 北京中电普华信息技术有限公司 | Incremental data acquisition method and device |
Cited By (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108089879A (en) * | 2016-11-21 | 2018-05-29 | 广州市动景计算机科技有限公司 | Increment updating method, equipment and programmable device |
| CN108089879B (en) * | 2016-11-21 | 2021-11-26 | 阿里巴巴（中国）有限公司 | Incremental updating method, equipment and programmable equipment |
| CN108268497A (en) * | 2016-12-30 | 2018-07-10 | 北京国双科技有限公司 | The method of data synchronization and device of relevant database |
| CN107329998A (en) * | 2017-06-09 | 2017-11-07 | 广州虎牙信息科技有限公司 | User's increment class data capture method, device and equipment |
| CN108959009A (en) * | 2018-07-26 | 2018-12-07 | 郑州云海信息技术有限公司 | A kind of server failure analysis method and its fail analysis device |
| CN110046982A (en) * | 2018-11-28 | 2019-07-23 | 阿里巴巴集团控股有限公司 | A kind of interest-bearing data processing method and device |
| CN110046982B (en) * | 2018-11-28 | 2023-11-07 | 创新先进技术有限公司 | Method and device for processing information data |
| CN110147380A (en) * | 2019-05-23 | 2019-08-20 | 腾讯科技(成都)有限公司 | Data-updating method, device, server and storage medium |
| CN110147380B (en) * | 2019-05-23 | 2023-11-24 | 腾讯科技(成都)有限公司 | Data updating method, device, server and storage medium |
| CN112580094A (en) * | 2020-12-14 | 2021-03-30 | 京东数字科技控股股份有限公司 | Data processing method, electronic device, and storage medium |
| CN113177053A (en) * | 2021-05-21 | 2021-07-27 | 滨州职业学院 | Computer data updating method and related device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105868361A (en) | Data updating method and device | |
| DE112011103378B4 (en) | Automatic and self-adapting data backup operations | |
| CN103678042B (en) | A kind of backup policy information generating method based on data analysis | |
| CN102722379B (en) | Software recommendation method and system | |
| CN101082970A (en) | Method for realizing government affairs examination and approval workflow engines system | |
| CN105528275B (en) | Database security inspection method | |
| CN103246549B (en) | A kind of method and system of data conversion storage | |
| DE112020003351T5 (en) | Automatically detect ransomware with on-demand file system locking and an automatic repair feature | |
| CN105677802A (en) | Internet information analysis system | |
| CN113141410A (en) | Dynamically adjusted QPS control method, system, device and storage medium | |
| CN111367951A (en) | Method and device for processing stream data | |
| CN106789193A (en) | A kind of cluster ballot referee method and system | |
| CN104199955A (en) | Information management system and information management method | |
| CN106022976A (en) | Demand side oriented power consumer classification method and system | |
| CN110472854A (en) | A kind of marketing management system and method towards multi-product by all kinds of means | |
| CN101960435A (en) | Method and apparatus for performing a host enumeration process | |
| CN106302473B (en) | A kind of the duplication maintaining method and system of SQL Server database | |
| CN105045541A (en) | Increment snapshot method and apparatus | |
| CN106656522A (en) | Data calculation method and system of cross-data center | |
| CN104778253B (en) | A kind of method and apparatus that data are provided | |
| CN103970854B (en) | Method for synchronizing incremental certificate information between SAP ECC end and SAP BW end | |
| CN104009970A (en) | Network information acquisition method | |
| CN105959172B (en) | A kind of the redundant network management method and platform of group system | |
| CN112350843A (en) | Scene type cutting and connecting method and system based on virtual component | |
| CN104636345A (en) | Database reading and writing method based on distributed cache |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20160817 |