CN107357791A - A kind of data sharing method and device - Google Patents
A kind of data sharing method and device Download PDFInfo
- Publication number
- CN107357791A CN107357791A CN201610305168.2A CN201610305168A CN107357791A CN 107357791 A CN107357791 A CN 107357791A CN 201610305168 A CN201610305168 A CN 201610305168A CN 107357791 A CN107357791 A CN 107357791A
- Authority
- CN
- China
- Prior art keywords
- data
- application system
- normal
- incremental
- application
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/445—Program loading or initiating
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/17—Details of further file system functions
- G06F16/176—Support for shared access to files; File sharing support
Abstract
The invention provides a kind of data sharing method and device, this method includes：Obtain the incremental data of the adjacent Backup Data twice of the first application system；Data processing is carried out to incremental data, obtains the normal data of preset format；Normal data is sent into the second application system associated with the first application system.The present invention realizes the data docking between distributed each application system, information between each system is really integrated into the information interaction between carry out system, ensure the accuracy of data interaction, solves the problems, such as data syn-chronization under distributed environment, the change of original system is preferably minimized, so as to Rapid Implementation and is brought benefits.
Description
Technical field
The present invention relates to database field, more particularly to a kind of data sharing method and device.
Background technology
During IT application in enterprise, due to lacking unified planning in first stage of construction, application system is big
It is to carry out development and implementation from the angle of department, basic unit mostly, lacks the consideration of the overall situation so that each portion developed
There is no unified data standard between the application system of door, data format is different, can not be real between system
Now effective data sharing；Same type of data are present in multiple systems, and number can not be realized between system
According to synchronization；In the unitized process of data is realized, no matter these information islands are using upper or tieing up
Certain workload can all be increased in shield, cause the unnecessary wasting of resources, therefore realized between each system
Automaticdata it is synchronous, the information between each system is really integrated into the information interaction between carry out system
And the uniformity of data is kept, will be that an emphasis of IT application in enterprise will solve the problems, such as.
A kind of traditional way for keeping data syn-chronization is Enterprise information integration (Enterprise Application
Integration, EAI) implementation, this implementation need each system to the system that interacts all
Corresponding data-interface is provided, development amount is larger；And each application and development manufacturer needs each self-coordinating
The discussion work of interface specification, interface dependence is higher, and performance period is uncontrollable.Therefore how to solve to be distributed
Under formula environment the problem of data syn-chronization, turn into urgent need to resolve during cloud computation data center data syn-chronization
Problem.
The content of the invention
The invention provides a kind of data sharing method and device, its purpose is to solve under distributed environment
The problem of data syn-chronization.
In order to achieve the above object, the embodiment provides a kind of data sharing method, including：
Obtain the incremental data of the adjacent Backup Data twice of the first application system；
Data processing is carried out to incremental data, obtains the normal data of preset format；
Normal data is sent into the second application system associated with the first application system.
Preferably, the step of incremental data for obtaining the adjacent Backup Data twice of the first application system, includes：
In the adjacent Backup Data twice for obtaining the first application system, the data and the data of preceding backup that back up afterwards
Compare, newly-increased data and/or the data to change.
Preferably, in the adjacent Backup Data twice for obtaining the first application system, the data that back up afterwards with it is preceding standby
Part data compare, newly-increased data and/or change data the step of include：
The source data in the first application system is copied into default first according to the timing of the first predetermined period should
With in the Materialized View of system, and update the materialized view log of Materialized View；
According to materialized view log, in the adjacent Backup Data twice for obtaining the first application system, back up afterwards
Data are compared with the data of preceding backup, newly-increased data and/or the data to change；
The increment list of the first application system is established, incremental data is stored in increment list.
Preferably, the step of carrying out data processing to incremental data, obtaining the normal data of preset format includes：
Data Format Transform is carried out to the incremental data in increment list, obtains the normal data of preset format；
Normal data is stored in theme storehouse, and the time of Data Format Transform is recorded in Materialized View day
In will.
Preferably, normal data is stored in after the step in theme storehouse, this method also includes：
The incremental data corresponding with normal data is stored in theme storehouse.
Preferably, normal data is sent to the step in the second application system associated with the first application system
Including：
Target query object in the session number in the data inquiry request of the second application system received
For the first application system when, normal data is sent to second associated with the first application system by session number
In application system；Or
The session number of data synchronization request is generated according to the timing of the first predetermined period, according to the default first application
The corresponding relation of system and the second application system, normal data is sent to associated with the first application system
In two application systems；Wherein, the object synchronization object in the session number of data synchronization request is and the first application
The second application system that system is associated by session number.
Preferably, normal data is sent to the step in the second application system associated with the first application system
Afterwards, this method also includes：
Remove increment list.
To achieve these goals, embodiments of the invention additionally provide a kind of data sharing device, including：
Acquisition module, the incremental data of the adjacent Backup Data twice for obtaining the first application system；
Processing module, for carrying out data processing to incremental data, obtain the normal data of preset format；
Sending module, for normal data to be sent into the second application system associated with the first application system.
Preferably, acquisition module includes：
Acquisition submodule, in the adjacent Backup Data twice for obtaining the first application system, the number that backs up afterwards
According to compared with the data of preceding backup, newly-increased data and/or the data to change.
Preferably, acquisition submodule includes：
Copied cells, for copying to the source data in the first application system according to the timing of the first predetermined period
In the Materialized View of default first application system, and update the materialized view log of Materialized View；
Acquiring unit, for according to materialized view log, obtaining the adjacent of the first application system and backing up number twice
In, the data backed up afterwards are compared with the data of preceding backup, newly-increased data and/or the data to change；
Memory cell, for establishing the increment list of the first application system, incremental data is stored in increment list.
Preferably, processing module includes：
Transform subblock, for carrying out Data Format Transform to the incremental data in increment list, obtain default lattice
The normal data of formula；
Record sub module, for normal data to be stored in theme storehouse, and by the time of Data Format Transform
It is recorded in materialized view log.
Preferably, processing module also includes：
Sub-module stored, for the incremental data corresponding with normal data to be stored in theme storehouse.
Preferably, sending module includes：
First sending submodule, for when the session in the data inquiry request of the second application system received
When target query object in number is the first application system, normal data is sent to the first application system and led to
Cross in the second application system of session number association；Or
Second sending submodule, for generating the session number of data synchronization request according to the timing of the first predetermined period,
According to the corresponding relation of default first application system and the second application system, normal data is sent to
In second application system of one application system association；Wherein, the target in the session number of data synchronization request is same
It is to pass through associated the second application system of session number with the first application system to walk object.
Preferably, the device also includes：
Module is removed, for sending normal data to second associated with the first application system in sending module
After in application system,
Remove increment list.
The such scheme of the present invention comprises at least following beneficial effect：
Data sharing method and device provided by the invention, by obtaining incremental data and being established for incremental data
Increment list, the change of the first application system data reflect in increment list first；Data are carried out to incremental data
Form is changed, and the normal data of unified form is formed, to overcome the format differences problem between different application systems；
Theme storehouse is established for normal data, and is issued to the second associated application system, improves the reality of data sharing
Shi Xing；The present invention realizes the data docking between distributed each application system, by between each system
Information really integrates the information interaction between carry out system, ensures the accuracy of data interaction；Work as basis
When business demand needs to provide data support service for new application system, it need to only obtain in the embodiment of the present invention
Normal data.The present invention solves the problems, such as data syn-chronization under distributed environment, makes original system
Change can be preferably minimized, and so as to Rapid Implementation and be brought benefits.
Brief description of the drawings
Fig. 1 represents the basic step flow chart for the data sharing method that the first embodiment of the present invention provides；
Fig. 2 represents one of schematic diagram of a scenario of the second embodiment of the present invention；
Fig. 3 represents the two of the schematic diagram of a scenario of the second embodiment of the present invention；
Fig. 4 represents the structural representation at the shared data center that the second embodiment of the present invention provides；
Fig. 5 represents the application system of the second embodiment of the present invention or the base at user's accessing shared data center
This flow chart of steps；
Fig. 6 represents the structural representation for the data sharing device that the third embodiment of the present invention provides.
Embodiment
To make the technical problem to be solved in the present invention, technical scheme and advantage clearer, below in conjunction with attached
Figure and specific embodiment are described in detail.
The present invention is directed to the problem of existing, there is provided a kind of data sharing method and device.
First embodiment
Referring to Fig. 1, the first embodiment of the present invention provides a kind of data sharing method, including：
Step 101, the incremental data of the adjacent Backup Data twice of the first application system is obtained.
Wherein, incremental data includes newly-increased data and/or the data to change.Realize that data sharing needs
The data of each application system are managed collectively, in order to reduce data redundancy, only need to obtain the first application
Incremental data in the adjacent Backup Data twice of system.
Step 102, data processing is carried out to incremental data, obtains the normal data of preset format.
Wherein, normal data is the unified model established for data warehouse, passes through built-in function, self-defined pin
The mode such as this realizes the conversion by data from business model to analysis model, and obtained final result is external
The data for meeting specification provided；Due to there is no unified data standard between distributed each application system,
Data format is different, and effective data sharing can not be realized between system, for the ease of being managed collectively,
The data of each application system are subjected to data processing, are converted into the data of unified form.
Step 103, normal data is sent into the second application system associated with the first application system.
Wherein, normal data corresponding with the incremental data of the first application system is sent to the first application and is
In the second application system of association of uniting, docked with realizing with the data between distributed each application system,
Information between each system is really integrated into the information interaction between carry out system, ensures data interaction
Accuracy；When needing to provide data support service for new application system according to business demand, only need to obtain
Normal data in the embodiment of the present invention.
Specifically, step 101 includes：
In the adjacent Backup Data twice for obtaining the first application system, the data and the data of preceding backup that back up afterwards
Compare, newly-increased data and/or the data to change.
, wherein it is desired to what is obtained be after the data that back up compared with the data of preceding backup, newly-increased data and/
Or the data to change, i.e. incremental data；And needed in delta data synchronous to associated application system
When change after obtained data, i.e., after the data that back up.
Preferably, in the adjacent Backup Data twice for obtaining the first application system, the data that back up afterwards with it is preceding standby
Part data compare, newly-increased data and/or change data the step of include：
The first step, regularly the source data in the first application system is copied to according to the first predetermined period default
In the Materialized View of first application system, and update the materialized view log of Materialized View.
Wherein, Materialized View is the local replica of teledata, should by first according to the timing of the first predetermined period
Copied to the source data in system in default Materialized View, and the time of each copy source data is recorded
Into materialized view log, it is easy to be managed collectively distributed application system and data query.
Second step, according to materialized view log, in the adjacent Backup Data twice for obtaining the first application system,
The data backed up afterwards are compared with the data of preceding backup, newly-increased data and/or the data to change.
Wherein, during incremental data is obtained, by inquiring about each copy source in materialized view log
The time of data is recorded, and obtains the incremental data in adjacent Backup Data twice.
3rd step, the increment list of the first application system is established, incremental data is stored in increment list.
Wherein, increment list is established for the first application system, for interim storage incremental data.
Specifically, step 102 includes：
The first step, Data Format Transform is carried out to the incremental data in increment list, obtains the standard of preset format
Data.
Wherein, Data Format Transform is carried out to the incremental data in increment list to obtain the criterion numeral of unified form
According to.
Second step, normal data is stored in theme storehouse, and the time of Data Format Transform is recorded in thing
Change in view daily record.
Wherein, normal data is stored in theme storehouse in order to the increment to distributed each application system
Normal data corresponding to data carries out unified storage and management and safeguarded.What is preserved in theme storehouse is unified form
Normal data, for issuing normal data to be synchronized to other application system, by theme storehouse realize with
Data docking between distributed each application system, ensure the accuracy of data interaction.
Further, include after step normal data being stored in theme storehouse in above-mentioned second step：
The incremental data corresponding with normal data is stored in theme storehouse.
Wherein, incremental data is stored in theme storehouse, it is necessary to illustrate, incremental data and normal data
Need corresponding storage；Incremental data, equivalent to the counterfoil of interaction data, is easy to inquire about and managed with normal data
Reason, ensure accuracy and uniqueness of the data between each system.
Preferably, step 103 includes：
Target query object in the session number in the data inquiry request of the second application system received
For the first application system when, normal data is sent to second associated with the first application system by session number
In application system；
Wherein, when the data inquiry request of the second application system received, can be taken in data inquiry request
Band session number, includes target query object in session number, when the target query object of the second application system is the
During one application system, normal data is sent to the second application system.
Or
The session number of data synchronization request is generated according to the timing of the first predetermined period, according to the default first application
The corresponding relation of system and the second application system, normal data is sent to associated with the first application system
In two application systems；Wherein, the object synchronization object in the session number of data synchronization request is and the first application
The second application system that system is associated by session number.
Wherein, data synchronization request is periodically generated, and according to the corresponding relation between the application system pre-set
Using the second application system as the object synchronization object in the session number of data synchronization request and by normal data
Send to the second application system.
It should be noted that, it is necessary to be according to the second application before the second application system of normal data transmission
The data format of system carries out Data Format Transform to normal data.
Preferably, after step 103, this method also includes：
Remove increment list.
Wherein, after the completion of data syn-chronization, incremental data is invalid, removes be convenient to clean internal memory in time.
In the above embodiment of the present invention, by obtaining incremental data and establishing increment list for incremental data, the
The change of one application system data reflects in increment list first；Data Format Transform is carried out to incremental data,
The normal data of unified form is formed, to overcome the format differences problem between different application systems；For criterion numeral
According to establishing theme storehouse, and the second associated application system is issued to, improves the real-time of data sharing；This
Invention realizes the data docking between distributed each application system, and the information between each system is real
The information interaction between carry out system is integrated, ensures the accuracy of data interaction；When according to business demand
When needing to provide data support service for new application system, the criterion numeral in the embodiment of the present invention need to be only obtained
According to.The present invention solves the problems, such as data syn-chronization under distributed environment, makes the change of original system can be with
It is preferably minimized, so as to Rapid Implementation and brings benefits.
Second embodiment
Referring to Fig. 2, second embodiment provides a shared data for being based on ESB (ESB)
The specific embodiment at center.Wherein, shared data center include Web service layer, ESB,
Service layer, display layer, logical layer, persistent layer and shared data bank；
Wherein, Web service layer provides for other application system and accesses data, services, including in shared data
The certain operations of heart data syn-chronization；Presentation layer then completes the management to shared data center, and this includes metadata
Management, the function of system regular maintenance etc..
Two-part data, the counterfoil of interaction data and the member at shared data center are included in shared data bank
Data.Interaction data counterfoil is mainly the accuracy and uniqueness for ensureing data between each system, and data
It is then the definition and management to shared data center model, it ensure that the normal operation at shared data center,
For security reasons, shared data center is not provided to functions such as the query modifications of data, avoids causing
Data exception, each system is caused to go wrong.
Referring to Fig. 3, the most important function in shared data center is exactly to realize data sharing, i.e. the synchronization of data
And exchange.Shared data center is by the data duplication of application system to data exchange zone, in the number to exchange area
According to being saved in after being cleaned and being changed in theme storehouse, each application system is then distributed to again.Shared number
It is divided into two major parts according to center：Data exchange zone and theme storehouse.
First, data exchange zone
Shared data center is that each application system creates a database user, the money that this user is possessed
Source is referred to as data exchange zone, the object of following several types under the user be present：
(1) Materialized View, Materialized View are the local replicas of teledata, the basis in data exchange zone
The table that application system database needs to import creates corresponding Materialized View, and total in ESB as needed
In line timing these views are refreshed, such as by QuartZ (a kind of task scheduling framework, it is special
In the scheduling of concurrent tasks) mode start periodic refreshing task.
(2) materialized view log, materialized view log according to the needs of the fast refresh of different Materialized Views,
One physical address (ROWID) of unique mark or major key (PRIMARY KEY) can be established as
Type, it may also select whether to include specifying list arranged etc..
(3) increment list, before carrying out data cleansing, first can be inquired according to materialized view log from last time
Clean to the data to be changed untill current time, then these data are saved in increment list wait into
Row cleaning.
(4) data to be transmitted, when application system data after over cleaning in addition to being saved in theme storehouse,
Also corresponding record is distributed in data to be transmitted corresponding to other application system, by transmission task by this
The data of a little tables are sent to corresponding application system.
2nd, theme storehouse
Theme storehouse is the nucleus at shared data center, and preservation is data of the application system after over cleaning,
Wherein, the cleaning in the embodiment of the present invention, it is understood that for conversion, i.e., the mould established for data warehouse
Type, data are turned from business model to analysis model to realize by modes such as built-in function, custom scripts
Change, obtained final result is that what is externally provided meet in the data of specification, that is, final shared data
Calculation evidence.
With continued reference to Fig. 2 and Fig. 3, the data at shared data center import (or being data duplication), cleaning,
Distribute this series of action to dispatch by ESB buses, including four key steps：
Step 1, replication application system data, data that application system is increased newly or being changed are (i.e.
Incremental data) it imported into the corresponding increment list of shared data centre data exchange area, wherein, the step
By application system shared data center Web-Service can be called to complete, shared number can also be passed through
Start timed task according to the QuartZ at center to obtain from Materialized View.
Step 2, data cleansing, data cleansing are that ephemeral data storage is transferred to the process in theme storehouse, this rank
Section calls storing process by ESB unified message object (Universal Message Objects, UMO)
To realize, therefore the module mainly generates the data cleansing storage that ephemeral data storage is transferred to centre data storage
Process.
Specifically, there is two ways log-on data cleaning task, one kind is to be configured to cleaning task
OutBound, after data are imported by WebService or QuarZ tasks, ESB buses excite immediately
Corresponding packet goes out to management module (OutBound) to carry out data cleansing, counts in this process
According to cleaning task be passively perform (passively trigger scene, WebService called by other application system
Request content, request data format are caught, then are cleaned response content by shared data center by service
Or it is converted into desired data format), the data higher to requirement of real-time typically use such a mode；
Another be by data cleansing task configuration in QuartZ, using QuartZ tasks as data wrap into
Management module (InBound) carrys out start by set date.
3rd, by the data after cleaning from theme storehouse be distributed to data exchange zone (theme storehouse be database, it is necessary to
Data after cleaning are fetched into data exchange zone), on the one hand the data after cleaning will update shared data
In the theme storehouse at center, the tables of data to be transmitted for each application system for needing these data is also distributed in addition
In, the increment list of deletion correspondence system after distribution.
4th, the data of data exchange zone are sent to application system, by shared data centre data exchange area
Data renewal to be transmitted is into the database of application system.
Referring to Fig. 4, the structure at shared data center of the invention is divided into three layers, respectively data Layer, clothes
Business layer and application layer, function difference are as follows：
(1) data Layer, data Layer are the bottoms of system, are responsible for providing data according to shared data center
Behavior the service of being packaged into is described, then by service registry to service register center, when service is called
When, database performs corresponding behavior, and result is returned into last layer.
Wherein, the effect of ESB is responsible for the behavior description for providing data in data source being encapsulated as
Service；When service is called by system, it is responsible for corresponding behavior in activation data source, and returning result.Clothes
The effect of business registration center is the service describing submitted according to data center by service registry.
(2) service layer, service layer is responsible for receiving inquiry request from last layer, and is noted according to existing service
Volume information by request call respective service and passes to last layer.
SOAP routers are responsible for that the service with data center will be asked to be mapped.If corresponding service,
It is called with regard to sending request message；If without corresponding message, request nothing is illustrated to application program
Method performs.After have sent request message, SOAP routers receive the result of ESB return simultaneously
It will be passed to application program.
(3) application layer, application layer are tops, and access interface is provided for outer application system.
Referring to Fig. 5, the basic step flow at application system or user's accessing shared data center is as shown in the figure：
Application program is filed a request as needed；
Request matches with the service registered in service register center, and result is recorded；
SOAP routers send service invocation request SOAP roads according to the calling of request to shared data center
It is exactly a soap message transparent transmission effect by device；
ESB receives service request, activation service, obtains the result after performing, result is returned
Back to SOAP routers；
The call result received is packaged as soap message by SOAP routers, passes to application program.
In the above embodiment of the present invention, the shared data center based on ESB meets the reality of data transfer
The requirement of lower coupling and scalability between when property and shared data center and each application system, arrange existing
Systematic data, the dirty data that will be present in each information island are progressively removed, it is ensured that in shared data
The authority of data in the heart；Complete to dock with the data of existing application system by shared data center, ensure
The correctness that core data interacts between these systems；According to business demand, the application system for future provides
Data support service, i.e., the system newly added only needs i.e. achievable and existing by the service of data center's offer
Systematic data syn-chronization.
3rd embodiment
Referring to Fig. 6, the third embodiment of the present invention provides a kind of data sharing device, including：
Acquisition module 601, the incremental data of the adjacent Backup Data twice for obtaining the first application system；
Processing module 602, for carrying out data processing to incremental data, obtain the normal data of preset format；
Sending module 603, it is for normal data to be sent to the second application associated with the first application system
In system.
Preferably, acquisition module 601 includes：
Acquisition submodule, in the adjacent Backup Data twice for obtaining the first application system, the number that backs up afterwards
According to compared with the data of preceding backup, newly-increased data and/or the data to change.
Preferably, acquisition submodule includes：
Copied cells, for copying to the source data in the first application system according to the timing of the first predetermined period
In the Materialized View of default first application system, and update the materialized view log of Materialized View；
Acquiring unit, for according to materialized view log, obtaining the adjacent of the first application system and backing up number twice
In, the data backed up afterwards are compared with the data of preceding backup, newly-increased data and/or the data to change；
Memory cell, for establishing the increment list of the first application system, incremental data is stored in increment list.
Preferably, processing module 602 includes：
Transform subblock, for carrying out Data Format Transform to the incremental data in increment list, obtain default lattice
The normal data of formula；
Record sub module, for normal data to be stored in theme storehouse, and by the time of Data Format Transform
It is recorded in materialized view log.
Preferably, processing module 602 also includes：
Sub-module stored, for the incremental data corresponding with normal data to be stored in theme storehouse.
Preferably, sending module 603 includes：
First sending submodule, for when the session in the data inquiry request of the second application system received
When target query object in number is the first application system, normal data is sent to the first application system and led to
Cross in the second application system of session number association；Or
Second sending submodule, for generating the session number of data synchronization request according to the timing of the first predetermined period,
According to the corresponding relation of default first application system and the second application system, normal data is sent to
In second application system of one application system association；Wherein, the target in the session number of data synchronization request is same
It is to pass through associated the second application system of session number with the first application system to walk object.
Preferably, the device also includes：
Module is removed, for sending normal data to associating with the first application system in sending module 603
After in second application system,
Remove increment list.
In the above embodiment of the present invention, incremental data is obtained by acquisition module 601 and built for incremental data
Vertical increment list, the change of the first application system data reflect in increment list first；Processing module 602 is to increasing
Measure data and carry out Data Format Transform, form the normal data of unified form, to overcome between different application systems
Format differences problem；Theme storehouse is established for normal data, is issued to by sending module 603 associated
Second application system, improve the real-time of data sharing；The present invention realizes distributed each application system
Between data docking, the information between each system is really integrated into the information interaction between carry out system,
Ensure the accuracy of data interaction；When according to business demand need for new application system provide data support clothes
During business, the normal data in the embodiment of the present invention need to be only obtained.The present invention is solved under distributed environment
The problem of data syn-chronization, it is preferably minimized the change of original system, so as to Rapid Implementation and generation
Benefit.
It should be noted that data sharing device provided in an embodiment of the present invention is the device using the above method,
I.e. all embodiments of the above method are applied to the device, and can reach same or analogous beneficial effect.
Described above is the preferred embodiment of the present invention, it is noted that for the common skill of the art
For art personnel, on the premise of principle of the present invention is not departed from, some improvements and modifications can also be made,
These improvements and modifications also should be regarded as protection scope of the present invention.
Claims (14)
- A kind of 1. data sharing method, it is characterised in that including：Obtain the incremental data of the adjacent Backup Data twice of the first application system；Data processing is carried out to the incremental data, obtains the normal data of preset format；The normal data is sent into the second application system associated with first application system.
- 2. data sharing method according to claim 1, it is characterised in that the acquisition first should Included with the step of incremental data of the adjacent Backup Data twice of system：In the adjacent Backup Data twice for obtaining the first application system, the data and the data of preceding backup that back up afterwards Compare, newly-increased data and/or the data to change.
- 3. data sharing method according to claim 2, it is characterised in that the acquisition first should With in the adjacent Backup Data twice of system, the data backed up afterwards are compared with the data of preceding backup, newly-increased number According to and/or change data the step of include：The source data in the first application system is copied to default described the according to the timing of the first predetermined period In the Materialized View of one application system, and update the materialized view log of the Materialized View；According to the materialized view log, in the adjacent Backup Data twice for obtaining the first application system, standby The data of part are compared with the data of preceding backup, newly-increased data and/or the data to change；The increment list of first application system is established, the incremental data is stored in the increment list.
- 4. data sharing method according to claim 3, it is characterised in that described to the increment Data carry out data processing, and the step of obtaining the normal data of preset format includes：Data Format Transform is carried out to the incremental data in the increment list, obtains the normal data of preset format；The normal data is stored in theme storehouse, and the time of the Data Format Transform is recorded in institute State in materialized view log.
- 5. data sharing method according to claim 4, it is characterised in that described by the standard Data storage includes after the step in theme storehouse：The incremental data corresponding with the normal data is stored in theme storehouse.
- 6. data sharing method according to claim 1, it is characterised in that described by the standard Data, which are sent to the step in the second application system associated with first application system, to be included：Target query object in the session number in the data inquiry request of the second application system received For first application system when, the normal data is sent described to passing through with first application system In second application system of session number association；OrThe session number of data synchronization request is generated according to the timing of the first predetermined period, according to the default first application The corresponding relation of system and the second application system, by the normal data send to first application system In second application system of association；Wherein, the object synchronization object in the session number of the data synchronization request To pass through associated the second application system of session number with first application system.
- 7. data sharing method according to claim 3, it is characterised in that described by the standard Data are sent to the step in the second application system associated with first application system, in addition to：Remove the increment list.
- A kind of 8. data sharing device, it is characterised in that including：Acquisition module, the incremental data of the adjacent Backup Data twice for obtaining the first application system；Processing module, for carrying out data processing to the incremental data, obtain the normal data of preset format；Sending module, should to second associated with first application system for the normal data to be sent With in system.
- 9. data sharing device according to claim 8, it is characterised in that the acquisition module bag Include：Acquisition submodule, in the adjacent Backup Data twice for obtaining the first application system, the number that backs up afterwards According to compared with the data of preceding backup, newly-increased data and/or the data to change.
- 10. data sharing device according to claim 9, it is characterised in that the acquisition submodule Including：Copied cells, for copying to the source data in the first application system according to the timing of the first predetermined period In the Materialized View of default first application system, and update the materialized view log of the Materialized View；Acquiring unit, for according to the materialized view log, obtaining the adjacent standby twice of the first application system In part data, the data backed up afterwards newly-increased data and/or change compared with the data of preceding backup Data；Memory cell, for establishing the increment list of first application system, the incremental data is stored in In the increment list.
- 11. data sharing device according to claim 10, it is characterised in that the processing module Including：Transform subblock, for carrying out Data Format Transform to the incremental data in the increment list, obtain pre- If the normal data of form；Record sub module, turn for the normal data to be stored in theme storehouse, and by the data format The time changed is recorded in the materialized view log.
- 12. data sharing device according to claim 11, it is characterised in that the processing module Also include：Sub-module stored, for the incremental data corresponding with the normal data to be stored in theme storehouse.
- 13. data sharing device according to claim 8, it is characterised in that the sending module bag Include：First sending submodule, for when the session in the data inquiry request of the second application system received When target query object in number is first application system, the normal data is sent to described In the second application system that one application system is associated by the session number；OrSecond sending submodule, for generating the session number of data synchronization request according to the timing of the first predetermined period, According to the corresponding relation of default first application system and the second application system, by the normal data send to In the second application system associated with first application system；Wherein, the session of the data synchronization request Object synchronization object in number is to be by the second associated application of session number with first application system System.
- 14. data sharing device according to claim 11, it is characterised in that also include：Module is removed, is for sending the normal data to the described first application in the sending module After in the second application system of association of uniting, the increment list is removed.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610305168.2A CN107357791B (en) | 2016-05-10 | 2016-05-10 | Data sharing method and device |
| PCT/CN2017/079739 WO2017193739A1 (en) | 2016-05-10 | 2017-04-07 | Data sharing method and apparatus |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610305168.2A CN107357791B (en) | 2016-05-10 | 2016-05-10 | Data sharing method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107357791A true CN107357791A (en) | 2017-11-17 |
| CN107357791B CN107357791B (en) | 2021-10-15 |
Family
ID=60266887
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610305168.2A Active CN107357791B (en) | 2016-05-10 | 2016-05-10 | Data sharing method and device |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN107357791B (en) |
| WO (1) | WO2017193739A1 (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108388615A (en) * | 2018-02-09 | 2018-08-10 | 杭州数梦工场科技有限公司 | A kind of method for interchanging data, system and electronic equipment |
| CN108897880A (en) * | 2018-07-05 | 2018-11-27 | 南方电网科学研究院有限责任公司 | A kind of electric energy data sharing method and system |
| CN110287255A (en) * | 2019-05-23 | 2019-09-27 | 深圳壹账通智能科技有限公司 | Data sharing method, device and computer equipment based on user behavior |
| CN112825072A (en) * | 2019-11-21 | 2021-05-21 | 青岛海信移动通信技术股份有限公司 | Communication terminal and data sharing method |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113537558A (en) * | 2021-06-03 | 2021-10-22 | 广州快批信息科技有限公司 | Method and device for automatically processing upstream synchronization of material demands and terminal equipment |
| CN114079668B (en) * | 2022-01-20 | 2022-04-08 | 檀沐信息科技(深圳)有限公司 | Information acquisition and arrangement method and system based on internet big data |
| CN116633691B (en) * | 2023-07-24 | 2023-10-27 | 四川航天天盛科技有限公司 | Cloud platform system based on SaaS and data storage method thereof |
Citations (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6532520B1 (en) * | 1999-09-10 | 2003-03-11 | International Business Machines Corporation | Method and apparatus for allocating data and instructions within a shared cache |
| US20060059140A1 (en) * | 2004-09-14 | 2006-03-16 | Logical Information Machines, Inc. | Correcting data warehouse with prioritized processing for integrity and throughput |
| CN101266606A (en) * | 2007-03-15 | 2008-09-17 | 阿里巴巴公司 | On-line data migration method based on Oracle database |
| CN101674495A (en) * | 2009-10-20 | 2010-03-17 | 中兴通讯股份有限公司 | Method and device for preprocessing data disaster tolerance |
| CN102508835A (en) * | 2011-09-22 | 2012-06-20 | 用友软件股份有限公司 | Incremental data real-time synchronizing device based on log management packet and incremental data real-time synchronizing method based on same |
| CN102693324A (en) * | 2012-01-09 | 2012-09-26 | 西安电子科技大学 | Distributed database synchronization system, synchronization method and node management method |
| CN103136231A (en) * | 2011-11-25 | 2013-06-05 | 中国移动通信集团江苏有限公司 | Data synchronization method and system for heterogeneous databases |
| CN103617585A (en) * | 2013-11-06 | 2014-03-05 | 梧州学院 | Data sharing platform-based data processing method |
| US20140067921A1 (en) * | 2010-06-07 | 2014-03-06 | Salesforce.Com, Inc. | System, method and computer program product for performing a synchronization of data |
| US20150347250A1 (en) * | 2014-05-30 | 2015-12-03 | Altibase Corp. | Database management system for providing partial re-synchronization and partial re-synchronization method of using the same |
| CN105183860A (en) * | 2015-09-10 | 2015-12-23 | 北京京东尚科信息技术有限公司 | Data synchronization method and system |
| US20160004871A1 (en) * | 2014-07-07 | 2016-01-07 | Qualcomm Incorporated | Method and apparatus for incrementally sharing greater amounts of information between user devices |
| CN105338078A (en) * | 2015-10-26 | 2016-02-17 | 北京百度网讯科技有限公司 | Data storage method and device used for storing system |
| CN105447083A (en) * | 2015-11-06 | 2016-03-30 | 深圳市中润四方信息技术有限公司 | Data convergence and divergence method and system for multi-source heterogeneous database |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105677384A (en) * | 2015-12-28 | 2016-06-15 | 上海爱数信息技术股份有限公司 | System supporting information synchronization of organizations and users between different application systems |
-
2016
- 2016-05-10 CN CN201610305168.2A patent/CN107357791B/en active Active
-
2017
- 2017-04-07 WO PCT/CN2017/079739 patent/WO2017193739A1/en active Application Filing
Patent Citations (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6532520B1 (en) * | 1999-09-10 | 2003-03-11 | International Business Machines Corporation | Method and apparatus for allocating data and instructions within a shared cache |
| US20060059140A1 (en) * | 2004-09-14 | 2006-03-16 | Logical Information Machines, Inc. | Correcting data warehouse with prioritized processing for integrity and throughput |
| CN101266606A (en) * | 2007-03-15 | 2008-09-17 | 阿里巴巴公司 | On-line data migration method based on Oracle database |
| CN101674495A (en) * | 2009-10-20 | 2010-03-17 | 中兴通讯股份有限公司 | Method and device for preprocessing data disaster tolerance |
| US20140067921A1 (en) * | 2010-06-07 | 2014-03-06 | Salesforce.Com, Inc. | System, method and computer program product for performing a synchronization of data |
| CN102508835A (en) * | 2011-09-22 | 2012-06-20 | 用友软件股份有限公司 | Incremental data real-time synchronizing device based on log management packet and incremental data real-time synchronizing method based on same |
| CN103136231A (en) * | 2011-11-25 | 2013-06-05 | 中国移动通信集团江苏有限公司 | Data synchronization method and system for heterogeneous databases |
| CN102693324A (en) * | 2012-01-09 | 2012-09-26 | 西安电子科技大学 | Distributed database synchronization system, synchronization method and node management method |
| CN103617585A (en) * | 2013-11-06 | 2014-03-05 | 梧州学院 | Data sharing platform-based data processing method |
| US20150347250A1 (en) * | 2014-05-30 | 2015-12-03 | Altibase Corp. | Database management system for providing partial re-synchronization and partial re-synchronization method of using the same |
| US20160004871A1 (en) * | 2014-07-07 | 2016-01-07 | Qualcomm Incorporated | Method and apparatus for incrementally sharing greater amounts of information between user devices |
| CN105183860A (en) * | 2015-09-10 | 2015-12-23 | 北京京东尚科信息技术有限公司 | Data synchronization method and system |
| CN105338078A (en) * | 2015-10-26 | 2016-02-17 | 北京百度网讯科技有限公司 | Data storage method and device used for storing system |
| CN105447083A (en) * | 2015-11-06 | 2016-03-30 | 深圳市中润四方信息技术有限公司 | Data convergence and divergence method and system for multi-source heterogeneous database |
Non-Patent Citations (3)
| Title |
|---|
| CHENDI YU ET AL: "Make Driver Agent More Reserved: An AIM-Based Incremental Data Synchronization Policy", 《2013 IEEE 9TH INTERNATIONAL CONFERENCE ON MOBILE AD-HOC AND SENSOR NETWORKS》 * |
| 王汉文等: "智慧校园数据共享平台的设计与实现", 《中国教育网络》 * |
| 郝平 等: "一种移动网络下基于双时间戳的数据增量同步研究", 《计算机应用与软件》 * |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108388615A (en) * | 2018-02-09 | 2018-08-10 | 杭州数梦工场科技有限公司 | A kind of method for interchanging data, system and electronic equipment |
| CN108897880A (en) * | 2018-07-05 | 2018-11-27 | 南方电网科学研究院有限责任公司 | A kind of electric energy data sharing method and system |
| CN110287255A (en) * | 2019-05-23 | 2019-09-27 | 深圳壹账通智能科技有限公司 | Data sharing method, device and computer equipment based on user behavior |
| CN112825072A (en) * | 2019-11-21 | 2021-05-21 | 青岛海信移动通信技术股份有限公司 | Communication terminal and data sharing method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107357791B (en) | 2021-10-15 |
| WO2017193739A1 (en) | 2017-11-16 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107357791A (en) | A kind of data sharing method and device | |
| CN102103518B (en) | System for managing resources in virtual environment and implementation method thereof | |
| CN106559488B (en) | A method of establishing the power grid geographical information space service of tenant's driving | |
| CN105897946B (en) | A kind of acquisition methods and system of access address | |
| CN103297507B (en) | Cloud computing operation system and the method for providing a user service | |
| CN104636077B (en) | Network control techology storage system and method for virtual machine | |
| CN103842969B (en) | Information processing system | |
| CN102262680B (en) | Distributed database proxy system based on massive data access requirement | |
| CN107111519A (en) | For managing the system with scheduling container | |
| CN103546571B (en) | Platform-as-a-service (PaaS) realizing method and device | |
| CN102882927A (en) | Cloud storage data synchronizing framework and implementing method thereof | |
| CN109889575A (en) | Cooperated computing plateform system and method under a kind of peripheral surroundings | |
| CN102262674A (en) | Data synchronization method and system for distributed memory database | |
| CN103957270B (en) | Cloud atomic unit delivery and deployment method and device | |
| CN103827832B (en) | System and method for persisting transaction records in a transactional middleware machine environment | |
| CN106980678A (en) | Data analysing method and system based on zookeeper technologies | |
| CN101535965A (en) | Technique for improving scalability and portability of a storage management system | |
| CN103605698A (en) | Cloud database system used for distributed heterogeneous data resource integration | |
| CN102281330A (en) | Data storage, communication access and control method for software as a service (SAAS) platform | |
| CN109547512A (en) | A kind of method and device of the distributed Session management based on NoSQL | |
| CN101128827A (en) | Method and apparatus for distributed data management in a switching network | |
| CN102710763A (en) | Method and system for pooling, slicing and fault transfer of distributed cache | |
| CN101674495A (en) | Method and device for preprocessing data disaster tolerance | |
| CN109542583A (en) | A kind of virtual device management method based on dual bus | |
| CN103369015A (en) | Convenient method for accessing web camera through web |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |