CN107957933A - The monitoring method and device of data duplication - Google Patents
The monitoring method and device of data duplication Download PDFInfo
- Publication number
- CN107957933A CN107957933A CN201711266490.XA CN201711266490A CN107957933A CN 107957933 A CN107957933 A CN 107957933A CN 201711266490 A CN201711266490 A CN 201711266490A CN 107957933 A CN107957933 A CN 107957933A
- Authority
- CN
- China
- Prior art keywords
- data
- duplication
- software
- monitoring
- server
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/3003—Monitoring arrangements specially adapted to the computing system or computing system component being monitored
- G06F11/3034—Monitoring arrangements specially adapted to the computing system or computing system component being monitored where the computing system component is a storage system, e.g. DASD based or network based
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/14—Error detection or correction of the data by redundancy in operation
- G06F11/1402—Saving, restoring, recovering or retrying
- G06F11/1446—Point-in-time backing up or restoration of persistent data
- G06F11/1448—Management of the data involved in backup or backup restore
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2201/00—Indexing scheme relating to error detection, to error correction, and to monitoring
- G06F2201/80—Database-specific techniques
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- Computing Systems (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Quality & Reliability (AREA)
- Databases & Information Systems (AREA)
- Mathematical Physics (AREA)
- Data Mining & Analysis (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The present invention provides a kind of monitoring method of data duplication, when the execution software for performing data copy operation replicates software for first, determines the first ID set and the 2nd ID set；The first ID set includes：The current ID for having parsed each data into backup database, the 2nd ID set include：The first duplication software copies to the ID of each data of open platform from the backup database；First ID set and the 2nd ID set are matched, when matching degree is less than preset matching value, determine that data duplication process postpones.Method provided by the invention, the ID of the ID that each data of parsing have been completed by monitoring and each data for having completed data duplication, matching operation is carried out to it, when matching degree is less than preset matching value, determine that data duplication process postpones, so as to find the replica delay during data duplication in time, and timely processing postpones, and lifts work efficiency.
Description
Technical field
The present invention relates to technical field of data processing, the monitoring method and device of more particularly to a kind of data duplication.
Background technology
AS/400 servers are most popular middle-size and small-size, the multi-user's business computing systems in the world today, are taken in multi-user
It is engaged in device field, remains best-selling status.It is each to be widely used in circulation, financial instrument, manufacture, transport, security protection etc.
Industry.Preferably the data produced in AS/400 servers can be applied in order to facilitate user, in AS/400 servers
It is mounted with that cross-platform data replicates software, the data for AS/400 servers to be produced copy to open platform in real time.
Inventor has found that it is existing, AS/400 servers are produced in application cross-platform data duplication software
Data duplication to during open platform, due to the difference between each processing equipment in AS/400 servers, can cause
The cross-platform replica delay for replicating software and data being produced to AS/400 servers so that user cannot obtain AS/400 generations in time
Data, reduce work efficiency.Therefore, there is an urgent need for a kind of monitoring method to data reproduction process, cross-platform data is replicated
Reproduction process of the software to data is monitored, so that when duplication postpones, timely processing delay, lifts work efficiency.
The content of the invention
The technical problems to be solved by the invention are to provide a kind of monitoring method of data duplication, can be effectively to cross-platform
Reproduction process of the data duplication software to data is monitored, and finds delay in time, lifts the work efficiency of user.
The present invention also provides a kind of monitoring device of data duplication, to ensure above method realization in practice and should
With.
A kind of monitoring method of data duplication, including：
Determine the current target software for performing data copy operation；
When the target software replicates software for first, the first policer operation is performed, first policer operation includes：
Determine the first ID set and the 2nd ID set；The first ID set includes：Currently parse to backup database
In each data ID, the 2nd ID set includes：The first duplication software copies to out from the backup database
It is laid flat the ID of each data of platform；
First ID set and the 2nd ID set are matched, when matching degree is less than preset matching value, determine institute
The first duplication software is stated to postpone the process of the data duplication that server produces to open platform.
Above-mentioned method, optionally, further includes：
When the target software replicates software for second, the second policer operation is performed, second policer operation includes：
The first time stamp that Production database in server produces target data is obtained, and the target data is parsed to clothes
Second timestamp of local data base in business device；
The difference between the first time stamp and second timestamp is calculated, when the difference exceedes preset time value
When, determine that the second duplication software postpones the process of the data duplication that the server produces to open platform.
Above-mentioned method, it is optionally, described to determine that the first ID set and the 2nd ID gather, including：
Read the pre-established data record replicated in state control table；
The data record is analyzed, is gathered with obtaining the first ID set and the 2nd ID.
Above-mentioned method, optionally, further includes：
The first warning message is sent respectively to subscription client and server, to prompt user and server data copied
Cheng Fasheng postpones.
Above-mentioned method, optionally, further includes：
Definite the first ID set, the 2nd ID the matching degree information gathered and be calculated are preserved, with generative nature
Can analytical statement.
Above-mentioned method, optionally, further includes：
The duplication state of each data for having completed to replicate in the duplication state control table is read, and is judged described each
Whether duplication state is normal, when data abnormal there are duplication state, for second warning message of data sending to clothes
Business device and subscription client.
Above-mentioned method, optionally, further includes：
Warning message is sent to monitoring alarm platform, to prompt data duplication process to postpone.
A kind of monitoring device of data duplication, including：
Determination unit, for determining the current target software for performing data copy operation；
Execution unit, when replicating software for the target software for first, performs the first policer operation, first prison
Control operation includes：
Determine the first ID set and the 2nd ID set；The first ID set includes：Currently parse to backup database
In each data ID, the 2nd ID set includes：The first duplication software copies to out from the backup database
It is laid flat the ID of each data of platform；
First ID set and the 2nd ID set are matched, when matching degree is less than preset matching value, determine institute
The first duplication software is stated to postpone the process of the data duplication that server produces to open platform.
A kind of storage medium, the storage medium include the program of storage, wherein, when described program is run described in control
Equipment where storage medium performs the monitoring method of above-mentioned data duplication.
A kind of electronic equipment, including memory, and one either one of them or one of more than one program with
Upper program storage in memory, and be configured to by one either more than one processor perform it is one or one with
Upper program includes the instruction for being used for being operated below：
Determine the current target software for performing data copy operation；
When the target software replicates software for first, the first policer operation is performed, first policer operation includes：
Determine the first ID set and the 2nd ID set；The first ID set includes：Currently parse to backup database
In each data ID, the 2nd ID set includes：The first duplication software copies to out from the backup database
It is laid flat the ID of each data of platform；
First ID set and the 2nd ID set are matched, when matching degree is less than preset matching value, determine institute
The first duplication software is stated to postpone the process of the data duplication that server produces to open platform.
Compared with prior art, the present invention includes advantages below：
The present invention provides a kind of monitoring method of data duplication, it is first determined the current execution for performing data copy operation
Software, when the execution software for performing data copy operation replicates software for first, determines the first ID set and the 2nd ID set；
The first ID set includes：The current ID for having parsed each data into backup database, the 2nd ID set include：
The first duplication software copies to the ID of each data of open platform from the backup database；First ID is gathered
Matched with the 2nd ID set, when matching degree is less than preset matching value, determine that the first duplication software produces server
The process of raw data duplication to open platform postpones.Method provided by the invention, each of parsing has been completed by monitoring
The ID of a data and completed data duplication each data ID, matching operation is carried out to it, that is, compare the first ID set and
Difference between 2nd ID set, when matching degree is less than preset matching value, determines that the first duplication software produces server
The process of raw data duplication to open platform postpones, so as to find that the duplication during data duplication is prolonged in time
Late, and timely processing postpones, and lifts work efficiency.
Brief description of the drawings
To describe the technical solutions in the embodiments of the present invention more clearly, make required in being described below to embodiment
Attached drawing is briefly described, it should be apparent that, drawings in the following description are only some embodiments of the present invention, for
For those of ordinary skill in the art, without having to pay creative labor, it can also be obtained according to these attached drawings
His attached drawing.
Fig. 1 is a kind of method flow diagram of the monitoring method of data duplication provided by the invention；
Fig. 2 is a kind of another method flow diagram of the monitoring method of data duplication provided by the invention；
Fig. 3 is the provided by the invention first Organization Chart for replicating software execution reproduction process；
Fig. 4 is the provided by the invention second Organization Chart for replicating software execution reproduction process；
Fig. 5 is the provided by the invention second method flow diagram for replicating software execution reproduction process；
Fig. 6 is a kind of structure diagram of the monitoring device of data duplication provided by the invention；
Fig. 7 is the structure diagram of a kind of electronic equipment provided by the invention.
Embodiment
Below in conjunction with the attached drawing in the embodiment of the present invention, the technical solution in the embodiment of the present invention is carried out clear, complete
Site preparation describes, it is clear that described embodiment is only part of the embodiment of the present invention, instead of all the embodiments.It is based on
Embodiment in the present invention, those of ordinary skill in the art are obtained every other without making creative work
Embodiment, belongs to the scope of protection of the invention.
The present invention can be used in numerous general or special purpose computing device environment or configuration.Such as：Personal computer, service
Device computer, handheld device or portable set, laptop device, multi-processor device including any of the above device or equipment
Distributed computing environment etc..
An embodiment of the present invention provides a kind of monitoring method of data duplication, this method can be applied in computer or terminal
Processor in, the monitoring process of the monitoring method of data duplication provided by the invention is performed by the processor, the present invention is real
Apply in example, the processor can be AS400 servers, and Fig. 1 shows the monitoring of data duplication provided in an embodiment of the present invention
The method flow diagram of method, including：
S101：Determine the current target software for performing data copy operation；
In monitoring method provided in an embodiment of the present invention, the execution software for performing data duplication process in the server can be with
Have a variety of, can replicate software DP4 (DataPropagator/400), or replicate software cd C
(IBMInfoSphere Data Replication), preferred pin is supervised to replicating software cd C and DP4 in the embodiment of the present invention
Control, in the embodiment of the present invention, it is first determined current to perform the target software for replicating operation.
S102：When the current target software for performing data copy operation is the first duplication software, S103 is performed；
When it is the first duplication software to judge the current target software for performing data copy operation, redirects and perform S103；This
In inventive embodiments, the first duplication software can replicate software cd C.
S103：Determine the first ID set and the 2nd ID set；The first ID set includes：Currently parse to backup number
According to the ID of each data in storehouse, the 2nd ID set includes：The first duplication software is replicated from the backup database
To the ID of each data of open platform；
In the embodiment of the present invention, each data ID currently parsed into backup database is formed into the first ID set,
Each data ID that current first duplication software is copied to open platform from the Backup Data forms the 2nd ID set.
S104：First ID set and the 2nd ID set are matched, when matching degree is less than preset matching value, really
The fixed first duplication software postpones the process of the data duplication that server produces to open platform.
In the embodiment of the present invention, the first ID set and the 2nd ID set are matched, when matching degree is less than default
During with value, show that the first duplication software copies the processes of data from backup database and postpones.
The monitoring method of data duplication provided in an embodiment of the present invention, the ID of each data of parsing has been completed by monitoring
And the ID of each data of data duplication has been completed, matching operation is carried out to it, that is, compares the first ID set and the 2nd ID set
Between difference, when matching degree is less than preset matching value, determine it is described first duplication software the data that server produces are answered
Make to the process of open platform and postpone, so as to find the replica delay during data duplication in time, and locate in time
Reason delay, lifts work efficiency.
The embodiment of the present invention gathers the first ID and the 2nd ID set carries out matched process, can be to determine the first ID collection
The quantity of data ID in conjunction, and determine the quantity of data ID in the 2nd ID set, the first ID set and the 2nd ID set are carried out
Difference comparsion, when difference exceedes certain numerical value, shows that the first ID set and the matching degree of the 2nd ID set are less than default
With value.
It can also be that each data ID in the first ID set and the 2nd ID set is matched, that is, be present in the first ID collection
Data ID in conjunction whether there is in the 2nd ID set, when the quantity being not present in the 2nd ID set exceedes certain numerical value
When, show that the first ID set and the matching degree of the 2nd ID set are less than default matching value.
With reference to figure 2, on the basis of Fig. 1, the monitoring method of data duplication provided in an embodiment of the present invention is shown again
One method flow diagram, on the basis of Fig. 1, further includes：
S105：When target software replicates software for second, step S106 is performed；
In the embodiment of the present invention, described second, which replicates software, to replicate software for DP4.
S106：Obtain the first time stamp that Production database in server produces target data, and the target data solution
Analyse the second timestamp of the local data base into server；
In the embodiment of the present invention, the Production database in server remembers the data of each generation when producing data
Record as target data, first time when recording data generation stabs, then keeps track of the data, record the data and be resolved
The second timestamp into server during local data base.
S107：The difference between the first time stamp and second timestamp is calculated, is preset when the difference exceedes
During time value, determine that the second duplication software prolongs the process of the data duplication that the server produces to open platform
Late.
In the embodiment of the present invention, the difference at the first time between stamp and the second timestamp is calculated, when difference is exceeded default
Between value be show the second duplication software again by server produce data duplication to open platform when postpone.
The monitoring method of data duplication provided in an embodiment of the present invention, it is soft for the current target for performing data copy operation
When part replicates software for second, record data produce and complete two timestamps during parsing, when the difference of two timestamps surpasses
When crossing certain numerical value, determine that current reproduction process can produce delay.So as to find delay and timely processing delay in time, carry
Rise work efficiency.
It is described to determine the first ID collection when the software for performing data duplication replicates software for first in the embodiment of the present invention
Close and the 2nd ID gathers, including：
Read the pre-established data record replicated in state control table；
The data record is analyzed, is gathered with obtaining the first ID set and the 2nd ID.
In the embodiment of the present invention, duplication state control table is provided with, the data of backup database are resolved to for each
ID all can be recorded in the duplication state control table, copied for the first duplication software from the backup database
The ID of each data, can also be recorded in the duplication state control table, therefore, read in the duplication state control table
Data record is simultaneously analyzed, you can obtains the first ID set and the 2nd ID set.
In the embodiment of the present invention, when the software for performing data duplication replicates software for first, prolong in reproduction process
In the case of late, the first warning message can be sent respectively to subscription client and server, to prompt user and server data
Reproduction process postpones.
, can be by the whole of data duplication when the software for performing data duplication replicates software for first in the embodiment of the present invention
Data are obtained during a monitoring to be stored, including by by definite the first ID set, the 2nd ID gather and is calculated
Matching degree information is preserved, to generate performance analytical statement.
In the embodiment of the present invention, when the software for performing data duplication replicates software for first, the monitoring of data duplication
Cheng Zhong, further includes：
The duplication state of each data for having completed to replicate in the duplication state control table is read, and is judged described each
Whether duplication state is normal, when data abnormal there are duplication state, for second warning message of data sending to clothes
Business device and subscription client.
In the embodiment of the present invention, when the software for performing data duplication replicates software for second, in the process of data duplication
When postponing, warning message is sent to monitoring alarm platform, to prompt data duplication process to postpone.And preserve and monitored
All data obtained in journey, to generate performance analytical statement.
With reference to figure 3, show that provided in an embodiment of the present invention first replicates the Organization Chart that software performs reproduction process, it is described
First duplication software can be CDC softwares.
Production database in server is parsed data to backup log after data are produced in the form of journal file
In, for the backup log that is, backup database, first replicates software by the data duplication in backup database to opening
Platform when, delay can be produced, monitoring method provided by the invention, is mainly monitored the reproduction process.It is soft for CDC
Part, the present invention can provide CDC duplication monitoring modules and whole reproduction process are monitored.
Production database parses to the data ID of each data in backup database and is maintained in the control of duplication state
In table, the data ID for each data that the first duplication software copies to open platform from the backup database is similarly protected
In the presence of replicating in state control table, therefore, in monitoring method provided in an embodiment of the present invention, Production database is parsed to backup
Each data ID in database gathers as the first ID, when the first duplication software copies to open put down from the Backup Data
Each data ID of platform gathers as the 2nd ID, compares the difference between the first ID set and the 2nd ID set, when difference reaches
When alarm requires, monitoring module can respectively send a warning message to the machine and manufacturing machine at the same time.
In monitoring method provided in an embodiment of the present invention, each can also be read from the duplication state control table
The duplication state of data replicated has been completed, has judged whether the duplication state of each data of duplication is normal, for replicating state
Abnormal data, while send warning message to the machine and manufacturing machine.
In the embodiment of the present invention, when the first duplication software is CDC softwares, CDC replicates monitoring module and reads answering for CDC in real time
State control table processed, by calculating the duplication state in control table, compared with monitoring alarm threshold values, if it exceeds alarming threshold value,
A warning message then is sent to local and production alert data, then is sent warning message unification by monitoring alarm platform.
In addition, all duplication status informations are also unified to preserve, to do performance analysis report.
With reference to figure 4, show that provided in an embodiment of the present invention second replicates the Organization Chart that software performs reproduction process, it is described
Second duplication software can be DP4 softwares.
The data of generation are resolved in local data base, then by the Production database in server after data are produced
By second replicate software by the data duplication in local data base into open platform.
Generally, think that obvious postpone is not present in reproduction process of the second duplication software for data in local data base,
The process that data in Production database are resolved to local data base can produce delay, so as to also result in, in Production database
The process of the data duplication of generation to development platform is postponed.
The monitoring flow chart for the second duplication software DP4 with reference to shown in Fig. 5, specifically includes：
Within the specifically monitoring cycle, such as an every 15 minutes monitoring cycles, when record Production database produces data
First time stamp, and the second timestamp when data are resolved to local data base judges stamp and the second timestamp at the first time
Between difference, when difference is more than alarm threshold value, sends delayed alarm to monitoring alarm platform, and will be obtained during monitoring
Data stored, store monitoring history library in, so as to generate performance monitoring analysis report.
If within the monitoring cycle, do not postpone, enter back into next monitoring cycle.
The monitoring method of data duplication provided in an embodiment of the present invention, realizing the duplication state to business software realizes
It is automatically-monitored, by the arrangement to monitoring data and report is generated, has to the duplicating efficiency of software and gets information about.When multiple
When system delay occurs, system manager can obtain warning message at the first time, so as to reduce management and link up cost, carry
Elevator ties up efficiency.
Corresponding with a kind of monitoring method of data duplication shown in Fig. 1, the embodiment of the present invention additionally provides a kind of number
According to the monitoring device of duplication, for the specific implementation to the monitoring method of data duplication in Fig. 1, the data of the embodiment of the present invention are answered
The monitoring method of system can be applied in computer or the processor of terminal, its structure diagram is as shown in fig. 6, specifically include：
Determination unit 201, for determining the current target software for performing data copy operation；
Execution unit 202, when replicating software for the target software for first, performs the first policer operation, and described the
One policer operation includes：
Determine the first ID set and the 2nd ID set；The first ID set includes：Currently parse to backup database
In each data ID, the 2nd ID set includes：The first duplication software copies to out from the backup database
It is laid flat the ID of each data of platform；
First ID set and the 2nd ID set are matched, when matching degree is less than preset matching value, determine institute
The first duplication software is stated to postpone the process of the data duplication that server produces to open platform.
Monitoring device provided by the invention, the ID of each data of parsing has been completed by monitoring and has completed data duplication
Each data ID, matching operation is carried out to it, compare the first ID set the 2nd ID gather between difference, work as matching degree
During less than preset matching value, determine that described first replicates software by the process hair of the data duplication that server produces to open platform
Raw delay, so as to find the replica delay during data duplication in time, and timely processing postpones, and lifts work efficiency.
Monitoring device provided by the invention, further includes：
Determination unit 201, when determining that the target software replicates software for second, the execution unit 202 performs second
Policer operation, second policer operation include：
The first time stamp that Production database in server produces target data is obtained, and the target data is parsed to clothes
Second timestamp of local data base in business device；
The difference between the first time stamp and second timestamp is calculated, when the difference exceedes preset time value
When, determine that the second duplication software postpones the process of the data duplication that the server produces to open platform.
The embodiment of the present invention additionally provides a kind of storage medium, and the storage medium includes the program of storage, wherein, in institute
The monitoring method that the equipment where the storage medium is controlled during program operation performs above-mentioned data duplication is stated, the method is specific
Including：
Determine the current target software for performing data copy operation；
When the target software replicates software for first, the first policer operation is performed, first policer operation includes：
Determine the first ID set and the 2nd ID set；The first ID set includes：Currently parse to backup database
In each data ID, the 2nd ID set includes：The first duplication software copies to out from the backup database
It is laid flat the ID of each data of platform；
First ID set and the 2nd ID set are matched, when matching degree is less than preset matching value, determine institute
The first duplication software is stated to postpone the process of the data duplication that server produces to open platform.
Above-mentioned method, optionally, further includes：
When the target software replicates software for second, the second policer operation is performed, second policer operation includes：
The first time stamp that Production database in server produces target data is obtained, and the target data is parsed to clothes
Second timestamp of local data base in business device；
The difference between the first time stamp and second timestamp is calculated, when the difference exceedes preset time value
When, determine that the second duplication software postpones the process of the data duplication that the server produces to open platform.
Above-mentioned method, it is optionally, described to determine that the first ID set and the 2nd ID gather, including：
Read the pre-established data record replicated in state control table；
The data record is analyzed, is gathered with obtaining the first ID set and the 2nd ID.
Above-mentioned method, optionally, further includes：
The first warning message is sent respectively to subscription client and server, to prompt user and server data copied
Cheng Fasheng postpones.
Above-mentioned method, optionally, further includes：
Definite the first ID set, the 2nd ID the matching degree information gathered and be calculated are preserved, with generative nature
Can analytical statement.
Above-mentioned method, optionally, further includes：
The duplication state of each data for having completed to replicate in the duplication state control table is read, and is judged described each
Whether duplication state is normal, when data abnormal there are duplication state, for second warning message of data sending to clothes
Business device and subscription client.
Above-mentioned method, optionally, further includes：
Warning message is sent to monitoring alarm platform, to prompt data duplication process to postpone.
The embodiment of the present invention additionally provides a kind of electronic equipment, its structure diagram is as shown in fig. 7, specifically include memory
301, and one either more than one program 302 one of them or more than one program 302 be stored in memory 301
In, and be configured to by one or more than one processor 303 perform the one or more programs 302 include use
In the instruction for carrying out following operation：
Determine the current target software for performing data copy operation；
When the target software replicates software for first, the first policer operation is performed, first policer operation includes：
Determine the first ID set and the 2nd ID set；The first ID set includes：Currently parse to backup database
In each data ID, the 2nd ID set includes：The first duplication software copies to out from the backup database
It is laid flat the ID of each data of platform；
First ID set and the 2nd ID set are matched, when matching degree is less than preset matching value, determine institute
The first duplication software is stated to postpone the process of the data duplication that server produces to open platform.
It should be noted that each embodiment in this specification is described by the way of progressive, each embodiment weight
Point explanation is all difference with other embodiment, between each embodiment identical similar part mutually referring to.
For device class embodiment, since it is substantially similar to embodiment of the method, so description is fairly simple, related part ginseng
See the part explanation of embodiment of the method.
Finally, it is to be noted that, herein, relational terms such as first and second and the like be used merely to by
One entity or operation are distinguished with another entity or operation, without necessarily requiring or implying these entities or operation
Between there are any actual relationship or order.Moreover, term " comprising ", "comprising" or its any other variant meaning
Covering non-exclusive inclusion, so that process, method, article or equipment including a series of elements not only include that
A little key elements, but also including other elements that are not explicitly listed, or further include for this process, method, article or
The intrinsic key element of equipment.In the absence of more restrictions, the key element limited by sentence "including a ...", is not arranged
Except also there are other identical element in the process, method, article or apparatus that includes the element.
For convenience of description, it is divided into various units during description apparatus above with function to describe respectively.Certainly, this is being implemented
The function of each unit can be realized in same or multiple softwares and/or hardware during invention.
As seen through the above description of the embodiments, those skilled in the art can be understood that the present invention can
Realized by the mode of software plus required general hardware platform.Based on such understanding, technical scheme essence
On the part that contributes in other words to the prior art can be embodied in the form of software product, the computer software product
It can be stored in storage medium, such as ROM/RAM, magnetic disc, CD, including some instructions are used so that a computer equipment
(can be personal computer, server, either network equipment etc.) performs some of each embodiment of the present invention or embodiment
Method described in part.
The monitoring method and device of a kind of data duplication provided by the present invention are described in detail above, herein
Apply specific case to be set forth the principle of the present invention and embodiment, the explanation of above example is only intended to help
Understand the method and its core concept of the present invention；Meanwhile for those of ordinary skill in the art, according to the thought of the present invention,
There will be changes in specific embodiments and applications, in conclusion this specification content should not be construed as to this
The limitation of invention.
Claims (10)
- A kind of 1. monitoring method of data duplication, it is characterised in that including：Determine the current target software for performing data copy operation；When the target software replicates software for first, the first policer operation is performed, first policer operation includes：Determine the first ID set and the 2nd ID set；The first ID set includes：Currently parse into backup database The ID of each data, the 2nd ID set include：The first duplication software copies to open flat from the backup database The ID of each data of platform；First ID set and the 2nd ID set are matched, when matching degree is less than preset matching value, determine described the One duplication software postpones the process of the data duplication that server produces to open platform.
- 2. according to the method described in claim 1, it is characterized in that, further include：When the target software replicates software for second, the second policer operation is performed, second policer operation includes：The first time stamp that Production database in server produces target data is obtained, and the target data is parsed to server Second timestamp of middle local data base；The difference between the first time stamp and second timestamp is calculated, when the difference exceedes preset time value, Determine that the second duplication software postpones the process of the data duplication that the server produces to open platform.
- 3. according to the method described in claim 1, it is characterized in that, it is described determine the first ID set and the 2nd ID set, including：Read the pre-established data record replicated in state control table；The data record is analyzed, is gathered with obtaining the first ID set and the 2nd ID.
- 4. according to the method described in claim 1, it is characterized in that, further include：The first warning message is sent respectively to subscription client and server, to prompt user and server data reproduction process to send out Raw delay.
- 5. according to the method described in claim 1, it is characterized in that, further include：Definite the first ID set, the 2nd ID the matching degree information gathered and be calculated are preserved, to generate performance point Analyse report.
- 6. according to the method described in claim 3, it is characterized in that, further include：The duplication state of each data for having completed to replicate in the duplication state control table is read, and judges each duplication Whether state is normal, when data abnormal there are duplication state, for second warning message of data sending to server And subscription client.
- 7. according to the method described in claim 2, it is characterized in that, further include：Warning message is sent to monitoring alarm platform, to prompt data duplication process to postpone.
- A kind of 8. monitoring device of data duplication, it is characterised in that including：Determination unit, for determining the current target software for performing data copy operation；Execution unit, when replicating software for the target software for first, performs the first policer operation, the first monitoring behaviour Work includes：Determine the first ID set and the 2nd ID set；The first ID set includes：Currently parse into backup database The ID of each data, the 2nd ID set include：The first duplication software copies to open flat from the backup database The ID of each data of platform；First ID set and the 2nd ID set are matched, when matching degree is less than preset matching value, determine described the One duplication software postpones the process of the data duplication that server produces to open platform.
- A kind of 9. storage medium, it is characterised in that the storage medium includes the program of storage, wherein, run in described program When control the equipment where the storage medium to perform the monitoring side of the data duplication as described in claim 1~7 any one Method.
- 10. a kind of electronic equipment, it is characterised in that including memory, and one or more than one program, one of them Either more than one program storage in memory and is configured to be wanted by one or more than one processor execution such as right Seek the monitoring method of the data duplication described in 1~7 any one.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711266490.XA CN107957933B (en) | 2017-12-05 | 2017-12-05 | Data replication monitoring method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711266490.XA CN107957933B (en) | 2017-12-05 | 2017-12-05 | Data replication monitoring method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107957933A true CN107957933A (en) | 2018-04-24 |
| CN107957933B CN107957933B (en) | 2021-11-16 |
Family
ID=61962262
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711266490.XA Active CN107957933B (en) | 2017-12-05 | 2017-12-05 | Data replication monitoring method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107957933B (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109684410A (en) * | 2018-12-24 | 2019-04-26 | 浙江大华技术股份有限公司 | A kind of system, method and the storage medium of determining master-slave database synchronization delayed time |
| CN111488239A (en) * | 2019-01-28 | 2020-08-04 | 伊姆西Ip控股有限责任公司 | Method, apparatus and computer program product for storing data |
| CN111831516A (en) * | 2020-07-24 | 2020-10-27 | 中国工商银行股份有限公司 | Data replication monitoring method, device, equipment and medium |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20050204105A1 (en) * | 2004-03-12 | 2005-09-15 | Shunji Kawamura | Remote copy system |
| US20130145018A1 (en) * | 2010-04-01 | 2013-06-06 | Hitachi, Ltd. | Operation delay monitoring method, operation management apparatus, and operation management program |
| CN103810076A (en) * | 2012-11-15 | 2014-05-21 | 国家电网公司 | Monitoring method and device for data reproduction |
| US20140289574A1 (en) * | 2011-10-24 | 2014-09-25 | Rambus Inc. | Dram retention test method for dynamic error correction |
| CN105657364A (en) * | 2015-12-30 | 2016-06-08 | 广东威创视讯科技股份有限公司 | Display method, device and system for image processor |
| CN106528803A (en) * | 2016-11-14 | 2017-03-22 | 武汉斗鱼网络科技有限公司 | Method and apparatus for monitoring MongoDB database object replication delay |
| CN106649577A (en) * | 2016-11-17 | 2017-05-10 | 杭州沃趣科技股份有限公司 | Method for detecting running state of synchronous software of Oracle database |
-
2017
- 2017-12-05 CN CN201711266490.XA patent/CN107957933B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20050204105A1 (en) * | 2004-03-12 | 2005-09-15 | Shunji Kawamura | Remote copy system |
| US20130145018A1 (en) * | 2010-04-01 | 2013-06-06 | Hitachi, Ltd. | Operation delay monitoring method, operation management apparatus, and operation management program |
| US20140289574A1 (en) * | 2011-10-24 | 2014-09-25 | Rambus Inc. | Dram retention test method for dynamic error correction |
| CN103810076A (en) * | 2012-11-15 | 2014-05-21 | 国家电网公司 | Monitoring method and device for data reproduction |
| CN105657364A (en) * | 2015-12-30 | 2016-06-08 | 广东威创视讯科技股份有限公司 | Display method, device and system for image processor |
| CN106528803A (en) * | 2016-11-14 | 2017-03-22 | 武汉斗鱼网络科技有限公司 | Method and apparatus for monitoring MongoDB database object replication delay |
| CN106649577A (en) * | 2016-11-17 | 2017-05-10 | 杭州沃趣科技股份有限公司 | Method for detecting running state of synchronous software of Oracle database |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109684410A (en) * | 2018-12-24 | 2019-04-26 | 浙江大华技术股份有限公司 | A kind of system, method and the storage medium of determining master-slave database synchronization delayed time |
| CN109684410B (en) * | 2018-12-24 | 2021-06-15 | 浙江大华技术股份有限公司 | System, method and storage medium for determining synchronization delay of master database and slave database |
| CN111488239A (en) * | 2019-01-28 | 2020-08-04 | 伊姆西Ip控股有限责任公司 | Method, apparatus and computer program product for storing data |
| CN111488239B (en) * | 2019-01-28 | 2023-07-07 | 伊姆西Ip控股有限责任公司 | Method, apparatus and computer program product for storing data |
| CN111831516A (en) * | 2020-07-24 | 2020-10-27 | 中国工商银行股份有限公司 | Data replication monitoring method, device, equipment and medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107957933B (en) | 2021-11-16 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111209131A (en) | Method and system for determining fault of heterogeneous system based on machine learning | |
| US10177984B2 (en) | Isolation of problems in a virtual environment | |
| US11593029B1 (en) | Identifying a parent event associated with child error states | |
| CN110175451A (en) | A kind of method for safety monitoring and system based on electric power cloud | |
| CN113595761B (en) | Micro-service component optimization method and medium of power system information communication integrated scheduling platform | |
| US9122784B2 (en) | Isolation of problems in a virtual environment | |
| CN107957933A (en) | The monitoring method and device of data duplication | |
| CN109669837A (en) | Equipment state method for early warning, system, computer installation and readable storage medium storing program for executing | |
| CN103605722A (en) | Method, device and equipment for database monitoring | |
| CN109165138A (en) | A kind of method and apparatus of monitoring equipment fault | |
| CN110784374A (en) | Method, device, equipment and system for monitoring operation state of service system | |
| CN112468361A (en) | Network connection state monitoring method and device, electronic equipment and storage medium | |
| CN109901969B (en) | Design method and device of centralized monitoring management platform | |
| US20170199800A1 (en) | System and method for comprehensive performance and availability tracking using passive monitoring and intelligent synthetic transaction generation in a transaction processing system | |
| CN110941632A (en) | Database auditing method, device and equipment | |
| CN113419935B (en) | Mobile terminal performance monitoring method, device, equipment and storage medium | |
| CN103824017A (en) | Method and platform for monitoring rogue programs | |
| CN114172921A (en) | Log auditing method and device for scheduling recording system | |
| CN104268231B (en) | A kind of file access method, device and Intelligent File System | |
| Sahoo et al. | Providing persistent and consistent resources through event log analysis and predictions for large-scale computing systems | |
| CN108304731A (en) | A kind of method, system and information processing platform that management business data calls | |
| Aguilera-Mendoza et al. | Modeling and simulation of Hadoop Distributed File System in a cluster of workstations | |
| CN113409876A (en) | Method and system for positioning fault hard disk | |
| CN107678905B (en) | Monitoring method and device | |
| CN115766498B (en) | Big data link full-link tracking monitoring method and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |