KR101949761B1 - Integrated replication system - Google Patents

Abstract

The present invention relates to an integrated replication system. According to an embodiment of the present invention, the integrated replication system comprises: a receiving module receiving data from N number of source systems; a processing module processing the received data in accordance with a predetermined reference; a storing module storing the data received from the receiving module; and a transmitting module transmitting at least one, from the data received from the receiving module or the data stored in the storing module, to M number of target systems.

Description

Integrated replication system {INTEGRATED REPLICATION SYSTEM}

The present invention relates to an integrated replication system, and more particularly, to a real-time integrated replication system between heterogeneous databases for transferring, transferring, and integrating various databases.

With the recent diversification of fixed and unstructured databases, the information management environment is becoming more complicated and confronts the need to manage data comprehensively in various IT environments.

With the advent of the Big Data era, in infinite data environments scattered in various forms, it has become a challenge for companies to gain valuable information through meaningful data by leading enterprise data integration for business success.

In addition, as data continues to grow explosively in the recent enterprise and at the same time real-time-based services continue to increase, many companies are always looking to maintain a flexible IT infrastructure.

In addition, due to the rapid development of the cloud and big data industries, there is a growing demand for integrated management systems for organizing, moving, and analyzing rapidly growing data.

In recent years, as database products have diversified and cloud-based markets have grown, demand for product conversion and migration, interoperability, and rapid conversion of data has increased, necessitating logical data extraction and replication tools.

However, existing products at present have various functions, but they are not a good alternative in the cloud market.

The present invention is intended to provide a system capable of minimizing the load on a database server and a network through a technique of ensuring consistency of replicated data and a modified data replication technique.

The present invention also provides a system capable of increasing the availability of data between heterogeneous databases by simplifying complexity in a large structure composed of a plurality of source systems and target systems.

According to an aspect of the invention, an integrated replication system comprises: a receiving module for receiving data from N source systems; A processing module for processing the received data according to a predetermined criterion; A storage module for storing data received from the receiving module; And a transmission module that transmits at least one of data received from the receiving module or data stored in the storage module to M target systems.

The processing module may be configured to process the data received through the receiving module into a first mode for directly sending the data to the transmitting module or send data received through the receiving module to the transmitting module and store the data in the storing module 2 mode.

The processing module may process the data stored in the storage module into three modes for sending the data to the transmission module.

The integrated replication system may further comprise: a receiving agent module for preparing a task of receiving data from the source system; And a transmission agent module for preparing a task of transmitting data to the target system, wherein the processing module receives a data reception task preparation completion signal from the reception agent module and a data transmission task preparation completion signal from the transmission agent module Upon receipt, data may be communicated to the source system and the target system via the receiving module and the sending module.

The reception agent module and the transmission agent module may transmit and receive data independently of the reception module and the transmission module.

The reception agent module and the transmission agent module transmit and receive data in the HTTP mode, and the reception module and the transmission module can transmit and receive data in a message queue system.

The processing module may selectively apply the first mode, the second mode and the third mode to a part of the M target systems in parallel in accordance with a preset reference, In the case of the second mode, it is recognized that the importance or usability is high and the data corresponding to the set or checked data is recognized by the administrator. And in the case of the third mode, when data is transmitted to each of the M target systems, existing stored data is used or reused.

According to an embodiment of the present invention, it is possible to provide a system capable of minimizing a load on a database server and a network through a technique of ensuring consistency of replicated data and a modified data replication technique.

In addition, according to an embodiment of the present invention, it is possible to provide a system capable of increasing the availability of data between heterogeneous databases by simplifying complexity in a large structure composed of a plurality of source systems and target systems.

1 is a view for explaining an integrated copy system according to an embodiment of the present invention.
FIG. 2 is a block diagram specifically illustrating the integrated replication system of FIG. 1; FIG.
FIG. 3 is a view for explaining a first mode scheme of an integrated replication system according to an embodiment of the present invention.
4 is a diagram for explaining a second mode scheme of the integrated replication system according to an embodiment of the present invention.
5 is a diagram for explaining a third mode scheme of the integrated replication system according to an embodiment of the present invention.

Specific structural or functional descriptions of embodiments of the invention disclosed in the specification or the application are illustrative only for the purpose of illustrating embodiments of the invention and the embodiments according to the invention may be embodied in various forms, And should not be construed as limited to the embodiments set forth herein or in the application.

The embodiments according to the present invention are susceptible to various changes and may take various forms, so that specific embodiments are illustrated in the drawings and described in detail in this specification or application. It is to be understood, however, that it is not intended to limit the embodiments according to the concepts of the present invention to the particular forms of disclosure, but includes all modifications, equivalents, and alternatives falling within the spirit and scope of the present invention.

The terms first and / or second, etc. may be used to describe various components, but the components should not be limited by the terms. The terms are intended to distinguish one element from another, for example, without departing from the scope of the invention in accordance with the concepts of the present invention, the first element may be termed the second element, The second component may also be referred to as a first component.

It is to be understood that when an element is referred to as being "connected" or "connected" to another element, it may be directly connected or connected to the other element, . On the other hand, when an element is referred to as being "directly connected" or "directly connected" to another element, it should be understood that there are no other elements in between. Other expressions that describe the relationship between components, such as "between" and "between" or "neighboring to" and "directly adjacent to" should be interpreted as well.

The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. The singular expressions include plural expressions unless the context clearly dictates otherwise. In this specification, the terms " comprises ", or " having ", or the like, specify that there is a stated feature, number, step, operation, , Steps, operations, components, parts, or combinations thereof, as a matter of principle.

Unless defined otherwise, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. Terms such as those defined in commonly used dictionaries are to be interpreted as having a meaning consistent with the contextual meaning of the related art and are to be interpreted as ideal or overly formal in the sense of the art unless explicitly defined herein Do not.

BEST MODE FOR CARRYING OUT THE INVENTION Hereinafter, the present invention will be described in detail with reference to the preferred embodiments of the present invention with reference to the accompanying drawings. Like reference symbols in the drawings denote like elements.

1 is a view for explaining an integrated copy system according to an embodiment of the present invention.

Referring to Figure 1, an integrated replication system 300 is coupled to a source system 100 and a target system 200 via a network 400 and performs replication of data from the source system 100 to the target system 200 .

The network 400 may include communication links known to those of ordinary skill in the art, such as the Internet, a computer network, and may include telephone or cable services, wireless or satellite services, and the like.

The source system 100 and the target system 200 organize and store data according to a database management system (DBMS).

The integrated replication system 300 stores data collected through the reception module 310 in a database. System software that is responsible for communication between a client and a server, or system software that is responsible for connecting a computer to a computer. Such an integrated replication system 300 provides an extension function between heterogeneous components, and allows a procedure of a specific application program to be called by another application program, or an object of an application program can be distributed and shared among heterogeneous networks , Or to deliver and exchange messages and data between distributed applications.

The integrated replication system 300 of the present invention extracts log data from a log of a database of a source system, transfers the log data to a database of the target system, and applies real-time conversion to SQL according to the format of the database. In addition, a management system for confirming the setting and the status is provided. The user can easily set and change the transmission target through the monitoring and management program. Then, data can be mapped between the source system 100 and the target system 200.

As described above, the integrated replication system 300 can simplify complexity in a large scale structure having a plurality of the source system 100 and the target system 200, and efficiently transmit / receive data between the systems.

In other words, the integrated replication system 300 can minimize the load on the source system 100 and the target system 200, and can reduce complexity in a structure including a plurality of source systems 100 and a plurality of target systems 200 The availability of data between heterogeneous databases can be increased.

The integrated replication system 300 will be described in more detail below.

FIG. 2 is a block diagram specifically illustrating the integrated replication system of FIG. 1; FIG.

2, the integrated replication system 300 includes a receiving module 310, a processing module 320, a storage module 330, a sending module 340, a receiving agent module 350, and a sending agent module 360, .

In the present invention, the integrated replication system 300 has a communication interface for performing communication with each server, and the integrated replication system 300 can store the received contents.

More specifically, the integrated replication system 300 selects target data from extracted data, sets it as extracted data, selects an object to be transmitted, and sets mapping information of the target system 200. The integrated replication system 300 extracts the changed data from the extraction target according to the set value, and transmits and extracts the changed data.

The receiving module 310 receives data from N (N is a natural number of 2 or more) source systems 100.

The processing module 320 processes the received data according to a predetermined criterion. The processing module 320 may selectively apply a first mode, a second mode and a third mode to be described later according to a situation according to preset criteria (for example, importance, usability, or user's business characteristics, etc.) And can selectively apply to some or all of the target systems. For example, if the data is pre-set or checked by the administrator or the user as having high importance or usability, the data can be applied to the second mode for backup, and the first mode if not.

In addition, when data is transmitted to each of two or more target systems, when the use of two or more target systems is determined to be different from each other, or when previously stored data is used, the third mode may be applied. Here, the processing module 320 may apply the first mode and the second mode in parallel. For example, when data is transmitted to each of two or more target systems, some of the two or more target systems may be applied to the first mode, the second mode to the second mode, and the third mode to the other. As a result, the system can be operated in accordance with the purpose and efficiency.

Details regarding the processing module 320 will be described later with FIGS. 3 to 5.

The storage module 330 stores data received from the receiving module 310. [

The transmission module transmits at least one of the data received from the reception module 310 or the data stored in the storage module 330 to M (M is a natural number of 2 or more) target systems 200.

In accordance with an embodiment of the present invention, the integrated replication system 300 replicates data in real time and reflects concurrent transactions by multiple users in the source system to the target system 200 in real time. Here, the data processing of the transmitting module 340 and the receiving module 310 uses a method of sequentially processing data (for example, a Queue method) without using a multiple processing method.

According to one embodiment of the present invention, the integrated replication system 300 further includes a receiving agent module 350 and a sending agent module 360. [ The receiving agent module 350 prepares to receive data from the source system 100, and the sending agent module 360 prepares to send data to the target system.

For example, when the processing module 320 receives the data reception job completion signal and the data transmission job completion signal from the transmission agent module 360 from the reception agent module 350, the reception module 310 and the transmission module 340 To process the data. Herein, the reception agent module 350 and the transmission agent module 360 constitute independent channels from the reception module 310 and the transmission module 340 to transmit and receive data.

The reason for using the separate receiving agent module 350 and the sending agent module 360 is to satisfy the accuracy of the received data transmission and the transmission quality.

According to one embodiment of the present invention, the receiving agent module 350 and the sending agent module 360 may communicate using the HTTP protocol, and the receiving module 310 and the transmitting module 340 may communicate with each other using a Message Queue (MQ) . ≪ / RTI > Such a configuration secures compatibility and scalability of communication for monitoring information using the HTTP method, and improves the transmission speed and accuracy, which is a disadvantage of the HTTP method, by using the MQ method.

In other words, when the preparation for transmission / reception is completed through the reception agent module 350 and the transmission agent module 360, the integrated replication system 300 performs an actual data transmission / reception operation through the reception module 310 and the transmission module 340 .

The integrated replication system 300 of the present invention can selectively apply the first mode, the second mode, and the third mode according to a situation according to preset criteria (for example, system format, user's job characteristics, etc.) Specifically, it is possible to selectively operate the first mode, the second mode and the third mode. Hereinafter, this will be described later with reference to Figs.

FIG. 3 is a view for explaining a first mode scheme of an integrated replication system according to an embodiment of the present invention.

Referring to FIG. 3, the processing module 320 may determine a first mode of directing data received via the receiving module 310 to the transmitting module 340. The data of the source system 1 is immediately received without being received and transmitted to the target system 1.

4 is a diagram for explaining a second mode scheme of the integrated replication system according to an embodiment of the present invention.

Referring to FIG. 4, the processing module 320 sends data received through the receiving module 310 to the transmitting module 340 and transmits the data received through the receiving module 310 to the storing module 330 It is possible to confirm the second mode for storing the data.

By storing the data received from the receiving module 310 in the storage module 330, it is possible to anticipate the data loss prevention effect. If the data transmitted through the transmission module 340 fails to reach the target point due to a failure of the network 400 or the target system 200, the data can be recovered through the data stored in the storage module 330. For example, it is the back-up function of the server.

5 is a diagram for explaining a third mode scheme of the integrated replication system according to an embodiment of the present invention.

Referring to FIG. 5, the processing module 320 can confirm a third mode of transmitting data stored in the storage module 330 to the transmission module 340.

According to an embodiment of the present invention, the processing module 320 may send the data to the transmission module 340 according to the format of the target system 200, thereby increasing compatibility and availability of data between the heterogeneous databases. For example, one target system 200 may be a system used in a management support system including business and decision making, and the other target system 200 may be a system used in a system development department. In this case, the format of each server may be different because it is used for different purposes. Therefore, the integrated replication system 300 of the present invention can transfer one source database to a plurality of target databases, thereby making it possible to utilize various kinds of data among heterogeneous databases.

There is no data conversion when the data stored in the third mode is transmitted to the target system by the transmission module.

As described with reference to FIGS. 3 to 5, the first mode, the second mode and the third mode of the integrated replication system are independently performed. With the above configuration of the integrated replication system, it is possible to flexibly handle transmission and reception of N: M receiving data from N source systems 100 and transmitting data to M target systems 200, Since all the data of the target system 100 and the target system 200 are stored in the integrated replication system 300, it is effective to monitor and manage the data.

When transferring data from one source system 100 to a plurality of target systems 200, the inventive integrated replication system 300 can reduce the load on the transmission of the source system 100 have.

The present invention can also be embodied as computer-readable codes on a computer-readable recording medium. A computer-readable recording medium includes all kinds of recording apparatuses in which data that can be read by a computer system is stored.

Examples of the computer-readable recording medium include a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like. (E.g., transmission over the Internet).

The computer readable recording medium may also be distributed over a networked computer system so that computer readable code can be stored and executed in a distributed manner. And functional programs, codes, and code segments for implementing the present invention can be easily inferred by programmers skilled in the art to which the present invention pertains.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed embodiments, but, on the contrary, is intended to cover various modifications and equivalent arrangements included within the spirit and scope of the appended claims.

Accordingly, the true scope of the present invention should be determined by the technical idea of the appended claims.

100: Source system
200: Target system
300: Integrated replication system
310: receiving module
320: Processing module
330: Storage module
340: Transmission module
350: Receive Agent Module
360: Transmission Agent Module
400: Network

Claims (7)

A receiving module for receiving data from the N source systems;
A processing module for processing the received data according to a predetermined criterion;
A storage module for storing data received from the receiving module; And
A transmission module for transmitting at least one of data received from the reception module or data stored in the storage module to M target systems;
A receiving agent module for preparing to receive data from the N source systems; And
Further comprising a sending agent module for preparing to send data to the M target systems,
The processing module comprises:
Upon reception of a data reception task preparation completion signal from the reception agent module and a data transmission task preparation completion signal from the transmission agent module, transmits data through the reception module and the transmission module to the N source system and the M target systems To-
Wherein the processing module processes the data received through the receiving module into a first mode for directly sending the data to the transmitting module or transmits the data received through the receiving module to the transmitting module and stores the data in the storing module , ≪ / RTI &
Wherein the processing module processes the data stored in the storage module into a third mode for sending the data to the transmission module in accordance with the format of the M target systems, The third mode is applied when it is judged that they are different according to the criterion,
The processing module comprises:
The first mode, the second mode and the third mode are selectively applied in parallel to a part of the M target systems in accordance with a preset reference, wherein the first mode, the second mode and the third mode are respectively independent Performed -
The preset reference may include:
In the case of the first mode, it is recognized that the importance or usability is not high by the administrator, and corresponds to data that is not set or checked,
In the case of the second mode, it is recognized that the importance or usability is high by the administrator and corresponds to the set or checked data,
(N, M is a natural number of 2 or more) when the data is transmitted to each of the M target systems in the third mode. delete delete delete The method according to claim 1,
The receiving agent module and the sending agent module,
And an integrated replication system for transmitting and receiving data independently of the reception module and the transmission module. 6. The method of claim 5,
Wherein the reception agent module and the transmission agent module transmit and receive data by the HTTP method,
Wherein the receiving module and the transmitting module transmit and receive data in a Message Queue manner. delete

Images