JP2009199197A - Computer system, data matching method and data matching program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a fault-tolerant computer system that ensures consistency between memory data in operating computers and that in other computers without stopping the operating computers to continue processing. <P>SOLUTION: (1) A snapshot of all the data in a memory of an operating source computer at a certain time point is acquired, transferred to a destination computer and written to a memory of the destination computer. (2) In the process of (1), the data updated in the memory of the source computer is continuously monitored, and differential data on detected updates is repeatedly transferred to the destination computer and written to the memory of the destination computer. (3) When the size of the differential data becomes smaller than that to be stored in one transmission message, the last differential data is transferred and written to the memory of the destination computer, and the processing of the destination computer is restarted in synchronism with the source computer. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention provides a computer system having a plurality of independent memory hierarchy management mechanisms interconnected via a network and configured by a computer in which a user program updates memory data. The present invention relates to the process of matching the memory data of the operating computer with another computer without stopping and continuing the processing, and shifting the matched computer to the execution state in the system.

  In a duplex computer system that simultaneously processes the same data sent from multiple subsystems on two host computers, synchronization of processing data when starting duplex operation, that is, copying master processing data to a slave system A slave-embedding method for a duplex computer system (see Patent Document 1) characterized in that the processing (this processing is referred to as “slave incorporation processing”) is performed using two disk devices and an inter-system communication path. Has been proposed.

Japanese Patent Laid-Open No. 11-73278

  In the above prior art, when performing data matching between computers without stopping the operating computers, even if data is copied from the operating computer to the copy destination computer, the running state of the operating computer is Depending on the data update frequency, data may be updated on the copy source computer during data copy, and the data copied to the copy destination computer may be different from the data on the copy source computer. Data matching may not be achieved.

  It is an object of the present invention to, in an operating computer system, to transfer the memory data of the computer at high speed regardless of the size of the memory data without interrupting the processing of the normally operating computer. It is to provide a system, method and program for matching data.

  According to the present invention, when the data transfer source computer processing device updates data in the memory of the data transfer source computer, the size of the updated data does not exceed the size of data that can be transferred in one transfer message. Until the updated data is divided and inserted into multiple transfer messages and transferred to the data transfer destination computer, the update is performed when the size of the updated data does not exceed the size of data that can be transferred with one transfer message. The inserted data is inserted into one message and transferred to the data transfer destination computer, and the processing device of the data transfer destination computer starts processing the data using the memory of the data transfer destination computer according to the program. Features. Preferably, when the processing device of the data transfer source computer receives a predetermined request from the data transfer destination computer, the data in the memory of the data transfer source computer is read and the data size can be transferred by one transfer message Determines whether the data size is exceeded, and if the data size exceeds the data size that can be transferred in one transfer message, the data is divided and inserted into multiple transfer messages and transferred to the data transfer destination computer After the data is transferred to the data transfer destination computer, it is detected at a predetermined cycle whether the data in the memory of the data transfer source computer has been updated. If the data is updated, the updated data is transferred to the data transfer destination computer. Whether the size of the data read and updated from the memory of the original computer exceeds the size of data that can be transferred in one transfer message If the size of the updated data exceeds the size of data that can be transferred in one transfer message, the updated data is divided and inserted into multiple transfer messages and transferred to the data transfer destination computer. If the updated data size does not exceed the size of the data that can be transferred in one transfer message, the program is executed when the updated data size does not exceed the size of the data that can be transferred in one transfer message. While waiting for data processing according to the above, the updated data is inserted into one message and transferred to the data transfer destination computer, and a predetermined notification is transferred to the data transfer destination computer. The device sequentially writes the data received from the data transfer source computer and the updated data to the memory of the data transfer destination computer. When the predetermined notification is received, the updated data inserted into one message received from the data transfer source computer while waiting for data processing according to the program of the processing device of the data transfer source computer Is written in the memory of the data transfer destination computer, and based on a predetermined notification, data processing according to the program is started in synchronization with the data processing according to the program of the processing device of the data transfer source computer And

  Further, the present invention provides a computer system having a plurality of independent memory hierarchy management mechanisms interconnected via a network and configured by a computer in which a user program updates memory data. This is a method to match the memory data of the copy source computer without stopping and continuing the process. Extract all the memory data at a certain point in the copy source computer and transfer it to the copy destination computer. Writing all the extracted data into the memory of the copy destination computer with overwriting, monitoring the update of memory data by processing of a user program in the copy source computer according to the hierarchy, and the update monitoring Transfer only the difference of the memory data detected by the above to the copy destination computer, and overwrite the corresponding part of the memory data. Repeat to write the forgiveness and a step.

  According to the present invention, in an operating computer system, the memory data of the computer can be transferred at high speed regardless of the size of the memory data without interrupting the processing of the normally operating computer. It is possible to match the data, and it is possible to maintain the reliability of the computer system and to guarantee the non-stop of the service executed and provided by the system.

  FIG. 1 is directed to a computer system having a plurality of independent memory hierarchy management mechanisms interconnected via a network according to the present invention and configured by a computer in which a user program updates memory data. It is a figure which shows the outline | summary of the memory data matching method between computers which have the hierarchy management mechanism of a memory to implement.

  The main components are a copy source computer 0111, a user program 0121 that operates on the copy destination computer 0112 and the copy source computer 0111, a memory 0131 that updates data while the user program 0121 is processing, and a copy destination computer 0112. An operating user program 0122, and a memory 0132 for updating data during the processing of the user program 0122. The storage capacity of the memory 0131 and the memory 0132 is, for example, 8 Gbytes.

  The memory data matching method between computers having a memory hierarchy management mechanism according to the present invention has three stages: “all data copy” (0101), “difference data copy” (0102), and “final copy” (0103). To implement.

  In the first stage “all data copy” (0101), a snapshot of all data at a certain point in the memory 0131 of the copy source computer 0111 (a set of data on the memory is collected as it is) is taken and the data is copied to Transfer to computer 0112. The copy destination computer 0112 receives all the transferred data, and writes to the memory 0132 of the copy destination computer 0112 with overwriting permitted (0141). Regarding the transfer, if it is determined that the size of all data in the memory 0131 is larger than a predetermined threshold, the data is divided into a plurality of messages and transmitted. Here, the user program 0121 is operating in the copy source computer 0111 and updates the data in the memory 0131, but the user program 0122 is not operating in the copy destination computer 0112. Therefore, the data of the memory 0131 of the copy source computer 0111 can be updated even during the process of transferring all the data and writing to the memory 0132 of the copy destination computer 0112.

  In the second stage “difference data copy” (0102), the copy source computer 0111 monitors the data update to the memory 0121 during the execution of the first stage (0151), and the detected update location data is stored in the memory. The data extracted from 0121 and transferred to the copy destination computer 0112 as difference data from the data copied in the first stage (0101). At 0112, the copy destination computer receives the transferred difference data, and writes to the corresponding portion of the memory 0132 of the copy destination computer 0112 with overwriting permitted (0142). Regarding the transfer, when it is determined that the difference data has a size larger than a predetermined threshold, the difference data is divided into a plurality of messages and transmitted. Even during the above-described extraction, transfer, and writing of the difference data to the memory 0132 of the copy destination computer 0112, the copy source computer 0111 further updates the data to the memory 0131 by the operating user program 0121. The For this reason, monitoring of data update to the memory 0131, extraction of the difference data, transfer to the copy destination computer 0112, and writing of the difference data to the memory 0132 of the copy destination computer 0112 are repeatedly performed.

  The time required for a series of processes of data extraction from the memory 0131 in the copy source computer 0111, transfer to the copy destination computer 0112, and writing to the memory 0132 of the copy destination computer 0112 is defined as data copy time (0161, 0162). , 0163). Most of the data copy time occupies the transfer time from the copy source computer 0111 to the copy destination computer 0112, and the size of the data copy time is proportional to the size of the data to be transferred. Therefore, in the second stage (0102), if the extraction of the difference data, the transfer to the copy destination computer 0112, and the writing of the difference data to the memory 0132 of the copy destination computer 0112 are repeatedly executed, The size of the difference data decreases, and the data copy time 0162 per time decreases accordingly.

  Here, when the data copy time (data transfer time) becomes the minimum, that is, when the size of the difference data becomes smaller than the size that can be stored in one transmission message, the “final copy” (from the second stage 0102 to the third stage) 0103).

  In the third stage 0103, the user program 0121 of the copy source computer 0111 is temporarily stopped (0171), and the difference data whose size can be stored in the one transmission message (for example, 1 Mbyte) or less is transferred to the copy destination computer 0112. The transfer and writing of the difference data to the memory 0132 of the copy destination computer 0112 (0143) is performed. In this process, the transfer and writing of the difference data is the last, and the memory data matching is completed (0172). Thereafter, the processing of the user program (0121, 0122) is resumed after synchronization is established between the copy source computer 0111 and the copy destination computer 0112, that is, at the same timing (0173).

  In the above, the user program operates periodically, and there is a waiting time between the end of processing in one cycle and the next cycle. Therefore, the user program 0121 is temporarily stopped at 0171 during the standby time. The time required for the third stage 0103 needs to be within the waiting time of the user program. Therefore, the allowable range of the data copy time 0163 in the third stage 0103 is determined according to the operation specification of the user program.

  FIG. 2 is a sequence diagram showing the flow of processing for matching memory data between computers having a memory hierarchy management mechanism constituting a computer system according to the present invention.

  The main components are a matching processing unit 0203 for performing memory data matching processing in the copy source computer 0111, a memory 0131, a user program 0121 for updating data in the memory 0131, and a memory data match in the copy destination computer 0112. 4 are a matching processing unit 0204 that performs data processing, a memory 0132, and a user program 0122 that updates data in the memory 0132.

  In the copy destination computer 0112, at 0261, the user program 0122 completes the initialization process and enters a standby state. In 0241, the matching processing unit 0204 transmits a matching start request to the matching processing unit 0203 of the copy source computer 0111.

  In the copy source computer 0111, when the matching processing unit 0203 receives the matching start request from the matching processing unit 0204 of the copy destination computer 0112, in 0231, all the memory data is read from the memory 0131 and stored in the buffer area. Accumulate temporarily. The buffer area is preferably formed in an area different from the memory 0131 on the storage device (memory). In 0232, all the memory data read in 0231 is transferred to the copy destination computer 0112. When the matching processing unit 0204 of the copy destination computer 0112 receives all the memory data transferred from the copy source computer 0111, the entire memory data is written to the memory 0132 with overwriting at 0242. As a result, the same data exists at the same address on the memory 0131 and the memory 0132.

  The copy source computer 0111 reads all memory data at 0231, transfers all the memory data to the copy destination computer 0112 at 0232, and writes to the memory 0132 of the copy destination computer 0112 at 0242. The user program 0121 is in operation and can update data in the memory 0131 in the course of processing (0251, 0252). For this reason, there is a possibility that the data content of the memory 0132 of the copy destination computer 0112 at the time of completing the processing of 0231, 0232, 0242 is different from the memory 0131 of the copy source computer 0111. Therefore, in 0233, when the matching processing unit 0203 detects data update of the memory 0131 after transferring all the memory data, the data at the updated portion is read as difference data. In 0234, the difference data read in 0233 is transferred to the copy destination computer 0112. When the matching processing unit 0204 of the copy destination computer 0112 receives the difference data transferred from the copy source computer 0111, the difference data is written to the memory 0132 with overwriting at 0243. Thereafter, the update data is read by the copy source computer 0111, the difference data is read and transferred to the copy destination computer 0112, and the difference data is written by the copy destination computer 0112 (0235, 0236, 0244). Repeat until.

  In 0237, when the matching processing unit 0203 of the copy source computer 0111 has no difference data and determines completion of memory data matching, it notifies the copy destination computer 0112. In the copy destination computer 0112, the process of the user program 0122 is resumed in 0262.

  FIG. 3 is a diagram showing a module configuration of a computer that constitutes a computer system and executes processing for an external request in the present invention.

  The computer 0300 includes processing such as a user program 0301 that executes processing for a request from an external system and returns a response, a memory 0302 that the user program 0301 reads and writes during processing, and memory data matching between computers. A matching processing unit 0303 is introduced. Reading and writing of data to the memory 0302 by the user program 0301 is realized by a CPU that processes according to the user program 0301, and the matching processing unit 0303 is realized by a CPU that processes according to the matching processing program.

  The main component of the matching processing unit 0303 monitors the data update to the memory 0302 by the user program 0301, and sequentially records information about the update location using the page update management table 0341 and the group management table 0342 when an update is detected. Refers to the update monitoring unit 0331, the page update management table 0341, a data transfer / write unit 0332 for performing processing for memory data matching between computers, and a temporary user program according to the progress of the memory data matching processing There is a user program execution management unit 0333 that performs control such as stop, processing restart, and synchronization between computers, and a data communication unit 0334 that performs communication with other computers 0300 in the system via the communication medium 0305. The monitoring of the update may be performed at the same cycle as the processing cycle of the user program, or may be performed at a cycle shorter than the processing cycle of the user program.

  In the memory data matching process, in the computer 0300 serving as the copy source, the data transfer / write unit 0332 reads all the data in the memory 0302 and transfers the data to the copy destination computer via the data communication unit 0334, or With reference to the page update management table 0341, processing such as reading of data at the update location and transfer of the data to the copy destination computer via the data communication unit 0334 is performed. On the other hand, in the computer 0300 as the copy destination, the data transfer / write unit 0332 receives the data transferred from the data transfer / write unit 0332 of the copy source computer and writes the data to the memory 0302.

  FIG. 4 is a diagram showing a group structure for allocating pages for monitoring the update of memory data hierarchically managed by a computer in the present invention.

  Main components are a node 0401 assigned to each page (0, 1, 2,..., M, m + 1, m + 2,...) Constituting the memory 0302, and a plurality of nodes 0401 without duplication. Group 0402 to be formed.

  A node 0401 assigned to each individual page constituting the memory 0302 detects and records the occurrence location of data update to the memory 0302 by the user program 0301 in units of pages. Note that the size of the page constituting the memory 0302 is determined by the specifications of the processor or OS, and is 4 kbytes, for example.

  The group 0402 detects and records whether or not one or more of the data update occurrences recorded exist among the plurality of nodes 0401 included in each group. Here, if at least one of the pages mapped to the node 0401 included in the group 0402 has been updated, the occurrence of data update is recorded in the group 0402.

  As an example of the detection / recording of data update to the memory 0302 using the node 0401 and the group 0402, the node 0401 has a dirty value whose value is set by hardware for each page when data update to the page occurs. A bit is available. It is assumed that the dirty bit is cleared when reading the data of the page that has been updated. The group 0402 can use write protection that generates an exception process when a write process to the memory 0302 is performed. Using the write protection, flag information indicating whether or not data update has occurred is recorded for each group 0402. The details of the table for recording the flag information related to the occurrence of data update of the group 0402 is shown in FIG. 5A. Dirty bits are stored on a page for each page, while write protection is stored in a table that manages write protection for multiple groups. Therefore, because the number is large and it is necessary to access the page area, it takes time to search for dirty bits, but the number is small and it is only necessary to search in the table. Does not take time.

  FIG. 5A is a diagram showing a group update management table for managing presence / absence of update for each group of pages constituting the memory in the copy source computer in the present invention.

  The main components of the group update management table 0501 are a group 0511 and an update flag 0512.

  Group 0511 stores identification information of a group in which a plurality of pages constituting the memory 0302 are allocated without duplication. The update flag 0512 stores flag information indicating whether or not data update has occurred in at least one page included in the group corresponding to the information stored in the group 0511. In the example shown in the figure, a value of “TRUE” is stored in a group including at least one page in which data update has occurred, and a value of “FALSE” is stored if no data update has occurred in all pages in the group. When the value of the update flag 0512 is “TRUE”, the update flag 0512 is referred to once, and is reset at the time of searching and referring to the page in which the update is detected from the pages included in the corresponding group. Then store the value of “FALSE”.

  FIG. 5B is a diagram showing a page update management table for managing the update location of memory data and the transfer state of difference data in the copy source computer in the present invention.

  The main components of the page update management table 0502 are a group 0521, an address 0522, a detection time 0523, and a status 0524.

  Group 0521 stores identification information of a group including a page in which data update is detected. Even if it is within the same group, if the updated page is different, it is considered as another record. The information stored in the group 0521 corresponds to the group 0511 of the group update management table 0501. Address 0522 stores the address of the page where the data update is detected. In the detection time 0523, the time when the data update is detected in the page of the address stored in the address 0522 is stored. The status 0524 stores a status relating to the transfer state of the difference data due to the data update of the page. If the difference data is extracted from the memory area and transferred to the copy destination computer, the value is “SENT”, “SENDING” if the transfer process is in progress, and “NOT-SEND” if the transfer process has not been executed yet. Stored.

  FIG. 6 is a flowchart showing the flow of processing for detecting update of memory data in the copy source computer in the present invention.

  In 0601, the group update management table in the copy source computer is referred to. In 0602, if there is a group having an update as a result of 0601, in 0603, the update record of the node corresponding to each page belonging to the group is referred to. In 0604, if there is a page with an update as a result of 0603, in 0605, information regarding the page with the update which is the corresponding part is added to the page update management table. In 0602, if there is no updated group as a result of 0601, the processing from 0603 to 0605 is not performed. In 0604, if there is no updated page as a result of 0603, the process of 0605 is not performed. In 0606, when the confirmation of the group management table is not completed for all groups, the processing from 0601 to 0605 is repeated. If the confirmation of the group management table has been completed for all groups in 0606, if the memory matching process has been completed in 0607, the process ends. If the memory matching process is not completed in 0607, the process from 0601 is repeated after waiting for a designated time in 0608.

  FIG. 7 is a flowchart showing a flow of processing for transferring the difference data extracted by detecting update of memory data in the copy source computer to the copy destination computer in the present invention.

  In 0701, information on the area related to one group in the page update management table is read. In 0702, if there is an update location in the page belonging to the group as a result of 0701, the information of the page update management table is referred to in 0706, and the data of the corresponding page is extracted from the memory as difference data. In 0707, when the application operation is being monitored, in 0708, when the application is operating, it waits until the application enters a standby state. If the application is waiting at 0708, the difference data extracted at 0706 is stored in the transfer message at 0709. If the size of the difference data exceeds the size that can be stored in one transfer message, the difference data is divided into a plurality of messages and stored. In 0707, when the application operation is not monitored, the processing of 0709 is performed without performing the processing of 0708. In 0710, the message generated in 0709 is transmitted to the copy destination computer. If the transmission of all the difference data extracted in 0706 is not completed in 0711, the processing from 0707 to 0710 is repeated. If the transmission of all the difference data extracted in 0706 is completed in 0711, the process from 0701 is repeated if the reading of the area information regarding all groups in the page update management table is not completed in 0703. In 0702, if the result of 0701 is that there is no update location in the page belonging to the group, the processing of 0703 is performed. In 0703, when the reading of the area information regarding all the groups in the page update management table has been completed, in 0704, when the memory matching process has been completed, the process ends. If the memory matching process is not completed in 0704, the process from 0701 is repeated after waiting for a specified time in 0705. The waiting time is specified in advance according to the update frequency of the memory data by the application.

  By monitoring application operations at 0707 and 0708 and performing data transmission processing while waiting for application processing, the load on the copy source computer can be reduced and the amount of data difference due to data update can be reduced early. .

  FIG. 8 is a flowchart showing a flow of processing for writing the difference data received from the copy source computer to the memory by the copy destination computer in the present invention.

  The copy destination computer waits for a message transmitted from the copy source computer. In 0801, the message is received. If the type of the message received in 0801 is “all data” in 0802, data is extracted from the received message in 0803. In 0804, the data extracted in 0803 is written into the corresponding location in the memory (the same address as the address in the memory of the copy source computer). Thereafter, the message reception waiting state from the copy source computer is entered, and the processing from 0801 is repeated. If the type of the message received at 0801 is “difference data”, at 0805, one difference data is extracted from one or more difference data included in the received message. In 0806, the difference data extracted in 0805 is written to the corresponding location in the memory (the same address as the address in the memory of the copy source computer). In 0807, when extraction of all the difference data from the received message is completed, a message reception waiting state from the copy source computer is entered, and the processing from 0801 is repeated. If the extraction of all the difference data from the received message is not completed in 0807, the processes of 0805 and 0806 are repeated. If the type of the message received in 0801 is “notice of end notice”, in 0808, end processing such as end of communication and backup of necessary data is performed, and the processing ends.

  FIG. 9 is a fault tolerant computer system configured by a plurality of independent nodes interconnected via a network (communication medium) to which the present invention is applied, and executing the same processing in parallel in each of the constituent nodes. It is a figure which shows the outline | summary. The node shown in FIG. 9 is a system component (for example, a computer) and is different from the node 0401 (directory node) shown in FIG.

  The main components of the fault tolerant computer system 0901 are two or more nodes 0911 interconnected via the LAN 0912, a gateway server 0913 connected to the wide area network 0902 and relaying communication with an external system, and the like.

  The fault tolerant computer system 0901 receives a request from an external system 0903 that can communicate via the wide area network 0902, performs processing for the request, and returns a service result to the external system 0903 as a response. provide. Here, the input message 0931 is received as a request from the external system 0903, and an output message 0941 storing the processing result for the request is transmitted to the external system 0903.

  Inside the fault tolerant computer system 0901, the gateway server 0913 that has received the input message 0931 as a request from the external system 0903 via the wide area network 0902 sends the input message 0932 to all the nodes 0911 in the system via the LAN 0912. Retransfer as. Here, almost all of the nodes 0911 receive the message, and the input message 0932 is broadcast so that the processing for the approximate message can be started. Each node 0911 that has received the input message 0932 executes processing for the input message 0932, and transmits an output message 0942 storing the processing result to the gateway server 0913 via the LAN 0912. The gateway server 0913 that has received the output message 0942 from each node 0911 creates an output message 0941 as a response to the requesting external system 0903 and transmits it to the external system 0903. Here, the gateway server 0913 performs comparison and collation of data contents of one or more output messages 0942 received from each node 0911, correctness determination, and the like, and transmits correct message data to the requesting external system 0903 as the output message 0941. To do.

  The main hardware configuration of the node 0911 includes a processing device (CPU) 0921, a storage device (memory, hard disk) 0922, and a communication device 0923. The storage device 0922 stores data necessary for executing a service provided to the external system 0903 by the fault-tolerant computer system 0901, and a user program for executing processing for a request from the external system 0903 regarding the service. A software program for performing synchronization during operation and re-installation among a plurality of nodes 0911, a software program for performing communication between the node 0911 and the gateway server 0913 via the LAN 0912, and the like. Processed by the processing device 0921. That is, predetermined processing is realized for predetermined data by reading and writing (including updating) predetermined data to and from the storage device according to the program. The memories 0131 and 0132 and the buffer are included in the storage device. The communication device 0923 receives the input message 0932 from the gateway server 0913, and performs communication processing for transmitting the output message 0942 to the gateway server 0913.

  In the fault tolerant computer system 0901, a plurality of nodes 0911 have the same hardware configuration and execute the same program in synchronization (in parallel). In addition, two or more nodes 0911 are included in the fault-tolerant computer system 0901, and the processing for the request from the external system 0903 is simultaneously executed by these to cause a failure in one or more nodes. Even in such a case, the remaining operating nodes execute processing, so that it is possible to maintain service provision by normal operation as a system, and to improve the fault tolerance and reliability of the system.

  FIG. 10 shows the difference between the detected memory areas divided into two or more operating computers in the present invention, and the update in the memory area shared by each computer is monitored as a copy source. It is a figure which shows the outline | summary of the process which transfers data to a copy destination computer, and performs writing.

  The main components are a plurality of computers operating in the system, the computers 1010, 1011, 1012, and the copy source computers and the LAN 0912 that share the memory area to be updated and are the copy source computers. The copy destination computers 0112 interconnected with each other. In the copy source computers 1010, 1011, and 1012, the user programs 1040, 1041, and 1042 perform the same processing at the same timing, respectively, and perform similar data updates on the memory areas 1020, 1021, and 1022 of the computers.

  Here, it is assumed that the copy source computers 1010, 1011, and 1012 share the areas 0, 1, and n as data update monitoring targets, and update and monitor only these shared areas among the memory areas. Therefore, when the copy source computer 1010 detects the data update in the area 0, the copy source computer 1010 transfers the difference data related to the area to the copy destination computer 0112 and writes it in the area 0 in the memory area 0132 of the copy destination computer 0112 (1030). ). When the copy source computer 1011 detects the data update in the area 1, the copy source computer 1011 transfers the difference data related to the area to the copy destination computer 0112, and writes it in the area 1 in the memory area 0132 of the copy destination computer 0112 (1031). . When the copy source computer 1012 detects the data update in the area n, the copy source computer 1012 transfers the difference data relating to the area to the copy destination computer 0112 and writes it in the area n in the memory area 0132 of the copy destination computer 0112 (1032). .

  As described above, by sharing the memory area subject to update monitoring to a plurality of computers, the processing load associated with the memory data matching processing in the copy source computer can be reduced.

  FIG. 11 is a flowchart showing a processing flow from the end of the memory data matching process between the copy source computer and the copy destination computer to the resumption of the processing of the user program in the copy destination computer in the present invention.

  In the copy source computer, in 1101, the update of the memory data is detected by the procedure shown in FIG. In 1102, the difference data by the update detected in 1101 is transferred to the copy destination computer according to the procedure shown in FIG. In 1103, it is determined whether or not the size of the difference data transferred in 1102 is equal to or larger than the specified threshold value. If the size of the difference data transferred in 1102 is equal to or larger than the specified threshold value, the processing of 1101 and 1102 is repeated. In step 1103, if the size of the difference data transferred in step 1102 is equal to or less than the specified threshold value, in step 1104, an end notice is transmitted to the copy destination computer. Here, the threshold value of the difference data size is the maximum amount of data that can be stored in one transmission message used for transfer from the copy source computer to the copy destination computer so that the time required to transfer the difference data is minimized. Size. The end notice notification is for informing in advance that the memory data matching process is ended with the difference data last transmitted in 1102. In 1105, the user program running on the copy source computer is temporarily stopped.

  In the copy destination computer, in 1111, the difference data transferred from the copy source computer in 1102 is received. In 1112, the difference data received in 1111 is written in the corresponding location in the memory of the copy destination computer. If the end notice notice transmitted from the copy source computer is not received in 1104 at 1113, the processing of 1111 and 1112 is repeated. In 1113, when the end notice notification transmitted from the copy source computer is received in 1104, the elapsed time of the data writing process to the memory performed in 1112 is measured in 1114, and the specified timeout occurs. In this case, the processing of 1111, 1112, 1113 is repeated. Here, the time-out time is determined according to the processing cycle of the user program (this is a cycle in which the user program updates data in the memory), the standby time, and the like. In 1114, the elapsed time of the data write process to the memory performed in 1112 is measured, and when the data write process in 1112 is completed before the timeout occurs, in 1115, the copy source computer is Send write completion notification. In 1116, the processing of the user program of the copy destination computer is resumed.

  In the copy source computer, in 1106, the process waits for reception of the write completion notification transmitted from the copy destination computer in 1115, and if a timeout occurs, the process of the user program suspended in 1105 is resumed in 1107. The processing from 1101 to 1106 is repeated. In 1106, when a write completion notification transmitted from the copy destination computer is received in 1115, in 1108, the process was temporarily stopped in 1105 in synchronization with the user program of the copy destination computer resumed in 1116. Resumes user program processing. As a method of synchronization, the processing start time of the user program of the copy destination computer is embedded in the write completion notification transmitted from the copy destination computer, and the copy source computer that received the write completion notification is within the copy source computer at the processing start time. The processing of the user program is resumed. In addition, as another method of synchronizing, the process restart time of the user program of the copy source computer (the next process time along the processing cycle of the active user program is included in the end notice transmitted from the copy source computer. The copy destination computer receiving the notice of completion notice starts processing of the user program in the copy destination computer at the processing resumption time.

  FIG. 12 is a diagram showing a flow of processing for verifying normal completion of memory data matching between the copy source computer and the copy destination computer in the present invention.

  The main components are operating in the system, and are connected to the copy source computer 0111 that is the copy source in the memory data matching process and the copy source computer 0111 via the LAN 0912, and in the memory data matching process. The copy destination computer 0112 is a copy destination.

  The copy source computer 0111 has a memory data matching target, the data is updated by the user program 0121, and has the same size and the same configuration as the memory area 0131 in addition to the memory area 0131 to be monitored for update. A spare memory area 1213 is prepared.

  In the memory data matching process, the copy source computer 0111 detects the update of the memory area 0131 (1221), transfers the difference data based on the update detection to the copy destination computer 0112, and stores the memory area 0132 of the copy destination computer 0112. When data is written in the corresponding location, the difference data based on the update detection is similarly written in the spare memory area 1213 in the copy source computer 0111 (1223). As a result, the spare memory area 1213 and the memory area 0132 of the copy destination computer 0112 should have the same data contents.

  When the memory data matching process ends, the copy source computer 0111 compares the data contents of the memory area 0131 and the spare memory area 1213. If the data contents of both areas are the same, the memory data matching is performed. It is determined that the process has been normally completed.

  With the above, verification of normal completion of memory data matching can be speeded up.

  FIG. 13 is a diagram showing a message format of transfer data transmitted from the copy source computer to the copy destination computer in the present invention.

  The main components of the message 1301 are header information 1311, identification information 1312, serial number 1313, number of data 1314, total data size 1315, and data area 1316.

  The header information 1311 stores information related to the message protocol and the like. The identification information 1312 stores identification information indicating whether this message is an all data transfer message, a differential data transfer message, or an end notice notification message. The serial number 1313 stores a serial number assigned to a message transmitted from the copy source computer to the copy destination computer. The number of data 1314 stores the number of data included in the data area 1316. The total data size 1315 stores the total size of data included in the data area 1316. The data area 1316 stores individual data (1321, 1322, 1323).

  The breakdown of the data (1321, 1322, 1323) stored in the data area 1316 is an address 1331, a data size 1332, and a data body 1333. The address 1331 stores an address in the memory area where the data is stored. The data size 1332 stores the size of the data. The data body 1333 stores the current value of the data extracted from the memory area.

  When the message 1301 is a differential data transfer message, the individual data (1321, 1322, 1323) stored in the data area 1316 is the individual differential data updated and extracted from the memory area. When the total size of the differential data updated and extracted from the memory area is larger than the maximum size that can be stored in the message, the differential data is divided and stored in a plurality of messages and transferred. When the message 1301 is a message for all data transfer, only one data is stored in the data area 1316, and data of a size that can be stored in the message is cut out from all the data and stored. When the size of all data is larger than the maximum size that can be stored in a message, the entire data is divided and stored in a plurality of messages and transferred. When the message 1301 is an end notice (notification of the end of matching process), the message includes only header information 1311 and identification information 1312 and no other information.

  As mentioned above, although embodiment of this invention was described concretely based on the embodiment, it is not limited to this and can be variously changed in the range which does not deviate from the summary.

  The present invention is applicable to a fault tolerant computer system.

A memory implemented according to the present invention for a computer system having a plurality of independent memory hierarchical management mechanisms interconnected via a network and configured by a computer in which a user program updates memory data. It is a figure which shows the outline | summary of the memory data matching method between computers which have the hierarchy management mechanism of. It is a sequence diagram which shows the flow of the process for memory data matching between the computers which have the hierarchy management mechanism of a memory which comprises the computer system in this invention. It is a figure which shows the module structure of the computer which comprises the computer system in this invention, and performs the process with respect to the request | requirement from the outside. It is a figure which shows the group structure which allocates a page for the update monitoring of the memory data hierarchically managed by the computer in this invention. It is a figure which shows the group update management table which manages the presence or absence of the update for every group of the page which comprises memory in a copy origin computer in this invention. It is a figure which shows the page update management table which manages the update location of memory data, and the transfer state of difference data in the copy source computer in this invention. It is a flowchart which shows the flow of a process which performs update detection of memory data in the copy source computer in this invention. 5 is a flowchart showing a flow of processing for transferring difference data extracted by detecting update of memory data in a copy source computer to a copy destination computer in the present invention. It is a flowchart which shows the flow of the process which writes in the memory the difference data received from the copy origin computer in the copy destination computer in this invention. 1 shows an overview of a fault-tolerant computer system that is configured by a plurality of independent nodes interconnected via a network (communication medium), to which the present invention is applied, and in which the same processing is executed in parallel in each of the configured nodes. FIG. In the present invention, the memory area is divided and assigned to two or more operating computers, the update in the memory area shared by each computer is monitored as a copy source, and the detected difference data is copied to the copy destination. It is a figure which shows the outline | summary of the process which transfers to a computer and performs writing. It is a flowchart which shows the flow of a process from the completion | finish of a memory data matching process between a copy source computer and a copy destination computer in the present invention to a user program process resumption in a copy destination computer. It is a figure which shows the flow of a process which verifies the normal completion of memory data matching between a copy source computer and a copy destination computer in this invention. It is a figure which shows the message format of the transfer data in this invention transmitted from a copy source computer to a copy destination computer in this invention.

Explanation of symbols

  0111, copy source computer, 0112, copy destination computer, 0121, user program, 0131, 0132, memory, 0122, user program.

Claims (15)

In a computer system having a plurality of computers connected to each other,
Each computer includes a processing device and a storage device,
The processing device of each computer can execute a program for processing data from outside the computer system and a matching processing program for processing data matching with other computers in the computer system.
The storage device of each computer includes a memory used when the processing device of each computer processes the data according to the program,
When the data on the memory of the data transfer source computer is updated according to the matching processing program, the processing device of the data transfer source computer in the computer system has a transfer message whose size of the updated data is one transfer message. The updated data is divided and inserted into a plurality of transfer messages and transferred to the data transfer destination computer in the computer system until the size of the data that can be transferred in the computer system is not exceeded. When the size of the data that can be transferred by one transfer message does not exceed the size, the updated data is inserted into the one message and transferred to the data transfer destination computer, and the processing device of the data transfer destination computer Starting the processing of the data using the memory of the data transfer destination computer according to the program Computer system, characterized in that. The computer system according to claim 1,
The processing device of the data transfer source computer, according to the matching processing program,
When a predetermined request is received from the data transfer destination computer, data in the memory of the data transfer source computer is read, and whether or not the size of the data exceeds the size of data that can be transferred in one transfer message Determining, if the size of the data exceeds the size of data that can be transferred in the one transfer message, the data is divided into a plurality of transfer messages and transferred to the data transfer destination computer,
After the data is transferred to the data transfer destination computer, it is detected at a predetermined cycle whether or not the data in the memory of the data transfer source computer has been updated, and when the data is updated, the updated data is Read from the memory of the data transfer source computer, determine whether the size of the updated data exceeds the size of data that can be transferred in one transfer message, and the size of the updated data is the one transfer When the size of the data that can be transferred by the message is exceeded, the updated data is divided and inserted into a plurality of transfer messages and transferred to the data transfer destination computer. Repeat until no more than the size of data that can be transferred in one transfer message,
When the size of the updated data does not exceed the size of data that can be transferred by the one transfer message, the updated data is transferred to the one message while waiting for processing of the data according to the program. And transfer it to the data transfer destination computer, transfer a predetermined notification to the data transfer destination computer,
The processing device of the data transfer destination computer, according to the matching processing program,
Sequentially writing the data received from the data transfer source computer and the updated data to the memory of the data transfer destination computer;
When the predetermined notification is received, it is inserted into the one message received from the data transfer source computer while waiting for the processing of the data according to the program of the processing device of the data transfer source computer Write the updated data to the memory of the data transfer destination computer,
A computer system which starts processing of the data according to the program in synchronization with the processing of the data according to the program of the processing device of the data transfer source computer based on the predetermined notification . A computer system including a plurality of computers connected to each other, each computer including a processing device and a storage device, and the processing device of each computer processing data from outside the computer system, And a matching processing program for processing data matching with other computers in the computer system, and the storage device of each computer processes the data according to the program by the processing device of each computer In a data matching method between computers executed on a computer system having a memory to be used at the time,
When the processing device of the data transfer source computer in the computer system updates the data in the memory of the data transfer source computer according to the matching processing program, the size of the updated data is one transfer message. The updated data is divided and inserted into a plurality of transfer messages and transferred to the data transfer destination computer in the computer system until the size of the data that can be transferred in the computer system is not exceeded. When the size of the data that can be transferred by one transfer message does not exceed the size, the updated data is inserted into the one message and transferred to the data transfer destination computer, and the processing device of the data transfer destination computer Starting the processing of the data using the memory of the data transfer destination computer according to the program Data matching method, characterized in that. The data matching method according to claim 3, wherein
The processing device of the data transfer source computer, according to the matching processing program,
When a predetermined request is received from the data transfer destination computer, data in the memory of the data transfer source computer is read, and whether or not the size of the data exceeds the size of data that can be transferred in one transfer message Determining, if the size of the data exceeds the size of data that can be transferred in the one transfer message, the data is divided into a plurality of transfer messages and transferred to the data transfer destination computer,
After the data is transferred to the data transfer destination computer, it is detected at a predetermined cycle whether or not the data in the memory of the data transfer source computer has been updated, and when the data is updated, the updated data is Read from the memory of the data transfer source computer, determine whether the size of the updated data exceeds the size of data that can be transferred in one transfer message, and the size of the updated data is the one transfer When the size of the data that can be transferred by the message is exceeded, the updated data is divided and inserted into a plurality of transfer messages and transferred to the data transfer destination computer. Repeat until no more than the size of data that can be transferred in one transfer message,
When the size of the updated data does not exceed the size of data that can be transferred by the one transfer message, the updated data is transferred to the one message while waiting for processing of the data according to the program. And insert it into the data transfer destination computer, transfer a predetermined notification to the data transfer destination computer,
The processing device of the data transfer destination computer, according to the matching processing program,
Sequentially writing the data received from the data transfer source computer and the updated data to the memory of the data transfer destination computer;
When the predetermined notification is received, it is inserted into the one message received from the data transfer source computer while waiting for the processing of the data according to the program of the processing device of the data transfer source computer Write the updated data to the memory of the data transfer destination computer,
Based on the predetermined notification, the processing of the data according to the program is started in synchronization with the processing of the data according to the program of the processing device of the data transfer source computer Method. A computer system including a plurality of computers connected to each other, each computer including a processing device and a storage device, and the processing device of each computer processing data from outside the computer system, And a matching processing program for processing data matching with other computers in the computer system, and the storage device of each computer processes the data according to the program by the processing device of each computer In a data matching processing program for causing a computer system having a memory to be used at the time to execute data matching processing between computers,
When the data in the memory of the data transfer source computer is updated in the processing device of the data transfer source computer in the computer system, the size of the updated data is the size of data that can be transferred in one transfer message The updated data can be divided and inserted into a plurality of transfer messages and transferred to the data transfer destination computer in the computer system until the size of the updated data is transferred by the one transfer message If the data size does not exceed the data size, the updated data is inserted into the one message and transferred to the data transfer destination computer, and the processing device of the data transfer destination computer is in accordance with the program. A process for starting processing of the data using a memory of a data transfer destination computer is executed. Over data match processing program. In the data matching processing program of claim 5,
In the processing device of the data transfer source computer,
When a predetermined request is received from the data transfer destination computer, data in the memory of the data transfer source computer is read, and whether or not the size of the data exceeds the size of data that can be transferred in one transfer message Determining, when the size of the data exceeds the size of data that can be transferred by the one transfer message, dividing and inserting the data into a plurality of transfer messages and transferring the data to the data transfer destination computer;
After the data is transferred to the data transfer destination computer, it is detected at a predetermined cycle whether or not the data in the memory of the data transfer source computer has been updated, and when the data is updated, the updated data is Read from the memory of the data transfer source computer, determine whether the size of the updated data exceeds the size of data that can be transferred in one transfer message, and the size of the updated data is the one transfer When the size of the data that can be transferred by the message is exceeded, the updated data is divided and inserted into a plurality of transfer messages and transferred to the data transfer destination computer. Processing until it does not exceed the size of data that can be transferred in one transfer message,
When the size of the updated data does not exceed the size of data that can be transferred by the one transfer message, the updated data is transferred to the one message while waiting for processing of the data according to the program. Is inserted into the data transfer destination computer and transferred to the data transfer destination computer, and a predetermined notification is transferred to the data transfer destination computer.
In the processing device of the data transfer destination computer,
A process of sequentially writing the data received from the data transfer source computer and the updated data to the memory of the data transfer destination computer;
When the predetermined notification is received, it is inserted into the one message received from the data transfer source computer while waiting for the processing of the data according to the program of the processing device of the data transfer source computer A process of writing the updated data into the memory of the data transfer destination computer;
Based on the predetermined notification, a process of starting the processing of the data according to the program is executed in synchronization with the processing of the data according to the program of the processing device of the data transfer source computer. A data matching program. In a computer system comprising a plurality of computers interconnected via a network, each computer is a computer system in which a program updates data in a memory, and in a memory data matching method for matching memory data between computers ,
Extracting all data in the memory at a certain point in the copy source computer, transferring it to the copy destination computer, and writing the extracted all data to the copy destination computer with overwriting, and
Monitoring the update of data on the memory by the processing of the program in the copy source computer;
Only the difference of the memory data detected by update monitoring is transferred to the copy destination computer, and the difference data by the update detection is written to the corresponding location on the memory of the copy destination computer with overwriting. And a step of repeating until no data on the memory is updated. The data matching method according to claim 7, wherein
Each computer manages data in memory hierarchically,
In order to monitor the update of the memory data by the processing of the program in the copy source computer, a plurality of pages constituting the memory are allocated to a group without overlapping each other for the memory data to be hierarchically managed, and the unit of the group The data matching method is characterized in that the data update is monitored and the update location is specified in units of pages from the pages included in the group only for the group in which the update is detected. The data matching method according to claim 8, wherein
A data matching method, characterized in that groups for allocating pages constituting a memory are arranged in multiple stages. The data matching method according to claim 7, wherein
A computer that performs transfer of difference data to a copy destination computer by detecting update of memory data in a copy source computer every time data update is detected in units of groups to which pages in the memory are allocated. Data matching method. The data matching method according to claim 7, wherein
When there are two or more computers operating in the computer system, the memory area is divided and allocated to two or more operating computers as copy source computers, and the memory area allocated by each computer is allocated. A data matching method, wherein data update is monitored, detected difference data is transferred to a copy destination computer, and written to a corresponding portion of memory data of the copy destination computer. In the data matching method according to claim 7 or 10,
When the computer system is a fault-tolerant computer system in which the same processing is executed in parallel in each of the constituting computers and the service provision by the system is performed without interruption, the difference data copy destination computer by the data update detection in the copy source computer The data matching method is characterized in that the operation of the program in the copy source computer is monitored, and the transfer is executed at a timing when the program is waiting and the memory data is not updated. The data matching method of claim 12, wherein
When the update detection amount of the memory data in the copy source computer operating in the fault tolerant computer is less than the size that can be stored in one transfer message, the program in the copy source computer is transmitted when the transfer message is transmitted. When the copy destination computer receives the transfer message and completes the writing of the memory data to the corresponding location, it is considered that the memory data matching is completed, and the data update detection in the copy source computer is completed. And end the differential data transfer,
A data matching method, comprising: resuming processing of the program in a copy destination computer in synchronization with a suspended program of the copy source computer. In the data matching method according to claim 7 or 13,
When the difference data is transferred to the copy destination computer by detecting the update of the memory data in the copy source computer, and the difference data is also written in the area in the copy source computer, and the update detection and the difference data transfer are finished. The data matching method characterized by verifying by. 15. The data matching method of claim 14, wherein
A data matching method comprising: notifying a copy destination computer when verification of data matching in a copy source computer is completed, and bringing the copy destination computer online in the computer system.

Images