JPWO2015097991A1 - Transaction distributed processing apparatus, method, system, and storage medium - Google Patents

Abstract

The present invention more reliably detects a uniqueness constraint violation while suppressing a decrease in scalability when log advance recording and data reflection of a transaction to be distributed are performed asynchronously. The transaction distribution processing device 30 includes a management data distribution holding unit 31, a transaction processing unit 32, and a delay reflection unit 34. The management data distribution holding unit 31 holds the management data distributed to the own device based on the violation detection key in association with the violation detection key while the processing target data is waiting to be reflected in the transaction log. When there is no other management data corresponding to the violation detection key in the distribution destination of the management data for the violation detection key in the transaction distributed to the own device, the transaction processing unit 32 transfers the management data to the violation The transaction log is recorded in advance after being stored in association with the detection key. The delay reflecting unit 34 reflects the transaction log on the data holding device 10.

Description

  The present invention relates to a distributed processing system that distributes transactions for data.

  There is known a distributed processing system that distributes transactions for data to a plurality of processing units and processes them in parallel.

  For example, such a distributed processing system is known that uses a data management technique called a key value store (KVS). The KVS sets a unique key corresponding to the data (value) to be saved. The KVS then writes a set of key and value, and reads the value by designating the key. KVS is characterized by excellent scalability and suitable for distributed processing.

  For example, Patent Document 1 describes a related technique related to distributed KVS. In this related technology, a management map is prepared for each server that processes transactions in a distributed manner. The management map holds a transaction ID as a key and a transaction state and a transaction ID waiting for completion as a value. This related technique uses a management map to manage the dependency relationship of locks between transactions, and realize distributed processing of transactions without causing rollback unnecessarily.

  Also, such a distributed processing system records a transaction log (WAL: Write Ahead Logging) in advance for each processing unit for processing a transaction in a distributed manner. The distributed processing system completes the transaction processing based on the preceding record of the transaction log. Then, the distributed processing system performs reflection on the actual data asynchronously with the transaction processing. As a result, such a distributed processing system realizes faster transaction processing.

JP2013-033345A

  However, in the distributed processing system that asynchronously performs prior recording and data reflection of the transaction log as described above, detection of occurrence of a constraint violation for a unique key has been performed at the time of data reflection. The key having uniqueness is a primary key, a unique key, or the like. This is because duplication of keys cannot be detected between transactions executed in different processing units without waiting until the time when data having uniqueness restrictions are aggregated and reflected. However, in this case, when a constraint violation is detected, the transaction itself is completed as a write-ahead transaction log. As a result, it was incomplete as a measure for detecting violations of uniqueness constraints.

  Here, in the distributed processing system as described above, a method of centrally managing keys with uniqueness constraints and checking for constraint violations related to uniqueness at the start of a transaction can be considered. However, in that case, since the check for violation of the constraint on uniqueness is concentrated in one place, there is a problem that the scalability of the distributed processing system is impaired against the design concept.

  In the related art described in Patent Document 1, processing can be performed in consideration of the dependency relationship between locks between transactions, but there is no description about detection of a constraint violation related to uniqueness.

  The present invention has been made to solve the above-described problems. That is, according to the present invention, in a distributed processing system that asynchronously performs transaction log pre-recording and actual data reflection, when a transaction is distributed in a plurality of processing units, the processing unit is crossed while suppressing a decrease in scalability. An object is to provide a technique capable of more reliably detecting a uniqueness constraint violation.

  In order to achieve the above object, the transaction distributed processing device of the present invention targets the management data distributed to the own device based on a violation detection key that can cause a uniqueness constraint violation between transactions as a target. While processing target data is waiting to be reflected in the transaction log, when processing a transaction distributed to the management data distributed holding means and the own apparatus (transaction distributed processing apparatus) held in association with the violation detection key The management data distribution holding means of the own device or another transaction distributed processing device that is the distribution destination of the management data specified based on the violation detection key in the transaction is associated with the violation detection key If no other management data is retained, the transaction The management data related to the allocation destination is held in association with the violation detection key in the management data distribution holding means of the distribution destination, and a transaction log representing the processing contents of the transaction is recorded in advance in the transaction log holding means Thus, the transaction processing means for completing the transaction processing and the delay reflection means for reflecting the transaction log held in the transaction log holding means to the processing target data asynchronously with the processing by the transaction processing means, Is provided.

  In addition, the application apparatus of the present invention includes an application unit that generates a transaction for processing target data, and a transaction distribution for specifying a transaction distributed processing apparatus that is a distribution destination of the transaction among the transaction distributed processing apparatuses described above. A transaction distribution unit that stores information and requests a transaction distributed processing device specified based on the transaction distribution information to process a transaction generated by the application unit; and Storing management data distribution information for specifying the transaction distribution processing device to which the management data is to be distributed, and specifying a transaction distribution process specified based on the management data distribution information The device, and a management data distributing means to be notified to the distribution destination to become a transaction distributed processing apparatus of the transaction.

  The data holding device of the present invention includes a data holding unit for holding the processing target data, and a data reflecting unit for reflecting the transaction log held in the transaction distributed processing device to the data holding unit. .

  Further, the configuration management apparatus of the present invention updates distribution information and updates the transaction distribution information and the management data distribution information held in the application device according to the configuration change of the transaction distributed processing device. Means.

  The distributed processing system of the present invention is a target of a transaction generated by the above-described transaction distributed processing device, the above-described application device that requests the transaction distributed processing device to process a transaction, and the application device. The above-described data holding device that holds data to be processed, and the above-described configuration management device that manages the configuration of the transaction distributed processing device, the application device, and the data holding device.

  Also, the distributed processing method of the present invention allows management associated with a violation detection key that may cause a unique constraint violation between transactions when a transaction for processing target data is distributed to one or more transaction distributed processing devices. Data is distributed to the transaction distributed processing device specified based on the violation detection key, and the transaction distributed processing device to which the management data is allocated is based on another transaction associated with the violation detection key. When the management data is not held, while the processing target data is waiting for reflection of the transaction log, the management data is held in association with the violation detection key, and then the transaction distribution destination In the transaction distributed processing device, the transaction log Completing the transaction processing by the preceding recording, the asynchronously with the transaction processing to reflect the transaction log to the processing target data.

  Further, the transaction distributed processing method of the present invention is configured such that management data distributed to the own device based on a violation detection key that can cause a uniqueness constraint violation between transactions, and processing target data targeted by the transaction are transaction logs. When processing a transaction to which processing is distributed to its own device using the management data distribution and holding means that holds the data in association with the violation detection key while waiting for the reflection, based on the violation detection key in the transaction When other management data associated with the violation detection key is not held in the management data distribution holding means of the own device or another device that is the distribution destination of the specified management data, The management data is detected in the management data distribution and holding means at the distribution destination. The transaction processing is completed by pre-recording the transaction log representing the processing content of the transaction after being held in correspondence with the transaction, and the transaction log is set as the processing target data asynchronously with the transaction processing. Reflect it.

  In addition, the storage medium of the present invention reflects the management data distributed to the own device based on the violation detection key that may cause a uniqueness constraint violation between transactions, and the processing target data targeted by the transaction reflects the transaction log. When processing a transaction to which processing is distributed to its own device using the management data distribution and holding means that holds the data in association with the violation detection key while waiting, it is specified based on the violation detection key in the transaction. If the management data distribution and holding means of the own device or another device that is the distribution destination of the management data does not hold other management data associated with the violation detection key, the management related to the transaction Data is held in association with the violation detection key in the management data distribution holding means of the distribution destination After that, the transaction log representing the processing content of the transaction is recorded in advance in the transaction log holding means, so that the transaction processing step for completing the transaction processing and the transaction processing are held in the transaction log holding means asynchronously. A transaction distribution processing program for causing a computer device to execute a delay reflection step of reflecting the processed transaction log on the processing target data is stored.

  Further, the transaction distribution method of the present invention includes transaction distribution information for identifying a transaction distribution processing device that is a distribution destination of the transaction, among transaction distribution processing devices that execute the transaction distribution processing method described above, Using the management data distribution information for identifying the transaction distributed processing device that is the distribution destination of the management data among the transaction distributed processing devices, a transaction for the processing target data is generated, and the generated transaction Processing is requested to the transaction distributed processing device specified based on the transaction distribution information, and the transaction distributed processing device specified based on the management data distribution information becomes the transaction distribution destination. Transac It notifies the tio emission distributed processing system.

  Further, the storage medium of the present invention is a transaction distribution for specifying a transaction distribution processing apparatus that is a distribution destination of the transaction among transaction distribution processing apparatuses that execute the transaction distribution processing program stored in the storage medium. A transaction for the processing target data is generated using the distribution information and the management data distribution information for identifying the transaction distribution processing device that is the distribution destination of the management data among the transaction distribution processing devices. A transaction generation step, and a transaction distribution step for requesting the transaction distributed processing device specified based on the transaction distribution information to process the transaction generated in the transaction generation step. A transaction distribution processing step for causing a computer device to execute a management data distribution step of notifying a transaction distribution processing device specified as the management data distribution information to a transaction distribution processing device that is a distribution destination of the transaction. Memorize minute program.

  In addition, the data holding method of the present invention holds processing target data that reflects a transaction log recorded in advance by a transaction distributed processing device that executes the above-described transaction distributed processing method.

  Further, the storage medium of the present invention has a transaction log recorded in advance by a transaction distributed processing device that executes the transaction distributed processing program stored in the above-described storage medium for the processing target data held in the data holding means. A data holding program for causing the computer apparatus to execute the reflecting step to be reflected is stored.

  In addition, the configuration management method of the present invention provides the transaction distribution information and the management data distribution used in the transaction distribution method according to a configuration change of the transaction distribution processing device that executes the transaction distribution processing method. Update information.

  The storage medium of the present invention is used by the transaction distribution program stored in the storage medium according to the configuration change of the transaction distribution processing apparatus that executes the transaction distribution processing program stored in the storage medium. A configuration management program for causing a computer device to execute a distribution information update step for updating the transaction distribution information and the management data distribution information is stored.

  In a distributed processing system that asynchronously performs transaction log pre-recording and actual data reflection, uniqueness across processing units is suppressed while suppressing a decrease in scalability when a transaction is distributed in a plurality of processing units. It is possible to provide a technique that can more reliably detect constraint violations.

It is a block diagram which shows the structure of the distributed processing system as embodiment of this invention. It is a hardware block diagram of the distributed processing system as embodiment of this invention. It is a functional block diagram of a distributed processing system as an embodiment of the present invention. It is a flowchart explaining the transaction distribution operation | movement of the distributed processing system as embodiment of this invention. It is a flowchart explaining the transaction processing of the distributed processing system as embodiment of this invention. It is a flowchart explaining the transaction log reflection operation | movement of the distributed processing system as embodiment of this invention. It is a flowchart explaining the data reflection operation | movement of the distributed processing system as embodiment of this invention. It is a flowchart explaining the management data deletion operation | movement of the distributed processing system as embodiment of this invention. It is a flowchart explaining the structure management operation | movement of the distributed processing system as embodiment of this invention. It is a schematic diagram which shows the structure of the specific example of the distributed processing system as embodiment of this invention. It is a figure explaining the process target data in the specific example of embodiment of this invention. It is a figure explaining the process target data distributedly held in the specific example of the embodiment of the present invention. It is a figure explaining the management data of the primary key in the specific example of embodiment of this invention. It is a figure explaining the management data of the primary key distributedly hold | maintained in the specific example of embodiment of this invention. It is a figure explaining the management data distribution information of the primary key before and behind updated in the specific example of embodiment of this invention. It is a schematic diagram which shows the structure of the other specific example of the distributed processing system as embodiment of this invention. It is a figure explaining the process target data in the other specific example of embodiment of this invention. It is a figure explaining KVS as an entity of processing object data in other specific examples of an embodiment of the invention. It is a figure explaining the management data of the unique key in the other specific example of embodiment of this invention.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

(Description of configuration)
A configuration of a distributed processing system 1 as an embodiment of the present invention is shown in FIG.

  In FIG. 1, the distributed processing system 1 includes a data holding device 10, an application device 20, a transaction distributed processing device 30, and a configuration management device 40. Each device is connected to be communicable with each other via a network. Here, FIG. 1 shows a plurality of data holding devices 10, one application device 20, a plurality of transaction distributed processing devices 30, and one configuration management device 40. The number of devices included in the system is not limited.

  The data holding device 10 is a device that holds processing target data. In the present embodiment, the processing target data represents a virtual table (virtual table), and a key value store in which data is associated with information including the identification information of the virtual table and the value of the primary key in the virtual table as a key. (KVS: Key Value Store). In the present embodiment, the data holding device 10 holds the processing target data in a distributed manner with other data holding devices 10.

  The application device 20 is a device that generates a transaction for processing target data. In the present embodiment, the application apparatus 20 generates a transaction for the above-described KVS that represents a virtual table.

  The transaction distributed processing device 30 is a device that distributes transactions generated by the application device 20 with other transaction distributed processing devices 30.

  The configuration management device 40 is a device that manages the configuration of the distributed processing system 1.

  Next, FIG. 2 shows a hardware configuration of each device constituting the distributed processing system 1. In FIG. 2, the data holding device 10 includes a central processing unit (CPU) 1001, a random access memory (RAM) 1002, a read only memory (ROM) 1003, a storage device 1004 such as a hard disk, and a network interface 1005. It can be configured by a computer device provided. The application device 20 can be configured by a computer device that includes a CPU 2001, a RAM 2002, a ROM 2003, a storage device 2004 such as a hard disk, and a network interface 2005. The transaction distributed processing device 30 can be configured by a computer device including a CPU 3001, a RAM 3002, a ROM 3003, a storage device 3004 such as a hard disk, and a network interface 3005. The configuration management device 40 can be configured by a computer device that includes a CPU 4001, a RAM 4002, a ROM 4003, a storage device 4004 such as a hard disk, and a network interface 4005. Note that the hardware configuration of each device constituting the distributed processing system 1 is not limited to the above-described configuration.

  Next, the functional block configuration of each device constituting the distributed processing system 1 is shown in FIG.

  First, the functional block configuration of the transaction distributed processing device 30 will be described.

  In FIG. 3, the transaction distributed processing device 30 includes a management data distribution holding unit 31, a transaction processing unit 32, a transaction log holding unit 33, and a delay reflection unit 34. Here, when the transaction distribution processing device 30 is configured by a computer device including the hardware elements illustrated in FIG. 2, the management data distribution holding unit 31 and the transaction log holding unit 33 are configured by the RAM 3002 and the storage device 3004. . The transaction processing unit 32 and the delay reflection unit 34 include a network interface 3005 and a CPU 3001 that reads a computer program and various data stored in the ROM 3003 or the storage device 3004 into the RAM 3002 and executes them. Note that the hardware configuration of each functional block configuring the transaction distributed processing device 30 is not limited to the above-described configuration.

  The management data distribution holding unit 31 holds the management data distributed to the own device based on the violation detection key in association with the violation detection key. Here, the violation detection key is a key that can cause a uniqueness constraint violation between transactions among keys having uniqueness constraints in the processing target data. The management data is information indicating that the processing target data targeted by the transaction is waiting for reflection of the transaction log. Further, the management data distribution and holding unit 31 holds such management data while the corresponding processing target data is waiting for reflection of the transaction log.

  Here, when the processing target data is KVS representing a virtual table, it is assumed that a uniqueness constraint violation may occur for a primary key of a certain virtual table between transactions. In this case, the violation detection key is information including the identification information of the virtual table and the value of the primary key in the virtual table. Further, it is assumed that a uniqueness constraint violation may occur for a unique key of a certain virtual table between transactions. In this case, the violation detection key is information including the identification information of the virtual table and the value of the unique key in the virtual table. The management data may be KVS in which information including a transaction key described later is associated with the violation detection key.

  The management data distribution holding unit 31 stores one management data for each violation detection key value, and cannot hold a plurality of management data for the same value of the violation detection key at the same time. The value of the violation detection key for which the management data is distributed to the management data distribution holding unit 31 of which transaction distributed processing device 30 is uniquely identified by the application device 20 described later based on the violation detection key. It is stipulated.

  When the transaction processing unit 32 processes a transaction requested from the application apparatus 20, the transaction detection unit 32 distributes the violation detection key in the transaction to the management data of the transaction distributed processing apparatus 30 that is the distribution destination of the management data for the violation detection key. An attempt is made to hold the dispersion holding unit 31. If there are a plurality of violation detection keys that may cause a uniqueness constraint violation in the transaction, the transaction processing unit 32 may try to store each violation detection key in the distribution destination. Here, it is assumed that the distribution destination of each management data is notified from the application apparatus 20. The details of the distribution destination notification from the application apparatus 20 will be described later.

  As described above, the management data distribution holding unit 31 is configured to hold one management data for the same value of the violation detection key and not to hold a plurality of management data for the same value of the violation detection key. Here, in the management data distribution and holding unit 31 of the distribution destination, other management data based on other transactions may already be held for the corresponding violation detection key. In this case, the transaction processing unit 32 fails to hold the management data to the distribution destination. On the other hand, there is a case where other management data is not held for the relevant violation detection key in the management data distribution holding unit 31 of the distribution destination. In this case, the transaction processing unit 32 succeeds in holding the management data to the distribution destination.

  Further, the transaction processing unit 32 is configured to operate as follows when each management data related to the requested transaction is successfully stored in the distribution destination. In this case, the transaction processing unit 32 records a transaction log representing the processing contents of the transaction in the transaction log holding unit 33 in advance. Then, the transaction processing unit 32 notifies the application device 20 of completion of the transaction processing.

  The transaction processing unit 32 is configured to operate as follows when failing to hold at least one of the management data related to the requested transaction in the distribution destination. In this case, the transaction processing unit 32 returns to the state before starting the processing of this transaction, and notifies the application device 20 of an error. Returning to the previous state means, for example, performing a process of deleting, from the distribution destination, management data that has been successfully held at the distribution destination, among the management data related to the requested transaction.

  Note that the transaction processing unit 32 may perform a confirmation process after the management data is successfully stored in the distribution destination and before the transaction log is recorded in advance. The confirmation process is a process of confirming that the data to be processed relating to the violation detection key is not held for the data holding device 10 that is the distribution destination of the data to be processed relating to the violation detection key. Such a data holding device 10 to be confirmed can be identified by referring to data distribution information described below. Thereby, the transaction processing unit 32 can further ensure that the uniqueness constraint violation does not occur due to the corresponding transaction.

  The transaction log holding unit 33 holds a transaction log recorded in advance by the transaction processing unit 32.

  The delay reflection unit 34 reflects the transaction log held in the transaction log holding unit 33 on the processing target data of the data holding device 10 asynchronously with the transaction processing by the transaction processing unit 32.

  Specifically, the delay reflection unit 34 specifies the data holding device 10 that is the distribution destination of the processing target data that is the target of the transaction log. For this purpose, the delay reflection unit 34 may store data distribution information in advance, for example. The data distribution information is information for identifying the data holding device 10 that is the distribution destination of each processing target data among the data holding devices 10. For example, the data distribution information is information in which the data holding device 10 that is a distribution destination is determined for a range of hash values calculated from information including a virtual table information and a primary key value. There may be.

  In this case, the delay reflection unit 34 calculates a hash value by applying a hash function to information including the information identifying the virtual table indicated by the transaction log and the value of the primary key. Then, the delay reflection unit 34 may specify the data holding device 10 associated with the range including the calculated hash value as the distribution destination of the processing target data.

  Then, the delay reflection unit 34 transmits reflection information for reflecting the transaction log held in the transaction log holding unit 33 to the processing target data to the data holding device 10 specified based on the data distribution information. To do. The delay reflection unit 34 deletes the transaction log for which the reflection information has been reflected from the transaction log holding unit 33.

  Next, the functional block configuration of the application apparatus 20 will be described.

  In FIG. 3, the application device 20 includes an application unit 21, a transaction distribution unit 22, and a management data distribution unit 23. Here, when the application device 20 is configured by a computer device including the hardware elements illustrated in FIG. 2, the application unit 21 reads the computer program and various data stored in the ROM 2003 or the storage device 2004 into the RAM 2002. It is comprised by CPU2001 to perform. The transaction distribution unit 22 and the management data distribution unit 23 include a network interface 2005 and a CPU 2001 that reads a computer program and various data stored in the ROM 2003 or the storage device 2004 into the RAM 2002 and executes them. Note that the hardware configuration of each functional block constituting the application apparatus 20 is not limited to the above-described configuration.

  The application unit 21 generates a transaction for the processing target data. As described above, in the present embodiment, the application unit 21 generates a transaction for KVS representing a virtual table. Each transaction is set with a transaction key for identifying the transaction. For example, two virtual tables each include a column representing the same item “A”, and in each virtual table, two related processes that specify the same value in the “A” column are defined as one transaction class. Think about the case. In this case, the transaction key may be a value specified in the item “A”.

  Further, the application unit 21 can specify a violation detection key that can cause a uniqueness constraint violation with another transaction based on the definition information of the transaction to be generated. For example, assume that a unique constraint violation may occur for a primary key of a virtual table between transactions. In this case, the application unit 21 specifies information including the identification information of the virtual table and the value of the primary key in the virtual table as a violation detection key in this transaction. In addition, for example, it is assumed that a unique constraint violation may occur for a unique key of a virtual table between transactions. In this case, the application unit 21 specifies information including the identification information of the virtual table and the unique key value in the virtual table as a violation detection key in the transaction. The application unit 21 may specify a plurality of violation detection keys that may cause uniqueness constraint violations between transactions. The identified violation detection key is used by the management data distribution unit 23 described later.

  The transaction distribution unit 22 stores transaction distribution information in advance. Here, the transaction distribution information is information for identifying the transaction distribution processing device 30 that is the distribution destination of each transaction among the transaction distribution processing devices 30. For example, the transaction distribution information may be information in which the transaction distribution processing device 30 that is the distribution destination is determined for the range of hash values calculated from the transaction key.

  In addition, the transaction distribution unit 22 identifies the transaction distribution processing device 30 that is the distribution destination of the transaction generated by the application unit 21 based on the transaction distribution information. Then, the transaction distribution unit 22 requests the transaction distribution processing device 30 that is the distribution destination to process the transaction.

  For example, consider a case where the transaction distribution information is information in which the distribution destination transaction distribution processing device 30 is associated with a range of hash values. In this case, the transaction distribution unit 22 calculates a hash value by applying a hash function to the transaction key. And the transaction distribution part 22 should just specify the transaction distribution processing apparatus 30 matched with the range containing the calculated hash value as a distribution destination.

  The management data distribution unit 23 stores management data distribution information in advance. Here, the management data distribution information is information for identifying the transaction distribution processing device 30 that is the distribution destination of the management data based on the violation detection key among the transaction distribution processing devices 30. For example, the management data distribution information may be information in which the transaction distribution processing device 30 that is the distribution destination is determined for the range of hash values calculated from the violation detection key.

  Further, the management data distribution unit 23 notifies the distributed transaction processing apparatus 30 serving as a transaction distribution destination of the management data distribution destination for each violation detection key in the transaction.

  For example, consider a case where the management data distribution information is information in which the distribution destination transaction distribution processing device 30 is associated with a range of hash values. In this case, the management data distribution unit 23 calculates a hash value by applying a hash function to each violation detection key in the transaction. And the management data distribution part 23 should just specify the transaction distribution processing apparatus 30 matched with the range containing the calculated hash value as a distribution destination.

  In addition, the management data distribution unit 23 may notify the distribution destination of the management data associated with the violation detection key in the processing target data that has been reflected in response to the inquiry from the data holding device 10. This inquiry is performed in order to request from the data holding device 10 to delete the corresponding management data in the transaction distribution processing device 30 that is the distribution destination.

  Next, the functional block configuration of the data holding device 10 will be described.

  In FIG. 3, the data holding device 10 includes a data holding unit 11 and a data reflecting unit 12. Here, when the data holding device 10 is configured by a computer device including the hardware elements illustrated in FIG. 2, the data holding unit 11 is configured by the storage device 1004. The data reflection unit 12 includes a network interface 1005 and a CPU 1001 that reads a computer program and various data stored in the ROM 1003 or the storage device 1004 into the RAM 1002 and executes them. Note that the hardware configuration of each functional block constituting the data holding device 10 is not limited to the above-described configuration.

  The data holding unit 11 holds processing target data. As described above, in the present embodiment, the processing target data is distributed and held in the plurality of data holding devices 10. Therefore, the data holding unit 11 holds the processing target data distributed to the own device. Further, in the present embodiment, the processing target data is KVS using information including the identification information of the virtual table and the value of the primary key in the virtual table as a key. As described above, which data to be processed is held in which data holding device 10 is determined to be uniquely specified based on the key by the data distribution information held in the transaction distributed processing device 30. ing.

  The data reflection unit 12 causes the data holding unit 11 to reflect the transaction log reflection information transmitted from the transaction distributed processing device 30.

  In addition, the data reflection unit 12 deletes the management data for the transaction distributed processing device 30 that is the distribution destination of the management data associated with the violation detection key in the processing target data to be reflected. Request. As described above, the data reflection unit 12 can identify the transaction distributed processing device 30 that is the distribution destination of the corresponding management data by making an inquiry to the application device 20. If the distributed processing system 1 includes a plurality of application devices 20, the data reflection unit 12 may make an inquiry to any application device 20. The data reflection unit 12 can obtain information representing one or more application devices 20 that can be inquired by making an inquiry to the configuration management device 40 described later. In addition, the data reflection unit 12 may select a reference destination among a plurality of application devices 20 according to a predetermined rule. For example, as a predetermined rule, a rule that stores the latest reference destination and changes the reference destination by round robin may be applied. With this configuration, it is possible to prevent the inquiries from the data holding device 10 from being concentrated on a specific application device 20.

  Next, the functional block configuration of the configuration management device 40 will be described.

  In FIG. 3, the configuration management apparatus 40 includes a distribution information update unit 41. Here, when the configuration management device 40 is configured by a computer device including the hardware elements illustrated in FIG. 2, the distribution information update unit 41 includes a network interface 4005, a computer stored in the ROM 4003 or the storage device 4004. The CPU 4001 executes programs and various data read into the RAM 4002 and executed. Note that the hardware configuration of each functional block constituting the distribution information update unit 41 is not limited to the above-described configuration.

  The distribution information update unit 41 updates the transaction distribution information and the management data distribution information in the application device 20 in accordance with the configuration change of the transaction distributed processing device 30 in the distributed processing system 1. The configuration change of the transaction distributed processing device 30 means, for example, addition of a new transaction distributed processing device 30 or deletion of an existing transaction distributed processing device 30. In addition, the configuration change is not limited to such addition or deletion, but may be a change in the load status of each transaction distributed processing device 30. In that case, the distribution information update unit 41 may change the assigned range of each device in the transaction distribution information and the management data distribution information in accordance with the change in each load situation.

  In addition, the distribution information update unit 41 controls the movement of already stored management data between the transaction distribution processing devices 30 so that the management data is stored based on the updated management data distribution information. For example, the distribution information update unit 41 determines the update contents of the management data distribution information, then controls the management data movement between the transaction distributed processing devices 30, and updates the management data distribution information when the movement is completed. You may make it do.

  Further, the distribution information update unit 41 updates the data distribution information in the transaction distributed processing device 30 in accordance with the configuration change of the data holding device 10 in the distributed processing system 1. The configuration change of the data holding device 10 means, for example, addition of a new data holding device 10 or deletion of an existing data holding device 10. In addition, the configuration change is not limited to such addition or deletion, but may be a change in the load status of each data holding device 10. In that case, the distribution information update unit 41 may change the assigned range of each device in the data distribution information in accordance with the change in each load situation.

  Further, the distribution information update unit 41 controls the movement of the already stored processing target data between the data holding devices 10 so that the processing target data is stored based on the updated data distribution information. . For example, the distribution information update unit 41 determines the update contents of the data distribution information, and then controls the movement of the processing target data between the data holding devices 10 and updates the data distribution information when the movement is completed. You may do it.

  For example, the distribution information update unit 41 holds configuration information regarding the configuration of each device in the distributed processing system 1 and detects the addition or deletion thereof, thereby performing the above-described update processing of each distribution information. You may go.

(Description of operation)
The operation of the distributed processing system 1 configured as described above will be described with reference to the drawings.

  First, the transaction distribution operation of the application apparatus 20 is shown in FIG.

  In FIG. 4, first, the application unit 21 generates a transaction for the processing target data (step S1). As described above, a transaction key is set in the generated transaction.

  Next, the transaction distribution unit 22 identifies the transaction distribution processing device 30 that is the distribution destination of the transaction generated in step S1 (step S2). As described above, the transaction distribution unit 22 specifies the distribution destination by referring to the transaction distribution information.

  Next, the management data distribution unit 23 identifies the transaction distribution processing device 30 that is the distribution destination of the management data based on each violation detection key that may cause a uniqueness constraint violation in the transaction generated in step S1. (Step S3). As described above, the management data distribution unit 23 specifies the distribution destination by referring to the management data distribution information.

  Next, the transaction distribution unit 22 requests the transaction distribution processing device 30 that is the distribution destination of the transaction identified in step S2 to process the transaction generated in step S1. Also, the management data distribution unit 23 notifies the transaction distribution processing device 30 that is the transaction distribution destination of the distribution destination of the management data for each violation detection key identified in step S3 (step S4). .

  Next, the transaction distribution unit 22 receives information indicating the completion or error of transaction processing from the transaction distribution processing device 30 that is the transaction distribution destination identified in step S2 (step S5).

  Thus, the application apparatus 20 ends the transaction distribution operation.

  Next, transaction processing of the transaction distributed processing device 30 is shown in FIG.

  In FIG. 5, first, the transaction processing unit 32 receives a transaction processing request from the application apparatus 20. In addition, for each violation detection key in this transaction, the transaction processing unit 32 receives information representing the transaction distribution processing device 30 that is the distribution destination of the management data (step S11).

  Next, the transaction processing unit 32 repeats the following steps S12 to S13 for each violation detection key in this transaction.

  Here, the transaction processing unit 32 determines whether or not other management data associated with the corresponding violation detection key is held in the management data distribution holding unit 31 to which the corresponding violation detection key is allocated. (Step S12).

  Here, when other management data associated with the relevant violation detection key is not held, the transaction processing unit 32 associates with the relevant violation detection key in the management data distribution holding unit 31 of the distribution destination. Management data is held (step S13).

  If there is another violation detection key (Yes in step S14), the transaction processing unit 32 repeats the processing from step S12 for the violation detection key. As described above, after executing step S13, the transaction processing unit 32 may perform confirmation processing on the processing target data related to the relevant violation detection key on the data holding device 10 that is the distribution destination. . In this case, the transaction processing unit 32 may repeat the process for the next violation detection key after performing the confirmation process.

  If the management data is successfully held at the distribution destination for all violation detection keys, the transaction processing unit 32 records the transaction log in advance. Specifically, the transaction processing unit 32 records a transaction log representing the processing content of this transaction in advance in the transaction log holding unit 33 (step S15).

  Next, the transaction processing unit 32 notifies the application device 20 of completion of the transaction processing (step S16).

  On the other hand, when the management data associated with one of the violation detection keys is held in the distribution destination in step S12, the transaction processing unit 32 returns to the state before step S11 (step S17). Specifically, the transaction processing unit 32 may perform a process of deleting management data that has once been successfully stored in the distribution destination by executing step S13 so far.

  Next, the transaction processing unit 32 notifies an error to the application apparatus 20 (step S18).

  Thus, the transaction distributed processing device 30 ends the transaction process.

  Next, the delay reflecting operation of the transaction distributed processing device 30 is shown in FIG.

  In FIG. 6, first, the delay reflection unit 34 identifies the data holding device 10 that is the distribution destination of the processing target data for the transaction log held in the transaction log holding unit 33 (step S <b> 31). As described above, the delay reflection unit 34 specifies the distribution destination by referring to the data distribution information.

  Next, the delay reflection unit 34 transmits reflection information for reflecting the transaction log to the processing target data to the data holding device 10 identified in step S31 (step S32).

  Thus, the transaction distribution processing device 30 ends the delay reflection operation.

  Next, the data reflection operation in the data holding device 10 is shown in FIG.

  In FIG. 7, first, the data reflection unit 12 receives reflection information for reflecting the transaction log on the processing target data from the transaction distributed processing device 30 (step S41).

  Next, the data reflection unit 12 reflects the received reflection information on the data holding unit 11 (step S42).

  Next, the data reflection unit 12 specifies the transaction distributed processing device 30 that is the distribution destination of the management data based on the violation detection key in the processing target data to be reflected (step S43). As described above, the distributed transaction processing apparatus 30 can be identified by making an inquiry to the application apparatus 20.

  Next, the data reflection unit 12 requests the transaction distribution processing device 30 specified in step S43 to delete the management data associated with the corresponding violation detection key (step S44).

  Thus, the data holding device 10 ends the data reflection operation.

  Next, FIG. 8 shows the management data deletion operation of the transaction distributed processing device 30 requested to delete the management data in step S44 described above.

  In FIG. 8, first, the transaction distributed processing device 30 receives a management data deletion request from the data holding device 10 (step S51).

  Next, the management data distribution holding unit 31 deletes the management data associated with the corresponding violation detection key (step S52).

  Thus, the transaction distributed processing device 30 ends the management data deletion operation.

  Next, an operation in which the configuration management apparatus 40 manages the configuration of the distributed processing system 1 is shown in FIG.

  In FIG. 9, the case where the configuration of the data holding device 10 is changed will be described first (“data holding device” in step S61). In this case, the distribution information update unit 41 determines the update contents of the data distribution information in each transaction distributed processing device 30 (step S62).

  Next, the distribution information update unit 41 controls each data holding device 10 to move the data to be processed already stored based on the update content determined in step S62 (step S63).

  Next, the distribution information update unit 41 updates the data distribution information in each transaction distributed processing device 30 (step S64).

  The distribution information update unit 41 executes the processes of steps S63 and S64 as inseparable processes. For example, other processes that refer to the data distribution information during the process of step S63 or S64 wait for the completion of steps S63 and S64.

  A case where the configuration of the transaction distributed processing device 30 is changed will be described (“transaction distributed processing device” in step S61). In this case, the distribution information update unit 41 determines the update contents of the transaction distribution information and the management data distribution information in the application device 20 (step S65).

  Next, the distribution information update unit 41 controls each transaction distribution processing device 30 to move the already stored management data based on the update contents of the management data distribution information determined in step S65. (Step S66).

  Next, the distribution information update unit 41 updates the transaction distribution information and management data distribution information of the application device 20 (step S67).

  The distribution information update unit 41 executes the processes of steps S66 and S67 as an inseparable process. For example, other processes that refer to transaction distribution information or management data distribution information during the process of step S66 or S67 wait for the completion of steps S66 and S67.

  Thus, the configuration management apparatus 40 ends the configuration management operation.

(Specific example 1 of the embodiment of the present invention)
Next, a first specific example (specific example 1) of the present embodiment will be described. In the specific example 1, the data holding device 10 is referred to as a computer or node S arranged in the S layer. Further, the application device 20 is referred to as a computer or a node P arranged in the P layer. Further, the transaction distributed processing device 30 is referred to as a computer or node T arranged in the T layer. FIG. 10 is a diagram schematically illustrating the configuration of the first specific example. In FIG. 10, the distributed processing system 1 includes one node P1 in the P layer, three nodes T1 to T3 in the T layer, and two nodes S1 to S2 in the S layer. The configuration management device 40 is not shown.

  In this specific example 1, an example in which the primary key of a virtual table is applied as a violation detection key that may cause a uniqueness constraint violation between transactions will be described. In this case, the management data distribution information of the node P1 is management data distribution information based on the primary key of the virtual table. Further, the management data distribution and holding unit 31 of the nodes T1 to T3 holds management data for the primary key of the virtual table.

  Further, in this specific example 1, it is assumed that the processing target data is KVS representing the virtual table A and the virtual table B related to the ordering and billing of the product. FIG. 11 shows virtual table A and virtual table B, and KVS as an entity thereof. In the virtual table A, a column of “invoice number” is set as the primary key. In the virtual table B, “order number” is set as the primary key. In the KVS in FIG. 11, the KV pair corresponding to the virtual table B corresponds to the key starting with “index_table B_” so that it can be accessed by specifying “invoice number” which is not the primary key. An index to the KV pair is held. Further, as shown in FIG. 12, each KV pair of the processing target data (KVS) is distributed and held in the node S1 or S2 uniquely specified by the key.

Further, in this specific example 1, it is assumed that the unit of transaction processing is defined as “each“ invoice number ”column has the same value in each virtual table”. In this case, the “invoice number” column is the transaction key. Hereinafter, a transaction processing unit identified by “invoice number” is referred to as “transaction class 1”. At this time, it is assumed that “transaction class 1” is defined in the P layer as follows.
“Transaction class 1” is generated from the “invoice number” column of virtual table A.
“Transaction class 1” is generated from the “invoice number” column of virtual table B.

Here, consider the case where the following two transactions having the transaction key as the invoice number “10008” are about to be executed simultaneously.
<Transaction 1>
In the virtual table A, “Invoice number: 10008, Billing address: Sato, Invoice date: 2013/07/01” is inserted. • In the virtual table B, “Order number: 00010, Product name: Rice cooker, Invoice number: Insert "10008"<transaction2>
In the virtual table A, “Invoice number: 10008, Billing address: Tanaka, Billing date: 2013/07/01” is inserted. • In the virtual table B, “Order number: 00010, Product name: Radio, Invoice number: 10008” In this case, the transaction distribution unit 22 of the node P1 holds, as the transaction distribution information, information in which the node T that is the distribution destination is associated with the hash value range calculated from the transaction key To do.

  Further, the delay reflecting unit 34 of the node T associates the node S as the distribution destination with the range of the hash value calculated from “virtual table name + primary key value” as the data distribution information. Keep information. Here, it is assumed that the same data distribution information is held in the nodes T1 to T3. “X + Y” represents information consisting of X and Y.

  At this time, the distribution destination of each transaction in the T layer is uniquely determined from the invoice number “10008” which is a transaction key based on the transaction distribution information in the node P1. Further, the distribution destination in the S layer of the KV pair as the processing target data is uniquely determined from “virtual table name + primary key value” based on the data distribution information in the node T.

  At this time, the node in the T layer, which is the transaction distribution destination, completes the transaction processing by recording the transaction log in advance (WAL: Write Ahead Logging) for each transaction. Hereinafter, the transaction log recorded in advance is also referred to as WAL. Further, the node of the S layer that is the distribution destination of the processing target data reflects WAL in the processing target data asynchronously with the transaction processing. Therefore, execution of transaction 1 and transaction 2 may cause a primary key constraint violation (duplication of “invoice number”) in virtual table A. Further, in the virtual table B, a primary key constraint violation (duplication of “order number”) may occur.

  Therefore, in this specific example 1, “virtual table A + primary key value” and “virtual table B + primary key value”, which may cause a uniqueness constraint violation, are the violation detection keys. Therefore, the management data distribution unit 23 of the node P1 stores management data distribution information related to the primary key. Specifically, the management data distribution information related to the primary key includes information in which the distribution destination node T is associated with the range of hash values calculated from “virtual table name + primary key value”. Become. As a result, the node T that is the distribution destination of the management data is uniquely determined based on the management data distribution information of the node P1.

  Further, FIG. 13 shows the management data for the primary key generated in this specific example 1. In addition, although the left figure of FIG. 13 has shown the management data about a primary key typically with a table format, as the right figure, the substance is KVS. In the left diagram of FIG. 13, the management data indicated by each row is information in which “transaction key” is associated with “virtual table name” and “primary key value”. In the right diagram of FIG. 13, the KV pair of management data indicated by each row is associated with data including “virtual table name, primary key, transaction key” using “virtual table name + primary key value” as a key. Information. In this case, the management data KV pair whose key is “virtual table name + primary key value” is the KV pair of the processing target data whose key is “virtual table name + primary key value”. It can be said that it is waiting for storage.

  Further, in this specific example, the management data for these primary keys is distributed and held in nodes T1 to T3 as shown in FIG. Which management data is held in which node T is determined based on the management data distribution information of the node P1 as described above.

  The operation of the distributed processing system 1 in the specific example 1 configured as described above will be described.

  First, in the node P1, the application unit 21 generates the above-described transaction 1 (step S1 in FIG. 4).

  At this time, the transaction key of the transaction 1 is the invoice number “10008”. Therefore, the transaction distribution unit 22 specifies the distribution destination of the transaction 1 by referring to the transaction distribution information (step S2). Specifically, the transaction distribution unit 22 may calculate the hash value of the invoice number “10008” and specify the node T associated with the range including the calculated hash value in the transaction distribution information. . Here, it is assumed that the node T1 is specified.

  Further, the violation detection key that may cause a uniqueness constraint violation in the first virtual table A insertion processing in transaction 1 is the claim number in virtual table A, that is, “Table A — 10008”. The violation detection key that may cause a uniqueness constraint violation in the second insertion process to the virtual table B is the order number in the virtual table B, that is, “Table B — 0010”.

  Therefore, the management data distribution unit 23 specifies the distribution destination of the management data related to the violation detection key “Table A_10008” by referring to the management data distribution information. Specifically, the management data distribution unit 23 may calculate the hash value of “Table A_10008” and specify the node T associated with the range including the calculated hash value in the management data distribution information. . Here, it is assumed that the node T2 is specified. Similarly, the management data distribution unit 23 specifies the distribution destination of the management data corresponding to the violation detection key “Table B — 0010” by referring to the management data distribution information. Here, it is assumed that the node is T3 (step S3).

  Next, the transaction allocating unit 22 requests the processing of the transaction 1 to the node T1 to which the transaction 1 is allocated. In addition, the management data distribution unit 23 notifies the node T1 of the node T2 as a management data distribution destination for the violation detection key “Table A_10008”. Also, the management data distribution unit 23 notifies the node T1 of the node T3 as a management data distribution destination for the violation detection key “Table B — 0010” (step S4).

  Next, the node T1 requested to process the transaction 1 operates as follows. The transaction processing unit 32 of the node T1 attempts to hold the management data for the first violation detection key “Table A_10008” in the management data distribution holding unit 31 of the node T2 notified as the distribution destination.

  Here, it is assumed that other management data (KV pair) having “Table A_10008” as a key is not held in the management data distribution holding unit 31 of the node T2 (No in step S12 in FIG. 5).

  In this case, the transaction processing unit 32 of the node T1 causes the management data distribution and holding unit 31 of the node T2 to hold a KV pair in which data including the transaction key “10008” is associated with “Table A — 10008” as a key (Step S1). S13).

  Here, the success in holding the management data (KV pair) in the T layer with “Table A — 10008” as a key indicates the following. In other words, the success of the retention indicates that the processing target data (KV pair) with “Table A — 10008” as a key is waiting to be stored in the data retention unit 11 (KVS) of the S layer for subsequent transactions. Show. In addition, the success of this holding was that there was no other processing target data (KV pair) with “Table A — 10008” as a key waiting for storage in the data holding unit 11 (KVS) of the S layer until just before. Is shown.

  Next, the transaction processing unit 32 of the node T1 may confirm that there is no processing target data (KV pair) using “Table A_10008” that has been updated and reflected as a key in the S layer. Thereby, the transaction processing unit 32 of the node T1 ensures that a uniqueness constraint violation (duplicate primary key) does not occur. In this confirmation process, it can be specified by referring to the data distribution information which node in the S layer holds the processing target data with “Table A — 10008” as a key.

  Next, the transaction processing unit 32 of the node T1 executes steps S12 to S13 in the same manner as described above for the second violation detection key “Table B — 0010”.

  In other words, the transaction processing unit 32 tries to hold the management data for the second violation detection key “Table B — 0010” in the node T3 that is notified as the distribution destination.

  Here, it is assumed that other management data (KV pair) having “Table B — 0010” as a key is not held in the management data distribution holding unit 31 of the node T3 (No in step S12).

  In this case, the transaction processing unit 32 of the node T1 causes the management data distribution holding unit 31 of the node T3 to hold a KV pair in which data including the transaction key “10008” is associated with “Table B — 0010” as a key (Step S1). S13).

  As described above, the success in holding the management data (KV pair) using “Table B — 0010” as a key in the T layer indicates the following. In other words, the success of the retention indicates that the processing target data (KV pair) using “Table B — 0010” as a key is waiting to be stored in the data retention unit 11 (KVS) of the S layer for the subsequent transaction. Show. Also, the success of this retention was that there was no other processing target data (KV pair) using “Table B — 0010” as a key waiting for storage in the data retention unit 11 (KVS) of the S layer. Is shown.

  Next, the transaction processing unit 32 of the node T1 may confirm that there is no processing target data (KV pair) having “Table B — 0010” updated as a key in the S layer. Thereby, the transaction processing unit 32 ensures that a uniqueness constraint violation (duplicate primary key) does not occur. In this confirmation process, it can be specified by referring to the data distribution information which node of the S layer holds the data to be processed with “Table B — 0010” as a key.

  In this way, the node T1 succeeded in holding management data in the T layer for the violation detection keys “Table A_10008” and “Table B_00010” that may cause a uniqueness constraint violation in the transaction 1. As a result, it is confirmed that the primary key is not duplicated by the transaction 1.

  Therefore, the transaction processing unit 32 of the node T1 records the WAL of the transaction 1 in advance in the transaction log holding unit 33 of the own device (step S15).

  Then, the transaction processing unit 32 notifies the completion of the transaction 1 to the node P1 (Step S16).

  Thus, the transaction 1 is completed. The transaction processing unit 32 may perform the order of confirming the holding of the management data for each violation detection key in the transaction according to a predetermined rule. For example, the transaction processing unit 32 may evaluate the violation detection key as a character string, and perform management data holding confirmation processing in ascending order.

  Asynchronously with the transaction 1 processing, the delay reflection unit 34 of the node T1 reflects the WAL of the transaction 1 recorded in the transaction log holding unit 33 as follows.

  First, the delay reflection unit 34 refers to the data distribution information for the node S that is the distribution destination of the processing target data based on the violation detection key “Table A — 10008” in the first process indicated by the WAL of the transaction 1. This is specified (step S31 in FIG. 6). Specifically, the delay reflection unit 34 calculates the hash value of “Table A_10008”. Then, the delay reflection unit 34 may specify the node S associated with the range including the calculated hash value in the data distribution information. Here, it is assumed that the node is S2.

  Next, the delay reflection unit 34 transmits the reflection information of the insertion process to the virtual table A to the node S2 (step S32).

  Next, the data reflection unit 12 of the node S2 inserts processing target data (KV pair) using “Table A_10008” as a key into the data holding unit 11 based on the reflection information (step S42 in FIG. 7).

  Next, the data reflection unit 12 specifies the allocation destination of the management data for the violation detection key “Table A_10008” in the reflected processing target data by inquiring the node P1 (step S43). Here, the node T2 is specified.

  Next, the data reflection unit 12 requests the node T2 to delete the management data associated with the violation detection key “Table A_10008” (step S44).

  Accordingly, the management data distribution holding unit 31 of the node T2 deletes the management data (KV pair) using the violation detection key “Table A_10008” as a key.

  Similarly, for the second insertion process indicated by WAL of transaction 1, the delay reflection unit 34 of the node T1 specifies, for example, the node S1 as the distribution destination of the processing target data, and transmits the reflection information. The node S1 that has received the reflection information operates in substantially the same manner as described above, and inserts processing target data having “Table B — 0010” as a key into the data holding unit 11. In response to a request from the node S1, the node T3 deletes the management data (KV pair) using the violation detection key “Table B — 0010” as a key from the management data distribution holding unit 31.

  This completes the reflection of the transaction 1 to the S layer of the WAL.

  Here, it is assumed that the node P1 generates the transaction 2 and requests the node T2 for the processing in parallel with the processing of the transaction 1 at the node T1. In transaction 2, the violation detection keys that may cause uniqueness violations are “Table A_10008” and “Table B_00010”, as in transaction 1. Similarly to the above, the allocation destination of the management data of the violation detection key “Table A_10008” is the node T2, and the allocation destination of the management data of the violation detection key “Table B_00010” is the node T3.

  In this case, the management data distribution and holding unit 31 of the node T2 has already held the management data (KV pair) keying the violation detection key “Table A_10008” by the processing of the transaction 1 described above. Accordingly, the transaction processing unit 32 of the node T2 fails to hold the management data (KV pair) using the violation detection key “Table A_10008” as a key in the T layer.

  Alternatively, it is assumed that the reflection of WAL of the above-described transaction 1 proceeds asynchronously during the processing of transaction 2. For this reason, it is also conceivable that the management data (KV pair) with “table A_10008” as a key by transaction 1 has already been deleted from the management data distribution holding unit 31 of the node T2. In this case, the transaction processing unit 32 of the node T2 succeeds in holding the management data (KV pair) using the violation detection key “Table A_10008” as a key in the T layer.

  However, it is assumed that the WAL reflection of transaction 1 has not yet been completed. Therefore, it is assumed that the management data (KV pair) based on “table B_00010” based on transaction 1 is still held in the management data distribution holding unit 31 of the node T3. In this case, the transaction processing unit 32 of the node T2 fails to hold the management data (KV pair) using the violation detection key “Table B — 0010” as a key in the T layer.

  As described above, in the node T2 requested to process the transaction 2, it is assumed that the transaction processing unit 32 fails to hold the management data of the violation detection key in the T layer (Yes in step S12). Specifically, the transaction processing unit 32 has failed to hold at least one of the management data of the violation detection key “Table A_10008” and the management data of the violation detection key “Table B_00010” in the T layer.

  In this case, the transaction processing unit 32 of the node T2 returns to the state before starting the processing of the transaction 2 (step S17), and notifies the node P1 of the error of the transaction 2 (step S18). For example, a case will be described in which the management data of “Table A_10008” has been successfully held but the management data of “Table B_00010” has failed to be held. In this case, the transaction processing unit 32 of the node T2 may return to the original state by canceling the holding of the management data of “Table A_10008”.

  This is the end of the description of transaction 2 processing.

  Next, the operation of the configuration management apparatus 40 when the node T4 is added to the T layer in the specific example 1 will be described.

  Here, an example of the management data distribution information (KVS) held in the management data distribution unit 23 of the node P1 before the node T4 is added is shown in Table a of FIG.

  First, since the node T4 is newly added, the distribution information update unit 41 of the configuration management device 40 determines the update contents of the transaction distribution information and the management data distribution information of the node P1 (step S65).

  Here, regarding the management data distribution information, it is assumed that the management data distribution information (KVS) shown in Table a of FIG. 15 is updated as shown in Table b of FIG. Specifically, it is determined that a part of the hash range allocated to the existing nodes T1 to T3 is allocated to the new node T4.

  Therefore, the distribution information updating unit 41 controls the movement of management data in each management data distribution holding unit 31 with respect to the existing nodes T1 to T3 (step S66). Specifically, the nodes T1 to T3, under the control of the distribution information update unit 41, each KV pair of keys included in the hash range newly allocated to the node T4 in each management data distribution holding unit 31 (Management data) is moved to the node T4.

  When the movement is completed, the distribution information update unit 41 updates the management data distribution information of the node P1 as shown in Table b of FIG. Further, the distribution information update unit 41 updates the transaction distribution information of the node P1 (step S67). As described above, the distribution information update unit 41 executes steps S66 and S67 as an inseparable process.

  Thus, the configuration management apparatus 40 ends the configuration management operation.

(Specific example 2 of the embodiment of the present invention)
Next, a second specific example (specific example 2) of the present embodiment will be described. Specific Example 2 describes an example in which a unique key in a virtual table is applied in addition to a primary key in a virtual table as a violation detection key that can cause a uniqueness constraint violation between transactions. The structure of the specific example 2 is typically shown in FIG. In FIG. 16, this distributed processing system 1 includes one node P1 for the P layer, three nodes T1 to T3 for the T layer, and two nodes S1 to S2 for the S layer, as in the first specific example. And a configuration management device 40. In FIG. 16, the configuration management apparatus 40 is not shown.

  The management data distribution information of the node P1 stores “management data distribution information related to the unique key of the virtual table” in addition to “management data distribution information related to the primary key of the virtual table” in the first specific example.

  The management data distribution holding unit 31 of the nodes T1 to T3 stores “management data related to the unique key of the virtual table” in addition to “management data related to the primary key of the virtual table” in Specific Example 1 described above.

  Further, in this specific example 2, it is assumed that the processing target data is KVS representing the virtual table C, the virtual table D, and the virtual table E related to the facility reservation. FIG. 17 shows a virtual table C, a virtual table D, and a virtual table E. FIG. 18 shows KVS as an entity of these virtual tables. In the virtual table C, a column of “reservation number” is set as the primary key. In the virtual table D, “user code” is set as the primary key. In the virtual table E, “facility code” is set as the primary key. Here, when it is defined that “a facility different from others can be reserved only once for each user”, the “facility code” of the virtual table D is subjected to a unique restriction.

  In the KVS of FIG. 18, the KV pair corresponding to the virtual table C is associated with the key starting from “index_table C_” so that the KV pair corresponding to the virtual table C can be accessed by specifying the “facility code” that is not the primary key. An index to the pair is maintained. Similarly, an index to the corresponding KV pair is associated with a key starting from “index_table D_” so that the KV pair corresponding to the virtual table D can be accessed by specifying “facility code” which is not the primary key. Is retained.

  Also, each KV pair of the processing target data (KVS) shown in FIG. 18 is distributed and held in the node S1 or S2 uniquely specified by the key, as in the case of the specific example 1.

Further, in this specific example 2, it is assumed that the unit of transaction processing is defined as “each facility code column has the same value in each virtual table”. In this case, the “facility code” column is a transaction key. Hereinafter, a transaction processing unit identified by “facility code” is referred to as “transaction class 2”. At this time, it is assumed that “transaction class 2” is defined in the P layer as follows.
“Transaction class 2” is generated from the “facility code” column of virtual table C.
“Transaction class 2” is generated from the “facility code” column of the virtual table D.

Here, consider a case where the following two transactions having the transaction key as the facility code “S2004” are about to be executed simultaneously.
<Transaction 3>
Update the facility code in the row of “user code: 00003, user name: Tanaka” in virtual table D to S2004. • In virtual table C, “reservation number: 0619093001, reservation date: 2013/06/19, facility code” : S2004 "<transaction 4>
-Update the facility code in the row of "User code: 00007, User name: Yamazaki" in virtual table D to S2004-In virtual table C, "Reservation number: 0619093001, reservation date: 2013/06/19, facility code" : S2004 ”is inserted. In this case, the transaction distribution unit 22 of the node P1 uses, as the transaction distribution information, information in which the node T of the distribution destination is associated with the range of hash values calculated from the transaction key. Hold.

  Similarly to the specific example 1 described above, the delay reflection unit 34 of the node T corresponds to the node S as the distribution destination in the range of the hash value calculated from “virtual table name + primary key value”. Hold the attached information. Here, it is assumed that the same data distribution information is held in the nodes T1 to T3.

  At this time, the distribution destination of each transaction in the T layer is uniquely determined from the facility code “S2004”, which is a transaction key, based on “transaction distribution information” in the node P1. Also, KVS as processing target data The distribution destination in the S layer of each row (KV pair) is uniquely determined from “virtual table name + primary key” based on the data distribution information in the node T.

  At this time, similarly to the above-described specific example 1, transaction processing (recording of WAL) in the T layer and reflection of WAL in the S layer are performed asynchronously. Therefore, when the transaction 3 and the transaction 4 are executed, a unique key constraint violation (duplication of “facility code”) may occur in the virtual table D. In addition, in the virtual table C, a primary key constraint violation (duplication of “reservation number”) may occur.

  Therefore, in this specific example 2, “virtual table C + primary key value” and “virtual table D + unique key value” are violation detection keys that can cause a uniqueness constraint violation. Therefore, the management data distribution unit 23 of the node P1 stores management data distribution information related to the primary key and management data distribution information related to the unique key. The management data distribution information related to the primary key is information in which the node T that is the distribution destination of the management data is associated with the range of hash values calculated from “virtual table name + primary key value”. Further, the management data distribution information related to the unique key includes information in which the node T that is the distribution destination of the management data is associated with the range of hash values calculated from “virtual table name + unique key value”. Become. As a result, the node T that is the distribution destination of the management data related to the primary key and the management data related to the unique key is uniquely determined based on the management data distribution information in the node P1.

  Further, in this specific example 2, among the management data distributed and held in the management data distribution holding unit 31 of the node T, the management data related to the unique key is shown in FIG. In addition, although the left figure of FIG. 19 has shown the information hold | maintained at the management data dispersion | distribution holding | maintenance part 31 with a table format, as the right figure, the substance is KVS. In the left diagram of FIG. 19, the management data indicated by each row is information in which “transaction key” is associated with “virtual table name” and “unique key value”. That is, in the right diagram of FIG. 19, the KV pair of management data indicated by each row is associated with data representing “virtual table name, unique key, transaction key” using “virtual table name + unique key value” as a key. Information. In this case, the management data KV pair whose key is “virtual table name + unique key value” is the processing data KV pair specified from the “virtual table name + unique key value” to the node S. Indicates that it is waiting to be stored.

  The operation of the distributed processing system 1 in the specific example 2 configured as described above will be described.

  First, in the node P1, the application unit 21 generates the above-described transaction 3 (step S1 in FIG. 4).

  At this time, the transaction key of the transaction 3 is the facility code “S2004”. Therefore, the transaction distribution unit 22 specifies the distribution destination of the transaction 3 by referring to the transaction distribution information (step S2). Specifically, the transaction distribution unit 22 calculates a hash value of the facility code “S2004”. And the transaction distribution part 22 should just identify the node T matched with the range containing the calculated hash value in transaction distribution information. Here, it is assumed that the node T1 is specified.

  The violation detection key that may cause a uniqueness constraint violation in the update process of the first virtual table D in the transaction 3 is the facility code in the virtual table D, that is, “Table D_S2004”. The violation detection key that may cause a uniqueness constraint violation in the insertion processing into the second virtual table C is a reservation number in the virtual table C, that is, “Table C_06190930001”.

  Therefore, the management data distribution unit 23 specifies the distribution destination of the management data related to “Table D_S2004” that is the violation detection key including the unique key by referring to the management data distribution information related to the unique key. Specifically, the management data distribution unit 23 calculates the hash value of “Table D_S2004”. Then, the management data distribution unit 23 may specify the node T associated with the range including the calculated hash value in the management data distribution information related to the unique key. Here, it is assumed that the node T2 is specified. Similarly, the management data distribution unit 23 specifies the distribution destination of the management data related to the violation detection key “Table C_0619093001” including the primary key by referring to the management data distribution information related to the primary key. Specifically, the management data distribution unit 23 calculates a hash value of “Table C_0619093001”. Then, the management data distribution unit 23 may specify the node T associated with the range including the calculated hash value in the management data distribution information related to the primary key. Here, it is assumed that the node T3 is specified (step S3).

  Next, the transaction distribution unit 22 requests the processing of the transaction 3 to the node T1 to which the transaction 3 is allocated. Also, the management data distribution unit 23 notifies the node T1 of the node T2 as a management data distribution destination for the violation detection key “table D_S2004” including the unique key. In addition, the management data distribution unit 23 notifies the node T1 of the node T3 as a management data distribution destination for the violation detection key “Table C — 0619093001” including the primary key (step S4).

  Next, the node T1 requested to process the transaction 3 operates as follows. The transaction processing unit 32 of the node T1 holds the management data for the first violation detection key “table D_S2004” including the unique key in the management data distribution holding unit 31 of the node T2 notified as the distribution destination. Try to make it.

  Here, it is assumed that other management data (KV pair) having “Table D_S2004” as a key is not held in the management data distribution holding unit 31 of the node T2 (No in step S12 in FIG. 5).

  In this case, the transaction processing unit 32 of the node T1 causes the management data distribution and holding unit 31 of the node T2 to hold the KV pair in which the data including the transaction key “S2004” is associated with “Table D_S2004” as a key (Step S1). S13).

  Here, the success in holding the management data (KV pair) in the T layer using “Table D_S2004” as a key indicates the following. That is, the success of the holding indicates that the processing target data related to “Table D_S2004” is waiting to be stored in the data holding unit 11 (KVS) of the S layer for the subsequent transaction. Further, the success of the holding indicates that there is no processing target data related to “Table D_S2004” waiting for storage in the data holding unit 11 (KVS) of the S layer until just before.

  Next, the transaction processing unit 32 of the node T1 may confirm that there is no processing target data (KV pair) related to the “table D_S2004” that has been updated and reflected in the S layer. As a result, the transaction processing unit 32 ensures that no uniqueness constraint violation (unique key duplication) occurs. In this confirmation process, it can be specified by referring to the data distribution information which node in the S layer holds the processing target data related to “Table D_S2004”.

  Next, the transaction processing unit 32 executes steps S12 to S13 in the same manner as described above for the second violation detection key “table C — 061909300” including the primary key.

  That is, the transaction processing unit 32 tries to hold the management data for the second violation detection key “Table C — 061909300” including the primary key in the node T3 notified as the distribution destination.

  Here, it is assumed that other management data (KV pair) having “Table C — 061909300” as a key is not held in the management data distribution holding unit 31 of the node T3 (No in step S12).

  In this case, the transaction processing unit 32 of the node T1 causes the management data distribution and holding unit 31 of the node T3 to hold a KV pair in which data including the transaction key “S2004” is associated with “Table C — 061909300” as a key (Step S1). S13).

  As described above, success in holding the management data (KV pair) in the T layer with “Table C — 061909300” as a key indicates the following. In other words, the success of this holding indicates that the processing target data (KV pair) with “Table C_061909300” as a key is waiting to be stored in the data holding unit 11 (KVS) of the S layer for the subsequent transaction. Show. In addition, the success of the holding indicates that there is no processing target data (KV pair) with “Table C — 061909300” as a key waiting for storage in the data holding unit 11 (KVS) of the S layer until just before. ing.

  Next, the transaction processing unit 32 of the node T1 may confirm that there is no processing target data (KV pair) having “Table C — 061909300” updated as a key in the S layer. Thereby, the transaction processing unit 32 ensures that no uniqueness constraint violation (primary key duplication) has occurred. In this confirmation process, it can be identified by referring to the data distribution information which node in the S layer holds the processing target data with “Table C — 061909300” as a key.

  In this way, in the transaction 3, the node T1 succeeded in retaining the management data in the T layer for the violation detection key “table D_S2004” including the unique key and the violation detection key “table C_061909300” including the primary key. As a result, it is confirmed that the unique key duplication and the primary key duplication do not occur in the transaction 3.

  Therefore, the transaction processing unit 32 of the node T1 records the WAL of the transaction 3 in the transaction log holding unit 33 of the own device (step S15).

  Then, the transaction processing unit 32 notifies the completion of the transaction 3 to the node P1.

  Thus, the transaction 3 is completed.

  Further, asynchronously with the processing of the transaction 3, the delay reflection unit 34 of the node T1 reflects the WAL of the transaction 3 recorded in the transaction log holding unit 33 as follows.

  First, the delay reflection unit 34 specifies the distribution destination of the processing target data based on the violation detection key “table D_S2004” in the first process indicated by the WAL of the transaction 3 (step S31 in FIG. 6). Specifically, the delay reflection unit 34 specifies the node S corresponding to “index_table D_facility code_S2004” by referring to the data distribution information. Here, it is assumed that the node is S2.

  Next, the delay reflection unit 34 transmits the reflection information of the update process of the first virtual table D to the node S2 (step S32).

  Next, based on the reflection information, the data reflection unit 12 of the node S2 causes the data holding unit 11 to use the index information KV pair having “index_table D_facility code_S2004” as a key and “table D_0003” as a key. The KV pair is updated (step S42 in FIG. 7).

  Next, the data reflection unit 12 identifies the violation detection key “table D_S2004” including the unique key in the reflected processing target data by querying the node P1 for the node T to which the management data is distributed ( Step S43). Here, the node T2 is specified.

  Next, the data reflection unit 12 requests the node T2 to delete the management data for the violation detection key “Table D_S2004” (step S44).

  As a result, the management data distribution holding unit 31 of the node T2 deletes the management data (KV pair) using “Table D_S2004” as a key.

  Similarly, the delay reflection unit 34 of the node T1 also specifies, for example, the node S1 as the distribution destination of the processing target data for the second insertion process indicated by the WAL of the transaction 3, and sets the reflection information of the insertion process. Send. The node S1 that has received the reflection information operates in substantially the same manner as described above, and inserts processing target data with “Table C — 061909300” as a key into the data holding unit 11. Then, in response to a request from the node S1, the node T3 deletes the management data (KV pair) using the violation detection key “Table C_061909300” as a key from the management data distribution holding unit 31.

  Thus, the reflection of the transaction 3 on the SAL of the WAL is completed.

  Here, it is assumed that in parallel with the transaction processing at the node T1, the node P1 generates a transaction 4 and requests the processing from the node T2. In the transaction 4, the violation detection keys that may cause uniqueness violations are “table D_S 2004” including the unique key and “table C_061909300” including the primary key, as in the transaction 3. In the same manner as described above, the distribution destination of the management data of “Table D_S2004” including the unique key is T2, and the distribution destination of the management data of “Table C_061909300” including the primary key is the node T3.

  In this case, the management data distribution and holding unit 31 of the node T2 has already held the management data (KV pair) having “Table D_S2004” as a key by the processing of the transaction 3 described above. Therefore, the transaction processing unit 32 of the node T2 fails to hold the management data (KV pair) using “Table D_S2004” as a key in the T layer.

  Alternatively, it is assumed that the WAL reflection of the transaction 3 is progressing asynchronously during the processing of the transaction 4. It is also conceivable that the management data (KV pair) with “table D_S2004” by the transaction 3 as a key has already been deleted from the management data distribution holding unit 31 of the node T2. In this case, the transaction processing unit 32 of the node T2 succeeds in holding the management data (KV pair) using “Table D_S2004” as a key in the T layer.

  However, it is assumed that WAL reflection of transaction 3 has not been completed. Then, it is assumed that the management data distribution and holding unit 31 of the node T3 still holds the management data (KV pair) by “transaction 3” using “Table C — 061909300” as a key. In this case, the transaction processing unit 32 of the node T2 fails to hold the management data (KV pair) with “Table C — 061909300” as a key in the T layer.

  As described above, it is assumed that the transaction processing unit 32 of the node T2 requested to process the transaction 4 has failed to hold the management data of the violation detection key in the T layer (Yes in step S12). Specifically, the transaction processing unit 32 fails to hold at least one of the management data of the violation detection key “Table D_S2004” and the management data of the violation detection key “Table C_061909300”.

  In this case, the transaction processing unit 32 of the node T2 returns the state before starting the processing of the transaction 4 (step S17), and notifies the node P1 of the error of the transaction 4 (step S18). For example, a case where the management data of “Table D_S2004” has been successfully held but the management data of “Table C_061909300” has not been successfully held will be described. In this case, the transaction processing unit 32 of the node T2 may return to the original state by canceling the holding of the management data of “Table D_S2004”.

  This is the end of the description of the transaction 4 by the node T2.

  Note that the operation of the configuration management apparatus 40 when the node T4 is added is substantially the same as in the first specific example. However, in step S65, the distribution information update unit 41 determines the update contents of the management data distribution information based on the unique key in addition to the update contents of the management data distribution information based on the transaction distribution information and the primary key. . In step S66, the distribution information update unit 41 controls the movement of management data related to the unique key in addition to the control of movement of management data related to the primary key between the nodes T1 to T3. In step S67, the distribution information update unit 41 updates the management data distribution information based on the unique key in addition to the update of the management data distribution information based on the transaction distribution information and the primary key of the node P1.

  Above, description of the specific example 2 is complete | finished.

  Next, effects of the embodiment of the present invention will be described.

  The distributed processing system as an embodiment of the present invention has the following effects in a distributed processing system in which transaction log recording and actual data reflection are performed asynchronously. That is, the distributed processing system as an embodiment of the present invention more reliably detects a constraint violation related to uniqueness across processing units while suppressing a decrease in scalability when a transaction is distributed and executed in a plurality of processing units. be able to.

  The reason is that each device of the transaction distributed processing device is configured to operate as follows. In other words, the management data distribution holding unit holds the management data distributed to the own device based on the violation detection key that may cause a uniqueness constraint violation between transactions in association with the violation detection key. In addition, the management data distribution holding unit holds such management data while the processing target data targeted by the transaction is waiting for the transaction log to be reflected. Then, when the transaction processing unit processes the requested transaction, it tries to hold the management data for the violation detection key in the transaction to the distribution destination. Then, when the management data is not held in the management data distribution holding unit of the distribution destination transaction distribution processing device, the transaction processing unit holds the management data. Then, when the management data is successfully stored in the distribution destination, the transaction processing unit completes the transaction processing by recording the transaction log. Then, the delay reflection unit reflects the transaction log to the processing target data of the data holding device asynchronously with the transaction processing.

  As a result, the present embodiment is unique at the time of transaction processing without waiting for the reflection to the processing target data even when the reflection to the processing target data is performed asynchronously after delaying the transaction processing. A constraint violation can be reliably detected. Further, in the present embodiment, management data for reliably detecting such a unique constraint violation is generated based on the definition information of the transaction, and is deleted when the processing target data is made permanent. For this reason, this Embodiment does not require special user operation. In this embodiment, management data for reliably detecting such a uniqueness constraint violation is distributed and held in one or more transaction distributed processing devices. For this reason, this embodiment does not concentrate the load on one apparatus and does not impair the scalability of the distributed processing system as compared with the case where one apparatus centrally manages such uniqueness constraint violations. In addition, according to the present embodiment, in accordance with a configuration change such as addition or deletion of each device constituting the distributed processing system, the management data distributed retention destination for reliably detecting such a uniqueness constraint violation is updated. To do. For this reason, this embodiment is easy to scale out.

  In this embodiment, the transaction distribution information, the management data distribution information, and the data distribution information are determined by the distribution destination device for the range of hash values calculated from the key value. It was described as information. In addition, each distribution information may be other information as long as the distribution destination can be uniquely specified based on the key value.

  Further, in the present embodiment, an example has been described in which the application apparatus notifies the distribution destination of management data to the transaction distribution processing apparatus that is the distribution destination of the transaction. In addition, the transaction distributed processing device to which the transaction processing is distributed may be configured to obtain the distribution destination of the corresponding management data by making an inquiry to the application device.

  Further, in the present embodiment, an example has been described in which the data holding device that has reflected the transaction log obtains the distribution destination of the corresponding management data by making an inquiry to the application device. In addition, the transaction distributed processing device that requested the reflection of the transaction log may be configured to notify the data holding device that is the distribution destination of the reflection of the device to which the corresponding management data is distributed. In this case, the data holding device may maintain the communication connection with the transaction distributed processing device that has requested the reflection of the transaction log until the data reflection is completed. This eliminates the need for the data holding device to specify the distribution destination of the management data after reflecting the data, thereby reducing the communication cost.

  In the present embodiment, the processing target data is mainly described as being distributed and held in a plurality of data holding devices. However, the processing target data in the present invention is necessarily distributed and held in a plurality of devices. It does not have to be. In that case, the delay reflection unit of the transaction distributed processing apparatus according to the present embodiment does not necessarily store the data distribution information.

  In the present embodiment, the example in which the processing target data is KVS representing a virtual table has been mainly described. However, the present invention can be applied to various systems that perform distributed processing on transactions for processing target data.

  In addition, the present invention is not limited to the above-described embodiments, and can be applied to various distributed processing systems that perform transaction processing and reflection on processing target data asynchronously.

  In each embodiment of the present invention described above, each functional block of the data holding device, the transaction distributed processing device, the application device, and the configuration management device executes a computer program stored in a storage device or ROM. The description has been centered on an example realized by the CPU. However, the present invention is not limited to this, and some, all, or a combination of each functional block may be realized by dedicated hardware.

  Moreover, in each embodiment of the present invention described above, the functional blocks of each device may be realized by being distributed to a plurality of devices.

  In each embodiment of the present invention described above, the operation of each device described with reference to each flowchart may be stored in a storage device (storage medium) of the computer device as a computer program of the present invention. Good. Then, the computer program may be read and executed by the CPU. In such a case, the present invention is constituted by the code of the computer program or a storage medium.

  The present invention has been described above using the above-described embodiment as an exemplary example. However, the present invention is not limited to the embodiment described above. That is, the present invention can apply various modes that can be understood by those skilled in the art within the scope of the present invention.

  This application claims the priority on the basis of Japanese application Japanese Patent Application No. 2013-265516 for which it applied on December 24, 2013, and takes in those the indications of all here.

DESCRIPTION OF SYMBOLS 1 Distributed processing system 10 Data holding apparatus 11 Data holding part 12 Data reflection part 20 Application apparatus 21 Application part 22 Transaction distribution part 23 Management data distribution part 30 Transaction distributed processing apparatus 31 Management data distribution holding part 32 Transaction processing part 33 Transaction Log holding unit 34 Delay reflection unit 40 Configuration management device 41 Distribution information update unit 1001, 2001, 3001, 4001 CPU
1002, 2002, 3002, 4002 RAM
1003, 2003, 3003, 4003 ROM
1004, 2004, 3004, 4004 Storage device 1005, 2005, 3005, 4005 Network interface

Claims (21)

Management data distributed to its own device based on a violation detection key that can cause a uniqueness constraint violation between transactions, while the processing target data targeted by the transaction is waiting for reflection of the transaction log, the violation detection key Management data distributed holding means to hold in association with,
When processing a transaction whose processing is distributed to the own device (transaction distributed processing device), the own device or the other transaction distribution to which the management data specified based on the violation detection key in the transaction is allocated When other management data associated with the violation detection key is not held in the management data distribution holding means of the processing device, the management data related to the transaction is stored in the management data distribution holding destination Transaction processing means for completing the transaction processing by pre-recording the transaction log representing the processing content of the transaction in the transaction log holding means after the means is held in association with the violation detection key;
A delay reflecting means for reflecting the transaction log held in the transaction log holding means to the processing target data asynchronously with the processing by the transaction processing means;
Transaction processing apparatus comprising: The processing target data is expressed in a format in which data is associated with the key using information including identification information of a virtual table (virtual table) and a primary key value in the virtual table as a key, and the transaction When a uniqueness constraint violation can occur for a primary key or unique key in the virtual table between
The management data distribution and holding unit holds the management data in association with information including identification information of the virtual table and a value of the primary key or a value of the unique key. The transaction distributed processing device described. When the processing target data is distributed and held in a plurality of data holding devices,
The delay reflecting means stores data distribution information for identifying the data holding device that is a distribution destination of processing target data targeted by the transaction log among the plurality of data holding devices, The reflection information for reflecting the transaction log in the processing target data is transmitted to the data holding device specified based on the data distribution information. Transaction distributed processing unit. Application means for generating a transaction for the data to be processed;
The transaction distribution information for specifying the transaction distributed processing device which becomes the transaction distribution destination among the transaction distributed processing devices according to any one of claims 1 to 3, is stored, Transaction distribution means for requesting the transaction distributed processing device specified based on the transaction distribution information to process the transaction generated by the application means;
Management data distribution information for specifying the transaction distribution processing device that is the distribution destination of the management data among the transaction distribution processing devices is stored, and is specified based on the management data distribution information Management data distribution means for notifying the transaction distributed processing device to the transaction distributed processing device that is the distribution destination of the transaction;
Application device equipped with. The application means uses the identification information of a virtual table (virtual table) and information including the value of the primary key in the virtual table as a key, and the processing target expressed in a format in which data is associated with the key Generate the transaction for the data,
The management data distribution means, when a unique constraint violation may occur for the primary key or unique key in the virtual table between the transactions, the identification information of the virtual table and the value of the primary key or the value of the unique key 5. The application apparatus according to claim 4, wherein the management data distribution information for specifying the transaction distributed processing apparatus to which the management data is distributed is stored based on the information consisting of . Data holding means for holding the processing target data;
Data reflecting means for reflecting the transaction log held in the transaction distributed processing device according to any one of claims 1 to 3 to the data holding means;
A data holding device.   The data holding means holds the processing target data in the form of data for the key using information including identification information of a virtual table (virtual table) and a value of a primary key in the virtual table as a key. The data holding device according to claim 6.   The data holding device according to claim 6 or 7, wherein the data holding unit holds the processing target data in a distributed manner with other data holding devices.   When the data reflection unit completes the reflection on the processing target data, the management data distribution holding unit transfers the management data to the transaction distribution processing device to which the management data related to the violation detection key in the processing target data is distributed. 9. The data holding device according to claim 6, wherein the management data is requested to be deleted.   The transaction distribution information and the management held in the application device according to claim 4 or 5 according to a configuration change of the transaction distributed processing device according to any one of claims 1 to 3. A configuration management apparatus comprising distribution information updating means for updating data distribution information.   The configuration management apparatus according to claim 10, wherein the distribution information update unit updates the data distribution information held in the transaction distributed processing device according to a configuration change of the data holding device. . The transaction distributed processing device according to any one of claims 1 to 3,
The application device according to claim 4 or 5, wherein the transaction processing request is issued to the transaction distributed processing device;
The data holding device according to any one of claims 6 to 9, which holds processing target data that is a target of a transaction generated by the application device;
The configuration management device according to claim 10 or 11, which manages configurations of the transaction distributed processing device, the application device, and the data holding device;
Distributed processing system with When a transaction for data to be processed is distributed to one or more transaction distributed processing devices,
Management data associated with a violation detection key that may cause a unique constraint violation between transactions is distributed to the transaction distributed processing device specified based on the violation detection key,
When the management data based on another transaction associated with the violation detection key is not held in the transaction distributed processing device to which the management data is distributed, the processing target data is reflected in the transaction log. While waiting, after holding the management data in association with the violation detection key,
Transaction processing is completed by pre-recording the transaction log in the transaction distributed processing device to which the transaction is allocated,
A distributed processing method in which the transaction log is reflected in the processing target data asynchronously with the transaction processing. Management data distributed to its own device based on a violation detection key that can cause a uniqueness constraint violation between transactions, while the processing target data targeted by the transaction is waiting for reflection of the transaction log, the violation detection key Using management data distributed holding means to hold in association with
When processing a transaction to which processing is assigned to the own device, the management data distributed and holding means of the own device or another device to which the management data specified based on the violation detection key in the transaction is assigned, When other management data associated with the violation detection key is not retained, the management data relating to the transaction is retained in association with the violation detection key in the management data distribution and retention unit at the distribution destination The transaction processing is completed by pre-recording a transaction log representing the processing content of the transaction,
A transaction distributed processing method in which the transaction log is reflected on the processing target data asynchronously with the transaction processing. Management data distributed to its own device based on a violation detection key that can cause a uniqueness constraint violation between transactions, while the processing target data targeted by the transaction is waiting for reflection of the transaction log, the violation detection key Using management data distributed holding means to hold in association with
When processing a transaction to which processing is assigned to the own device, the management data distributed and holding means of the own device or another device to which the management data specified based on the violation detection key in the transaction is assigned, When other management data associated with the violation detection key is not retained, the management data relating to the transaction is retained in association with the violation detection key in the management data distribution and retention unit at the distribution destination Transaction processing step for completing the transaction processing by pre-recording the transaction log representing the processing content of the transaction in the transaction log holding means,
A delay reflecting step of reflecting the transaction log held in the transaction log holding means asynchronously with the transaction processing on the processing target data;
A storage medium storing a transaction distributed processing program for causing a computer device to execute. A transaction distribution information for identifying a transaction distribution processing device that is a distribution destination of the transaction among the transaction distribution processing devices that execute the transaction distribution processing method according to claim 14, and the transaction distribution processing device , Using management data distribution information for specifying the transaction distributed processing device that is the distribution destination of the management data,
Generate a transaction for the data to be processed,
Request the transaction distributed processing device identified based on the transaction distribution information to process the generated transaction;
A transaction distribution method for notifying a transaction distributed processing device that is specified based on the management data distribution information to a transaction distributed processing device that is a distribution destination of the transaction. Transaction distribution information for identifying a transaction distribution processing device that is a distribution destination of the transaction among transaction distribution processing devices that execute the transaction distribution processing program stored in the storage medium according to claim 15; Among the transaction distributed processing devices, using management data distribution information for specifying the transaction distributed processing device that is the distribution destination of the management data,
A transaction generation step of generating a transaction for the processing target data;
A transaction distribution step for requesting the transaction distributed processing device specified based on the transaction distribution information to process the transaction generated in the transaction generation step;
A management data distribution step for notifying a transaction distributed processing device, which is a distribution destination of the transaction, of a transaction distributed processing device specified based on the management data distribution information;
The storage medium which memorize | stored the transaction distribution program which makes a computer apparatus perform.   A data holding method for holding data to be processed that reflects a transaction log recorded in advance by a transaction distributed processing device that executes the transaction distributed processing method according to claim 14.   A reflecting step of reflecting a transaction log recorded in advance by a transaction distributed processing device that executes a transaction distributed processing program stored in a storage medium according to claim 15 on the processing target data held in the data holding means. A storage medium storing a data holding program to be executed by a computer device.   The transaction distribution information and the management data distribution information used in the transaction distribution method according to claim 16 in accordance with a configuration change of a transaction distributed processing apparatus that executes the transaction distributed processing method according to claim 14. Configuration management method to be updated.   The said transaction distribution program memorize | stored in the storage medium of Claim 17 is used by the transaction distribution program memorize | stored according to the structure change of the transaction distribution processing apparatus which executes the transaction distribution processing program memorize | stored in the storage medium of Claim 15 A storage medium storing a configuration management program for causing a computer apparatus to execute a distribution information update step for updating transaction distribution information and the management data distribution information.

Images