JP5741131B2 - Parameter management method using similar requirements - Google Patents

Description

  The present invention relates to a technique for optimizing tuning parameters in a bus transfer type message exchange system.

  2. Description of the Related Art In recent years, service forms such as SaaS (Software as a Service) and cloud have attracted attention as a business form in which a computer resource is owned by a computer and used by a customer. These operators generally have a large number of computers in a data center and provide services to customers. As a result, compared to conventional systems used in the company, new hardware configuration changes have occurred due to hardware plan updates and equipment accommodation plans, and a large amount of hardware is present along with this. There is a new problem of facilitating operations such as changing the configuration of the system constructed above. Patent Document 1 discloses a job having a learning function that analyzes and accumulates interactively obtained instructions, efficiently allocates resources to the job using the information, and adapts to the planning contents. -It is related with a resource allocation learning apparatus.

Japanese Patent No. 3740728

  By the way, a conventional cloud business operator has a large number of computer systems and provides services using the system to customers. In an environment owned by a cloud business operator, there is a tendency that the configuration is changed more frequently than a conventional in-house system due to a model update due to technological advancement or an increase in physical accommodation efficiency. As a matter of course, there is a demand for improving the work efficiency of the configuration change. Also, minimizing the amount of investment is a natural requirement for businesses, and for cloud businesses, providing services with a smaller number of computers and less expensive computer hardware for equivalent processing performance. Is an issue.

  On the other hand, in recent years, a system based on SOA (Service Oriented Architecture) that realizes business improvement and integration by linking business applications as services and linking between services has been used. As one form of a system based on SOA, there is a bus type message exchange system that realizes cooperation between systems by mutually converting protocols and data formats between systems using different protocols and different data formats.

  Here, the bus type message exchange system is one form of a computer system, and when the cloud operator uses the bus type message exchange system, the problem of the cloud operator applies to the bus type message exchange system as it is. In a bus-type message exchange system, the processing efficiency is optimized by adjusting the number of threads allocated to linked input and output processing (hereinafter referred to as “tuning”), and equivalent processing is achieved with fewer computer resources. Capability can be provided. Tuning is a characteristic that adjustment values differ according to system requirements such as the amount of data determined according to customer requirements, guaranteed response time (turnaround time; hereinafter referred to as “TAT”), and hardware processing capacity. have.

  For this reason, conventionally, it has been generally performed manually for each system in accordance with customer requirements, and there is a problem that it takes time and effort. Of course, since the processing capability during tuning does not reach after tuning, there is a problem that higher performance, that is, more expensive hardware must be used to cover this, and the cost is increased.

  In view of such circumstances, the present invention aims to improve the efficiency of tuning work to the optimum parameters according to customer requirements and minimize the hardware cost in a cloud environment or a large-scale load distribution environment. .

  The invention according to an embodiment of the present invention is a method for tuning a bus transfer type message exchange system. This tuning method automatically determines tuning parameters such as the number of processing threads, accumulates the determined parameters, and uses parameters with similar requirements to improve the initial value accuracy of parameters. It is characterized by.

  That is, the invention according to an embodiment of the present invention measures the number of messages that have passed through each component connected to the path through which the message passes in the bus type message exchange system, and calculates the throughput for each component. In addition, tuning parameters are determined and set in the computer so that the throughput of each component is leveled and predetermined system requirements are satisfied. Here, the system requirements may include TAT and message length. At the same time, it is stored in the tuning parameter storage device. The invention according to an embodiment of the present invention refers to a tuning parameter stored in a tuning parameter storage device and uses it as an initial parameter in tuning other computers. Furthermore, the invention according to an embodiment of the present invention dynamically updates the optimum parameters in response to changes in the frequency of message transmission / reception and changes in requirements by measuring throughput in real time.

  According to the present invention, tuning parameters that satisfy the requirements and equalize the throughput between components in the service bus are set. The parameter calculation / setting device refers to the throughput of each component using the throughput reference means, and equalizes the throughput with the number of message passing balancer, so that the component with insufficient throughput is required to increase the number of allocated threads. The number of assigned threads is reduced for components that have excessive throughput. This minimizes the number of waiting threads that satisfy the requirements, thereby eliminating waste of CPU resources and maximizing processing efficiency (number of processing messages / CPU usage time).

  The parameters tuned in this way are held in the tuning parameter storage device. By referencing the optimum tuning parameters stored in the tuning parameter storage device to each service bus with reference to the parameter calculation / setting device, the initial value accuracy of parameters in other service buses is increased, and processing efficiency is optimized. You can save time. Further, since the accuracy of the initial value is increased, the load factor is lowered. As a result, the processing margin is reduced, and low-cost hardware with a lower processing capability can be used.

It is a block diagram which shows schematic structure of the message exchange system which concerns on one Embodiment of this invention. In this embodiment, it is a figure which shows an example of the record format stored in the tuning parameter storage apparatus 125. FIG. 4 is a flowchart showing a flow of processing for calculating an actual measurement value of throughput in the service bus 101 in the present embodiment. In this embodiment, it is a flowchart which shows the flow of a process in the parameter calculation / setting apparatus 119. It is a block diagram which shows schematic structure of a message exchange system about the Example which copies a tuning parameter at the time of load distribution.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. In addition, the same code | symbol is attached | subjected to the same element and the overlapping description is abbreviate | omitted.

  FIG. 1 is a block diagram showing a schematic configuration of a bus transfer type message exchange system according to an embodiment of the present invention. As shown in the figure, the message exchange system includes a service bus 101, a parameter calculation / setting device 119, and a tuning parameter storage device 125.

  The service bus 101 includes a first external communication unit 102 and a second external communication unit 111 that perform communication with an external system, and a routing unit 109 that distributes messages. The service bus 101 is a bus having the same functions as the conventional bus, and is connected to a plurality of external systems such as the client 117 and the Web service 118 through the LAN, and performs message transfer between these external systems.

  The first external communication unit 102 includes an external communication reception unit 103, a transmission unit 104 to the routing unit 109, a throughput measurement unit 105, a thread number control unit 106, and a parameter setting unit 107, and communicates with the client 117.

  The routing unit 109 is connected to the first external communication unit 102 and the second external communication unit 111 through the first queue 108 and the second queue 110, and performs routing inside the service bus 101.

  The second external communication unit 111 includes an external communication transmission unit 112, a reception unit 113 from the routing unit 109, a throughput measurement unit 114, a thread number control unit 115, and a parameter setting unit 116, and communicates with the Web service 118. .

  The parameter calculation / setting device 119 includes a throughput reference unit 120, a passing message number balancer 121, a thread number adjustment unit 122, a parameter setting unit 123, and a storage device communication unit 124. The parameter calculation / setting device 119 is further connected to the service bus 101 and calculates and sets the optimum parameters of the service bus 101.

  The tuning parameter storage device 125 includes parameter storage means 126 and parameter reference means 127. The tuning parameter storage device 125 is further connected to a parameter calculation / setting device 119 for storing and referring to the tuning parameters.

  FIG. 2 is a diagram illustrating an example of a record format stored in the tuning parameter storage device 125 in the present embodiment. The tuning parameter storage device 125 stores a record including the requirement 201 and the tuning parameter 206. More specifically, the tuning parameter storage device 125 stores a tuning parameter 206 using the requirement 201 as a key. The requirement 201 is defined by the customer, and includes a TAT worst value 202, a TAT average value 203, a data size maximum value 204, and a data size average value 205. The tuning parameter 206 includes a first external communication unit thread number 207 and a second external communication unit thread number 208. The tuning parameter 206 is adjusted by the parameter calculation / setting device 119 so as to satisfy the requirement 201 defined by the customer.

  In this embodiment, the element of the tuning parameter 206 is only the number of threads assigned to each component. However, the number of threads is not limited to this, and the number of connection pools can also be handled as the tuning parameter.

  Next, the processing flow in the present embodiment will be described with reference to FIGS.

  FIG. 3 is a flowchart showing a flow of processing for calculating an actual measured value of the throughput in the service bus 101 in the present embodiment. The service bus 101 constituting the bus transfer type message exchange system plays a role of flowing a message received from the outside into the bus and transferring it to the outside. In the bus transfer type message exchange system, processing such as data format conversion is generally interposed, but since it is not directly related to the present embodiment, it is omitted in the following description.

  In the first external communication unit 102, when the external communication receiving means 103 receives a message from the client 117 (301), the message is sent in parallel at a multiplicity corresponding to the number of threads controlled by the thread number control means 106. 1 to the queue 108. At this time, if a message exceeding the number of controlled threads is received simultaneously, the message enters a waiting state. The waiting message starts processing as soon as the thread is available, but insufficient thread count causes a decrease in throughput. When the message is transferred to the routing unit 109, the throughput measuring unit 105 counts the message as a message that has passed through the first external communication unit 102, and calculates the first external communication from the number of messages that have passed per unit time. Throughput information of the unit 102 is calculated (302).

  In the first queue 108, the messages received from the first external communication unit 102 are sequentially extracted from the first queue 108 to the routing unit 109 (303). When receiving a message from the first queue 108, the routing unit 109 performs routing processing and transfers the message to the second queue 110 (304).

  In the second external communication unit 111, when the reception unit 113 from the routing unit receives a message from the second queue 110 (305), the external communication transmission unit 112 is controlled by the thread number control unit 115. In parallel with the multiplicity corresponding to the number, the message is transferred to the Web service 118. At this time, as in the processing in the first external communication unit 102, when messages exceeding the number of threads controlled by the thread number control means 115 are received simultaneously, the message enters a waiting state. The waiting message starts processing as soon as the thread is available, but insufficient thread count causes a decrease in throughput. Similarly to the processing in the first external communication unit 102, the throughput of the external communication unit 2 is calculated simultaneously with reception from the routing unit. That is, the throughput measuring unit 114 counts messages that have passed through the second external communication unit 111 and calculates throughput information (306).

  FIG. 4 is a flowchart showing the flow of processing in the parameter calculation / setting apparatus 119 in the present embodiment. As in FIG. 3, processing that is not directly related to the present embodiment, such as data format conversion, is not described.

  The parameter calculation / setting device 119 uses the parameter storage means 126 of the tuning parameter storage device 125 before starting the message transmission from the client 117, and uses the TAT worst value 202, the TAT average value 203, and the maximum data size as the maximum message length. The requirement 201 including the value 204 and the data size average value 205 as the average message length is compared, and whether or not the tuning parameter 206 of the same requirement or similar requirement is stored in the tuning parameter storage device 125 using the requirement 201 as a key. Confirm (401).

  When the tuning parameter 206 having the same requirement or similar requirement is stored in the tuning parameter storage device 125 (402: Yes), the parameter calculation / setting device 119 uses the parameter reference means 127 of the tuning parameter storage device 125 to The tuning parameter 206 is retrieved (408). Then, based on the tuning parameter record extracted from the tuning parameter storage device 125, the parameter setting unit 123 sets each of the first external communication unit 102 and the second external communication unit 111 (409). ). In this embodiment, the number of threads of each of the first external communication unit 102 and the second external communication unit 111 is set.

  When the tuning parameter storage device 125 does not store the tuning parameter 206 having the same requirement or the similar requirement (402: No), or after the tuning parameter is set by the parameter setting unit 123 in step 409, the throughput measuring unit 105, The throughput information of the first external communication unit 102 and the second external communication unit 111 measured by 114 is referred to (403). Throughput information is measured by the parameter calculation / setting device 119 by the process illustrated in FIG.

  Subsequently, the passing message number balancer 121 calculates the number of messages that satisfy the requirement 201 and pass a uniform number of messages between the first external communication unit 102 and the second external communication unit 111 ( 404). Then, the thread number adjusting unit 122 calculates the minimum number of threads that can process the number of messages calculated by the passing message number balancer 121 for each of the first external communication unit 102 and the second external communication unit 111 (405). ). The parameter setting unit 123 of the parameter calculation / setting device 119 sets the calculated number of threads using the parameter setting units 107 and 116 for the first external communication unit 102 and the second external communication unit 111, respectively. Is applied (406). Further, the storage device communication means 124 of the parameter calculation / setting device 119 uses the parameter storage means 126 of the tuning parameter storage device 125 to adjust the number of adjusted threads of each unit and the TAT worst value 202 defined as system requirements. The TAT average value 203, the data size maximum value 204, and the data size average value 205 are stored as one record in the tuning parameter storage device 125 (407).

  In this way, in the bus transfer type message exchange system, it is possible to refer to the optimum tuning parameter by accumulating the optimized tuning parameter in the tuning parameter accumulating device 125, thereby realizing high-precision tuning in a plurality of computers. To do.

  As for the tuning parameter optimization in the first representative computer, as described above, the number of threads in each unit is set so that the number of passing messages is uniform among a plurality of checkpoints. Preferably, the number of threads is set so that the total CPU utilization rate including the threads is minimized. Then, tuning parameters such as the adjusted number of threads are stored in the tuning parameter storage device 125 using the requirement 201 including the TAT worst value 202, the TAT average value 203, the data size maximum value 204, and the data size average value 205 as a key. When the remaining plurality of computers take out the tuning parameters from the tuning parameter storage device 125, the tuning parameters are taken out from a record in which all the elements of the requirement 201 completely match or a similar record. As a similar record, for example, it is preferable to extract a record having the smallest sum of error rates for each element.

  In the above embodiment, the throughput of the first external communication unit 102 and the second external communication unit 111 is calculated, and the number of passing messages is uniform between the first external communication unit 102 and the second external communication unit 111. Although the example in which the number of threads in each unit is set is shown, the first external communication unit 102, the routing unit 109, and the routing control unit (not shown) that holds the routing information of the routing unit 109 are further provided. The throughput of each of the second external communication units 111 is calculated, and the number of threads in each unit is set so that the number of passing messages is uniform among the first external communication unit 102, the routing unit 109, and the second external communication unit 111. As such, a message exchange system may be configured. At this time, the routing control unit includes a throughput measuring unit and a parameter setting unit (not shown).

  In the system configuration including the routing control unit, in the throughput calculation process, the following process is performed in addition to the process shown in FIG. That is, after the routing unit 109 retrieves the message from the first queue 108 in step 303, the routing unit 109 transfers the message to a third queue (not shown). When the routing control unit receives a message from the routing unit 109 via the third queue, the routing control unit performs routing processing and then returns the message to the routing unit 109 again via the third queue. At this time, simultaneously with the completion of the return processing, the throughput measuring means in the routing control unit counts the messages that have passed through the routing control unit, and calculates the throughput. The throughput calculation process is the same as the process in the first external communication unit 102. When the routing unit 109 receives a message from the routing control unit, the routing unit 109 returns to step 304 and transfers the message to the second queue 110.

  In the system configuration including the routing control unit, the parameter calculation / setting apparatus 119 performs the following processing in addition to the processing shown in FIG. That is, in step 409, based on the tuning parameter record extracted from the tuning parameter storage device 125, the parameter setting unit 123 sets each of the first external communication unit 102, the routing unit 109, and the second external communication unit 111. Set the number of threads. In step 403, when the throughput information is referred to, in addition to the throughput information of the first external communication unit 102 and the second external communication unit 111 measured by the throughput measurement means 105 and 114, The throughput information of the routing unit 109 measured by the throughput measuring unit is also referred to. Subsequently, in step 404, the passing message number balancer 121 satisfies the requirement 201, and a uniform number of messages pass between the first external communication unit 102, the routing unit 109, and the second external communication unit 111. Calculate the number of such messages. In step 405, the thread number adjusting unit 122 can process the number of messages calculated by the passing message number balancer 121 for each of the first external communication unit 102, the routing unit 109, and the second external communication unit 111. Calculate the minimum number of threads. Further, in step 406, the parameter setting unit 123 of the parameter calculation / setting device 119 has a parameter setting unit provided for each of the first external communication unit 102, the routing unit 109, and the second external communication unit 111. Use to apply the calculated thread count setting. Thus, more accurate tuning can be realized in a plurality of computers.

  Next, another embodiment of the present invention will be described.

  FIG. 5 is a block diagram showing a schematic configuration of a message exchange system according to an embodiment in which tuning parameters are copied during load distribution. In the figure, clients 501a-n, service buses 503a-n, and Web services 504a-n correspond to the client 117, service bus 101, and Web service 118 of FIG. 1, respectively. Each of the n computers 502a-n includes a corresponding service bus 503a-n, and each is connected to the corresponding client 501a-n and Web service 504a-n. In this embodiment, the parameter calculation / setting device 509 is connected to n service buses 503a to 503n through a LAN. The parameter calculation / setting device 509 is connected to the database controller 510, and the database controller 510 controls the operation of the tuning parameter storage device 511.

  When the (n + 1) th service bus is newly added to this configuration, the parameter calculation / setting device 509 determines whether there is a similar requirement among the existing n requirements with respect to the (n + 1) th requirement. Confirm with the tuning parameter storage device 511.

  When tuning parameters having similar requirements are held in the tuning parameter storage device 511, the tuning parameters are applied to the (n + 1) th service bus. If there are multiple similar requirements in the existing n requirements, the tuning parameter of the most similar requirement (the same requirement if there is the same requirement) is set to the (n + 1) th service. Applies to buses. Here, a similar requirement exists when there is a record that completely matches all elements of the (n + 1) th requirement among existing n requirements, or the similarity to the (n + 1) th requirement is This refers to the case where there are existing n records below a predetermined threshold value. The similarity is preferably calculated by, for example, the sum of error rates for each element. In this way, the operation can be started promptly with a highly accurate setting.

  The present invention is not limited to the above-described embodiment, and can be implemented in various other forms without departing from the gist of the present invention. For this reason, the said embodiment is only a mere illustration in all points, and is not interpreted limitedly. For example, the above-described processing steps can be executed in any order or in parallel as long as there is no contradiction in the processing contents. In the present specification and claims, the term uniform includes not only completely uniform but also substantially uniform. Similarly, in this specification and the claims, the term simultaneous includes the case of substantially simultaneous as well as the case of completely simultaneous.

A part or all of the above embodiments can be described as in the following supplementary notes, but is not limited thereto.

  (Supplementary Note 1) In a message exchange system, a service bus connected to an external system for transferring messages, a tuning parameter storage device in which system requirements and tuning parameters are stored in association with each other, and information acquired from the service bus A parameter calculation / setting device that determines the tuning parameter based on the parameter and applies the determined tuning parameter setting to the service bus. The parameter calculation / setting device corresponds the determined tuning parameter to the system requirements. And a storage device communication means for storing the tuning parameters in the tuning parameter storage device and reading out the tuning parameters from the tuning parameter storage device using the system requirements as a key. .

  (Supplementary note 2) The message exchange system according to supplementary note 1, wherein the tuning parameter includes the number of threads.

  (Supplementary Note 3) The parameter calculation / setting device is configured to obtain throughput information measured at a plurality of check points of the service bus, and throughput information at the plurality of check points acquired by the throughput reference means. The message count balancer that calculates the number of messages that allow a uniform number of messages to pass between multiple checkpoints, and the minimum number of threads that can process the number of messages calculated by the message count balancer. A thread number adjusting unit for calculating each of the check points, and a parameter setting unit for applying the setting of the number of threads calculated for each of the plurality of check points to each of the plurality of check points by the thread number adjusting unit. The message exchange according to appendix 2, wherein the device communication means stores the number of threads calculated for each of the plurality of checkpoints by the thread number adjustment means in association with the system requirements in the tuning parameter storage device. system.

  (Supplementary note 4) The system requirements include at least one of the worst value of response time, the average value of response time, the maximum value of data size, or the average value of data size. The message exchange system according to any one of the above.

  (Appendix 5) A method for managing tuning parameters in a message exchange system including a service bus, a tuning parameter storage device, and a parameter calculation / setting device connected to the service bus and the tuning parameter storage device, The parameter calculation / setting device determines a tuning parameter based on the information acquired from the service bus, applies the determined tuning parameter setting to the service bus, and determines the determined tuning parameter as a system requirement. A method comprising: associating and storing in a tuning parameter storage device; and reading out tuning parameters from the tuning parameter storage device using system requirements as a key.

DESCRIPTION OF SYMBOLS 101 Service bus, 102 1st external communication part, 103 External communication receiving means, 104 Transmission means to routing part, 105 Throughput measurement means, 106 Thread number control means, 107 Parameter setting means, 108 1st queue, 109 Routing 110, second queue, 111 second external communication unit, 112 external communication transmission unit, 113 reception unit from routing unit, 114 throughput measurement unit, 115 thread number control unit, 116 parameter setting unit, 117 client, 118 Web service, 119 parameter calculation / setting device, 120 throughput reference means, 121 passed message number balancer, 122 thread number adjustment means, 123 parameter setting means, 124 storage device communication means, 125 Chu Packaging parameter storage unit, 126 parameter storage unit, 127 parameter reference means, 501 clients, 502 computer, 503 service bus, 504 Web service, 509 parameter calculation-setting device, 510 database controller, 511 tuning parameter storage device

Claims (5)

In a message exchange system,
A service bus for transferring messages, connected to external systems;
And tuning parameters storage device and system requirements defined by the user and tuning parameters are stored in association,
A parameter calculation / setting device for determining a tuning parameter to satisfy a system requirement defined by the user based on information obtained from the service bus, and applying the determined tuning parameter setting to the service bus; ,
With
The parameter calculation / setting device stores the determined tuning parameter in the tuning parameter storage device in association with the system requirement defined by the user , and uses the tuning parameter storage device as a key for the system requirement. to read out the tuning parameters of the same requirements or similar requirements, and a storage device communication means may utilize tuning parameters read the as initial parameters in the tuning of the other computer,
A message exchange system characterized by that.   The message exchange system according to claim 1, wherein the tuning parameter includes the number of threads. The parameter calculation / setting device includes:
Throughput reference means for acquiring throughput information measured at a plurality of checkpoints of the service bus;
Based on throughput information at a plurality of checkpoints acquired by the throughput reference means, a message count balancer that calculates a message count such that a uniform number of messages pass between the plurality of checkpoints;
Thread number adjusting means for calculating a minimum number of threads that can process the number of messages calculated by the number of message passing through the balancer for each of the plurality of checkpoints;
A parameter setting unit that applies the setting of the number of threads calculated for each of the plurality of checkpoints by the thread number adjusting unit to each of the plurality of checkpoints;
The storage device communication means stores the number of threads calculated for each of the plurality of checkpoints by the thread number adjustment means in association with system requirements in the tuning parameter storage device. The message exchange system according to claim 2. The system requirements are the worst value of the response time, average response time, maximum data size, or any one of claims 1 to 3, characterized in that it comprises at least one of the average value of the data size The message exchange system described in 1. A method for managing tuning parameters in a message exchange system including a service bus, a tuning parameter storage device, and a parameter calculation / setting device connected to the service bus and the tuning parameter storage device,
The parameter calculation / setting device is
Determining tuning parameters to meet system requirements defined by a user based on information obtained from the service bus;
Applying the determined tuning parameter settings to the service bus;
Storing the determined tuning parameters in the tuning parameter storage device in association with system requirements defined by the user ;
A step of the system requirements from the tuning parameters storage device to read out the tuning parameters of the same requirements or similar requirements in key, use the tuning parameters read as initial parameters in the tuning of the other computer,
A method comprising: