JP2010033292A - Virtual server resource adjusting system, resource adjusting device, virtual server resource adjusting method, and computer program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To dynamically conduct the scaling-up or scaling-out of a virtual server on the basis of an operational policy and a load condition. <P>SOLUTION: A resource adjusting device collects the load conditions of respective virtual servers from physical servers 3-1 to 3-n. When detecting that a virtual server A is in a high load condition, the device computes a total resource quantity, which is reducible from a virtual server which does not belong to a virtual server group α which provides the same application as the virtual server A, on the basis of the present load condition. Further, the resource adjusting device determines the allocatable quantities of resources to be added to the virtual servers A, B and H which all belong to the virtual server group α, so that the total quantity of the additional resources may become the reducible total resource quantity, on the basis of whether the resource allocation of the virtual server group α is made either by scaling-up or by scaling-out and which virtual servers the resources are intensively given in case of the scaling-up. Then, the device makes instructs the rearrangement of the virtual servers and the reduction and addition of the resources. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to a virtual server resource adjustment system, a virtual server resource adjustment device, a virtual server resource adjustment method, and a computer program that dynamically add and delete resources to and from a virtual server in a system using a virtual server.

In recent years, virtual servers that can use one physical server as a plurality of virtual servers have become widespread. Since virtual servers dynamically allocate resources according to load conditions, resource efficiency is possible. For example, it is possible to provide application services such as data centers using such virtual server technology. It has been.
When considering the optimal operation of multiple virtual servers operating in a data center or the like with various loads, resources are concentrated on as few virtual servers as possible to reduce the number of servers that execute processing. Possible methods include scale-up to scale up and scale-out to increase the number of processing servers that implement virtual servers and distribute processing. Patent Documents 1 and 2 describe a technique for scaling up or scaling out a server according to system load or system usage.
JP 2006-343899 A JP 2007-213286 A

In a system that uses virtual servers, if you want to operate with an emphasis on power efficiency of the servers, in order to reduce the number of servers in operation, resources are concentrated on as few virtual servers as possible by scaling up. It becomes necessary to do. In addition, when performing server operation with higher availability than power supply efficiency, it is necessary to increase the number of servers operating as virtual servers and distribute the processing by scaling out. However, for example, the overall power efficiency of the server is emphasized and operation is performed to reduce the number of servers in operation. However, for a specific application, multiple physical servers are used to ensure reliability. There is a demand for flexible scale-up and scale-out, such as performing distributed processing.
However, the techniques described in Patent Documents 1 and 2 described above only perform either scale-up or scale-out, and optimal resource allocation cannot be performed in consideration of the server operation policy.

  The present invention has been made in consideration of such circumstances, and its purpose is a virtual server resource that can dynamically scale up or scale out a virtual server based on the server operation policy and load status. An adjustment system, a virtual server resource adjustment device, a virtual server resource adjustment method, and a computer program are provided.

  In order to solve the above-mentioned problem, the present invention provides a virtual server resource adjustment system comprising a server device that operates as a virtual server and a resource adjustment device that adjusts the amount of resources allocated to the virtual server, the resource adjustment The apparatus includes: information associating a virtual server group with a virtual server belonging to the virtual server group; and a resource allocation method applied to the virtual server group to allocate resources to the virtual servers belonging to the virtual server group. It is the role of each virtual server allocating resources intensively, with information indicating whether it is a scale-out allocated in a distributed manner, or a scale-up that allocates resources intensively to some virtual servers belonging to the virtual server group Information indicating whether the role is to allocate resources in a distributed manner, information on the amount of resources used by each virtual server, A storage unit that stores information indicating a determination criterion of a load state and load state notification information indicating a load state of the virtual server, and a load state that receives the load state notification information from the server device and writes the load state notification information to the storage unit The virtual server compares the load state of the virtual server indicated by the load status notification information read from the storage unit with the collection unit and the determination criterion of the high load state read from the storage unit. A load determination unit that determines whether or not the load is high, and a high load virtual that is a virtual server group to which the virtual server that is determined to be high by the load determination unit belongs with reference to the storage unit The server group is specified, the load state and the amount of used resources of the virtual server belonging to a virtual server group different from the specified high load virtual server group are read, and the read load state is supported. A free resource calculation unit that calculates a total resource amount that can be reduced from the difference between the resource amount for use and the read use resource amount, and a resource allocation method for the high-load virtual server group that is stored in the storage unit; , Belonging to the high-load virtual server group such that the total additional resource amount is the total resource amount calculated by the free resource calculation unit based on the role of the virtual server belonging to the high-load virtual server group An additional resource calculation unit that determines allocation of the additional resource amount to the virtual server to be performed, and an instruction that instructs the server device to add the resource of the resource amount allocated to the virtual server according to the determination of the additional resource calculation unit And the server device sends load status notification information indicating a load status of a virtual server operating on the server device to the resource A load status output unit that transmits to the coordinating device; and a management unit that receives an instruction from the resource coordinating device and adds a resource of an additional resource amount allocated to the virtual server belonging to the high-load virtual server group. This is a virtual server resource adjustment system characterized by that.

  The present invention is the above-described virtual server resource adjustment system, wherein the free resource calculation unit is a resource allocation method for a virtual server group different from the high-load virtual server group stored in the storage unit And the allocation of the reduced resource amount of the virtual server belonging to the virtual server group so that the total reduced resource amount becomes the total resource amount based on the role of the virtual server belonging to the virtual server group. And the instructing unit instructs the server device to reduce the allocated amount of resources to be reduced from the virtual server according to the determination by the free resource calculating unit. And reducing the allocated amount of resources from the virtual server that is the target of resource reduction. That.

  The present invention is the above-described virtual server resource adjustment system, wherein the storage unit stores information on a resource amount included in the server device, and the resource adjustment device includes the high-load virtual server group. For each of the virtual servers belonging to different virtual server groups, the resource usage after resource reduction obtained by subtracting the resource reduction amount allocated to the virtual server from the resource usage amount of the virtual server read from the storage unit The amount of used resources of the virtual server before adding the resource read from the storage unit for each virtual server belonging to the high-load virtual server group, the amount of additional resources allocated to the virtual server, and the storage unit On the basis of the resource amount of the server device read from A relocation calculation unit for determining a server, wherein the instruction unit instructs the server device to change the arrangement of virtual servers according to the determination by the relocation calculation unit, and the management unit receives from the resource adjustment device In response to the instruction, the placement of the virtual server is changed.

  Further, the present invention is the above-described virtual server resource adjustment system, wherein the determination criterion of the high load state is a high load threshold value indicating a resource usage amount of the virtual server, and the load status notification information includes Information indicating actual resource usage in the virtual server is included, and the load determination unit includes the resource usage of the virtual server indicated by the load status notification information and the virtual server read from the storage unit. The free resource calculation unit compares the high load threshold with the high load threshold and determines whether or not the virtual server has a high load. The additional resource calculation unit updates the high load threshold value of the target virtual server to which the resource is added by adding the resource amount to the additional resource. Updated by adding the value of the scan volume, and wherein the.

  The present invention is the above-described virtual server resource adjustment system, wherein the storage unit further stores information indicating a determination criterion for a low load state, and the load determination unit is indicated by the load status notification information. Comparing the load state of the virtual server with the determination criterion of the low load state read from the storage unit to determine whether or not the virtual server has a low load, the free resource calculation unit, Referring to the storage unit, a low load virtual server group that is a virtual server group to which a virtual server determined to be low load by the load determination unit belongs is specified, and a virtual belonging to the specified low load virtual server group Read server load status and amount of used resources, and calculate the total amount of resources that can be reduced from the difference between the amount of used resources corresponding to the read load status and the amount of used resources read Further, based on the resource allocation method of the low-load virtual server group and the role of the virtual server belonging to the low-load virtual server group, the total reduced resource amount becomes the total resource amount. The allocation of the reduced resource amount of the virtual server belonging to the low load virtual server group is determined, and the instruction unit reduces the allocation allocated from the virtual server belonging to the low load virtual server group according to the determination by the free resource calculation unit The server unit is instructed to reduce the resource amount of resources, and the management unit receives an instruction from the resource adjustment unit and allocates from the virtual server belonging to the low-load virtual server group for which resource reduction is determined It is characterized by reducing resources of a reduced amount of resources.

  Further, the present invention is the virtual server resource adjustment system described above, wherein the storage unit stores information on a resource amount included in the server device, and each of the virtual servers belonging to the low-load virtual server group The amount of used resources after resource reduction obtained by subtracting the reduced resource allocated to the virtual server from the amount of used resources of the virtual server read from the storage unit, and the low-load virtual server read from the storage unit A relocation calculation unit that determines a virtual server to be allocated to each of the server devices based on a used resource amount of the virtual server belonging to a virtual server group different from the group and a resource amount of the server device The instruction unit may change the placement of the virtual server to the server device according to the determination by the rearrangement calculation unit. It is shown, wherein the management unit receives an instruction from the resource adjustment apparatus, to change the arrangement of the virtual server, and wherein the.

  Further, the present invention is the virtual server resource adjustment system described above, wherein the determination criterion for the high load state is a high load threshold value indicating the amount of used resources of the virtual server, and the determination criterion for the low load state is: It is a low load threshold value indicating a resource usage amount at the time of an assumed low load of the virtual server, and the load status notification information includes information indicating an actual resource usage amount in the virtual server, and the load The determination unit compares the resource usage of the virtual server indicated by the load status notification information with the low load threshold value of the virtual server read from the storage unit, and determines whether or not the virtual server has a low load. A value obtained by subtracting the reduced resource amount of the virtual server from the high load threshold value of the virtual server belonging to the low load virtual server group. With more updates, the low load threshold value of the virtual server is updated to a value corresponding to the updated the high load threshold, characterized in that.

  Further, the present invention is the virtual server resource adjustment system described above, wherein the storage unit stores load resource characteristic data indicating a relationship between an access load and a resource usage, and the load status notification information includes , Information indicating an access load in the virtual server is included, and the free resource calculation unit reads the load status notification information of the virtual server from the storage unit for each virtual server to be resource-reduced, and performs a predetermined calculation. Calculate an assumed high access load from the access load indicated by the read load status notification information, and further calculate the assumed high access load using the load resource characteristic data read from the storage unit. The corresponding virtual server that acquires the corresponding resource amount and reads the acquired resource amount from the storage unit It calculates the amount of free resources by subtracting from the high load threshold value, the calculated total vacant resource amount by summing the vacant resource amount calculated for the virtual servers, respectively, characterized in that.

  Further, the present invention is the virtual server resource adjustment system described above, wherein the free resource calculation unit is configured such that when the resource allocation method of the virtual server group to which the virtual server subject to resource reduction belongs is a scale-out, the virtual server Decide the allocation of the reduced resource amount of the virtual server so that the used resource amount of all virtual servers belonging to the group is equal, and scale up the resource allocation method of the virtual server group to which the virtual server that is the resource reduction target belongs In this case, the reduction resource amount allocation is determined so that the resource reduction ratio of the virtual server in the role of allocating resources in a distributed manner among the virtual servers belonging to the virtual server group is increased.

  Further, the present invention is the virtual server resource adjustment system described above, wherein the additional resource calculation unit belongs to the high load virtual server group when the resource allocation method of the high load virtual server group is scale-out. If the allocation of the additional resource amount of the virtual server is determined so that the used resource amount of all the virtual servers to be equalized, and the resource allocation method of the high-load virtual server group is scale-up, the high-load virtual server Of the virtual servers belonging to the server group, the distribution of the additional resource amount is determined so that the used resource ratio of the virtual server having the role of allocating resources centrally after the resource addition is increased.

  The present invention is the above-described virtual server resource adjustment system, which receives information on a virtual server group to be accessed from a user terminal and belongs to the virtual server group according to a load state of the virtual server. An access distribution device that determines which of the virtual servers should be accessed and notifies the user terminal of the virtual server is further provided.

  Further, the present invention is the virtual server resource adjustment system described above, wherein the resource is any one or more of a CPU, a memory, a disk I / O, and a network I / O.

  Further, the present invention is the resource adjustment device in a virtual server resource adjustment system comprising a server device that operates as a virtual server and a resource adjustment device that adjusts the amount of resources allocated to the virtual server, the virtual server group comprising: Scale-out in which information in which virtual servers belonging to the virtual server group are associated with each other and a resource allocation method applied to the virtual server group allocate resources to the virtual servers belonging to the virtual server group in a distributed manner; Alternatively, information indicating whether the scale-up is to allocate resources intensively to some of the virtual servers belonging to the virtual server group, and whether each virtual server has a role of allocating resources intensively. Information indicating whether the role is assigned, information on the amount of resources used by each virtual server, and criteria for determining the high load state A storage unit that stores information indicating load status notification information indicating a load status of the virtual server, a load status collection unit that receives the load status notification information from the server device and writes the load status notification information to the storage unit, and Whether the virtual server has a high load by comparing the load state of the virtual server indicated by the load status notification information read from the storage unit and the determination criterion of the high load state read from the storage unit A load determination unit that determines whether or not, and a high load virtual server group that is a virtual server group to which the virtual server determined to be a high load by the load determination unit belongs with reference to the storage unit The load state and the amount of used resources of a virtual server belonging to a virtual server group different from the specified high load virtual server group are read, and the used resource amount corresponding to the read load state A free resource calculation unit that calculates a total resource amount that can be reduced from a difference from the read used resource amount, a resource allocation method of the high load virtual server group that is stored in the storage unit, and the high load virtual server Based on the role of the virtual server belonging to the server group, the virtual server belonging to the high-load virtual server group is assigned to the virtual server group belonging to the high-load virtual server group so that the total additional resource amount is the total resource amount calculated by the free resource calculation unit. An additional resource calculation unit that determines allocation of the additional resource amount, and an instruction unit that instructs the server device to add resources of the resource amount allocated to the virtual server according to the determination of the additional resource calculation unit. This is a resource adjustment device.

  In addition, the present invention is the resource adjustment device described above, wherein the storage unit further stores information indicating a determination criterion for a low load state, and the load determination unit is configured to store the virtual information indicated by the load status notification information. The server load state is compared with the determination criterion of the low load state read from the storage unit to determine whether or not the virtual server has a low load, and the free resource calculation unit includes the storage unit The low load virtual server group, which is the virtual server group to which the virtual server determined to be low load by the load determination unit, is identified, and the load of the virtual server belonging to the identified low load virtual server group The total resource amount that can be reduced is calculated from the difference between the used resource amount corresponding to the read load state and the read used resource amount. Based on the resource allocation method of the load virtual server group and the role of the virtual server belonging to the low load virtual server group, the low load virtual server group so that the total reduced resource amount becomes the total resource amount And determining the allocation of the reduced resource amount of the virtual server that belongs to the virtual server belonging to the low-load virtual server group according to the determination by the free resource calculating unit. The server apparatus is instructed to reduce it.

  The present invention is also a virtual server adjustment method used in a virtual server resource adjustment system including a server device that operates as a virtual server and a resource adjustment device that adjusts the amount of resources allocated to the virtual server, The coordinating apparatus is configured such that information associating a virtual server group with a virtual server belonging to the virtual server group, and a resource allocation method applied to the virtual server group to a virtual server belonging to the virtual server group. Information indicating whether it is a scale-out for allocating resources in a distributed manner or a scale-up for allocating resources intensively to some of the virtual servers belonging to the virtual server group, and a role for each virtual server to allocate resources intensively Information indicating whether it is a role to allocate resources in a distributed manner, and the amount of resources used by each virtual server Information, information indicating a judgment criterion for a high load state, and load status notification information indicating the load status of the virtual server, and the load status output unit of the server device includes the server A load status output process for transmitting load status notification information indicating a load status of a virtual server operating in the device to the resource adjustment device; and in the resource adjustment device, a load status collection unit receives the load from the server device. A load status collection process for receiving status notification information and writing it to the storage unit; a load determination unit; a load status of the virtual server indicated by the load status notification information read from the storage unit; Comparing the read judgment criterion of the high load state to determine whether the virtual server has a high load, the free resource calculation unit, Referring to a storage unit, a high-load virtual server group that is a virtual server group to which the virtual server determined to have a high load in the load determination process belongs is specified, and is different from the specified high-load virtual server group Reads the load status and used resource amount of the virtual servers belonging to the virtual server group, and calculates the total resource amount that can be reduced from the difference between the used resource amount corresponding to the read load state and the read used resource amount Based on the resource calculation process, the resource allocation method of the high load virtual server group stored in the storage unit, and the role of the virtual server belonging to the high load virtual server group. The virtual server belonging to the high-load virtual server group so that the total additional resource amount becomes the total resource amount calculated in the free resource calculation process. An additional resource calculation process for determining allocation of the additional resource amount to the server, and the instruction unit adds the resource of the resource amount allocated to the virtual server according to the determination in the additional resource calculation process to the server device An instruction process for instructing, and a resource addition in which the management unit of the server apparatus receives an instruction from the resource adjustment apparatus and adds a resource of an additional resource amount allocated to the virtual server belonging to the high-load virtual server group A virtual server resource adjusting method characterized by comprising:

  Further, the present invention is the virtual server resource adjustment method described above, wherein the storage unit of the resource adjustment device further stores information indicating a criterion for determining a low load state, and the resource adjustment device includes: Whether the load determination unit compares the load state of the virtual server indicated by the load state notification information with the determination criterion of the low load state read from the storage unit, and whether the virtual server has a low load A low load determination process for determining whether or not, and the free resource calculation unit refers to the storage unit, a virtual server group to which a virtual server determined to be low load in the low load determination process belongs Identify the low-load virtual server group, read the load status and amount of used resources of the virtual servers belonging to the specified low-load virtual server group, and use the load corresponding to the read load status. The total amount of resources that can be reduced is calculated from the difference between the resource amount and the read used resource amount. Further, the resource allocation method for the low-load virtual server group and the virtual server belonging to the low-load virtual server group are calculated. A low-load virtual server free resource calculation process for determining allocation of the reduced resource amount of the virtual server belonging to the low-load virtual server group based on the role so that the total reduced resource amount becomes the total resource amount; The instruction unit instructs the server device to reduce the resource of the reduced resource amount allocated from the virtual server belonging to the low-load virtual server group according to the determination in the low-load virtual server free resource calculation process. A reduction instruction process, and the management unit of the server apparatus receives an instruction from the resource adjustment apparatus, From the virtual servers belonging to the low-load virtual servers which reduced is determined, and a resource reduction step to reduce the reduce the resource amount of resources allocated, further comprising a to.

  Further, the present invention provides a computer used as the resource adjustment device in a virtual server resource adjustment system comprising a server device that operates as a virtual server and a resource adjustment device that adjusts the amount of resources allocated to the virtual server. Information relating to the load status notification information received from a device and associating a virtual server group with a virtual server belonging to the virtual server group, and a resource allocation method applied to the virtual server group include the virtual server group Information indicating whether the scale-out is to allocate resources to the virtual servers belonging to the server in a distributed manner, or the scale-up is to allocate resources centrally to some of the virtual servers belonging to the virtual server group. Indicates whether the role is to allocate resources or to allocate resources in a distributed manner A load status collecting step for writing to a storage unit for storing information, information on the amount of used resources of each virtual server, information indicating a judgment criterion for a high load status, and load status notification information indicating a load status of the virtual server; The load state of the virtual server indicated by the load status notification information read from the storage unit is compared with the judgment criterion of the high load state read from the storage unit, and the virtual server has a high load. A load determination step for determining whether or not, and referring to the storage unit, a high load virtual server group that is a virtual server group to which the virtual server determined to be a high load in the load determination step belongs Then, the load status and the amount of used resources of the virtual server belonging to the virtual server group different from the specified high load virtual server group are read, and the read load status is set. A free resource calculation step for calculating a total resource amount that can be reduced from the difference between the corresponding used resource amount and the read used resource amount, and resource allocation of the high load virtual server group stored in the storage unit Based on the method and the role of the virtual server belonging to the high load virtual server group, the high load virtual server group so that the total additional resource amount becomes the total resource amount calculated in the free resource calculation step An additional resource calculation step for determining the allocation of the additional resource amount to the virtual server belonging to the server, and instructing the server device to add the resource amount allocated to the virtual server according to the determination in the additional resource calculation step An instruction step is executed.

Further, the present invention is a computer program as described above, wherein the computer
Compare the load status of the virtual server indicated by the load status notification information with the low load status determination criteria read from the storage unit, and determine whether the virtual server has a low load. Referring to the load determination step and the storage unit, the low load virtual server group that is the virtual server group to which the virtual server determined to be low load in the low load determination step belongs is specified, and the specified low load Read the load status and the amount of used resources of the virtual servers belonging to the virtual server group, calculate the total resource amount that can be reduced from the difference between the used resource amount corresponding to the read load state and the read used resource amount, Further, based on the resource allocation method of the low-load virtual server group and the role of the virtual server belonging to the low-load virtual server group, the total reduced resource amount Low load virtual server free resource calculation step for determining allocation of the reduced resource amount of the virtual server belonging to the low load virtual server group so as to be the total resource amount, and determination in the low load virtual server free resource calculation step And a resource reduction instructing step for instructing the server device to reduce resources of a reduced resource amount allocated from the virtual server belonging to the low-load virtual server group.

According to the present invention, as a system operation policy, a virtual server group that shares a load in advance and its resource allocation method, and a virtual server that plays a role of allocating resources in a centralized or distributed manner within the virtual server group are defined. When a load on a certain virtual server becomes high or low, a virtual server that inputs or reduces resources and the amount of that resource are determined and allocated according to the defined operation policy. Can be changed. Further, relative scale-up and scale-out can be realized by a certain number of virtual servers without adding, deleting, starting, or stopping the virtual servers themselves.
As described above, according to the present invention, it is possible to dynamically and easily scale up or scale out a virtual server according to a load situation in accordance with a system operation policy.

Hereinafter, an embodiment of the present invention will be described in detail with reference to the drawings.
FIG. 1 is a connection diagram showing the overall configuration of a virtual server resource adjustment system according to an embodiment of the present invention. In this figure, a resource adjustment device 1, a plurality of physical servers 3-1 to 3-n that realize virtual servers, and a load distribution device 5 are connected to a maintenance network 7 that uses IP (Internet Protocol) or the like. Yes. The physical servers 3-1 to 3-n (hereinafter collectively referred to as the physical server 3) and the load distribution device 5 are connected to the user terminal 6 via the end user network 8 using IP or the like. Yes.

  FIG. 2 is a diagram for explaining the virtual server group. The virtual server group includes virtual servers that share a specific load, that is, one or a plurality of virtual servers that provide the same application (AP). In the figure, a virtual server A and a virtual server AA are arranged on the physical server 3-1, a virtual server B and a virtual server BB are arranged on the physical server 3-2, and the physical server 3- A virtual server H and a virtual server HH are arranged in n. In this way, one virtual server is arranged on any one physical server 3. Here, a virtual server A, a virtual server B, and a virtual server H that provide the same application belong to the virtual server group α, and a virtual server that provides the same application to the virtual server group β AA and virtual server BB belong, and only virtual server HH belongs to virtual server group γ. Note that the load distribution device 5 determines which virtual server belonging to the same virtual server group the access from the user terminal 6 is distributed based on the load state of each virtual server, and instructs the user terminal 6 It shall be.

FIG. 3 is a diagram for explaining the resource allocation method. The resource allocation method includes a scale-out method in which resources are distributed and a scale-up method in which resources are concentrated.
FIG. 3A shows a scale-out method. As shown in FIG. 3A, in the scale-out method, for example, the virtual server A and the virtual server B belong to the same virtual server group, and the allocated resources are increased because the load of the virtual server group increases. When it is necessary, the resource allocation amount of the entire virtual server group is increased so that the virtual server A and the virtual server B have substantially the same resource amount after the allocation amount increase.
FIG. 3B shows a scale-up method. As shown in FIG. 3B, in the scale-up method, for example, the virtual server A and the virtual server B belong to the same virtual server group, and the allocated resources are increased because the load of the virtual server group increases. When it is necessary to allocate resources to a specific virtual server, here, virtual server B, the resource allocation amount of the entire virtual server group is increased.

FIG. 4 is a diagram for explaining the role of the virtual server. Each virtual server is assigned either “virtual server role: OUT” that plays the role of scale-out or “virtual server role: UP” that plays the role of scale-up. When the scale-out method is applied to the virtual server group (FIG. 3A), the allocation amount increases for all virtual servers of the virtual server role OUT and virtual server role UP belonging to the virtual server group. Allocate additional resources so that later resource amounts are equal. When the scale-up method is applied to the virtual server group (FIG. 3B), a relatively large amount of additional resources are allocated to the virtual servers of the virtual server role UP belonging to the virtual server group.
As a result, the resources are relatively concentrated or distributed among the virtual servers belonging to the virtual server group, so there is no need to add / delete / start / stop the virtual server itself. The concept of scale-out (increasing the number of servers) and scale-up (centralized resource allocation) can be realized.

Next, an outline of the operation of the virtual server resource adjustment system will be described.
FIGS. 5-8 is a figure which shows the operation | movement outline | summary of the virtual server resource adjustment system at the time of heavy load generation | occurrence | production.
FIG. 5 is a diagram showing an outline of the operation for reducing free resources from a virtual server group to which no load is applied. In the figure, it is assumed that the resource adjustment device 1 detects that a high load has occurred in the virtual server A belonging to the virtual server group α. The resource adjustment device 1 is a resource amount that can be reduced from the currently allocated resource amount for each of the virtual servers AA, BB,..., HH other than the virtual servers A, B, H belonging to the virtual server group α. A certain free resource amount is calculated, and the calculated free resource amounts are summed to calculate a total free resource amount UR. After the resource adjustment device 1 calculates the total free resource amount UR, whether the scale-out method or the scale-up method is adopted for the virtual server group to which the virtual server belongs to the resource amount to be reduced from each virtual server This is determined based on the resource method and the role of each virtual server.

  FIG. 6 is a diagram illustrating an outline of an operation for determining a resource addition target virtual server in a virtual server group in which a high load occurs. In the figure, the resource adjustment device 1 calculates a resource amount NR that needs to be added from the load of the virtual server A in which a high load has occurred, and compares it with the total free resource amount UR. If the total free resource amount UR is larger, the resource adjustment device 1 determines that the resource can be added, and determines the resource allocation method of the virtual server group α and the virtual servers A, B, and H belonging to the virtual server group α. The virtual server to which a resource is to be added and the resource amount ARm (m indicates which virtual server is to be added) to each virtual server are determined based on the role of At this time, the resource adjustment device 1 distributes so that (total of additional resource amount ARm of each virtual server) = (total free resource amount UR). Here, since the resource allocation method of the virtual server group α is the scale-up method, it is determined that the resource is added with priority over the virtual server B of “virtual server role: UP”.

  Note that the virtual server from which a high load is detected and the virtual server from which resource addition has been determined do not necessarily have to be the same. This is because the load distribution device 5 that determines which virtual server in the virtual server group is to be accessed according to the load status of each virtual server distributes many accesses to the virtual server to which the resource has been added. This is for adjusting to reduce the access load to the detected virtual server. That is, here, by increasing the resource allocation of the virtual server B and performing load distribution again accordingly, the access load of the virtual server A is transferred to the virtual server B.

  FIG. 7 is a diagram for explaining a combination problem of rearrangement of virtual servers. The resource adjustment device 1 determines the relocation to all the physical servers 3 so that the free resource on the physical server 3 where the virtual server to which the resource is to be added is arranged becomes the additional resource amount ARm of the virtual server. In the figure, the free resources on the physical server 3 where the virtual server B to which the resource is added are placed are rearranged so that ARm (m = virtual server B). This rearrangement becomes a combined arrangement problem of the used resource amount for all the virtual servers and the additional resource amount ARm for adding resources with respect to the resource amounts of all the physical servers 3.

  FIG. 8 is a diagram showing an operation outline of virtual server relocation. After calculating the relocation position of the virtual server, the resource adjustment device 1 reduces free resources from the virtual servers belonging to the virtual server group other than the virtual server group α between the physical servers 3-1 to 3-n, Move and arrange virtual servers while they are running. Then, after the relocation is performed, a free resource of the additional resource amount ARm is added to the virtual server of the virtual server group α. Here, the virtual server BB arranged in the physical server 3-2 is moved to the physical server 3-1, and the additional resource amount ARm (m = virtual) is transferred to the virtual server B arranged in the physical server 3-2. Server B) resources are added.

  FIG. 9 is a diagram showing an operation outline of the virtual server resource adjustment system when a low load is detected. When the resource adjustment device 1 detects a low load state of the virtual server, the resource adjustment device 1 uses a low load to optimize the virtual server arrangement status of the physical server 3 and resources according to the resource distribution method for each virtual server group. The free resources of the entire virtual server group in which this is detected are calculated, and the reallocation for all the virtual servers and the resource adjustment according to the resource distribution method for each virtual server group are performed.

  For example, when the resource adjustment device 1 detects a low load on the virtual server A belonging to the virtual server group α, the resource amount can be reduced for each of the virtual servers A, B, and H belonging to the virtual server group α. A free resource amount is calculated, and the calculated free resource amounts are totaled to calculate a total free resource amount. The resource coordinating apparatus 1 has a resource allocation method as to which of the scale-out method and the scale-up method is adopted for the virtual server group α, and the roles of the virtual servers A, B, and H belonging to the virtual server group α. Based on the above, the virtual server whose resources are to be reduced and the resource amount to be reduced in the virtual server are determined so that the total becomes the total free resource amount, and the resources are reduced. The resource adjustment device 1 determines relocation on all physical servers 3 for all virtual servers, and moves and arranges virtual servers between physical servers 3-1 to 3-n. Here, the virtual server H arranged in the physical server 3-n is arranged in the physical server 3-1, the virtual server HH is arranged in the physical server 3-2, and the virtual server is arranged in the physical server 3-n. The power is turned off.

Subsequently, devices constituting the virtual server resource adjustment system will be described.
FIG. 10 is a block diagram showing a configuration showing the configuration of the physical server 3. Only functional blocks related to the present invention are extracted and shown. In the figure, a physical server 3 is a hardware main body of a server device and operates as a virtual server computer. A virtual server computer realized in the physical server 3 is a virtual server 35. The management unit 31 that manages the entire physical server 3 allocates various resources such as a CPU and a memory used by the virtual server 35.

  The management unit 31 includes a load status output unit 32, a notification unit 33, and a resource state monitoring unit 34. The resource state monitoring unit 34 periodically collects load states for various resources of each virtual server 35. The load status output unit 32 periodically loads the resource status of each virtual server 35 collected by the resource status monitoring unit 34 and the load status notification information indicating the access load information in the virtual server 35 to the resource adjustment device 1. Notify The notification unit 33 notifies the load distribution device 5 of the load state of the virtual server 35. The virtual server 35 operates using various resources allocated by the management unit 31, but can access only the processes executed by itself, and cannot access processes of other virtual servers 35.

  Note that a CPU (Central Processing Unit), a memory, a disk I / O, a network I / O, and the like are used as various resources. In addition, throughput (number of processes per unit time) that serves as an index representing the overall consumption of resources is used as a kind of resource. In addition, in order to handle the increase / decrease amount of the resource between different physical servers 3 as a standard, the unit of the resource usage of various resources is standardized. Specifically, the CPU is in units of Hz (hertz) using the total frequency considering the number of cores and CPUs, the memory is in bytes (bytes) as the memory size, and the disk I / O is bps (bits per second) or Assume that network I / O is handled in units of bps or pps (Packet Per Second) in units of IOPS (Input Output per Second).

  FIG. 11 is a block diagram showing the configuration of the resource adjustment apparatus 1, and only functional blocks related to the present invention are extracted and shown. In the figure, the resource adjustment device 1 includes a load status collection unit 11, a load determination unit 12, a free resource calculation unit 13, an additional resource calculation unit 14, a rearrangement calculation unit 15, a movement execution unit 16, and a storage unit 20. Prepare. The storage unit 20 includes a load status table storage unit 21, a load characteristic table storage unit 22, a threshold table storage unit 23, a free resource table storage unit 24, an additional resource table storage unit 25, a virtual server group table storage unit 26, and a movement table storage. Unit 27, physical server table storage unit 28, and virtual server table storage unit 29. The resource adjustment device 1 can be realized by a computer device such as one or a plurality of servers.

  The load status table storage unit 21 stores a load status table that is data for recording the load status of each virtual server 35. The load characteristic table storage unit 22 stores, for each application, load resource characteristic data indicating a correlation between the load and the resource amount of various resources consumed. The threshold table storage unit 23 stores a threshold table that is data for recording a high load threshold and a low load threshold for each resource of each virtual server 35. The free resource table storage unit 24 stores a free resource table that is data for recording free resource amounts of various resources of each virtual server 35. The additional resource table storage unit 25 stores an additional resource table that is data for recording resource amounts of various resources to be added to the virtual server 35. The virtual server group table storage unit 26 stores a virtual server group table that is data indicating the resource allocation method of the virtual server group, the virtual server 35 to which the virtual server group belongs, the role of the virtual server 35, and the like. The movement table storage unit 27 stores a movement table that is data for recording the virtual server 35 to be arranged in the physical server 3 different from the current one. The physical server table storage unit 28 stores a physical server table that is data indicating the maximum amount of various resources implemented by each physical server 3. The virtual server table storage unit 29 stores a physical server 3 in which each virtual server 35 is arranged, and a virtual server table that is data for recording resources used by the virtual server 35.

  The load status collection unit 11 updates the load status table with the load status notification information received from the physical server 3. The load determination unit 12 refers to the load status table and the threshold table to determine whether any of the virtual servers 35 is in a high load state or a low load state. The free resource calculation unit 13 loads the virtual server 35 belonging to a virtual server group other than the virtual server group to which the virtual server 35 in which the high load state is detected, or the virtual server 35 in which the low load state is detected. The total free resource amount is calculated by referring to the resource characteristic data, and further, the virtual server group table is referred to determine how to allocate the total free resource amount to the virtual server 35, and the result indicates the free space Update the resource table and the high and low load thresholds in the threshold table. The additional resource calculation unit 14 refers to the virtual server group table, determines the virtual server 35 to which the resource is added in the virtual server group to which the virtual server 35 in which the high load is detected, and the amount of the resource to be added. Update the resource table. The relocation calculation unit 15 refers to the threshold value table, the additional resource table, the physical server table, and the virtual server table, performs a relocation calculation as to which physical server 3 is to execute the virtual server, and reconfigures based on the calculation result. Update the allocation table. The migration execution unit 16 refers to the migration table updated by the relocation calculation unit 15 and issues a command for moving the placement of the virtual server 35 to the physical server 3. Further, the rearrangement calculation unit 15 issues a command for instructing the physical server 3 to reduce or add resources used by the virtual server 35.

  FIG. 12 shows a data configuration example of the load situation table stored in the load situation table storage unit 21. The load status table includes a record including information such as a virtual server ID that uniquely identifies the virtual server 35, an access load in the virtual server 35, and usage statuses of various resources of the virtual server 35. The usage status of various resources includes, for example, resource IDs of various resources (CPU, memory disk I / O, network I / O, throughput, etc.) and resource usage information.

  FIG. 13 shows a data configuration example of the load characteristic table stored in the load characteristic table storage unit 22. The load characteristic table is created in advance and is stored in the load characteristic table storage unit 22. The load characteristic table includes a record including information such as an application ID that uniquely identifies an application, a resource ID that identifies a resource type, load resource characteristic data of the resource, and a maximum access load amount of the resource.

  FIG. 14 shows a data configuration example of the threshold value table stored in the threshold value table storage unit 23. The threshold table is composed of records including information on virtual server IDs, resource IDs, high load thresholds, and low load thresholds.

  FIG. 15 shows a data configuration example of the free resource table stored in the free resource table storage unit 24. The free resource table is composed of records including information such as a virtual server ID that identifies the virtual server 35, a resource ID, and a free resource amount.

  FIG. 16 shows a data configuration example of the additional resource table stored in the additional resource table storage unit 25. The additional resource table indicates the additional virtual server ID that is the ID of the virtual server 35 to which the resource is to be added, the resource ID that identifies the resource to be used for adding the used resource amount, and the resource amount to be added to the resource of the virtual server 35 It consists of records consisting of information such as the additional resource amount ARm.

  FIG. 17 shows a data configuration example of the virtual server group table stored in the virtual server group table storage unit 26. The virtual server group table includes a virtual server group ID for identifying the virtual server group, a belonging virtual server ID list indicating the ID of the virtual server 35 belonging to the virtual server group, and whether the policy of the virtual server group is a scale-up method or a scale-out Resource allocation method ID for specifying the method, maximum access load of the virtual server group, virtual server role indicating whether the role of each virtual server 35 specified in the belonging virtual server ID list is UP / OUT, etc. Consists of records consisting of information. Here, the virtual server group ID is the same as the application ID, but a different one may be used. In this case, it is assumed that the application ID and the virtual server group ID are associated with each other.

  FIG. 18 stores a data example of the movement table stored in the movement table storage unit 27. The migration table includes a migration source physical server ID indicating the ID of the physical server 3 on which the virtual server 35 is currently operating, and a migration destination physical server ID indicating the ID of the physical server 3 that is the migration destination of the virtual server 35 by rearrangement. , And a record made up of information such as a virtual server ID that identifies the virtual server 35 to be moved.

  FIG. 19 shows a data configuration example of the physical server table stored in the physical server table storage unit 28. The physical server table is composed of records including information such as a physical server ID that identifies the physical server 3, physical server resource data that indicates the amount of each resource mounted in the physical server 3, and the like.

  FIG. 20 shows a data configuration example of the virtual server table stored in the virtual server table storage unit 29. The virtual server table includes a virtual server ID, an arrangement physical server ID indicating the physical server 3 in which the virtual server 35 is arranged, a resource ID list indicating an ID of a resource used by the virtual server 35 in the physical server 3, It is composed of records consisting of such information.

Next, preparations for the virtual server resource adjustment system will be described.
The operator of the virtual server resource adjustment system defines a virtual server group that realizes each application and a virtual server 35 that belongs to the virtual server group. Then, a resource allocation method is defined for each virtual server group, and a virtual server role UP / OUT is defined for each virtual server 35 belonging to the virtual server group. The operator creates a virtual server group table based on these definitions and registers it in the virtual server group table storage unit 26. By rewriting this virtual server group table, it becomes possible to dynamically change the policy of adopting the scale-up method or the scale-out method for the virtual server group and the role of the virtual server 35.

  Further, for each application running on the virtual server 35, the operator can load resource characteristic data indicating fluctuations in the usage amount of various resources (CPU, memory, disk I / O, network I / O) with respect to the access load. To get. It is assumed that this load resource characteristic data is measured in advance at the development-verification stage or the like. The operator creates a load characteristic table based on the acquired information and registers it in the load characteristic table storage unit 22.

  Further, the operator sets a high load threshold and a low load threshold for various resources of the virtual server 35 in order to determine the high load state and the low load state of the virtual server 35. Increase / decrease in usage of various resources changes in conjunction with the access load (for example, if the CPU exceeds the threshold, it can be presumed that the memory will also exceed the threshold at the same time). It is only necessary to monitor the threshold and the low load threshold. However, the threshold value of each of the various resources to be set at this time needs to be set to a value that exceeds the threshold value almost simultaneously by determining the resource consumption per unit load based on the load resource characteristic data. Note that the value indicated by the high load threshold is considered to be a resource value enclosed in advance because it is likely to be used in the virtual server 35, and “high load threshold of virtual server” = “the amount of resources used by the virtual server”. And The operator creates a threshold table based on the set high load threshold and low load threshold for each resource of each virtual server 35 and registers it in the threshold table storage unit 23.

  Further, the operator defines the maximum resource amount that can be used for each resource for each physical server 3. Normally, the total of the maximum resource amounts of all the physical servers 3 is the total total resource amount that can be used for the virtual server 35. The operator creates a physical server table based on the resource amounts of various resources included in each physical server 3 and writes the physical server table in the physical server table storage unit 28.

Further, the operator defines the maximum access load amount as the maximum allowable access load for each virtual server group used when adjusting the resources of the virtual server 35. Usually, this maximum access load amount is the maximum access load that can be allowed in the total total resource amount of all physical servers. The operator registers the defined maximum access load amount of each virtual server group in the virtual server group table stored in the virtual server group table storage unit 26.
Further, the operator generates a virtual server table based on which physical server 3 the virtual server 35 is arranged in, and registers it in the virtual server table storage unit 29.

FIG. 21 is a diagram illustrating the relationship between the load resource characteristic data and the high load threshold and the low load threshold. As shown in the figure, the load resource characteristic data indicates the correlation between the access load and the required resource amount for each of various resources (in the figure, only the CPU, memory, and throughput are shown).
When the actual load on the virtual server 35 is between the currently assumed low access load and high access load, that is, when the resource usage is between the high load threshold and the low load threshold, virtual The resource adjustment and relocation of the server 35 are not performed, and the actual load is higher than the assumed high access load, that is, when the resource usage exceeds the high load threshold or the actual load is assumed. When the access load becomes lower than the low access load, that is, when the usage amount of the resource falls below the low load threshold, the resource adjustment and relocation of the virtual server 35 are performed.

Next, detailed processing of the virtual server resource adjustment system will be described.
FIG. 22 is a processing flow showing the operation of the resource adjustment apparatus 1. Here, it is assumed that the above-described definition is made and each table is registered in the storage unit 20.
The load status output unit 32 of the physical server 3 includes the ID of each virtual server 35 arranged in itself, the resource usage status of various resources of the virtual server 35 collected by the resource status monitoring unit 34, and the virtual server. The load status notification information obtained by setting the access log of the virtual server 35 acquired from 35 is periodically notified. The load status collection unit 11 of the resource adjustment device 1 writes the load status table in the load status table storage unit 21 based on the load status notification information notified from the physical server 3. At this time, the access load is calculated and written from the access log, but the access load itself may be received from the physical server 3. Further, as the usage status of various resources of the load status notification information, information that can calculate the resource usage amount, for example, the resource usage rate may be set without setting the resource usage amount itself.

[Step S105: Detection of High Load State]
The load determination unit 12 of the resource adjustment apparatus 1 determines whether a high load state has occurred in the virtual server group every predetermined time or whenever the load status table is updated.
The load determination unit 12 sequentially selects all the virtual servers 35 from the load status table stored in the load status table storage unit 21 or the virtual server ID and the virtual server 35 for which the load status table has been updated. Information on various resource usages of the virtual server ID is read out, and further, information on the combination of the resource ID corresponding to the virtual server ID and the high load threshold is obtained from the threshold table stored in the threshold table storage unit 23. read out. Then, the resource usage and the high load threshold for the same virtual server ID are compared for each resource, and it is determined whether the current resource usage exceeds the high load threshold for any of the resources of the virtual server 35. Note that it may be determined whether the usage amount exceeds the high load threshold value only for a predetermined type of resource, or the usage amount of the predetermined amount or more of any type of resource exceeds the high load threshold value. It may be judged whether it has exceeded. When the resource usage exceeds the high load threshold, the load determination unit 12 has a high load, and it is necessary to add a resource to the virtual server group to which the virtual server 35 in which the high load is generated belongs. It is judged that.

  Hereinafter, a virtual server 35 in which a high load is detected is referred to as a “high load detection virtual server”, a virtual server group to which the high load detection virtual server belongs is referred to as a “high load virtual server group”, and a virtual server that belongs to the high load virtual server group. 35 is described as “high load group belonging virtual server”. Further, a virtual server group other than the high load virtual server group is referred to as a “normal load virtual server group”, and a virtual server 35 belonging to the normal load virtual server group is referred to as a “normal load group belonging virtual server”.

[Step S110: Calculation of Free Resources]
When the load determination unit 12 determines that a high load is occurring, all the virtual servers 35 not belonging to the high load virtual server group, that is, all the normal load group belonging virtual servers are reduced (scaled down).・ In). First, the free resource calculation unit 13 calculates the total free resource amount UR, which is the sum of the free resource amounts of all the normal load group belonging virtual servers, for each resource.

  Specifically, the free resource calculation unit 13 refers to the virtual server group table stored in the virtual server group table storage unit 26 and refers to the virtual server group ID corresponding to the virtual server ID of the high-load detection virtual server ( (Hereinafter referred to as “high load virtual server group ID”), the affiliation corresponding to a virtual server group ID other than the specified high load virtual server group ID (hereinafter referred to as “normal load virtual server group ID”) Read the virtual server ID list. When the virtual server ID of the normal load group belonging virtual server included in the read belonging virtual server ID list (hereinafter, “normal load group belonging virtual server ID”) is acquired, the normal load group belonging virtual server is obtained as follows. For each resource, the amount of free resources is calculated.

FIG. 23 is a diagram for explaining calculation of the amount of free resources.
The free resource calculation unit 13 reads out information on usage amounts and access loads of various resources corresponding to the normal load group belonging virtual server ID from the load status table stored in the load status table storage unit 21, and further includes a threshold table. When information on a combination of a resource ID and a high load threshold corresponding to the normal load group belonging virtual server ID is read from the threshold table stored in the storage unit 23, the resource usage and the high load threshold are compared for each resource. To do. If there is a difference between the resource usage amount and the high load threshold, the free resource calculation unit 13 determines that it is possible to lower the high load threshold by looking at the excess. As the high load threshold is lowered, the resource can be reduced, and the reduced resource amount becomes the “free resource amount”.

  Therefore, the free resource calculation unit 13 determines, from the load characteristic table stored in the load characteristic table storage unit 22, the resource ID of the record in which the normal load group belonging virtual server ID is set as the application ID, and the load Read a set of resource characteristic data. The free resource calculation unit 13 obtains an assumed high access load based on the current access load amount of the virtual server belonging to the normal load group indicated by the access load information. The assumed high access load can be obtained as the upper limit value of the load range calculated as in (1) or (2) below.

  (1) The load range is determined by the confidence interval of the load distribution: The free resource calculation unit 13 determines the expected load range when the sample average of the access average is m and the sample standard deviation of the access average is σ ( Load range) <(m + 2.26σ). The upper limit of this load range is assumed to be a high access load. The access average is acquired from the access load information in the load status table corresponding to the normal load group affiliation virtual server ID that is the calculation target of the current free resource amount.

  (2) Determining the load range from the maximum value of the distribution: The free resource calculation unit 13 calculates the assumed load range by (load range) <(maximum value of access load distribution) × (grace). The upper limit of this load range is assumed to be a high access load. Note that (grace) is a predetermined constant of 1 or more. The maximum value of the access load distribution is acquired from the access load information in the load status table corresponding to the normal load group belonging virtual server ID.

  The free resource calculation unit 13 acquires the resource usage of various resources corresponding to the assumed high access load based on the relationship between the load and the resource amount indicated by the load resource characteristic data, and obtains a high load for calculating the free resource amount. The threshold is used. The free resource calculation unit 13 calculates the reducible resource amount, that is, the free resource amount, by subtracting the current high load threshold from the high load threshold for calculating the free resource amount for various resources. When the free resource calculation unit 13 calculates the free resource amounts of various resources for all the normal load group belonging virtual servers, the free resource calculating unit 13 sums up the free resource amounts calculated for all the normal load group belonging virtual servers for each resource. The total free resource amount UR of the resource is calculated.

  When the total free resource amount UR of various resources is calculated, the free resource calculation unit 13 follows the resource distribution method of the normal load virtual server group and the virtual server role of each virtual server belonging to the normal load group as follows: The amount of resource reduction of various resources in the normal load group virtual server is determined.

  The free resource calculation unit 13 includes the resource allocation method corresponding to each normal load virtual server group ID, the virtual server ID of the normal load group belonging virtual server belonging to the normal load virtual server group ID, and the virtual server role thereof. Read from the virtual server group table stored in the virtual server group table storage unit 26. Further, the current used resource amount of each resource of each normal load group belonging virtual server is read from the high load threshold value of the threshold value table stored in the threshold value table storage unit 23.

  When the resource distribution method of the read normal load virtual server group is the scale-up method, the resource reduction amount of the virtual server belonging to the normal load group belonging to the normal load virtual server group is reduced, and the virtual server role OUT By increasing the resource reduction amount of the normal load group belonging virtual server, the remaining resources of the normal load group belonging virtual server of the virtual server role UP are relatively high in the normal load virtual server group, and the virtual server role OUT Reduce the remaining resources of the normal load group virtual server. For example, for the virtual servers belonging to the normal load group of the virtual server role OUT, if the resource amount can be reduced so that all of the virtual servers belong to the same level or priorities are assigned, and the resource amount can be further reduced, the virtual server role UP For normal load servers, resources are reduced by assigning priorities equally or even within the virtual server role UP.

  On the other hand, when the resource allocation method of the read normal load virtual server group is the scale-up method, the normal load group belonging virtual server regardless of whether it is the virtual server role UP or OUT belonging to the normal load virtual server group The resources are reduced so that the resource amount corresponding to the used resource amount becomes equal.

  When the free resource calculation unit 13 increases or decreases the resource reduction amount for each of the various resources of the normal load group belonging virtual server in this way, the free resource calculation unit 13 determines the free resource for each resource of all the normal load group belonging virtual servers. Then, a new high load threshold is determined for each resource of the virtual server belonging to the normal load group. The free resource calculation unit 13 subtracts the free resource amount in the normal load group belonging virtual server from the high load threshold of the current normal load group belonging virtual server for various resources, thereby obtaining a new high load threshold, that is, A new amount of used resources is calculated.

Furthermore, the free resource calculation unit 13 also lowers the low load threshold for each resource in order to avoid the new high load threshold being lower than the current low load threshold. The free resource calculation unit 13 determines the assumed low access load from the current access load amount of each normal load group belonging virtual server using the load resource characteristic data, and corresponds to the assumed assumed low access load. The resource amount of each resource is determined as a new low load threshold.
For example, an assumed high access load amount corresponding to a new high load threshold obtained from load resource characteristic data and an assumed low access load amount corresponding to a new low load threshold obtained from load resource characteristic data. A new low load threshold for each resource is determined so that the average is a sample average of the actual access load.

  As described above, the free resource calculation unit 13 determines whether or not to reduce the resources for all the virtual servers belonging to the normal load group. When the load threshold value and the low load threshold value are calculated, a record indicating information associating the normal load group belonging virtual server ID, the resource ID, and the free resource amount for the resource of the resource ID, 24 is written in the free resource table stored in 24. Furthermore, the free resource calculation unit 13 updates the threshold value table stored in the threshold value table storage unit 23 with the normal load group belonging virtual server ID, the resource ID, and the high load threshold value and low load threshold value of the resource.

[Step S115: Calculation of Required Resources]
Next, the additional resource calculation unit 14 calculates a required resource amount NR that is a resource amount that needs to be added in the high-load virtual server group for each of the various resources. It is determined whether the access load amount exceeds the maximum access load amount. This corresponds to the virtual server ID of the high load detection virtual server (hereinafter referred to as “high load detection virtual server ID”) from the load resource characteristic data of the load characteristic table stored in the load characteristic table storage unit 22. A determination is made by reading the maximum access load amount and reading and comparing the current access load amount corresponding to the high load detection virtual server ID from the load state table stored in the load state table storage unit 21.

  FIG. 24 is a diagram illustrating a method for calculating the required resource amount NR. If the current access load amount does not exceed the maximum access load amount, the additional resource calculation unit 14 reads out the load characteristic table stored in the load characteristic table storage unit 22 corresponding to the high load detection virtual server ID. The assumed high access load is obtained based on the load resource characteristic data and the access load read in correspondence with the high load detection virtual server ID from the load situation table stored in the load situation table storage unit 21. . The assumed high access load can be obtained as the upper limit value of the load range calculated in the same manner as described above and step S110. (1) When determining the load range based on the confidence interval of the load distribution, assuming that the sample average of the access average is m and the sample standard deviation of the access average is σ, the load range assumed is (load range) < Calculated by (m + 2.26σ). Alternatively, (2) when the load range is determined from the maximum value of the distribution, the assumed load range is calculated by (load range) <(maximum value of access load distribution) × (grace). (Grace) is a predetermined constant of 1 or more. The additional resource calculation unit 14 acquires the resource amount corresponding to the assumed high access load from the load resource characteristic data for various resources, and the required resource amount from the difference between the acquired resource amount and the current high load threshold value NR is calculated.

[S120: Determination of whether free resources are sufficient]
The additional resource calculation unit 14 determines whether there are enough free resources. If it is determined in step S115 that the current access load amount in the high load detected virtual server exceeds the maximum access load amount, it is determined that the calculated required resource amount NR is smaller than the free resource amount UR for any of the resources. Or the sum of the calculated required resource amount NR and the used resource amount of the high load virtual server group (= high load threshold) exceeds the maximum resource amount of all the physical servers 3 for any of the resources Determine that there are not enough free resources. The maximum resource amount of all physical servers 3 for each resource is obtained by summing the resource amounts of each physical server 3 obtained from the physical server table stored in the physical server table storage unit 28 for each resource. .

[S125: Determination of resource addition server]
The additional resource calculation unit 14 allocates all of the total free resources UR to the high load group belonging virtual server belonging to the high load virtual server group. Therefore, based on the resource allocation method of the high-load virtual server group and the virtual server role of each high-load group virtual server, the high-load group virtual server to which the resource is added is determined, and the high-load group virtual An additional resource amount ARm for each of the various resources to be added to the server is determined. That is, the additional resource amount ARm is distributed from the total free resource amount UR. Specifically, it operates as follows.

  The additional resource calculation unit 14 assigns the resource allocation method corresponding to the high load virtual server group ID, the virtual server ID of the virtual server belonging to the high load group belonging to the high load virtual server group ID, and the virtual server role to the virtual server. Read from the virtual server group table of the group table storage unit 26. Further, the current used resource amount of each resource of each normal load group belonging virtual server is read from the high load threshold value of the threshold value table stored in the threshold value table storage unit 23.

  When the resource allocation method of the read high-load virtual server group is the scale-up method, the total free resource amount UR is added only to the virtual server belonging to the high-load group belonging to the virtual server role UP. An additional resource amount ARm of various resources of the belonging virtual server is determined. At this time, the free resource amount UR may be distributed so that the resource amount after the addition of the resources of the high load group virtual server belonging to the virtual server role UP is equal, or may be distributed in a predetermined order. In addition, if the additional resource amount ARm and the used resource amount of the high load group belonging virtual server to which the resource is added, that is, the total amount of the high load threshold exceeds the resource amount of the physical server 3 having the largest resource amount, it exceeds In other words, it is assumed that free resources are allocated to the high load group belonging virtual server of the virtual server role OUT. The resource amount of each physical server 3 is acquired from the physical server table stored in the physical server table storage unit 28.

  On the other hand, if the resource allocation method of the normal load virtual server group is the scale-out method, the total free resource amount UR is distributed so that the resource usage amount of the high load group belonging virtual server belonging to the high load virtual server group becomes equal. As an addition, an additional resource amount ARm is determined for each resource of the high load group belonging virtual server. At this time, the resource amount of the physical server 3 having the smallest resource amount is the total amount of the additional resource amount ARm of the high load group belonging virtual server and the used resource (= high load threshold) of the high load group belonging virtual server. When exceeding, it does not necessarily have to be distributed so that the resource amount for each high load group belonging virtual server becomes equal.

  When the additional resource calculation unit 14 determines the amount of additional resources for each resource of each high load group belonging virtual server, the virtual server ID of the high load group belonging virtual server, the resource ID, and the high load group belonging virtual server A record indicating the additional resource amount ARm of the resource specified by the resource ID is written in the additional resource table stored in the additional resource table storage unit 25.

[S130: Relocation calculation]
The rearrangement calculation unit 15 of the resource adjustment device 1 uses the amount of free resources on the physical server 3 on which the high load group belonging virtual server to which the resource is added becomes the additional resource amount ARm of the high load group belonging virtual server. As described above, relocation on all physical servers 3 is considered for all virtual servers 35. That is, the rearrangement calculation unit 15 obtains a solution to the combined placement problem of the used resource amount (= high load threshold) for each virtual server 35 and the additional resource amount ARm with respect to the resource amounts of all the physical servers 3. The resource amounts of all the physical servers 3 are read from the physical server table stored in the physical server table storage unit 28. Further, the used resource amount of each of the virtual servers 35 is read from the high load threshold value of the threshold value table stored in the threshold value table storage unit 23. At this time, in the threshold table, the current high load threshold is set for the high load group belonging virtual server, and the high load threshold after the free resource reduction is set for the normal load group belonging virtual server. The resource amount ARm is read from the additional resource table stored in the additional resource table storage unit 25. As a method for solving the combination arrangement problem in the rearrangement, a method for calculating all combinations, a conventional greedy method, a dynamic programming method, a linear programming method, or the like can be used.

  When solving the combined placement problem in this rearrangement, it may be added to the problem constraint that the virtual servers 35 belonging to the same virtual server group are not placed on the same physical server 3. Further, when solving the combined placement problem in the rearrangement, a condition for minimizing the movement of the virtual server 35 between the physical servers 3 may be added. Moreover, when solving the combination arrangement problem in the rearrangement, it may be added to the constraint condition of the problem that the virtual server 35 belonging to the high-load virtual server group is not moved. Further, when solving the combined placement problem in the rearrangement, in order to increase the use efficiency of the physical server 3, it is possible to add the virtual servers 35 to one physical server 3 as a constraint condition of the problem.

  When the rearrangement calculation unit 15 obtains a solution of the rearrangement problem of which virtual server 35 is placed in which physical server 3, the virtual server 35 in which the physical server 3 to be placed is changed by the obtained solution. , The source physical server ID indicating the ID of the physical server 3 where the virtual server 35 is currently arranged, the destination physical server ID indicating the ID of the physical server 3 to be rearranged, and the virtual of the virtual server 35 A migration table indicating the server ID is written in the migration table storage unit 27.

[S135: Determination of whether rearrangement is possible]
In step S125, the rearrangement calculation unit 15 determines whether the combined placement problem in rearrangement has been solved. If the combination arrangement problem cannot be solved, the process returns to step S115, and again adjusts the additional resource amount ARm of each high load group belonging virtual server distributed from the total available resource amount UR for each resource, It is also possible to solve the placement problem.

[S140: Implementation of rearrangement]
After the physical server 3 to which each virtual server 35 is rearranged is determined by the relocation calculation unit 15, the movement execution unit 16 moves the virtual server 35 between the physical servers 3 according to the determination and moves the virtual server 35. To do. The migration execution unit 16 transmits a resource reduction instruction, a movement instruction, and a resource addition instruction command to the physical server 3. In the resource reduction instruction command, the ID of the virtual server 35 subject to resource reduction, which is read from the free resource table stored in the free resource table storage unit 24, and the resource amount to be reduced from the virtual server 35 (free resource amount) ) Information. The movement instruction command includes information on the movement source physical server ID, the movement destination physical server ID, and the virtual server ID of the moving virtual server 35 read from the movement table stored in the movement table storage unit 27. In the resource addition instruction command, the ID of the virtual server 35 to which the resource is to be added, read from the additional resource table stored in the additional resource table storage unit 25, and the resource amount (additional resource to be added to the virtual server 35) Quantity ARm). Note that a movement instruction, a resource reduction instruction, and a resource addition instruction related to all the physical servers 3 and the virtual server 35 may be transmitted to all the physical servers 3. A movement instruction, a resource reduction instruction, and a resource addition instruction may be transmitted.

The management unit 31 of the physical server 3 cooperates with the other physical servers 3 to reduce the resource amount of the corresponding virtual server 35 according to the resource reduction instruction, and rearrange the virtual server 35 while operating. As a method of moving the virtual server 35 between the physical servers 3, conventional techniques such as a virtual server migration function (also referred to as hot migration or live migration) can be used (for example, VWare function of VMWare). Then, the management unit 31 of the physical server 3 reduces the resource amount of the corresponding virtual server 35 and adds the additional resource amount ARm according to the resource addition instruction command after the relocation.
The additional resource calculation unit 14 of the resource adjustment device 1 adds a new high value for the ID of the high load group belonging virtual server, the resource ID, and the resource of the resource ID for the high load group belonging virtual server to which the resource has been added. The threshold value table stored in the threshold value table storage unit 23 is updated with the load threshold value and the low load threshold value. Further, the relocation calculation unit 15 updates the virtual server table allocation physical server information stored in the virtual server table storage unit 29 with the ID of the physical server 3 after the migration.

  When updating the threshold value table, the additional resource calculation unit 14 stores the high load threshold value of each high load group belonging virtual server registered in the current threshold value table for each resource in the additional resource table storage unit 25. The added resource amount ARm of each of the high load group belonging virtual servers is rewritten to a value added. Further, the additional resource calculation unit 14 updates the low load threshold value to a value corresponding to the new high load threshold value. For example, the high access load amount corresponding to the new high load threshold obtained from the load resource characteristic data of the high load virtual server group and the low access load amount corresponding to the new low load threshold obtained from the load resource characteristic data. A new low load threshold for each resource is determined so that the average is a sample average of the actual access load.

[S145: Alarm output]
The resource adjustment device 1 outputs an alarm when it is determined in step S120 that there are not enough free resources. Further, the resource adjustment device 1 outputs an alarm when the rearrangement calculation unit 15 determines that rearrangement is impossible in step S135. For example, the alarm is displayed on a display provided in the resource adjustment device 1, a lamp for notifying the alarm is turned on, or the occurrence of an alarm is notified to a computer device connected to the resource adjustment device 1 via the maintenance network 7. And output.

[Step S150: Detection of Low Load State]
In step S105, when the load determination unit 12 of the resource adjustment device 1 determines that a high load has not occurred, it subsequently determines whether a low load has occurred.
The load determination unit 12 determines the resource ID corresponding to the virtual server ID from the threshold value table stored in the threshold value table storage unit 23 in order for all the virtual servers 35 or for the virtual server 35 in which the load status table is updated. And a combination of the low load threshold and the various resource usages of the virtual server 35 read in step S105, and the current resource usage for any of the resources of the virtual server 35 is the low load threshold It is judged whether it is below. At this time, it may be determined whether the usage amount is smaller than the low load threshold only for a predetermined type of resource, or the usage amount is low for any one type or any number of arbitrary types of resources. It may be determined whether it is smaller than the threshold value. When the resource usage is smaller than the low load threshold, the load determination unit 12 determines that a low load is occurring. Then, as described below, the virtual server 35 in which the low load is detected in order to optimize the arrangement state of the virtual server 35 on the physical server 3 and to optimize the resource according to the resource allocation method for each virtual server group. The free resources of the entire virtual server group to which the server belongs are calculated, and the resources are adjusted according to the rearrangement of the virtual server 35 and the resource distribution method for each virtual server group.

  Hereinafter, the virtual server 35 in which the low load has occurred is referred to as “low load detection virtual server”, the virtual server group to which the low load detection virtual server belongs is referred to as “low load virtual server group”, and the virtual server to which the virtual server belongs to The server 35 is described as “low load group virtual server”. Further, a virtual server group other than the low load virtual server group is referred to as a “normal load virtual server group”, and a virtual server 35 belonging to the normal load virtual server group is referred to as a “normal load group belonging virtual server”.

[Step S155: Free Resource Calculation]
If it is determined in step 150 that a low load has occurred, the resource adjustment device 1 determines that resource reduction of the low load virtual server group is necessary. Therefore, the resource adjustment device 1 first performs resource reduction (scale-down / in) for each low-load group virtual server belonging to the low-load virtual server group.

  The free resource calculation unit 13 refers to the virtual server group table stored in the virtual server group table storage unit 26 and reads a virtual server ID list including the virtual server IDs of the low-load detection virtual servers. When the virtual server ID of the low load group belonging virtual server included in the read belonging virtual server ID list (hereinafter, “low load group belonging virtual server ID”) is acquired, the low load group belonging virtual server is obtained as follows: For each resource, the amount of free resources is calculated.

  The free resource calculation unit 13 reads the resource usage and access load information corresponding to the low load group belonging virtual server ID from the load status table stored in the load status table storage unit 21, and further, the threshold table storage unit 23 When the information of the combination of the resource ID corresponding to the low load group belonging virtual server ID and the high load threshold is read from the threshold table stored in the table, the resource usage and the high load threshold are compared for each resource. If there is a difference between the actual resource usage indicated by the access load information and the high load threshold, the free resource calculation unit 13 determines that it is possible to lower the high load threshold by looking at the excess. As the high load threshold is lowered, the resource can be reduced, and the reduced resource becomes the “free resource amount”.

  The free resource calculation unit 13 includes, from the load characteristic table stored in the load characteristic table storage unit 22, a resource ID corresponding to a record in which the low load group belonging virtual server ID is set as an application ID, and a load Read a set of resource characteristic data. The free resource calculation unit 13 obtains an assumed high access load based on the current access load amount of the low load group belonging virtual server indicated by the access load information. The assumed high access load can be calculated as the upper limit value of the load range calculated in the same manner as in step S110. (1) When determining the load range based on the confidence interval of the load distribution, assuming that the sample average of the access average is m and the sample standard deviation of the access average is σ, the load range assumed is (load range) < Calculated by (m + 2.26σ). Alternatively, (2) when the load range is determined from the maximum value of the distribution, the assumed load range is calculated by (load range) <(maximum value of access load distribution) × (grace). (Grace) is a predetermined constant of 1 or more. The maximum value of the access average and the access load distribution is acquired from the access load information in the load situation table stored in the load situation table storage unit 21 using the low load group belonging virtual server ID as a key.

  Based on the relationship between the load and resource amount indicated by the load resource characteristic data, the free resource calculation unit 13 determines the usage amount of various resources corresponding to the assumed high access load as a high load threshold for calculating the free resource amount. And The free resource calculation unit 13 calculates the reducible resource amount, that is, the free resource amount, by subtracting the current high load threshold from the high load threshold for calculating the free resource amount for various resources.

  As described above, when the free resource amount is calculated for each virtual server belonging to the low load group, the calculated free resource amount is totaled for each resource to calculate the total free resources of various resources of the low load virtual server group. Subsequently, according to the resource allocation method of the low-load virtual server group and the virtual server role of each low-load group virtual server, the free resource calculation unit 13 sets various resources in the low-load group virtual server as follows. Determine the amount of resource reduction. At this time, the various resources are allocated so that the total resource reduction amount of the virtual server belonging to the low load group as a result of adding the height is the calculated total free resource amount.

  The free resource calculation unit 13 displays the resource allocation method corresponding to the low-load virtual server group ID, the low-load group belonging virtual server ID belonging to the low-load virtual server group ID, and the virtual server role of the virtual server group table. Read from the virtual server group table stored in the storage unit 26. Further, the current used resource amount of each resource of each low load group virtual server is read from the high load threshold value of the threshold value table stored in the threshold value table storage unit 23.

  When the resource allocation method of the read low-load virtual server group is the scale-up method, the resource reduction amount of the virtual server role belonging virtual server role OUT belonging to the low-load virtual server group is increased, and the virtual server role UP By reducing the resource reduction amount of the low load group virtual server, the remaining resources of the low load group virtual server of the virtual server role UP are relatively high in the low load virtual server group, and the virtual server role OUT Allocate a resource reduction amount so that the remaining resources of the virtual server belonging to the low load group become low. For example, if all virtual servers belonging to the low load group of the virtual server role OUT are equal, or if the resource amount can be reduced by giving priority to the virtual server role UP, and the resource amount can be further reduced For the normal load servers of the virtual server role UP, the resource amount is reduced evenly or with priorities.

  On the other hand, when the resource allocation method of the read low-load virtual server group is the scale-up method, the low-load group belonging virtual server regardless of whether the virtual server role UP or OUT belongs to the low-load virtual server group The amount of resource reduction is determined so that the amount of used resources becomes equal.

  When the free resource calculation unit 13 increases the resource reduction amount for each resource of each low load group belonging virtual server in this way, the free resource calculation unit 13 determines the free resource for each resource of all the low load group belonging virtual servers. Next, a new high load threshold is determined for various resources of the low load group belonging virtual server. The free resource calculation unit 13 subtracts the free resource amount in the low load group belonging virtual server from the high load threshold of the current low load group belonging virtual server for various resources, thereby obtaining a new high load threshold, that is, A new amount of used resources is calculated.

  Furthermore, the free resource calculation unit 13 also lowers the low load threshold for each resource in order to avoid the new high load threshold being lower than the current low load threshold. The free resource calculation unit 13 determines the assumed low access load from the current access load amount of each low load group virtual server using the load resource characteristic data, and corresponds to the determined assumed low access load. The resource amount of each resource is determined as a new low load threshold. For example, an assumed high access load amount corresponding to a new high load threshold obtained from load resource characteristic data and an assumed low access load amount corresponding to a new low load threshold obtained from load resource characteristic data. A new low load threshold for each resource is determined so that the average is a sample average of the actual access load.

  As described above, the free resource calculation unit 13 determines whether to reduce resources for all the low-load group belonging virtual servers. When the high load threshold and the low load threshold are calculated, a record indicating information associating the low load group belonging virtual server ID, the resource ID, and the free resource amount for the resource of the resource ID is stored in the free resource table storage The free resource table stored in the unit 24 is written. Further, the free resource calculation unit 13 updates the threshold table stored in the threshold table storage unit 23 with the low load group belonging virtual server ID, the resource ID, and the high load threshold and low load threshold of the resource.

[S160: Relocation calculation]
The relocation calculation unit 15 of the resource adjustment device 1 considers relocation on all physical servers 3 for all virtual servers 35. That is, the rearrangement calculation unit 15 obtains a solution to the combined placement problem of the used resource amount (= high load threshold) for all the virtual servers 35 with respect to the resource amounts of all the physical servers 3. The resource amounts of all the physical servers 3 are read from the physical server table stored in the physical server table storage unit 28. The used resource amount of each of the virtual servers 35 is read from the high load threshold value in the threshold value table stored in the threshold value table storage unit 23. At this time, for the low load group belonging virtual server, the high load threshold after the free resource reduction is set in the threshold table. As a method for solving the combination arrangement problem in the rearrangement, a method for calculating all combinations, a conventional greedy method, a dynamic programming method, a linear programming method, or the like can be used.

  When solving the combined placement problem in this rearrangement, it may be added to the problem constraint that the virtual servers 35 belonging to the same virtual server group are not placed on the same physical server 3. Further, when solving the combined placement problem in the rearrangement, a condition for minimizing the movement of the virtual server 35 between the physical servers 3 may be added. Further, when solving the combined placement problem in the rearrangement, it may be added to the constraint condition of the problem that the virtual server 35 belonging to the low-load virtual server group is not moved. Further, when solving the combined placement problem in the rearrangement, in order to increase the use efficiency of the physical server 3, it is possible to add the virtual servers 35 to one physical server 3 as a constraint condition of the problem.

  When the rearrangement calculation unit 15 obtains a solution of the rearrangement problem of which virtual server 35 is placed in which physical server 3, the virtual server 35 in which the physical server 3 to be placed is changed by the obtained solution. , The source physical server ID indicating the ID of the physical server 3 where the virtual server 35 is currently arranged, the destination physical server ID indicating the ID of the physical server 3 to be rearranged, and the virtual of the virtual server 35 A migration table indicating the server ID is written in the migration table storage unit 27. If the combination arrangement problem in the rearrangement cannot be solved, an alarm is output.

[S165: Implementation of rearrangement]
After the physical server 3 to which each virtual server 35 is rearranged is determined by the relocation calculation unit 15, the movement execution unit 16 moves the virtual server 35 between the physical servers 3 according to the determination and moves the virtual server 35. To do. Therefore, the movement execution unit 16 transmits a resource reduction instruction and a movement instruction command to the physical server 3. In the resource reduction instruction command, the ID of the virtual server belonging to the low load group that is the resource reduction target read from the free resource table stored in the free resource table storage unit 24 and the virtual server belonging to the low load group should be reduced Information on resource amount (free resource amount) is included. The movement instruction command includes information on the movement source physical server ID, the movement destination physical server ID, and the virtual server ID of the moving virtual server 35 read from the movement table stored in the movement table storage unit 27. It is. The movement instruction and the resource reduction instruction related to all the physical servers 3 and the virtual server 35 may be transmitted to all the physical servers 3, and the resource reduction instruction related to the physical server 3 and A movement instruction may be transmitted.

  The management unit 31 of the physical server 3 cooperates with the other physical servers 3 to reduce the resource amount of the corresponding virtual server 35 according to the resource reduction instruction, and rearrange the virtual server 35 while operating. The relocation calculation unit 15 of the resource adjustment apparatus 1 updates the allocation physical server information of the virtual server table stored in the virtual server table storage unit 29 with the ID of the physical server 3 after the movement.

  Note that when the resource allocation method for each virtual server group is switched, the resources of the virtual servers 35 belonging to the virtual server group can be forcibly set in a low load state.

  Note that an arbitrary arbitrary load balancer can be used as the load balancer 5, but an example will be described here. In the load balancer 5, the fully qualified domain name (FQDN), the IP address of the virtual server 35 that provides the application service of the FQDN, and the virtual server 35 having the IP address can currently provide the application service. The distribution information indicating the information associating with the state of whether or not is stored. The notification unit 33 of the physical server 3 acquires the resource state data of the virtual server 35 from the resource state monitoring unit 34 and notifies the load distribution device 5 of the load state of the virtual server 35 obtained from the acquired data. Based on the notification from the physical server 3, the load distribution device 5 writes application service provision available when the virtual server 35 is not loaded, and application service unavailable when the load is applied. When the user terminal 6 accesses the web, the user terminal 6 notifies the load distribution device 5 of the FQDN of the access destination, and the load distribution device 5 refers to the distribution information and can access an accessible virtual network corresponding to the received FQDN. The IP address of the server 35 is read and returned to the user terminal 6. Thereby, the user terminal 6 transmits an application service request to the virtual server 35 of the physical server 3 with the received IP address as the destination. The virtual server 35 of the physical server 3 that has received the access executes the requested application service. Thereby, the number of accesses can be controlled according to the load of each virtual server 35.

  According to the present embodiment, it becomes possible to dynamically adjust the virtual server resource according to the resource allocation method for each virtual server group, and according to the state of whether the virtual server group has a high load or a low load. The utilization efficiency of the physical server can be increased. In addition, since the scale-out and scale-up mechanisms can be easily realized, the user can strategically select scale-up and scale-out, and can obtain the effects of the selection. In other words, by allocating resources by scaling up, the degree of improvement in response increases from the queuing theory perspective. In addition, the resource usage efficiency is high and the power efficiency is improved. On the other hand, processing is distributed and executed by performing resource allocation by scale-out. Therefore, it is resistant to failures, increases reliability, and improves availability. In addition, in the conventional mechanism, in order to realize the scale-out, a mechanism for starting and stopping a new virtual server is required. However, according to this embodiment, the number of virtual servers is not changed. Can be scaled out.

  Note that the resource adjustment device 1, the physical server 3, the load distribution device 5, and the user terminal 6 described above have a computer system therein. Then, the load status collection unit 11, the load determination unit 12, the free resource calculation unit 13, the additional resource calculation unit 14, the relocation calculation unit 15, the migration execution unit 16, and the management unit 31 of the physical server 3 of the resource adjustment device 1. The operation processes of the virtual server 35, the load balancer 5, and the user terminal 6 are stored in a computer-readable recording medium in the form of a program, and the computer system reads out and executes the program. The above processing is performed. The computer system here includes a CPU, various memories, an OS, and hardware such as peripheral devices.

Further, the “computer system” includes a homepage providing environment (or display environment) if a WWW system is used.
The “computer-readable recording medium” refers to a portable medium such as a flexible disk, a magneto-optical disk, a ROM, and a CD-ROM, and a storage device such as a hard disk built in the computer system. Furthermore, the “computer-readable recording medium” dynamically holds a program for a short time like a communication line when transmitting a program via a network such as the Internet or a communication line such as a telephone line. In this case, a volatile memory in a computer system serving as a server or a client in that case, and a program that holds a program for a certain period of time are also included. The program may be a program for realizing a part of the functions described above, and may be a program capable of realizing the functions described above in combination with a program already recorded in a computer system.

1 is an overall configuration diagram of a virtual server resource adjustment system according to an embodiment of the present invention. It is a figure for demonstrating a virtual server group. It is a figure for demonstrating a resource allocation system. It is a figure for demonstrating the role of a virtual server. It is a figure which shows the operation | movement outline | summary about the free resource reduction from the virtual server group which is not loaded. It is a figure which shows the operation | movement outline | summary about the determination of the resource addition object virtual server in the virtual server group in which high load generate | occur | produced. It is a figure explaining the combination problem of the rearrangement of a virtual server. It is a figure which shows the operation | movement outline | summary about the virtual server rearrangement at the time of heavy load generation | occurrence | production. It is a figure which shows the operation | movement outline | summary at the time of low load detection. It is a block diagram which shows the structure of a physical server. It is a block diagram which shows the structure which shows the structure of a resource adjustment apparatus. It is a figure which shows the data structural example of a load condition table. It is a figure which shows the data structural example of load resource characteristic data. It is a figure which shows the data structural example of a threshold value table. It is a figure which shows the data structural example of an empty resource table | surface. It is a figure which shows the data structural example of an additional resource table | surface. It is a figure which shows the data structural example of a virtual server group table | surface. It is a figure which shows the example of a data structure of a movement table. It is a figure which shows the data structural example of a physical server table | surface. It is a figure which shows the data structural example of a virtual server table | surface. It is a figure which shows the relationship between load resource characteristic data, a high load threshold value, and a low load threshold value. It is a processing flow of a resource adjustment system. It is a figure for demonstrating calculation of the amount of free resources. It is a figure for demonstrating the calculation method of required resource amount NR.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 ... Resource adjustment apparatus 3, 3-1, 3-2, 3-n ... Physical server (server apparatus)
DESCRIPTION OF SYMBOLS 5 ... Load distribution apparatus 11 ... Load condition collection part 12 ... Load determination part 13 ... Free resource calculation part 14 ... Additional resource calculation part 15 ... Relocation calculation part 16 ... Movement execution part (instruction part)
DESCRIPTION OF SYMBOLS 20 ... Memory | storage part 21 ... Load condition table memory | storage part 22 ... Load characteristic table memory | storage part 23 ... Threshold value table memory | storage part 24 ... Empty resource table memory | storage part 25 ... Additional resource table memory | storage part 26 ... Virtual server group table memory | storage part 27 ... Movement table Storage unit 28 ... Physical server table storage unit 29 ... Virtual server table storage unit 31 ... Management unit 32 ... Load status output unit 33 ... Notification unit 34 ... Resource state monitoring unit 35 ... Virtual server

Claims (18)

A virtual server resource adjustment system comprising a server device that operates as a virtual server and a resource adjustment device that adjusts the amount of resources allocated to the virtual server,
The resource adjustment device includes:
Information associating a virtual server group with a virtual server belonging to the virtual server group;
The resource allocation method applied to the virtual server group is a scale-out in which resources are distributedly allocated to virtual servers belonging to the virtual server group, or resources are concentrated on some virtual servers belonging to the virtual server group. Information indicating whether the scale-up is assigned, and
Information indicating whether each virtual server has a role of allocating resources in a concentrated manner or a role of allocating resources in a distributed manner;
Information on the amount of resources used by each virtual server,
Information indicating the criteria for determining the high load state,
A storage unit for storing load status notification information indicating a load state of the virtual server;
A load status collection unit that receives the load status notification information from the server device and writes the load status notification information to the storage unit;
The load state of the virtual server indicated by the load status notification information read from the storage unit is compared with the judgment criterion of the high load state read from the storage unit, and the virtual server has a high load. A load determination unit for determining whether or not,
Referring to the storage unit, a high load virtual server group that is a virtual server group to which the virtual server determined to be high load by the load determination unit belongs is identified, and the identified high load virtual server group is Reads the load status and used resource amount of virtual servers belonging to different virtual server groups, and calculates the total resource amount that can be reduced from the difference between the used resource amount corresponding to the read load state and the read used resource amount A free resource calculator,
Based on the resource allocation method of the high load virtual server group stored in the storage unit and the role of the virtual server belonging to the high load virtual server group, the total additional resource amount is calculated as the free resource calculation. An additional resource calculation unit that determines allocation of the additional resource amount to the virtual servers belonging to the high-load virtual server group so that the total resource amount calculated by the unit is obtained;
An instruction unit for instructing the server device to add a resource of a resource amount allocated to the virtual server according to the determination of the additional resource calculation unit,
The server device
A load status output unit that transmits load status notification information indicating a load status of a virtual server operating on the server device to the resource adjustment device;
A management unit that receives an instruction from the resource adjustment device and adds a resource of an additional resource amount allocated to the virtual server belonging to the high-load virtual server group;
A virtual server resource adjustment system characterized by that. The free resource calculation unit is based on a resource allocation method of a virtual server group different from the high-load virtual server group and a role of a virtual server belonging to the virtual server group stored in the storage unit Determining the allocation of the reduced resource amount of the virtual server belonging to the virtual server group so that the total reduced resource amount becomes the total resource amount,
The instructing unit instructs the server device to reduce the resource of the allocated reduced resource amount from the virtual server according to the determination by the free resource calculating unit,
The management unit receives an instruction from the resource adjustment device, and reduces the resource of the allocated reduction resource amount from the virtual server that is a resource reduction target.
The virtual server resource adjustment system according to claim 1. The storage unit stores resource amount information included in the server device,
The resource adjustment device, for each of the virtual servers belonging to a virtual server group different from the high-load virtual server group, reduces resources allocated to the virtual server from the used resource amount of the virtual server read from the storage unit The amount of used resources after resource reduction obtained by subtracting the amount, the amount of used resources of the virtual server before adding the resource read from the storage unit for each virtual server belonging to the high-load virtual server group, and the virtual Based on the additional resource amount allocated to the server and the resource amount included in the server device read from the storage unit, further comprises a relocation calculation unit that determines a virtual server to be allocated to each of the server devices,
The instruction unit instructs the server device to change the placement of the virtual server according to the determination by the relocation calculation unit,
The management unit receives an instruction from the resource adjustment device and changes the placement of the virtual server.
The virtual server resource adjustment system according to claim 2, wherein: The criterion for determining the high load state is a high load threshold value indicating a resource usage amount of the virtual server,
The load status notification information includes information indicating actual resource usage in the virtual server,
The load determination unit compares the resource usage of the virtual server indicated by the load status notification information with a high load threshold value of the virtual server read from the storage unit, and the virtual server has a high load. Whether or not
The free resource calculation unit updates the high load threshold of the target virtual server for resource reduction with a value obtained by subtracting the reduced resource amount of the virtual server,
The additional resource calculation unit updates the high load threshold of the target virtual server to which the resource is added with a value obtained by adding the additional resource amount of the virtual server.
The virtual server resource adjustment system according to claim 2 or claim 3, wherein The storage unit further stores information indicating a criterion for determining a low load state,
The load determination unit compares the load state of the virtual server indicated by the load status notification information with the determination criterion of the low load state read from the storage unit, and the virtual server has a low load. Whether or not
The free resource calculation unit refers to the storage unit, identifies a low load virtual server group that is a virtual server group to which a virtual server determined to be low load by the load determination unit, and identifies the identified low load Read the load status and amount of used resources of the virtual servers belonging to the load virtual server group, and calculate the total resource amount that can be reduced from the difference between the read resource amount and the used resource amount corresponding to the read load state. Further, based on the resource allocation method of the low-load virtual server group and the role of the virtual server belonging to the low-load virtual server group, the total reduced resource amount becomes the total resource amount. Determine the allocation of the reduced resource amount of the virtual server belonging to the low load virtual server group,
The instructing unit instructs the server device to reduce resources of a reduced resource amount allocated from the virtual server belonging to the low-load virtual server group according to the determination by the free resource calculating unit,
The management unit receives an instruction from the resource adjustment device, and reduces resources of an allocated reduction resource amount from the virtual servers belonging to the low-load virtual server group for which resource reduction is determined.
The virtual server resource adjustment system according to claim 1. The storage unit stores resource amount information included in the server device,
For each of the virtual servers belonging to the low-load virtual server group, the resource usage after resource reduction obtained by subtracting the resource reduction allocated to the virtual server from the resource usage amount of the virtual server read from the storage unit Each of the server devices based on the amount, the used resource amount of the virtual server belonging to a virtual server group different from the low-load virtual server group read from the storage unit, and the resource amount of the server device A relocation calculation unit that determines a virtual server to be arranged;
The instruction unit instructs the server device to change the placement of the virtual server according to the determination by the relocation calculation unit,
The management unit receives an instruction from the resource adjustment device and changes the placement of the virtual server.
The virtual server resource adjustment system according to claim 5, wherein: The criterion for determining the high load state is a high load threshold value indicating a resource usage amount of the virtual server,
The criterion for determining the low load state is a low load threshold value indicating a resource usage amount at a low load assumed by the virtual server,
The load status notification information includes information indicating actual resource usage in the virtual server,
The load determination unit compares the resource usage of the virtual server indicated by the load status notification information with a low load threshold value of the virtual server read from the storage unit, and the virtual server has a low load. Whether or not
The free resource calculation unit updates the high load threshold of the virtual server belonging to the low load virtual server group with a value obtained by subtracting the reduced resource amount of the virtual server, and sets the low load threshold of the virtual server, Update to the value corresponding to the updated high load threshold,
The virtual server resource adjustment system according to claim 6. The storage unit stores load resource characteristic data indicating a relationship between access load and resource usage,
The load status notification information includes information indicating an access load in the virtual server,
The free resource calculation unit reads the load status notification information of the virtual server from the storage unit for each virtual server to be resource-reduced, and assumes from the access load indicated by the read load status notification information by a predetermined calculation formula A high access load to be calculated, and using the load resource characteristic data read from the storage unit, a resource amount corresponding to the assumed high access load is acquired, and the acquired resource amount is stored in the storage Calculating a free resource amount by subtracting from the high load threshold value of the virtual server read from the unit, and calculating a total free resource amount by summing up the free resource amounts calculated for each of the virtual servers,
The virtual server resource adjustment system according to claim 4 or 7, characterized in that The free resource calculation unit
If the resource allocation method of the virtual server group to which the virtual server that is the target of resource reduction belongs is scale-out, the resource reduction of the virtual server so that the used resource amount of all virtual servers belonging to the virtual server group is equalized Determine the quantity allocation,
When the resource allocation method of the virtual server group to which the virtual server subject to resource reduction belongs is scale-up, the resource reduction ratio of the virtual server that has the role of allocating resources in a distributed manner among the virtual servers belonging to the virtual server group Decide the allocation of the reduced resource amount so that it becomes higher,
The virtual server resource system according to claim 1, wherein the virtual server resource system is a virtual server resource system. The additional resource calculation unit
When the resource allocation method of the high-load virtual server group is scale-out, the additional resource amount of the virtual server is allocated so that the used resource amounts of all virtual servers belonging to the high-load virtual server group are equalized. Decide
When the resource allocation method of the high-load virtual server group is scale-up, the percentage of resources used after adding the virtual server that has the role of intensively allocating resources among the virtual servers belonging to the high-load virtual server group Determine the allocation of additional resources so that the
The virtual server resource system according to claim 1, wherein the virtual server resource system is a virtual server resource system.   The information on the virtual server group of the access destination is received from the user terminal, the virtual server belonging to the virtual server group is determined to be accessed according to the load state of the virtual server, and the user terminal The virtual server resource adjustment system according to any one of claims 1 to 10, further comprising an access distribution device that notifies the server.   The virtual server resource adjustment system according to any one of claims 1 to 11, wherein the resource is any one or more of a CPU, a memory, a disk I / O, and a network I / O. The resource adjustment device in a virtual server resource adjustment system comprising a server device that operates as a virtual server and a resource adjustment device that adjusts the amount of resources allocated to the virtual server,
Information associating a virtual server group with a virtual server belonging to the virtual server group;
The resource allocation method applied to the virtual server group is a scale-out in which resources are distributedly allocated to virtual servers belonging to the virtual server group, or resources are concentrated on some virtual servers belonging to the virtual server group. Information indicating whether the scale-up is to be assigned, and
Information indicating whether each virtual server has a role of allocating resources in a concentrated manner or a role of allocating resources in a distributed manner;
Information on the amount of resources used by each virtual server,
Information indicating the criteria for determining the high load state,
A storage unit for storing load status notification information indicating a load state of the virtual server;
A load status collection unit that receives the load status notification information from the server device and writes the load status notification information to the storage unit;
The load state of the virtual server indicated by the load status notification information read from the storage unit is compared with the judgment criterion of the high load state read from the storage unit, and the virtual server has a high load. A load determination unit for determining whether or not,
Referring to the storage unit, a high load virtual server group that is a virtual server group to which the virtual server determined to be high load by the load determination unit belongs is identified, and the identified high load virtual server group is Reads the load status and used resource amount of virtual servers belonging to different virtual server groups, and calculates the total resource amount that can be reduced from the difference between the used resource amount corresponding to the read load state and the read used resource amount A free resource calculator,
Based on the resource allocation method of the high load virtual server group stored in the storage unit and the role of the virtual server belonging to the high load virtual server group, the total additional resource amount is calculated as the free resource calculation. An additional resource calculation unit that determines allocation of the additional resource amount to the virtual servers belonging to the high-load virtual server group so that the total resource amount calculated by the unit is obtained;
An instruction unit for instructing the server device to add a resource of a resource amount allocated to the virtual server according to the determination of the additional resource calculation unit;
A resource adjustment apparatus comprising: The storage unit further stores information indicating a criterion for determining a low load state,
The load determination unit compares the load state of the virtual server indicated by the load status notification information with a low load state determination criterion read from the storage unit to determine whether the virtual server has a low load. Determine whether or not
The free resource calculation unit refers to the storage unit, identifies a low load virtual server group that is a virtual server group to which a virtual server determined to be low load by the load determination unit, and identifies the identified low load Read the load status and amount of used resources of the virtual servers belonging to the load virtual server group, and calculate the total resource amount that can be reduced from the difference between the read resource amount and the used resource amount corresponding to the read load state. Further, based on the resource allocation method of the low-load virtual server group and the role of the virtual server belonging to the low-load virtual server group, the total reduced resource amount becomes the total resource amount. Determine the allocation of the reduced resource amount of the virtual server belonging to the low load virtual server group,
The instructing unit instructs the server device to reduce a resource of a reduced resource amount allocated from the virtual server belonging to the low load virtual server group according to the determination by the free resource calculating unit;
The resource adjustment apparatus according to claim 13. A virtual server adjustment method used in a virtual server resource adjustment system comprising a server device that operates as a virtual server and a resource adjustment device that adjusts the amount of resources allocated to the virtual server,
The resource adjustment device includes:
Information associating a virtual server group with a virtual server belonging to the virtual server group;
The resource allocation method applied to the virtual server group is a scale-out in which resources are distributedly allocated to virtual servers belonging to the virtual server group, or resources are concentrated on some virtual servers belonging to the virtual server group. Information indicating whether the scale-up is to be assigned, and
Information indicating whether each virtual server has a role of allocating resources in a concentrated manner or a role of allocating resources in a distributed manner;
Information on the amount of resources used by each virtual server,
Information indicating the criteria for determining the high load state,
A storage unit that stores load status notification information indicating a load state of the virtual server;
A load status output process in which the load status output unit of the server device transmits load status notification information indicating a load status of a virtual server operating on the server device to the resource adjustment device;
In the resource adjustment device,
A load status collection unit that receives the load status notification information from the server device and writes it to the storage unit; and
The load determination unit compares the load state of the virtual server indicated by the load status notification information read from the storage unit with the determination criterion of the high load state read from the storage unit, and the virtual server A load determination process for determining whether or not the load is high,
A free resource calculation unit refers to the storage unit to identify a high load virtual server group that is a virtual server group to which the virtual server that is determined to have a high load in the load determination process belongs, The load status and amount of used resources of a virtual server belonging to a virtual server group different from the load virtual server group can be read, and the amount of used resources corresponding to the read load status can be reduced from the difference between the read amount of used resources Free resource calculation process for calculating the total resource amount,
Based on the resource allocation method of the high load virtual server group stored in the storage unit and the role of the virtual server belonging to the high load virtual server group, the additional resource calculation unit An additional resource calculation process for determining the distribution of the additional resource amount to the virtual servers belonging to the high-load virtual server group so that the amount is the total resource amount calculated in the free resource calculation process;
An instruction process instructing the server device to add a resource of a resource amount allocated to the virtual server according to the determination in the additional resource calculation process;
A resource addition process in which the management unit of the server device receives an instruction from the resource adjustment device and adds a resource of an additional resource amount allocated to the virtual server belonging to the high-load virtual server group;
A virtual server resource adjustment method comprising: The storage unit of the resource adjustment device further stores information indicating a criterion for determining a low load state,
In the resource adjustment device,
The load determination unit compares the load state of the virtual server indicated by the load status notification information with the determination criterion of the low load state read from the storage unit, and the virtual server has a low load. A low load determination process for determining whether or not,
The free resource calculation unit refers to the storage unit to identify and identify a low-load virtual server group that is a virtual server group to which a virtual server determined to have a low load in the low-load determination process belongs Reads the load status and amount of used resources of virtual servers belonging to the low-load virtual server group, and calculates the total resource amount that can be reduced from the difference between the used resource amount corresponding to the read load state and the read used resource amount Further, based on the resource allocation method of the low-load virtual server group and the role of the virtual server belonging to the low-load virtual server group, the total reduced resource amount becomes the total resource amount, A low-load virtual server free resource calculation process for determining the allocation of the reduced resource amount of the virtual server belonging to the low-load virtual server group;
Resource reduction instructing the server device to reduce the resource of the reduced resource amount allocated from the virtual server belonging to the low-load virtual server group according to the determination in the low-load virtual server free resource calculation process Instruction process,
Resource for reducing the resource of the allocated reduction resource amount from the virtual server belonging to the low load virtual server group in which the management unit of the server device receives an instruction from the resource adjustment device and resource reduction is determined Reduction process,
The virtual server resource adjustment method according to claim 15, further comprising: A computer used as the resource adjustment device in a virtual server resource adjustment system comprising a server device that operates as a virtual server and a resource adjustment device that adjusts the amount of resources allocated to the virtual server,
The load status notification information is received from the server device, the information associating the virtual server group and the virtual server belonging to the virtual server group, and the resource allocation method applied to the virtual server group include the virtual server group Information indicating whether the scale-out is to allocate resources to virtual servers belonging to a server group in a distributed manner, or the scale-up is to allocate resources centrally to some virtual servers belonging to the virtual server group, and each virtual server is concentrated Information indicating whether it is a role of allocating resources in a distributed manner or a role of allocating resources in a distributed manner, information on the amount of used resources of each virtual server, information indicating a judgment criterion for a high load state, and Load status collection step for writing the load status notification information indicating the load status in a storage unit;
The load state of the virtual server indicated by the load status notification information read from the storage unit is compared with the judgment criterion of the high load state read from the storage unit, and the virtual server has a high load. A load determination step for determining whether or not,
With reference to the storage unit, a high load virtual server group that is a virtual server group to which the virtual server determined to be high load in the load determination step belongs is identified, and the identified high load virtual server group is Reads the load status and used resource amount of virtual servers belonging to different virtual server groups, and calculates the total resource amount that can be reduced from the difference between the used resource amount corresponding to the read load state and the read used resource amount Free resource calculation step;
Based on the resource allocation method of the high load virtual server group stored in the storage unit and the role of the virtual server belonging to the high load virtual server group, the total additional resource amount is calculated as the free resource calculation. An additional resource calculation step for determining the distribution of the additional resource amount to the virtual servers belonging to the high-load virtual server group so as to be the total resource amount calculated in the step;
An instruction step for instructing the server device to add a resource of a resource amount allocated to the virtual server according to the determination in the additional resource calculation step;
A computer program for executing In the computer,
Compare the load status of the virtual server indicated by the load status notification information with the low load status determination criteria read from the storage unit, and determine whether the virtual server has a low load. A load determination step;
Referring to the storage unit, a low load virtual server group that is a virtual server group to which a virtual server determined to be low load in the low load determination step belongs is specified, and belongs to the specified low load virtual server group Read the load status and the amount of used resources of the virtual server, calculate the total resource amount that can be reduced from the difference between the used resource amount corresponding to the read load state and the read used resource amount, Based on the resource allocation method of the virtual server group and the role of the virtual server belonging to the low-load virtual server group, the low-load virtual server group is configured so that the total reduced resource amount becomes the total resource amount. A low-load virtual server free resource calculation step for determining allocation of a reduced resource amount of the virtual server to which it belongs;
In accordance with the determination in the low load virtual server free resource calculation step, a resource reduction instruction step for instructing the server device to reduce a resource of a reduced resource amount allocated from the virtual server belonging to the low load virtual server group;
The computer program according to claim 17, further comprising:

Images