JP2018156146A - Information processing device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To properly set the resource of a machine which executes predetermined processes.SOLUTION: An information processing device comprises determination means which acquires associated information for associating a data amount of processing object data in processing of the processing object data by a machine with predetermined resources and a resource usage amount, and determines the configuration of the machine, based on the associated information and a data amount of new processing object data.SELECTED DRAWING: Figure 6

Description

  The present invention relates to an information processing apparatus, and more particularly to an information processing apparatus that determines the configuration of a machine.

  There is a resource management technology for managing the configuration of a virtual machine in a situation where a business application is executed on a virtual machine on an IaaS (Infrastructure as a Service) platform. For example, depending on the load status of the virtual server, the specifications such as CPU (central processing unit) of the virtual machine and the quantity of the virtual machine are automatically set so that the business application can operate on the virtual machine. Enlarging / reducing is performed.

  Here, as a business application executed on a virtual machine, for example, there is an application for building a source code. The source code build is, for example, a task of generating an intermediate file for each source code file on one build machine and generating an executable file by combining the intermediate files.

  As a technique for managing a virtual machine that executes a business application, there is a technique disclosed in Patent Document 1. In Patent Document 1, when using a virtual machine, CPU / memory specifications of a virtual machine required for a business application operating on the virtual machine are determined based on past CPU / memory usage and processing time. doing.

Japanese Patent Laying-Open No. 2015-060279

  However, in the technique of Patent Document 1 described above, when the configuration of the virtual machine is determined based on only the previous resource usage amount in the build of the source code, the resource usage amount is not always appropriate. For this reason, there arises a problem that resources are wasted due to excessive resource allocation and processing delay due to excessive resource allocation occurs, and resources cannot be used efficiently.

  In addition, not only virtual machines but also physical machines have a problem in that machines with appropriate resource usage cannot be used based only on the previous resource usage of the business application being executed. Arise.

  For this reason, an object of the present invention is to solve the above-described problem that the resource of a machine that executes a predetermined process cannot be set appropriately.

An information processing apparatus according to one aspect of the present invention
Acquire association information that associates the data amount of the processing target data and the resource usage when the processing target data is processed on a machine having a predetermined resource, and obtains the association information and the new processing target data A determination means for determining the configuration of the machine based on the amount of data;
The configuration is as follows.

An information processing system according to one aspect of the present invention
A storage device that stores association information that associates a data amount and a resource usage amount when processing target data is processed in a machine having a predetermined resource;
An information processing apparatus comprising: a determination unit that acquires the association information from the storage device; and determines the configuration of the machine based on the association information and a new data amount of the processing target data;
With
The configuration is as follows.

In addition, a program which is one embodiment of the present invention is
In the information processing device,
Acquire association information that associates the data amount of the processing target data and the resource usage when the processing target data is processed on a machine having a predetermined resource, and obtains the association information and the new processing target data Determining means for determining the configuration of the machine based on the amount of data;
To realize,
The configuration is as follows.

An information processing method according to one aspect of the present invention includes:
Acquire association information associating the data amount of the processing target data with the resource usage when processing the processing target data on a machine having a predetermined resource,
The configuration of the machine is determined based on the association information and the data amount of the new processing target data.
The configuration is as follows.

  By configuring as described above, the present invention can appropriately set resources of a machine that executes a predetermined process.

It is a block diagram which shows the whole structure of the information processing system in Embodiment 1 of this invention. It is a figure which shows the structure of the build execution server disclosed in FIG. It is a flowchart which shows operation | movement of the build execution server disclosed in FIG. It is a figure which shows the mode of the process by the build execution server disclosed in FIG. It is a figure which shows the mode of the process by the build execution server disclosed in FIG. It is a block diagram which shows the structure of the information processing apparatus in Embodiment 2 of this invention. It is a flowchart which shows operation | movement of the information processing apparatus in Embodiment 2 of this invention.

<Embodiment 1>
A first embodiment of the present invention will be described with reference to FIGS. 1 and 2 are diagrams for explaining the configuration of the information processing system. 3 to 5 are diagrams for explaining the operation of the information processing system.

[Constitution]
The information processing system according to the present invention is an information processing system that performs resource management of virtual machines on an IaaS basis. In particular, in this embodiment, the purpose of using a virtual machine is to execute source code build, and an information processing system for determining the configuration of the virtual machine is illustrated.

  However, in the present invention, the purpose of use of the virtual machine for determining the configuration is not limited to the above, and may be used for processing any data to be processed. In the present invention, the machine whose configuration is determined is not limited to a virtual machine, and the configuration of a physical machine may be determined.

  As shown in FIG. 1, the information processing system according to this embodiment includes a source code management server 1, a build execution server 3, and a virtual machine management server 5 connected via a network. These are in a state where communication is possible via the network. Further, as will be described later, the information processing system includes a virtual machine 6 activated by the virtual machine management server 5 connected to a network.

  The source code management server 1 is configured by an information processing device including an arithmetic device and a storage device. The source code management server 1 has a function of managing the source code file 2 stored in the storage device and acquiring the source code file from the storage device. Such a function is constructed by executing a program on the arithmetic device.

  The build execution server 3 is configured by an information processing device including an arithmetic device and a storage device. Then, as shown in FIG. 2, the build execution server 3 includes a source code acquisition unit 31, a build execution unit 32, a configuration determination unit 33, a machine request unit, which are constructed by incorporating a program into an arithmetic device. 34.

  The source code acquisition unit 31 (determination unit) requests the source code management server 1 for the source code (processing target data) to be built, and acquires the source code from the source code management server 1. Then, the source code acquisition unit 31 divides the acquired source code into units that can be built, and generates a plurality of steps (division processing target data) to be built.

  The build execution unit 32 uses the activated virtual machine 6 to build each step obtained by dividing the source code as described above. Then, the build execution unit 32 stores the usage amount of the resources constituting the virtual machine 6 required for the build of each step in the storage device as the resource usage history data 4 (association information). At this time, the build execution unit 32 stores the resource usage amount in association with the source code amount representing the data amount of each step. For example, the resource usage is the number of CPU cores constituting the virtual machine or the CPU usage rate. However, the resource usage is not limited to that described above.

  The configuration determining unit 33 (determining unit) determines a virtual machine based on each step of the source code acquired by the source code acquiring unit 31 and the resource usage history data 4 when building a new source code. 6 configuration is determined. At this time, the configuration determination unit 33 determines the configuration of the virtual machine 6 that executes the build of the step for each step. In particular, the specifications and quantity of the resources constituting the virtual machine 6, for example, the CPU performance and the number of cores are determined.

  Specifically, the configuration determination unit 33 determines the resource specifications and quantity according to the difference amount of source code amount from the previous time to the current time and the rate of increase / decrease. In addition, the configuration determining unit 33 determines the resource specifications and quantity based not only on the amount of source code but also on the resource usage rate when the step was processed last time. Note that the method for determining the configuration of the virtual machine 6 will be described in detail later when the operation is described.

  The machine request unit 34 (request unit) outputs a request for constructing the virtual machine 6 determined by the configuration determination unit 33 to the virtual machine management server 5.

  The virtual machine management server 5 is configured by an information processing apparatus including an arithmetic device and a storage device. Then, the virtual machine management server 5 has a function of starting the virtual machine 6 having the requested specifications and quantity of resources in response to a virtual machine construction request from the configuration determining unit 33. Such a function is constructed by executing a program on the arithmetic device.

[Operation]
Next, the information processing system having the above-described configuration, in particular, the configuration of the build execution server 3 will be described with reference to the flowchart of FIG.

  First, at the time of the first build execution, the build execution server 3 acquires the source code to be built from the source code management server 1 (step S1), and divides it into each step as a unit for building (step S2). Then, the build execution server 3 requests the virtual machine management server 5 to start one virtual machine with predetermined specifications. The virtual machine management server 5 activates one virtual machine 6 in response to the request.

  Subsequently, the build execution server 3 builds the source code on the activated virtual machine 6 (Yes in step S3, step S4). The build execution server 3 associates the step executed in parallel during the build with the resource usage of the virtual machine 6 used at that time, and saves it in the resource usage history data 4 (step S5).

  Subsequently, at the time of the second build execution, the build execution server 3 obtains the source code to be built from the source code management server 1 (step S1) as described above, and performs each step as a unit for building. Divide (step S2). And the build execution server 3 calculates the difference of the data amount from the last time for every step (No in step S3, step S6).

  The build execution server 3 calculates the configuration necessary for each step in the current build, that is, the specifications of the resource, based on the calculated difference and the resource usage history data 4 (step S7). At this time, for example, the number of CPU cores is increased or decreased according to the increase / decrease rate of the data amount. As an example, when the data amount is reduced by half, the number of CPU cores having the same performance is halved. When there is no difference in the amount of source code between the previous time and the current time, the number of CPU cores is increased or decreased based on the resource usage rate when the previous build was performed. As an example, if the CPU usage rate was 50% last time, the number of CPU cores having the same performance is halved.

  Subsequently, the build execution server 3 requests the virtual machine management server 5 for the calculated configuration of the virtual machine, that is, the specifications and quantity of the required virtual machine (step S8). Then, the virtual machine management server 5 starts up the requested specifications and quantity of virtual machines 6.

  Thereafter, similarly to the above, each step is built using the virtual machine 6 started by the build execution server 3 (step S5). Then, the build execution server 3 associates the step executed at the time of building with the resource usage of the virtual machine 6 used at that time, and stores it in the resource usage history data 4 (step S5).

[Concrete example]
Next, a specific example of determining the configuration of the virtual machine by the information processing system described above will be described with reference to FIGS.

  First, the build of Step A with a source code amount “1000”, Step B with a source code amount “500”, and Step C with a source code amount “2000” is performed for the first time. At this time, the resource of the virtual machine 6 that performs the build is assumed to have two CPU cores.

  When a build is performed in such a situation, as shown in FIG. 4A, each source code amount and a resource usage amount with two CPU cores are stored as resource usage history data 4. In addition, the CPU usage rate is stored in the resource usage history data 4 for each step, as shown in FIG. In the example of FIG. 4B, Step A uses 100% CPU for 100 seconds processing time, Step B uses 50% CPU for 50 seconds processing time, Step C uses CPU. In this example, “100%” is used and a processing time of 200 seconds is required.

  Next, it is assumed that the second build is performed. At this time, as shown in FIG. 5, in the current build, step A has a source code amount of “500”, step B has a source code amount of “500”, and step C has a source code amount of “4000”. And

  Then, in step A, the source code amount has changed from “1000” to “500”, and there is a difference of “−500” from the previous time. That is, the source code amount is ½. For this reason, for step A, the build execution server 3 determines that the number of CPU cores of the virtual machine to be allocated may be 1/2 of the previous time when the performance is the same. That is, the number of CPU cores is determined as “1”.

  In step C, the source code amount is changed from “2000” to “4000”, which is twice the previous time. For this reason, the build execution server 3 determines that for step C, the number of CPU cores of the virtual machine to be allocated is twice as large as the previous one when the performance is the same. That is, the CPU core number is determined to be “4”.

  On the other hand, in step B, the amount of source code has not changed to “500” both in the previous time, but the previous CPU usage rate is 50%. That is, for step B, only 1/2 of the allocated virtual machine resource was used last time. For this reason, for step B, the build execution server 3 determines that the number of CPU cores of the allocated virtual machine may be 1/2 of the previous time when the performance is the same. That is, the number of CPU cores is determined as “1”.

  From the above, the build execution server 3 is a virtual machine with a CPU core number “1” for step A and step B, a virtual machine with a CPU core number “4” for step C, and so on. Determine the configuration. Then, the build execution server 3 requests the virtual machine management server 5 to start the virtual machine 6 having such a configuration.

  In the example of FIG. 5 described above, since the CPU usage rate in the previous build process is 100% in step A and step C, the number of CPU cores is not changed according to the CPU usage rate. However, if the previous CPU usage rate is less than 100% in step A and step C, the number of CPU cores is reduced assuming that the CPU usage rate will be 100% in the current build process. Also good. For example, if the previous CPU usage rate was 50% in Step C, the number of CPU cores may be reduced to ½ this time. For this reason, as described above, even if the source code amount in step C is doubled, if the CPU usage rate is 50%, the number of CPU cores is increased or decreased as a result, and the CPU cores are increased. The number may be determined as “2”.

  In the above description, the machine used for the source code build process is a virtual machine, but the machine may be a physical machine. In this case, a group of physical machines having different specifications may be prepared, and the virtual machine management server 5 may start a physical machine having the determined configuration as the physical machine management server.

  As described above, according to the present invention, since the specifications and quantity of the required virtual machine are determined based on the difference from the previous time of the source code to be built, the CPU of the virtual machine is executed by executing in parallel. / The amount of processing per memory is constant. As a result, resources can be used efficiently. Furthermore, this makes it easy to estimate the time required for the build.

<Embodiment 2>
Next, a second embodiment of the present invention will be described with reference to FIGS. FIG. 6 is a block diagram illustrating the configuration of the information processing apparatus according to the second embodiment, and FIG. 7 is a flowchart illustrating the operation thereof. Note that the information processing apparatus in the present embodiment shows an outline of the configuration of the build execution server 3 described in the first embodiment.

As shown in FIG.
Acquires association information that associates the data amount of the processing target data and the resource usage when the processing target data is processed on a machine having a predetermined resource, and the association information and new processing target data data And determining means 110 for determining the configuration of the machine based on the quantity.

  According to the information processing apparatus 100, first, association information that associates the data amount of the processing target data and the resource usage amount when the processing target data is processed by a machine having a predetermined resource is acquired (step S11). ). Then, the machine configuration is determined based on the acquired association information and the data amount of the new processing target data (step S12).

  As described above, according to the present invention, a necessary machine configuration is determined based on the amount of change in data to be processed. Therefore, it is possible to construct a machine that can efficiently use resources according to the amount of data to be processed.

<Appendix>
Part or all of the above-described embodiment can be described as in the following supplementary notes. The outline of the configuration of the information processing apparatus, information processing system, program, and information processing method in the present invention will be described below. However, the present invention is not limited to the following configuration.

(Appendix 1)
Acquire association information that associates the data amount of the processing target data and the resource usage when the processing target data is processed on a machine having a predetermined resource, and obtains the association information and the new processing target data A determination means for determining the configuration of the machine based on the amount of data;
Information processing device.

(Appendix 2)
An information processing apparatus according to attachment 1, wherein
The determination means is based on the association information when the processing target data was processed last time, and a difference amount between the data amount of the processing target data processed last time and the new data amount of the processing target data. To determine the configuration of the machine,
Information processing device.

(Appendix 3)
An information processing apparatus according to appendix 1 or 2,
The determination means determines a ratio of changing the configuration of the machine according to a ratio of a data amount of the new processing target data to a data amount of the processing target data processed last time.
Information processing device.

(Appendix 4)
An information processing apparatus according to appendix 2 or 3,
The determining means determines the configuration of the machine based on the resource usage rate when the processing target data was processed last time.
Information processing device.

(Appendix 5)
An information processing apparatus according to appendix 4, wherein
The determining unit determines the configuration of the machine based on the usage rate when the usage rate of the resource when the processing target data is processed last time is less than 100%.
Information processing device.

(Appendix 6)
An information processing apparatus according to any one of appendices 1 to 5,
The determination means includes, for each division processing target data obtained by dividing the processing target data into a plurality of units, the association information that associates the data amount and the resource usage when the division processing target data is processed, The configuration of the machine is determined based on the amount of data to be divided and processed,
Information processing device.

(Appendix 6.1)
An information processing apparatus according to any one of appendices 1 to 6,
Comprising request means for outputting the determined request for constructing the machine configuration to another information processing apparatus having a machine construction function;
Information processing device.

(Appendix 6.2)
An information processing apparatus according to any one of appendices 1 to 6.1,
The determining unit acquires the association information that associates the data amount of the source code and the resource usage when the source code is built in a virtual machine having a predetermined resource, and the association information And determining the configuration of the virtual machine based on the data amount of the source code.
Information processing device.

(Appendix 7)
A storage device that stores association information that associates a data amount and a resource usage amount when processing target data is processed in a machine having a predetermined resource;
An information processing apparatus comprising: a determination unit that acquires the association information from the storage device; and determines the configuration of the machine based on the association information and a new data amount of the processing target data;
Information processing system with

(Appendix 8)
An information processing system according to appendix 7,
Other information processing apparatus for constructing the machine having the configuration determined by the determining means,
Information processing system with

(Appendix 9)
In the information processing device,
Acquire association information that associates the data amount of the processing target data and the resource usage when the processing target data is processed on a machine having a predetermined resource, and obtains the association information and the new processing target data Determining means for determining the configuration of the machine based on the amount of data;
A program to realize

(Appendix 9.1)
The program according to appendix 9, wherein
In addition to the information processing apparatus,
Request means for outputting the determined request to construct the machine configuration to another information processing apparatus having a machine construction function;
A program to realize

(Appendix 10)
Acquire association information associating the data amount of the processing target data with the resource usage when processing the processing target data on a machine having a predetermined resource,
The configuration of the machine is determined based on the association information and the data amount of the new processing target data.
Information processing method.

(Appendix 11)
An information processing method according to attachment 10, wherein
Based on the association information when the processing target data was processed last time and the difference amount between the data amount of the processing target data processed last time and the data amount of the new processing target data, Determine the configuration,
Information processing method.

(Appendix 12)
An information processing method according to attachment 11, wherein
According to the ratio of the data amount of the new processing target data to the data amount of the processing target data processed last time, the ratio of changing the configuration of the machine is determined.
Information processing method.

(Appendix 13)
An information processing method according to appendix 11 or 12,
Determining the configuration of the machine based on the resource usage rate when the processing target data was processed last time;
Information processing device.

(Appendix 14)
An information processing method according to attachment 13, wherein
When the resource usage rate when the processing target data was processed last time is less than 100%, the configuration of the machine is determined based on the usage rate.
Information processing method.

(Appendix 15)
An information processing method according to any one of appendices 10 to 13,
For each division processing target data obtained by dividing the processing target data into a plurality of units, the association information that associates the data amount and the resource usage when the division processing target data is processed, and the new division processing target data Determining the configuration of the machine based on the amount of data;
Information processing.

(Appendix 16)
An information processing method according to any one of appendices 10 to 15,
Outputting the determined request to construct the machine configuration to another information processing apparatus having a machine construction function;
Information processing method.

(Appendix 17)
An information processing method according to any one of appendices 10 to 16,
The association information that associates the data amount of the source code and the resource usage when the source code is built in the virtual machine having the predetermined resource is acquired, and the association information and the new source code Determining the configuration of the virtual machine based on the amount of data;
Information processing method.

  Note that the above-described program is stored in a storage device or recorded on a computer-readable recording medium. For example, the recording medium is a portable medium such as a flexible disk, an optical disk, a magneto-optical disk, and a semiconductor memory.

  Although the present invention has been described with reference to the above-described embodiment and the like, the present invention is not limited to the above-described embodiment. Various changes that can be understood by those skilled in the art can be made to the configuration and details of the present invention within the scope of the present invention.

DESCRIPTION OF SYMBOLS 1 Source code management server 2 Source code file 3 Build execution server 31 Source code acquisition part 32 Build execution part 33 Configuration determination part 34 Machine request part 4 Resource use history data 5 Virtual machine management server 6 Virtual machine N network

Claims (10)

Acquire association information that associates the data amount of the processing target data and the resource usage when the processing target data is processed on a machine having a predetermined resource, and obtains the association information and the new processing target data A determination means for determining the configuration of the machine based on the amount of data;
Information processing device. The information processing apparatus according to claim 1,
The determination means is based on the association information when the processing target data was processed last time, and a difference amount between the data amount of the processing target data processed last time and the new data amount of the processing target data. To determine the configuration of the machine,
Information processing device. The information processing apparatus according to claim 1 or 2,
The determination means determines a ratio of changing the configuration of the machine according to a ratio of a data amount of the new processing target data to a data amount of the processing target data processed last time.
Information processing device. An information processing apparatus according to claim 2 or 3,
The determining means determines the configuration of the machine based on the resource usage rate when the processing target data was processed last time.
Information processing device. The information processing apparatus according to claim 4,
The determining unit determines the configuration of the machine based on the usage rate when the usage rate of the resource when the processing target data is processed last time is less than 100%.
Information processing device. An information processing apparatus according to any one of claims 1 to 5,
The determination means includes, for each division processing target data obtained by dividing the processing target data into a plurality of units, the association information that associates the data amount and the resource usage when the division processing target data is processed, The configuration of the machine is determined based on the amount of data to be divided and processed,
Information processing device. A storage device that stores association information that associates a data amount and a resource usage amount when processing target data is processed in a machine having a predetermined resource;
An information processing apparatus comprising: a determination unit that acquires the association information from the storage device; and determines the configuration of the machine based on the association information and a new data amount of the processing target data;
Information processing system with The information processing system according to claim 7,
Other information processing apparatus for constructing the machine having the configuration determined by the determining means,
Information processing system with In the information processing device,
Acquire association information that associates the data amount of the processing target data and the resource usage when the processing target data is processed on a machine having a predetermined resource, and obtains the association information and the new processing target data Determining means for determining the configuration of the machine based on the amount of data;
A program to realize Acquire association information associating the data amount of the processing target data with the resource usage when processing the processing target data on a machine having a predetermined resource,
The configuration of the machine is determined based on the association information and the data amount of the new processing target data.
Information processing method.

Images