JP2011186637A - System and method for cooperating resource - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a service executed in a certain cloud by use of a resource of another cloud. <P>SOLUTION: Respective cloud cooperation management devices 1 exchange upper system procedure data indicating a stop or a start of a virtual machine constituting an upper system with each other, and store them. A cloud cooperation management device 1 of a cloud A transmits the upper system of a resource control target to a cloud cooperation management device 1 of a cloud B, and instructs a virtualization device 5 inside its own cloud about the stop or the start of the virtual machine constituting the upper system according to a resource control source procedure indicated by the upper system procedure data corresponding to the upper system. The cloud cooperation management device 1 of the cloud B instructs a virtualization device 5 inside its own cloud about the start of the virtual machine constituting the upper system according to a resource control destination procedure indicated by the upper system procedure data corresponding to the upper system of the resource control target received from the cloud A and stored. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to a resource cooperation system and a resource cooperation method between cloud service systems.

As an inexpensive and flexible system provision environment, the use of a cloud service (IaaS: Infrastructure as a Service) that lends virtual machines and storage at a charge according to contracted users is expanding. Initially, only large-scale public clouds were provided as services, but recently there has been an increase in the number of “small clouds” shared by relatively small organizations such as private clouds and community clouds. In response, it has come to “choose the cloud”.
On the other hand, Patent Document 1 describes that virtual machine system technology is applied to a computer system installed at a plurality of locations to switch between a master system and a backup system.

JP 2005-173751 A

In the small cloud as described above, it is considered that a situation in which resources for providing services are insufficient is likely to occur compared to a large-scale cloud. However, it is difficult to increase resources as soon as a resource shortage occurs. In view of this, it is conceivable to use a part of other cloud resources, or to transfer the service to another cloud with relatively sufficient resources.
However, in many cases, each cloud is provided completely independently by different operators, and the specifications differ from each other. In terms of handling multiple clouds, RightScale provides users with a web interface that can operate multiple clouds in a unified manner. However, there is only one “entrance for users” such as operation and status browsing for each cloud. It can be implemented with a web system, and does not increase the interoperability and ease of migration of resources between clouds.
The technology disclosed in Patent Document 1 starts a virtual machine system in a computer system at a plurality of bases in a normal operation state, and switches from a master system to a backup system when a failure occurs, resulting in insufficient resources. Sometimes it cannot be applied when resources are mutually used between clouds or when the cloud service itself is migrated.

  The present invention has been made in view of the above circumstances, and the purpose thereof is a resource cooperation system capable of providing a service being executed in a certain cloud using resources of another cloud, and It is to realize a resource cooperation method.

  In order to solve the above-described problem, the present invention provides a resource cooperation system formed by connecting a plurality of cloud systems having a virtualization apparatus and a cloud cooperation management apparatus via a network, and the cloud cooperation management apparatus as a resource control source A control source storage unit that stores upper system procedure data indicating a procedure for stopping or starting a virtual machine that constitutes a higher system, and the higher system procedure data stored in the control source storage unit in another cloud Control source inter-cloud information update unit to be transmitted to the cooperation management device, an instruction output unit for notifying the cloud cooperation management device of the resource control target of the resource control target higher system, and the resource control target higher system The host system procedure data is read from the control source storage unit, and the host system is read The virtual machine constituting the higher-level system is started on the virtualization device in the own cloud system according to the procedure of the resource control source indicated by the sequential data, or is started on the virtualization device in the own cloud system A control source procedure execution unit that stops the virtual machine constituting the higher system, and the cloud cooperation management device that is a resource control destination includes a control destination storage unit that stores the higher system procedure data, and a resource control source The control target inter-cloud information update unit that receives the host system procedure data from the cloud cooperation management device and writes it to the control destination storage unit, and the resource control target notified from the cloud cooperation management device of the resource control source Identify the host system procedure data stored in the control destination storage unit by the host system A control-destination procedure execution unit that starts the virtual machine constituting the higher-level system on the virtualization device in the own cloud system according to the resource control-destination procedure indicated by the identified higher-level system procedure data. Is a resource linkage system characterized by

  Further, the present invention is the resource cooperation system described above, wherein the control source storage unit further stores higher system configuration information indicating a configuration of a higher system by a plurality of virtual machines, and the control source inter-cloud information update unit Transmits the higher system configuration information stored in the control source storage unit to the other cloud cooperation management device, and the control source procedure execution unit corresponds to the higher system corresponding to the resource control target higher system. Reads the configuration information from the control source storage unit, determines the order of virtual machines to be stopped according to the dependency relationship of the virtual machines indicated by the read higher-level system configuration information, and sends the configuration information to the virtualization device in its own cloud according to the determined order The virtual machine that has been started is stopped, and the inter-control-destination cloud information update unit The host system configuration information is received from the management device and written to the control destination storage unit, and the control destination procedure execution unit sends the host system configuration information corresponding to the resource control target host system from the control destination storage unit. Determining the order of virtual machines to be activated according to the dependency relationship of the virtual machines indicated by the read upper system configuration information, and activating the virtual machines on the virtualization apparatus in the own cloud according to the determined order; It is characterized by.

  Further, the present invention is the resource cooperation system described above, wherein the first procedure execution unit and the second procedure execution unit have a dependency relationship between the address information of the activated virtual machine in the host system. It is characterized in that it is set in another virtual machine.

  Further, the present invention is the resource cooperation system described above, wherein the upper system procedure data includes starting or stopping of the virtual machine constituting the upper system of the resource control target, starting of a service provided by the virtual machine, or 1 of the following processes: stop, update of the setting file of the service, allocation or deallocation of external storage to the virtual machine, transmission of notification to the resource control source or resource control destination, and waiting for notification from the resource control source or resource control destination A procedure comprising the above is shown.

  Further, the present invention is the resource cooperation system described above, wherein the control source storage unit stores the types of virtual machines that can be activated in the other cloud systems, and the resource control source cloud cooperation management device includes: A list output unit that reads out and outputs a list of other cloud systems capable of starting up the virtual machine constituting the resource control target higher-order system from the control source storage unit, and the instruction output unit includes the list The high-order system of the resource control target is notified by using a cloud cooperation management device of another cloud system selected from the candidates output by the output unit as a resource control destination.

  Further, the present invention is the resource linkage system described above, wherein the control source storage unit stores information on charges of the own cloud system and other cloud systems, and the cloud linkage management device of the resource control source includes: Refers to the information on the charges of the own cloud system and other cloud systems stored in the control source storage unit, selects another cloud system whose difference between the own cloud system and the charge is within a predetermined range, and selects the selected other cloud system as a resource A list output unit for outputting as a control destination candidate, wherein the instruction output unit controls the resource control using a cloud cooperation management device of another cloud system selected from the candidates output by the list output unit as a resource control destination The target higher system is notified.

  Further, the present invention is the resource cooperation system described above, wherein the cloud cooperation management device acquires the resource state of the virtualization device in the own cloud system and notifies the cloud cooperation management device of the resource control source The cloud cooperation management device that is the resource control source includes, as a resource control destination candidate, another cloud system that is selected based on the resource availability indicated by the resource state received from the other cloud cooperation management device. A list output unit for outputting, wherein the instruction output unit uses the cloud cooperation management device of another cloud system selected from the candidates output by the list output unit as a resource control destination for the host system to be controlled by the resource It is characterized by notifying.

  The present invention is also an inter-cloud resource cooperation method in a resource cooperation system formed by connecting a plurality of cloud systems having a virtualization apparatus and a cloud cooperation management apparatus via a network, and the cloud cooperation management of the resource control source In the apparatus, the control source inter-cloud information update unit reads the upper system procedure data indicating the procedure for stopping or starting the virtual machine constituting the upper system from the control source storage unit, and transmits it to the other cloud cooperation management device In the former cloud-to-cloud information update process, and in the cloud cooperation management device of the resource control destination, the control destination inter-cloud information update unit receives the upper system procedure data from the cloud cooperation management device of the resource control source and stores the control destination A control destination cloud-to-cloud information update process In the cloud cooperation management device of the source control source, the instruction output unit notifies the resource cooperation target host system of the resource control target to the cloud cooperation management device, and the control source procedure execution unit includes the resource The host system procedure data corresponding to the host system to be controlled is read from the control source storage unit, and the virtual machine constituting the host system is set in accordance with the procedure of the resource control source indicated by the read host system procedure data. A control source procedure execution process for stopping the virtual machine constituting the host system, which is started on the virtualization device in the cloud system, or started on the virtualization device in the own cloud system, and a resource control destination In the cloud cooperation management device, the control destination procedure execution unit The higher-level system procedure data stored in the control-destination storage unit is identified by the higher-level system subject to resource control notified from the cloud cooperation management device, and the resource control-destination indicated by the identified higher-level system procedure data And a control destination procedure execution process for starting the virtual machine constituting the host system on the virtualization apparatus in the own cloud system according to the procedure.

According to the present invention, when resources of a higher system (cloud service) providing environment are insufficient in a certain cloud, a part of the resources of other clouds are used, or a higher system is provided to another cloud with sufficient resources It is possible to migrate the entire environment and continue to provide a higher system.
In addition, since the entire host system provision environment can be migrated between clouds as described above, a vendor lock-in state in which it is difficult for a user to migrate from one cloud operator to another cloud operator does not occur. , Users are more likely to benefit from competition among cloud operators. Although the cloud is a unified platform for many systems, the risk of users who use cloud services is eliminated because they do not have to rely on specific cloud operators. In addition, even if most or all of the computer device group constituting the cloud is damaged due to a catastrophic disaster, it is possible to continue providing services in other clouds.

1 is an overall configuration diagram of an inter-cloud resource cooperation system according to an embodiment of the present invention. It is a block diagram which shows the structure of the cloud by the same embodiment. It is a figure which shows the structural example of the high-order system by the embodiment. 2 shows an example of initial values of higher system configuration information according to the embodiment. It is a figure which shows the specific example of a structure of the high-order system by the embodiment. It is a figure which shows the specific example of the high-order system structure information by the embodiment. It is a figure which shows the high-order system procedure data which described the transfer procedure of the high-order system by the embodiment. It is a figure which shows the high-order system procedure data which described the scale-out procedure of the high-order system by the embodiment. It is a figure which shows the data structural example of the other cloud information by the embodiment. It is a figure which shows the data structural example of the resource information by the embodiment. It is a figure which shows the data structural example of the virtual machine list information by the embodiment. It is a figure which shows the data structural example of CPU architecture information by the embodiment. It is a figure which shows the data structural example of OS information by the embodiment. It is a figure which shows the data structural example of the fee information by the embodiment. It is a figure which shows the data structural example of the related high-order system structure information by the embodiment. It is a figure which shows the transfer procedure between the clouds of the high-order system by the embodiment. It is a figure which shows the transfer procedure between the clouds of the high-order system by the embodiment. It is a figure which shows the transfer procedure between the clouds of the high-order system by the embodiment. It is a figure which shows the transfer procedure between the clouds of the high-order system by the embodiment. It is a figure which shows the scale-out procedure between the clouds of the high-order system by the embodiment. It is a figure which shows the scale-out procedure between the clouds of the high-order system by the embodiment.

Hereinafter, exemplary embodiments of the present invention will be described with reference to the drawings.
FIG. 1 is an overall configuration diagram of an inter-cloud resource cooperation system according to an embodiment of the present invention.
As shown in the figure, the inter-cloud resource cooperation system is formed by connecting a plurality of cloud systems (hereinafter simply referred to as “cloud”) via a network 7 that is an IP network. A DNS (Domain Name System) server 8 and a user terminal 9 are connected to the network 7. In the figure, only one user terminal 9 is shown, but a plurality of user terminals 9 can be connected.

  Each cloud of cloud A, cloud B,..., Cloud N includes a cloud cooperation management device 1 and a cloud service system. A cloud service system that provides a cloud service to the user terminal 9 includes a cloud front-end device 3 and a virtualization device 5. In the figure, only one virtualization apparatus 5 is shown, but a plurality of virtualization apparatuses 5 may be provided.

  Hereinafter, a cloud to which devices such as the cloud cooperation management device 1, the cloud front-end device 3, and the virtualization device 5 belong is referred to as “own cloud” of the device, and a cloud different from the cloud to which the device belongs is referred to as “other cloud”. Describe. For example, in the cloud cooperation management device 1 of cloud A, the own cloud is cloud A, and the other clouds are cloud B,.

FIG. 2 is a block diagram showing the configuration of the cloud according to the present embodiment.
The virtualization device 5 is a computer device having a function of virtualizing its computer resources, and generates an instance of a virtual machine. In other words, the virtualization device 5 virtually divides physical hardware resources such as its CPU (central processing unit), memory, and disk, and based on an image file of a virtual machine including a predetermined program. The virtual machine is started on the divided computer resource (slot).

  The virtual machine has a function for executing a service and an agent function. The virtual machine performs various processes such as activation / termination of a service, update of a service setting file, attachment / detachment of an external storage, etc., instructed by the cloud cooperation management device 1 by an agent function. The virtual machine operates in cooperation with other virtual machines, and can constitute a system that provides a cloud service. A system that operates on the cloud and provides a cloud service is referred to as a “higher system”. Specifically, the “higher system” is realized by combining services executed by a plurality of software that performs processing on a virtual machine. The host system usually consists of only virtual machines activated in the virtualization device 5 in the same cloud. However, when scale-out is performed, virtual machines activated in the virtualization devices 5 in other clouds are used. Including the host system.

  The cloud front-end device 3 is realized by one or a plurality of computer devices, and starts and stops a virtual machine of its own cloud, acquires a virtual machine list of its own cloud, assigns and unassigns storage to the virtual machine of its own cloud, Acquires the resource status of the virtual machine in its own cloud.

  The cloud cooperation management device 1 includes a storage unit 11, a management interface (hereinafter referred to as “IF”) unit 12, a cooperation IF unit 13, a configuration management unit 14, a configuration control unit 15, a cloud operation IF unit 16, and A virtual machine operation IF unit 17 is provided.

  The storage unit 11 includes other cloud information and related upper system configuration information, upper system configuration information of the own cloud and other clouds, upper system procedure data, virtual machine list information, resource information, CPU (central processing unit) architecture Various information such as information, OS (Operation System) information, and fee information is stored.

  Other cloud information shows the IP address of the cloud cooperation management apparatus 1 which belongs to another cloud. Related higher-level system configuration information associates higher-level systems that can be provided in the own cloud with other clouds that are migration destinations of the higher-level systems, and other clouds that are scale-out destinations of virtual machines that constitute the higher-level systems. Information. As information for specifying another cloud, the ID of the cloud cooperation management apparatus 1 belonging to the other cloud can be used.

The host system configuration information indicates the configuration of the virtual machine that configures the host system, and includes attribute information of each virtual machine that configures the host system, information on the number of activated virtual machines and the IP address of each virtual machine. The attribute information includes information such as dependency relationships between services constituting the higher system, the default number of virtual machines, whether scale-out is possible, and startup requirements. The information on the startup requirements is to start and run the virtual machine, such as image files that are virtual machine software and middleware files, the OS on which the virtual machine operates, and the hardware requirements such as the CPU required for the virtual machine operation. The requirements necessary for this are shown.
The host system procedure data is data describing procedures for migration of the entire host system between clouds, scale-out of virtual machines between clouds, startup of the host system, and stop of the host system.

  The virtual machine list information indicates a list of image files of virtual machines supported in the cloud service system. The resource information indicates the state of the resource of the cloud service system, and includes information on the total memory amount and free memory total amount of the cloud service system, the total disk amount and free disk total amount, and the total number of CPUs and the number of free CPUs. The CPU architecture information indicates a CPU architecture name supported by the cloud service system. The OS information indicates an OS name supported by the cloud service system. The charge information indicates a unit of charge and a charge per unit.

  The management IF unit 12 receives various instructions regarding the start of execution of the higher system procedure. The management IF unit 12 also accepts registration and change of information in the storage unit 11. The cooperation IF unit 13 transmits / receives data to / from another cloud cooperation management device 1 via the network 7. The cloud operation IF unit 16 transmits / receives data to / from the cloud front-end device 3 of its own cloud. The virtual machine operation IF unit 17 transmits / receives data to / from a virtual machine in its own cloud.

The configuration management unit 14 manages information stored in the storage unit 11. The configuration management unit 14 includes an in-cloud information update unit 141, an inter-cloud information update unit 142, and a related higher system information update unit 143.
The in-cloud information update unit 141 receives various information collected by the cloud front-end device 3 of the own cloud from the virtualization device 5 in the own cloud, and stores it in the storage unit 11 based on the received information Update the information. Further, the information of the own cloud stored in the storage unit 11 is updated according to the input from the management IF unit 12.
The inter-cloud information update unit 142 periodically reads the upper system configuration information, upper system procedure data, virtual machine list information, resource information, CPU architecture information, OS information, and fee information of the own cloud from the storage unit 11 and others. To the cloud cooperation management device 1. Further, the inter-cloud information update unit 142 transmits the update information to another cloud cooperation management device 1 when the higher-level system configuration information is updated. Further, the inter-cloud information update unit 142 writes various information received from the other cloud cooperation management device 1 to the storage unit 11.
The related higher system information update unit 143 is a higher system configuration information of the own cloud stored in the storage unit 11, a virtual machine list of other clouds, resource information of the own cloud and other clouds, CPU architecture information, OS information, fee information Etc., the related higher system configuration information is generated and written in the storage unit 11.

The configuration control unit 15 executes host system procedures such as starting, stopping, and migrating the host system and scaling out the virtual machine in accordance with the instruction received from the management IF unit 12. The configuration control unit 15 includes a list presentation unit 151, an instruction output unit 152, and a procedure execution unit 153.
When the instruction received from the management IF unit 12 is a transition to a higher system between clouds or a scale-out, the list presenting unit 151 outputs a list of clouds that can be a migration destination or a scale-out destination.
The instruction output unit 152 receives information on the cloud selected from the list output by the list presenting unit 151, and instructs the procedure execution unit 153 and the selected cloud cooperation management apparatus 1 of the selected cloud to execute the upper system procedure. To do.
The procedure execution unit 153 reads the upper system procedure data and the upper system configuration information from the storage unit 11 in accordance with the instruction received from the instruction output unit 152 or another cloud cooperation management apparatus 1, and starts the virtual machine based on the information. Processing such as stopping is performed. Each procedure included in the host system procedure data is executed by an API (Application Program Interface) provided by the configuration control unit 15.

  Hereinafter, the cloud cooperation management device 1, the cloud front-end device 3, and the virtualization device 5 of each cloud are represented by adding codes corresponding to the cloud. For example, the cloud cooperation management device 1, the cloud front end device 3, and the virtualization device 5 of the cloud A are described as the cloud cooperation management device 1a, the cloud front end device 3a, and the virtualization device 5a, respectively, and the cloud cooperation management device of the cloud B 1, the cloud front-end device 3 and the virtualization device 5 are referred to as a cloud cooperation management device 1b, a cloud front-end device 3b, and a virtualization device 5b, respectively. Similarly, the functional block in the cloud cooperation management apparatus 1 of each cloud is represented by adding a code corresponding to the cloud. For example, the storage unit 11 of the cloud cooperation management device 1a of the cloud A is described as a storage unit 11a, and the storage unit 11 of the cloud cooperation management device 1b of the cloud B is described as a storage unit 11b.

Next, various types of information stored in the cloud cooperation management device 1 will be described. Before this description, the configuration of the host system will be described.
FIG. 3 is a diagram illustrating a configuration example of the host system.
FIG. 3A shows the configuration of the host system W before the scale-out, and FIG. 3B shows the configuration of the host system W after the scale-out.
As shown in FIGS. 3A and 3B, the host system W has a virtual machine X that executes service α and service β, a virtual machine Y that executes service γ, and a virtual machine that executes service δ. Machine Z. Further, there is a dependency relationship between the service α and the service β, the service β and the service γ, and the service γ and the service δ. In FIG. 3A, there are two virtual machines X and Y, and one virtual machine Z. However, after the scale-out of the virtual machine Y as shown in FIG. There are 4 units.

  FIG. 4 shows an example of the initial setting of the host system configuration information stored in the storage unit 11 of the cloud cooperation management device 1. The upper system configuration information shown in the figure describes the configuration of the upper system W shown in FIG. The external reference file group of the host system configuration information is composed of external reference files of the respective virtual machines X, Y, and Z. Each external reference file describes virtual machine identification information and attribute information of the virtual machine. Yes. The attribute information describes the default number of virtual machines, scale-out availability, services executed on the virtual machines, other services on which the services depend, dynamic parameters related to the services, and startup requirements. The The dynamic parameter is a parameter whose setting value is dynamically changed as the virtual machine is activated.

  The initial setting of the host system configuration information shown in FIG. 4 is a class, that is, a model of the host system configuration information. When executing the host system procedure, this class is used to set an actual dynamic parameter (IP address, etc.). Set to create an instance. By creating an instance, an entity of higher system configuration information is created individually based on the class (model) and placed on the memory. Then, the upper system procedure is executed using the generated instance.

As shown in the figure, the ID of the host system W is described in the host system configuration information, and the IDs of the virtual machines X, Y, and Z are described in the external reference file. The attribute information of the virtual machine X indicates that the default number is two, scale-out is not possible, the services α and β are executed, the service α depends on the service β, and the service β depends on the service γ. The attribute information of the virtual machine Y has two default units and depends on the virtual machine Z, can be scaled out, the service γ is executed, the service γ depends on the service δ, and the IP address is dynamic. The attribute information of the virtual machine Z indicates that the default number is 1, the scale-out is not possible, the service δ is executed, the service δ does not depend on other services, and the IP address is dynamic. Indicates a parameter.
In addition, virtual machine image file names, OS names, and CPU architecture names are shown as activation requirements for virtual machines X, Y, and Z.
When each virtual machine is activated, the IP address and the number of activated virtual machines are set in the higher system configuration information. The IP address may include a port number.

FIG. 5 shows a specific example of the configuration of the host system, and FIG. 6 shows a specific example of host system configuration information corresponding to the host system shown in FIG.
As shown in FIG. 5, the host system “Web 3-tier system” includes a virtual machine “LB / Web” that executes the service “UltraMonxxx” and the service “Apaxxx”, and a virtual machine “App” that executes the service “Tomxxx”. And a virtual machine “DB” that executes the service “PostxxxSQL”.

FIG. 6 shows that the host system (Web 3-tier system) identified by ID “BSID-00000001” is composed of virtual machines identified by IDs “LB / Web”, “App”, and “DB”. Is described.
The virtual machine “LB / Web” has two defaults (default = “2”), scale-out is not possible (scalable = “false”), the service “UltraMonxxx” and the service “Apaxxx” are executed, and the service “ "UltraMonxxx" depends on the service "Apaxxx" of the virtual machine "LB / Web"("dependon" value = "Apaxxx # LB / Web"), the IP address (ipAddress) is a dynamic parameter, and the service "Apaxxx "Is dependent on the service" Tomxxx "of the virtual machine" App "(" dependon "value =" Tomxxx # App "), and the IP address (ipAddress) is a dynamic parameter.

Similarly, the virtual machine identified by the ID “App” has two default machines and a maximum of 10 machines, scale-out is possible, the service “Tomxxx” is executed, and the service “Tomxxx” is a service of the virtual machine “DB”. Depends on “PostxxxSQL”, it is described that the IP address is a dynamic parameter. The virtual machine specified by the ID “DB” has one default, cannot be scaled out, and executes the service “PostxxxSQL”. The service “PostxxxSQL” describes that the IP address is a dynamic parameter.
Furthermore, the image file names of the virtual machines “LB / Web”, “App”, and “DB” are “lbweb-image”, “ap-image”, and “db-image”, respectively, and the virtual machine “LB / Web” , “App” and “DB” describe that the CPU architecture is “x86_yy” and the OS is “Linxx”.
As described above, by declaring that the IP address is dynamically set, when the service configuration file is updated in the upper system procedure, the dynamically set IP address is acquired and set. It can be embedded in a file.

  7 and 8 are diagrams illustrating a configuration example of higher-level system procedure data stored in the storage unit 11 of the cloud cooperation management device 1. The procedures indicated by the host system procedure data include a host system start procedure, stop procedure, migration procedure, and scale-out procedure.

  FIG. 7 shows host system procedure data describing the transition procedure of the host system W. The host system procedure data of the migration procedure describes the ID of the host system W, information indicating that the procedure is a “migration procedure”, and a migration source procedure and a migration destination procedure. The migration source procedure is a procedure for determining the termination order of virtual machines, executing a termination script for each virtual machine according to the determined termination order, and notifying the migration destination cloud cooperation management apparatus 1 of the termination of the virtual machine, and Consists of a termination script for each virtual machine. In addition, the migration destination procedure includes waiting for notification of completion of the virtual machine from the migration source cloud cooperation management apparatus 1, determining the startup order of the virtual machine, executing the startup script of each virtual machine according to the determined startup order, and updating the DNS. And a startup script for each virtual machine.

For example, the termination script can be used to stop services in each virtual machine, detach external storage (external disk) from the virtual machine (unmount), deallocate external storage from the virtual machine (detach), stop the virtual machine, etc. It can be configured including procedures.
For example, the startup script can be used to start each virtual machine, wait for the virtual machine to start, assign external storage to the virtual machine (attach), attach external storage to the virtual machine (mount), and configure settings for services in the virtual machine. It can be configured to include procedures such as file update and service activation in the virtual machine. The content to be set in the configuration file update is described in advance as a configuration file in the script. However, the parameter (for example, IP address) declared as dynamic in the higher-level system configuration information is acquired and stored in the configuration file. Can be included.

  The host system procedure data for the stop procedure is the same procedure as the source procedure in the host system procedure data for the migration procedure, and the host system procedure data for the startup procedure is the destination in the host system procedure data for the migration procedure. The procedure is the same as the procedure. However, the procedure for sending / receiving notifications and waiting for notifications between the migration destination and the migration source is excluded.

  FIG. 8 shows host system procedure data describing the scale-out procedure of the host system V configured to include the virtual machines P and Q. As shown in the figure, the host system procedure data of the scale-out procedure includes the ID of the host system V, information indicating that the procedure is a “scale-out procedure”, and a scale-out source procedure and a scale-out destination procedure. Described. Here, the scale-out target virtual machine P is, for example, distributed processing middleware that depends on the virtual machine Q, the virtual machine P executes the service ε, and the virtual machine Q executes the service ζ.

  The scale-out source procedure of the virtual machine P includes the virtual machine start start notification to the scale-out destination, the start script execution of the scale-out target virtual machine P, the virtual machine start-up completion notification to the scale-out destination, and the virtual from the scale-out destination Waiting for machine start completion notification, setting file update for virtual machine Q service ζ, setting file update for virtual machine P service ε, setting file update completion notification to scale-out destination, setting file update completion notification from scale-out destination , A procedure for restarting the service ε of the virtual machine P and the service ζ of the virtual machine Q, and a startup script of the scale-out target virtual machine.

Also, the scale-out destination procedure of the virtual machine P is to wait for the virtual machine start start notification from the scale-out source, execute the start script of the virtual machine P, notify the virtual machine start-up completion to the scale-out source, and the virtual machine from the scale-out source It comprises a procedure for waiting for a start completion notification, updating a setting file for the service ε of the virtual machine P, a setting file update completion notification to the scale-out source, and a start-up script for the virtual machine to be scaled out.
The start script includes, for example, instructions for starting each virtual machine and waiting for the virtual machine to start.

  As described above, the process described in the host system procedure data, that is, the process that can be executed by the API provided by the procedure execution unit 153 includes starting and stopping the virtual machine, detaching and attaching the storage, allocation, and deallocation. , Waiting for completion of a predetermined procedure block, waiting for a predetermined notification and notification reception, etc. In addition, for example, IP address assignment to a virtual machine, command execution on a virtual machine, processing execution in another thread, etc. Yes, a series of procedures can be described by a combination of these processes.

  FIG. 9 is a diagram illustrating a data configuration example of other cloud information stored in the storage unit 11 of the cloud cooperation management device 1. As shown in the figure, the other cloud information is a list in which the ID (id) of the other cloud cooperation management device 1 that is linked is associated with the IP address (address) of the other cloud cooperation management device 1 Consists of.

  FIG. 10 is a diagram illustrating a data configuration example of the resource information stored in the storage unit 11 of the cloud cooperation management device 1. The resource information is associated with the ID of the cloud cooperation management device 1, and the total memory (memory) of the entire virtualization device 5 in the cloud to which the cloud cooperation management device 1 specified by this ID belongs, and the total free memory ( available_memory), total disk amount (disk), free disk total amount (available_disk), CPU total number (cpu), and free CPU number (available_cpu).

  FIG. 11 is a diagram illustrating a data configuration example of the virtual machine list information stored in the storage unit 11 of the cloud cooperation management device 1. The virtual machine list information is associated with the ID of the cloud cooperation management device 1, and the virtual machine image file supported by the virtualization device 5 in the cloud to which the cloud cooperation management device 1 specified by this ID belongs. A list of names (vm_image) is shown. The type of virtual machine that can be started can be represented by the virtual machine image file name.

  FIG. 12 is a diagram illustrating a data configuration example of the CPU architecture information stored in the storage unit 11 of the cloud cooperation management device 1. The CPU architecture information is associated with the ID of the cloud cooperation management device 1, and the CPU architecture name (arch) supported by the virtualization device 5 in the cloud to which the cloud cooperation management device 1 specified by this ID belongs. A list of

  FIG. 13 is a diagram illustrating a data configuration example of OS information stored in the storage unit 11 of the cloud cooperation management device 1. The OS information is associated with the ID of the cloud cooperation management device 1, and a list of OS names (os) supported by the virtualization device 5 in the cloud to which the cloud cooperation management device 1 specified by this ID belongs. Indicates.

  FIG. 14 is a diagram illustrating a data configuration example of fee information stored in the storage unit 11 of the cloud cooperation management device 1. The charge information is associated with the ID of the cloud cooperation management device 1, and the unit of charge of the higher system in the cloud to which the cloud cooperation management device 1 specified by this ID belongs, and the charge per unit ( price). As the unit of charge, for example, the number of CPUs, the memory size, etc., or a combination thereof can be used.

  FIG. 15 is a diagram illustrating a data configuration example of related higher-level system configuration information stored in the storage unit 11 of the cloud cooperation management device 1. As shown in the figure, the related higher-level system configuration information includes the ID (id) of a higher-level system that the cloud cooperation management device 1 may be a target of activation, stop, migration, and scale-out, and the migration of the higher-level system. It consists of a list in which the ID (recovery_dst) of the cloud cooperation management device 1 of another cloud that can be the destination and the ID (scaleout_dst) of the cloud cooperation management device 1 of another cloud that can be the scale-out destination of the higher system are associated with each other .

Next, the operation of the inter-cloud resource cooperation system of this embodiment will be described.
First, in each cloud, the in-cloud information update unit 141 of the cloud cooperation management device 1 writes other cloud information and fee information input by the management IF unit 12 in the storage unit 11. The in-cloud information update unit 141 of the cloud cooperation management device 1 requests the virtual machine, CPU architecture, and OS information from the cloud front-end device 3 of its own cloud. In the cloud front-end device 3, the image file name, CPU architecture information, and OS information of a virtual machine supported by the virtualization device 5 of the own cloud are registered in advance. In response to the inquiry, the cloud front-end device 3 transmits the pre-stored virtual machine image file name, CPU architecture information, and OS information to the cloud cooperation management device 1 of its own cloud. The in-cloud information update unit 141 of the cloud cooperation management device 1 stores the virtual machine image file name, CPU architecture information, and OS information received from the cloud front-end device 3 corresponding to the ID of the own cloud cooperation management device 1. The virtual machine list information, CPU architecture information, and OS information in the unit 11 are written.

  In each cloud, the in-cloud information update unit 141 of the cloud cooperation management device 1 periodically outputs a resource status query to the cloud front-end device 3 of its own cloud. When the cloud front-end device 3 receives the inquiry about the resource state, the memory amount, the free memory amount, the disk capacity, the free disk capacity, the number of CPUs, the number of free CPUs, etc. from each of all the virtualization devices 5 in its own cloud Are read out and output to the cloud cooperation management device 1. Based on the resource status of each virtualization device 5 received from the cloud front-end device 3, the in-cloud information update unit 141 of the cloud cooperation management device 1 is based on the total memory amount of the entire cloud, the total free memory amount, the total disk amount, the total free disk amount, The total number of CPUs and the total number of free CPUs are calculated, and the resource information in the storage unit 11 corresponding to the ID of the own cloud cooperation management device 1 is updated based on the calculation result. Note that the contents input from the management IF 11 may be written for the total memory amount, the total disk amount, and the total CPU number of the entire cloud.

  On the other hand, in each cloud, the inter-cloud information update unit 142 of the cloud cooperation management device 1 periodically stores the higher-level system configuration information, higher-level system procedure data, resource information, CPU architecture, and the like stored in the storage unit 11. When information, OS information, and charge information are read as linkage information, the ID of the cloud linkage management device 1 is added to the read linkage information, and the IP of another cloud linkage management device 1 set in other cloud information Send address as destination. The inter-cloud information update unit 142 of the cloud cooperation management device 1 that is the destination associates the received update information with the ID of the cloud cooperation management device 1 that is the source of the update information and writes it in the storage unit 11.

  Through the above procedure, between the cloud cooperation management devices 1 of each cloud, the higher system configuration information, higher system procedure data, resource information, CPU architecture information, OS information, and fee information are periodically exchanged and updated.

  In each cloud, the related higher system information update unit 143 of the cloud cooperation management device 1 identifies one higher system configuration information of the own cloud stored in the storage unit 11, and from the identified higher system configuration information, Read activation requirements. The related higher system information update unit 143 refers to the virtual machine list information, the CPU architecture information, and the OS information in the storage unit 11 associated with the ID of the other cloud cooperation management device 1, and Identify another cloud that meets the virtual machine startup requirements and determine that it is the destination cloud. For example, the related higher system information update unit 143a of the cloud cooperation management apparatus 1a of cloud A reads the activation requirements of each virtual machine from the higher system configuration information of the higher system W of the own cloud. The related higher system information update unit 143a displays all the virtual machine images indicated by the activation requirements of each read virtual machine in the virtual machine list information, CPU architecture information, and OS information associated with the ID of the cloud cooperation management device 1b. If the file name, all OS names, and all CPU architecture names are included, the cloud B is determined to be the migration destination cloud of the host system W. The related higher system information update unit 143 performs the same determination for the virtual machine list information of other clouds.

  Further, the related higher system information update unit 143 reads the activation requirement ID of the virtual machine that can be scaled out from the higher system configuration information of the identified own cloud. The related higher system information update unit 143 refers to the virtual machine list information, CPU architecture information, and OS information in the storage unit 11 associated with the IDs of the other cloud cooperation management devices 1 to Identify another cloud that satisfies the startup requirements of the virtual machine that can be scaled out, and determine that it is the scale-out destination cloud. For example, the related higher system information update unit 143a of the cloud cooperation management apparatus 1a of the cloud A reads the virtual machine start-up requirement that can be scaled out from the higher system configuration information of the higher system W of the own cloud. Further, the related higher system information update unit 143a is indicated in the virtual machine list information, CPU architecture information, and OS information associated with the ID of the cloud cooperation management device 1n by the read-out requirements of each read-out virtual machine that can be scaled out. If all virtual machine image file names, all OS names, and all CPU architecture names are included, the cloud N is determined to be a scale-out destination cloud of the host system W. The related higher system information update unit 143 performs the same determination for the virtual machine list information of other clouds.

The related higher system information update unit 143 determines the higher system ID read from the higher system configuration information of the own cloud, the ID of the cloud cooperation management device 1 of the other cloud determined to be the migration destination cloud, and the scale-out destination cloud The ID of the cloud cooperation management device 1 of another cloud is written in the related higher system configuration information.
The related higher system information update unit 143 specifies the higher system configuration information of the own cloud stored in the storage unit 11 in order, and performs the same processing as described above.

  The related higher system information update unit 143 assigns priorities to the cloud determined to be the migration destination cloud and the scale-out destination cloud or excludes the migration destination cloud and the scale-out destination cloud from the target by the following processing. It is also possible.

(1) Compare the charge information of the own cloud with the charge information of the migration destination cloud and the scale-out destination cloud, and increase the priority of the migration destination cloud and the scale-out destination cloud as the amount is closer. Moreover, when there is a divergence greater than a predetermined amount, it may be excluded from the migration destination cloud and the scale-out destination cloud.

(2) Referring to the resource information of the migration destination cloud and the scale-out destination cloud, the priority of the migration destination cloud and the scale-out destination cloud is increased in descending order of the total free memory amount, free disk total amount, and free CPU total number. The priority of the migration destination cloud and the scale-out destination cloud may be increased in descending order of the ratio of the total free memory to the total memory, the ratio of the total free disk to the total disk, and the ratio of the total free CPU to the total number of CPUs. It is arbitrary whether to give priority to memory, disk, or CPU.

  The related higher system information update unit 143 may use either (1) or (2), or both. When both are used, it is arbitrary which is given priority.

  16 to 19 are diagrams illustrating a procedure for migrating a host system between clouds. In the following description, the migration source cloud is assumed to be cloud A, the migration destination cloud is assumed to be cloud B, and the migration target higher level system is assumed to be a higher level system W composed of virtual machines running in the cloud A.

  In FIG. 16, the management IF unit 12a of the cloud cooperation management apparatus 1a belonging to the cloud A receives the command including the inter-cloud migration instruction and the ID of the host system W that is the inter-cloud migration target, and sends it to the configuration control unit 15a. Output (step S105). This command may be input by a user using an input unit provided in the cloud cooperation management device 1a, or may be received from another device connected to the cloud cooperation management device 1a via the network 7. The list presenting unit 151a of the configuration control unit 15a specifies the related higher system configuration information stored in the storage unit 11a using the ID of the higher system W set in the command as a key, and the specified related higher system configuration information Then, the ID of the cloud cooperation management device 1 of another cloud that can be the migration destination is read out. The list presenting unit 151a uses the read list of IDs of the other cloud cooperation management devices 1 or the list of names of the clouds specified by the IDs of these other cloud cooperation management devices 1 as the transfer destination candidate information. Output to. The management IF unit 12a outputs the migration destination candidate information received from the list presenting unit 151a to a display provided in the cloud cooperation management device 1 or a display of another device that is a command transmission source (step S110). When a priority is added to the ID of the read other cloud cooperation management apparatus 1, information on the priority of each migration destination cloud is also output, for example, displaying in order of priority.

The user selects the cloud B as the migration destination from the output migration destination candidate information, and inputs the cloud selection information for specifying the selected cloud B. The management IF unit 12a of the cloud cooperation management device 1a outputs the input cloud selection information to the configuration control unit 15a (step S115).
The instruction output unit 152a of the configuration control unit 15a outputs the ID of the host system W and the execution instruction of the migration source procedure for migration between clouds to the procedure execution unit 153a (step S120). Further, when the instruction output unit 152a detects that the cloud B is selected by the cloud selection information, the ID of the cloud cooperation management device 1b belonging to the cloud B is used as a key, and the IP of the cloud cooperation management device 1b is obtained from other cloud information. Read the address. The instruction output unit 152a transmits the ID of the host system W, the ID of the own cloud cooperation management apparatus 1a, and the execution instruction of the migration destination procedure for migration between clouds using the read IP address as a destination (step S125). .

  In the procedure execution unit 153a of the cloud cooperation management device 1a, the ID of the higher system W is set from the higher system procedure data stored in the storage unit 11a corresponding to the ID of the own cloud cooperation management device 1a. Identify higher-level system procedure data for the migration procedure. When the procedure execution unit 153a reads the migration source procedure from the identified higher-level system procedure data (step S130), the procedure execution unit 153a starts executing the read migration source procedure (step S135). Here, it is assumed that the transfer target is the host system W and the transfer source procedure is read from the host system procedure data shown in FIG.

  On the other hand, the procedure execution unit 153b of the cloud cooperation management device 1b receives the ID of the host system W transmitted from the cloud cooperation management device 1a via the cooperation IF unit 13b, the ID of the cloud cooperation management device 1a, and the cloud An instruction to execute the migration destination procedure is received. The procedure execution unit 153b is a host system procedure data of the migration procedure in which the ID of the host system W is set from the host system procedure data stored in the storage unit 11b corresponding to the ID of the cloud cooperation management device 1a. Is identified. When the procedure execution unit 153b reads the migration destination procedure from the identified higher-level system procedure data (step S140), the procedure execution unit 153b starts executing the read migration destination procedure (step S145). Here, it is assumed that the transfer target is the host system W, and the transfer destination procedure is read from the host system procedure data shown in FIG.

  When the migration source procedure is started, the procedure execution unit 153a of the cloud cooperation management device 1a first determines the virtual machine end order, so that the host system corresponding to the ID of the cloud cooperation management device 1a and the ID of the host system W The configuration information is specified and read from the storage unit 11a. The procedure execution unit 153a determines an end order in order from the virtual machine having the deepest dependency on other virtual machines based on the dependency relationship of the services in each virtual machine indicated by the higher-level system configuration information (step S150). In the case of the host system configuration information shown in FIG. 4, since the service β of the virtual machine X depends on the service γ of the virtual machine Y, the virtual machine Y depends on the virtual machine Y. Because the service γ of the virtual machine Z depends on the service δ of the virtual machine Z, the fact that the virtual machine Y depends on the virtual machine Z is because the service δ of the virtual machine Z does not depend on other services. It can be seen that the γ virtual machine Z does not depend on other virtual machines. The procedure execution unit 153a finally ends the virtual machine Z that does not depend on other virtual machines, ends the virtual machine Y that depends on the virtual machine Z before the virtual machine Z, and virtual machines that depend on the virtual machine Y. It is determined that X ends before the virtual machine Y. Therefore, the end order is the order of the virtual machines X, Y, and Z. The procedure execution unit 153a ends the virtual machine according to the determined end order.

  In FIG. 17, the procedure execution unit 153a first reads and executes the virtual machine X termination script included in the migration source procedure in order to terminate the virtual machine X first. When the procedure execution unit 153a reads the IP addresses of all the virtual machines X from the host system configuration information read in step S150, the procedure execution unit 153a transmits an instruction to stop the service α to the virtual machines X with the read IP addresses as destinations (step S205). ). The agent of the virtual machine X stops the service α (step S210). Next, the procedure execution unit 153a transmits an instruction to stop the service β to the virtual machine X according to the virtual machine X termination script (step S215). The agent of the virtual machine X stops the service β (step S220). This is because the service α is dependent on the service β, and thus ends from the service α.

  Subsequently, the procedure execution unit 153a transmits an instruction to stop the virtual machine X to the cloud front-end device 3a according to the virtual machine X termination script (step S225). The cloud front-end device 3a outputs an instruction to stop the virtual machine X to the virtualization device 5a that is starting the virtual machine X. The virtualization apparatus 5 a that has received the instruction to stop the virtual machine X stops the virtual machine X. Thereby, the instance of the virtual machine X that has been executed in the virtualization apparatus 5a is released. The procedure execution unit 153a deletes the IP address of the virtual machine X (service α and service β) from the higher-level system configuration information in the storage unit 11a identified in step S150, and updates the number of virtual machines X started to 0.

  When the procedure execution unit 153a finishes executing the virtual machine X end script, the procedure execution unit 153a subsequently executes the virtual machine Y end script. When the procedure execution unit 153a reads the IP addresses of all the virtual machines Y from the higher-level system configuration information, the procedure execution unit 153a transmits an instruction to stop the service γ to the virtual machine Y with the read IP address as the destination (step S230). The agent stops the service γ (step S235). Subsequently, the procedure execution unit 153a transmits a stop instruction for the virtual machine Y to the cloud front-end device 3a (step S240), and the cloud front-end device 3a sends the virtual machine Y to the virtualization device 5a that is running the virtual machine Y. To stop the virtual machine Y. The virtualization apparatus 5 a that has received the instruction to stop the virtual machine Y stops the virtual machine Y. The procedure execution unit 153a deletes the IP address of the virtual machine Y from the higher-level system configuration information in the storage unit 11a identified in step S150, and updates the number of virtual machines Y started to 0.

  When the procedure execution unit 153a finishes executing the virtual machine Y end script, the procedure execution unit 153a subsequently executes the virtual machine Z end script. When the procedure execution unit 153a reads the IP address of the virtual machine Z from the higher-level system configuration information, the procedure execution unit 153a sends an instruction to stop the service δ to the virtual machine Z with the read IP address as the destination (step S245), and the agent of the virtual machine Z Stops the service δ (step S250). Furthermore, the procedure execution unit 153a transmits an external storage disconnection instruction to the virtual machine Z (step S255), and the agent of the virtual machine Z disconnects the external storage (step S260).

The procedure execution unit 153a transmits an external storage deallocation instruction to the cloud front-end device 3a (step S265), and the cloud front-end device 3a sends the virtual machine Z to the virtualization device 5a that is running the virtual machine Z. The external storage allocation cancellation instruction is output. The virtualization apparatus 5a that has received the instruction cancels the allocation of the external storage to the virtual machine Z.
Further, the procedure execution unit 153a transmits a stop instruction for the virtual machine Z to the cloud front-end device 3a (step S270), and the cloud front-end device 3a sends the virtual machine Z to the virtualization device 5a that is running the virtual machine Z. A stop instruction for the virtual machine Z is output. The virtualization apparatus 5 a that has received the instruction to stop the virtual machine Z stops the virtual machine Z. The procedure execution unit 153a deletes the IP address of the virtual machine Z from the higher-level system configuration information in the storage unit 11a identified in step S150, and updates the number of virtual machines Z to be activated to zero.

  The inter-cloud information update unit 142a of the cloud cooperation management device 1a includes the ID of the cloud cooperation management device 1a and the ID of the higher system W, the IP addresses of the virtual machines X, Y, and Z deleted from the higher system configuration information, and The updated number of activated virtual machines X, Y, and Z is transmitted as higher system configuration update information to other cloud cooperation management apparatuses 1 including the cloud cooperation management apparatus 1b. The inter-cloud information update unit 142 of the other cloud cooperation management device 1 is stored in the storage unit 11 corresponding to the ID of the cloud cooperation management device 1a and the ID of the higher system W by the received higher system configuration update information. Update the higher system update information.

  When the procedure execution unit 153a finishes executing the end script of the virtual machine, the procedure execution unit 153a transmits a virtual machine end notification to the cloud cooperation management device 1b of the migration destination cloud (step S275). The procedure execution unit 153b of the cloud cooperation management device 1b of the migration destination cloud is in a state of waiting for the termination of the virtual machine from the migration source after the migration destination script is started (step S280).

  In FIG. 18, when the procedure execution unit 153b of the cloud cooperation management device 1b of the migration destination cloud receives the virtual machine end notification transmitted from the cloud cooperation management device 1a, the cloud cooperation management device determines the virtual machine activation order. The host system configuration information corresponding to the ID of 1a and the ID of the host system W is specified and read from the storage unit 11b. The procedure execution unit 153b determines the activation order in order from virtual machines that do not depend on other virtual machines, based on the dependency relationship of each virtual machine indicated by the higher-level system configuration information (step S305). In the case of the host system configuration information shown in FIG. 4, the virtual machine Z that does not depend on other virtual machines is started first, the virtual machine Y that depends on the virtual machine Z is started next to the virtual machine Z, and the virtual machine It is determined that the virtual machine X depending on Y is started next to the virtual machine Y. Therefore, the activation order is the order of the virtual machines Z, Y, and X. Also, the default number of each virtual machine is read. The procedure execution unit 153b activates the virtual machine according to the determined activation order.

  First, the procedure execution unit 153b reads and executes the virtual machine Z activation script included in the migration destination procedure in order to activate the virtual machine Z first. The procedure execution unit 153b transmits a virtual machine Z activation instruction to the cloud front-end device 3b according to the virtual machine Z activation script (step S310). In this virtual machine activation instruction, the default number “1” of the virtual machines Z is set as the activation number. The procedure execution unit 153b waits until communication with the virtual machine Z becomes possible after transmitting the instruction to start the virtual machine Z.

  When the cloud front-end device 3b receives an instruction to start the virtual machine Z, the cloud front-end device 3b selects the virtualization device 5b to start the virtual machine Z and assigns an IP address to the virtual machine Z. The cloud front-end device 3b transmits an instruction to start the virtual machine Z and the assigned IP address to the selected virtualization device 5b, and notifies the cloud cooperation management device 1b of the assigned IP address. The virtualization apparatus 5b that has received the activation instruction and the IP address of the virtual machine Z activates the virtual machine Z and sets the received IP address in the activated virtual machine Z, then the activation notification set with the IP address as the transmission source. The signal is transmitted by broadcasting or the like (step S315). When the procedure execution unit 153b of the cloud cooperation management device 1b receives the activation notification signal in which the IP address received from the cloud front-end device 3b is set as the transmission source (step S320), the procedure execution unit 153b in the storage unit 11b identified in step S305 The IP address of the virtual machine Z and the number of activated virtual machines Z are written in the host system configuration information.

Next, the procedure execution unit 153b transmits an external storage allocation instruction to the cloud front-end device 3b according to the virtual machine Z startup script (step S325). The cloud front-end device 3b transmits an instruction to allocate the external storage to the virtual machine Z to the virtualization device 5b that has started the virtual machine Z, and the virtualization device 5b that has received the instruction sends the instruction to the virtual machine Z. Allocate external storage.
Further, the procedure execution unit 153b transmits an external storage installation instruction to the virtual machine Z with the received IP address of the virtual machine as a destination in accordance with the virtual machine Z startup script (step S330). Storage attachment is executed (step S335).
Subsequently, the procedure execution unit 153b transmits a service δ activation instruction to the virtual machine Z according to the virtual machine Z activation script (step S340), and the agent of the virtual machine Z activates the service δ (step S345).

When the execution of the virtual machine Z activation script is finished, the procedure execution unit 153b of the cloud cooperation management device 1b reads out and executes the virtual machine Y activation script included in the migration destination procedure.
The procedure execution unit 153b transmits an instruction to start the virtual machine Y to the cloud front end device 3b according to the virtual machine Y start script (step S350). In this virtual machine activation instruction, the default number “2” of virtual machines Y is set as the activation number. After the procedure execution unit 153b transmits an instruction to start the virtual machine Y, the procedure execution unit 153b waits until communication with the virtual machine Y becomes possible.

  When the cloud front-end device 3b receives the activation instruction for the virtual machine Y, the cloud front-end device 3b selects the virtualization devices 5b that should activate the virtual machines Y for the number of activations, and assigns an IP address to the virtual machine Y. There may be one or two virtualization devices 5b to start the virtual machine Y. The cloud front-end device 3b transmits an instruction to start the virtual machine Y and the assigned IP address to the selected virtualization device 5b, and notifies the assigned IP address to the cloud cooperation management device 1b. The virtualization apparatus 5b that has received the activation instruction and the IP address of the virtual machine Y activates the virtual machine Y and sets the received IP address to the activated virtual machine Y. When the virtual machine Y is activated, the activation notification is set with the IP address as the transmission source. The signal is transmitted by broadcasting or the like (step S355). When the procedure execution unit 153b of the cloud cooperation management device 1b receives an activation notification signal in which the IP address received from the cloud front-end device 3b is set as a transmission source (step S360), the procedure execution unit 153b in the storage unit 11b identified in step S305 The IP address of the virtual machine Y and the number of activated virtual machines Y are written in the host system configuration information.

Next, the procedure execution unit 153b transmits a setting file update instruction for the service γ to the virtual machine Y according to the virtual machine Y start script (step S365). The service γ setting file included in the setting file update instruction includes the IP address of the virtual machine Z acquired in accordance with the variable parameter specification described in the higher-level system configuration information. The agent of the virtual machine Y updates the setting file of the service γ according to the setting file included in the setting file update instruction (step S370).
Subsequently, the procedure execution unit 153b transmits a service γ start instruction to the virtual machine Y according to the virtual machine Y start script (step S375), and the agent of the virtual machine Y starts the service γ (step S380).

In FIG. 19, the procedure execution unit 153 b of the cloud cooperation management device 1 b reads and executes the virtual machine X startup script included in the migration destination procedure when the execution of the virtual machine Y startup script is completed.
The procedure execution unit 153b transmits an instruction to start the virtual machine X to the cloud front end apparatus 3b according to the virtual machine X start script (step S405). In this virtual machine activation instruction, the default number “2” of the virtual machines X is set as the activation number. After the procedure execution unit 153b transmits an instruction to start the virtual machine X, the procedure execution unit 153b waits until communication with the virtual machine X becomes possible.

  When the cloud front-end device 3b receives the activation instruction of the virtual machine X, the cloud front-end device 3b selects the virtualization device 5b that should activate the virtual machines X for the number of activations and assigns an IP address to the virtual machine X. The cloud front-end device 3b transmits an instruction to start the virtual machine X and the assigned IP address to the selected virtualization device 5b, and notifies the cloud cooperation management device 1b of the assigned IP address. The virtualization apparatus 5b that has received the activation instruction and the IP address of the virtual machine X activates the virtual machine X and sets the received IP address in the activated virtual machine X, the activation notification set with the IP address as the transmission source. The signal is transmitted by broadcasting or the like (step S410). When the procedure execution unit 153b of the cloud cooperation management device 1b receives an activation notification signal in which the IP address received from the cloud front-end device 3b is set as a transmission source (step S415), the procedure execution unit 153b in the storage unit 11b identified in step S305 The IP address of the virtual machine X (service α and service β) and the number of activated virtual machines X are written in the host system configuration information.

  Next, the procedure execution unit 153b transmits a setting file update instruction for the service α to the virtual machine X in accordance with the virtual machine X startup script (step S420). The agent of the virtual machine X updates the setting file of the service β according to the setting file included in the received setting file update instruction (step S425). Subsequently, the procedure execution unit 153b transmits a service β start instruction to the virtual machine X according to the virtual machine X start script (step S430), and the agent of the virtual machine X starts the service β (step S435).

  Furthermore, the procedure execution unit 153b transmits a setting file update instruction for the service α to the virtual machine X in accordance with the virtual machine X startup script (step S440). The setting file of the service α included in the setting file update instruction includes the IP address of the virtual machine Y acquired in accordance with the variable parameter specification described in the higher system configuration information. The agent of the virtual machine X updates the setting file of the service α according to the setting file included in the received setting file update instruction (step S445). Subsequently, the procedure execution unit 153b transmits a service α activation instruction to the virtual machine X according to the virtual machine X activation script (step S450), and the agent of the virtual machine X activates the service α (step S455).

  The inter-cloud information update unit 142b of the cloud cooperation management device 1b includes the ID of the cloud cooperation management device 1a and the ID of the upper system W, the IP addresses of the virtual machines X, Y, and Z written in the upper system configuration information, and the update. The number of activated virtual machines X, Y, and Z is transmitted to the other cloud cooperation management apparatus 1 as higher system configuration update information. The inter-cloud information update unit 142 of the other cloud cooperation management device 1 is stored in the storage unit 11 corresponding to the ID of the cloud cooperation management device 1a and the ID of the higher system W by the received higher system configuration update information. Update the higher system update information.

  Subsequently, the procedure execution unit 153b of the cloud cooperation management device 1b performs DNS update according to the migration destination procedure (step S460). The procedure execution unit 153 b outputs a registration instruction for the web address such as the URL of the host system X and the IP address of the virtual machine X to the DNS server 8. The DNS server 8 stores the received web address of the host system X and the IP address of the virtual machine X in association with each other. Thereby, when the DNS server 8 receives the web address of the host system X from the user terminal 9, the DNS server 8 returns the IP address of the virtual machine X.

  Note that the contents of the user-set database used by the host system are usually backed up to a device outside the cloud by some method. Therefore, the setting contents of data stored in the virtual machine operating as a database in the host system are acquired and set from this separately stored backup data.

  In the above procedure, the migration source cloud cooperation management apparatus 1 notifies the migration destination cloud cooperation management apparatus 1 of completion after all virtual machines have stopped, but when the first virtual machine is stopped, the migration destination The cloud cooperation management device 1 may be notified of the end. This is because the provision of the host system in the migration source cloud stops when any of the virtual machines stops.

  In addition to a shortage of resources, the migration procedure can be used when, for example, a catastrophic disaster occurs and all or a wide range of devices that make up the cloud service providing system that provides the host system are damaged. It can be used to recover the host system in the cloud. In such a case, since the notification from the migration source may not be sent to the migration destination cloud, the migration destination procedure of the higher-level system procedure data has passed a predetermined time from the start of waiting for the termination notification from the migration source side, and the termination notification When the wait timer times out, the following procedure is performed.

  The activation procedure and the termination procedure are the same as the migration destination procedure and the migration source procedure in the migration procedure described above, respectively, but the migration destination list is not presented. In addition, the start procedure and the end procedure do not include transmission / reception of notifications between clouds in the migration destination procedure and the migration source procedure and notification waiting procedures between clouds.

  The cloud front-end device 3 may assign two IP addresses, an outward IP address and an inward IP address, to one virtual machine. In this case, the configuration control unit 15 of the cloud cooperation management device 1 registers the outgoing IP address in the DNS server 8 and notifies the other virtual machines of the incoming IP address. As a result, the user terminal 9 accesses the cloud front-end device 3 using the outgoing IP address notified from the DNS server 8, and converts the outgoing IP address to the inward IP address in the cloud front-end device 3. Sort access from. On the other hand, direct communication is performed between virtual machines using an inward IP address.

  20 and 21 are diagrams illustrating a scale-out procedure between the clouds of the higher system. In the following description, the scale-out source cloud is assumed to be cloud A, the scale-out destination cloud is assumed to be cloud B, and the scale-out target virtual machine is assumed to be a virtual machine P of the host system V composed of virtual machines running in the cloud A. . Since the virtual machine P is distributed processing middleware and interacts with other virtual machines P, each virtual machine P needs the IP address of the other virtual machine P.

  In FIG. 20, the management IF unit 12a of the cloud cooperation management device 1a belonging to the cloud A receives a command including the inter-cloud scale-out instruction and the ID of the host system V that performs the scale-out, and sends it to the configuration control unit 15a. Output (step S505). The list presentation unit 151a of the configuration control unit 15a specifies the related higher system configuration information stored in the storage unit 11a by using the ID of the higher system V set in the command as a key, and the specified related higher system configuration information The ID of the cloud cooperation management device 1 of another cloud that can be a scale-out destination is read out. The list presenting unit 151a uses the read list of IDs of the other cloud cooperation management devices 1 or the list of cloud names specified by the IDs of these other cloud cooperation management devices 1 as scale-out destination candidate information. To 12a. The management IF unit 12a outputs the scale-out destination candidate information received from the list presenting unit 151a to the display (step S510). When a priority is added to the ID of the read other cloud cooperation management apparatus 1, information on the priority of each scale-out destination cloud is also output, such as displaying in order of priority.

  The user selects the scale-out destination cloud B from the output scale-out destination candidate information, inputs the cloud selection information for specifying the selected cloud B, and the virtual machine P to be scaled out and the cloud A The number of additional activations of the virtual machine P and the number of activations of the virtual machine P in the cloud B are input. The management IF unit 12a of the cloud cooperation management device 1a outputs the input information to the configuration control unit 15a as scale-out instruction information (step S515).

  The instruction output unit 152a of the configuration control unit 15a outputs the ID of the host system V, the scale-out instruction information, and the execution instruction for the scale-out source procedure to the procedure execution unit 153a (step S520). Further, when the instruction output unit 152a detects that the cloud B is selected by the cloud selection information in the scale-out instruction information, the instruction output unit 152a uses the ID of the cloud cooperation management device 1b belonging to the cloud B as a key to check the cloud from other cloud information. The IP address of the cooperation management device 1b is read out. The instruction output unit 152a transmits the ID of the host system V, the ID of the own cloud cooperation management device 1a, and the execution instruction of the scale-out destination procedure with the read IP address as the destination (step S525). The scale-out destination procedure execution instruction includes the ID of the virtual machine P to be scaled out and the number of virtual machines P activated in the cloud B.

  In the procedure execution unit 153a of the cloud cooperation management device 1a, the ID of the higher system V is set from the higher system procedure data stored in the storage unit 11a corresponding to the ID of the own cloud cooperation management device 1a. Identify the high-level system procedure data for the scale-out procedure. When the procedure execution unit 153a reads the scale-out source procedure from the identified higher-level system procedure data (step S530), the procedure execution unit 153a starts executing the read scale-out source procedure (step S535). Here, description will be made assuming that the scale-out source procedure is read from the higher-level system procedure data shown in FIG.

  On the other hand, the procedure execution unit 153b of the cloud cooperation management device 1b uses the ID of the host system V and the ID of the cloud cooperation management device 1a transmitted from the cloud cooperation management device 1a via the cooperation IF unit 13b, and the scale-out. An instruction to execute the previous procedure is received. The procedure execution unit 153b of the cloud cooperation management device 1b is a scale in which the ID of the higher system V is set from the higher system procedure data stored in the storage unit 11b corresponding to the ID of the cloud cooperation management device 1a. Identify the upper system procedure data for the out procedure. When the procedure execution unit 153b reads the scale-out destination procedure from the identified higher-level system procedure data (step S540), the procedure execution unit 153b starts executing the read scale-out destination procedure (step S545), and the virtual machine from the scale-out source The activation reception waiting state is entered (step S550). Here, a description will be given assuming that the scale-out destination procedure is read from the higher-level system procedure data shown in FIG.

  In accordance with the scale-out source procedure, the procedure execution unit 153a of the cloud cooperation management device 1a transmits a virtual machine activation start signal to the cloud cooperation management device 1b belonging to the cloud B that is the scale-out destination cloud (step S555).

  In FIG. 21, the procedure execution unit 153a of the cloud cooperation management device 1a transmits an instruction to start the virtual machine P to the cloud front-end device 3a (step S605). In this virtual machine activation instruction, the number of additional activations of the virtual machine P is set. The procedure execution unit 153a waits until communication with the virtual machine P becomes possible after transmitting the instruction to start the virtual machine P.

  The cloud front-end device 3a and the virtualization device 5a perform processing similar to steps S350 to S360 in FIG. 18 (steps S610 and S615). That is, the cloud front-end device 3a transmits the virtual machine P start instruction and the assigned IP address to the virtualization device 5a selected as the target for starting the virtual machine P, and also sends the assigned IP address to the cloud Notify the cooperation management device 1a. The virtualization device 5a activates the virtual machine P, sets the received IP address, and transmits an activation notification signal. When the procedure execution unit 153a of the cloud cooperation management device 1a receives the activation notification signal, the procedure execution unit 153a associates the ID of the higher system V with the ID of the higher system V and stores the IP of the virtual machine P in the higher system configuration information of the own cloud. Write the address and update the number of boots. The inter-cloud information update unit 142a notifies the other cloud cooperation management device 1 of the ID of the cloud cooperation management device 1a and the ID of the host system V, the IP address of the virtual machine P, and the number of activated devices. The inter-cloud information update unit 142 of another cloud cooperation management device 1 including the cloud cooperation management device 1b receives the received virtual machine P in the higher system configuration information corresponding to the ID of the cloud cooperation management device 1a and the ID of the higher system V. Write the IP address and the number of units started.

  When the procedure execution unit 153a notifies the cloud cooperation management device 1b of the completion of virtual machine startup in accordance with the scale-out source procedure (step S620), the procedure execution unit 153a enters a state of waiting for reception of a virtual machine startup completion notification from the scale-out destination.

  On the other hand, in FIG. 20, the procedure execution unit 153b of the cloud cooperation management device 1b is in a state of waiting for a virtual machine activation start signal from the scale-out source according to the scale-out destination procedure. The transmitted virtual machine activation start signal is received (step S560).

  In FIG. 21, the cloud cooperation management device 1b, the cloud front-end device 3b, and the virtualization device 5b are connected to the cloud cooperation management device 1a, the cloud front-end device 3a, and the virtualization device 5a in steps S605 to S615 described above. Similar processing is performed (steps S630 to S645). Thereby, the virtual machine P is started on the virtualization apparatus 5b, and the cloud cooperation management apparatus 1b transmits a virtual machine start-up completion notification to the cloud cooperation management apparatus 1a, and then the virtual machine start-up completion notification from the scale-out source Waiting to receive. In step S645, the procedure execution unit 153b of the cloud cooperation management device 1b associates the ID of the cloud cooperation management device 1a and the ID of the higher system V with the higher system configuration information stored in the storage unit 11b. The IP address of the virtual machine P is written and the number of activated machines is updated. Then, the inter-cloud information update unit 142b notifies the other cloud cooperation management device 1 of the ID of the cloud cooperation management device 1a and the ID of the host system V, and the IP address and the number of activated virtual machines P of the cloud B. The inter-cloud information update unit 142 of another cloud cooperation management device 1 including the cloud cooperation management device 1a receives the received virtual machine P in the higher system configuration information corresponding to the ID of the cloud cooperation management device 1a and the ID of the higher system V. Write the IP address and the number of units started.

  When the procedure execution unit 153a of the cloud cooperation management device 1a receives the virtual machine start-up completion notification from the scale-out destination cloud cooperation management device 1b, it follows the scale-out source procedure to the virtual machine Q on which the virtual machine P depends. A setting file update instruction for the service ζ is transmitted to the service ζ (step S655). The setting file of the service ζ included in the setting file update instruction includes the IP addresses of all virtual machines P acquired from the host system configuration information, that is, the virtual machines P activated in the cloud A and the cloud B. The agent of the virtual machine Q updates the setting file of the service ζ held therein according to the setting file included in the received setting file update instruction (step S660).

Subsequently, the procedure execution unit 153a of the cloud cooperation management device 1a transmits a setting file update instruction for the service ε to the virtual machine P in accordance with the scale-out source procedure (step S665). The setting file of the service ε included in the setting file update instruction includes the IP address of the virtual machine Q and the IP addresses of all the virtual machines P acquired from the higher system configuration information. The agent of the virtual machine P updates the setting file of the service ε held therein in accordance with the setting file included in the received setting file update instruction (step S670).
When the procedure execution unit 153a notifies the cloud cooperation management device 1b of setting completion of the scale-out source according to the scale-out source procedure, the procedure execution unit 153a enters a setting completion reception waiting state from the scale-out destination (step S675).

  Upon receiving the virtual machine startup completion notification from the scale-out destination, the procedure execution unit 153b of the cloud cooperation management device 1b transmits a setting file update instruction for the service ε to the virtual machine P according to the scale-out destination procedure ( Step S685). The setting file of the service ε included in the setting file update instruction includes the IP address of the virtual machine Q and the IP addresses of all the virtual machines P acquired from the higher system configuration information. The agent of the virtual machine P updates the setting file of the service ε held therein in accordance with the setting file included in the received setting file update instruction (step S690).

  In accordance with the scale-out destination procedure, the procedure execution unit 153b notifies the cloud cooperation management device 1a of the completion of setting of the scale-out source, and ends the scale-out destination procedure (step S695).

  Then, upon receiving the setting completion notification from the scale-out destination, the procedure execution unit 153a of the cloud cooperation management device 1a stops the service including the subordinate virtual machine P for the virtual machine Q according to the scale-out source procedure. An instruction is transmitted (step S700). The agent of the virtual machine Q instructs all the virtual machines P to stop the service using the address of the virtual machine P described in the setting file of the service ζ, and further stops the service ζ in the virtual machine Q. To do. The virtual machine P stops the service ε (step S705).

  Thereafter, the procedure execution unit 153a of the cloud cooperation management device 1a transmits a service activation instruction including the subordinate virtual machine P to the virtual machine Q in accordance with the scale-out source procedure (step S710). The agent of the virtual machine Q instructs all the virtual machines P to start the service, and further starts the service ζ in the virtual machine Q. The virtual machine P activates the service ε (step S715).

  In the above procedure, based on the cloud selection information, scale-out instruction information, etc. input by the user, the instruction output unit 152a of the cloud cooperation management device 1a transfers to the procedure execution unit 153b of the cloud cooperation management device 1b. The execution instruction of the pre-procedure and the execution instruction of the scale-out pre-procedure are output. However, as another embodiment, for example, the management IF 12b of the cloud cooperation management device 1b includes an input unit provided in the cloud cooperation management device 1b, Or you may receive the instruction | indication input by the user directly from the other apparatus connected via the network 7, and may instruct | indicate execution of the migration destination procedure between scales and a scale-out destination procedure to the procedure execution part 153b.

  The inter-cloud resource cooperation system of the present embodiment described above has the following characteristics.

(1) It is possible to describe, exchange and execute the procedures of the host system.
The inter-cloud resource cooperation system exchanges and executes upper system procedure data describing a procedure unique to the upper system between the clouds. The procedure describes the dynamic information of the host system, that is, the start and stop of the virtual machine and service, the setting change, and the like, and describes the operation in each cloud.

(2) Description and exchange of configuration information of the host system is possible.
The inter-cloud resource cooperation system exchanges upper system configuration information describing the configuration of the upper system between clouds. This higher-level system configuration information is static information of the higher-level system, that is, service allocation to the virtual machine, necessary hardware specifications, basic network settings, etc. Become.

(3) Updates related to the configuration of the host system can be exchanged.
The inter-cloud resource linkage system regularly exchanges the higher system configuration information, and if there is an update, notifies the update contents, so that update information such as changes to the configuration of the upper system is exchanged between clouds. Is possible.

  As described above, even when a higher system is migrated between clouds, unlike existing redundancy systems (which do not use a cloud), it is not necessary to make a separate capital investment. It is also possible to present to the user a migration destination cloud for migration due to resource shortage and a cloud that can recover a cloud system that has failed due to a catastrophic disaster or the like. In this case, as the index for selecting the migration destination (recovery destination), the type of virtual machine, the type of OS or application that can run on the virtual machine, the availability of CPU or disk, the charge, etc. can be used. Then, after the migration destination (recovery destination) cloud is determined, recovery processing is performed.

Further, the inter-cloud resource cooperation system of the present embodiment can be scaled out across the clouds.
In this case, the cloud cooperation management apparatus determines which virtual machine is to be scaled out based on the host system configuration information described in advance by the user. In addition, it is possible to flexibly change the description conditions of the higher-level system configuration information at that time, such as whether scale-out is possible or not, and the dependency when scale-out is performed (change of the setting condition to refer to the scale-out destination instance). it can. Also, the scale-out destination cloud cooperation management apparatus reads the upper system procedure data and executes scale out based on the upper system configuration information. At this time, in order to change the setting based on the dependency relationship between instances, information (IP address / port number, etc.) is exchanged and synchronization processing is exchanged with the scale-out source cloud cooperation management apparatus.

  According to the present embodiment, by interlinking a plurality of clouds, it is possible to improve interoperability and ease of migration between the plurality of clouds. Specific usage examples include inter-cloud migration that restores higher systems in another cloud in the event of a resource shortage or failure in the cloud, or a scale-out that expands the system using resources in another cloud when there is a shortage of resources in the cloud. be able to.

  The cloud cooperation management device 1, the cloud front-end device 3, the virtualization device 5, the DNS server 8, and the user terminal 9 described above have a computer system therein. The operation process of the configuration management unit 14 and the configuration control unit 15, the cloud front-end device 3, the virtualization device 5, the DNS server 8, and the user terminal 9 of the cloud cooperation management device 1 is computer-readable in the form of a program. The above processing is performed by the computer system reading and executing this program stored in a recording medium. The computer system here includes a CPU, various memories, an OS, and hardware such as peripheral devices.

Further, the “computer system” includes a homepage providing environment (or display environment) if a WWW system is used.
The “computer-readable recording medium” refers to a storage device such as a flexible medium, a magneto-optical disk, a portable medium such as a ROM and a CD-ROM, and a hard disk incorporated in a computer system. Furthermore, the “computer-readable recording medium” dynamically holds a program for a short time like a communication line when transmitting a program via a network such as the Internet or a communication line such as a telephone line. In this case, a volatile memory in a computer system serving as a server or a client in that case, and a program that holds a program for a certain period of time are also included. The program may be a program for realizing a part of the functions described above, and may be a program capable of realizing the functions described above in combination with a program already recorded in a computer system.

  The present invention is not limited to the embodiment described above, and various modifications can be made without departing from the spirit of the present invention, and it goes without saying that these are also included in the scope of the present invention. Yes.

DESCRIPTION OF SYMBOLS 1 ... Cloud cooperation management apparatus 11 ... Memory | storage part (control source memory | storage part, control destination memory | storage part)
DESCRIPTION OF SYMBOLS 12 ... Management IF part 13 ... Cooperation IF part 14 ... Configuration management part 141 ... In-cloud information update part 142 ... Inter-cloud information update part (Control source inter-cloud information update part, Control destination inter-cloud information update part)
143 ... Related upper system information update unit 15 ... Configuration control unit 151 ... List presentation unit 152 ... Instruction output unit 153 ... Procedure execution unit (control source procedure execution unit, control destination procedure execution unit)
DESCRIPTION OF SYMBOLS 16 ... Cloud operation IF part 17 ... Virtual machine operation IF part 3 ... Cloud front-end apparatus 5 ... Virtualization apparatus 8 ... DNS server 9 ... User terminal

Claims (8)

A resource cooperation system formed by connecting a plurality of cloud systems having a virtualization apparatus and a cloud cooperation management apparatus via a network,
The cloud cooperation management device of the resource control source
A control-source storage unit that stores host system procedure data indicating a procedure for stopping or starting a virtual machine constituting the host system;
A control source inter-cloud information update unit that transmits the higher-level system procedure data stored in the control source storage unit to the other cloud cooperation management device;
An instruction output unit for notifying a resource control target higher-level system to the cloud cooperation management device of the resource control destination;
The host system procedure data corresponding to the host system subject to resource control is read from the control source storage unit, and the virtual machine constituting the host system is automatically determined according to the procedure of the resource control source indicated by the read host system procedure data. A control source procedure execution unit that starts on the virtualization device in the cloud system or stops the virtual machine that configures the host system that is started on the virtualization device in the own cloud system. ,
The cloud cooperation management device of the resource control destination is
A control destination storage unit for storing the upper system procedure data;
A control destination inter-cloud information update unit that receives the host system procedure data from the cloud cooperation management device of the resource control source and writes it in the control destination storage unit;
The higher-level system procedure data stored in the control-destination storage unit is identified by the higher-level system subject to resource control notified from the cloud cooperation management device of the resource control source, and the identified higher-level system procedure data indicates A control-destination procedure execution unit that starts the virtual machine constituting the higher-level system on the virtualization device in its own cloud system according to a resource control-destination procedure;
A resource linkage system characterized by this. The control source storage unit further stores higher system configuration information indicating a configuration of a higher system by a plurality of virtual machines,
The control source inter-cloud information update unit transmits the higher-level system configuration information stored in the control source storage unit to the other cloud cooperation management device,
The control source procedure execution unit should read the higher system configuration information corresponding to the resource control target higher system from the control source storage unit, and stop according to the dependency relationship of the virtual machine indicated by the read higher system configuration information Determine the order of the virtual machines, stop the virtual machine that is activated in the virtualization device in the own cloud according to the determined order,
The inter-control-destination cloud information update unit receives the higher-level system configuration information from the cloud cooperation management device of the resource control source and writes it to the control-destination storage unit,
The control-destination procedure execution unit should read the higher-level system configuration information corresponding to the higher-level system subject to resource control from the control-destination storage unit, and start up according to the virtual machine dependency indicated by the read higher-level system configuration information Determine the order of the virtual machines, and start the virtual machines on the virtualization device in the own cloud according to the determined order;
The resource cooperation system according to claim 1. The first procedure execution unit and the second procedure execution unit set the address information of the activated virtual machine in another virtual machine having a dependency in the higher system,
The resource cooperation system according to claim 1 or 2, characterized by the above. The upper system procedure data includes starting or stopping of the virtual machine constituting the upper system of the resource control target, starting or stopping of a service provided by the virtual machine, updating of a setting file of the service, external storage for the virtual machine Indicates a procedure consisting of one or more of: allocation or deallocation, transmission of notification to the resource control source or resource control destination, and waiting for notification from the resource control source or resource control destination.
The resource cooperation system according to any one of claims 1 to 3, wherein The control source storage unit stores the types of virtual machines that can be activated in the other cloud systems,
The resource control source cloud cooperation management apparatus reads a list of other cloud systems that can start the virtual machine constituting the resource control target higher system from the control source storage unit and outputs a list output unit In addition,
The instruction output unit notifies the resource control target higher system using a cloud cooperation management device of another cloud system selected from the candidates output by the list output unit as a resource control destination.
The resource cooperation system according to any one of claims 1 to 4, wherein the resource cooperation system is characterized in that The control source storage unit stores information on charges of the own cloud system and other cloud systems,
The cloud cooperation management device of the resource control source refers to the information on the charges of the own cloud system and other cloud systems stored in the control source storage unit, and the other cloud system within which the difference between the own cloud system and the charge is within a predetermined range And a list output unit for outputting the selected other cloud system as a resource control destination candidate.
The instruction output unit notifies the resource control target higher system using a cloud cooperation management device of another cloud system selected from the candidates output by the list output unit as a resource control destination.
The resource cooperation system according to any one of claims 1 to 4, wherein the resource cooperation system is characterized in that The cloud cooperation management device
A notification unit that acquires the resource state of the virtualization device in its own cloud system and notifies the cloud cooperation management device of the resource control source,
The cloud control management device of the resource control source includes a list output unit that outputs another cloud system selected based on the resource free state indicated by the resource status received from the other cloud cooperation management device as a resource control destination candidate. In addition,
The instruction output unit notifies the resource control target higher system using a cloud cooperation management device of another cloud system selected from the candidates output by the list output unit as a resource control destination.
The resource cooperation system according to any one of claims 1 to 4, wherein the resource cooperation system is characterized in that A resource cooperation method in a resource cooperation system formed by connecting a plurality of cloud systems having a virtualization device and a cloud cooperation management device via a network,
In the cloud cooperation management device of the resource control source,
The inter-control cloud information update unit reads the upper system procedure data indicating the stop or start procedure of the virtual machine constituting the upper system from the control source storage unit, and transmits it to the other cloud cooperation management device. Information update process,
In the cloud cooperation management device of the resource control destination,
While the control destination inter-cloud information update unit has a control destination inter-cloud information update process that receives the host system procedure data from the cloud cooperation management device of the resource control source and writes it to the control destination storage unit,
In the cloud cooperation management device of the resource control source,
An instruction output unit that notifies a resource control target higher-level system to the cloud cooperation management apparatus that is a resource control destination; and
The control source procedure execution unit reads the higher system procedure data corresponding to the resource control target higher system from the control source storage unit, and determines the higher system according to the resource control source procedure indicated by the read higher system procedure data. Control to start the virtual machine to be configured on the virtualization device in the own cloud system or to stop the virtual machine constituting the upper system that is started to the virtualization device in the own cloud system The original procedure execution process,
In the cloud cooperation management device of the resource control destination,
The control-destination procedure execution unit has identified and identified the higher-level system procedure data stored in the control-destination storage unit by the higher-level system subject to resource control notified from the cloud cooperation management device that is the resource control source A control-destination procedure execution process for starting the virtual machine constituting the higher-level system on the virtualization device in its own cloud system according to the procedure of the resource control destination indicated by the higher-level system procedure data;
A resource linkage method characterized by that.

Images