US9684542B2 - Smart cloud workload balancer - Google Patents
Smart cloud workload balancer Download PDFInfo
- Publication number
- US9684542B2 US9684542B2 US15/153,772 US201615153772A US9684542B2 US 9684542 B2 US9684542 B2 US 9684542B2 US 201615153772 A US201615153772 A US 201615153772A US 9684542 B2 US9684542 B2 US 9684542B2
- Authority
- US
- United States
- Prior art keywords
- physical server
- cloud computing
- computing system
- topology
- odb
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
- G06F9/5005—Allocation of resources, e.g. of the central processing unit [CPU] to service a request
- G06F9/5027—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals
- G06F9/505—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals considering the load
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/21—Design, administration or maintenance of databases
-
- G06F17/30289—
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/455—Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
- G06F9/45533—Hypervisors; Virtual machine monitors
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/455—Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
- G06F9/45533—Hypervisors; Virtual machine monitors
- G06F9/45558—Hypervisor-specific management and integration aspects
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/06—Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
- G06Q10/063—Operations research, analysis or management
- G06Q10/0631—Resource planning, allocation, distributing or scheduling for enterprises or organisations
- G06Q10/06315—Needs-based resource requirements planning or analysis
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/06—Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
- G06Q10/063—Operations research, analysis or management
- G06Q10/0633—Workflow analysis
-
- H04L29/00—
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1001—Protocols in which an application is distributed across nodes in the network for accessing one among a plurality of replicated servers
- H04L67/1004—Server selection for load balancing
- H04L67/1023—Server selection for load balancing based on a hash applied to IP addresses or costs
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1097—Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/455—Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
- G06F9/45533—Hypervisors; Virtual machine monitors
- G06F9/45558—Hypervisor-specific management and integration aspects
- G06F2009/45595—Network integration; Enabling network access in virtual machine instances
Definitions
- the present invention discloses a system and associated method for dynamically optimizing workload distribution in a cloud computing system based on operating cost.
- Conventional workload optimization methods in cloud computing systems use static planning for overall operation. Since software licenses are required to run software application programs that services clients of the cloud computing system, statically planning the number of software licenses in the cloud computing system causes operating cost issues. When the cloud computing system acquires enough number of software licenses to fully utilize all physical servers at all time, the cloud computing system incurs unnecessary additional software license cost. Having too few number of software licenses to reduce extra cost may degrade utilization of the physical servers and performance of the cloud computing system.
- a method for dynamically optimizing workload of a cloud computing system comprises: configuring, by a smart cloud workload balancer (SCWB), the cloud computing system into an operative status by defining a virtual machine (VM) topology representing a respective virtual machine assignment for each physical server of the cloud computing system such that the cloud computing system services workload of the cloud computing system by use of the VM topology, wherein the cloud computing system comprises an objects database (ODB) storing system configuration parameters of: business policies, zero or more physical server availability zones, zero or more physical server restriction zones, zero or more physical server location pools, zero or more software license pools, a respective available licenses per software application in the software license pools, a respective software cost per said software application, a power cost of the cloud computing system, at least one virtual machine (VM), and zero or more installed licenses per VM; determining that the cloud computing system does not perform optimally with respect to a total cost of the cloud computing system based on the system configuration parameters stored in the ODB, wherein said total cost is a
- a computer program product comprises a computer readable memory unit that embodies a computer readable program code.
- the computer readable program code contains instructions that, when run by a processor of a computer system, implement a method for dynamically optimizing workload of a cloud computing system.
- a computer system comprises a processor, a memory coupled to the processor, and a computer readable storage device coupled to the processor, said storage device containing program code configured to be executed by the processor via the memory to implement a method for dynamically optimizing workload of a cloud computing system.
- a process for supporting computer infrastructure comprising providing at least one support service for at least one of creating, integrating, hosting, maintaining, and deploying computer-readable code in a computing system, wherein the code in combination with the computing system is capable of performing a method for dynamically optimizing workload of a cloud computing system.
- FIG. 1 illustrates a cloud computing system for optimizing workload by dynamically reallocating virtual machines of the cloud computing system, in accordance with embodiments of the present invention.
- FIG. 2 illustrates functional components of the smart cloud workload balancer (SCWB) in the cloud computing system of FIG. 1 , in accordance with the embodiments of the present invention.
- SCWB smart cloud workload balancer
- FIG. 3 is a flowchart depicting a method for optimizing workload by dynamically reallocating virtual machines of the cloud computing system, which is performed by the smart cloud workload balancer (SCWB) 13 of FIG. 1 , in accordance with the embodiments of the present invention.
- SCWB smart cloud workload balancer
- FIG. 4 is a flowchart depicting system configuration substeps performed in place of step 100 of FIG. 3 by the system configuration module of the smart cloud workload balancer (SCWB), in accordance with the embodiments of the present invention.
- SCWB smart cloud workload balancer
- FIG. 5 is a flowchart depicting monitoring substeps performed in place of step 200 of FIG. 3 by the monitoring and control module (MC) of the smart cloud workload balancer (SCWB), in accordance with the embodiments of the present invention.
- MC monitoring and control module
- SCWB smart cloud workload balancer
- FIG. 6 is a flowchart depicting maintenance substeps performed in place of step 300 of FIG. 3 by the maintenance module of the smart cloud workload balancer (SCWB) in accordance with the embodiments of the present invention.
- SCWB smart cloud workload balancer
- FIG. 7A is a flowchart depicting optimization substeps performed in place of step 400 of FIG. 3 by the workload optimizer (WO) of the smart cloud workload balancer (SCWB) in accordance with the embodiments of the present invention.
- WO workload optimizer
- SCWB smart cloud workload balancer
- FIG. 7B is a flowchart depicting cost minimization substeps performed in place of step 420 of FIG. 7A by the workload optimizer (WO) of the smart cloud workload balancer (SCWB), in accordance with the embodiments of the present invention.
- WO workload optimizer
- SCWB smart cloud workload balancer
- FIG. 8 is a flowchart depicting reporting substeps performed in place of step 500 of FIG. 3 by the smart cloud workload balancer (SCWB) in accordance with the embodiments of the present invention.
- SCWB smart cloud workload balancer
- FIG. 9 illustrates a computer system used for optimally balancing workload among at least two physical servers of the cloud computing system, in accordance with the embodiments of the present invention.
- FIG. 1 illustrates a cloud computing system 10 for optimizing workload by dynamically reallocating virtual machines of the cloud computing system 10 , in accordance with embodiments of the present invention.
- the cloud computing system 10 comprises an administrator 11 , a configuration management database (CMDB) 12 , a smart cloud workload balancer (SCWB) 13 , an asset management database (AMDB) 16 , a virtual machine and hardware manager (VMM) 17 , and at least two physical servers.
- the CMDB 12 , the SCWB 13 , the AMDB 16 , and the VMM 17 run on a respective generic computer system. See descriptions of FIG. 9 infra for details of a generic computer system.
- An example of the cloud computing system 10 is IBM® Global Technology Services (GTS) infrastructure shared among customers of the IBM GTS, which provides data processing services by use of System x physical servers virtualized by VMware®, and System p physical servers virtualized by PowerVM.
- GTS Global Technology Services
- the administrator 11 is a human user configuring and monitoring operations of the cloud computing system 10 by interacting with the SCWB 13 .
- the administrator 11 sets policies controlling the workload balancing, defines costs for operating the cloud computing system 10 as a sum of electrical power usage and software licensing fees, verifies an ensemble status as to virtual machine assignment for respective physical servers, and creates, deletes, and reconfigures virtual machines in respective physical servers.
- the administrator 11 also receives a performance report in response to a request for the performance report.
- the smart cloud workload balancer (SCWB) 13 performs automated workload optimization over virtual machines of the cloud computing system 10 such that the cloud computing system 10 performs given workload with a minimum cost.
- the SCWB 13 distributes the workload over the virtual machines in a way to minimize the operational costs of the cloud computing system 10 based on technical, availability and software license constraints of the cloud computing system 10 .
- Examples of conventional workload balancing methods in cloud computing systems may be, inter alia, the VMware Distributed Resource Scheduling, the Citrix® Dynamic Workload Balancing, the IBM Systems Director VMControl, etc. (Citrix is a registered trademark of Citrix Systems, Inc.
- the SCWB 13 automatically reconfigures workload of the cloud computing system 10 among virtual machines by utilizing dynamic zoning of physical servers based on policy restriction zones and availability zones for workload balancing and by utilizing multiple sources of performance data, a cost model for software license cost, and an automated workload optimizing method based on the performance data and the cost model.
- the term “physical servers availability zone” is defined as a logical group of physical servers that shares one or more external physical components such as power distribution units, datacenter room, rack, network switches, external storage, etc., such that all physical servers in one availability zone operate atomically but not partially available.
- the term “physical servers restriction zone” is defined as a dynamic logical group of physical servers within a specific physical server availability zone that represents a logical condition such as, inter alia, a group having license to run a specific software program during a specific time period. See description of FIG. 2 , infra, for functional components of the SCWB 13 . See description of FIG. 3 , infra, for steps performed by the SCWB 13 .
- the configuration management database (CMDB) 12 stores information about dependencies between said at least one physical server and virtual machines running on respective physical servers and topology information as to virtual machine assignment for respective physical servers.
- the SCWB 13 updates the CMDB 12 with new topology information resulting from optimization of workload distribution among physical servers.
- VM topology and “topology information” are used interchangeably.
- the cloud computing system 10 further comprises an external integration tool and/or an external cloud automation tool.
- the external integration tool extends the functions of the SCWB 13 by exchanging various data and metadata such as, inter alia, user directories, billing and accounting data, change management data, service request, etc.
- the external integration tool interacts with specific components within the SCWB 13 . See description of FIG. 2 infra for details of the components interfacing the external integration tool.
- the external cloud automation tool receives end user requests and automates provisioning of services in the cloud computing system 10 .
- Examples of the external cloud automation tool may be, inter alia, ITSAM®, EucalyptusTM, etc. (ITSAM is a registered trademark of Expetec Corporation in the United States and/or other countries; Eucalyptus is a trademark of Eucalyptus Systems, Inc., in the United States and/or other countries.)
- the asset management database (AMDB) 16 stores software asset information regarding a number of available software licenses, a number of installed software licenses, etc.
- the administrator 16 provides the asset information of the AMDB 16 by interactive input to the SCWB 13 , wherein the asset information is not stored in the AMDB 16 .
- the virtual machine and hardware manager (VMM) 17 monitors and manages said at least two physical servers and virtual machines running on said physical servers.
- the SCWB 13 interacts with the VMM 17 in receiving performance data of the cloud computing system 10 and electrical power usage information.
- the SCWB 13 automatically controls VM allocation over physical servers by use of the VMM 17 , communicating via, inter alia, hypervisors, VMM application programming interfaces (APIs).
- the VMM 17 receives requests for virtual operations and physical operations from the SCWB 13 and performs adding, moving, deleting, suspending virtual machines to and from respective physical machines, changing configuration of virtual machine assignment for respective physical servers. Examples of the VMM 17 may be, inter alia, the Hardware Management Console (HMC), the VMware vCenter, the Citrix XenCenter, the IBM System Director, etc.
- HMC Hardware Management Console
- VMware vCenter the VMware vCenter
- Citrix XenCenter the IBM System Director
- a physical server 18 of said at least two physical servers is a generic computer system that runs zero or more virtual machines.
- a virtual machine (VM) 19 of said zero or more virtual machines is a software implementation of a computer system that services a portion of workload of the cloud computing system 10 . In servicing the workload, the virtual machine 19 runs various software applications, which is associated with a respective software license cost.
- Overall software license cost of running the software applications in the cloud computing system 10 is calculated based on a respective number of physical or virtual central processing units (CPUs) in each physical server where a virtual machine that performs a software application is running.
- CPUs central processing units
- FIG. 2 illustrates functional components of the smart cloud workload balancer (SCWB) 13 in the cloud computing system 10 of FIG. 1 supra, in accordance with the embodiments of the present invention.
- SCWB smart cloud workload balancer
- the SCWB 13 comprises an objects database (ODB) 21 , a workload optimizer (WO) 22 , a monitoring and control module (MC) 23 , a user interface (UI) 24 , an automated operations application programming interface (AO-API) 25 , a bulk data loader interface (BDLI) 26 , and an automation dispatcher interface (ADI) 27 .
- ODB objects database
- WO workload optimizer
- MC monitoring and control module
- UI user interface
- AO-API automated operations application programming interface
- BDLI bulk data loader interface
- ADI automation dispatcher interface
- the objects database (ODB) 21 stores information necessary for workload optimization over virtual machines (VMs) running on physical servers of the cloud computing system as used by the workload optimizer (WO) 22 .
- the information is gathered from various components of the cloud computing system 10 of FIG. 1 supra.
- the information stored in the ODB 21 comprises policy information, monitoring information, configuration data and asset data.
- the policy information indicates various policy data items stored in the ODB, which define workload balancing policies per inputs provided by the administrator of the cloud computing system.
- the policy data items may be, inter alia, software asset information regarding a number of available software licenses and a number of installed software licenses as buffered from the AMDB 16 of FIG. 1 supra, thresholds of workload per VM and/or physical server, a range of VM relocation frequency permitted in the cloud computing system, a level of compliance to the software license agreement, software license restrictions, VM business priorities, physical servers restriction zones and physical servers availability zones, physical servers location pools, VM affinity rules and VM anti-affinity rules, hardware constrains and power consumption limits, etc.
- the term “physical servers location pool” is defined as a logical group of physical servers hosted by a same data center or a network such that the SCWB prevents a network congestion that may result from high data traffic required between virtual machines running in remote locations by allocating two virtual machines having high communication requirements in a same physical servers location pool.
- the term “VM affinity rule” is defined as a relationship between two virtual machines that perform better when the two VMs run in a same physical server.
- the term “VM anti-affinity rule” is defined as a relationship between two virtual machines that cannot perform in a same physical server.
- the monitoring information indicates various monitoring data items stored in the ODB as collected from the physical servers of the cloud computing system while normal operation processing the workload.
- Examples of the monitoring data items may be, inter alia, respective electrical power consumption of each physical server, resource utilization information for each physical server and VM, wherein the resource comprises processor, memory, and input/output (I/O) data communication channel bandwidth, etc.
- the configuration information indicates various configuration data items stored in the ODB as configured by the administrator and as buffered from the CMDB 12 of FIG. 1 supra.
- Examples of the configuration data items may be, inter alia, virtual machine (VM) configuration and physical server configuration.
- the VM configuration specifies, for each VM, a respective capacity and target performance level for resources of each VM, comprising virtual processors, memory, and network.
- the physical server configuration specifies, for each physical server, a respective number of core processors, a respective amount of memory, CPU performance level relative to other CPU types available in the other physical servers in the cloud computing system, etc.
- the workload optimizer (WO) 22 automatically performs workload optimization by use of linear or quadratic programming based on information retrieved from the ODB 21 such that the WO 22 dynamically decides a optimal workload distribution for virtual machines running in the physical servers of the cloud computing system, wherein the workload distribution improves performance of the cloud computing system as well as meets operation criteria of the cloud computing system as specified by the information from the ODB 21 . See description of step 400 of FIG. 3 infra and FIGS. 7A-7B infra for detailed operations of the WO 22 .
- the monitoring and control module (MC) 23 monitors virtual machines and physical servers of the cloud computing system for hardware constraints and system availability data during normal business operation. See description of step 200 of FIG. 3 infra and FIG. 5 infra for detailed operations of the MC 23 .
- the user interface (UI) 24 enables the administrator of the cloud computing system to interact with the SCWB 13 by providing inputs determining restriction policies and other system configuration information. See description of steps 100 and 500 of FIG. 3 infra for detailed operations of the UI 24 .
- the automated operations application programming interface (AO-API) 25 is an application programming interface (API) used by the external cloud automation tool and/or the external integration tool to interact with the SCWB for system services provided by other components of the cloud computing system 10 of FIG. 1 supra.
- Examples of the system services may be, inter alia, creating a new virtual machine in a physical server, delete an existing virtual machine from a physical server, etc. See description of step 100 of FIG. 3 infra for detailed operations of the AO-API 25 .
- the bulk data loader interface (BDLI) 26 enables database components of the cloud computing system 10 to update the content of the ODB 21 .
- the external integration tool interacts with a bulk data loader interface (BDLI) 26 for data synchronization. See description of step 100 of FIG. 3 infra for detailed operations of the BDLI 26 .
- the automation dispatcher interface (ADI) 27 enables the virtual machine and hardware manager (VMM) 17 of FIG. 1 supra to interact with the SCWB 13 in provisioning, changing, and removing virtual machines, in provisioning a new physical server, and in shutting down an existing physical server. See description of step 400 of FIG. 3 infra for detailed operations of the ADI 27 .
- VMM virtual machine and hardware manager
- the SCWB 13 of the present invention dynamically optimizes workload distribution of virtual machines (VMs) over physical servers in the cloud computing system such that performing the workload in pursuant to an optimized workload distribution minimizes software license cost of the cloud computing system.
- the SCWB 13 takes system information into account in building a software license cost model. See description of the ODB 21 for examples of the system information.
- the software license cost model may differ based on licensing objectives such as licensing per physical machines, licensing per processors, licensing per cores, licensing by sub-capacity differentiation of software costs by processor type, etc.
- the software license cost is calculated based on a number of VMs running a software application subject to a respective software license agreement.
- the SCWB 13 dynamically analyzes the software license cost model and calculates a total cost of cloud computing and generates a new VM topology with minimum total cost subject real-time content of the ODB 21 , as described in FIGS. 7A and 7B infra.
- the SCWB 13 controls management of the cloud computing system, virtual machine assignment and application distribution, interfaces with external data sources and processing components, etc.
- the cloud computing system needs to acquire software licenses for all physical servers in a resource pool to run a specific software application. Including all physical servers in the resource pool is not cost effective in terms of the software license cost since not all physical servers need to run the software application at all time.
- the cloud computing system may limit a number of physical servers in the resource pool by excluding certain physical servers from the resource pool, which limits flexible virtual machine reallocation of the cloud computing system because virtual machines running the software application cannot be allocated on the physical servers that is excluded from the resource pool.
- the workload optimization of the present invention dynamically reallocates any virtual machine to any physical server, which provides flexible and cost-effective workload optimization.
- FIG. 3 is a flowchart depicting a method for optimizing workload by dynamically reallocating virtual machines of the cloud computing system 10 of FIG. 1 supra, which is performed by the smart cloud workload balancer (SCWB) 13 of FIG. 1 , supra, in accordance with the embodiments of the present invention.
- SCWB smart cloud workload balancer
- the SCWB configures the cloud computing system for production/normal operation by use of a first group of functional blocks comprising the user interface (UI) 24 , automated operations application programming interface (AO-API) 25 , and the bulk data loader interface (BDLI) 26 of FIG. 2 supra.
- UI user interface
- AO-API automated operations application programming interface
- BDLI bulk data loader interface
- the first group of functional blocks in the SCWB is referred to as a system configuration module. See description of FIG. 4 , infra, for details of steps performed by the system configuration module for system configuration.
- step 100 the cloud computing system starts production/normal operation, and the SCWB performs steps 200 , 300 , 400 and 500 , concurrently with the production/normal operation, which are respectively associated with either a human trigger provided by the administrator or an automatic trigger given by the cloud computing system.
- step 200 the SCWB monitors performance of the cloud computing system by use of the monitoring and control module (MC) 23 of FIG. 2 supra, and updates content of the ODB with the monitored performance data. See description of FIG. 5 , infra, for details of steps performed by the MC for monitoring performance of the cloud computing system.
- MC monitoring and control module
- step 300 the SCWB performs maintenance operations for the cloud computing system by use of a second group of functional blocks comprising the monitoring and control module (MC) 23 and the automation dispatcher interface (ADI) 27 of FIG. 2 supra.
- the second group of functional blocks in the SCWB is referred to as a maintenance module. See description of FIG. 6 , infra, for details of steps performed by the maintenance module for maintenance of the cloud computing system.
- step 400 the SCWB optimizes workload of virtual machines within the cloud computing system by use of the workload optimizer (WO) 22 of FIG. 2 supra. See description of FIG. 7A , infra, for details of steps performed for workload optimization.
- WO workload optimizer
- step 500 the SCWB reports performance of the cloud computing system based on user request by use of the UI 24 of FIG. 2 supra. See description of FIG. 8 , infra, for details of steps performed for reporting of the cloud computing system.
- FIG. 4 is a flowchart depicting system configuration substeps performed in place of step 100 of FIG. 3 supra by the system configuration module of the smart cloud workload balancer (SCWB), in accordance with the embodiments of the present invention.
- SCWB smart cloud workload balancer
- step 110 the system configuration module identifies virtual machine and hardware manager (VMM) and physical servers of the cloud computing system according to inputs provided by the administrator.
- the system configuration module subsequently updates data items corresponding to the VMM and physical servers stored in the object database (ODB). Then the system configuration module proceeds with step 120 .
- VMM virtual machine and hardware manager
- ODB object database
- step 120 the system configuration module defines business policies of the cloud computing system according to inputs provided by the administrator and updates data items corresponding to the business policies of the ODB. Examples of business policies may be, inter alia, thresholds of virtual machine move frequency, etc. Then the system configuration module proceeds with step 130 .
- the system configuration module defines physical server availability zones, physical servers restriction zones, and physical servers location pools according to inputs provided by the administrator and updates respective data items corresponding to the physical server availability zones, physical servers restriction zones, and physical servers location pools of the ODB.
- Each physical server in the cloud computing system participates in one availability zone and at least one restriction zone. Allocating a virtual machine in a physical server included in a restriction zone of said at least one restriction zone is dynamically managed by the SCWB.
- Each software license constraint is implemented as a respective restrict zone. Multiple restriction zones may exist within a single availability zone. Then the system configuration module proceeds with step 140 .
- step 140 the system configuration module creates software license pools, and respectively defines available licenses and software license cost for each software application within the software license pools according to inputs provided by the administrator.
- the system configuration module subsequently updates data items respectively corresponding to the created software license pools, defined available licenses and software license cost as stored in the object database (ODB). Then the system configuration module proceeds with step 150 .
- ODB object database
- step 150 the system configuration module defines power cost of the cloud computing system according to inputs provided by the administrator, which is defined as a sum of respective electrical power cost for all physical servers of the cloud computing system.
- the system configuration module subsequently updates a data item corresponding to the defined power cost in the ODB. Then the system configuration module proceeds with step 160 .
- step 160 the system configuration module defines and identifies virtual machines (VM) of the cloud computing system according to inputs provided by the administrator.
- the system configuration module subsequently updates data items respectively corresponding to each VM in the ODB. Then the system configuration module proceeds with step 170 .
- VM virtual machines
- step 170 the system configuration module defines installed licenses per virtual machine (VM) according to inputs provided by the administrator.
- the system configuration module subsequently updates data items respectively corresponding to installed license number for each VM in the ODB. Then the system configuration module proceeds with step 180 .
- VM virtual machine
- the system configuration module defines a VM topology, which specifies a respective mapping between each VM and an associated physical machine in which each VM is running according to inputs provided by the administrator.
- the VM topology is also determined by VM affinity rules and VM anti-affinity rules.
- the VM affinity rules define groups of virtual machines that may be allocated in a same physical server, and the VM anti-affinity rules define groups of virtual machines that should not be allocated in a same physical server.
- the system configuration module subsequently updates a data item corresponding to the defined VM topology in the ODB. Then the system configuration module terminates as completing system configuration, and the cloud computing system starts production/normal operation.
- the SCWB proceeds with at least one step selected from steps 200 , 300 , 400 and 500 according to inputs provided by the administrator.
- FIG. 5 is a flowchart depicting monitoring substeps performed in place of step 200 of FIG. 3 supra by the monitoring and control module (MC) of the smart cloud workload balancer (SCWB), in accordance with the embodiments of the present invention.
- MC monitoring and control module
- SCWB smart cloud workload balancer
- the MC performs steps 210 through 260 described below for each monitoring cycle predetermined by the administrator.
- step 210 the MC collects performance data from virtual machines and/or physical servers as the virtual machines process workloads of the cloud computing system during the production/normal operation. Then the MC proceeds with step 220 .
- step 220 the MC determines whether the cloud computing system performs optimally based on the performance data collected in step 210 . If the MC determines that the cloud computing system performs optimally, then the MC proceeds with step 230 for further monitoring. If the MC determines that the cloud computing system does not perform optimally, then the MC proceeds with step 260 . Wherein the performance data from step 210 indicates that the cloud computing system reaches a peak usage of any physical server of that there exist a failed physical server, the MC determines that the cloud computing system does not perform optimally and needs optimization.
- step 230 the MC collects power usage data from each physical server in the cloud computing system during the production/normal operation. Then the MC proceeds with step 240 .
- step 240 the MC monitors real-time availability of the virtual machines and the physical servers. Then the MC proceeds with step 250 .
- step 250 the MC updates objects database (ODB) with data collected in steps 230 and 240 . Then the MC terminates a cycle of monitoring.
- ODB objects database
- step 260 the MC triggers workload optimization by invoking the workload optimizer (WO), step 400 of FIG. 3 supra. Then the MC terminates a cycle of monitoring.
- WO workload optimizer
- FIG. 6 is a flowchart depicting maintenance substeps performed in place of step 300 of FIG. 3 supra by the maintenance module of the smart cloud workload balancer (SCWB) in accordance with the embodiments of the present invention.
- SCWB smart cloud workload balancer
- step 310 the maintenance module changes system/VM configuration parameter values stored in the ODB according to inputs provided by the administrator. See descriptions of the ODB in FIG. 2 supra for specific data items comprising the system configuration parameter. Then the management module proceeds with step 340 .
- the maintenance module manages physical server according to a physical server management operation provided by the administrator, by interacting with the virtual machine and hardware manager (VMM) of the cloud computing system.
- a value of the physical server management operation is selected from ⁇ add, delete, suspend ⁇ , wherein add operation adds a new physical server to a current pool of physical servers and subsequently marks the added physical server as available for running virtual machines, wherein delete operation removes a physical server from the pool and subsequently turns the removed physical server off, and wherein suspend operation temporarily turns off a physical server and marks the physical server as unavailable for running virtual machines.
- the physical server management operations result in updating the ODB. Then the management module proceeds with step 340 .
- the maintenance module manages virtual machines (VMs) according to a VM management operation provided by the administrator, by interacting with the virtual machine and hardware manager (VMM) of the cloud computing system.
- a value of the VM management operation is selected from ⁇ add, delete, suspend ⁇ , wherein add operation instantiates a new virtual machine in a physical server and subsequently marks the new virtual machine as available for running a software application, wherein delete operation removes a virtual machine from a pool of virtual machines, and wherein suspend operation temporarily put a virtual machine in a suspended state such that the virtual machine does not consume any resources, neither the software licenses nor physical resources.
- the VM management operations result in updating the ODB. Then the management module proceeds with step 340 .
- step 340 the maintenance module triggers workload optimization by invoking the workload optimizer (WO). Then the maintenance module terminates and the SCWB proceeds with the WO performing step 400 of FIG. 3 supra.
- WO workload optimizer
- FIG. 7A is a flowchart depicting optimization substeps performed in place of step 400 of FIG. 3 supra by the workload optimizer (WO) of the smart cloud workload balancer (SCWB) in accordance with the embodiments of the present invention.
- WO workload optimizer
- SCWB smart cloud workload balancer
- step 410 the WO retrieves data items necessary for optimization from the objects database (ODB). Then the WO proceeds with step 420 .
- the WO determines a new VM topology by calculating minimum total cost and minimum number of VM relocation.
- the WO employs two-phase calculation using quadratic programming (QP) enabled solvers. See description of FIG. 7B infra for steps performed in determining the new VM topology. Then the WO proceeds with step 430 .
- QP quadratic programming
- step 430 the WO turns on physical servers necessary for the new VM topology as determined in step 420 supra. Then the WO proceeds with step 440 .
- step 440 the WO relocates virtual machines (VM) among physical servers pursuant to the new VM topology. Then the WO proceeds with step 450 .
- VM virtual machines
- step 450 the WO adjusts status information of relocated VMs pursuant to the new VM topology by use of a respective VM management operation selected from ⁇ add, delete, suspend ⁇ . Then the WO proceeds with step 460 .
- step 460 the WO turns off physical servers not used for virtual machines in the new VM topology. Then the WO proceeds with step 470 .
- step 470 the WO updates the ODB with data items reflecting the new VM topology. Then the WO terminates a cycle of workload optimization, and the cloud computing system continues workload production pursuant to the new VM topology.
- FIG. 7B is a flowchart depicting cost minimization substeps performed in place of step 420 of FIG. 7A supra by the workload optimizer (WO) of the smart cloud workload balancer (SCWB), in accordance with the embodiments of the present invention.
- WO workload optimizer
- SCWB smart cloud workload balancer
- the workload optimizer performs steps 4201 and 4202 based on data retrieved from the object database (ODB) of the SCWB.
- Step 4201 and step 4202 is mathematically modeled by use of mathematical optimization techniques such as quadratic programming (QP) and quadratically constrained quadratic program (QCQP), which is implemented by use of a QP and QCQP enabled solver.
- QP quadratic programming
- QQP quadratically constrained quadratic program
- step 4201 the WO minimizes a total cost of cloud computing (TC) for all software running on VMs on each physical servers, as a first phase of the two-phase VM topology calculation, subject to constraints comprising: each VM being associated to only one physical server; a threshold limiting the number of physical relocation; the amount of available resources per physical server; affinity and anti-affinity rule for each pair of two VMs; and amount of software license usage within licensed limit.
- TC minimum total cost
- the objective function of the total cost (TC), as a sum of software cost for all running software and electrical power cost for all running physical servers, is formulated as Formula [A].
- SC s is a respectively predefined unit cost for each software (s)
- SU s,j is a respectively predefined number of software units required to run s-th software (s) in j-th physical server
- IS s,j is a first binary variable that has value one (1) if there exist a VM that runs s-th software (s) in j-th physical server, and that has value zero (0) if there is no such VM
- PC j is a respective constant describing electrical power cost of j-th physical server
- B j is a second binary variable that has value one (1) if j-th physical server is turned on, and that has
- Formula [B] is a first group of constraints and is defined for each i-th VM. It indicates that i-th virtual machine (VM) is associated with j-th physical server, ensuring that each VM is associated with exactly one physical server within the cloud computing system.
- VM virtual machine
- KVM i,j is a third binary parameter representing whether or not j-th physical server enables i-th VM to run that has value one (1) if i-th VM can run on j-th physical server, and that has value zero (0) if i-th VM cannot run on j-th physical server such that a group of physical servers having value one (1) for KVM parameter comprise a physical server availability zone with respect to i-th VM
- VM i,j is a fourth binary variable that has value one (1) if i-th VM will run on j-th physical server after workload optimization, and that has value zero (0) if i-th VM will not run on j-th physical server after workload optimization
- B j is the second binary variable that has value one (1) if j-th physical server is turned on, and that has value zero (0) if j-th physical server is turned off
- Formula [C] is a second group of constraints that is defined respective to i-th VM, which represents a predefined threshold for a number of physical server relocation in one optimization cycle.
- RVM i is a parameter representing a number of relocations i-th VM had gone through in current optimization cycle
- CVM i,j is a binary parameter that has value one (1) if i-th VM currently runs on j-th physical server, and that has value zero (0) if i-th VM does not currently run on j-th physical server
- VM i,j is the fourth binary variable that has value one (1) if i-th VM will run on j-th physical server after workload optimization, and that has value zero (0) if i-th VM will not run on j-th physical server after workload optimization, as defined in Formula [B] supra, and wherein
- Formula [D] is a third group of constraints defined for a respective physical server to ensure amount of memory in the respective physical server is sufficient to run all virtual machines assigned to the respective physical server after optimization.
- VM i,j is the fourth binary variable that has value one (1) if i-th VM will run on j-th physical server after workload optimization, and that has value zero (0) if i-th VM will not run on j-th physical server after workload optimization as defined in Formula [B] supra, wherein M i indicates amount of memory required for i-th VM, and wherein BM j indicates maximum amount of memory usable in j-th physical server.
- Formula [E] is a fourth group of constraints defined for a respective physical server to ensure a number of CPU in the respective physical server is sufficient to run all virtual machines assigned to the respective physical server after optimization.
- VM i,j is the binary variable that has value one (1) if i-th VM will run on j-th physical server after workload optimization, and that has value zero (0) if i-th VM will not run on j-th physical server after workload optimization as defined in Formula [B] supra, wherein C i indicates an amount of CPU capacity/processing power required for i-th VM running in j-th physical server, and wherein BC j indicates a maximum amount of CPU capacity/processing power usable in j-th physical server.
- Formula [F] is a fifth group of constraints defined for a respective physical server to ensure input/output (I/O) capacity in the respective physical server is sufficient to run all virtual machines assigned to the respective physical server after optimization.
- VM i,j is the fourth binary variable that has value one (1) if i-th VM will run on j-th physical server after workload optimization, and that has value zero (0) if i-th VM will not run on j-th physical server after workload optimization as defined in Formula [B] supra, wherein IO i indicates a respective I/O capacity required for i-th VM running in j-th physical server, and wherein BIO j indicates maximum I/O capacity usable in j-th physical server.
- Formula [G] is a sixth group of constraints, defined for each pair of virtual machines that have predefined affinity rules stored in the ODB, to force that said pair of two virtual machines (VM a and VM b ) having the predefined affinity rules run in a same physical server.
- ⁇ j (VM a,j *VM b,j ) 1 [G] wherein VM a,j indicates a first virtual machine (VM a ) running on j-th physical server, and VM b,j indicates a second virtual machine (VM b ) running on j-th physical server as defined in Formula [B] supra.
- Formula [H] is a seventh group of constraints, defined for each pair of virtual machines that have predefined anti-affinity rules stored in the ODB, to avoid that said each pair of virtual machines having the predefined anti-affinity rules run in a same physical server.
- ⁇ j (VM a,j *VM b,j ) 0 [H] wherein VM a,j indicates the first virtual machine (VM a ) running on j-th physical server, and VM b,j indicates the second virtual machine (VM b ) running on j-th physical server, as defined in Formula [B] supra.
- Formulae [I], [J] and [K] are an eighth group of constraints defined for each software to ensure that software licenses are used in compliance with a software license policy respectively associated with each software application.
- IS s,j the first binary variable that has value one (1) if there exist a VM that runs s-th software (s) in j-th physical server, and that has value zero (0) if there is no such VM, as defined in Formula [A] supra
- SU s,j is a parameter indicating a number of software units required to run s-th software (s) in j-th physical server, as defined in Formula [A] supra
- VM i,j is the fourth binary variable that has value one (1) if i-th VM will run on j-th physical server after workload optimization, and that has value zero (0) if i-th VM will not run on j-th physical server after workload optimization, as defined in Formula [B] supra
- SVM i,s is a seventh binary parameter that has value one (1) if i-th VM requires s-th software (s) and that has value zero (0) if i-th VM does not require s-th software
- BigK indicates a constant very larger than estimated number of software licenses required.
- step 4202 the WO maximizes a number of virtual machines that are not relocated from a current physical server after the workload optimization, as the second phase of the two-phase VM topology calculation.
- the WO searches for a minimum number of relocations when taking the TC calculated from the first phase of step 4201 into account. Then the WO terminates the second phase of the two-phase VM topology calculation, and proceeds with step 430 of FIG. 7A , supra.
- the objective function of the second phase is: ⁇ i,j ( C VM i,j *VM i,j ) [L] wherein CVM i,j is the fifth binary variable that has value one (1) if i-th VM currently runs on j-th physical server, and that has value zero (0) if i-th VM does not currently run on j-th physical server, as defined in Formula [C] supra, and wherein VM i,j is the fourth binary variable that has value one (1) if i-th VM will run on j-th physical server after workload optimization, and that has value zero (0) if i-th VM will not run on j-th physical server after workload optimization, as defined in Formula [B] supra, subject to the same constraints from step 4201 and another constraint on acceptable range of relocation cost.
- Formula [M] is another constraint of the second phase to ensure that a new total cost does not significantly vary from the TC calculated in the first phase of step 4201 pursuant to Formula [A].
- TC is the total cost calculated in step 4201 and wherein ACV indicates a predefined number representing acceptable cost variance over the optimized total cost.
- the left term of Formula [M] is distinctive from TC calculated in the first phase by Formula [A] because the WO uses the new objective function represented by Formula [L] in step 4202 to minimize a number of relocations the new VM topology for workload optimization.
- FIG. 8 is a flowchart depicting reporting substeps performed in place of step 500 of FIG. 3 supra by the smart cloud workload balancer (SCWB) in accordance with the embodiments of the present invention.
- SCWB smart cloud workload balancer
- step 510 the WO receives a request for report from the admin via the User interface (UI). Then the WO proceeds with step 520 .
- UI User interface
- step 520 the WO configures a report based on the received request from step 510 . Then the WO proceeds with step 530 .
- step 530 the WO extracts data items necessary for the configured report from objects database (ODB) and subsequently generated the configured report. Then the WO proceeds with step 540 .
- ODB objects database
- step 540 the WO communicates the generated report comprising extracted data items to the admin via the UI. Then the WO terminates reporting and the SCWB proceeds with the WO performing another cycle of optimization.
- FIG. 9 illustrates a computer system 90 used for optimizing workload by dynamically reallocating virtual machines of a cloud computing system, in accordance with the embodiments of the present invention.
- the computer system 90 comprises a processor 91 , an input device 92 coupled to the processor 91 , an output device 93 coupled to the processor 91 , and memory devices 94 and 95 each coupled to the processor 91 .
- the computer system 90 represents any type of programmable data processing apparatus.
- the input device 92 is utilized to receive input data 96 into the computer system 90 .
- the input device 92 may be, inter alia, a keyboard, a mouse, a keypad, a touch screen, a scanner, a voice recognition device, a sensor, a network interface card (NIC), a Voice/video over Internet Protocol (VOIP) adapter, a wireless adapter, a telephone adapter, a dedicated circuit adapter, etc.
- the output device 93 is utilized to communicate results generated by the computer program code 97 to a user of the computer system 90 .
- the output device 93 may be, inter alia, a printer, a plotter, a computer screen, a magnetic tape, a removable hard disk, a floppy disk, a NIC, a VOIP adapter, a wireless adapter, a telephone adapter, a dedicated circuit adapter, an audio and/or visual signal generator, a light emitting diode (LED), etc.
- any of the components of the present invention can be deployed, managed, serviced, etc. by a service provider that offers to deploy or integrate computing infrastructure with respect to a process for optimizing workload by dynamically reallocating virtual machines of the cloud computing system of the present invention.
- the present invention discloses a process for supporting computer infrastructure, comprising integrating, hosting, maintaining and deploying computer-readable code into a computing system (e.g., computing system 90 ), wherein the code in combination with the computing system is capable of performing a method for optimizing workload by dynamically reallocating virtual machines of the cloud computing system.
- the invention provides a method that performs the process steps of the invention on a subscription, advertising and/or fee basis.
- a service provider such as a Solution Integrator
- the service provider can offer to create, maintain, support, etc., a process for optimizing workload by dynamically reallocating virtual machines of the cloud computing system of the present invention.
- the service provider can create, maintain, support, etc. a computer infrastructure that performs the process steps of the invention for one or more customers.
- the service provider can receive payment from the customer(s) under a subscription and/or fee agreement, and/or the service provider can receive payment from the sale of advertising content to one or more third parties.
- FIG. 9 shows the computer system 90 as a particular configuration of hardware and software
- any configuration of hardware and software may be utilized for the purposes stated supra in conjunction with the particular computer system 90 of FIG. 9 .
- the memory devices 94 and 95 may be portions of a single memory device rather than separate memory devices.
- aspects of the present invention may be embodied as a system, method or computer program product. Accordingly, aspects of the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment (including firmware, resident software, micro-code, etc.) or an embodiment combining software and hardware aspects that may all generally be referred to herein as a “circuit,” “module” or “system.” Furthermore, aspects of the present invention may take the form of a computer program product embodied in one or more computer readable medium(s) having computer readable program code embodied thereon.
- the computer readable medium may be a computer readable signal medium or a computer readable storage medium.
- the term “memory device” 94 , 95 represent a computer readable storage medium.
- a computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing.
- a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.
- a computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof.
- a computer readable signal medium may be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.
- Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, radio frequency (RF), etc., or any suitable combination of the foregoing.
- any appropriate medium including but not limited to wireless, wireline, optical fiber cable, radio frequency (RF), etc., or any suitable combination of the foregoing.
- Computer program code 97 for carrying out operations for aspects of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, Smalltalk, C++ or the like and conventional procedural programming languages, such as the “C” programming language or similar programming languages.
- the computer program code 97 may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server.
- the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet Service Provider).
- LAN local area network
- WAN wide area network
- Internet Service Provider for example, AT&T, MCI, Sprint, EarthLink, MSN, GTE, etc.
- These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks.
- These computer program instructions may also be stored in a computer readable storage medium that can direct a computer, other programmable data processing apparatus, or other devices to function in a particular manner, such that the instructions stored in the computer readable storage medium produce an article of manufacture including instructions which implement the function/act specified in the flowchart and/or block diagram block or blocks.
- the computer program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other devices to cause a series of operational steps to be performed on the computer, other programmable apparatus or other devices to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide processes for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks.
- each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s).
- the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved.
Landscapes
- Engineering & Computer Science (AREA)
- Business, Economics & Management (AREA)
- Human Resources & Organizations (AREA)
- Theoretical Computer Science (AREA)
- Software Systems (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Strategic Management (AREA)
- Entrepreneurship & Innovation (AREA)
- Economics (AREA)
- General Engineering & Computer Science (AREA)
- Marketing (AREA)
- Operations Research (AREA)
- General Business, Economics & Management (AREA)
- Educational Administration (AREA)
- Tourism & Hospitality (AREA)
- Game Theory and Decision Science (AREA)
- Quality & Reliability (AREA)
- Development Economics (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Databases & Information Systems (AREA)
- Data Mining & Analysis (AREA)
- Computer Security & Cryptography (AREA)
- Stored Programmes (AREA)
- Power Sources (AREA)
- Debugging And Monitoring (AREA)
Abstract
Description
Σs(SC s*Σj(SU s,j *IS s,j))+Σj(PC j *B j) [A]
wherein SCs is a respectively predefined unit cost for each software (s), wherein SUs,j is a respectively predefined number of software units required to run s-th software (s) in j-th physical server, wherein ISs,j is a first binary variable that has value one (1) if there exist a VM that runs s-th software (s) in j-th physical server, and that has value zero (0) if there is no such VM, wherein PCj is a respective constant describing electrical power cost of j-th physical server, and wherein Bj is a second binary variable that has value one (1) if j-th physical server is turned on, and that has value zero (0) if j-th physical server is turned off.
Σj KVMi,j*VMi,j *B j=1 [B]
wherein KVMi,j is a third binary parameter representing whether or not j-th physical server enables i-th VM to run that has value one (1) if i-th VM can run on j-th physical server, and that has value zero (0) if i-th VM cannot run on j-th physical server such that a group of physical servers having value one (1) for KVM parameter comprise a physical server availability zone with respect to i-th VM, wherein VMi,j is a fourth binary variable that has value one (1) if i-th VM will run on j-th physical server after workload optimization, and that has value zero (0) if i-th VM will not run on j-th physical server after workload optimization, and wherein Bj is the second binary variable that has value one (1) if j-th physical server is turned on, and that has value zero (0) if j-th physical server is turned off as defined in Formula [A] supra.
RVMi+(1−Σj(CVMi,j*VMi,j))≦MRVMi [C]
wherein RVMi is a parameter representing a number of relocations i-th VM had gone through in current optimization cycle, wherein CVMi,j is a binary parameter that has value one (1) if i-th VM currently runs on j-th physical server, and that has value zero (0) if i-th VM does not currently run on j-th physical server, wherein VMi,j is the fourth binary variable that has value one (1) if i-th VM will run on j-th physical server after workload optimization, and that has value zero (0) if i-th VM will not run on j-th physical server after workload optimization, as defined in Formula [B] supra, and wherein MRVMi is a predefined maximum number of relocations allowed for i-th VM in a current optimization cycle.
Σi(VMi,j *M i)≦BM j [D]
wherein VMi,j is the fourth binary variable that has value one (1) if i-th VM will run on j-th physical server after workload optimization, and that has value zero (0) if i-th VM will not run on j-th physical server after workload optimization as defined in Formula [B] supra, wherein Mi indicates amount of memory required for i-th VM, and wherein BMj indicates maximum amount of memory usable in j-th physical server.
Σi(VMi,j *C i)≦BC j [E]
wherein VMi,j is the binary variable that has value one (1) if i-th VM will run on j-th physical server after workload optimization, and that has value zero (0) if i-th VM will not run on j-th physical server after workload optimization as defined in Formula [B] supra, wherein Ci indicates an amount of CPU capacity/processing power required for i-th VM running in j-th physical server, and wherein BCj indicates a maximum amount of CPU capacity/processing power usable in j-th physical server.
Σi(VMi,j *IO i)≦BIO j [F]
wherein VMi,j is the fourth binary variable that has value one (1) if i-th VM will run on j-th physical server after workload optimization, and that has value zero (0) if i-th VM will not run on j-th physical server after workload optimization as defined in Formula [B] supra, wherein IOi indicates a respective I/O capacity required for i-th VM running in j-th physical server, and wherein BIOj indicates maximum I/O capacity usable in j-th physical server.
Σj(VMa,j*VMb,j)=1 [G]
wherein VMa,j indicates a first virtual machine (VMa) running on j-th physical server, and VMb,j indicates a second virtual machine (VMb) running on j-th physical server as defined in Formula [B] supra.
Σj(VMa,j*VMb,j)=0 [H]
wherein VMa,j indicates the first virtual machine (VMa) running on j-th physical server, and VMb,j indicates the second virtual machine (VMb) running on j-th physical server, as defined in Formula [B] supra.
Σj(IS s,j *SU s,j)≦L s*(1+LCP s) [I]
Σi(VMi,j *SVMi,s)≦BigK*IS s,j [J]
IS s,j≦Σi(VMi,j *SVMi,s) [K]
wherein ISs,j the first binary variable that has value one (1) if there exist a VM that runs s-th software (s) in j-th physical server, and that has value zero (0) if there is no such VM, as defined in Formula [A] supra, wherein SUs,j is a parameter indicating a number of software units required to run s-th software (s) in j-th physical server, as defined in Formula [A] supra, wherein Ls indicates a respective total number of available software license units for s-th software (s), and wherein LCPs is a parameter that has value zero (0) if the software license agreement is strictly followed and the administrator does not permit additional number of software license units than the current total number of available license units, and that has value larger than zero (>0) if the administrator may authorizes to use more software licenses than the current total number of available license units for s-th software (s)
Σi,j(CVMi,j*VMi,j) [L]
wherein CVMi,j is the fifth binary variable that has value one (1) if i-th VM currently runs on j-th physical server, and that has value zero (0) if i-th VM does not currently run on j-th physical server, as defined in Formula [C] supra, and wherein VMi,j is the fourth binary variable that has value one (1) if i-th VM will run on j-th physical server after workload optimization, and that has value zero (0) if i-th VM will not run on j-th physical server after workload optimization, as defined in Formula [B] supra, subject to the same constraints from
Σs(SC s*Σj(SU s,j *IS s,j))+Σj(PC j *B j)≦TC*(1+ACV) [M]
wherein TC is the total cost calculated in
Claims (19)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US15/153,772 US9684542B2 (en) | 2011-08-08 | 2016-05-13 | Smart cloud workload balancer |
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US13/204,858 US8909785B2 (en) | 2011-08-08 | 2011-08-08 | Smart cloud workload balancer |
US14/531,068 US9373096B2 (en) | 2011-08-08 | 2014-11-03 | Smart cloud workload balancer |
US15/153,772 US9684542B2 (en) | 2011-08-08 | 2016-05-13 | Smart cloud workload balancer |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US14/531,068 Continuation US9373096B2 (en) | 2011-08-08 | 2014-11-03 | Smart cloud workload balancer |
Publications (2)
Publication Number | Publication Date |
---|---|
US20160253211A1 US20160253211A1 (en) | 2016-09-01 |
US9684542B2 true US9684542B2 (en) | 2017-06-20 |
Family
ID=47678244
Family Applications (3)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US13/204,858 Active 2032-07-17 US8909785B2 (en) | 2011-08-08 | 2011-08-08 | Smart cloud workload balancer |
US14/531,068 Expired - Fee Related US9373096B2 (en) | 2011-08-08 | 2014-11-03 | Smart cloud workload balancer |
US15/153,772 Active US9684542B2 (en) | 2011-08-08 | 2016-05-13 | Smart cloud workload balancer |
Family Applications Before (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US13/204,858 Active 2032-07-17 US8909785B2 (en) | 2011-08-08 | 2011-08-08 | Smart cloud workload balancer |
US14/531,068 Expired - Fee Related US9373096B2 (en) | 2011-08-08 | 2014-11-03 | Smart cloud workload balancer |
Country Status (1)
Country | Link |
---|---|
US (3) | US8909785B2 (en) |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US10887167B2 (en) | 2018-04-30 | 2021-01-05 | At&T Intellectual Property I, L.P. | Adaptive software-defined storage for cloud storage workloads |
US20220309426A1 (en) * | 2021-03-26 | 2022-09-29 | Lenovo Enterprise Solutions (Singapore) Pte. Ltd. | License orchestrator to most efficiently distribute fee-based licenses |
US20240126843A1 (en) * | 2019-12-02 | 2024-04-18 | Cox Automotive, Inc. | Systems and Methods for Temporary Digital Content Sharing |
Families Citing this family (121)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9471384B2 (en) * | 2012-03-16 | 2016-10-18 | Rackspace Us, Inc. | Method and system for utilizing spare cloud resources |
US9369433B1 (en) * | 2011-03-18 | 2016-06-14 | Zscaler, Inc. | Cloud based social networking policy and compliance systems and methods |
US8909785B2 (en) | 2011-08-08 | 2014-12-09 | International Business Machines Corporation | Smart cloud workload balancer |
DE112011105577T5 (en) * | 2011-08-30 | 2014-05-08 | Hewlett-Packard Development Company, L.P. | Virtual high privilege mode for a system administration request |
WO2013042271A1 (en) * | 2011-09-22 | 2013-03-28 | 富士通株式会社 | Electronic computer system and virtual machine deployment method |
US8782242B2 (en) | 2011-10-13 | 2014-07-15 | Vmware, Inc. | Software application placement using computing resource containers |
US8880930B2 (en) * | 2011-10-13 | 2014-11-04 | Vmware, Inc. | Software application placement based on failure correlation |
US20130117157A1 (en) * | 2011-11-09 | 2013-05-09 | Gravitant, Inc. | Optimally sourcing services in hybrid cloud environments |
US8732291B2 (en) | 2012-01-13 | 2014-05-20 | Accenture Global Services Limited | Performance interference model for managing consolidated workloads in QOS-aware clouds |
US8930542B2 (en) | 2012-01-23 | 2015-01-06 | International Business Machines Corporation | Dynamically building a set of compute nodes to host the user's workload |
US9245096B2 (en) * | 2012-01-24 | 2016-01-26 | International Business Machines Corporation | Software license management in a networked computing environment |
US9100306B2 (en) * | 2012-02-16 | 2015-08-04 | International Business Machines Corporation | Managing cloud services |
JP2013186745A (en) * | 2012-03-08 | 2013-09-19 | Fuji Xerox Co Ltd | Processing system and program |
US9645851B1 (en) * | 2012-03-14 | 2017-05-09 | EMC IP Holding Company, LLC | Automated application protection and reuse using an affinity module |
US8958420B1 (en) * | 2012-03-30 | 2015-02-17 | Juniper Networks, Inc. | Methods and apparatus for virtualizing switch control plane engine |
WO2014000784A1 (en) * | 2012-06-27 | 2014-01-03 | Qatar Foundation | An arrangement configured to allocate network interface resources to a virtual machine |
EP2852889A1 (en) * | 2012-06-27 | 2015-04-01 | Qatar Foundation | An arrangement configured to allocate one or more resources of one or more computing devices to a virtual machine |
US9858095B2 (en) * | 2012-09-17 | 2018-01-02 | International Business Machines Corporation | Dynamic virtual machine resizing in a cloud computing infrastructure |
US9712402B2 (en) * | 2012-10-10 | 2017-07-18 | Alcatel Lucent | Method and apparatus for automated deployment of geographically distributed applications within a cloud |
US9021479B2 (en) * | 2012-10-10 | 2015-04-28 | International Business Machines Corporation | Enforcing machine deployment zoning rules in an automatic provisioning environment |
US9069594B1 (en) * | 2012-12-27 | 2015-06-30 | Emc Corporation | Burst buffer appliance comprising multiple virtual machines |
US10095978B2 (en) * | 2013-01-05 | 2018-10-09 | Microsoft Technology Licensing, Llc | Monitor-mine-manage cycle |
US9184982B2 (en) * | 2013-01-15 | 2015-11-10 | Hewlett-Packard Development Company, L.P. | Balancing the allocation of virtual machines in cloud systems |
US9946527B2 (en) * | 2013-03-15 | 2018-04-17 | Bmc Software, Inc. | Service placement techniques for a cloud datacenter |
US20150156065A1 (en) * | 2013-03-15 | 2015-06-04 | Gravitant, Inc. | Policy management functionality within a cloud service brokerage platform |
US9769675B2 (en) * | 2013-03-15 | 2017-09-19 | Hewlett Packard Enterprise Development Lp | Cloud-based connectivity |
US9338226B2 (en) * | 2013-08-12 | 2016-05-10 | Fred Korangy | Actor system and method for analytics and processing of big data |
EP3044690A4 (en) * | 2013-09-13 | 2017-04-12 | Hewlett-Packard Development Company, L.P. | Intelligent auto-scaling |
US20150081400A1 (en) * | 2013-09-19 | 2015-03-19 | Infosys Limited | Watching ARM |
US20150089062A1 (en) * | 2013-09-25 | 2015-03-26 | Virtual Bridges, Inc. | Methods and systems for dynamically specializing and re-purposing computer servers in an elastically scaling cloud computing infrastructure |
US10291472B2 (en) | 2015-07-29 | 2019-05-14 | AppFormix, Inc. | Assessment of operational states of a computing environment |
US10355997B2 (en) | 2013-09-26 | 2019-07-16 | Appformix Inc. | System and method for improving TCP performance in virtualized environments |
US10581687B2 (en) | 2013-09-26 | 2020-03-03 | Appformix Inc. | Real-time cloud-infrastructure policy implementation and management |
US10936976B2 (en) * | 2013-09-30 | 2021-03-02 | Bmc Software, Inc. | Workload management for license cost optimization |
CN106055381B (en) | 2013-10-23 | 2019-10-22 | 华为技术有限公司 | A kind of method and apparatus creating virtual machine |
US10447538B2 (en) | 2013-10-30 | 2019-10-15 | Micro Focus Llc | Facilitating autonomous computing within a cloud service |
EP3063660A4 (en) | 2013-10-30 | 2017-06-14 | Hewlett-Packard Enterprise Development LP | Execution of a topology |
US10230580B2 (en) | 2013-10-30 | 2019-03-12 | Hewlett Packard Enterprise Development Lp | Management of the lifecycle of a cloud service modeled as a topology |
EP3063663A4 (en) | 2013-10-30 | 2017-04-19 | Hewlett-Packard Enterprise Development LP | Stitching an application model to an infrastructure template |
US10284427B2 (en) | 2013-10-30 | 2019-05-07 | Hewlett Packard Enterprise Development Lp | Managing the lifecycle of a cloud service modeled as topology decorated by a number of policies |
US20160239595A1 (en) * | 2013-10-30 | 2016-08-18 | Hewlett Packard Enterprise Development Lp | Instantiating a topology-based service using a blueprint as input |
EP3063658A4 (en) * | 2013-10-30 | 2017-05-24 | Hewlett-Packard Enterprise Development LP | Realized topology system management database |
EP3063654A4 (en) | 2013-10-30 | 2017-06-21 | Hewlett-Packard Enterprise Development LP | Modifying realized topologies |
WO2015065356A1 (en) | 2013-10-30 | 2015-05-07 | Hewlett-Packard Development Company, L.P. | Topology remediation |
US10230568B2 (en) | 2013-10-30 | 2019-03-12 | Hewlett Packard Enterprise Development Lp | Monitoring a cloud service modeled as a topology |
US9519513B2 (en) | 2013-12-03 | 2016-12-13 | Vmware, Inc. | Methods and apparatus to automatically configure monitoring of a virtual machine |
US9465549B1 (en) * | 2013-12-19 | 2016-10-11 | Emc Corporation | Dynamic allocation of a high-speed memory pool between a cluster file system and a burst buffer appliance |
US10809866B2 (en) | 2013-12-31 | 2020-10-20 | Vmware, Inc. | GUI for creating and managing hosts and virtual machines |
US9678731B2 (en) | 2014-02-26 | 2017-06-13 | Vmware, Inc. | Methods and apparatus to generate a customized application blueprint |
US9432267B2 (en) | 2014-03-12 | 2016-08-30 | International Business Machines Corporation | Software defined infrastructures that encapsulate physical server resources into logical resource pools |
US9858060B2 (en) | 2014-05-09 | 2018-01-02 | International Business Machines Corporation | Automated deployment of a private modular cloud-computing environment |
US9535735B2 (en) | 2014-06-09 | 2017-01-03 | International Business Machines Corporation | Adaptive virtual machine request approver |
US10382279B2 (en) * | 2014-06-30 | 2019-08-13 | Emc Corporation | Dynamically composed compute nodes comprising disaggregated components |
US20150378763A1 (en) | 2014-06-30 | 2015-12-31 | Vmware, Inc. | Methods and apparatus to manage monitoring agents |
JP6365027B2 (en) * | 2014-07-03 | 2018-08-01 | 富士通株式会社 | Allocation program, allocation device, allocation system, and allocation method |
US9280392B1 (en) * | 2014-10-02 | 2016-03-08 | International Business Machines Corporation | Resource substitution and reallocation in a virtual computing environment |
US9367344B2 (en) | 2014-10-08 | 2016-06-14 | Cisco Technology, Inc. | Optimized assignments and/or generation virtual machine for reducer tasks |
EP3007407B1 (en) * | 2014-10-10 | 2018-08-15 | Alcatel Lucent | Configuration method, equipment, system and computer readable medium for determining a new configuration of calculation resources |
US9923954B2 (en) * | 2014-12-16 | 2018-03-20 | International Business Machines Corporation | Virtual fencing gradient to incrementally validate deployed applications directly in production cloud computing environment |
US9886083B2 (en) | 2014-12-19 | 2018-02-06 | International Business Machines Corporation | Event-driven reoptimization of logically-partitioned environment for power management |
US20160191320A1 (en) * | 2014-12-30 | 2016-06-30 | International Business Machines Corporation | Relocating an embedded cloud for fast configuration of a cloud computing environment |
US11182713B2 (en) * | 2015-01-24 | 2021-11-23 | Vmware, Inc. | Methods and systems to optimize operating system license costs in a virtual data center |
US10009278B2 (en) * | 2015-02-09 | 2018-06-26 | Mellanox Technologies, Ltd. | Time-efficient network function virtualization architecture |
US10061864B1 (en) * | 2015-03-27 | 2018-08-28 | EMC IP Holding Company LLC | Method and system for improving datacenter operations utilizing layered information model |
US9846589B2 (en) | 2015-06-04 | 2017-12-19 | Cisco Technology, Inc. | Virtual machine placement optimization with generalized organizational scenarios |
US10848574B2 (en) | 2015-06-11 | 2020-11-24 | Microsoft Technology Licensing, Llc | Computing resource management system |
US10908938B2 (en) * | 2015-06-16 | 2021-02-02 | Vmware, Inc. | Methods and systems to determine application license costs in a virtualized data center for use in virtual machine consolidation |
US9760398B1 (en) * | 2015-06-29 | 2017-09-12 | Amazon Technologies, Inc. | Automatic placement of virtual machine instances |
US10243815B2 (en) * | 2015-06-29 | 2019-03-26 | Vmware, Inc. | Methods and systems to evaluate data center resource allocation costs |
US9992113B2 (en) * | 2015-06-30 | 2018-06-05 | Vmware, Inc. | Virtual network interface controller performance using physical network interface controller receive side scaling offloads |
EP3121997B3 (en) * | 2015-07-20 | 2024-04-10 | Koninklijke KPN N.V. | Service provisioning in a communication network |
US9578351B1 (en) | 2015-08-28 | 2017-02-21 | Accenture Global Services Limited | Generating visualizations for display along with video content |
US9940739B2 (en) | 2015-08-28 | 2018-04-10 | Accenture Global Services Limited | Generating interactively mapped data visualizations |
CN106557399B (en) * | 2015-09-25 | 2019-09-06 | 伊姆西公司 | The method and apparatus of the state of storage cluster for rendering |
FI20155792A (en) | 2015-11-02 | 2017-05-03 | Db Pro Oy | Capacity planning procedure |
JP2017102777A (en) * | 2015-12-03 | 2017-06-08 | 富士通株式会社 | Load distribution processing server, load distribution processing method, and system |
US11803926B2 (en) * | 2015-12-10 | 2023-10-31 | Kyndryl, Inc. | Workload distribution optimizer |
US11650848B2 (en) * | 2016-01-21 | 2023-05-16 | Suse Llc | Allocating resources for network function virtualization |
JP6724436B2 (en) * | 2016-03-11 | 2020-07-15 | オムロン株式会社 | Network system, function setting method and function setting program |
US10243816B2 (en) | 2016-04-18 | 2019-03-26 | International Business Machines Corporation | Automatically optimizing network traffic |
GB2549773B (en) * | 2016-04-28 | 2018-05-16 | Metaswitch Networks Ltd | Configuring host devices |
US10552413B2 (en) * | 2016-05-09 | 2020-02-04 | Sap Se | Database workload capture and replay |
CN109196807B (en) * | 2016-06-01 | 2021-09-24 | 瑞典爱立信有限公司 | Network node and method of operating a network node for resource distribution |
US10616311B2 (en) | 2016-06-03 | 2020-04-07 | At&T Intellectual Property I, L.P. | Facilitating management of communications systems |
US10298702B2 (en) | 2016-07-05 | 2019-05-21 | Sap Se | Parallelized replay of captured database workload |
US20180032361A1 (en) * | 2016-07-29 | 2018-02-01 | Hewlett Packard Enterprise Development Lp | Virtual Machines Deployment in a Cloud |
GB2540902B (en) * | 2016-11-10 | 2017-07-19 | Metaswitch Networks Ltd | Optimising a mapping of virtualised network functions onto physical resources in a network using dependency models |
US10310932B2 (en) | 2017-01-13 | 2019-06-04 | Bank Of America Corporation | Using a concentration risk of a computing resource to define affinity and anti-affinity workloads |
US10592528B2 (en) | 2017-02-27 | 2020-03-17 | Sap Se | Workload capture and replay for replicated database systems |
US10678579B2 (en) * | 2017-03-17 | 2020-06-09 | Vmware, Inc. | Policy based cross-cloud migration |
US10282114B1 (en) * | 2017-03-22 | 2019-05-07 | State Farm Mutual Automobile Insurance Company | System and computer-implemented method for balancing loads across data storage pools |
US11068314B2 (en) * | 2017-03-29 | 2021-07-20 | Juniper Networks, Inc. | Micro-level monitoring, visibility and control of shared resources internal to a processor of a host machine for a virtual environment |
US10868742B2 (en) | 2017-03-29 | 2020-12-15 | Juniper Networks, Inc. | Multi-cluster dashboard for distributed virtualization infrastructure element monitoring and policy control |
US10862952B1 (en) * | 2017-03-30 | 2020-12-08 | Amazon Technologies, Inc. | Migration of operational computing hardware to a data center |
US10169069B2 (en) | 2017-04-06 | 2019-01-01 | International Business Machines Corporation | System level update protection based on VM priority in a multi-tenant cloud environment |
US10469567B2 (en) | 2017-04-14 | 2019-11-05 | At&T Intellectual Property I, L.P. | Model-driven implementation of services on a software-defined network |
US11323327B1 (en) | 2017-04-19 | 2022-05-03 | Juniper Networks, Inc. | Virtualization infrastructure element monitoring and policy control in a cloud environment using profiles |
FR3065554A1 (en) * | 2017-04-21 | 2018-10-26 | Orange | METHOD FOR MANAGING A CLOUD COMPUTING SYSTEM |
CN108205474B (en) * | 2017-08-23 | 2022-03-04 | 珠海市魅族科技有限公司 | Memory management method, terminal device, computer apparatus, and readable storage medium |
KR102297850B1 (en) * | 2017-10-27 | 2021-09-06 | 한국전자통신연구원 | Method and appratus for providing a cloud service based on cloud service brokerage |
US10552188B2 (en) * | 2017-11-01 | 2020-02-04 | Alibaba Group Holding Limited | Virtual private cloud services with physical machine servers and virtual machines |
US10620959B2 (en) | 2017-12-01 | 2020-04-14 | International Business Machines Corporation | Optimized multi-processor instruction scheduler |
US10922141B2 (en) * | 2017-12-11 | 2021-02-16 | Accenture Global Solutions Limited | Prescriptive analytics based committed compute reservation stack for cloud computing resource scheduling |
US10678439B2 (en) * | 2018-04-02 | 2020-06-09 | Micron Technology, Inc. | Optimization of memory systems based on performance goals |
US10698892B2 (en) | 2018-04-10 | 2020-06-30 | Sap Se | Order-independent multi-record hash generation and data filtering |
US10999161B2 (en) * | 2018-04-27 | 2021-05-04 | Comptel Oy | Method and arrangement for licence management in NFV network environment |
US11645237B2 (en) * | 2018-05-10 | 2023-05-09 | International Business Machines Corporation | Replicating data utilizing a virtual file system and cloud storage |
US10789088B2 (en) * | 2018-07-26 | 2020-09-29 | Vmware, Inc. | Peer-to-peer license enforcement in virtualized computing environments |
US11579908B2 (en) | 2018-12-18 | 2023-02-14 | Vmware, Inc. | Containerized workload scheduling |
US11513823B2 (en) * | 2018-12-18 | 2022-11-29 | Servicenow, Inc. | Chat interface for resource management |
US11146592B2 (en) * | 2019-01-16 | 2021-10-12 | Vmware, Inc. | Enforcing universal security policies across data centers |
US11704617B2 (en) * | 2019-06-20 | 2023-07-18 | Stripe, Inc. | Systems and methods for modeling and analysis of infrastructure services provided by cloud services provider systems |
US11144443B2 (en) | 2019-09-09 | 2021-10-12 | Microsoft Technology Licensing, Llc | Optimization of workloads based on constraints |
CN110837417A (en) * | 2019-09-24 | 2020-02-25 | 华为技术有限公司 | Recommendation method and device for cloud system resource set and computing device cluster |
US11709752B2 (en) | 2020-04-02 | 2023-07-25 | Sap Se | Pause and resume in database system workload capture and replay |
US11615012B2 (en) | 2020-04-03 | 2023-03-28 | Sap Se | Preprocessing in database system workload capture and replay |
FR3119067B3 (en) * | 2021-01-20 | 2022-12-23 | Ebos Tech | Flexible provisioning of network slices in a mobile network through a network exposure feature |
US11856052B2 (en) | 2021-02-18 | 2023-12-26 | Jpmorgan Chase Bank, N.A. | System and method for implementing a smart cloud deployment module |
US11522947B1 (en) * | 2021-06-09 | 2022-12-06 | Bank Of America Corporation | System for implementing hybrid cloud computation engines using infrastructure optimization |
CN113254162A (en) * | 2021-07-06 | 2021-08-13 | 云宏信息科技股份有限公司 | Management method for PowerVM virtualization, readable storage medium and cloud management platform |
CN118170522B (en) * | 2024-05-11 | 2024-08-16 | 中移(苏州)软件技术有限公司 | Task scheduling method and device, electronic equipment and readable storage medium |
Citations (18)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2003021396A2 (en) | 2001-09-05 | 2003-03-13 | Protier Corporation | Virtualized logical server cloud |
US20070067433A1 (en) | 2005-09-21 | 2007-03-22 | D Alterio Domenico | Method, system and computer program for hardware inventory in virtualized environments |
US20070271560A1 (en) | 2006-05-18 | 2007-11-22 | Microsoft Corporation | Deploying virtual machine to host based on workload characterizations |
US20080183626A1 (en) | 2007-01-31 | 2008-07-31 | Francisco Romero | Software license agreement management based on temporary usage |
US20090132699A1 (en) | 2007-11-20 | 2009-05-21 | Ratnesh Sharma | Data Center Synthesis |
WO2009070661A1 (en) | 2007-11-27 | 2009-06-04 | Manageiq, Inc. | Automatic optimization for virtual systems |
US20090320020A1 (en) | 2008-06-24 | 2009-12-24 | International Business Machines Corporation | Method and System for Optimising A Virtualisation Environment |
EP2216732A1 (en) | 2009-02-10 | 2010-08-11 | Novell, Inc. | Virtual machine software license management |
US20100293619A1 (en) | 2009-05-13 | 2010-11-18 | Canon Kabushiki Kaisha | License management system and license management method |
US20110099403A1 (en) | 2009-10-26 | 2011-04-28 | Hitachi, Ltd. | Server management apparatus and server management method |
US20110154327A1 (en) | 2009-09-11 | 2011-06-23 | Kozat Ulas C | Method and apparatus for data center automation |
US20110239010A1 (en) | 2010-03-25 | 2011-09-29 | Microsoft Corporation | Managing power provisioning in distributed computing |
US20110307291A1 (en) | 2010-06-14 | 2011-12-15 | Jerome Rolia | Creating a capacity planning scenario |
US20120005505A1 (en) | 2009-03-13 | 2012-01-05 | Tolia Niraj | Determining Status Assignments That Optimize Entity Utilization And Resource Power Consumption |
US8185894B1 (en) | 2008-01-10 | 2012-05-22 | Hewlett-Packard Development Company, L.P. | Training a virtual machine placement controller |
US20120296852A1 (en) | 2011-05-20 | 2012-11-22 | Daniel Juergen Gmach | Determining workload cost |
US8396807B1 (en) | 2009-06-26 | 2013-03-12 | VMTurbo, Inc. | Managing resources in virtualization systems |
US8909785B2 (en) | 2011-08-08 | 2014-12-09 | International Business Machines Corporation | Smart cloud workload balancer |
-
2011
- 2011-08-08 US US13/204,858 patent/US8909785B2/en active Active
-
2014
- 2014-11-03 US US14/531,068 patent/US9373096B2/en not_active Expired - Fee Related
-
2016
- 2016-05-13 US US15/153,772 patent/US9684542B2/en active Active
Patent Citations (19)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2003021396A2 (en) | 2001-09-05 | 2003-03-13 | Protier Corporation | Virtualized logical server cloud |
US20070067433A1 (en) | 2005-09-21 | 2007-03-22 | D Alterio Domenico | Method, system and computer program for hardware inventory in virtualized environments |
US20070271560A1 (en) | 2006-05-18 | 2007-11-22 | Microsoft Corporation | Deploying virtual machine to host based on workload characterizations |
US20080183626A1 (en) | 2007-01-31 | 2008-07-31 | Francisco Romero | Software license agreement management based on temporary usage |
US20090132699A1 (en) | 2007-11-20 | 2009-05-21 | Ratnesh Sharma | Data Center Synthesis |
WO2009070661A1 (en) | 2007-11-27 | 2009-06-04 | Manageiq, Inc. | Automatic optimization for virtual systems |
US8185894B1 (en) | 2008-01-10 | 2012-05-22 | Hewlett-Packard Development Company, L.P. | Training a virtual machine placement controller |
US20090320020A1 (en) | 2008-06-24 | 2009-12-24 | International Business Machines Corporation | Method and System for Optimising A Virtualisation Environment |
EP2216732A1 (en) | 2009-02-10 | 2010-08-11 | Novell, Inc. | Virtual machine software license management |
US20120005505A1 (en) | 2009-03-13 | 2012-01-05 | Tolia Niraj | Determining Status Assignments That Optimize Entity Utilization And Resource Power Consumption |
US20100293619A1 (en) | 2009-05-13 | 2010-11-18 | Canon Kabushiki Kaisha | License management system and license management method |
US8396807B1 (en) | 2009-06-26 | 2013-03-12 | VMTurbo, Inc. | Managing resources in virtualization systems |
US20110154327A1 (en) | 2009-09-11 | 2011-06-23 | Kozat Ulas C | Method and apparatus for data center automation |
US20110099403A1 (en) | 2009-10-26 | 2011-04-28 | Hitachi, Ltd. | Server management apparatus and server management method |
US20110239010A1 (en) | 2010-03-25 | 2011-09-29 | Microsoft Corporation | Managing power provisioning in distributed computing |
US20110307291A1 (en) | 2010-06-14 | 2011-12-15 | Jerome Rolia | Creating a capacity planning scenario |
US20120296852A1 (en) | 2011-05-20 | 2012-11-22 | Daniel Juergen Gmach | Determining workload cost |
US8909785B2 (en) | 2011-08-08 | 2014-12-09 | International Business Machines Corporation | Smart cloud workload balancer |
US20150051942A1 (en) | 2011-08-08 | 2015-02-19 | International Business Machines Corporation | Smart cloud workload balancer |
Non-Patent Citations (14)
Title |
---|
Advisory Action (Jan. 6, 2014) for U.S. Appl. No. 13/204,858, filed Aug. 8, 2011. |
Amendment (Jan. 11, 2016) for U.S. Appl. No. 14/531,068, filed Nov. 3, 2014. |
Amendment (Jul. 24, 2013) for U.S. Appl. No. 13/204,858, filed Aug. 8, 2011. |
Appeal Brief (Mar. 10, 2014) for U.S. Appl. No. 13/204,858, filed Aug. 8, 2011. |
Final Amendment (Dec. 9, 2013) for U.S. Appl. No. 13/204,858, filed Aug. 8, 2011. |
Final Office Action (Oct. 8, 2013) for U.S. Appl. No. 13/204,858, filed Aug. 8, 2011. |
Li et al., Deployment of Services in a Cloud Subject to Memory and License Constraints, 2009 IEEE International Conference on Cloud Computing, 978-0-7695-3840-2/09 DOI 10.1109/CLOUD.2009.62, pp. 33-40. |
Notice of Allowance (Aug. 1, 2014) for U.S. Appl. No. 13/204,858, filed Aug. 8, 2011. |
Notice of Allowance (Mar. 28, 2016) for U.S. Appl. No. 14/531,068, filed Nov. 3, 2014. |
Notice of Appeal (Jan. 8, 2014) for U.S. Appl. No. 13/204,858, filed Aug. 8, 2011. |
Office Action (Apr. 25, 2013) for U.S. Appl. No. 13/204,858, filed Aug. 8, 2011. |
Office Action (Oct. 26, 2015) for U.S. Appl. No. 14/531,068, filed Nov. 3, 2014. |
Publication (Feb. 14, 2013) for U.S. Appl. No. 13/204,858, filed Aug. 8, 2011. |
Schmidt et al., Efficient Distribution of Virtual Machines for Cloud Computing, 2010 18th Euromicro Conference on Parallel, Distributed and Network-based Processing, 1066-6192/10 DOI 10.1109/PDP.2010.39, pp. 567-574. |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US10887167B2 (en) | 2018-04-30 | 2021-01-05 | At&T Intellectual Property I, L.P. | Adaptive software-defined storage for cloud storage workloads |
US20240126843A1 (en) * | 2019-12-02 | 2024-04-18 | Cox Automotive, Inc. | Systems and Methods for Temporary Digital Content Sharing |
US20220309426A1 (en) * | 2021-03-26 | 2022-09-29 | Lenovo Enterprise Solutions (Singapore) Pte. Ltd. | License orchestrator to most efficiently distribute fee-based licenses |
US11593732B2 (en) * | 2021-03-26 | 2023-02-28 | Lenovo Enterprise Solutions (Singapore) Pte. Ltd. | License orchestrator to most efficiently distribute fee-based licenses |
Also Published As
Publication number | Publication date |
---|---|
US20150051942A1 (en) | 2015-02-19 |
US8909785B2 (en) | 2014-12-09 |
US20160253211A1 (en) | 2016-09-01 |
US9373096B2 (en) | 2016-06-21 |
US20130042003A1 (en) | 2013-02-14 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US9684542B2 (en) | Smart cloud workload balancer | |
US12074774B2 (en) | Methods, systems, and apparatus to scale in and/or scale out resources managed by a cloud automation system | |
US9569598B2 (en) | Software license management in a networked computing environment | |
US11200526B2 (en) | Methods and systems to optimize server utilization for a virtual data center | |
Gulati et al. | Vmware distributed resource management: Design, implementation, and lessons learned | |
EP3401787B1 (en) | Analyzing resource utilization of a cloud computing resource in a cloud computing environment | |
US20200097185A1 (en) | Allocation and balancing of storage resources | |
CN102681899B (en) | Virtual computing resource dynamic management system of cloud computing service platform | |
US11508021B2 (en) | Processes and systems that determine sustainability of a virtual infrastructure of a distributed computing system | |
US8739169B2 (en) | Method for monitoring operating experiences of images to improve workload optimization in cloud computing environments | |
US11095530B2 (en) | Service level management of a workload defined environment | |
US10908938B2 (en) | Methods and systems to determine application license costs in a virtualized data center for use in virtual machine consolidation | |
US20130111032A1 (en) | Cloud optimization using workload analysis | |
US20120330700A1 (en) | Application placement among a set of consolidation servers utilizing license cost and application workload profiles as factors | |
US20120204187A1 (en) | Hybrid Cloud Workload Management | |
US9170850B2 (en) | Minimizing workload migrations during cloud maintenance operations | |
US10235473B2 (en) | Methods and systems to allocate logical disk costs to virtual machines in a virtual data center | |
WO2022078060A1 (en) | Tag-driven scheduling of computing resources for function execution | |
US11755359B2 (en) | Methods and apparatus to implement intelligent selection of content items for provisioning | |
US20240303150A1 (en) | Methods and apparatus to improve availability of failed entities | |
Patel et al. | Survey on resource allocation technique in cloud | |
Liyanage | Network bandwidth aware dynamic automated framework for Virtual Machine Live Migration in cloud environments | |
BAUDE | Multi Autonomic Management for Optimizing Energy Consumption in Cloud Infrastructures |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: INTERNATIONAL BUSINESS MACHINES CORPORATION, NEW Y Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:FRANCO, LUCAS G.;LIMA, LUCAS M.;PARRA, ANA B.;AND OTHERS;SIGNING DATES FROM 20140905 TO 20141103;REEL/FRAME:038580/0588 |
|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |
|
MAFP | Maintenance fee payment |
Free format text: PAYMENT OF MAINTENANCE FEE, 4TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1551); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY Year of fee payment: 4 |
|
AS | Assignment |
Owner name: KYNDRYL, INC., NEW YORK Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:INTERNATIONAL BUSINESS MACHINES CORPORATION;REEL/FRAME:057885/0644 Effective date: 20210930 |