JP7160449B2 - Method, system, computer program and recording medium for allocating cloud resources in a cloud computing system based on tiered storage data movement - Google Patents

Description

TECHNICAL FIELD This disclosure relates to cloud computing, and more particularly to management of cloud resources based on tiered storage data movement.

Cloud computing enables ubiquitous access to a shared pool of configurable resources (eg, computer networks, servers, storage, applications and services) that can be rapidly provided programmatically over a network. A computing system that provides cloud computing services can use automated storage tiering to manage data storage in the cloud computing system. Automatic storage tiering is a storage management capability for moving mode data between different storage types (e.g., storage tiers) to optimize storage allocation, e.g., with respect to cost, performance, and storage space. .

Policy-based optimization of cloud resources in tiered storage operations can be provided.

According to an embodiment of the present disclosure, a method for allocating cloud resources in a cloud computing system based on tiered storage data movement provides notification that data movement is initiated by the tiered storage system. sending a request to the tiered storage system to move the data associated with the cloud computing system from the first storage tier to the second storage tier and the notification includes an indication of the conditions for initiating data movement. The method may further include receiving notifications from the tiered storage system. The method may then include using the received notification to identify a hosted computing environment having a volume associated with the data movement. The method may also include determining whether to change the allocation of resources to the hosted computing environment. The method may additionally include changing the allocation of resources to the Hosted Computing Environment in response to the determination to change the allocation of resources to the Hosted Computing Environment.

Viewed from a first aspect, the present invention provides a method for allocating cloud resources in a cloud computing system based on tiered storage data movement, the method comprising: storing data by the tiered storage system; sending a request to a tiered storage system to provide notification that migration is to begin, wherein the data migration moves data associated with the cloud computing system from a first storage tier to a second storage tier; sending a notification including an indication of the conditions for initiating the data movement; receiving the notification from the tiered storage system; and specifying volumes associated with the data movement. using the received notification to identify a Hosted Computing Environment having; determining whether to change the allocation of resources to the Hosted Computing Environment; and changing the allocation of resources to the Hosted Computing Environment in response to the decision to change the allocation of the Hosted Computing Environment.

Desirably, the present invention provides a method, wherein the request includes a criterion for providing notification, the criterion being that a first storage tier has better performance than a second storage tier based on whether

Desirably, the present invention provides a method, wherein the request includes criteria for providing notification, the criteria being based on aggregate characteristics of data movement.

Desirably, the present invention provides a method wherein the collective characteristic is data migration from a storage tier having a first performance level to a storage tier having a second performance level lower than the first performance level. and the frequency of data movement from the storage tier in response to a determination that the storage tier has insufficient storage capacity and the set of hosted computers from the first storage system to the second storage system. and data movement of data associated with the operating environment.

Desirably, the present invention provides a method, wherein the resources include at least one of allocated memory, processing resources, and communication bandwidth.

Desirably, the present invention provides a method wherein changing resource allocation moves a hosted computing environment from a first host computing system to a second host computing system. including doing

Desirably, the present invention provides a method wherein altering resource allocation includes suspending execution of the hosted computing environment.

Preferably, the present invention provides a method, wherein changing the resource allocation includes notifying a user associated with the hosted computing environment to cause the user to change the resource allocation.

Preferably, the present invention provides a method, wherein changing the resource allocation includes notifying a service associated with the hosted computing environment to cause the service to change the resource allocation.

Viewed from a second aspect, the present invention provides a system for allocating cloud resources in a cloud computing system based on tiered storage data movement, said system comprising a memory and a processor. or a plurality of computing nodes and non-transitory computer readable storage media of one or more of the computing nodes embodied with program instructions, the program instructions being data migrated by a tiered storage system. sending a request to the tiered storage system to provide notification that the cloud computing system is about to start moving data associated with the cloud computing system from the first storage tier to the second sending a notification including an indication of the conditions for initiating the data movement; receiving the notification from the tiered storage system; and specifying volumes associated with the data movement. using the received notification to identify a Hosted Computing Environment having; determining whether to change the allocation of resources to the Hosted Computing Environment; and changing the allocation of resources to the hosted computing environment in response to the decision to change the allocation of.

Desirably, the present invention provides a system, wherein the request includes a criterion for providing notification, the criterion being whether the first storage tier has better performance than the second storage tier. based on.

Desirably, the present invention provides a system wherein the request includes criteria for providing notifications, the criteria being based on collective characteristics of data movements.

Desirably, the present invention provides a system wherein the collective characteristic is the rate of data movement from a storage tier having a first performance level to a storage tier having a second performance level lower than the first performance level. A frequency and frequency of data movement from a storage tier in response to a determination that the storage tier has insufficient storage capacity and a set of hosted computing from a first storage system to a second storage system. and data movement of data associated with the environment.

Preferably, the invention provides a system, wherein the resources include at least one of allocated memory, processing resources, and communication bandwidth.

Preferably, the present invention provides a system wherein changing resource allocation moves a hosted computing environment from a first host computing system to a second host computing system Including.

Preferably, the present invention provides a system, wherein changing resource allocation includes suspending execution of the hosted computing environment.

Preferably, the present invention provides a system, wherein changing the resource allocation includes notifying a user associated with the hosted computing environment to cause the user to change the resource allocation.

Preferably, the present invention provides a system wherein changing the resource allocation includes notifying a service associated with the hosted computing environment to cause the service to change the resource allocation.

Viewed from a third aspect, the present invention provides a computer program product for allocating cloud resources in a cloud computing system based on tiered storage data movement, the computer program product comprising program instructions is embodied such that the computer readable storage medium is not the transient signal per se, but the program instructions provide notification that data movement is to be initiated by the tiered storage system sending a request to a tiered storage system, wherein the data movement includes moving data associated with the cloud computing system from a first storage tier to a second storage tier, and the notification is , including an indication of the conditions for initiating the data movement; receiving a notification from the tiered storage system; and a hosted computing environment having volumes associated with the data movement. identifying using the notification; determining whether to change the allocation of resources to the Hosted Computing Environment; and in response to the decision to change the allocation of resources to the Hosted Computing Environment. changing an allocation of resources to the hosted computing environment; and causing the processing circuit to perform a method.

Desirably, the present invention provides a computer program product, wherein the request includes criteria for providing a notification, the criteria indicating that a first storage tier outperformed a second storage tier. Based on whether it has performance.

Other embodiments are directed to systems and computer program products for implementing the methods described herein.

The above summary is not intended to describe each illustrated embodiment or every implementation of the present disclosure.

The drawings included in this application are incorporated into and form a part of this specification. They describe embodiments of the disclosure and, together with the specification, serve to explain the principles of the disclosure. Those drawings merely illustrate certain embodiments and do not limit the disclosure.

FIG. 2 illustrates a cloud computing node according to one embodiment of the invention; 1 illustrates a cloud computing environment according to one embodiment of the invention; FIG. FIG. 4 illustrates an abstract model layer according to one embodiment of the invention; 1 illustrates a sequence of operations for enabling management of cloud resources based on tiered storage data movement, in accordance with various embodiments; FIG. 1 illustrates a series of operations for allocating cloud resources in a cloud computing system based on tiered storage data movement, in accordance with various embodiments; FIG. 1 is a block diagram of an exemplary cloud computing environment using tiered storage, in accordance with various embodiments; FIG. 7 is a block diagram of an exemplary tiered storage system 705, in accordance with various embodiments; FIG. 1 is a block diagram of an exemplary cloud computing system, according to various embodiments; FIG.

While the invention is subject to various modifications and alternative forms, specifics thereof have been shown by way of example in the drawings and will be described in detail. However, it should be understood that it is not intended to limit the invention to particular embodiments described. Rather, the invention is intended to include all modifications, equivalents, and alternatives falling within the spirit and scope of the invention.

Aspects of the present disclosure relate to cloud computing, and more particularly aspects relate to management of cloud resources based on tiered storage data movement. Although the disclosure is not necessarily limited to such applications, various aspects of the disclosure can be understood through discussion of various examples using this context.

A cloud computing system may use a tiered storage system to store blocks of data that implement logical volumes managed by the cloud computing system. A block of data may represent part or all of a logical storage volume of a cloud computing system. A logical storage volume of the cloud computing system may be partitioned into two additional virtual volumes assigned to the computing environment hosted by the cloud computing system. While cloud computing systems are aware of the mapping between the virtual volumes of the hosted computing environment and the blocks of the logical volumes of the cloud computing system, tiered storage systems generally do not share this information. cannot access.

As part of their tiered storage management responsibilities, tiered storage systems automatically (e.g., themselves) initiate data movement to store block data associated with logical volumes in the cloud computing system. can be moved or relocated from the first storage tier to the second storage tier. A tiered storage system may have conditions (eg, reasons or trigger events) to initiate data movement. Examples of conditions include usage of the first storage tier above the threshold usage and available storage capacity on the first storage tier below the threshold capacity. While tiered storage systems are typically aware of inter-tier data movement and the reason for initiating data movement, cloud computing systems affected by the movement generally do not have access to this information.

The information disconnection between the reasons for data movements initiated by tiered storage systems and the information about which hosted computing environments have virtual volumes affected by these data movements is It may result in sub-optimal utilization of computing resources within the computing system.

Embodiments of the present disclosure tier one or more blocks of data associated with the cloud computing system by enabling the tiered storage system to transmit to the cloud computing system. of computing resources in the cloud computing system by configuring the cloud system to request and use information about why a type storage system moves from a first storage tier to a second storage tier. Based on the recognition that utilization can be improved. The cloud computing system can use this information to manage the allocation of resources provided to the hosted computing environment to improve resource utilization. For example, data movement to a slower storage tier (e.g., a storage tier that has lower read/write processing capabilities than the current storage tier) is processed for the hosted computing environment that has virtual volumes associated with the data movement. can result in a decrease in the number of transactions being processed. As an example, a cloud computing system may allow a particular block to be placed in a slower tier, e.g., to reduce memory or processor resources allocated to a hosted computing environment having virtual volumes associated with the relocated blocks. Information can be used to indicate that the In another example, when a data movement moves blocks from a slower storage tier to a faster storage tier, the cloud computing system uses information about this data movement to determine which virtual volumes are associated with the data movement. A host-based computing environment can be moved to a faster processor or system bus.

Accordingly, embodiments of the present disclosure are directed to techniques (eg, methods, systems, and computer program products) for enabling management of cloud resources based on tiered storage data movement. The technique is performed by a tiered storage system to receive a request from the cloud computing system and provide notification to the cloud computing system that data movement is to be initiated by the tiered storage system. can be performed. Data movement includes moving data associated with the cloud computing system from a first storage tier to a second storage tier. In some embodiments, the notification includes an indication of the conditions (eg, reason or trigger event) for initiating (eg, initiating and executing) data movement. The techniques may also be performed by the tiered storage system to determine that the conditions for initiating data movement have also been met, and to initiate data movement in response to that determination. The tiered storage system can then send a notification to the cloud computing system in response to initiation of data movement.

In some embodiments, the first storage tier (eg, the data movement source) has a performance level that is different than the performance level of the second storage tier (eg, the data movement destination).

In some embodiments, the request received from the cloud computing system includes criteria for causing the tiered storage system to provide notifications. In these embodiments, the notification is sent in response to determining that the criteria are met. The criteria may be based on at least one of data movement and conditions for initiating data movement. Criteria may also be based on a set of (eg, one or more) collective characteristics of data movements initiated by the tiered storage system. The collective characteristic can be, for example, the frequency of data movement from a storage tier having a first performance level to a storage tier having a second performance level lower than the first performance level. Another example of a collective characteristic is the frequency of data movement from a storage tier in response to a determination that the storage tier has insufficient storage capacity.

In some embodiments, data associated with the cloud computing system may be one or more blocks of data implementing virtual volumes associated with the hosted computing environment.

In certain embodiments, the conditions for initiating data movement are that the input/output resource utilization of the storage tier reaches a threshold utilization level, the amount of data associated with the cloud computing system reaches a threshold amount Or it can be at least one of exceeding and the amount of data stored in the first tier reaching a threshold amount. Other criteria are possible.

Other embodiments of the present disclosure are directed to techniques (e.g., methods, systems, and computer program products) for allocating cloud resources in a cloud computing system based on data movement through a tiered storage system. do. The techniques may be performed by a cloud computing system, for example, to improve utilization of cloud computing resources in response to data movement initiated by a tiered storage system. The technique includes sending a request to the tiered storage system to provide notification that data movement will be initiated by the tiered storage system. Data movement may include moving data associated with the cloud computing system from a first storage tier to a second storage tier. The notification may include an indication of the conditions for initiating data movement. The technique may further include receiving notifications from the tiered storage system. The techniques may then include using the received notification to identify a hosted computing environment having volumes (eg, virtual volumes) associated with the data movement. The techniques may then include determining whether to change the allocation of resources to the identified hosted computing environment. The techniques may further include changing the allocation of resources in response to determining to change the allocation of resources to the hosted computing environment.

In some embodiments, requests sent to the tiered storage system include criteria for providing notifications. The criteria may be based, for example, on whether the storage tier that is the source of the data movement has better performance than the performance of the storage tier that is the destination of the data movement. The criteria may also be based on at least one of data movement direction and conditions for initiating data movement. Criteria may further be based on a set of (eg, one or more) collective characteristics of data movements initiated by the tiered storage system. The collective characteristic can be the frequency or total number of data migrations from a storage tier having a first performance level to a storage tier having a second performance level lower than the first performance level. The collective characteristic can also be the frequency or total number of data movements from a storage tier in response to a determination that the storage tier has insufficient storage capacity. The collective property further includes data associated with a set of hosted computing environments (e.g., virtual volumes of the set of hosted computing environments) from the first storage system to the second storage system. can be data movement to

In some embodiments, allocated resources in a cloud computing system may include memory, processors, and communication bandwidth allocated to the hosted computing environment.

In some embodiments, changing the allocation of resources includes moving the hosted computing environment from a first host computing system to a second host computing system. In some embodiments, changing the allocation of resources includes suspending execution of the hosted computing environment. In certain embodiments, changing the allocation of resources includes notifying a user associated with the hosted computing environment to cause the user to change the allocation of resources to the hosted computing environment. In another embodiment, changing the resource allocation includes notifying a service associated with the hosted computing environment to cause the server to change the resource allocation.

As used herein, the term cloud computing system is used to enable access to a shared pool of configurable resources (e.g., computer networks, servers, storage, applications and services). including computing systems (eg, host computing systems) and applications configured to A cloud computing system supports or hosts a hosted computing environment (e.g., a virtual machine) on top of software and firmware layers that provide an abstraction of the hardware associated with the cloud computing system. can be done. Operation of a cloud computing system may be managed (eg, governed and executed) by one or more software applications (hereinafter "cloud managers").

As used herein, a logical volume is one or more storage volumes on a virtual disk or virtual disk partition that can be viewed as a single persistent storage area to a computing environment. storage space abstraction (eg, physical extension of a storage volume). A tiered storage system, for example, can provide one or more logical volumes to a cloud computing system. A cloud computing system can partition its logical volumes into one or more virtual volumes that can be assigned to a hosted computing environment.

Although a logical volume can be viewed by a cloud computing system as a single volume of storage, a logical volume is, from the perspective of a tiered storage system, one allocated to the cloud computing system. Viewed as a set of blocks. Hierarchical storage systems are typically unaware of virtual volume partitions of logical volumes. In some environments, tiered storage systems are unaware of the structure of logical volumes. Similarly, a cloud computing system may be unaware of management operations performed on blocks of its logical volumes (eg, data movement between tiers and triggering events and conditions that initiate data movement).

Although this disclosure includes detailed descriptions of cloud computing, it is to be foreseen that implementations of the teachings set forth herein are not limited to cloud computing environments. Rather, embodiments of the invention may be practiced in conjunction with any other type of computing environment now known or later developed.

Cloud computing is a shared pool of configurable computing resources (e.g., networks, network bandwidth, servers, A model of service delivery for enabling convenient, on-demand network access to (processing, memory, storage, applications, virtual machines, and services). This cloud model may include at least five characteristics, at least three service models, and at least four deployment models.

The properties are as follows.
On-demand self-service: Cloud consumers automatically and unilaterally allocate computing power as needed, without the need for human interaction with providers of services, such as server time and network storage. can supply.
Broad network access: Capabilities are available over the network and by heterogeneous thin or thick client platforms (e.g., mobile phones, laptops, and PDAs) Accessed through standard mechanisms that facilitate their use.
Resource Pooling: A provider's computing resources are pooled to serve multiple consumers using a multi-tenant model, with different physical and virtual resources dynamically allocated and reassigned according to demand. Consumers generally do not have control or knowledge of the exact location of the provided resource, but may be able to specify the location (e.g., country, state, or data center) at a higher level of abstraction. At points, there is a sense of positional independence.
Rapid adaptability: Capacity can be rapidly and elastically provisioned, possibly automatically, to scale out quickly and released quickly to scale in quickly. To consumers, the capacity available to supply often appears unlimited and can be purchased in any amount at any time.
Measured services: Cloud systems measure resource utilization by leveraging metering capabilities at some level of abstraction appropriate to the type of service (e.g., storage, processing, bandwidth, and active user accounts). Automatically control and optimize. Resource usage can be monitored, controlled and reported to provide transparency for both providers and consumers of the services utilized.

The service model is as follows.
Software as a Service (SaaS): The ability offered to the consumer is aimed at using the provider's applications running on the cloud infrastructure. Applications are accessible from various client devices via thin client interfaces such as web browsers (eg, web-based email). Consumers do not manage or control the underlying cloud infrastructure, including networks, servers, operating systems, storage, or even individual application capabilities, with the possible exception of limited user-specific application configuration settings.
Platform as a Service (PaaS): Capabilities provided to consumers are on applications created or acquired by cloud infrastructure consumers written using programming languages and tools supported by the provider. intended to be deployed in Consumers do not manage or control the underlying cloud infrastructure, including networks, servers, operating systems, or storage, but they do control the deployed applications and possibly the application hosting environment configuration.
Infrastructure as a Service (IaaS): The ability provided to the consumer allows the consumer to deploy and run any software that may include processing, storage, networking, and operating systems and applications It is intended to provide other basic computing resources. Consumers do not manage or control the underlying cloud infrastructure, but do control the operating system, storage, deployed applications, and possibly restrict selected network components (e.g., host firewalls). to control.

The deployment model is as follows.
Private Cloud: Cloud infrastructure is operated only for the organization. It can be managed by an organization or a third party and can exist on-premises or off-premises.
Community cloud: A cloud infrastructure shared by several organizations to support a specific community with common interests (eg, mission, security requirements, policies, and compliance considerations). It can be managed by an organization or a third party and can exist on-premises or off-premises.
Public Cloud: A cloud infrastructure made available to the general public or a large industrial group and owned by an organization that sells cloud services.
Hybrid cloud: cloud infrastructure remains a unique entity but is tied together by standard or proprietary technologies that enable data and application portability (e.g. cloud bursting for load balancing across clouds) It is a composition of two or more clouds (private, community, or public) connected to each other.

Cloud computing environments are service-oriented with an emphasis on statelessness, low coupling, modularity, and semantic interoperability. At the heart of cloud computing is an infrastructure with a network of interconnected nodes.

Referring now to FIG. 1, a schematic diagram of an example cloud computing node is shown. Cloud computing node 10 is but one example of a suitable cloud computing node and is not intended to suggest any limitation as to the scope of use or functionality of embodiments of the inventions described herein. not Nevertheless, cloud computing node 10 may be implemented and/or perform any of the aforementioned functionality.

Within cloud computing node 10 resides a computer system/server 12 that is capable of operating with numerous other general purpose or special purpose computing system environments or configurations. Examples of well-known computing systems, environments, and/or configurations that may be suitable for use with computer system/server 12 include personal computer systems, server computer systems, thin clients, thick Clients, handheld or laptop devices, multiprocessor systems, microprocessor-based systems, set-top boxes, programmable consumer electronics, network PCs, minicomputer systems, mainframe computer systems, and distributed cloud computing environments including any of the foregoing systems or devices, etc., including but not limited to.

Computer system/server 12 may be described in the general context of computer system-executable instructions, such as program modules, being executed by the computer system. Generally, program modules may include routines, programs, objects, components, logic, data structures, etc. that perform particular tasks or implement particular abstract data types. Computer system/server 12 may be practiced in distributed cloud computing environments where tasks are performed by remote processing devices that are linked through a communications network. In a distributed cloud computing environment, program modules may be located in both local and remote computer system storage media including memory storage devices.

As shown in FIG. 1, computer system/server 12 within cloud computing node 10 is shown in the form of a general purpose computing device. Components of computer system/server 12 include one or more processors or processing units 16 , system memory 28 , and bus 18 coupling various system components including system memory 28 to processor 16 . may include, but are not limited to.

Bus 18 may be any type of bus, including memory buses or memory controllers, peripheral buses, accelerated graphics ports, and processor or local buses using any of a variety of bus architectures. Represents any one or more of the structures. By way of example and not limitation, such architectures include Industry Standard Architecture (ISA) buses, Micro Channel Architecture (MCA) buses, Enhanced ISA (EISA) buses, It includes a Video Electronics Standards Association (VESA) local bus and a Peripheral Component Interconnect (PCI) bus.

Computer system/server 12 typically includes a variety of computer system readable media. Such media can be any available media that can be accessed by computer system/server 12 and includes both volatile and nonvolatile media, removable and non-removable media. include.

The system memory 28 may include computer system readable media in the form of volatile memory such as random access memory (RAM) 30 and/or cache memory 32 . Computer system/server 12 may further include other removable/non-removable, volatile/non-volatile computer system storage media. Solely by way of example, storage system 34 may be provided for reading from and writing to non-removable, nonvolatile magnetic media (not shown, commonly referred to as "hard drives"). Although not shown, a magnetic disk drive for reading from and writing to removable, non-volatile magnetic disks (e.g., "floppy disks"), CD-ROM, DVD-ROM or other optical media, etc. An optical disc drive for reading from or writing to removable non-volatile optical discs may be provided. In such cases, each may be connected to bus 18 by one or more data media interfaces. As further depicted and described below, memory 28 stores at least one program product having a set (eg, at least one) of program modules configured to perform the functions of an embodiment of the present invention. can contain.

Programs/utilities 40, having a set (at least one) of program modules 42, may include, by way of example and not limitation, memory 28, as well as an operating system, one or more application programs, other program modules, and other programs. can be stored in modules and program data. Each or some combination of the operating system, one or more application programs, other program modules, and program data may include an implementation of a networked environment. Program modules 42 generally implement the functions and/or methodologies of embodiments of the invention as described herein.

Computer system/server 12 also includes one or more external devices 14, such as a keyboard, pointing device, display 24, and one or more external devices 14 that enable a user to interact with computer system/server 12. device, or any device (e.g., network cards, modems, etc.), or combination thereof, that enables computer system/server 12 to communicate with one or more other computing devices. obtain. Such communication may occur via input/output (I/O) interface 22 . Further, computer system/server 12 may be connected via network adapter 20 to a local area network (LAN), general wide area network (WAN), public network (e.g., the Internet), or combinations thereof. can communicate with one or more networks of As shown, network adapter 20 communicates with other components of computer system/server 12 via bus 18 . Although not shown, it should be understood that other hardware and/or software components may be used in conjunction with computer system/server 12 . Examples include, but are not limited to, microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, data archive storage systems, and the like.

Referring now to FIG. 2, an exemplary cloud computing environment 50 is depicted. As shown, the cloud computing environment 50 includes, for example, a personal digital assistant (PDA) or mobile phone 54A, a desktop computer 54B, a laptop computer 54C, or an automotive computer system 54N, or a combination thereof. , with which local computing devices used by cloud consumers can communicate. Nodes 10 may communicate with each other. Nodes 10 may be physically or virtually grouped (not shown) in one or more networks, such as private clouds, community clouds, public clouds, or hybrid clouds, or combinations thereof, as previously described. can be done). This enables the cloud computing environment 50 to provide infrastructure, platform and/or software as a service that does not require cloud consumers to maintain resources on their local computing devices. The types of computing devices 54A-N shown in FIG. 2 are intended to be exemplary only, and that computing nodes 10 and cloud computing environment 50 may be connected to any type of network or network address. It is understood that one can communicate with any type of computerized device via available connections (eg, using a web browser) or both.

Referring now to FIG. 3, a set of functional abstraction layers provided by cloud computing environment 50 (FIG. 2) is shown. It is to be foreseen that the components, layers, and functions shown in FIG. 3 are intended to be exemplary only, and that embodiments of the present invention are not so limited. As shown, the following layers and corresponding functions are provided.

Hardware and software layer 60 includes hardware and software components. Examples of hardware components include mainframes, servers based on RISC (reduced instruction set computer) architecture, storage devices, networks, and network components. In some embodiments, the software component includes network application server software.

Virtualization layer 62 is an abstraction that may provide the following examples of virtual entities: virtual servers, virtual storage, virtual networks, including virtual private networks, virtual applications and operating systems, and virtual clients. bring about layering.

In one example, management layer 64 may provide the functionality described below. Resource provisioning provides dynamic procurement of computing and other resources utilized to perform tasks within a cloud computing environment. Metering and pricing provides cost tracking as resources are utilized within the cloud computing environment and billing or billing for consumption of those resources. In one example, these resources may include application software licenses. Security provides identity verification of cloud consumers and tasks, and protection of data and other resources. The user portal provides consumer and system administrator access to the cloud computing environment. Service level management provides allocation and management of cloud computing resources such that required service levels are met. Planning and fulfillment of Service Level Agreements (SLAs) results in the pre-arrangement and procurement of cloud computing resources with projected future requirements according to SLAs.

Workload layer 66 provides an example of functionality for which the cloud computing environment can be utilized. Examples of workloads and functions that can be delivered from this tier include mapping and navigation, software development and lifecycle management, virtual classroom teaching delivery, data analytics processing, transaction processing, and mobile desktops.

Referring now to the figures, FIG. 4 illustrates a sequence of operations 400 for enabling management of cloud resources based on tiered storage data movement, according to various embodiments. Operation 400 may be performed by a tiered storage system, such as tiered storage system 705 (FIG. 7). In some embodiments, operation 400 is automatically performed by a storage manager application of a tiered storage system according to feedback provided by hardware and other software components of the tiered storage system. be able to. The storage manager may include computer-executable code executable by a computing system, such as computer system 12 (FIG. 1). In some embodiments, the computing system may be a hardware component (eg, a tiered storage server) associated with layer 60 of the cloud computing system shown in FIG. In certain embodiments, the computing system (eg, tiered storage system) is separate from the cloud computing system.

The tiered storage system may perform operation 405 to receive a request from a cloud computing system and provide data movement notification for data blocks associated with the cloud computing system. A cloud computing system may be a tenant of a tiered storage system and may be assigned one or more data blocks of storage on the tiered storage system. In some embodiments, the request is received through a storage driver. In other embodiments, the request may be received in data packets over a communication channel (eg, a communication cable, bus, data communication network, etc.) that couples the tiered storage system to the cloud computing system. The request may be implemented in a data structure extractable from the data packet by a storage manager associated with the hierarchical computing system.

In some embodiments, a tiered storage system has two or more storage tiers. A storage tier is a storage resource (eg, storage volume and communication hardware and software) that has specific performance characteristics that distinguish it from another storage resource or storage tier. The first storage tier may, for example, have greater input/output (I/O) processing power, more storage capacity, or greater communication bandwidth than the second storage tier. Storage systems can move data from one storage tier to another to optimize cost, performance, and storage space, for example. Data movement is, for example, moving data associated with a cloud computing system (e.g., data blocks allocated to a cloud computing system) from a first storage tier to a second storage tier. can include

In some embodiments, a tiered storage system may be automatically triggered to initiate data movement in response to a set of trigger conditions (hereinafter, conditions). A trigger condition can be any event or condition associated with a storage tier or tenant of a tiered storage system. A trigger condition can be, for example, an indication that I/O resource (eg, read/write operations, data bus bandwidth, and stored data) utilization of a storage tier has reached or exceeded a threshold utilization level. In another example, a trigger condition can be an indication that the amount of data stored in a storage tier by a tenant (eg, cloud computing system) has reached or exceeded a threshold amount. As a third example, the trigger condition may be an indication that usage of the cloud computing system of the tiered storage system exceeds a subscribed or paid usage level.

In certain embodiments, notifications are data structures generated by the tiered storage system and sent to the cloud computing system. The notification may include an indication of the conditions (eg, trigger conditions) that caused the storage system to initiate data movement. Notifications may further indicate changes in blocks, storage tiers, and storage performance levels associated with data movement.

In some embodiments, the request received at operation 405 may include criteria (eg, policy) for having the tiered storage system provide data movement notifications. Criteria may be based on data movement and conditions that trigger data movement. The criteria may be, for example, that the tiered storage system should move data from a first storage tier having a first performance level to a second storage tier having a second performance level lower than the first performance level. Data movement notifications can be provided by the tiered storage system when initiated (eg, a data movement that moves data from a faster storage tier to a slower storage tier). As another example, the criterion is that the number of I/O operations processed by a storage tier (e.g., for a cloud computing system) exceeds a threshold number of I/O operations (this information is A data movement notification can be provided to a tiered storage system when the tiered storage system initiates data movement in response to a tiered storage system that can be used by a cloud computing system for purposes of .

Criteria may also be based on collective characteristics of data movements initiated by the tiered storage system. An example of a collective characteristic includes frequency of data movement from a storage tier having a first performance level to a storage tier having a second performance level, where the second performance level is lower than the first performance level. Another example of an aggregate performance characteristic is the frequency or total number of data movements from a storage tier in response to a determination that the storage tier has insufficient storage capacity or I/O bandwidth. Other individual or collective criteria for having the tiered storage system provide data movement notifications may be used with the techniques described herein.

The tiered storage system may perform operation 410 to determine if conditions are met to initiate data movement from the first storage tier to the second storage tier. Performing operation 410 may include, for example, querying a storage controller associated with the storage tier to determine the amount of available storage space in the storage tier and the I/O utilization of the storage tier. . Performing operation 410 may also be performed on tenant actions, such as, for example, to evaluate collective trigger conditions or tenant-based conditions (e.g., I/O requests from tenants exceeding a threshold number of requests). monitoring or logging of I/O operations or transactions performed by the storage tier to evaluate conditions triggered in response.

In some embodiments, the information queried or monitored while performing operation 110 is used to evaluate conditions for providing data movement notifications, as described herein. can be logged to a data structure later.

The tiered storage system performs operation 415 to initiate a data movement event in response to determining that the conditions for initiating data movement from the first storage tier to the second storage tier are met. can do. Initiating data movement may include selecting one or more blocks of data to transfer from the first storage tier to the second storage tier. Initiating a data movement stores information related to the data movement in a data structure, including, for example, the source tier, destination tier, trigger conditions, data blocks moved, and tenants affected by the data movement. can further include:

In some embodiments, the tiered storage system performs operation 420 to determine whether the criteria for providing notifications to the cloud computing system (eg, data movement notification criteria) are met. can judge. Performing operation 420 may include identifying cloud computing systems affected by the data movement initiated at operation 415 . Performing operation 420 uses the logged data movement information to evaluate data movement notification criteria received from the cloud computing system identified in operation 405, as described herein. may further include: Evaluating the data movement notification criteria includes calculating one or more statistics about the data movement information and performing one or more logical operations using the statistics, e.g., thresholds associated with the movement notification criteria. may include performing The tiered storage system may return to operation 410 in response to a determination that the criteria were not met, while the tiered storage system responds to a determination that the criteria were met. and can proceed to operation 425 .

The storage system may perform operation 425 to send a notification to the cloud computing system. Performing operation 425 includes, for example, creating a data structure having an indication of the data blocks that have been moved, the conditions or reasons for initiating the data movement, and information related to the performance of the storage tiers involved in the data movement. generating. Performing operation 425 may further include performing one or more operations to send the notification to the cloud computing system over the communication channel.

FIG. 5 illustrates a sequence of operations 500 for allocating cloud resources in a cloud computing system based on tiered storage data movement, in accordance with various embodiments. Operations 500 may be performed by a cloud computing system, such as cloud computing system 805 (FIG. 8). In some embodiments, operation 500 may be automatically performed by a cloud manager application of a cloud computing system. The cloud manager may include code executable by a computing system, such as computer system 12 (FIG. 1). In some embodiments, the cloud manager is a software component associated with layer 64 of the cloud computing system shown in FIG.

The cloud computing system may perform operation 505 to send a request to the tiered storage system to provide notification that data movement will be initiated by the tiered storage system. Data movement is, for example, from a first storage tier to a second storage tier, as described herein, data associated with a cloud computing system (e.g., data assigned to a cloud computing system). data blocks). The notification can be a data structure generated by the tiered storage system and sent to the cloud computing system, as described herein. In some embodiments, the request includes criteria for having the tiered storage system provide data movement notifications. The characteristics of the criteria match those described in the discussion of operation 400 (FIG. 4). Performing operation 505 may include generating a data structure with the request and sending the data structure to the tiered storage system via a communication channel.

The cloud computing system may perform operation 510 to receive notifications (eg, data movement notifications) from the tiered storage system. Notifications may be received in data packets from communication channels that couple the tiered storage system to the cloud computing system. The notification may be implemented in a data structure that can be extracted from the data packet, for example, by the cloud manager. Notifications may include an indication of blocks to be moved, conditions or reasons for initiating data movement, and information related to the performance of the storage tiers involved in the data movement, as described herein.

The cloud computing system may perform operation 515 to use the received notification to identify hosted computing environments having virtual volumes associated with the data movement. Performing operation 515 includes determining from the notification one or more blocks of data associated with the data movement operation. Performing operation 515 is then received, for example, from a data structure mapping block of logical volumes of the cloud computing system to one or more virtual volumes assigned to the hosted computing environment. determining a hosted computing environment having virtual volumes associated with one or more blocks indicated in the notification.

The cloud computing system may perform operation 520 to determine whether to change the allocation of resources to the identified hosted computing environment. Performing operation 520 may include determining from a data structure storing storage tier movement policies whether to change the allocation of resources to the hosted computing environment. In some embodiments, a storage tier movement policy may indicate conditions or criteria for changing the allocation of resources to one or more hosted computing environments in response to tiered storage data movement. In some embodiments, the conditions or criteria may be substantially the same as the criteria for causing data movement notifications to be sent to the tiered storage system. The cloud computing system may return to operation 510 in response to determining not to change the allocation of resources to the identified hosted computing environment, while the cloud computing system: Operation 525 may proceed in response to a determination to change the allocation of resources to the identified Hosted Computing Environment.

The cloud manager may perform operation 525 to change the allocation of resources to the Hosted Computing Environment in response to the decision to change the allocation of resources to the Hosted Computing Environment. In some embodiments, resources allocated to the host computing environment may include at least one of allocated memory, processing resources, and communication resources (eg, communication bandwidth). Changing the allocation of resources includes moving the identified hosted computing environment from a first host computing system to a second host computing system in the cloud computing system. obtain. Altering the allocation of resources also includes suspending execution of the identified hosted computing environment. In some embodiments, changing the resource allocation includes notifying a user associated with the hosted computing environment to cause the user to change the resource allocation. In some embodiments, changing the resource allocation includes notifying a service associated with the identified Hosted Computing Environment to cause the service to change the resource allocation. In other embodiments, allocation of one or more other resources may be changed according to other stored storage tier migration policies.

FIG. 6 illustrates a block diagram of an exemplary cloud computing environment 600 using tiered storage, in accordance with various embodiments. Cloud computing environment 600 includes cloud computing system 605 coupled to tiered storage system 635 using communication channel 650 .

In some embodiments, cloud computing system 605 includes software to enable or host hosted computing environment 610 and hosted computing environment 620, as described herein. • includes one or more computing systems that run applications and firmware applications; Cloud computing system 605 also includes volume 630 (e.g., logical volume). All or part of volume 630 may be stored in tiered storage system 635 on storage tier 1 640 or storage tier 2 645 as described herein.

In some embodiments, communication channel 650 is configured to transfer data in one or more data structures or packets between cloud computing system 605 and tiered storage system 635. , a data bus, a communication cable, or a data communication network.

FIG. 7 shows a block diagram of an exemplary tiered storage system 705, according to various embodiments. Tiered storage system 705 may include processor 710 , memory 715 , and tiered storage 730 . Memory 715 may include storage manager 720 and notification policy 725 . Storage manager 720 may execute on processor 710 to perform the operations and techniques described herein. Notification policies 725 may include data movement notification requests from registered tenants (eg, cloud computing systems that submit data movement notification requests). The request may include criteria for having tiered storage system 705 provide data movement notifications, as described herein. Tiered storage 730 may include storage tier 1 735 and storage tier 2 750 . Storage tier 1 735 may have a performance level or grade and may include one or more storage drives (eg, disk drives, solid state drives, etc.) that store data blocks 745A and 745B. Storage tier 2 750 may have another performance level or grade and may include one or more storage drives that store data blocks 760A and 760B.

FIG. 8 shows a block diagram of an exemplary cloud computing system 800, according to various embodiments. Tiered cloud computing system 805 may include processor 810, memory 815, and tiered storage 855 (eg, logical volumes). Memory 815 may include cloud manager 820 , storage tier movement policy 825 , and hosted computing environment 830 . Cloud manager 820 may execute on processor 810 to perform the operations and techniques described herein. Hosted computing environment 830 may include an operating system 835 and allocated resources such as memory 840 , communication resources 845 , and virtual volumes 850 .

The invention may be a system, method, or computer program product, or a combination thereof. A computer program product may include one or more computer-readable storage media having computer-readable program instructions for causing a processor to perform aspects of the present invention.

A computer-readable storage medium may be a tangible device capable of holding and storing instructions for use by an instruction execution device. A computer-readable storage medium may be, for example, but not limited to, an electronic storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any suitable combination of the foregoing. A non-exhaustive list of more specific examples of computer-readable storage media includes portable computer diskettes, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), static random access memory (SRAM), portable compact disk read-only memory (CD-ROM), digital versatile disk (DVD), memory stick, floppy disk, Included are mechanically encoded devices such as punch cards or raised structures in grooves on which instructions are recorded, and any suitable combination of the foregoing. As used herein, computer-readable storage media refers to radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through waveguides or other transmission media (e.g., through fiber optic cables). It should not be interpreted as being a transient signal per se, such as an optical pulse), or an electrical signal transmitted over a wire.

The computer readable program instructions described herein can be transferred from a computer readable storage medium to a respective computing/processing device or over a network, such as the Internet, local area network, wide area network or wireless network or the like. It can be downloaded to an external computer or external storage device via combination. A network may comprise copper transmission cables, optical transmission fibers, wireless transmissions, routers, firewalls, switches, gateway computers or edge servers, or a combination thereof. A network adapter card or network interface within each computing/processing device receives computer-readable program instructions from the network and stores the computer-readable program instructions for storage on a computer-readable storage medium within the respective computing/processing device. Transfer orders.

Computer readable program instructions for carrying out the operations of the present invention may be assembler instructions, Instruction Set Architecture (ISA) instructions, machine instructions, machine dependent instructions, microcode, firmware instructions, state setting data or Smalltalk (registered written in any combination of one or more programming languages, including object-oriented programming languages such as C++, and conventional procedural programming languages, such as, for example, the "C" programming language or similar programming languages It can be source code or object code. The computer-readable program instructions may reside entirely on the user's computer, partially on the user's computer, as a stand-alone software package, partially on the user's computer and partially on a remote computer, or on a remote computer or server. can be run perfectly with In the latter scenario, the remote computer may be connected to or connected to the user's computer via any type of network, including a local area network (LAN) or wide area network (WAN). A connection may be made to an external computer (eg, over the Internet using an Internet service provider). In some embodiments, electronic circuits including, for example, programmable logic circuits, field programmable gate arrays (FPGAs), or programmable logic arrays (PLAs) are programmed with a computer readable program to carry out aspects of the present invention. Computer readable program instructions may be executed by customizing the electronic circuitry using the state information of the instructions.

Aspects of the present invention are described herein with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the invention. It will be understood that each block of the flowchart illustrations and/or block diagrams, and combinations of blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer readable program instructions.

Instructions executed through a processor of a computer or other programmable data processing apparatus produce the means for performing the functions/acts specified in one or more blocks of the flowchart illustrations and/or block diagrams. As such, these computer readable program instructions may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine. Computer-readable storage media having instructions stored thereon include articles of manufacture that include instructions for implementing aspects of the functions/operations specified in one or more blocks of the flow diagrams and/or block diagrams. The readable program instructions may be stored in a computer-readable storage medium and capable of directing a computer, programmable data processing apparatus, or other device, or combination thereof, to function in a specific manner.

Computer readable program instructions that execute on a computer, other programmable apparatus, or other device to perform the functions/acts specified in one or more blocks of the flowchart illustrations and/or block diagrams; a sequence of operations on a computer, other programmable apparatus or device, when loaded into a computer or other programmable data processing apparatus or other device to produce a computer-implemented process It may be one that causes a step to be executed.

The flow diagrams and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present invention. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of instructions containing one or more executable instructions to perform the specified logical function. In some alternative implementations, the functions noted in the blocks may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently or the blocks may sometimes be executed in the reverse order, depending on the functionality involved. Each block in the block diagrams and/or flow diagrams, and combinations of blocks in the block diagrams and/or flow diagrams, is represented by dedicated hardware that performs or executes a specified function or combination of dedicated hardware and computer instructions. Note also that it may be implemented by a hardware-based system.

The description of various embodiments of the disclosure has been presented for purposes of illustration and is not intended to be exhaustive or limited to the disclosed embodiments. Numerous modifications and variations will become apparent to those skilled in the art without departing from the scope of the described embodiments. The terminology used herein is used to describe principles of the embodiments, practical applications, or technical improvements over those found on the market, or to explain the embodiments disclosed herein by those skilled in the art. was selected to allow

Claims (20)

A method performed by a cloud computing system for allocating cloud resources in the cloud computing system based on tiered storage data movement, comprising:
Sending a request to a tiered storage system to provide notification that data movement is to be initiated by the tiered storage system, comprising:
said moving data comprises moving data associated with said cloud computing system from a first storage tier to a second storage tier;
said sending, wherein said notification includes an indication of conditions for initiating said data movement;
receiving the notification from the tiered storage system;
using the received notification to identify a hosted computing environment having volumes associated with the data movement;
determining whether to change the allocation of resources to the hosted computing environment;
changing the allocation of the resources to the Hosted Computing Environment in response to a decision to change the allocation of the resources to the Hosted Computing Environment;
The determining comprises moving the hosted computing environment from a data structure storing a storage tier movement policy indicating conditions or criteria for changing allocations of resources to the hosted computing environment in response to the data movement. determining whether to change the allocation of resources to a storage environment , wherein the condition or criterion is the same as the criterion for causing the notification to be sent to the tiered storage system . 2. The method of claim 1, wherein the request includes criteria for providing the notification, the criteria being based on whether the first storage tier has better performance than the second storage tier. the method of. 2. The method of claim 1, wherein the request includes criteria for providing the notification, the criteria being based on collective characteristics of the data movement. The collective property is
frequency of data migration from a storage tier having a first performance level to a storage tier having a second performance level lower than the first performance level;
frequency of data movement from a storage tier in response to a determination that the storage tier has insufficient storage capacity;
4. The method of claim 3, at least one of: data movement of data associated with a set of hosted computing environments from a first storage system to a second storage system. 2. The method of claim 1, wherein the resources comprise at least one of allocated memory, processing resources, and communication bandwidth. 2. The method of claim 1, wherein said changing allocation of said resources comprises moving said hosted computing environment from a first host computing system to a second host computing system. Method. 2. The method of claim 1, wherein said altering allocation of said resources comprises suspending execution of said Hosted Computing Environment. 2. The method of claim 1, wherein said changing said resource allocation comprises notifying a user associated with said hosted computing environment to cause said user to change said resource allocation to said user. . 2. The method of claim 1, wherein said changing the resource allocation comprises notifying a service associated with the hosted computing environment to cause the service to change the resource allocation. A system for allocating cloud resources in a cloud computing system based on tiered storage data movement, comprising:
one or more computing nodes having memory and processors;
a non-transitory computer-readable storage medium of said one or more computing nodes embodied with program instructions, said program instructions comprising:
Sending a request to a tiered storage system to provide notification that data movement is to be initiated by the tiered storage system, comprising:
said moving data comprises moving data associated with said cloud computing system from a first storage tier to a second storage tier;
said sending, wherein said notification includes an indication of conditions for initiating said data movement;
receiving the notification from the tiered storage system;
using the received notification to identify a hosted computing environment having volumes associated with the data movement;
determining whether to change the allocation of resources to the hosted computing environment;
changing the allocation of the resources to the Hosted Computing Environment in response to a decision to change the allocation of the resources to the Hosted Computing Environment, performed by the processor to cause the system to: is possible and
The determining comprises moving the hosted computing environment from a data structure storing a storage tier movement policy indicating conditions or criteria for changing allocations of resources to the hosted computing environment in response to the data movement. determining whether to change the allocation of resources to a storage environment , wherein said condition or criterion is the same as the criterion for causing said notification to be sent to said tiered storage system. 11. The claim 10, wherein the request includes criteria for providing the notification, the criteria being based on whether the first storage tier has better performance than the second storage tier. system. 11. The system of claim 10, wherein the request includes criteria for providing the notification, the criteria being based on collective characteristics of the data movements. The collective property is
frequency of data migration from a storage tier having a first performance level to a storage tier having a second performance level lower than the first performance level;
frequency of data movement from a storage tier in response to a determination that the storage tier has insufficient storage capacity;
13. The system of claim 12, at least one of: moving data associated with a set of hosted computing environments from a first storage system to a second storage system. 11. The system of claim 10, wherein the resources comprise at least one of allocated memory, processing resources, and communication bandwidth. 11. The method of claim 10, wherein said changing allocation of said resources comprises moving said hosted computing environment from a first host computing system to a second host computing system. system. 11. The system of claim 10, wherein said altering the allocation of said resources comprises suspending execution of said hosted computing environment. 11. The system of claim 10, wherein the modifying the resource allocation comprises notifying a user associated with the hosted computing environment to cause the user to modify the resource allocation. 11. The system of claim 10, wherein said changing the resource allocation comprises notifying a service associated with the hosted computing environment to cause the service to change the resource allocation. A computer program for allocating cloud resources in a cloud computing system based on tiered storage data movement, said computer program executing the steps of the method of any one of claims 1-9. A computer program to make 20. A computer-readable recording medium recording the computer program according to claim 19.

Images