JP2021503650A - Methods, systems, computer programs and recording media for allocating cloud resources in cloud computing systems based on tiered storage data movement - Google Patents

Abstract

A method for allocating cloud resources in a cloud computing system based on tiered storage data movement is to the tiered storage system to provide a notification that the tiered storage system will initiate the data movement. Sending a request, the data movement involves moving data related to the cloud computing system from the first storage tier to the second storage tier, and the notification initiates the data movement. Use the received notifications to identify the hosted computing environment that has the volume associated with sending, receiving notifications from the tiered storage system, and moving data, including instructions for the conditions for. To the hosted computing environment in response to the decision to change the resource allocation to the hosted computing environment and to change the resource allocation to the hosted computing environment. Includes changing resource allocations for. [Selection diagram] Fig. 1

Description

The disclosure relates to cloud computing and, more particularly, to the management of cloud resources based on tiered storage data movement.

Cloud computing enables ubiquitous access to shared pools of configurable resources (eg, computer networks, servers, storage, applications and services) that can be quickly provided programmatically over networks. Computing systems that provide cloud computing services can use automatic storage tiering to manage data storage in cloud computing systems. Automatic storage tiering is the ability to manage mode data to move mode data between different storage types (eg, storage tiers) to optimize storage allocation, for example in terms of cost, performance, and storage space. ..

It can provide policy-based optimization of cloud resources in tiered storage operations.

According to embodiments of the present disclosure, a method for allocating cloud resources in a cloud computing system based on tiered storage data movement provides notification that the tiered storage system initiates data movement. It may involve sending a request to the tiered storage system as such, where data movement moves data related to the cloud computing system from the first storage tier to the second storage tier. The notification includes instructions on the conditions for initiating the data movement. The method may further include receiving notifications from a tiered storage system. The method may then include identifying hosted computing environments with volumes associated with data movement using received notifications. The method may also include deciding whether to change the allocation of resources to a hosted computing environment. The method may additionally include changing the allocation of resources to the hosted computing environment in response to the decision to change the allocation of resources to the hosted computing environment.

From a first aspect, the invention provides a method for allocating cloud resources in a cloud computing system based on tiered storage data movement, the method of which is data by a tiered storage system. By sending a request to the tiered storage system to provide a notification that the move is about to begin, the data move moves data related to the cloud computing system from the first storage tier to the second. Sending notifications, including moving to a storage tier, including instructions for conditions to initiate a data movement, receiving notifications from a tiered storage system, and volumes associated with the data movement. Identify your hosted computing environment using the notifications received, decide whether to change the allocation of resources to the hosted computing environment, and resources to the hosted computing environment. Includes changing the allocation of resources to a hosted computing environment in response to a decision to change the allocation of.

Desirably, the present invention provides a method, wherein the request comprises a criterion for providing a notification, wherein the first storage tier has better performance than the second storage tier. Based on whether or not.

Desirably, the present invention provides a method, wherein the request comprises criteria for providing notification, which criteria are based on aggregate characteristics of data movement.

Desirably, the present invention provides a method in which the collective characteristic is the movement of data from a storage tier with a first performance level to a storage tier with a second performance level lower than the first performance level. Frequency, the frequency of data movement from the storage tier in response to the determination that the storage capacity of the storage tier is insufficient, and a set of hosted computers from the first storage system to the second storage system. Data movement of data related to the ing environment, and at least one of them.

Desirably, the present invention provides a method, wherein the resource comprises at least one of allocated memory, processing resources, and communication bandwidth.

Desirably, the present invention provides a method in which changing resource allocation moves a hosted computing environment from a first host computing system to a second host computing system. Including doing.

Desirably, the present invention provides a method in which changing resource allocation involves suspending the execution of a hosted computing environment.

Desirably, the present invention provides a method, wherein changing the resource allocation involves notifying the user associated with the hosted computing environment to cause the user to change the resource allocation.

Desirably, the present invention provides a method, wherein changing the resource allocation involves notifying the service associated with the hosted computing environment and causing the service to change the resource allocation.

From a second aspect, the invention provides a system for allocating cloud resources in a cloud computing system based on tiered storage data movement, one of which has a memory and a processor. Or it comprises multiple computing nodes and a non-transient computer-readable storage medium of one or more computing nodes that embodies the program instructions, and the program instructions are moved by a tiered storage system. Is to send a request to the tiered storage system to provide a notification that is being started, and the data movement is to move the data related to the cloud computing system from the first storage tier to the second. Sending notifications, including moving to a storage tier, including instructions for conditions to initiate a data movement, receiving notifications from a tiered storage system, and volumes associated with the data movement. Identify your hosted computing environment using the notifications received, decide whether to change the allocation of resources to the hosted computing environment, and resources to the hosted computing environment. It is possible for the processor to change the allocation of resources to the hosted computing environment in response to the decision to change the allocation of the above system.

Desirably, the present invention provides a system, in which the request comprises a criterion for providing a notification, which criterion is whether the first storage tier has better performance than the second storage tier. based on.

Desirably, the invention provides a system, where the request comprises a criterion for providing a notification, the criterion being based on the collective nature of data movement.

Desirably, the present invention provides a system in which the collective characteristic is the movement of data from a storage tier with a first performance level to a storage tier with a second performance level lower than the first performance level. Frequency, frequency of data movement from the storage tier in response to the determination that the storage capacity of the storage tier is insufficient, and a set of hosted computing from the first storage system to the second storage system. At least one of the data movements of environment-related data.

Desirably, the invention provides a system in which resources include at least one of allocated memory, processing resources, and communication bandwidth.

Desirably, the present invention provides a system, where changing resource allocation moves a hosted computing environment from a first host computing system to a second host computing system. Including that.

Desirably, the present invention provides a system in which changing resource allocation involves suspending the execution of a hosted computing environment.

Desirably, the present invention provides a system in which changing resource allocation involves notifying a user associated with a hosted computing environment and causing the user to change the resource allocation.

Desirably, the present invention provides a system in which changing resource allocation involves notifying services associated with a hosted computing environment and causing the service to change resource allocation.

From a third aspect, the present invention provides a computer program product for allocating cloud resources in a cloud computing system based on tiered storage data movement, where the computer program product is a program instruction. Including a computer-readable storage medium embodied in, the computer-readable storage medium is not the transient signal itself, but a program instruction to provide a notification that data movement is initiated by the tiered storage system. Sending a request to a tiered storage system, including moving data related to a cloud computing system from a first storage tier to a second storage tier, notifications Received a hosted computing environment with volumes associated with sending, receiving notifications from a tiered storage system, and including instructions for conditions to initiate a data move. In response to identifying using notifications, deciding whether to change the allocation of resources to the hosted computing environment, and changing the allocation of resources to the hosted computing environment. It can be done by the processing circuit to cause the processing circuit to perform methods including changing the allocation of resources to the hosted computing environment.

Desirably, the present invention provides a computer program product, wherein the request comprises a criterion for providing a notification, wherein the first storage tier outperforms the performance of the second storage tier. Based on whether it has performance.

Other embodiments cover system and computer program products for implementing the methods described herein.

The above overview is not intended to describe each of the indicated embodiments or any implementation of the present disclosure.

The drawings included in the present application are incorporated herein by reference and form in part thereof. They serve to explain embodiments of the present disclosure and, together with the present specification, explain the principles of the present disclosure. Those drawings merely illustrate certain embodiments and do not limit this disclosure.

It is a figure which shows the cloud computing node by one Embodiment of this invention. It is a figure which shows the cloud computing environment by one Embodiment of this invention. It is a figure which shows the abstraction model layer by one Embodiment of this invention. It is a figure which shows the series of operations for enabling the management of the cloud resource based on the tiered storage data movement by various embodiments. FIG. 5 illustrates a series of operations for allocating cloud resources in a cloud computing system based on tiered storage data movement according to various embodiments. It is a block diagram of an exemplary cloud computing environment using tiered storage according to various embodiments. FIG. 6 is a block diagram of an exemplary tiered storage system 705 according to various embodiments. It is a block diagram of an exemplary cloud computing system according to various embodiments.

The present invention follows various modified and alternative forms, the details of which are shown by way of illustration and will be described in detail. However, it should be understood that it is not intended to limit the invention to the particular embodiments described. Rather, the invention is intended to include all modifications, equivalents, and alternative forms within the ideas and scope of the invention.

Aspects of the present disclosure relate to cloud computing, and more specifically, aspects relate to management of cloud resources based on tiered storage data movement. Although the present disclosure is not necessarily limited to such areas of application, various aspects of the present disclosure may be understood through the discussion of various examples using this context.

A cloud computing system can use a tiered storage system to store blocks of data that implement the logical volumes managed by the cloud computing system. A block of data can represent part or all of a logical storage volume in a cloud computing system. The logical storage volume of a cloud computing system can be partitioned into two additional virtual volumes assigned to the computing environment hosted by the cloud computing system. While cloud computing systems are aware of the mapping between virtual volumes in a hosted computing environment and blocks of logical volumes in a cloud computing system, tiered storage systems generally have this information. Cannot access to.

Hierarchical storage systems, as part of their tiered storage management responsibilities, automatically initiate data movement (eg, on their own) and block data associated with the logical volumes of the cloud computing system. Can be moved or rearranged from the first storage tier to the second storage tier. Hierarchical storage systems may have conditions (eg, reasons or trigger events) to initiate data movement. Examples of conditions include the use of a first storage tier above the threshold usage and the available storage capacity in the first storage tier below the threshold capacity. Hierarchical storage systems typically recognize the reasons for initiating inter-tier data movement and data movement, while cloud computing systems affected by the movement generally do not have access to this information.

Information disconnection between the reason for data movement initiated by a tiered storage system and information about which hosted computing environment has virtual volumes affected by these data movements is cloud computing. It can result in sub-optimal use of computing resources within a computing system.

An embodiment of the present disclosure allows a tiered storage system to transmit to a cloud computing system, as well as tiering one or more blocks of data related to the cloud computing system. Compute resources in a cloud computing system by configuring the cloud system to request and use information about why the type storage system moves from the first storage tier to the second storage tier. Based on the recognition that usage can be improved. Cloud computing systems can use this information to manage the allocation of resources supplied to hosted computing environments and improve resource utilization. For example, moving data to a slower storage tier (eg, having lower read / write processing power than the current storage tier, eg, storage tier) is handled for a hosted computing environment with virtual volumes associated with the data move. It can result in a reduction in transactions being done. As an example, a cloud computing system has a tier where certain blocks are slower, for example, to reduce memory or processor resources allocated to a hosted computing environment that has virtual volumes associated with the relocated blocks. Information can be used to indicate that it has been moved to. In another example, when a data move moves a block from a slower storage tier to a faster storage tier, the cloud computing system uses the information about this data move to associate the virtual volume with the data move. Hosted computing environments can be moved to faster processors or system buses.

Accordingly, embodiments of the present disclosure cover techniques (eg, methods, systems, and computer program products) for enabling management of cloud resources based on tiered storage data movement. The technique is performed by a tiered storage system in order to receive a request from the cloud computing system and provide the cloud computing system with a notification that the tiered storage system will initiate data movement. Can be executed. Data movement involves moving data related to a cloud computing system from a first storage tier to a second storage tier. In some embodiments, the notification includes an indication of a condition (eg, a reason or a trigger event) for initiating (eg, invoking and executing) data movement. The technique can also be performed by a tiered storage system to determine that the conditions for initiating the data movement are further met and to initiate the data movement in response to that determination. The tiered storage system can then send a notification to the cloud computing system in response to the start of data movement.

In some embodiments, the first storage tier (eg, the source of the data movement) has a different performance level than the performance level of the second storage tier (eg, the destination of the data movement).

In some embodiments, the request received from the cloud computing system includes criteria for causing the tiered storage system to provide notifications. In these embodiments, the notification is transmitted in response to a determination that the criteria are met. Criteria may be based on at least one of a data movement and a condition for initiating the data movement. Criteria can also be based on the collective characteristics of a set (eg, one or more) of data movement initiated by a tiered storage system. The collective characteristic can be, for example, the frequency of data movement from a storage tier with a first performance level to a storage tier with a second performance level lower than the first performance level. Another example of a collective characteristic is the frequency of data movement from a storage tier in response to a determination that the storage tier has insufficient storage capacity.

In some embodiments, the data associated with a cloud computing system can be one or more blocks of data that implements virtual volumes associated with a hosted computing environment.

In certain embodiments, the conditions for initiating data movement are that the input / output resource utilization of the storage tier reaches a threshold utilization level and that the amount of data associated with the cloud computing system reaches the threshold amount. Alternatively, it can be at least one of exceeding this and the amount of data stored in the first layer reaching the threshold amount. Other criteria are possible.

Other embodiments of the present disclosure cover techniques for allocating cloud resources in cloud computing systems based on data movement by tiered storage systems (eg, methods, systems, and computer program products). To do. The technique can be performed, for example, by a cloud computing system to improve the utilization of clouding computing resources in response to data movement initiated by a tiered storage system. The technique involves sending a request to a tiered storage system to provide a notification that the tiered storage system has initiated a data move. Data movement may include moving data related to a cloud computing system from a first storage tier to a second storage tier. The notification may include instructions on the conditions for initiating the data movement. The technique may further include receiving notifications from a tiered storage system. The technique may then include identifying hosted computing environments with volumes (eg, virtual volumes) associated with data movement using received notifications. The technique may then include deciding whether to change the allocation of resources to the identified hosted computing environment. The technique may further include changing the resource allocation in response to the decision to change the resource allocation to the hosted computing environment.

In some embodiments, the request sent to the tiered storage system includes criteria for providing notifications. Criteria can be based, for example, on whether the storage tier that is the source of the data movement has better performance than the performance of the storage tier that is the destination of the data movement. Criteria can also be based on at least one of the data movement direction and the conditions for initiating the data movement. Criteria can further be based on the collective characteristics of a set (eg, one or more) of data movement initiated by a tiered storage system. The collective characteristic can be the frequency or total number of data movements from the storage tier with the first performance level to the storage tier with the second performance level lower than the first performance level. The collective characteristic can also be the frequency, or total number, of data movements from the storage tier in response to a determination that the storage tier has insufficient storage capacity. Aggregate characteristics further include data associated with a set of hosted computing environments (eg, virtual volumes of that set of hosted computing environments) from a first storage system to a second storage system. Can be a data move to.

In some embodiments, the resources allocated in a cloud computing system may include memory, processors, and communication bandwidth allocated in a hosted computing environment.

In some embodiments, changing resource allocation involves moving a hosted computing environment from a first host computing system to a second host computing system. In some embodiments, changing resource allocation involves suspending the execution of a hosted computing environment. In certain embodiments, changing resource allocation involves notifying a user associated with a hosted computing environment to cause the user to change the resource allocation to the hosted computing environment. In another embodiment, changing the resource allocation involves notifying the service associated with the hosted computing environment and causing the server to change the resource allocation.

As used herein, the term cloud computing system is intended to allow access to shared pools of configurable resources (eg, computer networks, servers, storage, applications and services). Includes computing systems (eg, host computing systems) and applications configured in. A cloud computing system supports or hosts a hosted computing environment (eg, a virtual machine) at the top of the software and firmware layers that provides the hardware abstraction associated with the cloud computing system. Can be done. The operation of a cloud computing system can be managed (eg, controlled and executed) by one or more software applications (“cloud managers”).

As used herein, a logical volume is on a virtual disk or one or more storage volumes within a virtual disk partition that can be viewed as a single persistent storage in a computing environment. Is an abstraction of the storage space of (for example, physical expansion of a storage volume). A tiered storage system can provide, for example, one or more logical volumes to a cloud computing system. A cloud computing system can partition its logical volume into one or more virtual volumes that can be assigned to a hosted computing environment.

A logical volume can be seen by a cloud computing system as a single volume of storage, but a logical volume is assigned to a cloud computing system from the perspective of a tiered storage system1 Seen as a pair of blocks. Hierarchical storage systems typically do not recognize virtual volume partitions for logical volumes. In some environments, tiered storage systems are unaware of the structure of logical volumes. Similarly, a cloud computing system may be unaware of the administrative actions performed on a block of its logical volume (eg, data movement between hierarchies and trigger events and conditions that initiate data movement).

Although this disclosure includes a detailed description of cloud computing, it is understood in advance that the implementations of the teachings given herein are not limited to cloud computing environments. Rather, embodiments of the present invention can be implemented in conjunction with any other type of computing environment currently known or later developed.

Cloud computing is a shared pool of configurable computing resources that can be quickly supplied and released within minimal management effort or interaction with a service provider (eg, network, network bandwidth, servers, etc.) It is a model of service delivery that enables convenient on-demand network access to processing, memory, storage, applications, virtual machines, and services. This cloud model may include at least 5 characteristics, at least 3 service models, and at least 4 deployment models.

The characteristics are as follows.
On-Demand Self-Service: Cloud consumers automatically and unilaterally provide computing power, such as server time and network storage, as needed, without the need for human interaction with service providers. Can be supplied.
Broad network access: Capabilities are available over the network and depend on heterogeneous thin or thick client platforms (eg, mobile phones, laptops, and PDAs). Accessed through standard mechanisms that facilitate use.
Resource pooling: Provider computing resources are pooled to serve multiple consumers using a multi-tenant model, and different physical and virtual resources are dynamically allocated and reallocated on demand. Consumers generally do not have control or knowledge of the exact location of the resources provided, but may be able to specify a location (eg, country, state, or data center) at a higher level of abstraction. In terms of points, there is a sense of positional independence.
Rapid Adaptability: Capabilities can be supplied quickly and flexibly, and in some cases can be automatically, quickly scaled out and quickly released and quickly scaled in. To consumers, the capacity available to supply often looks unlimited and can be purchased in any quantity at any time.
Measured Services: Cloud systems utilize resource utilization by leveraging measurement capabilities with some level of abstraction appropriate for the type of service (eg, storage, processing, bandwidth, and active user accounts). Automatically control and optimize. Resource use can provide transparency for both providers and consumers of services that are monitored, controlled and reported.

The service model is as follows.
Software as a Service (Software as a Service): The capabilities provided to consumers are intended to use the provider's applications running on the cloud infrastructure. The application is accessible from a variety of client devices via a thin client interface such as a web browser (eg, web-based email). Consumers do not manage or control the underlying cloud infrastructure, including networks, servers, operating systems, storage, or even individual application capabilities, with the exception of limited user-specific application configuration settings.
Platform as a Service (PaaS): The capabilities provided to consumers are on applications created or acquired by cloud infrastructure consumers created using programming languages and tools supported by the provider. The purpose is to deploy to. Consumers do not manage or control the underlying cloud infrastructure, including networks, servers, operating systems, or storage, but control deployed applications and possibly application hosting environment configurations.
Infrastructure as a Service (IAAS): The capabilities provided to consumers allow them to deploy and run any software that may include processing, storage, networks, and operating systems and applications. The purpose is to supply other basic computing resources. Consumers do not manage or control the underlying cloud infrastructure, but control the operating system, storage, deployed applications, and in some cases limit selected network components (eg, host firewalls). To control.

The deployment model is as follows.
Private cloud: The cloud infrastructure works only for the organization. It may be controlled by an organization or a third party and may exist on-premises or off-premises.
Community Cloud: A cloud infrastructure is shared by several organizations to support specific communities with common interests (eg, missions, security requirements, policies, and compliance considerations). It may be controlled by an organization or a third party and may exist on-premises or off-premises.
Public Cloud: The cloud infrastructure is made available to the general public or large industrial groups and is owned by the organization that sells cloud services.
Hybrid Cloud: The cloud infrastructure remains a unique entity, but is tied together by standard or proprietary technologies that enable data and application portability (for example, cloud bursting for load balancing between clouds). It is a composite of two or more clouds (private, community, or public).

Cloud computing environments are service-oriented with an emphasis on statelessness, low coupling, modularity, and semantic interoperability. At the heart of cloud computing is an infrastructure with a network of interconnected nodes.

Here, referring to FIG. 1, a schematic diagram of an example of a cloud computing node is shown. The cloud computing node 10 is merely an example of a suitable cloud computing node and is intended to imply any limitation with respect to the use or scope of functionality of the embodiments of the invention described herein. Not. Nevertheless, the cloud computing node 10 is capable of implementing and / or performing any of the aforementioned functionality.

Within the cloud computing node 10, there is a computer system / server 12 capable of operating with the environment or configuration of many other general purpose or dedicated computing systems. Examples of well-known computing systems, environments, or configurations or combinations thereof that may be suitable for use with computer systems / servers 12 are personal computer systems, server computer systems, thin clients, and chic. Clients, handheld or laptop devices, multiprocessor systems, microprocessor-based systems, set-top boxes, programmable household appliances, network PCs, minicomputer systems, mainframe computer systems, And, but are not limited to, distributed cloud computing environments that include any of the systems or devices described above.

The computer system / server 12 can be described in the general context of computer system executable instructions such as program modules being executed by the computer system. In general, a program module can include routines, programs, objects, components, logic, data structures, etc. that perform a particular task or implement a particular abstract data type. The computer system / server 12 may be implemented in a distributed cloud computing environment in which tasks are performed by remote processing devices linked over a communication network. In a distributed cloud computing environment, program modules can be located on both local computer system storage media, including memory storage devices, and remote computer system storage media.

As shown in FIG. 1, the computer system / server 12 in the cloud computing node 10 is shown in the form of a general purpose computing device. The components of the computer system / server 12 include a bus 18 that connects one or more processors or processing units 16, system memory 28, and various system components, including system memory 28, to the processor 16. It may include, but is not limited to.

Bus 18 is of several types of buses, including memory buses or memory controllers, peripheral buses, accelerated graphics ports, and processors or local buses that use any of the various bus architectures. Represents one or more of the structures. As an example, and without limitation, such architectures include Industry Standard Architecture (ISA) buses, Micro Channel Architecture (MCA) buses, Enhanced ISA (EISA) buses, etc. Includes the Video Electronics Standards Association (VESA) local bus and the Peripheral Component Interconnects (PCI) bus.

The computer system / server 12 typically includes various computer system readable media. Such media may be any available medium accessible by the computer system / server 12, which may include both volatile and non-volatile media, both removable and non-removable media. Including.

The system memory 28 may include computer system readable media in the form of volatile memory, such as random access memory (RAM) 30 and / or cache memory 32. The computer system / server 12 may further include other removable / non-removable, volatile / non-volatile computer system storage media. As merely an example, the storage system 34 may be provided for reading from and writing to a non-removable, non-volatile magnetic medium (not shown, commonly referred to as a "hard drive"). A magnetic disk drive, not shown, for reading from and writing to a removable, non-volatile magnetic disk (eg, a "floppy disk"), and a CD-ROM, DVD-ROM, or other optical medium, etc. An optical disk drive for reading from or writing to a removable non-volatile optical disk can be provided. In such cases, each may be connected to bus 18 by one or more data medium interfaces. As further depicted and described below, the memory 28 comprises at least one program product having a set (eg, at least one) of program modules configured to perform the functions of embodiments of the present invention. Can include.

A program / utility 40 having a set (at least one) of program modules 42 includes, by way of example, and without limitation, memory 28, as well as an operating system, one or more application programs, and other programs. Can be stored in modules and program data. An operating system, one or more application programs, other program modules, and / or some combination of program data may include implementations of a network environment. Program module 42 generally performs the function and / or methodology of embodiments of the invention as described herein.

The computer system / server 12 may also be one or more external devices 14, such as a keyboard, pointing device, display 24, etc., and one or more devices that allow the user to interact with the computer system / server 12. Communicates with a device, or any device (eg, network card, modem, etc.) that allows the computer system / server 12 to communicate with one or more other computing devices, or a combination thereof. obtain. Such communication can occur via the input / output (I / O) interface 22. In addition, the computer system / server 12 may, via a network adapter 20, a local area network (LAN), a general wide area network (WAN), a public network (eg, the Internet), or a combination thereof. Can communicate with one or more networks of. As shown, the network adapter 20 communicates with other components of the computer system / server 12 via bus 18. Although not shown, it should be understood that other hardware and / or software components may be used in conjunction with the computer system / server 12. Examples include, but are not limited to, microcodes, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data archive storage systems.

Here, referring to FIG. 2, an exemplary cloud computing environment 50 is depicted. As shown, the cloud computing environment 50 may include, for example, a personal digital assistant (PDA) or mobile phone 54A, a desktop computer 54B, a laptop computer 54C, or an automobile computer system 54N or a combination thereof. It comprises one or more cloud computing nodes 10 through which local computing devices used by cloud consumers, such as, can communicate. Nodes 10 can communicate with each other. Node 10 is physically or virtually grouped (illustrated) in one or more networks, such as a private cloud, community cloud, public cloud, or hybrid cloud or a combination thereof as described above. Can be done. This allows the cloud computing environment 50 to provide infrastructure, platforms or software, or a combination thereof, as a service that does not require cloud consumers to maintain resources on their local computing devices. The types of computing devices 54A-N shown in FIG. 2 are merely intended to be exemplary, and the computing node 10 and cloud computing environment 50 are any type of network or network address. It is understood that it is possible to communicate with any type of computerized device via possible connections (eg, using a web browser) or both.

Here, with reference to FIG. 3, a set of functional abstraction layers provided by the cloud computing environment 50 (FIG. 2) is shown. It should be understood in advance that the components, layers, and functions shown in FIG. 3 are merely intended to be exemplary and the embodiments of the present invention are not limited thereto. The following layers and corresponding functions are provided, as illustrated.

The hardware and software layer 60 includes hardware components and software components. Examples of hardware components include mainframes, servers based on RISC (Reduced Instruction Set Computer) architecture, storage devices, networks, and network components. In some embodiments, the software component includes network application server software.

The virtualization layer 62 is an abstraction that can provide the following examples of virtual entities: virtual servers, virtual storage, virtual networks including virtual private networks, virtual applications and operating systems, and virtual clients. Brings a chemical layer.

In one example, the management layer 64 may provide the functions described below. Resource supply results in the dynamic procurement of computing resources and other resources used to perform tasks within a cloud computing environment. Measurement and pricing provide cost tracking as resources are used within a cloud computing environment and billing or billing for the consumption of these resources. In one example, these resources may include application software licenses. Security provides cloud consumer and task identity verification, as well as protection of data and other resources. The user portal provides access to the cloud computing environment for consumers and system administrators. Service level management provides the allocation and management of cloud computing resources to meet the required service levels. The planning and implementation of service level agreements (SLAs) result in the advance arrangement and procurement of cloud computing resources for which future requirements are predicted in accordance with SLA.

The workload layer 66 provides an example of the functionality that a cloud computing environment can utilize for that purpose. Examples of workloads and features that can be provided from this layer include mapping and navigation, software development and lifecycle management, virtual classroom education delivery, data analysis processing, transaction processing, and mobile desktops.

With reference to the figure here, FIG. 4 shows a series of operations 400 for enabling management of cloud resources based on tiered storage data movement according to various embodiments. Operation 400 can be performed by a tiered storage system such as the tiered storage system 705 (FIG. 7). In some embodiments, operation 400 is automatically performed by the tiered storage system storage manager application according to the feedback provided by the tiered storage system hardware and other software components. be able to. The storage manager may include computer executable code that can be executed by a computing system such as computer system 12 (FIG. 1). In some embodiments, the computing system may be a hardware component (eg, a tiered storage server) associated with layer 60 of the cloud computing system shown in FIG. In certain embodiments, the computing system (eg, tiered storage system) is separate from the cloud computing system.

The tiered storage system can perform operation 405 to receive a request from the cloud computing system and provide data movement notifications for data blocks associated with the cloud computing system. A cloud computing system can be a tenant of a tiered storage system and can be assigned one or more data blocks of storage on the tiered storage system. In some embodiments, the request is received via a storage driver. In other embodiments, the request may be received in a data packet over a communication channel (eg, communication cable, bus, data communication network, etc.) that couples the tiered storage system to the cloud computing system. The request can be made in a data structure that can be extracted from the data packet by the storage manager associated with the hierarchical computing system.

In some embodiments, the tiered storage system has two or more storage tiers. A storage tier is a storage resource (eg, storage volume and communication hardware and software) that has specific performance characteristics that distinguish it from another storage resource or storage tier. The first storage tier can have, for example, more input / output (I / O) processing power, more storage capacity, or more communication bandwidth than the second storage tier. Storage systems can move data from one storage tier to another, for example, to optimize cost, performance, and storage space. Data movement is, for example, moving data related to a cloud computing system (eg, a block of data assigned to a cloud computing system) from a first storage tier to a second storage tier. May include.

In some embodiments, the tiered storage system can be automatically triggered to initiate data movement in response to a set of trigger conditions (hereinafter referred to as conditions). The trigger condition can be any event or condition related to the storage tier or tenant of the tiered storage system. The trigger condition can be, for example, an indication that the I / O resource utilization of the storage hierarchy (eg, read / write operations, data bus bandwidth, and stored data) has reached or exceeded the threshold utilization level. In another example, the trigger condition can be an indication that the amount of data stored in the storage tier by the tenant (eg, cloud computing system) has reached or exceeded the threshold amount. As a third example, the trigger condition can be an indication that the use of the cloud computing system of the tiered storage system exceeds the applied or paid usage level.

In certain embodiments, the notification is a data structure generated by a tiered storage system and is transmitted to a cloud computing system. The notification may include an indication of the condition (eg, the trigger condition) that caused the storage system to initiate the data movement. Notifications can further direct changes in blocks, storage tiers, and storage performance levels related to data movement.

In some embodiments, the request received in operation 405 may include criteria (eg, policies) for causing the tiered storage system to provide data movement notifications. Criteria can be based on data movements and conditions that trigger data movements. The criteria are, for example, that a tiered storage system moves data from a first storage tier with a first performance level to a second storage tier with a second performance level lower than the first performance level. When it starts (for example, a data move that moves data from a faster storage tier to a slower storage tier), the tiered storage system can be provided with a data move notification. As another example, the criterion is that the number of I / O operations processed by the storage tier (for example, for cloud computing systems) exceeds the threshold number of I / O operations (this information is billed). Data movement notifications can be provided to the tiered storage system when the tiered storage system initiates data movement in response to (which can be used by cloud computing systems for the purpose of).

Criteria can also be based on the collective characteristics of data movement initiated by a tiered storage system. An example of a collective characteristic includes the frequency of data movement from a storage tier having a first performance level to a storage tier having a second performance level, the second performance level being lower than the first performance level. Another example of a collective performance characteristic is the frequency or total number of data movements from a storage tier in response to a determination that the storage tier has insufficient storage capacity or I / O bandwidth. Other individual or collective criteria for having a tiered storage system provide data movement notifications may be used in conjunction with the techniques described herein.

The tiered storage system can perform operation 410 for determining whether the conditions for initiating data movement from the first storage tier to the second storage tier are met. Performing operation 410 may include, for example, querying a storage controller associated with the storage tier to determine the amount of storage space available in the storage tier and the I / O utilization of the storage tier. .. Performing action 410 can also be used for tenant actions, for example to evaluate collective trigger conditions, or for tenant-based conditions (eg, I / O requests from tenants exceed the request threshold). It may include monitoring or logging I / O operations or transactions performed by the storage tier to evaluate the conditions that are triggered in response.

In some embodiments, the information queried or monitored while performing operation 110 is used to evaluate the conditions for providing data movement notifications, as described herein. Can be logged in the data structure.

The tiered storage system performs operation 415 and initiates a data movement event in response to a determination that the conditions for initiating data movement from the first storage tier to the second storage tier have been met. can do. Initiating a data transfer may include selecting one or more blocks of data and transferring it from the first storage tier to the second storage tier. Initiating a data move stores information related to the data move in the data structure, including, for example, the source hierarchy, destination hierarchy, trigger conditions, moved data blocks, and tenants affected by the data move. Can further include that.

In some embodiments, the tiered storage system performs operation 420 to determine if the criteria for providing notifications to the cloud computing system (eg, data movement notification criteria) are met. Can be determined. Performing operation 420 may include identifying cloud computing systems that are affected by the data movement initiated in operation 415. Performing operation 420 uses the logged data movement information to evaluate the data movement notification criteria received from the cloud computing system identified in operation 405, as described herein. Can further include doing. Evaluating a data movement notification criterion is the calculation of one or more statistics about the data movement information, and one or more logical actions using that statistic and, for example, the thresholds associated with the movement notification criterion. May include performing. The tiered storage system can return to operation 410 in response to the determination that the criteria were not met, while the tiered storage system responds to the determination that the criteria are met. Then, the operation 425 can be proceeded.

The storage system can perform operation 425 to send a notification to the cloud computing system. Performing operation 425 involves, for example, a data structure that has information related to the indication of the moved data block, the conditions or reasons for initiating the data movement, and the performance of the storage tier involved in the data movement. May include producing. Performing operation 425 may further include performing one or more operations to send a notification to the cloud computing system over the communication channel.

FIG. 5 shows a series of operations 500 for allocating cloud resources in a cloud computing system based on tiered storage data movement according to various embodiments. Operation 500 can be performed by a cloud computing system such as cloud computing system 805 (FIG. 8). In some embodiments, operation 500 may be performed automatically by a cloud manager application in a cloud computing system. The cloud manager may include code that can be executed by a computing system such as computer system 12 (FIG. 1). In some embodiments, the cloud manager is a software component associated with layer 64 of the cloud computing system shown in FIG.

The cloud computing system can perform operation 505 and send a request to the tiered storage system to provide a notification that the tiered storage system has started moving data. Data movement is assigned, for example, from a first storage tier to a second storage tier, data associated with a cloud computing system (eg, a cloud computing system), as described herein. Data blocks) may include moving. The notification can be a data structure generated by a tiered storage system and can be sent to a cloud computing system, as described herein. In some embodiments, the request includes criteria for having the tiered storage system provide data movement notifications. The characteristics of the reference are consistent with the criteria described in the discussion of operation 400 (FIG. 4). Performing operation 505 may include generating the requesting data structure and transmitting the data structure to the hierarchical storage system over the communication channel.

The cloud computing system can perform operation 510 to receive notifications (eg, data movement notifications) from the tiered storage system. Notifications can be received in data packets from communication channels that combine tiered storage systems with cloud computing systems. Notification can be performed, for example, by a cloud manager in a data structure that can be extracted from the data packet. The notification may include instructions for the block to be moved, conditions or reasons for initiating the data movement, and information related to the performance of the storage tier involved in the data movement, as described herein.

The cloud computing system can perform operation 515 and use the notifications received to identify a hosted computing environment with virtual volumes associated with data movement. Performing operation 515 includes determining one or more blocks of data related to the data movement operation from the notification. Performing operation 515 is then received, for example, from the data structure mapping block of the logical volume of the cloud computing system to one or more virtual volumes assigned to the hosted computing environment. It may include determining a hosted computing environment with virtual volumes associated with one or more blocks indicated in the notification.

The cloud computing system can perform operation 520 to determine whether to change the allocation of resources to the identified hosted computing environment. Performing operation 520 may include determining from the data structure that stores the storage tier movement policy whether to change the allocation of resources to the hosted computing environment. In some embodiments, the storage tier movement policy may indicate conditions or criteria for changing the allocation of resources to one or more hosted computing environments in response to tiered storage data movement. In some embodiments, the conditions or criteria can be substantially the same as the criteria for causing the tiered storage system to send data movement notifications. The cloud computing system can return to operation 510 in response to the decision not to change the allocation of resources to the identified hosted computing environment, while the cloud computing system Operation 525 can proceed in response to the decision to change the allocation of resources to the identified hosted computing environment.

The cloud manager can perform operation 525 to change the allocation of resources to the hosted computing environment in response to the decision to change the allocation of resources to the hosted computing environment. In some embodiments, the resources allocated to the host computing environment may include at least one of the allocated memory, processing resources, and communication resources (eg, communication bandwidth). Changing resource allocation involves moving an identified hosted computing environment from a first host computing system to a second host computing system in a cloud computing system. obtain. Changing resource allocation also includes suspending the execution of the identified hosted computing environment. In some embodiments, changing the resource allocation involves notifying the user associated with the hosted computing environment and causing the user to change the resource allocation. In some embodiments, changing the resource allocation involves notifying the service associated with the identified hosted computing environment to change the resource allocation to the service. In other embodiments, the allocation of one or more other resources may be modified according to other stored storage tier movement policies.

FIG. 6 shows a block diagram of an exemplary cloud computing environment 600 using tiered storage, according to various embodiments. The cloud computing environment 600 includes a cloud computing system 605 coupled to a tiered storage system 635 using a communication channel 650.

In some embodiments, the cloud computing system 605 is software for enabling or hosting a hosted computing environment 610 and a hosted computing environment 620, as described herein. • Includes one or more computing systems running applications and firmware applications. The cloud computing system 605 also has a volume 630 (eg, logical) having one or more blocks assigned to the virtual volume 615 of the hosted computing environment 610 and the virtual volume 625 of the hosted computing environment 620. Volume) can be included. All or part of volume 630 may be stored in tiered storage system 635 on storage tier 1 640 or storage tier 2 645, as described herein.

In some embodiments, the communication channel 650 is configured to transfer data in one or more data structures or packets between the cloud computing system 605 and the tiered storage system 635. , Data bus, communication cable, or data communication network.

FIG. 7 shows a block diagram of an exemplary tiered storage system 705 according to various embodiments. The tiered storage system 705 may include a processor 710, memory 715, and tiered storage 730. The memory 715 may include a storage manager 720 and a notification policy 725. The storage manager 720 can run on processor 710 to perform the operations and techniques described herein. The notification policy 725 may include a data movement notification request from a registered tenant (eg, a cloud computing system that submits a data movement notification request). The request may include criteria for causing the tiered storage system 705 to provide data movement notifications, as described herein. The tiered storage 730 may include storage tier 1 735 and storage tier 2 750. Storage tier 1 735 may have performance levels or grades and may include one or more storage drives (eg, disk drives, solid state drives, etc.) that store data blocks 745A and 745B. Storage tier 2750 may have different performance levels or grades and may include one or more storage drives storing data blocks 760A and 760B.

FIG. 8 shows a block diagram of an exemplary cloud computing system 800 according to various embodiments. The tiered cloud computing system 805 may include a processor 810, memory 815, and tiered storage 855 (eg, a logical volume). The memory 815 may include a cloud manager 820, a storage tier movement policy 825, and a hosted computing environment 830. The cloud manager 820 can run on processor 810 to perform the operations and techniques described herein. The hosted computing environment 830 may include an operating system 835 and allocated resources such as memory 840, communication resources 845, and virtual volume 850.

The present invention may be a system, method, computer program product, or a combination thereof. A computer program product may include one or more computer readable storage media having computer readable program instructions for causing a processor to perform aspects of the invention.

The computer-readable storage medium can be a tangible device capable of holding and storing instructions used by the instruction executing device. The computer-readable storage medium may be, for example, an electronic storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any suitable combination described above, but is not limited thereto. A non-inclusive list of more specific examples of computer-readable storage media includes portable computer disksets, hard disks, random access memory (RAM), read-only memory (ROM), and erasable programmable read-only. Memory (EPROM or Flash Memory), Static Random Access Memory (SRAM), Portable Compact Disc Read-Only Memory (CD-ROM), Digital Versatile Disc (DVD), Memory Stick, Floppy Disk, Included are mechanically encoded devices such as punch cards or raised structures in grooves where instructions are recorded, and any suitable combination described above. As used herein, a computer-readable storage medium passes through a radio wave or other freely propagating electromagnetic wave, an electromagnetic wave propagating through a waveguide or other transmission medium (eg, a fiber optic cable). It should not be interpreted as a transient signal itself, such as an optical pulse) or an electrical signal transmitted over a wire.

The computer-readable program instructions described herein are from computer-readable storage media to their respective computing / processing devices, or networks such as the Internet, local area networks, wide area networks or wireless networks or the like. It can be downloaded to an external computer or external storage device via a combination. The network may include copper transmission cables, optical transmission fibers, wireless transmissions, routers, firewalls, switches, gateway computers or edge servers, or a combination thereof. A network adapter card or network interface within each computing / processing device receives computer-readable program instructions from the network and is a computer-readable program for storage in the computer-readable storage medium within each computing / processing device. Transfer instructions.

Computer-readable program instructions for performing the operations of the present invention are assembler instructions, instruction set architecture (ISA) instructions, machine instructions, machine-dependent instructions, microcodes, firmware instructions, state setting data, or Smalltalk (registration). Written in any combination of one or more programming languages, including object-oriented programming languages such as Trademark), C ++, and traditional procedural programming languages, such as the "C" programming language or similar programming languages. It can be source code or object code. Computer-readable program instructions are fully on the user's computer, partially on the user's computer, as a stand-alone software package, partially on the user's computer and partially on the remote computer, or on the remote computer or server. You can do it completely with. In the latter scenario, the remote computer can or can be connected to the user's computer via any type of network, including local area networks (LANs) or wide area networks (WANs). The connection can be made to an external computer (eg, over the Internet using an Internet service provider). In some embodiments, electronic circuits, including, for example, programmable logic circuits, field programmable gate arrays (FPGAs), or programmable logic arrays (PLAs), are computer readable programs for performing aspects of the invention. Computer-readable program instructions can be executed by personalizing electronic circuits using the state information of the instructions.

Aspects of the invention are described herein with reference to the methods, devices (systems), and flow diagrams and / or block diagrams of computer program products according to embodiments of the invention. It will be appreciated that each block of the flow diagram and / or block diagram, and the combination of the flow diagram and / or block diagram, can be implemented by computer-readable program instructions.

Instructions executed through the processor of a computer or other programmable data processing device provide the means for performing a specified function / operation in one or more blocks of a flow diagram and / or block diagram. As such, these computer-readable program instructions may be provided to the processor of a general purpose computer, a dedicated computer, or other programmable data processing device to create a machine. Computer-readable storage media in which instructions are stored so that the computer-readable storage medium comprises a product containing instructions that perform the specified function / operation mode in one or more blocks of a flow diagram and / or block diagram. The readable program instructions may be those stored on a computer-readable storage medium that can instruct a computer, programmable data processing device, or other device or combination thereof to function in a particular manner.

Computer-readable program instructions such that instructions executed on a computer, other programmable device, or other device perform the specified function / operation in one or more blocks of a flow diagram and / or block diagram. Is loaded onto a computer, other programmable data processor, or other device to spawn a process performed on the computer, and a series of operations on the computer, other programmable device, or other device. It may be one that executes a step.

The flow diagrams and block diagrams in the drawings show the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of the present invention. In this regard, each block in a flow diagram or block diagram may represent a module, segment, or part of an instruction that contains one or more executable instructions to perform a specified logical function. In some alternative implementations, the functions described in the blocks can occur outside the order shown in the figure. For example, two blocks shown in succession can actually be executed at substantially the same time, or the blocks can be executed, sometimes in reverse order, depending on the functions involved. Each block of the block diagram and / or flow diagram, and a combination of blocks of the block diagram or flow diagram or both, performs the specified function or performs or combines dedicated hardware and computer instructions. Also note that it can be implemented by a hardware-based system.

The description of the various embodiments of the present disclosure is presented for illustrative purposes and is not intended to be comprehensive or limited to the disclosed embodiments. A number of modifications and variations will be apparent to those skilled in the art without departing from the scope of the described embodiments. The terminology used herein is for those skilled in the art to explain the principles of the embodiment, practical applications or technical improvements beyond the techniques found on the market, or to those skilled in the art as disclosed herein. Selected to allow you to.

Claims (20)

A method for allocating cloud resources in a cloud computing system based on tiered storage data movement.
Sending a request to a tiered storage system to provide a notification that the tiered storage system will start moving data.
The data movement includes moving data related to the cloud computing system from a first storage tier to a second storage tier.
The transmission and the transmission, wherein the notification comprises an instruction of conditions for initiating the data movement.
Receiving the notification from the tiered storage system and
Identifying a hosted computing environment with a volume associated with the data movement using the received notification and
Determining whether to change the allocation of resources to the hosted computing environment and
A method comprising changing the allocation of the resource to the hosted computing environment in response to a decision to change the allocation of the resource to the hosted computing environment. The first aspect of the present invention is based on whether the request includes a criterion for providing the notification, and the criterion has a performance superior to that of the second storage tier. the method of. The method of claim 1, wherein the request comprises a criterion for providing the notice, wherein the criterion is based on the collective nature of the data movement. The collective property
The frequency of data movement from the storage tier having the first performance level to the storage tier having the second performance level lower than the first performance level, and
The frequency of data movement from the storage tier in response to the determination that the storage capacity of the storage tier is insufficient, and
The method of claim 3, wherein the method of claim 3 is at least one of data movements of data associated with a set of hosted computing environments from a first storage system to a second storage system. The method of claim 1, wherein the resource comprises at least one of allocated memory, processing resources, and communication bandwidth. The method of claim 1, wherein changing the allocation of resources comprises moving the hosted computing environment from a first host computing system to a second host computing system. .. The method of claim 1, wherein changing the resource allocation suspends execution of the hosted computing environment. The method of claim 1, wherein changing the resource allocation comprises notifying a user associated with the hosted computing environment and causing the user to change the resource allocation. The method of claim 1, wherein the modification of the resource allocation comprises notifying a service associated with the hosted computing environment and causing the service to change the resource allocation. A system for allocating cloud resources in a cloud computing system based on tiered storage data movement.
With one or more computing nodes with memory and processors,
The program instruction comprises a non-transient computer-readable storage medium of the one or more computing nodes in which the program instruction is embodied.
Sending a request to a tiered storage system to provide a notification that the tiered storage system will start moving data.
The data movement includes moving data related to the cloud computing system from a first storage tier to a second storage tier.
The transmission and the transmission, wherein the notification comprises an instruction of conditions for initiating the data movement.
Receiving the notification from the tiered storage system and
Identifying a hosted computing environment with a volume associated with the data movement using the received notification and
Determining whether to change the allocation of resources to the hosted computing environment and
Performed by the processor to cause the system to change the allocation of the resource to the hosted computing environment in response to a decision to change the allocation of the resource to the hosted computing environment. Possible, system. 10. The claim is set forth in claim 10, wherein the request includes a criterion for providing the notification, based on whether the criterion has better performance than the performance of the second storage tier. System. 10. The system of claim 10, wherein the request comprises a criterion for providing the notice, the criterion being based on the collective nature of the data movement. The collective property
The frequency of data movement from the storage tier having the first performance level to the storage tier having the second performance level lower than the first performance level, and
The frequency of data movement from the storage tier in response to the determination that the storage capacity of the storage tier is insufficient, and
The system according to claim 12, which is at least one of data movements of data associated with a set of hosted computing environments from a first storage system to a second storage system. 10. The system of claim 10, wherein the resource comprises at least one of allocated memory, processing resources, and communication bandwidth. 10. The system of claim 10, wherein changing the allocation of resources includes moving the hosted computing environment from a first host computing system to a second host computing system. .. 10. The system of claim 10, wherein changing the allocation of resources suspends execution of the hosted computing environment. 10. The system of claim 10, wherein changing the resource allocation comprises notifying a user associated with the hosted computing environment and causing the user to change the resource allocation. 10. The system of claim 10, wherein changing the resource allocation involves notifying a service associated with the hosted computing environment and causing the service to change the resource allocation. A computer program product for allocating cloud resources in a cloud computing system based on tiered storage data movement, said computer program product including a computer-readable storage medium in which program instructions are embodied. The computer-readable storage medium is not the transient signal itself, but the program instructions
Sending a request to a tiered storage system to provide a notification that the tiered storage system will start moving data.
The data movement includes moving data related to the cloud computing system from a first storage tier to a second storage tier.
The transmission and the transmission, wherein the notification comprises an instruction of conditions for initiating the data movement.
Receiving the notification from the tiered storage system and
Identifying a hosted computing environment with a volume associated with the data movement using the received notification and
Determining whether to change the allocation of resources to the hosted computing environment and
The processing circuit is made to perform a method including changing the allocation of the resource to the hosted computing environment in response to the decision to change the allocation of the resource to the hosted computing environment. A computer program product that can be executed by a processing circuit. 19. The claim comprises a criterion for providing the notification, wherein the criterion is based on whether the first storage tier has better performance than the performance of the second storage tier. Computer program products.