CN104717247A - Method and system for dynamically scheduling storage resources in cloud storage system - Google Patents
Method and system for dynamically scheduling storage resources in cloud storage system Download PDFInfo
- Publication number
- CN104717247A CN104717247A CN201310682932.4A CN201310682932A CN104717247A CN 104717247 A CN104717247 A CN 104717247A CN 201310682932 A CN201310682932 A CN 201310682932A CN 104717247 A CN104717247 A CN 104717247A
- Authority
- CN
- China
- Prior art keywords
- operation system
- storage resources
- information
- described operation
- cloud storage
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1097—Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The embodiment of the invention discloses a method and system for dynamically scheduling storage resources in a cloud storage system. The method comprises the steps that when a service system uses the cloud storage resources, the service type information provided by the service system, the storage resource information distributed to the service system and the information of the service condition of storage resources distributed to the service system are collected; according to a preset mode, modeling analysis is conducted on the service type information of the service system, the storage resource information distributed to the service system and the information of the service condition of the storage resources distributed to the service system, and storage resource information needed by the service system is obtained; whether the storage resources distributed to the service system support the storage resources needed by the service system or not is identified, if not, scheduling of the cloud storage resources is conducted, and corresponding storage resources in the cloud storage resources are scheduled for the service system according to the storage resource information needed by the service system. The method and system can achieve dynamic scheduling of the storage resources according to the requirements for storage resources of the service system.
Description
Technical field
The present invention relates to the storage resources dispatching technique in cloud stores service, especially a kind of dynamic dispatching method to storage resources in cloud storage system and system.
Background technology
At present, cloud storage system mainly through the storage resources of different stage in cloud memory resource pool, for different operation systems provides stores service.But the demand of different operation systems to storage resources is different.Such as, the medium and small data block files predominate of net dish class operation system, read-write mode is based on random read-write, net dish class operation system is less demanding to performance index such as the bandwidth of storage resources, input-output operation per second (Input/Output Operations Per Second, IOPS) and response times; And long data block files predominate in video playback class operation system, read-write mode is based on order read-write, higher to the bandwidth requirement of storage resources, but requires general to IOPS and response time etc.From the angle promoting cloud utilization ratio of storage resources and user's service level, cloud storage system needs the storage resources to different operation systems configuration different stage.
But realizing in process of the present invention, inventor finds that prior art at least exists following problem:
Existing cloud storage system is the storage resources that operation system is distributed is static constant, the perception to different business systems can not be realized, the dynamic dispatching of storage resources cannot be realized according to the demand of operation system to storage resources, therefore cannot meet the individual demand of operation system to storage resources, also cannot improve the reasonable utilization rate of storage resources.
Summary of the invention
Embodiment of the present invention technical problem to be solved is: provide a kind of dynamic dispatching method to storage resources in cloud storage system and system, to realize the dynamic dispatching of storage resources according to the demand of operation system to storage resources.
A kind of dynamic dispatching method to storage resources in cloud storage system that the embodiment of the present invention provides, comprising:
When operation system uses cloud storage resources, the storage resources information of gather traffic type information that described operation system provides, distributing to described operation system and described operation system are to the service condition information of the storage resources distributed;
According to predetermined manner, modeling analysis is carried out to the traffic type information of described operation system, the storage resources information of distributing to described operation system and the service condition information of described operation system to the storage resources distributed, obtain the storage resources information that described operation system needs, comprising: the type of storage resources and amount of capacity information;
Identify whether the storage resources information of distributing to described operation system supports the storage resources of described operation system needs;
If the storage resources information of distributing to described operation system does not support the storage resources of described operation system needs, then carry out the scheduling of cloud storage resources, from cloud storage resources, dispatch corresponding storage resources for described operation system according to the storage resources information that described operation system needs.
In another embodiment of said method of the present invention, the traffic type information gathering described operation system comprises:
User ID ID and the service code information of described operation system is obtained, the type of service of operation system according to user ID and service code identification from user management module.
In another embodiment of said method of the present invention, gather the storage resources information of distributing to described operation system and comprise:
From resource management module, obtain the storage resources information of distributing to described operation system, comprise the storage class of the storage resources distributed to described operation system, amount of capacity and interface type.
In another embodiment of said method of the present invention, gather the service condition information of described operation system to the storage resources distributed and comprise:
From monitoring resource module, obtain the service condition information of described operation system to the storage resources distributed, comprise input-output operation IOPS per second, bandwidth, average response time, read-write ratio, data block size and read-write frequency index.
In another embodiment of said method of the present invention, also comprise:
When operation system is registered in cloud storage system, the service code information submitted the user ID ID of this operation system to the user management module in cloud storage system and provide;
And when described operation system completes the registration in cloud storage system, the resource management module in cloud storage system to operation system memory allocated resource, and records the correspondence relationship information between the user ID of this operation system and the storage resources information of distribution.
In another embodiment of said method of the present invention, also comprise:
Monitoring resource module in cloud storage system uses in the process of cloud storage resources in operation system, the service condition of the storage resources that this operation system of Real-Time Monitoring is distributed, and record the user ID of this operation system and the service condition information to the storage resources distributed.
A kind of cloud storage system that the embodiment of the present invention provides, comprises for providing the access module of operation system access service and for providing the resource pool of storage resources, it is characterized in that, also comprise:
Acquisition module, the storage resources information of for when operation system uses cloud storage resources, gather traffic type information that described operation system provides, distributing to described operation system and described operation system are to the service condition information of the storage resources distributed;
Intelligent analysis module, according to predetermined manner, modeling analysis is carried out to the traffic type information of the described operation system of acquisition module collection, the storage resources information of distributing to described operation system and the service condition information of described operation system to the storage resources distributed, obtain the storage resources information that described operation system needs, comprising: the type of storage resources and amount of capacity information;
Identification module, for identifying whether the storage resources information of distributing to described operation system supports the storage resources of described operation system needs;
Storage resources scheduler module, for the recognition result according to identification module, if the storage resources information of distributing to described operation system does not support the storage resources of described operation system needs, then carry out the scheduling of cloud storage resources, from cloud storage resources, dispatch corresponding storage resources for described operation system according to the storage resources information that described operation system needs.
In another embodiment of said system of the present invention, also comprise:
User management module, for when operation system is registered in cloud storage system, receives the service code information that the user ID of described operation system that this operation system submits to and this operation system provide business;
Resource management module, for when described operation system completes the registration in cloud storage system, the storage resources in operation system Resources allocation pond, and record the correspondence relationship information between the user ID of this operation system and the storage resources information of distribution;
Monitoring resource module, for using in the process of cloud storage resources in operation system by access module, this operation system of Real-Time Monitoring to the service condition of the storage resources distributed, and records the user ID of this operation system and the service condition information to the storage resources distributed;
Described acquisition module, specifically obtains user ID ID and the service code information of described operation system from user management module, the type of service of operation system according to user ID and service code identification; And from resource management module, obtain the storage resources information of distributing to described operation system, comprise the storage class of the storage resources distributed to described operation system, amount of capacity and interface type; And from monitoring resource module, obtain the service condition information of described operation system to the storage resources distributed, comprise input-output operation IOPS per second, bandwidth, average response time, read-write ratio, data block size and read-write frequency index.
A kind of dynamical system to storage resources in cloud storage system that the embodiment of the present invention provides, comprises operation system and the cloud for providing operation system to access cloud storage system service stores client, it is characterized in that, also comprises:
Cloud storage system, the storage resources information of for when operation system uses cloud storage resources, gather traffic type information that described operation system provides, distributing to described operation system and described operation system are to the service condition information of the storage resources distributed; According to predetermined manner, modeling analysis is carried out to the traffic type information of described operation system, the storage resources information of distributing to described operation system and the service condition information of described operation system to the storage resources distributed, obtain the storage resources information that described operation system needs, comprising: the type of storage resources and amount of capacity information; Identify whether the storage resources information of distributing to described operation system supports the storage resources of described operation system needs; If the storage resources information of distributing to described operation system does not support the storage resources of described operation system needs, then carry out the scheduling of cloud storage resources, from cloud storage resources, dispatch corresponding storage resources for described operation system according to the storage resources information that described operation system needs.
In another embodiment of said system of the present invention, described cloud storage system is specially the cloud storage system that the above-mentioned any embodiment of the present invention provides.
The dynamic dispatching method to storage resources in cloud storage system provided based on the above embodiment of the present invention and cloud storage system, can when operation system use cloud storage resources, the traffic type information that capturing service system provides, the storage resources information of distributing to operation system and operation system are to the service condition information of the storage resources distributed; According to predetermined manner, to the service condition information of storage resources of distributing, modeling analysis is carried out to the traffic type information collected, the storage resources information of distributing to operation system and operation system, obtain the storage resources information that operation system needs, identify the storage resources information storage resources whether supporting business system needs distributed to operation system, if do not support, then carry out the scheduling of cloud storage resources, according to operation system need storage resources information from cloud storage resources for operation system dispatches corresponding storage resources.Compared with prior art, the embodiment of the present invention is applicable to the cloud storage system with different stage storage resources, service-aware can be carried out to operation system, and based on service-aware result, the dynamic dispatching of storage resources can be realized according to the demand of operation system to storage resources, effectively can meet the individual demand of operation system to storage resources, improve the reasonable utilization rate of storage resources, improve customer service quality level, solving existing cloud storage system is providing in the process of storage resources for different business systems, cannot according to the difference of operation system to storage resource demands, dynamically carry out the problem of storage resources scheduling.
Below by drawings and Examples, technical scheme of the present invention is described in further detail.
Description of the invention provides in order to example with for the purpose of describing, and is not exhaustively or limit the invention to disclosed form.Many modifications and variations are obvious for the ordinary skill in the art.Selecting and describing embodiment is in order to principle of the present invention and practical application are better described, and enables those of ordinary skill in the art understand the present invention thus design the various embodiments with various amendment being suitable for special-purpose.
Accompanying drawing explanation
What form a part for specification drawings describes embodiments of the invention, and is used from explanation principle of the present invention together with description one.
With reference to accompanying drawing, according to detailed description below, clearly the present invention can be understood, wherein:
Fig. 1 is the flow chart of the present invention to a dynamic approach embodiment of storage resources in cloud storage system.
Fig. 2 is the content example of traffic type information, the storage resources information of distribution and the service condition information to storage resources gathered in the embodiment of the present invention.
Fig. 3 is the structural representation of a cloud storage system of the present invention embodiment.
Fig. 4 is the structural representation of the present invention to the unified embodiment of the dynamical system of storage resources in cloud storage system.
Embodiment
Various exemplary embodiment of the present invention is described in detail now with reference to accompanying drawing.It should be noted that: unless specifically stated otherwise, otherwise positioned opposite, the numerical expression of the parts of setting forth in these embodiments and step and numerical value do not limit the scope of the invention.
Meanwhile, it should be understood that for convenience of description, the size of the various piece shown in accompanying drawing is not draw according to the proportionate relationship of reality.
Illustrative to the description only actually of at least one exemplary embodiment below, never as any restriction to the present invention and application or use.
May not discuss in detail for the known technology of person of ordinary skill in the relevant, method and apparatus, but in the appropriate case, described technology, method and apparatus should be regarded as a part for specification.
In all examples with discussing shown here, any occurrence should be construed as merely exemplary, instead of as restriction.Therefore, other example of exemplary embodiment can have different values.
It should be noted that: represent similar terms in similar label and letter accompanying drawing below, therefore, once be defined in an a certain Xiang Yi accompanying drawing, then do not need to be further discussed it in accompanying drawing subsequently.
Fig. 1 is the flow chart of the present invention to a dynamic approach embodiment of storage resources in cloud storage system.As shown in Figure 1, this embodiment comprises the dynamic approach of storage resources in cloud storage system:
110, the storage resources information of when operation system uses cloud storage resources, gather traffic type information that this operation system provides, distributing to this operation system and this operation system are to the service condition information of the storage resources distributed.
120, according to predetermined manner, traffic type information to the operation system collected, the storage resources information to operation system distribution and the service condition information of operation system to the storage resources distributed carry out modeling analysis, obtain the storage resources information that operation system needs, comprising: the type of storage resources and amount of capacity information.
130, identify the storage resources of the storage resources information of distributing to this operation system whether supporting business system needs.
If to operation system distribute storage resources information not supporting business system need storage resources, then perform 140 operation.Otherwise, if the storage resources of the storage resources Informational support operation system needs to operation system distribution, then do not perform subsequent operation, maintain the configuration of existing storage resources.
140, carry out the scheduling of cloud storage resources, according to operation system need storage resources information from cloud storage resources for operation system dispatches corresponding storage resources.
The dynamic dispatching method to storage resources in cloud storage system that the above embodiment of the present invention provides, can when operation system use cloud storage resources, the traffic type information that capturing service system provides, the storage resources information of distributing to operation system and operation system are to the service condition information of the storage resources distributed; According to predetermined manner, to the service condition information of storage resources of distributing, modeling analysis is carried out to the traffic type information collected, the storage resources information of distributing to operation system and operation system, obtain the storage resources information that operation system needs, identify the storage resources information storage resources whether supporting business system needs distributed to operation system, if do not support, then carry out the scheduling of cloud storage resources, according to operation system need storage resources information from cloud storage resources for operation system dispatches corresponding storage resources.Compared with prior art, the embodiment of the present invention can carry out service-aware to operation system, and based on service-aware result, the dynamic dispatching of storage resources can be realized according to the demand of operation system to storage resources, effectively can meet the individual demand of operation system to storage resources, improve the reasonable utilization rate of storage resources, solving existing cloud storage system is providing in the process of storage resources for different business systems, according to the difference of operation system to storage resource demands, cannot dynamically carry out the problem of storage resources scheduling.
Unrestricted to a concrete example of the dynamic approach embodiment of storage resources in cloud storage system according to the present invention, in operation 110 shown in Fig. 1, specifically can obtain user ID (ID) and the service code information of operation system from user management module, according to the type of service of user ID and service code identification services system; The storage resources information of distributing to operation system can be obtained from resource management module, comprise the storage class of the storage resources distributed to operation system, amount of capacity and interface type etc.; The service condition information of operation system to the storage resources distributed can be obtained from monitoring resource module, comprise the indexs such as the input-output operation IOPS per second to storage resources, bandwidth, average response time, read-write ratio, data block size and read-write frequency.As shown in Figure 2, the content example of traffic type information, the storage resources information of distribution and the service condition information to storage resources for gathering in this embodiment.
In the present invention is to cloud storage system the dynamic approach of storage resources another embodiment in, can also comprise:
When operation system is registered in cloud storage system, the service code information submitted the user ID ID of this operation system to the user management module in cloud storage system and provide;
And when operation system completes the registration in cloud storage system, the resource management module in cloud storage system to operation system memory allocated resource, and records the correspondence relationship information between the user ID of this operation system and the storage resources information of distribution.
In the present invention is to cloud storage system the dynamic approach of storage resources another embodiment in, can also comprise:
Monitoring resource module in cloud storage system uses in the process of cloud storage resources in operation system, the service condition of the storage resources that this operation system of Real-Time Monitoring is distributed, and record the user ID of this operation system and the service condition information to the storage resources distributed.
Fig. 3 is the structural representation of a cloud storage system of the present invention embodiment.The cloud storage system of this embodiment can be used in the present invention the dynamic approach embodiment of storage resources in above-mentioned each pair of cloud storage system.As shown in Figure 3, it comprises for providing the access module of operation system access service and for providing the resource pool of storage resources, also comprising acquisition module, intelligent analysis module, identification module and storage resources scheduler module.Wherein:
Acquisition module, the storage resources information of for when operation system uses cloud storage resources, gather traffic type information that this operation system provides, distributing to this operation system and this operation system are to the service condition information of the storage resources distributed.
Intelligent analysis module, according to predetermined manner, traffic type information to the operation system of acquisition module collection, the storage resources information to operation system distribution and the service condition information of operation system to the storage resources distributed carry out modeling analysis, obtain the storage resources information that operation system needs, comprising: the type of storage resources and amount of capacity information.
Identification module, for identifying the storage resources information storage resources whether supporting business system needs distributed to operation system.
Storage resources scheduler module, for the recognition result according to identification module, if to operation system distribute storage resources information not supporting business system need storage resources, then carry out the scheduling of cloud storage resources, according to operation system need storage resources information from cloud storage resources for operation system dispatches corresponding storage resources.
The storage resources service that resource pool wherein provides can include but not limited to NFS (Network File System, NFS), CIFS (CommonInternet File Systems, CIFS), block store with object store in any one or multiple.
The cloud storage system that the above embodiment of the present invention provides, can when operation system use cloud storage resources, the traffic type information that capturing service system provides, the storage resources information of distributing to operation system and operation system are to the service condition information of the storage resources distributed; According to predetermined manner, to the service condition information of storage resources of distributing, modeling analysis is carried out to the traffic type information collected, the storage resources information of distributing to operation system and operation system, obtain the storage resources information that operation system needs, identify the storage resources information storage resources whether supporting business system needs distributed to operation system, if do not support, then carry out the scheduling of cloud storage resources, according to operation system need storage resources information from cloud storage resources for operation system dispatches corresponding storage resources.Compared with prior art, the embodiment of the present invention can carry out service-aware to operation system, and based on service-aware result, the dynamic dispatching of storage resources can be realized according to the demand of operation system to storage resources, effectively can meet the individual demand of operation system to storage resources, improve the reasonable utilization rate of storage resources, solving existing cloud storage system is providing in the process of storage resources for different business systems, according to the difference of operation system to storage resource demands, cannot dynamically carry out the problem of storage resources scheduling.
Again see Fig. 3, in another embodiment of cloud storage system of the present invention, also comprise user management module, resource management module and monitoring resource module.Wherein:
User management module, for when operation system is registered in cloud storage system, receives the service code information that the user ID of operation system that this operation system submits to and this operation system provide business.
Resource management module, during for completing the registration in cloud storage system in operation system, the storage resources in operation system Resources allocation pond, and record the correspondence relationship information between the user ID of this operation system and the storage resources information of distribution.
Monitoring resource module, for using in the process of cloud storage resources in operation system by access module, this operation system of Real-Time Monitoring to the service condition of the storage resources distributed, and records the user ID of this operation system and the service condition information to the storage resources distributed.
Correspondingly, acquisition module, specifically obtains user ID and the service code information of operation system from user management module, according to the type of service of user ID and service code identification services system; And from resource management module, obtain the storage resources information of distributing to operation system, comprise the storage class of the storage resources distributed to operation system, amount of capacity and interface type etc.; And from monitoring resource module, obtain the service condition information of operation system to the storage resources distributed, comprise the IOPS to storage resources, bandwidth, average response time, read-write ratio, data block size and read-write frequency index etc.
Fig. 4 is the structural representation of the present invention to the unified embodiment of the dynamical system of storage resources in cloud storage system.The dynamic approach embodiment that the dynamical system of storage resources in cloud storage system be can be used in the present invention to storage resources in above-mentioned each pair of cloud storage system of this embodiment.As shown in Figure 4, it comprises the operation system using storage resources to provide business, client is stored with the cloud for providing operation system to access cloud storage system service, also comprise cloud storage system, this cloud storage system specifically can adopt the structure of any embodiment cloud storage system shown in Fig. 3 of the present invention to realize, for when operation system uses cloud storage resources, the traffic type information that capturing service system provides, the storage resources information of distributing to operation system and operation system are to the service condition information of storage resources of distributing; According to predetermined manner, traffic type information to operation system, the storage resources information to operation system distribution and the service condition information of operation system to the storage resources distributed carry out modeling analysis, obtain the storage resources information that operation system needs, comprising: the type of storage resources and amount of capacity information; Identify the storage resources information storage resources whether supporting business system needs distributed to operation system; If to operation system distribute storage resources information not supporting business system need storage resources, then carry out the scheduling of cloud storage resources, according to operation system need storage resources information from cloud storage resources for operation system dispatches corresponding storage resources.
In this specification, each embodiment all adopts the mode of going forward one by one to describe, and what each embodiment stressed is the difference with other embodiment, same or analogous part cross-reference between each embodiment.For system embodiment, because itself and embodiment of the method are substantially corresponding, so description is fairly simple, relevant part illustrates see the part of embodiment of the method.
Method of the present invention, system may be realized in many ways.Such as, any combination by software, hardware, firmware or software, hardware, firmware realizes method and system of the present invention.Said sequence for the step of described method is only to be described, and the step of method of the present invention is not limited to above specifically described order, unless specifically stated otherwise.In addition, in certain embodiments, can be also record program in the recording medium by the invention process, these programs comprise the machine readable instructions for realizing according to method of the present invention.Thus, the present invention also covers the recording medium stored for performing the program according to method of the present invention.
One of ordinary skill in the art will appreciate that: all or part of step realizing said method embodiment can have been come by the hardware that program command is relevant, aforesaid program can be stored in a computer read/write memory medium, this program, when performing, performs the step comprising said method embodiment; And aforesaid storage medium comprises: ROM, RAM, magnetic disc or CD etc. various can be program code stored medium.
Claims (10)
1. to a dynamic approach for storage resources in cloud storage system, it is characterized in that, comprising:
When operation system uses cloud storage resources, the storage resources information of gather traffic type information that described operation system provides, distributing to described operation system and described operation system are to the service condition information of the storage resources distributed;
According to predetermined manner, modeling analysis is carried out to the traffic type information of described operation system, the storage resources information of distributing to described operation system and the service condition information of described operation system to the storage resources distributed, obtain the storage resources information that described operation system needs, comprising: the type of storage resources and amount of capacity information;
Identify whether the storage resources information of distributing to described operation system supports the storage resources of described operation system needs;
If the storage resources information of distributing to described operation system does not support the storage resources of described operation system needs, then carry out the scheduling of cloud storage resources, from cloud storage resources, dispatch corresponding storage resources for described operation system according to the storage resources information that described operation system needs.
2. method according to claim 1, is characterized in that, the traffic type information gathering described operation system comprises:
User ID ID and the service code information of described operation system is obtained, the type of service of operation system according to user ID and service code identification from user management module.
3. method according to claim 1, is characterized in that, gathers the storage resources information of distributing to described operation system and comprises:
From resource management module, obtain the storage resources information of distributing to described operation system, comprise the storage class of the storage resources distributed to described operation system, amount of capacity and interface type.
4. method according to claim 1, is characterized in that, gathers the service condition information of described operation system to the storage resources distributed and comprises:
From monitoring resource module, obtain the service condition information of described operation system to the storage resources distributed, comprise input-output operation IOPS per second, bandwidth, average response time, read-write ratio, data block size and read-write frequency index.
5. the method according to Claims 1-4 any one, is characterized in that, also comprises:
When operation system is registered in cloud storage system, the service code information submitted the user ID ID of this operation system to the user management module in cloud storage system and provide;
And when described operation system completes the registration in cloud storage system, the resource management module in cloud storage system to operation system memory allocated resource, and records the correspondence relationship information between the user ID of this operation system and the storage resources information of distribution.
6. method according to claim 5, is characterized in that, also comprises:
Monitoring resource module in cloud storage system uses in the process of cloud storage resources in operation system, the service condition of the storage resources that this operation system of Real-Time Monitoring is distributed, and record the user ID of this operation system and the service condition information to the storage resources distributed.
7. a cloud storage system, comprises for providing the access module of operation system access service and for providing the resource pool of storage resources, it is characterized in that, also comprise:
Acquisition module, the storage resources information of for when operation system uses cloud storage resources, gather traffic type information that described operation system provides, distributing to described operation system and described operation system are to the service condition information of the storage resources distributed;
Intelligent analysis module, according to predetermined manner, modeling analysis is carried out to the traffic type information of the described operation system of acquisition module collection, the storage resources information of distributing to described operation system and the service condition information of described operation system to the storage resources distributed, obtain the storage resources information that described operation system needs, comprising: the type of storage resources and amount of capacity information;
Identification module, for identifying whether the storage resources information of distributing to described operation system supports the storage resources of described operation system needs;
Storage resources scheduler module, for the recognition result according to identification module, if the storage resources information of distributing to described operation system does not support the storage resources of described operation system needs, then carry out the scheduling of cloud storage resources, from cloud storage resources, dispatch corresponding storage resources for described operation system according to the storage resources information that described operation system needs.
8. system according to claim 7, is characterized in that, also comprises:
User management module, for when operation system is registered in cloud storage system, receives the service code information that the user ID of described operation system that this operation system submits to and this operation system provide business;
Resource management module, for when described operation system completes the registration in cloud storage system, the storage resources in operation system Resources allocation pond, and record the correspondence relationship information between the user ID of this operation system and the storage resources information of distribution;
Monitoring resource module, for using in the process of cloud storage resources in operation system by access module, this operation system of Real-Time Monitoring to the service condition of the storage resources distributed, and records the user ID of this operation system and the service condition information to the storage resources distributed;
Described acquisition module, specifically obtains user ID ID and the service code information of described operation system from user management module, the type of service of operation system according to user ID and service code identification; And from resource management module, obtain the storage resources information of distributing to described operation system, comprise the storage class of the storage resources distributed to described operation system, amount of capacity and interface type; And from monitoring resource module, obtain the service condition information of described operation system to the storage resources distributed, comprise input-output operation IOPS per second, bandwidth, average response time, read-write ratio, data block size and read-write frequency index.
9., to a dynamical system for storage resources in cloud storage system, comprising operation system and the cloud storage client for providing operation system to access cloud storage system service, it is characterized in that, also comprise:
Cloud storage system, the storage resources information of for when operation system uses cloud storage resources, gather traffic type information that described operation system provides, distributing to described operation system and described operation system are to the service condition information of the storage resources distributed; According to predetermined manner, modeling analysis is carried out to the traffic type information of described operation system, the storage resources information of distributing to described operation system and the service condition information of described operation system to the storage resources distributed, obtain the storage resources information that described operation system needs, comprising: the type of storage resources and amount of capacity information; Identify whether the storage resources information of distributing to described operation system supports the storage resources of described operation system needs; If the storage resources information of distributing to described operation system does not support the storage resources of described operation system needs, then carry out the scheduling of cloud storage resources, from cloud storage resources, dispatch corresponding storage resources for described operation system according to the storage resources information that described operation system needs.
10. system according to claim 9, is characterized in that, described cloud storage system is specially the cloud storage system described in claim 7 or 8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310682932.4A CN104717247A (en) | 2013-12-13 | 2013-12-13 | Method and system for dynamically scheduling storage resources in cloud storage system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310682932.4A CN104717247A (en) | 2013-12-13 | 2013-12-13 | Method and system for dynamically scheduling storage resources in cloud storage system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN104717247A true CN104717247A (en) | 2015-06-17 |
Family
ID=53416207
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201310682932.4A Pending CN104717247A (en) | 2013-12-13 | 2013-12-13 | Method and system for dynamically scheduling storage resources in cloud storage system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104717247A (en) |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104902029A (en) * | 2015-06-24 | 2015-09-09 | 北京麓柏科技有限公司 | Storage request control based on configuration parameter and client-side statistics |
| CN105516242A (en) * | 2015-11-23 | 2016-04-20 | 华为技术有限公司 | Storage resource distribution method and storage resource distribution system |
| CN107528870A (en) * | 2016-06-22 | 2017-12-29 | 腾讯科技（深圳）有限公司 | A kind of collecting method and its equipment |
| CN108958648A (en) * | 2018-05-08 | 2018-12-07 | 广东睿江云计算股份有限公司 | A kind of method of cloud disk storage optimization |
| CN110032447A (en) * | 2019-04-11 | 2019-07-19 | 北京百度网讯科技有限公司 | Method and apparatus for distributing resource |
| CN110389710A (en) * | 2018-04-20 | 2019-10-29 | 华为技术有限公司 | The method and apparatus for distributing storage resource |
| CN110830391A (en) * | 2018-08-10 | 2020-02-21 | 阿里巴巴集团控股有限公司 | Resource allocation method and device and cluster system |
| CN113132488A (en) * | 2021-04-22 | 2021-07-16 | 云上青海大数据产业有限公司 | Method for managing resources of cloud computing system |
| CN117195316A (en) * | 2023-08-21 | 2023-12-08 | 深圳市云存宝技术有限公司 | Cloud hard disk management method, device, server and medium based on cloud technology |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101986274A (en) * | 2010-11-11 | 2011-03-16 | 东软集团股份有限公司 | Resource allocation system and resource allocation method in private cloud environment |
| CN102209041A (en) * | 2011-07-13 | 2011-10-05 | 上海红神信息技术有限公司 | Scheduling method, device and system |
| CN102404399A (en) * | 2011-11-18 | 2012-04-04 | 浪潮电子信息产业股份有限公司 | Fuzzy dynamic allocation method for cloud storage resource |
| CN102497409A (en) * | 2011-12-08 | 2012-06-13 | 曙光信息产业(北京)有限公司 | Resource management method for cloud computing system |
| CN103164283A (en) * | 2012-05-10 | 2013-06-19 | 上海兆民云计算科技有限公司 | Method and system for dynamic scheduling management of virtualized resources in virtualized desktop system |
| CN103414764A (en) * | 2013-07-24 | 2013-11-27 | 广东电子工业研究院有限公司 | Cloud platform elastic storage system and elastic storage achieving method thereof |
-
2013
- 2013-12-13 CN CN201310682932.4A patent/CN104717247A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101986274A (en) * | 2010-11-11 | 2011-03-16 | 东软集团股份有限公司 | Resource allocation system and resource allocation method in private cloud environment |
| CN102209041A (en) * | 2011-07-13 | 2011-10-05 | 上海红神信息技术有限公司 | Scheduling method, device and system |
| CN102404399A (en) * | 2011-11-18 | 2012-04-04 | 浪潮电子信息产业股份有限公司 | Fuzzy dynamic allocation method for cloud storage resource |
| CN102497409A (en) * | 2011-12-08 | 2012-06-13 | 曙光信息产业(北京)有限公司 | Resource management method for cloud computing system |
| CN103164283A (en) * | 2012-05-10 | 2013-06-19 | 上海兆民云计算科技有限公司 | Method and system for dynamic scheduling management of virtualized resources in virtualized desktop system |
| CN103414764A (en) * | 2013-07-24 | 2013-11-27 | 广东电子工业研究院有限公司 | Cloud platform elastic storage system and elastic storage achieving method thereof |
Cited By (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104902029A (en) * | 2015-06-24 | 2015-09-09 | 北京麓柏科技有限公司 | Storage request control based on configuration parameter and client-side statistics |
| CN105516242A (en) * | 2015-11-23 | 2016-04-20 | 华为技术有限公司 | Storage resource distribution method and storage resource distribution system |
| CN107528870A (en) * | 2016-06-22 | 2017-12-29 | 腾讯科技（深圳）有限公司 | A kind of collecting method and its equipment |
| CN107528870B (en) * | 2016-06-22 | 2019-08-23 | 腾讯科技（深圳）有限公司 | A kind of collecting method and its equipment |
| CN110389710A (en) * | 2018-04-20 | 2019-10-29 | 华为技术有限公司 | The method and apparatus for distributing storage resource |
| CN108958648A (en) * | 2018-05-08 | 2018-12-07 | 广东睿江云计算股份有限公司 | A kind of method of cloud disk storage optimization |
| CN110830391A (en) * | 2018-08-10 | 2020-02-21 | 阿里巴巴集团控股有限公司 | Resource allocation method and device and cluster system |
| CN110032447A (en) * | 2019-04-11 | 2019-07-19 | 北京百度网讯科技有限公司 | Method and apparatus for distributing resource |
| US11146502B2 (en) | 2019-04-11 | 2021-10-12 | Beijing Baidu Netcom Science And Technology Co., Ltd. | Method and apparatus for allocating resource |
| CN113132488A (en) * | 2021-04-22 | 2021-07-16 | 云上青海大数据产业有限公司 | Method for managing resources of cloud computing system |
| CN117195316A (en) * | 2023-08-21 | 2023-12-08 | 深圳市云存宝技术有限公司 | Cloud hard disk management method, device, server and medium based on cloud technology |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104717247A (en) | Method and system for dynamically scheduling storage resources in cloud storage system | |
| US9569457B2 (en) | Data processing method and apparatus for distributed systems | |
| EP3285187B1 (en) | Optimized merge-sorting of data retrieved from parallel storage units | |
| CN109144699A (en) | Distributed task dispatching method, apparatus and system | |
| CN112416960B (en) | Data processing method, device, equipment and storage medium under multiple scenes | |
| CN102521014B (en) | Deploying method and deploying device for virtual machine | |
| CN111722806B (en) | Cloud disk allocation method and device, electronic equipment and storage medium | |
| CN105049268A (en) | Distributed computing resource allocation system and task processing method | |
| CN107291539B (en) | Cluster program scheduler method based on resource significance level | |
| US9740421B2 (en) | Just-in-time remote data storage allocation | |
| CN104820575A (en) | Method for realizing thin provisioning of storage system | |
| CN117076453A (en) | Batch task processing method, device and equipment | |
| CN110058808A (en) | Reduce the device of the Data Migration time of data rearrangement between storage hierarchical layer | |
| CN107506145B (en) | Physical storage scheduling method and cloud host creation method | |
| CN109190025A (en) | information monitoring method, device, system and computer readable storage medium | |
| CN105677763A (en) | Image quality evaluating system based on Hadoop | |
| CN103019855A (en) | Method for forecasting executive time of Map Reduce operation | |
| CN104410666A (en) | Method and system for implementing heterogeneous storage resource management under cloud computing | |
| CN103685517A (en) | Storage hierarchical scheduling method and system based on service class characteristics | |
| CN104683450A (en) | Video service monitoring cloud system | |
| US8443369B1 (en) | Method and system for dynamically selecting a best resource from each resource collection based on resources dependencies, prior selections and statistics to implement an allocation policy | |
| CN104660690A (en) | Cloud video service monitoring system | |
| CN103678360A (en) | Data storing method and device for distributed file system | |
| CN110232136A (en) | A kind of big data processing system based on cloud computing | |
| CN103647824A (en) | Storage resource optimized scheduling and discovering algorithm |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20150617 |