CN104717247A - Method and system for dynamically scheduling storage resources in cloud storage system - Google Patents

Method and system for dynamically scheduling storage resources in cloud storage system Download PDF

Info

Publication number
CN104717247A
CN104717247A CN201310682932.4A CN201310682932A CN104717247A CN 104717247 A CN104717247 A CN 104717247A CN 201310682932 A CN201310682932 A CN 201310682932A CN 104717247 A CN104717247 A CN 104717247A
Authority
CN
China
Prior art keywords
operation system
storage resources
information
described operation
cloud storage
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201310682932.4A
Other languages
Chinese (zh)
Inventor
孙振正
雷俊智
段勇
龚德志
龚靖
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
China Telecom Corp Ltd
Original Assignee
China Telecom Corp Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by China Telecom Corp Ltd filed Critical China Telecom Corp Ltd
Priority to CN201310682932.4A priority Critical patent/CN104717247A/en
Publication of CN104717247A publication Critical patent/CN104717247A/en
Pending legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • H04L67/1097Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The embodiment of the invention discloses a method and system for dynamically scheduling storage resources in a cloud storage system. The method comprises the steps that when a service system uses the cloud storage resources, the service type information provided by the service system, the storage resource information distributed to the service system and the information of the service condition of storage resources distributed to the service system are collected; according to a preset mode, modeling analysis is conducted on the service type information of the service system, the storage resource information distributed to the service system and the information of the service condition of the storage resources distributed to the service system, and storage resource information needed by the service system is obtained; whether the storage resources distributed to the service system support the storage resources needed by the service system or not is identified, if not, scheduling of the cloud storage resources is conducted, and corresponding storage resources in the cloud storage resources are scheduled for the service system according to the storage resource information needed by the service system. The method and system can achieve dynamic scheduling of the storage resources according to the requirements for storage resources of the service system.

Description

To dynamic dispatching method and the system of storage resources in cloud storage system
Technical field
The present invention relates to the storage resources dispatching technique in cloud stores service, especially a kind of dynamic dispatching method to storage resources in cloud storage system and system.
Background technology
At present, cloud storage system mainly through the storage resources of different stage in cloud memory resource pool, for different operation systems provides stores service.But the demand of different operation systems to storage resources is different.Such as, the medium and small data block files predominate of net dish class operation system, read-write mode is based on random read-write, net dish class operation system is less demanding to performance index such as the bandwidth of storage resources, input-output operation per second (Input/Output Operations Per Second, IOPS) and response times; And long data block files predominate in video playback class operation system, read-write mode is based on order read-write, higher to the bandwidth requirement of storage resources, but requires general to IOPS and response time etc.From the angle promoting cloud utilization ratio of storage resources and user's service level, cloud storage system needs the storage resources to different operation systems configuration different stage.
But realizing in process of the present invention, inventor finds that prior art at least exists following problem:
Existing cloud storage system is the storage resources that operation system is distributed is static constant, the perception to different business systems can not be realized, the dynamic dispatching of storage resources cannot be realized according to the demand of operation system to storage resources, therefore cannot meet the individual demand of operation system to storage resources, also cannot improve the reasonable utilization rate of storage resources.
Summary of the invention
Embodiment of the present invention technical problem to be solved is: provide a kind of dynamic dispatching method to storage resources in cloud storage system and system, to realize the dynamic dispatching of storage resources according to the demand of operation system to storage resources.
A kind of dynamic dispatching method to storage resources in cloud storage system that the embodiment of the present invention provides, comprising:
When operation system uses cloud storage resources, the storage resources information of gather traffic type information that described operation system provides, distributing to described operation system and described operation system are to the service condition information of the storage resources distributed;
According to predetermined manner, modeling analysis is carried out to the traffic type information of described operation system, the storage resources information of distributing to described operation system and the service condition information of described operation system to the storage resources distributed, obtain the storage resources information that described operation system needs, comprising: the type of storage resources and amount of capacity information;
Identify whether the storage resources information of distributing to described operation system supports the storage resources of described operation system needs;
If the storage resources information of distributing to described operation system does not support the storage resources of described operation system needs, then carry out the scheduling of cloud storage resources, from cloud storage resources, dispatch corresponding storage resources for described operation system according to the storage resources information that described operation system needs.
In another embodiment of said method of the present invention, the traffic type information gathering described operation system comprises:
User ID ID and the service code information of described operation system is obtained, the type of service of operation system according to user ID and service code identification from user management module.
In another embodiment of said method of the present invention, gather the storage resources information of distributing to described operation system and comprise:
From resource management module, obtain the storage resources information of distributing to described operation system, comprise the storage class of the storage resources distributed to described operation system, amount of capacity and interface type.
In another embodiment of said method of the present invention, gather the service condition information of described operation system to the storage resources distributed and comprise:
From monitoring resource module, obtain the service condition information of described operation system to the storage resources distributed, comprise input-output operation IOPS per second, bandwidth, average response time, read-write ratio, data block size and read-write frequency index.
In another embodiment of said method of the present invention, also comprise:
When operation system is registered in cloud storage system, the service code information submitted the user ID ID of this operation system to the user management module in cloud storage system and provide;
And when described operation system completes the registration in cloud storage system, the resource management module in cloud storage system to operation system memory allocated resource, and records the correspondence relationship information between the user ID of this operation system and the storage resources information of distribution.
In another embodiment of said method of the present invention, also comprise:
Monitoring resource module in cloud storage system uses in the process of cloud storage resources in operation system, the service condition of the storage resources that this operation system of Real-Time Monitoring is distributed, and record the user ID of this operation system and the service condition information to the storage resources distributed.
A kind of cloud storage system that the embodiment of the present invention provides, comprises for providing the access module of operation system access service and for providing the resource pool of storage resources, it is characterized in that, also comprise:
Acquisition module, the storage resources information of for when operation system uses cloud storage resources, gather traffic type information that described operation system provides, distributing to described operation system and described operation system are to the service condition information of the storage resources distributed;
Intelligent analysis module, according to predetermined manner, modeling analysis is carried out to the traffic type information of the described operation system of acquisition module collection, the storage resources information of distributing to described operation system and the service condition information of described operation system to the storage resources distributed, obtain the storage resources information that described operation system needs, comprising: the type of storage resources and amount of capacity information;
Identification module, for identifying whether the storage resources information of distributing to described operation system supports the storage resources of described operation system needs;
Storage resources scheduler module, for the recognition result according to identification module, if the storage resources information of distributing to described operation system does not support the storage resources of described operation system needs, then carry out the scheduling of cloud storage resources, from cloud storage resources, dispatch corresponding storage resources for described operation system according to the storage resources information that described operation system needs.
In another embodiment of said system of the present invention, also comprise:
User management module, for when operation system is registered in cloud storage system, receives the service code information that the user ID of described operation system that this operation system submits to and this operation system provide business;
Resource management module, for when described operation system completes the registration in cloud storage system, the storage resources in operation system Resources allocation pond, and record the correspondence relationship information between the user ID of this operation system and the storage resources information of distribution;
Monitoring resource module, for using in the process of cloud storage resources in operation system by access module, this operation system of Real-Time Monitoring to the service condition of the storage resources distributed, and records the user ID of this operation system and the service condition information to the storage resources distributed;
Described acquisition module, specifically obtains user ID ID and the service code information of described operation system from user management module, the type of service of operation system according to user ID and service code identification; And from resource management module, obtain the storage resources information of distributing to described operation system, comprise the storage class of the storage resources distributed to described operation system, amount of capacity and interface type; And from monitoring resource module, obtain the service condition information of described operation system to the storage resources distributed, comprise input-output operation IOPS per second, bandwidth, average response time, read-write ratio, data block size and read-write frequency index.
A kind of dynamical system to storage resources in cloud storage system that the embodiment of the present invention provides, comprises operation system and the cloud for providing operation system to access cloud storage system service stores client, it is characterized in that, also comprises:
Cloud storage system, the storage resources information of for when operation system uses cloud storage resources, gather traffic type information that described operation system provides, distributing to described operation system and described operation system are to the service condition information of the storage resources distributed; According to predetermined manner, modeling analysis is carried out to the traffic type information of described operation system, the storage resources information of distributing to described operation system and the service condition information of described operation system to the storage resources distributed, obtain the storage resources information that described operation system needs, comprising: the type of storage resources and amount of capacity information; Identify whether the storage resources information of distributing to described operation system supports the storage resources of described operation system needs; If the storage resources information of distributing to described operation system does not support the storage resources of described operation system needs, then carry out the scheduling of cloud storage resources, from cloud storage resources, dispatch corresponding storage resources for described operation system according to the storage resources information that described operation system needs.
In another embodiment of said system of the present invention, described cloud storage system is specially the cloud storage system that the above-mentioned any embodiment of the present invention provides.
The dynamic dispatching method to storage resources in cloud storage system provided based on the above embodiment of the present invention and cloud storage system, can when operation system use cloud storage resources, the traffic type information that capturing service system provides, the storage resources information of distributing to operation system and operation system are to the service condition information of the storage resources distributed; According to predetermined manner, to the service condition information of storage resources of distributing, modeling analysis is carried out to the traffic type information collected, the storage resources information of distributing to operation system and operation system, obtain the storage resources information that operation system needs, identify the storage resources information storage resources whether supporting business system needs distributed to operation system, if do not support, then carry out the scheduling of cloud storage resources, according to operation system need storage resources information from cloud storage resources for operation system dispatches corresponding storage resources.Compared with prior art, the embodiment of the present invention is applicable to the cloud storage system with different stage storage resources, service-aware can be carried out to operation system, and based on service-aware result, the dynamic dispatching of storage resources can be realized according to the demand of operation system to storage resources, effectively can meet the individual demand of operation system to storage resources, improve the reasonable utilization rate of storage resources, improve customer service quality level, solving existing cloud storage system is providing in the process of storage resources for different business systems, cannot according to the difference of operation system to storage resource demands, dynamically carry out the problem of storage resources scheduling.
Below by drawings and Examples, technical scheme of the present invention is described in further detail.
Description of the invention provides in order to example with for the purpose of describing, and is not exhaustively or limit the invention to disclosed form.Many modifications and variations are obvious for the ordinary skill in the art.Selecting and describing embodiment is in order to principle of the present invention and practical application are better described, and enables those of ordinary skill in the art understand the present invention thus design the various embodiments with various amendment being suitable for special-purpose.
Accompanying drawing explanation
What form a part for specification drawings describes embodiments of the invention, and is used from explanation principle of the present invention together with description one.
With reference to accompanying drawing, according to detailed description below, clearly the present invention can be understood, wherein:
Fig. 1 is the flow chart of the present invention to a dynamic approach embodiment of storage resources in cloud storage system.
Fig. 2 is the content example of traffic type information, the storage resources information of distribution and the service condition information to storage resources gathered in the embodiment of the present invention.
Fig. 3 is the structural representation of a cloud storage system of the present invention embodiment.
Fig. 4 is the structural representation of the present invention to the unified embodiment of the dynamical system of storage resources in cloud storage system.
Embodiment
Various exemplary embodiment of the present invention is described in detail now with reference to accompanying drawing.It should be noted that: unless specifically stated otherwise, otherwise positioned opposite, the numerical expression of the parts of setting forth in these embodiments and step and numerical value do not limit the scope of the invention.
Meanwhile, it should be understood that for convenience of description, the size of the various piece shown in accompanying drawing is not draw according to the proportionate relationship of reality.
Illustrative to the description only actually of at least one exemplary embodiment below, never as any restriction to the present invention and application or use.
May not discuss in detail for the known technology of person of ordinary skill in the relevant, method and apparatus, but in the appropriate case, described technology, method and apparatus should be regarded as a part for specification.
In all examples with discussing shown here, any occurrence should be construed as merely exemplary, instead of as restriction.Therefore, other example of exemplary embodiment can have different values.
It should be noted that: represent similar terms in similar label and letter accompanying drawing below, therefore, once be defined in an a certain Xiang Yi accompanying drawing, then do not need to be further discussed it in accompanying drawing subsequently.
Fig. 1 is the flow chart of the present invention to a dynamic approach embodiment of storage resources in cloud storage system.As shown in Figure 1, this embodiment comprises the dynamic approach of storage resources in cloud storage system:
110, the storage resources information of when operation system uses cloud storage resources, gather traffic type information that this operation system provides, distributing to this operation system and this operation system are to the service condition information of the storage resources distributed.
120, according to predetermined manner, traffic type information to the operation system collected, the storage resources information to operation system distribution and the service condition information of operation system to the storage resources distributed carry out modeling analysis, obtain the storage resources information that operation system needs, comprising: the type of storage resources and amount of capacity information.
130, identify the storage resources of the storage resources information of distributing to this operation system whether supporting business system needs.
If to operation system distribute storage resources information not supporting business system need storage resources, then perform 140 operation.Otherwise, if the storage resources of the storage resources Informational support operation system needs to operation system distribution, then do not perform subsequent operation, maintain the configuration of existing storage resources.
140, carry out the scheduling of cloud storage resources, according to operation system need storage resources information from cloud storage resources for operation system dispatches corresponding storage resources.
The dynamic dispatching method to storage resources in cloud storage system that the above embodiment of the present invention provides, can when operation system use cloud storage resources, the traffic type information that capturing service system provides, the storage resources information of distributing to operation system and operation system are to the service condition information of the storage resources distributed; According to predetermined manner, to the service condition information of storage resources of distributing, modeling analysis is carried out to the traffic type information collected, the storage resources information of distributing to operation system and operation system, obtain the storage resources information that operation system needs, identify the storage resources information storage resources whether supporting business system needs distributed to operation system, if do not support, then carry out the scheduling of cloud storage resources, according to operation system need storage resources information from cloud storage resources for operation system dispatches corresponding storage resources.Compared with prior art, the embodiment of the present invention can carry out service-aware to operation system, and based on service-aware result, the dynamic dispatching of storage resources can be realized according to the demand of operation system to storage resources, effectively can meet the individual demand of operation system to storage resources, improve the reasonable utilization rate of storage resources, solving existing cloud storage system is providing in the process of storage resources for different business systems, according to the difference of operation system to storage resource demands, cannot dynamically carry out the problem of storage resources scheduling.
Unrestricted to a concrete example of the dynamic approach embodiment of storage resources in cloud storage system according to the present invention, in operation 110 shown in Fig. 1, specifically can obtain user ID (ID) and the service code information of operation system from user management module, according to the type of service of user ID and service code identification services system; The storage resources information of distributing to operation system can be obtained from resource management module, comprise the storage class of the storage resources distributed to operation system, amount of capacity and interface type etc.; The service condition information of operation system to the storage resources distributed can be obtained from monitoring resource module, comprise the indexs such as the input-output operation IOPS per second to storage resources, bandwidth, average response time, read-write ratio, data block size and read-write frequency.As shown in Figure 2, the content example of traffic type information, the storage resources information of distribution and the service condition information to storage resources for gathering in this embodiment.
In the present invention is to cloud storage system the dynamic approach of storage resources another embodiment in, can also comprise:
When operation system is registered in cloud storage system, the service code information submitted the user ID ID of this operation system to the user management module in cloud storage system and provide;
And when operation system completes the registration in cloud storage system, the resource management module in cloud storage system to operation system memory allocated resource, and records the correspondence relationship information between the user ID of this operation system and the storage resources information of distribution.
In the present invention is to cloud storage system the dynamic approach of storage resources another embodiment in, can also comprise:
Monitoring resource module in cloud storage system uses in the process of cloud storage resources in operation system, the service condition of the storage resources that this operation system of Real-Time Monitoring is distributed, and record the user ID of this operation system and the service condition information to the storage resources distributed.
Fig. 3 is the structural representation of a cloud storage system of the present invention embodiment.The cloud storage system of this embodiment can be used in the present invention the dynamic approach embodiment of storage resources in above-mentioned each pair of cloud storage system.As shown in Figure 3, it comprises for providing the access module of operation system access service and for providing the resource pool of storage resources, also comprising acquisition module, intelligent analysis module, identification module and storage resources scheduler module.Wherein:
Acquisition module, the storage resources information of for when operation system uses cloud storage resources, gather traffic type information that this operation system provides, distributing to this operation system and this operation system are to the service condition information of the storage resources distributed.
Intelligent analysis module, according to predetermined manner, traffic type information to the operation system of acquisition module collection, the storage resources information to operation system distribution and the service condition information of operation system to the storage resources distributed carry out modeling analysis, obtain the storage resources information that operation system needs, comprising: the type of storage resources and amount of capacity information.
Identification module, for identifying the storage resources information storage resources whether supporting business system needs distributed to operation system.
Storage resources scheduler module, for the recognition result according to identification module, if to operation system distribute storage resources information not supporting business system need storage resources, then carry out the scheduling of cloud storage resources, according to operation system need storage resources information from cloud storage resources for operation system dispatches corresponding storage resources.
The storage resources service that resource pool wherein provides can include but not limited to NFS (Network File System, NFS), CIFS (CommonInternet File Systems, CIFS), block store with object store in any one or multiple.
The cloud storage system that the above embodiment of the present invention provides, can when operation system use cloud storage resources, the traffic type information that capturing service system provides, the storage resources information of distributing to operation system and operation system are to the service condition information of the storage resources distributed; According to predetermined manner, to the service condition information of storage resources of distributing, modeling analysis is carried out to the traffic type information collected, the storage resources information of distributing to operation system and operation system, obtain the storage resources information that operation system needs, identify the storage resources information storage resources whether supporting business system needs distributed to operation system, if do not support, then carry out the scheduling of cloud storage resources, according to operation system need storage resources information from cloud storage resources for operation system dispatches corresponding storage resources.Compared with prior art, the embodiment of the present invention can carry out service-aware to operation system, and based on service-aware result, the dynamic dispatching of storage resources can be realized according to the demand of operation system to storage resources, effectively can meet the individual demand of operation system to storage resources, improve the reasonable utilization rate of storage resources, solving existing cloud storage system is providing in the process of storage resources for different business systems, according to the difference of operation system to storage resource demands, cannot dynamically carry out the problem of storage resources scheduling.
Again see Fig. 3, in another embodiment of cloud storage system of the present invention, also comprise user management module, resource management module and monitoring resource module.Wherein:
User management module, for when operation system is registered in cloud storage system, receives the service code information that the user ID of operation system that this operation system submits to and this operation system provide business.
Resource management module, during for completing the registration in cloud storage system in operation system, the storage resources in operation system Resources allocation pond, and record the correspondence relationship information between the user ID of this operation system and the storage resources information of distribution.
Monitoring resource module, for using in the process of cloud storage resources in operation system by access module, this operation system of Real-Time Monitoring to the service condition of the storage resources distributed, and records the user ID of this operation system and the service condition information to the storage resources distributed.
Correspondingly, acquisition module, specifically obtains user ID and the service code information of operation system from user management module, according to the type of service of user ID and service code identification services system; And from resource management module, obtain the storage resources information of distributing to operation system, comprise the storage class of the storage resources distributed to operation system, amount of capacity and interface type etc.; And from monitoring resource module, obtain the service condition information of operation system to the storage resources distributed, comprise the IOPS to storage resources, bandwidth, average response time, read-write ratio, data block size and read-write frequency index etc.
Fig. 4 is the structural representation of the present invention to the unified embodiment of the dynamical system of storage resources in cloud storage system.The dynamic approach embodiment that the dynamical system of storage resources in cloud storage system be can be used in the present invention to storage resources in above-mentioned each pair of cloud storage system of this embodiment.As shown in Figure 4, it comprises the operation system using storage resources to provide business, client is stored with the cloud for providing operation system to access cloud storage system service, also comprise cloud storage system, this cloud storage system specifically can adopt the structure of any embodiment cloud storage system shown in Fig. 3 of the present invention to realize, for when operation system uses cloud storage resources, the traffic type information that capturing service system provides, the storage resources information of distributing to operation system and operation system are to the service condition information of storage resources of distributing; According to predetermined manner, traffic type information to operation system, the storage resources information to operation system distribution and the service condition information of operation system to the storage resources distributed carry out modeling analysis, obtain the storage resources information that operation system needs, comprising: the type of storage resources and amount of capacity information; Identify the storage resources information storage resources whether supporting business system needs distributed to operation system; If to operation system distribute storage resources information not supporting business system need storage resources, then carry out the scheduling of cloud storage resources, according to operation system need storage resources information from cloud storage resources for operation system dispatches corresponding storage resources.
In this specification, each embodiment all adopts the mode of going forward one by one to describe, and what each embodiment stressed is the difference with other embodiment, same or analogous part cross-reference between each embodiment.For system embodiment, because itself and embodiment of the method are substantially corresponding, so description is fairly simple, relevant part illustrates see the part of embodiment of the method.
Method of the present invention, system may be realized in many ways.Such as, any combination by software, hardware, firmware or software, hardware, firmware realizes method and system of the present invention.Said sequence for the step of described method is only to be described, and the step of method of the present invention is not limited to above specifically described order, unless specifically stated otherwise.In addition, in certain embodiments, can be also record program in the recording medium by the invention process, these programs comprise the machine readable instructions for realizing according to method of the present invention.Thus, the present invention also covers the recording medium stored for performing the program according to method of the present invention.
One of ordinary skill in the art will appreciate that: all or part of step realizing said method embodiment can have been come by the hardware that program command is relevant, aforesaid program can be stored in a computer read/write memory medium, this program, when performing, performs the step comprising said method embodiment; And aforesaid storage medium comprises: ROM, RAM, magnetic disc or CD etc. various can be program code stored medium.

Claims (10)

1. to a dynamic approach for storage resources in cloud storage system, it is characterized in that, comprising:
When operation system uses cloud storage resources, the storage resources information of gather traffic type information that described operation system provides, distributing to described operation system and described operation system are to the service condition information of the storage resources distributed;
According to predetermined manner, modeling analysis is carried out to the traffic type information of described operation system, the storage resources information of distributing to described operation system and the service condition information of described operation system to the storage resources distributed, obtain the storage resources information that described operation system needs, comprising: the type of storage resources and amount of capacity information;
Identify whether the storage resources information of distributing to described operation system supports the storage resources of described operation system needs;
If the storage resources information of distributing to described operation system does not support the storage resources of described operation system needs, then carry out the scheduling of cloud storage resources, from cloud storage resources, dispatch corresponding storage resources for described operation system according to the storage resources information that described operation system needs.
2. method according to claim 1, is characterized in that, the traffic type information gathering described operation system comprises:
User ID ID and the service code information of described operation system is obtained, the type of service of operation system according to user ID and service code identification from user management module.
3. method according to claim 1, is characterized in that, gathers the storage resources information of distributing to described operation system and comprises:
From resource management module, obtain the storage resources information of distributing to described operation system, comprise the storage class of the storage resources distributed to described operation system, amount of capacity and interface type.
4. method according to claim 1, is characterized in that, gathers the service condition information of described operation system to the storage resources distributed and comprises:
From monitoring resource module, obtain the service condition information of described operation system to the storage resources distributed, comprise input-output operation IOPS per second, bandwidth, average response time, read-write ratio, data block size and read-write frequency index.
5. the method according to Claims 1-4 any one, is characterized in that, also comprises:
When operation system is registered in cloud storage system, the service code information submitted the user ID ID of this operation system to the user management module in cloud storage system and provide;
And when described operation system completes the registration in cloud storage system, the resource management module in cloud storage system to operation system memory allocated resource, and records the correspondence relationship information between the user ID of this operation system and the storage resources information of distribution.
6. method according to claim 5, is characterized in that, also comprises:
Monitoring resource module in cloud storage system uses in the process of cloud storage resources in operation system, the service condition of the storage resources that this operation system of Real-Time Monitoring is distributed, and record the user ID of this operation system and the service condition information to the storage resources distributed.
7. a cloud storage system, comprises for providing the access module of operation system access service and for providing the resource pool of storage resources, it is characterized in that, also comprise:
Acquisition module, the storage resources information of for when operation system uses cloud storage resources, gather traffic type information that described operation system provides, distributing to described operation system and described operation system are to the service condition information of the storage resources distributed;
Intelligent analysis module, according to predetermined manner, modeling analysis is carried out to the traffic type information of the described operation system of acquisition module collection, the storage resources information of distributing to described operation system and the service condition information of described operation system to the storage resources distributed, obtain the storage resources information that described operation system needs, comprising: the type of storage resources and amount of capacity information;
Identification module, for identifying whether the storage resources information of distributing to described operation system supports the storage resources of described operation system needs;
Storage resources scheduler module, for the recognition result according to identification module, if the storage resources information of distributing to described operation system does not support the storage resources of described operation system needs, then carry out the scheduling of cloud storage resources, from cloud storage resources, dispatch corresponding storage resources for described operation system according to the storage resources information that described operation system needs.
8. system according to claim 7, is characterized in that, also comprises:
User management module, for when operation system is registered in cloud storage system, receives the service code information that the user ID of described operation system that this operation system submits to and this operation system provide business;
Resource management module, for when described operation system completes the registration in cloud storage system, the storage resources in operation system Resources allocation pond, and record the correspondence relationship information between the user ID of this operation system and the storage resources information of distribution;
Monitoring resource module, for using in the process of cloud storage resources in operation system by access module, this operation system of Real-Time Monitoring to the service condition of the storage resources distributed, and records the user ID of this operation system and the service condition information to the storage resources distributed;
Described acquisition module, specifically obtains user ID ID and the service code information of described operation system from user management module, the type of service of operation system according to user ID and service code identification; And from resource management module, obtain the storage resources information of distributing to described operation system, comprise the storage class of the storage resources distributed to described operation system, amount of capacity and interface type; And from monitoring resource module, obtain the service condition information of described operation system to the storage resources distributed, comprise input-output operation IOPS per second, bandwidth, average response time, read-write ratio, data block size and read-write frequency index.
9., to a dynamical system for storage resources in cloud storage system, comprising operation system and the cloud storage client for providing operation system to access cloud storage system service, it is characterized in that, also comprise:
Cloud storage system, the storage resources information of for when operation system uses cloud storage resources, gather traffic type information that described operation system provides, distributing to described operation system and described operation system are to the service condition information of the storage resources distributed; According to predetermined manner, modeling analysis is carried out to the traffic type information of described operation system, the storage resources information of distributing to described operation system and the service condition information of described operation system to the storage resources distributed, obtain the storage resources information that described operation system needs, comprising: the type of storage resources and amount of capacity information; Identify whether the storage resources information of distributing to described operation system supports the storage resources of described operation system needs; If the storage resources information of distributing to described operation system does not support the storage resources of described operation system needs, then carry out the scheduling of cloud storage resources, from cloud storage resources, dispatch corresponding storage resources for described operation system according to the storage resources information that described operation system needs.
10. system according to claim 9, is characterized in that, described cloud storage system is specially the cloud storage system described in claim 7 or 8.
CN201310682932.4A 2013-12-13 2013-12-13 Method and system for dynamically scheduling storage resources in cloud storage system Pending CN104717247A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201310682932.4A CN104717247A (en) 2013-12-13 2013-12-13 Method and system for dynamically scheduling storage resources in cloud storage system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201310682932.4A CN104717247A (en) 2013-12-13 2013-12-13 Method and system for dynamically scheduling storage resources in cloud storage system

Publications (1)

Publication Number Publication Date
CN104717247A true CN104717247A (en) 2015-06-17

Family

ID=53416207

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201310682932.4A Pending CN104717247A (en) 2013-12-13 2013-12-13 Method and system for dynamically scheduling storage resources in cloud storage system

Country Status (1)

Country Link
CN (1) CN104717247A (en)

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104902029A (en) * 2015-06-24 2015-09-09 北京麓柏科技有限公司 Storage request control based on configuration parameter and client-side statistics
CN105516242A (en) * 2015-11-23 2016-04-20 华为技术有限公司 Storage resource distribution method and storage resource distribution system
CN107528870A (en) * 2016-06-22 2017-12-29 腾讯科技(深圳)有限公司 A kind of collecting method and its equipment
CN108958648A (en) * 2018-05-08 2018-12-07 广东睿江云计算股份有限公司 A kind of method of cloud disk storage optimization
CN110032447A (en) * 2019-04-11 2019-07-19 北京百度网讯科技有限公司 Method and apparatus for distributing resource
CN110389710A (en) * 2018-04-20 2019-10-29 华为技术有限公司 The method and apparatus for distributing storage resource
CN110830391A (en) * 2018-08-10 2020-02-21 阿里巴巴集团控股有限公司 Resource allocation method and device and cluster system
CN113132488A (en) * 2021-04-22 2021-07-16 云上青海大数据产业有限公司 Method for managing resources of cloud computing system
CN117195316A (en) * 2023-08-21 2023-12-08 深圳市云存宝技术有限公司 Cloud hard disk management method, device, server and medium based on cloud technology

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101986274A (en) * 2010-11-11 2011-03-16 东软集团股份有限公司 Resource allocation system and resource allocation method in private cloud environment
CN102209041A (en) * 2011-07-13 2011-10-05 上海红神信息技术有限公司 Scheduling method, device and system
CN102404399A (en) * 2011-11-18 2012-04-04 浪潮电子信息产业股份有限公司 Fuzzy dynamic allocation method for cloud storage resource
CN102497409A (en) * 2011-12-08 2012-06-13 曙光信息产业(北京)有限公司 Resource management method for cloud computing system
CN103164283A (en) * 2012-05-10 2013-06-19 上海兆民云计算科技有限公司 Method and system for dynamic scheduling management of virtualized resources in virtualized desktop system
CN103414764A (en) * 2013-07-24 2013-11-27 广东电子工业研究院有限公司 Cloud platform elastic storage system and elastic storage achieving method thereof

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101986274A (en) * 2010-11-11 2011-03-16 东软集团股份有限公司 Resource allocation system and resource allocation method in private cloud environment
CN102209041A (en) * 2011-07-13 2011-10-05 上海红神信息技术有限公司 Scheduling method, device and system
CN102404399A (en) * 2011-11-18 2012-04-04 浪潮电子信息产业股份有限公司 Fuzzy dynamic allocation method for cloud storage resource
CN102497409A (en) * 2011-12-08 2012-06-13 曙光信息产业(北京)有限公司 Resource management method for cloud computing system
CN103164283A (en) * 2012-05-10 2013-06-19 上海兆民云计算科技有限公司 Method and system for dynamic scheduling management of virtualized resources in virtualized desktop system
CN103414764A (en) * 2013-07-24 2013-11-27 广东电子工业研究院有限公司 Cloud platform elastic storage system and elastic storage achieving method thereof

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104902029A (en) * 2015-06-24 2015-09-09 北京麓柏科技有限公司 Storage request control based on configuration parameter and client-side statistics
CN105516242A (en) * 2015-11-23 2016-04-20 华为技术有限公司 Storage resource distribution method and storage resource distribution system
CN107528870A (en) * 2016-06-22 2017-12-29 腾讯科技(深圳)有限公司 A kind of collecting method and its equipment
CN107528870B (en) * 2016-06-22 2019-08-23 腾讯科技(深圳)有限公司 A kind of collecting method and its equipment
CN110389710A (en) * 2018-04-20 2019-10-29 华为技术有限公司 The method and apparatus for distributing storage resource
CN108958648A (en) * 2018-05-08 2018-12-07 广东睿江云计算股份有限公司 A kind of method of cloud disk storage optimization
CN110830391A (en) * 2018-08-10 2020-02-21 阿里巴巴集团控股有限公司 Resource allocation method and device and cluster system
CN110032447A (en) * 2019-04-11 2019-07-19 北京百度网讯科技有限公司 Method and apparatus for distributing resource
US11146502B2 (en) 2019-04-11 2021-10-12 Beijing Baidu Netcom Science And Technology Co., Ltd. Method and apparatus for allocating resource
CN113132488A (en) * 2021-04-22 2021-07-16 云上青海大数据产业有限公司 Method for managing resources of cloud computing system
CN117195316A (en) * 2023-08-21 2023-12-08 深圳市云存宝技术有限公司 Cloud hard disk management method, device, server and medium based on cloud technology

Similar Documents

Publication Publication Date Title
CN104717247A (en) Method and system for dynamically scheduling storage resources in cloud storage system
US9569457B2 (en) Data processing method and apparatus for distributed systems
CN109144699A (en) Distributed task dispatching method, apparatus and system
CN103795804A (en) Storage resource scheduling method and storage calculation system
CN102521014B (en) Deploying method and deploying device for virtual machine
EP3285187B1 (en) Optimized merge-sorting of data retrieved from parallel storage units
US9740421B2 (en) Just-in-time remote data storage allocation
CN104820575A (en) Method for realizing thin provisioning of storage system
CN117076453A (en) Batch task processing method, device and equipment
CN111722806A (en) Cloud disk allocation method and device, electronic equipment and storage medium
CN103365971A (en) Mass data access processing system based on cloud computing
CN110058808A (en) Reduce the device of the Data Migration time of data rearrangement between storage hierarchical layer
CN107506145B (en) Physical storage scheduling method and cloud host creation method
CN109190025A (en) information monitoring method, device, system and computer readable storage medium
CN109062697A (en) It is a kind of that the method and apparatus of spatial analysis service are provided
KR101765725B1 (en) System and Method for connecting dynamic device on mass broadcasting Big Data Parallel Distributed Processing
CN104410666A (en) Method and system for implementing heterogeneous storage resource management under cloud computing
CN104683450A (en) Video service monitoring cloud system
US8443369B1 (en) Method and system for dynamically selecting a best resource from each resource collection based on resources dependencies, prior selections and statistics to implement an allocation policy
CN104660690A (en) Cloud video service monitoring system
CN107291539A (en) Cluster program scheduler method based on resource significance level
CN103678360A (en) Data storing method and device for distributed file system
CN110232136A (en) A kind of big data processing system based on cloud computing
CN202872848U (en) Cloud storage terminal equipment based on cloud information and cloud computing services
CN109766056A (en) A kind of storage array controllers IO array dispatching method and device

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20150617