CN103036994B - Realize the cloud storage system of load balancing - Google Patents
Realize the cloud storage system of load balancing Download PDFInfo
- Publication number
- CN103036994B CN103036994B CN201210553734.3A CN201210553734A CN103036994B CN 103036994 B CN103036994 B CN 103036994B CN 201210553734 A CN201210553734 A CN 201210553734A CN 103036994 B CN103036994 B CN 103036994B
- Authority
- CN
- China
- Prior art keywords
- load
- data file
- cloud storage
- storage server
- metadata
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000003860 storage Methods 0.000 title claims abstract description 234
- 238000012544 monitoring process Methods 0.000 claims abstract description 31
- 238000000034 method Methods 0.000 claims abstract description 28
- 230000005012 migration Effects 0.000 claims description 12
- 238000013508 migration Methods 0.000 claims description 12
- 230000004044 response Effects 0.000 claims description 5
- 238000007726 management method Methods 0.000 description 58
- 230000008569 process Effects 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 3
- 238000012545 processing Methods 0.000 description 2
- 239000007787 solid Substances 0.000 description 2
- 230000008859 change Effects 0.000 description 1
- 238000013523 data management Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000009826 distribution Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000005192 partition Methods 0.000 description 1
- 230000000737 periodic effect Effects 0.000 description 1
- 230000009897 systematic effect Effects 0.000 description 1
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a kind of cloud storage system realizing load balancing, comprising load monitoring service unit for when detecting that the load of the first cloud storage site exceedes load threshold, application request being transmitted to the second cloud storage site; One in multiple Service Access Points of the second cloud storage site for sending to the metadata location management service unit that in multiple metadata location management service unit, load is lighter by application request; This metadata location management service unit is used for determining according to application request and applying corresponding metadata location information, and obtains corresponding metadata according to determined metadata location information from corresponding meta data server; Service Access Point also operates so that data file management subsystem performs according to application request accordingly for obtained metadata and application request are sent to data file management subsystem.The invention also discloses the load-balancing method for cloud storage system.The present invention can improve the performance of cloud storage system.
Description
Technical field
The present invention relates to field of computer technology, more specifically, relate to the cloud storage system that realizes load balancing and the load-balancing method for cloud storage system.
Background technology
Faced by cloud storage system is the application scenarios that mass users operates mass data, in production environment, may occur the performance bottleneck in each level.These performance bottlenecks can comprise such as other performance bottleneck site-level, Intra-site metadata access bottleneck, Intra-site load data access bottleneck and Intra-site data and store unbalanced.Such as, cloud storage site is deployed in certain region usually, externally provides cloud stores service by the Internet.There is provided in cloud stores service process in cloud storage site, may occur that the visit capacity of this area exceedes the phenomenon of this station services ability or other reasons causes network congestion, thus affect service response.
But, in the cloud storage products of existing existence or solution, just the unbalanced situation of a certain level in each level or the unbalanced situation of part are processed.Because performance bottleneck may occur in each level, carry out the unbalanced situation of some levels processing the performance partly can only improving cloud storage system, the performance of cloud storage system can not be improved on the whole.
Summary of the invention
For solving prior art Problems existing, the invention provides and a kind ofly realize the cloud storage system of load balancing and the load-balancing method for cloud storage system, making it possible to the performance improving the system that cloud stores preferably.
According to an aspect of the present invention, provide a kind of cloud storage system realizing load balancing, comprise load monitoring service unit, multiple cloud storage site, described multiple cloud storage site comprises the first cloud storage site and the second cloud storage site, wherein:
Described load monitoring service unit is used for when detecting that the load of described first cloud storage site exceedes load threshold, application request is transmitted to described second cloud storage site;
Described second cloud storage site comprises multiple Service Access Point, multiple metadata location management service unit, at least one meta data server and data file management subsystem, wherein:
The Service Access Point selected from multiple Service Access Point is for sending to the metadata location management service unit that in described multiple metadata location management service unit, load is lighter by the described application request received;
The lighter metadata location management service unit of described load is used for determining according to described application request and applying corresponding metadata location information, and obtains corresponding metadata according to determined metadata location information from corresponding meta data server;
Selected Service Access Point is used for obtained metadata and described application request to send to described data file management subsystem so that described data file management subsystem performs corresponding operation according to described application request.
In an alternative embodiment, described application request comprises read request or the write request of application, and described data file management subsystem, comprising:
Multiple storage server, for storing data files, wherein data file manages in the mode that object stores and a data file has at least one object;
Load balancing administrative unit, for monitoring in described multiple storage server the loading condition of each, and monitor the first storage server in multiple storage server write heavier loads time, sending object migration instruction, or, monitor described first storage server read heavier loads time, send copy set up instruction; And,
Data migration unit, for moving in the lighter storage server of load according to described object migration instruction by the partial objects of the data file in the first storage server; Or, according to described copy set up to be designated as in described first storage server read access frequently data file in the storage server that load is lighter, set up multiple read-only copy.
In an alternative embodiment, described data file management subsystem also comprises: store balanced management unit, for monitoring in described multiple storage server the space utilization rate of each, when the space utilization rate monitoring the second storage server exceedes space utilization rate threshold value, select the time period that described second storage server service load is lighter, indicate described data migration unit that the partial objects of the data file of described two storage servers is moved to the less storage server of space utilization rate.
In an alternative embodiment, the storage server of described data file management subsystem comprises: buffer unit, SSD/SAS disk and SATA disk, wherein: hot spots data file is stored in described buffer unit; And ordinary hot point data file is stored in described SSD or SAS disk; And non-hot spot data file is stored in described SATA disk.
According to another aspect of the present invention, additionally provide a kind of load-balancing method for cloud storage system, described cloud storage system comprises load monitoring service unit and multiple cloud storage site, wherein, described multiple cloud storage site comprises the first cloud storage site and the second cloud storage site, described second cloud storage site comprises multiple Service Access Point, multiple metadata location management service unit, at least one meta data server and data file management subsystem, and described load-balancing method comprises:
Application request, when detecting that the load of described first cloud storage site exceedes load threshold, is transmitted to described second cloud storage site by described load monitoring service unit;
Described second cloud storage site selects a Service Access Point from multiple Service Access Point, and the described application request received is sent to selected Service Access Point;
Application request is sent to the metadata location management service unit that in multiple metadata location management service unit, load is lighter by selected Service Access Point;
The lighter metadata location management service unit of described load is determined according to described application request and applies corresponding metadata location information, then obtains corresponding metadata according to determined metadata location information from corresponding meta data server;
Obtained metadata and described application request are sent to described data file management subsystem so that described data file management subsystem performs corresponding operation according to described application request by selected Service Access Point.
In an alternative embodiment, described application request comprises read request or the write request of application, described data file management subsystem comprises multiple storage server storing data file, and wherein data file manages in the mode that object stores and a data file has at least one object.Described load-balancing method also comprises: each loading condition in the described multiple storage server of described data file management subsystem monitoring, when monitor the first storage server write heavier loads time, the partial objects of the partial document data in described first storage server is moved in the lighter storage server of load; And/or, when monitor described first storage server read heavier loads time, for read access in described first storage server frequently data file in the storage server that load is lighter, set up multiple read-only copy with the read request of response application.
In an alternative embodiment, described load-balancing method also comprises: described data file management subsystem to monitor in described multiple storage server each space utilization rate, when the space utilization rate monitoring the second storage server exceedes space utilization rate threshold value, select the time period that described second storage server service load is lighter, the partial objects of the partial document data of described second memory is moved to the less storage server of space utilization rate.
In an alternative embodiment, described cloud storage system takes global name space to manage to data file, and described metadata store location management service unit, when each document creation, distributes a global space name for each data file and identifies ID.
In an alternative embodiment, described second cloud storage site is the cloud storage site that in described multiple cloud storage site, load is lighter.
In an alternative embodiment, hot spots data file is stored in the buffer unit of storage server by described data file management subsystem; Ordinary hot point data file is stored in SSD or the SAS disk of storage server; And non-hot spot data file is stored in the SATA disk of storage server.
The present invention, by carrying out equilibrium treatment to the load of cloud storage system at least two levels, makes it possible to the performance improving cloud storage system preferably.
Accompanying drawing explanation
Fig. 1 is the structural representation of the cloud storage system realizing load balancing according to an embodiment of the invention.
Fig. 2 is the structural representation of the cloud storage site in the cloud storage system shown in Fig. 1.
Fig. 3 is the structural representation of the data file management subsystem of the cloud storage site shown in Fig. 2.
Fig. 4 is according to an embodiment of the invention for the schematic flow sheet of the load-balancing method of cloud storage system.
Embodiment
Below in conjunction with accompanying drawing, the present invention is described in detail further.
Fig. 1 is the structural representation of the cloud storage system realizing load balancing according to an embodiment of the invention.As shown in Figure 1, the cloud storage system realizing load balancing of the embodiment of the present invention, comprises load monitoring service unit 10 and multiple cloud storage site.In order to the object that the present invention is described clearly, in Fig. 1, schematically show the first cloud storage site 22 and the second cloud storage site 24 and other cloud storage site.Application request, for when detecting that the load of described first cloud storage site 22 exceedes load threshold, is transmitted to described second cloud storage site 24 by load monitoring service unit 10.It should be noted that, in embodiments of the present invention, the arbitrary cloud storage site in multiple cloud storage site can be the first cloud storage site and the second cloud storage site.In an alternative embodiment, the second cloud storage site can be the cloud storage site that in multiple cloud storage site, load is lighter, the cloud storage site that such as load is the lightest.
In an alternative embodiment, load monitoring service unit 10 can be the independently load monitoring server in cloud storage system, or, can be the unit be arranged in cloud storage site 22.
Second cloud storage site, after receiving application request, provides service by the application request of data file copy to user of this locality; Or, after the first cloud storage site copies to the second cloud storage site, provide service by data file by proprietary network.
In embodiment of the present invention, cloud storage system can adopt the mode to data file carries out global name space to manage, and multiple like this cloud storage site can identify same data file easily.Such as, cloud storage site, when each data file creates, for each data file distributes a global space name mark ID, is performed by the metadata store location management service unit in cloud storage site usually.
Fig. 2 is the structural representation of the cloud storage site in the cloud storage system shown in Fig. 1.The embodiment of the cloud storage site shown in Fig. 2 can be the arbitrary cloud storage site in multiple cloud storage site.For convenience of explanation, be described for the second cloud storage site.As shown in Figure 2, the second cloud storage site is configured with multiple Service Access Point 241.In an alternative embodiment, cloud storage site can be configure different Service Access Points according to the type of application service.
Second cloud storage site 24 also comprises multiple metadata location management service unit 243, at least one meta data server 245 and data file management subsystem 247.
Second cloud storage site selects a Service Access Point after receiving application request from multiple Service Access Point 241 (as 241A and 241B), such as Service Access Point 241A.Then, Service Access Point A is used for the application request received to send to the metadata location management service unit that in multiple metadata location management service unit 243 (as 243A, 243B ... 243N), load is lighter, such as metadata location management service unit 243A.In an alternative embodiment, Service Access Point 241A can be the metadata location management service unit selecting load lighter by load balancing module.
The lighter metadata location management service unit 243A of load is used for determining according to described application request and applying corresponding metadata location information, and obtains corresponding metadata according to determined metadata location information from corresponding meta data server.
Second cloud storage site of the embodiment of the present invention visits the metadata corresponding with application request by multiple Service Access Point, can make to be dispersed in different access points to the access of metadata, thus can improve the service ability of overall metadata.Then, select the lighter metadata location management service unit of load obtain and apply corresponding metadata location information, which further increases the metadata access ability of cloud storage site.By metadata location management service unit and meta data server secondary mode, the request of hundred million rank metadata can be processed.
Then, selected Service Access Point is used for obtained metadata and described application request to send to described data file management subsystem so that described data file management subsystem performs corresponding operation according to described application request.Such as, application request, after receiving application request, according to the type of application request, can be transmitted to corresponding metadata or Data Management Unit by Service Access Point, perform corresponding operation by metadata or data processing unit, after completing, return to the device sending application request.
In embodiment of the present invention, application request can comprise read request or the write request of application.
Fig. 3 is the structural representation of the data file management subsystem in the cloud storage site shown in Fig. 2.As shown in Figure 3, data file management subsystem comprises: multiple storage server 302 (as 302A, 302B ..., 302N), for storing data files, wherein data file manages in the mode that object stores and a data file has at least one object.In one embodiment, object generates when data file establishment or write operation, large bric-a-brac.For individual data file, may be made up of multiple object.In an alternative embodiment, form this data file all objects can integrated distribution in certain partition holding of the storage cluster be made up of multiple storage server
As shown in Figure 3, data file management subsystem also comprises load balancing administrative unit 304, for monitoring in described multiple storage server the loading condition of each.Load balancing administrative unit 304 be further used for such as monitor the first storage server 302A in multiple storage server write heavier loads time, sending object migration instruction.Load balancing administrative unit 304 also for such as monitor described first storage server 302A read heavier loads time, send copy set up instruction.Data file management subsystem also comprises data migration unit 306, for moving in the lighter storage server of load according to object migration instruction by the partial objects of the data file in the first storage server 302A; Or, according to described copy set up to be designated as in the first storage server 302A read access frequently data file in the storage server that load is lighter, set up multiple read-only copy, so that the read request of response application.
In the further embodiment of the present invention, the mode that described data file management subsystem can adopt classification to store improves calling data file.Such as, storage server can adopt system cache---SSD disk (Solid State Disk, solid state hard disc)/SAS disk (Serial AttachedSCSI Disk, Serial Attached SCSI (SAS) disk)---the mode that SATA disk (Serial ATA Disk, serial ports ATA disk) three grades mixing stores improves the performance of data file management subsystem.Such as, main memory capacity is provided by SATA disk, and each storage server configures a small amount of SSD disk or SAS disk, and the system cache of minute quantity.During storage, hot spots data file can be stored in system cache (buffer unit namely in storage server); Ordinary hot point data file can be stored in described SSD or SAS disk; And non-hot spot data file can be stored in described SATA disk.Hot spots data file, ordinary hot point data file and non-hot spot data file can be determined according to presetting focus judgment rule (requesting threshold of such as user).Data file management subsystem can adjust the memory location of data file at any time according to the focus statistics of data file.In embodiments of the present invention, system cache can use as the buffer memory of disk system.
In optional embodiment of the present invention, described data file management subsystem can also comprise storage balanced management unit.The file size produced due to application is uneven, therefore may there is larger difference in the space utilization rate of each storage server, in order to solve the difference in this memory space utilance, storing balanced management unit can the space utilization rate of each storage server of periodic monitoring.
Store balanced management unit 308, for monitoring in described multiple storage server the space utilization rate of each.Such as, when the space utilization rate monitoring the second storage server 302B exceedes space utilization rate threshold value, select the time period that the second storage server 302B service load is lighter, the partial objects of the data file of the second storage server 302B is moved to the less storage server of space utilization rate by designation data migration units.
The scheme that the cloud storage system of the embodiment of the present invention is combined by multi-stage equalization techniques, between sites, the Equalization Design of the aspect such as serving access node, Metadata Service and storage, data file service and storage, make the various access load of the Intra-site that not only can process single region and the unbalanced of memory load, but also the access load balancing of cross-region can be carried out.By the cloud storage system realizing load balancing of the embodiment of the present invention, the resource being distributed in each region website in whole cloud storage system can be made to be used appropriately.
Fig. 4 is according to an embodiment of the invention for the schematic flow sheet of the load-balancing method of cloud storage system.Load monitoring service unit and multiple cloud storage site is comprised according to the cloud storage system of the embodiment of the present invention.Described multiple cloud storage site comprises the first cloud storage site and the second cloud storage site, and described second cloud storage site comprises multiple Service Access Point, multiple metadata location management service unit, at least one meta data server and data file management subsystem.As shown in Figure 4, the load-balancing method of the embodiment of the present invention comprises:
S401, application request, when detecting that the load of the first cloud storage site exceedes load threshold, is transmitted to the second cloud storage site by load monitoring service unit;
S402, the second cloud storage site selects a Service Access Point from multiple Service Access Point, and the application request received is sent to selected Service Access Point;
S403, application request is sent to the metadata location management service unit that in multiple metadata location management service unit, load is lighter by selected Service Access Point;
S404, the lighter metadata location management service unit of described load is determined according to application request and applies corresponding metadata location information, then obtains corresponding metadata according to determined metadata location information from corresponding meta data server;
S405, obtained metadata and described application request are sent to described data file management subsystem so that described data file management subsystem performs corresponding operation according to described application request by selected Service Access Point.
In an alternative embodiment, described application request comprises read request or the write request of application.In an alternative embodiment, cloud storage system takes global name space to manage to data file, and described metadata store location management service unit, when data file creates, distributes a global space name for each data file and identifies ID.In an alternative embodiment, described second cloud storage site is the cloud storage site that in described multiple cloud storage site, load is lighter.
In an alternative embodiment, described file managemnent subsystem comprises multiple storage server storing data file, and wherein data file manages in the mode that object stores and a data file has at least one object.Described load-balancing method can also comprise: each loading condition in the described multiple storage server of described data file management subsystem monitoring, when monitor the first storage server write heavier loads time, the partial objects of the partial document data in described first storage server is moved in the lighter storage server of load; And/or, when monitor described first storage server read heavier loads time, for read access in described first storage server frequently data file in the storage server that load is lighter, set up multiple read-only copy with the read request of response application.
In an alternative embodiment, described load-balancing method can also comprise: described data file management subsystem to monitor in described multiple storage server each space utilization rate, when the space utilization rate monitoring the second storage server exceedes space utilization rate threshold value, select the time period that described second storage server service load is lighter, the partial objects of the partial document data of described second memory is moved to the less storage server of space utilization rate.
In an alternative embodiment, hot spots data file is stored in the buffer unit of storage server by described data file management subsystem; Ordinary hot point data file is stored in SSD or the SAS disk of storage server; And non-hot spot data file is stored in the SATA disk of storage server.
Specific descriptions about the load-balancing method for cloud storage system can describe with further reference to the part realizing the cloud storage system of load balancing of the embodiment of the present invention, do not repeat them here.
Any specific computer, virtual system or miscellaneous equipment is not limited at this algorithm provided and realization.According to description above, the structure constructed required by this type systematic is apparent.In addition, the present invention is not also for any certain programmed language.It should be understood that and various programming language can be utilized to realize content of the present invention described here, and the description done language-specific is above to disclose preferred forms of the present invention.
Those skilled in the art are appreciated that and adaptively can change the module in the equipment in embodiment and they are arranged in one or more equipment different from this embodiment.Module in embodiment or unit or assembly can be combined into a module or unit or parts, and multiple submodule or subelement or subassembly can be put them in addition.Except at least some in such feature and/or process or unit be mutually repel except, any combination can be adopted to combine all processes of all features disclosed in this specification (comprising adjoint claim, summary and accompanying drawing) and so disclosed any method or equipment or unit.Unless expressly stated otherwise, each feature disclosed in this specification (comprising adjoint claim, summary and accompanying drawing) can by providing identical, alternative features that is equivalent or similar object replaces.
In addition, although describe a large amount of details of the embodiment of the present invention in the specification of the application, but can understand, the embodiment of the present invention is not could must implement in all detail situations.In some instances, be not shown specifically known method, structure and technology, so that be expressly understood inventive concept of the present invention.
The foregoing is only preferred embodiment of the present invention, not in order to limit the present invention, within the spirit and principles in the present invention all, any amendment done, equivalent replacement, improvement etc., all should be included within protection scope of the present invention.
Claims (10)
1. realize a cloud storage system for load balancing, comprise load monitoring service unit, multiple cloud storage site, described multiple cloud storage site comprises the first cloud storage site and the second cloud storage site, wherein:
Described load monitoring service unit is used for when detecting that the load of described first cloud storage site exceedes load threshold, application request is transmitted to described second cloud storage site;
Described second cloud storage site comprises multiple Service Access Point, multiple metadata location management service unit, at least one meta data server and data file management subsystem, wherein:
The Service Access Point selected from multiple Service Access Point is for sending to the metadata location management service unit that in described multiple metadata location management service unit, load is lighter by the described application request received;
The lighter metadata location management service unit of described load is used for determining according to described application request and applying corresponding metadata location information, and obtains corresponding metadata according to determined metadata location information from corresponding meta data server;
Selected Service Access Point also operates so that described data file management subsystem performs according to described application request accordingly for obtained metadata and described application request are sent to described data file management subsystem.
2. cloud storage system according to claim 1, is characterized in that, described application request comprises read request or the write request of application, and described data file management subsystem, comprising:
Multiple storage server, for storing data files, wherein data file manages in the mode that object stores and a data file has at least one object;
Load balancing administrative unit, for monitoring in described multiple storage server the loading condition of each, and monitor the first storage server in multiple storage server write heavier loads time, sending object migration instruction, or, monitor described first storage server read heavier loads time, send copy set up instruction;
Data migration unit, for moving in the lighter storage server of load according to described object migration instruction by the partial objects of the data file in the first storage server; Or,
According to described copy set up to be designated as in described first storage server read access frequently data file in the storage server that load is lighter, set up multiple read-only copy.
3. cloud storage system according to claim 2, is characterized in that, described data file management subsystem also comprises:
Store balanced management unit, for monitoring in described multiple storage server the space utilization rate of each, when the space utilization rate monitoring the second storage server exceedes space utilization rate threshold value, select the time period that described second storage server service load is lighter, indicate described data migration unit that the partial objects of the data file of described second storage server is moved to the less storage server of space utilization rate.
4. cloud storage system according to claim 2, is characterized in that, the storage server of described data file management subsystem comprises: buffer unit, SSD/SAS disk and SATA disk, wherein: hot spots data file is stored in described buffer unit; And ordinary hot point data file is stored in described SSD or SAS disk; And non-hot spot data file is stored in described SATA disk.
5. cloud storage system according to claim 1, is characterized in that:
Described cloud storage system takes global name space to manage to data file, and described metadata store location management service unit, when each document creation, distributes a global space name for each data file and identifies ID; Or,
Described second cloud storage site is the cloud storage site that in described multiple cloud storage site, load is lighter.
6. the load-balancing method for cloud storage system, described cloud storage system comprises load monitoring service unit and multiple cloud storage site, wherein, described multiple cloud storage site comprises the first cloud storage site and the second cloud storage site, described second cloud storage site comprises multiple Service Access Point, multiple metadata location management service unit, at least one meta data server and data file management subsystem, and described load-balancing method comprises:
Application request, when detecting that the load of described first cloud storage site exceedes load threshold, is transmitted to described second cloud storage site by described load monitoring service unit;
Described second cloud storage site selects a Service Access Point from multiple Service Access Point, and the described application request received is sent to selected Service Access Point;
Described application request is sent to the metadata location management service unit that in multiple metadata location management service unit, load is lighter by selected Service Access Point;
The lighter metadata location management service unit of described load is determined according to described application request and applies corresponding metadata location information, then obtains corresponding metadata according to determined metadata location information from corresponding meta data server;
Obtained metadata and described application request are sent to described data file management subsystem so that described data file management subsystem performs corresponding operation according to described application request by selected Service Access Point.
7. load-balancing method according to claim 6, it is characterized in that, described application request comprises read request or the write request of application, described data file management subsystem comprises multiple storage server storing data file, wherein data file manages in the mode that object stores and a data file has at least one object, and described load-balancing method also comprises:
Each loading condition in the described multiple storage server of described data file management subsystem monitoring,
When monitor the first storage server write heavier loads time, the partial objects of the partial document data in described first storage server is moved in the lighter storage server of load; And/or,
When monitor described first storage server read heavier loads time, for read access in described first storage server frequently data file in the storage server that load is lighter, set up multiple read-only copy with the read request of response application.
8. load-balancing method according to claim 7, is characterized in that, described load-balancing method also comprises:
Described data file management subsystem to monitor in described multiple storage server each space utilization rate,
When the space utilization rate monitoring the second storage server exceedes space utilization rate threshold value, select the time period that described second storage server service load is lighter, the partial objects of the partial document data of described second memory is moved to the less storage server of space utilization rate.
9. load-balancing method according to claim 6, is characterized in that:
Described cloud storage system takes global name space to manage to data file, and described metadata store location management service unit, when each document creation, distributes a global space name for each data file and identifies ID; Or,
Described second cloud storage site is the cloud storage site that in described multiple cloud storage site, load is lighter.
10. load-balancing method according to claim 7, is characterized in that: hot spots data file is stored in the buffer unit of storage server by described data file management subsystem; Ordinary hot point data file is stored in SSD or the SAS disk of storage server; And non-hot spot data file is stored in the SATA disk of storage server.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210553734.3A CN103036994B (en) | 2012-12-18 | 2012-12-18 | Realize the cloud storage system of load balancing |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210553734.3A CN103036994B (en) | 2012-12-18 | 2012-12-18 | Realize the cloud storage system of load balancing |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103036994A CN103036994A (en) | 2013-04-10 |
| CN103036994B true CN103036994B (en) | 2015-08-19 |
Family
ID=48023466
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201210553734.3A Active CN103036994B (en) | 2012-12-18 | 2012-12-18 | Realize the cloud storage system of load balancing |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103036994B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP3419247A4 (en) * | 2016-02-19 | 2019-03-06 | Hangzhou Hikvision Digital Technology Co., Ltd. | Method and device for storage resource allocation for video cloud storage |
Families Citing this family (20)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP2942715B1 (en) | 2013-09-24 | 2017-11-08 | Huawei Technologies Co., Ltd. | Data migration method, data migration apparatus and storage device |
| CN104142862B (en) * | 2013-12-16 | 2015-09-16 | 腾讯科技（深圳）有限公司 | The overload protection method of server and device |
| CN103823639A (en) * | 2014-02-19 | 2014-05-28 | 曙光信息产业(北京)有限公司 | Method and system for migrating objects |
| CN104935760A (en) * | 2014-03-20 | 2015-09-23 | 中兴通讯股份有限公司 | Cloud call center recording method, system and core dispatching equipment |
| CN103825785B (en) * | 2014-03-24 | 2017-05-10 | 北京中电普华信息技术有限公司 | Monitoring method and device of service node |
| CN105025042B (en) * | 2014-04-16 | 2019-06-28 | 中国移动通信集团河北有限公司 | A kind of method and system of determining data information, proxy server |
| CN104092756B (en) * | 2014-07-09 | 2017-07-28 | 东南大学 | A kind of resource dynamic distributing method of the cloud storage system based on DHT mechanism |
| CN105763508B (en) * | 2014-12-16 | 2019-12-10 | 阿里巴巴集团控股有限公司 | Data access method and application server |
| CN106534227B (en) * | 2015-09-09 | 2020-02-18 | 阿里巴巴集团控股有限公司 | Method and apparatus for extending distributed consistency services |
| CN105338080A (en) * | 2015-10-28 | 2016-02-17 | 无锡峰巢美家网络科技有限公司 | Synchronization and balancing service system of multi-server service data and balancing method |
| CN106911776B (en) * | 2017-02-24 | 2020-02-07 | 郑州云海信息技术有限公司 | Management method and device of cloud storage equipment |
| CN107147531B (en) * | 2017-05-27 | 2020-03-20 | 贵州华宁科技股份有限公司 | CDM cluster website management system |
| CN107436813A (en) * | 2017-08-03 | 2017-12-05 | 郑州云海信息技术有限公司 | A kind of method and system of meta data server dynamic load leveling |
| CN110309101B (en) * | 2018-03-23 | 2021-08-31 | 浙江宇视科技有限公司 | Data management method and Hadoop distributed file system |
| CN108600012A (en) * | 2018-04-26 | 2018-09-28 | 深圳光华普惠科技有限公司 | Micro services framework monitoring system |
| CN109104404B (en) * | 2018-06-20 | 2022-03-29 | 广州中国科学院软件应用技术研究所 | Dynamic encrypted medical big data system and method |
| CN113885794B (en) * | 2021-09-10 | 2024-01-26 | 鸬鹚科技(深圳)有限公司 | Data access method and device based on multi-cloud storage, computer equipment and medium |
| CN114615275B (en) * | 2022-03-04 | 2024-05-10 | 国家工业信息安全发展研究中心 | Cloud storage-oriented distributed load balancing control method and device |
| CN116155909B (en) * | 2023-04-24 | 2023-06-27 | 中诚华隆计算机技术有限公司 | Method and system for load balancing by flow control chip |
| CN116893900A (en) * | 2023-07-19 | 2023-10-17 | 合芯科技有限公司 | Cluster computing pressure load balancing method, system, equipment and IC design platform |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101697526A (en) * | 2009-10-10 | 2010-04-21 | 中国科学技术大学 | Method and system for load balancing of metadata management in distributed file system |
| CN101710339A (en) * | 2009-11-20 | 2010-05-19 | 中国科学院计算技术研究所 | Method and system for controlling data storage in cluster file system and method for creating file |
| CN101753617A (en) * | 2009-12-11 | 2010-06-23 | 中兴通讯股份有限公司 | Cloud storage system and method |
| CN102035884A (en) * | 2010-12-03 | 2011-04-27 | 华中科技大学 | Cloud storage system and data deployment method thereof |
| CN102055650A (en) * | 2009-10-29 | 2011-05-11 | 华为技术有限公司 | Load balance method and system and management server |
| CN102163175A (en) * | 2011-04-26 | 2011-08-24 | 西安交通大学 | Hybrid address mapping method based on locality analysis |
-
2012
- 2012-12-18 CN CN201210553734.3A patent/CN103036994B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101697526A (en) * | 2009-10-10 | 2010-04-21 | 中国科学技术大学 | Method and system for load balancing of metadata management in distributed file system |
| CN102055650A (en) * | 2009-10-29 | 2011-05-11 | 华为技术有限公司 | Load balance method and system and management server |
| CN101710339A (en) * | 2009-11-20 | 2010-05-19 | 中国科学院计算技术研究所 | Method and system for controlling data storage in cluster file system and method for creating file |
| CN101753617A (en) * | 2009-12-11 | 2010-06-23 | 中兴通讯股份有限公司 | Cloud storage system and method |
| CN102035884A (en) * | 2010-12-03 | 2011-04-27 | 华中科技大学 | Cloud storage system and data deployment method thereof |
| CN102163175A (en) * | 2011-04-26 | 2011-08-24 | 西安交通大学 | Hybrid address mapping method based on locality analysis |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP3419247A4 (en) * | 2016-02-19 | 2019-03-06 | Hangzhou Hikvision Digital Technology Co., Ltd. | Method and device for storage resource allocation for video cloud storage |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103036994A (en) | 2013-04-10 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103036994B (en) | Realize the cloud storage system of load balancing | |
| US8495013B2 (en) | Distributed storage system and method for storing objects based on locations | |
| US9990147B2 (en) | Methods and apparatus for optimizing resource utilization in distributed storage systems | |
| US10579272B2 (en) | Workload aware storage platform | |
| US9632731B2 (en) | Distributing capacity slices across storage system nodes | |
| JP6507167B2 (en) | Distribute data on a distributed storage system | |
| US20190034084A1 (en) | Selecting controllers based on affinity between access devices and storage segments | |
| US20180081562A1 (en) | Cloud storage system | |
| US20160132541A1 (en) | Efficient implementations for mapreduce systems | |
| US8904047B1 (en) | Cloud capable storage system with high perormance nosql key-value pair operating environment | |
| CN104536903B (en) | A kind of mixing storage method and system stored classifiedly by data attribute | |
| US9906596B2 (en) | Resource node interface protocol | |
| CN102118433A (en) | Multiple-tier distributed cluster system | |
| US9158714B2 (en) | Method and system for multi-layer differential load balancing in tightly coupled clusters | |
| US20120297067A1 (en) | Load Balancing System for Workload Groups | |
| WO2006061272A1 (en) | Storage pool space allocation across multiple locations | |
| JP7234479B2 (en) | Object storage system using multi-level hash function for storage address determination | |
| US20190220454A1 (en) | Data storage system and process for providing distributed storage in a scalable cluster system and computer program for such data storage system | |
| CN111149081A (en) | Metadata control in load-balanced distributed storage systems | |
| KR102521051B1 (en) | Hybrid data lookup methods | |
| US20090240911A1 (en) | Information processing apparatus and informaiton processing method | |
| Nannai John et al. | A novel dynamic data replication strategy to improve access efficiency of cloud storage | |
| CN107969153A (en) | A kind of resource allocation methods, device and NUMA system | |
| KR20180046078A (en) | Database rebalancing method | |
| US20160014203A1 (en) | Storage fabric address based data block retrieval |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| EE01 | Entry into force of recordation of patent licensing contract |
Application publication date: 20130410 Assignee: JIANGSU DAWN INFORMATION TECHNOLOGY Co.,Ltd. Assignor: Dawning Information Industry (Beijing) Co.,Ltd. Contract record no.: 2017320000013 Denomination of invention: Cloud storage system capable of achieving load balance Granted publication date: 20150819 License type: Exclusive License Record date: 20170217 |
|
| LICC | Enforcement, change and cancellation of record of contracts on the licence for exploitation of a patent or utility model | ||
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20170609 Address after: 830011 No. 2015-735, Cyberport building, No. 258, Gaoxin street, hi tech Industrial Development Zone, the Xinjiang Uygur Autonomous Region, Urumqi Patentee after: Urumqi Zhongke Shuguang cloud computing Co.,Ltd. Address before: 100193 Beijing, Haidian District, northeast Wang West Road, building 8, No. 36 Patentee before: Dawning Information Industry (Beijing) Co.,Ltd. |
|
| CP03 | Change of name, title or address | ||
| CP03 | Change of name, title or address |
Address after: 830011 the Xinjiang Uygur Autonomous Region Urumqi hi tech Industrial Development Zone (new urban area) 2015-735, No. 258 Cyberport, high tech street. Patentee after: Xinjiang Zhongke Suguang Cloud Computing Co.,Ltd. Country or region after: Zhong Guo Address before: 830011 the Xinjiang Uygur Autonomous Region Urumqi hi tech Industrial Development Zone (new urban area) 2015-735, No. 258 Cyberport, high tech street. Patentee before: Urumqi Zhongke Shuguang cloud computing Co.,Ltd. Country or region before: Zhong Guo |