CN108111566A - A kind of cloud storage system expansion method, device and cloud storage system - Google Patents
A kind of cloud storage system expansion method, device and cloud storage system Download PDFInfo
- Publication number
- CN108111566A CN108111566A CN201611066896.9A CN201611066896A CN108111566A CN 108111566 A CN108111566 A CN 108111566A CN 201611066896 A CN201611066896 A CN 201611066896A CN 108111566 A CN108111566 A CN 108111566A
- Authority
- CN
- China
- Prior art keywords
- server
- dilatation
- data
- write
- dilatations
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1001—Protocols in which an application is distributed across nodes in the network for accessing one among a plurality of replicated servers
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1001—Protocols in which an application is distributed across nodes in the network for accessing one among a plurality of replicated servers
- H04L67/1004—Server selection for load balancing
- H04L67/1008—Server selection for load balancing based on parameters of servers, e.g. available memory or workload
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1097—Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
Abstract
An embodiment of the present invention provides a kind of cloud storage system expansion method, device and cloud storage system, the method is applied to the management server in cloud storage system, and method includes：Determine to be registered at least two dilatation servers of management server in preset time；Secondary server is chosen from least two dilatation servers, and indicates secondary server management at least two dilatation servers；When detecting write data requests, data are write to secondary server, so that the data received are write at least two dilatation servers by secondary server according to load balancing principle；The memory space occupation proportion of at least two dilatation servers is monitored by secondary server；When the memory space occupation proportion for monitoring at least two dilatation servers reaches first threshold, the administration authority of at least two dilatation servers of management is obtained.Using the embodiment of the present invention, smoothly data can be write to dilatation server.
Description
Technical field
The present invention relates to cloud storage technical fields, are deposited more particularly to a kind of cloud storage system expansion method, device and cloud
Storage system.
Background technology
At present, user accesses data often through cloud storage system.Wherein, cloud storage system is conceptive in cloud computing
Extend and developed it is a kind of by functions such as cluster application, grid or distributed file systems, by application it is soft
Part gathers collaborative work, a common system for externally providing data storage and Operational Visit function.Cloud storage system
It can include management server and storage server.Wherein, management server is used to received data being written to cloud storage
In storage server in system；Storage server is used to store received data.
In practical applications, the memory capacity of cloud storage system is differed from several PB (Petabyte, petabyte) to PB up to a hundred.
But as cloud storage technology is widely used, the capacity of fixed cloud storage system cannot be met the needs of users.
Therefore, technical staff usually needs, according to storage demand, the dilatation service of respective numbers manually to be added in cloud storage system
Device, to increase the memory capacity of cloud storage system.
But it when carrying out dilatation to cloud storage system in this way, can lead to the problem of as follows：During dilatation, management clothes
Business device can cause dilatation server storage pressure to rise violently, very preferentially to the dilatation server storage data with high storage performance
Data capability is write to what can be born beyond dilatation server, causes to be write the loss of data of the dilatation server.
The content of the invention
The embodiment of the present invention is designed to provide a kind of cloud storage system expansion method, device and cloud storage system, with
Smoothly data are write to dilatation server.
In a first aspect, an embodiment of the present invention provides a kind of cloud storage system expansion method, applied in cloud storage system
Management server, the method may include：
Determine to be registered at least two dilatation servers of the management server in preset time；
Secondary server is chosen from at least two dilatations server, and is indicated described in the secondary server management
At least two dilatation servers, wherein, the management server is actually determined in the secondary server, not to described pre-
If any dilatation server write-in data of the management server are registered in the time；
When detecting write data requests, data are write to the secondary server, so that the secondary server will connect
The data received write at least two dilatations server according to load balancing principle；
The memory space occupation proportion of at least two dilatations server is monitored by the secondary server；
When the memory space occupation proportion for monitoring at least two dilatations server reaches first threshold, obtain
Manage the administration authority of at least two dilatation server.
Optionally, the step of secondary server is chosen from at least two dilatations server can include：
Target dilatation server in at least two dilatations server is determined as secondary server, the target expands
Hold server for first dilatation server for being registered to the management server in the preset time.
Optionally, the step of secondary server is chosen from at least two dilatations server can include：
The dilatation server that at least two dilatations server is elected, is chosen for secondary server, wherein, institute
It is storage performance ginseng of at least two dilatations server based on received each dilatation server to state secondary server
It is several to elect what is come.
Optionally, before the step of writing data to the secondary server, can also include：
Initialization and/or formatting commands are sent to the secondary server, so that the secondary server is according to being connect
The initialization received and/or formatting commands are initialized and/or formatted to each dilatation server.
Optionally, the secondary server expands the data received according to load balancing principle write-in described at least two
The step of holding server, it can include：
The data received are write the secondary server itself and other dilatation servers by the secondary server, and
Whether the memory space occupation proportion for detecting the secondary server and other dilatation servers arrives second threshold；
If it is not, continue to write to data to the dilatation server of not up to described second threshold；
If reaching the second threshold, number is write to the secondary server itself and other described dilatation servers
According to until the memory space occupation proportion of the secondary server and other dilatation servers reaches the first threshold
When, stop writing data to the secondary server and other dilatation servers, wherein, the second threshold is less than first threshold
Value.
Second aspect, the embodiment of the present invention additionally provides a kind of cloud storage system flash chamber, applied to cloud storage system
In management server, described device can include：
Determination unit, for determining to be registered at least two dilatation services of the management server in preset time
Device；
Unit is chosen, for choosing secondary server from at least two dilatations server；
Indicating member is used to indicate the secondary server and manages at least two dilatations server, wherein, the pipe
Reason server is actually determined in the secondary server, not to being registered to the management server in the preset time
Any dilatation server writes data；
Write data unit, for when detecting write data requests, data being write to the secondary server, so that described
The data received are write at least two dilatations server by secondary server according to load balancing principle；
Monitoring unit, the memory space for monitoring at least two dilatations server by the secondary server account for
Use ratio；
Acquiring unit, for reaching the when the memory space occupation proportion that monitor at least two dilatations server
During one threshold value, the administration authority for managing at least two dilatation server is obtained.
Optionally, in one implementation, the selection unit is specifically used for：
Target dilatation server in at least two dilatations server is determined as secondary server, the target expands
Hold server for first dilatation server for being registered to the management server in the preset time.
Optionally, in another realization method, the selection unit is specifically used for：
The dilatation server that at least two dilatations server is elected, is chosen for secondary server, wherein, institute
It is storage performance ginseng of at least two dilatations server based on received each dilatation server to state secondary server
It is several to elect what is come.
Optionally, described device can also include：
Transmitting element, before write data unit writes data to the secondary server, to the assistant service
Device sends initialization and/or formatting commands, so that the secondary server is according to received initialization and/or formatting
Instruction, is initialized and/or is formatted to each dilatation server.
Optionally, in write data unit after the secondary server writes data, the secondary server will connect
The step of data received write at least two dilatations server according to load balancing principle can include：
The data received are write the secondary server itself and other dilatation servers by the secondary server, and
Whether the memory space occupation proportion for detecting the secondary server and other dilatation servers arrives second threshold；
If it is not, continue to write to data to the dilatation server of not up to described second threshold；
If reaching the second threshold, number is write to the secondary server itself and other described dilatation servers
According to until the memory space occupation proportion of the secondary server and other dilatation servers reaches the first threshold
When, stop writing data to the secondary server and other dilatation servers, wherein, the second threshold is less than first threshold
Value.
The third aspect, the embodiment of the present invention additionally provide a kind of cloud storage system, including management server and multiple dilatations
Server, the management server are used for：
Determine to be registered at least two dilatation servers of the management server in preset time；
Secondary server is chosen from at least two dilatations server, and is indicated described in the secondary server management
At least two dilatation servers, wherein, the management server is actually determined in the secondary server, not to described pre-
If any dilatation server write-in data of the management server are registered in the time；
When detecting write data requests, data are write to the secondary server, so that the secondary server will connect
The data received write at least two dilatations server according to load balancing principle；
The memory space occupation proportion of at least two dilatations server is monitored by the secondary server；
When the memory space occupation proportion for monitoring at least two dilatations server reaches first threshold, obtain
Manage the administration authority of at least two dilatation server.
In embodiments of the present invention, the management server in cloud storage system can be registered to described out of preset time
In the dilatation server of management server, a dilatation server is chosen as secondary server；And obtain auxiliary clothes in selection
It is engaged in before device, does not write data into any dilatation server, avoid moment of the dilatation server in access cloud storage system
The problem of storage pressure rises violently；After selection obtains secondary server, indicate the secondary server in the preset time
Interior, at least two dilatations server for being registered to the management server is managed；When detecting write data requests,
Data are write to secondary server, the secondary server smoothly writes data into dilatation server；The management service
Device can also monitor the memory space occupation proportion of each dilatation server by secondary server；When passing through the assistant service
When device monitors that the memory space occupation proportion of each dilatation server reaches first threshold, management server is obtained to each
The administration authority of dilatation server, at this moment, management server smoothly can write data, i.e. dilatation service to dilatation server
Device is smoothly added to the cloud storage system.
Description of the drawings
It in order to illustrate more clearly about the embodiment of the present invention or technical scheme of the prior art, below will be to embodiment or existing
There is attached drawing needed in technology description to be briefly described, it should be apparent that, the accompanying drawings in the following description is only this
Some embodiments of invention, for those of ordinary skill in the art, without creative efforts, can be with
Other attached drawings are obtained according to these attached drawings.
Fig. 1 is a kind of cloud storage system expansion method flow chart provided in an embodiment of the present invention；
Fig. 2 is a kind of cloud storage system expansion method schematic diagram provided in an embodiment of the present invention；
Fig. 3 is a kind of structure diagram of cloud storage system flash chamber provided in an embodiment of the present invention；
Fig. 4 is that the interaction of management server and secondary server in a kind of cloud storage system provided in an embodiment of the present invention is shown
It is intended to.
Specific embodiment
Below in conjunction with the attached drawing in the embodiment of the present invention, the technical solution in the embodiment of the present invention is carried out clear, complete
Site preparation describes, it is clear that described embodiment is only part of the embodiment of the present invention, instead of all the embodiments.It is based on
Embodiment in the present invention, those of ordinary skill in the art are obtained every other without making creative work
Embodiment belongs to the scope of protection of the invention.
In order to solve when carrying out dilatation to cloud storage system, since the management server in cloud storage system is preferentially to tool
There are the dilatation server storage data of high storage performance, caused dilatation server storage pressure rises violently or even beyond dilatation
Server can bear the problem of writing data capability, an embodiment of the present invention provides a kind of cloud storage system expansion method and dresses
It puts.
Cloud storage system expansion method provided in an embodiment of the present invention is illustrated first below.
It should be noted that the executive agent of the cloud storage system expansion method is：Need the cloud of expansion memory capacity
Management server in storage system.Wherein, realize that the functional software of the cloud storage system expansion method of the embodiment of the present invention can
Think：It is arranged in the management server dedicated for the software of dilatation, or：It is arranged in the management server
For the feature card in the software of dilatation, it is not limited thereto certainly.
Referring to Fig. 1, the cloud storage system expansion method may comprise steps of：
S101：Determine to be registered at least two dilatation servers of the management server in preset time；
It is understood that the management server can receive the registration request of dilatation server transmission, further, institute
Stating management server can determine to be registered at least two dilatation servers of itself in preset time.
For example, the management server can determine that in preset time be 9:00-9:In 05 period, it is registered to certainly
At least two dilatation servers of body, and using at least two dilatations server as the first equipment in the capacity expansion cluster.Certainly, institute
Stating management server can also determine that in preset time be 10:00-15:In 05, at least two dilatation services of itself are registered to
Device, and using this identified at least two dilatations server as the second equipment in the capacity expansion cluster, this is rational.
S102：Secondary server is chosen from at least two dilatations server, and indicates the secondary server pipe
Manage at least two dilatations server, wherein, the management server is actually determined in the secondary server, not to
Any dilatation server write-in data of the management server are registered in the preset time；
Wherein, after determining to be registered at least two dilatation servers of the management server in preset time,
In a kind of realization method, the management server can be by the target dilatation service in identified at least two dilatations server
Device is determined as secondary server.Wherein, the target dilatation server can be registered to institute for first in the preset time
The dilatation server of management server is stated, is not limited thereto certainly.
In another realization method, the management server can be pushed away identified at least two dilatations server
The dilatation server selected, is chosen for secondary server, wherein, the secondary server is at least two dilatations service
Device, the storage performance parameter based on received each dilatation server elect come.It is laid out for clarity, it is follow-up right
This kind of realization method is described in detail.
It should be noted that the storage performance parameter includes but is not limited to memory usage, central processing unit makes
With rate and network interface card utilization rate.
It is understood that after choosing secondary server from identified at least two dilatations server, the management
Server can indicate that the secondary server manages at least two dilatations server, that is to say, that the secondary server
The administration authority for managing at least two dilatations server is obtained, the administration authority is included at least two dilatations server
Into row write data management.
For example, when the management server will be 9 in preset time:00-9:In 05 period, the first of registration expands
The dilatation server A held in device clusters (including dilatation server A, dilatation server B and dilatation server C) is chosen for aiding in
After server, the management server can indicate the dilatation server A to its own and dilatation server B and dilatation
Server C is managed.
Similarly, when the management server will be 10 in preset time:00-15:In 05 period, the second dilatation of registration
Dilatation server D in device clusters (including dilatation server D and dilatation server E), it is described after being chosen for secondary server
Management server can indicate that the dilatation server D is managed its own and dilatation server E.
It should be noted that in order to avoid dilatation server is being registered to the moment of the management server, the management
Server insanely writes data to dilatation server, causes what storage pressure moment of dilatation server rose violently to happen,
The management server is actually determined in the secondary server, not to be registered in the preset time it is described management clothes
Any dilatation server write-in data of business device.
S103：When detecting write data requests, data are write to the secondary server, so that the secondary server
The data received are write into at least two dilatations server according to load balancing principle；
It is understood that in one implementation, the management server is being received to the secondary server
After writing the write data requests of data, the management server can write data to the secondary server.Wherein, it is described to write
Request of data can the secondary server send.
In another realization method, when the management server sends write data requests to the secondary server,
And it as the recipient that the secondary server is asked as write data, receives write data and asks and respond to allow to write
When entering data, the management server writes data to the secondary server.
In addition, the management server is after the secondary server writes data, described in the secondary server receives
The data that management server is write, and can be by received data, according at least two described in the write-in of load balancing principle
A dilatation server is realized and writes data management to each dilatation server.It is laid out for clarity, subsequently to the assistant service
The realization method of each dilatation server into row write data management is described in detail in device.
S104：The memory space occupation proportion of at least two dilatations server is monitored by the secondary server；
S105：When the memory space occupation proportion for monitoring at least two dilatations server reaches first threshold
When, obtain the administration authority for managing at least two dilatation server.
It is understood that during the secondary server is managed at least two dilatations server,
The memory space that the management server by the secondary server, can monitor at least two dilatations server occupies
Ratio.When the memory space occupation proportion for monitoring at least two dilatations server reaches first threshold, pipe is obtained
The administration authority of at least two dilatations server is managed, realizes the management server at least two dilatations server
It is directly managed, completes the dilatation of the cloud storage system.
Wherein, the mode of the administration authority of the management server acquisition at least two dilatations server includes：It obtains
The index data corresponding to the data that the secondary server writes at least two dilatations server is obtained, and described in instruction
Secondary server closes the function being managed at least two dilatations server.Wherein, in the secondary server
After closing management function, storage server storage data are only used as.
It should be noted that the first threshold and the memory space of each server in the cloud storage system occupy
The absolute value of the difference of ratio is less than predetermined threshold value.The predetermined threshold value can be carried out by people in the art according to actual conditions
Setting, does not limit herein.
In addition, memory space occupation proportion refers to that the storage for the data volume and dilatation server for writing dilatation server is held
The ratio of amount.
What deserves to be explained is at least two dilatations server involved in the embodiment of the present invention, is for same
It is registered in one preset time for the dilatation server of the management server.
In embodiments of the present invention, the management server in cloud storage system can be registered to described out of preset time
In the dilatation server of management server, a dilatation server is chosen as secondary server；And obtain auxiliary clothes in selection
It is engaged in before device, does not write data into any dilatation server, avoid moment of the dilatation server in access cloud storage system
The problem of storage pressure rises violently；After selection obtains secondary server, indicate the secondary server in the preset time
Interior, at least two dilatations server for being registered to the management server is managed；When detecting write data requests,
Data are write to secondary server, the secondary server smoothly writes data into dilatation server；The management service
Device can also monitor the memory space occupation proportion of each dilatation server by secondary server；When passing through the assistant service
When device monitors that the memory space occupation proportion of each dilatation server reaches first threshold, management server is obtained to each
The administration authority of dilatation server, at this moment, management server smoothly can write data, i.e. dilatation service to dilatation server
Device is smoothly added to the cloud storage system.
Management server in the embodiment of the present invention is elected identified at least two dilatations server below
Dilatation server, the realization method for being chosen for secondary server are described further.
For example, the management server is 9 in definite preset time:00-9:In 05 period, itself is registered to
After first equipment in the capacity expansion cluster (including dilatation server A, dilatation server B and dilatation server C), the first dilatation can be set
The quantity of dilatation server and the IP address and storage performance of each dilatation server included included in standby cluster
The information such as parameter, each dilatation server being sent respectively in the first equipment in the capacity expansion cluster.
Each dilatation server in the first equipment in the capacity expansion cluster, such as dilatation server A, are receiving the pipe
Manage the quantity 3 of dilatation server included in the first equipment in the capacity expansion cluster that server is sent, dilatation server A, dilatation clothes
It is engaged in the storage performance of the IP address and dilatation server A of device B and dilatation server C, dilatation server B and dilatation server C
After the information such as parameter, which can elect dilatation server according to the storage performance parameter of each dilatation server
B is secondary server, and according to the IP address of dilatation server B, sends connection request to dilatation server B, and taken to dilatation
Business device B sends the information such as itself working condition and disk parameter.
Mode is elected according to same, it itself is secondary server that dilatation server B, which is elected,；Dilatation server C elects expansion
Appearance server B is secondary server, and according to the IP address of dilatation server B, connection request is sent to dilatation server B, and
The information such as working condition and the disk parameter of itself are sent to dilatation server B.
The detection of dilatation server B receives 2 connection requests, and dilatation server B can determine itself to be dilatation server
A, the dilatation server that dilatation server B and dilatation server C are elected, and it oneself is described to be reported to the management service
The dilatation server that at least two dilatation servers are elected, so as to which the management server can be by the dilatation server B
It is chosen for secondary server.
Since in the prior art, before dilatation server is accessed cloud storage system, technical staff needs to pass through craft
Operation carries out initialization operation to the dilatation server, and either format manipulation terminates in initialization operation or format manipulation
And then by the dilatation server registration into cloud storage system, it is necessary to expend more human resources.And due to initialization
Operation and format manipulation usually need the more time, therefore can greatly expend the time of technical staff.Therefore, in this hair
In bright one embodiment, before the step of writing data to the secondary server, it can also include：
Initialization and/or formatting commands are sent to the secondary server, so that the secondary server is according to being connect
The initialization received and/or formatting commands are initialized and/or formatted to each dilatation server.
It is understood that the management server in dilatation server after itself is registered to, and to described auxiliary
It helps before server write-in data, initialization directive can be sent to the secondary server, so that the secondary server
After the initialization directive is received, the initialization directive can be based on, at least two dilatations server is carried out
Initialization.For example, being one piece of disk by the magnetic disc virtualization of at least two dilatations server, it is not limited thereto certainly.
In addition, the management server before data are write to the secondary server, can also take to the auxiliary
Business device sends formatting commands, so that the secondary server after the formatting commands are received, can be based on described
The disc format of at least two dilatations server is turned to the disc format of the cloud storage system by formatting commands.Example
Such as：The disk of at least two dilatations server is divided into preset group (i.e. default block region), is not limited thereto certainly.
It should be noted that the secondary server is at least two dilatations server initiation and/or form
After change, write data requests can be sent to the management server；The management server is receiving write data
After request, data are write to the secondary server.
Below to secondary server described in the embodiment of the present invention to each dilatation server into the reality of row write data management
Existing mode is described in detail.
In one implementation, the secondary server by the data received according to load balancing principle write-in described in
The step of at least two dilatation servers, can include：
The data received are write the secondary server itself and other dilatation servers by the secondary server, and
Whether the memory space occupation proportion for detecting the secondary server and other dilatation servers arrives second threshold；
If it is not, continue to write to data to the dilatation server of not up to described second threshold；
If reaching the second threshold, number is write to the secondary server itself and other described dilatation servers
According to until the memory space occupation proportion of the secondary server and other dilatation servers reaches the first threshold
When, stop writing data to the secondary server and other dilatation servers, wherein, the second threshold is less than first threshold
Value.
Wherein, the secondary server can preset first threshold and second threshold, and set the second threshold
Less than the first threshold.The first threshold is being described above, and this will not be repeated here.
It is understood that when the secondary server receives the data that the management server is sent, it is described auxiliary
Help server that can write data to the secondary server itself and other dilatation servers；And it may be employed what is detected in real time
Whether mode, the memory space occupation proportion for detecting the secondary server and other dilatation servers reach second
Threshold value.
If not reaching second threshold, data are continued to write to the dilatation server of not up to described second threshold；
When reaching the second threshold so that (i.e. memory space occupies ratio to the storage pressure of at least two dilatations server
Example) reach balanced for the first time, at this point, continuing to write to number to the secondary server itself and other described dilatation servers again
According to；Then, the secondary server detects itself and whether the memory space occupation proportion of other dilatation servers reaches
First threshold if not reaching the first threshold, is continued to write to the dilatation server of not up to described first threshold
Data；When reaching the first threshold so that the storage pressure of at least two dilatations server reaches second
Weighing apparatus, and the storage pressure of at least two dilatations server is caused gently to be transitioned into first threshold by second threshold, at this time
Stop writing data to the secondary server and other dilatation servers.
It should be noted that other described dilatation servers are：The management server is registered in preset time
In at least two dilatations service, all dilatation servers in addition to the secondary server.
It should also be noted that, in order to which the storage pressure of at least two dilatations server is made more gently to be transitioned into institute
First threshold is stated, the 3rd threshold value, the 4th threshold value and the 5th threshold value etc. can also be preset, this is all rational.Wherein, institute
It states the 3rd threshold value, the 4th threshold value and the 5th threshold value and is respectively less than the first threshold.
In addition, when at least two dilatations server is abnormal, the memory space of at least two server
Occupation proportion would generally be very high.Therefore, in order to detect whether at least two dilatations server is abnormal, this field
Technical staff can set an outlier threshold according to actual conditions.When any dilatation clothes in at least two dilatations server
When the memory space occupation proportion of business device is more than the outlier threshold, the dilatation server exception and notification technique personnel are determined.
Wherein, it will be appreciated by persons skilled in the art that the outlier threshold is more than the first threshold.
Cloud storage system expansion method provided in an embodiment of the present invention is described further with reference to Fig. 2.
Referring to Fig. 2, cloud storage system expansion method provided in an embodiment of the present invention may include steps of：
S1：At least two dilatation startup of server；
S2：At least two dilatations server is registered to the management server of cloud storage system in preset time；
S3：Each dilatation server of the management server into at least two dilatations server returns to registration
To the dilatation server of the management server quantity and be registered to each dilatation server of the management server
Storage performance parameter；
S4：At least two dilatations server elects auxiliary to take according to the storage performance parameter of each dilatation server
Business device；
S5：Other dilatation servers in at least two dilatations server in addition to secondary server, by itself
The information reportings such as presence and disk parameter give the secondary server；
S6：The secondary server is receiving the information such as presence and disk parameter that other equipment in the capacity expansions report
Afterwards, each dilatation server that the management server is registered in the preset time is initialized；
S7：After initialization operation is completed, the secondary server in the preset time to being registered to the management
Each dilatation server of server is formatted；
S8：After format manipulation is completed, the secondary server sends write data requests to the management server；
S9：The management server writes data after write data request is received, to the secondary server；
S10：The secondary server after the data of management server write-in are received, the secondary server to
Itself and other dilatation servers write data；
S11：The secondary server detects itself and whether the memory space occupation proportion of other dilatation servers is equal
Reach second threshold；
S12：When the secondary server detects that the memory space occupation proportion of itself and other dilatation servers is equal
When reaching second threshold, the secondary server continues to itself and other dilatation servers write-in data；
S13：The secondary server detects itself and whether the memory space occupation proportion of other dilatation servers is equal
Reach first threshold；
S14：When the secondary server detects that the memory space occupation proportion of itself and other dilatation servers is equal
When reaching first threshold, the secondary server transfers administration authority to the management server.
Corresponding to above method embodiment, the embodiment of the present invention additionally provides a kind of cloud storage system flash chamber, described
Device is applied to the management server in cloud storage system, and referring to Fig. 3, described device can include：
Determination unit 301, for determining to be registered at least two dilatations clothes of the management server in preset time
Business device；
Unit 302 is chosen, for choosing secondary server from at least two dilatations server；
Indicating member 303 is used to indicate the secondary server management at least two dilatations server, wherein,
The management server is actually determined in the secondary server, not to be registered in the preset time it is described management clothes
Any dilatation server write-in data of business device；
Write data unit 304, for when detecting write data requests, data to be write to the secondary server, so that
The data received are write at least two dilatations server by the secondary server according to load balancing principle；
Monitoring unit 305, it is empty for monitoring the storage of at least two dilatations server by the secondary server
Between occupation proportion；
Acquiring unit 306, for being reached when the memory space occupation proportion for monitoring at least two dilatations server
During to first threshold, the administration authority for managing at least two dilatation server is obtained.
In embodiments of the present invention, the management server in cloud storage system can be registered to described out of preset time
In the dilatation server of management server, a dilatation server is chosen as secondary server；And obtain auxiliary clothes in selection
It is engaged in before device, does not write data into any dilatation server, avoid moment of the dilatation server in access cloud storage system
The problem of storage pressure rises violently；After selection obtains secondary server, indicate the secondary server in the preset time
Interior, at least two dilatations server for being registered to the management server is managed；When detecting write data requests,
Data are write to secondary server, the secondary server smoothly writes data into dilatation server；The management service
Device can also monitor the memory space occupation proportion of each dilatation server by secondary server；When passing through the assistant service
When device monitors that the memory space occupation proportion of each dilatation server reaches first threshold, management server is obtained to each
The administration authority of dilatation server, at this moment, management server smoothly can write data, i.e. dilatation service to dilatation server
Device is smoothly added to the cloud storage system.
Optionally, in one implementation, the selection unit 302 is specifically used for：
Target dilatation server in at least two dilatations server is determined as secondary server, the target expands
Hold server for first dilatation server for being registered to the management server in the preset time.
Optionally, in another realization method, the selection unit 302 is specifically used for：
The dilatation server that at least two dilatations server is elected, is chosen for secondary server, wherein, institute
It is storage performance ginseng of at least two dilatations server based on received each dilatation server to state secondary server
It is several to elect what is come.
Optionally, in an embodiment of the invention, described device further includes：
Transmitting element, before write data unit writes data to the secondary server, to the assistant service
Device sends initialization and/or formatting commands, so that the secondary server is according to received initialization and/or formatting
Instruction, is initialized and/or is formatted to each dilatation server.
Optionally, in write data unit 304 after the secondary server writes data, the secondary server will
The step of data received write at least two dilatations server according to load balancing principle, can include：
The data received are write the secondary server itself and other dilatation servers by the secondary server, and
Whether the memory space occupation proportion for detecting the secondary server and other dilatation servers arrives second threshold；
If it is not, continue to write to data to the dilatation server of not up to described second threshold；
If reaching the second threshold, number is write to the secondary server itself and other described dilatation servers
According to until the memory space occupation proportion of the secondary server and other dilatation servers reaches the first threshold
When, stop writing data to the secondary server and other dilatation servers, wherein, the second threshold is less than first threshold
Value.
Corresponding to the above method and device embodiment, the embodiment of the present invention additionally provides a kind of cloud storage system, the cloud
Storage system includes management server and multiple dilatation servers, the management server are used for：
Determine to be registered at least two dilatation servers of the management server in preset time；
Secondary server is chosen from at least two dilatations server, and is indicated described in the secondary server management
At least two dilatation servers, wherein, the management server is actually determined in the secondary server, not to described pre-
If any dilatation server write-in data of the management server are registered in the time；
When detecting write data requests, data are write to the secondary server, so that the secondary server will connect
The data received write at least two dilatations server according to load balancing principle；
The memory space occupation proportion of at least two dilatations server is monitored by the secondary server；
When the memory space occupation proportion for monitoring at least two dilatations server reaches first threshold, obtain
Manage the administration authority of at least two dilatation server.
Optionally, in one implementation, the management server is specifically used for：By at least two dilatations service
Target dilatation server in device is determined as secondary server, and the target dilatation server is first in the preset time
It is registered to the dilatation server of the management server.
Optionally, in another realization method, the management server is specifically used for：At least two dilatation is taken
The dilatation server that business device is elected, is chosen for secondary server, wherein, the secondary server expands for described at least two
Hold storage performance parameter of the server based on received each dilatation server elect come.
Optionally, the management server is specifically used for：Before the step of writing data to the secondary server, to
The secondary server sends initialization and/or formatting commands, so that the secondary server is according to received initial
Change and/or formatting commands, are initialized and/or are formatted to each dilatation server.
Optionally, the secondary server is specifically used for：The secondary server writes the data received described auxiliary
Server itself and other dilatation servers are helped, and detects the storage of the secondary server and other dilatation servers
Whether space hold ratio arrives second threshold；
If it is not, continue to write to data to the dilatation server of not up to described second threshold；
If reaching the second threshold, number is write to the secondary server itself and other described dilatation servers
According to until the memory space occupation proportion of the secondary server and other dilatation servers reaches the first threshold
When, stop writing data to the secondary server and other dilatation servers, wherein, the second threshold is less than first threshold
Value.
The management server in cloud storage system is described further with secondary server with reference to Fig. 4.
Referring to Fig. 4, since the management server needs in cloud storage system carry out pipe to the storage server in the system
Reason, therefore the management server can include：
First Data write. module, first Data write. module include the first receiving unit and the first retransmission unit.
First receiving unit is used to receive the data that user is passed to, wherein, the data include file data, image data and regard
Frequency evidence；First retransmission unit is used for when receiving the dispatch command that the first data dispatch module is sent, and is responsible for forwarding
Data；
First data dispatch module for the data received by by first Data write. module, is dispatched to the cloud
In storage server in storage system, wherein, the first data dispatch module includes：Write data unit 304 and first is supervised
Control unit.Wherein, write data unit 304 can detect request that data are write to storage server, and the first monitoring
Unit detect the storage server operating status be presence when, to the storage server write data；It is described to write number
Request that data are write to secondary server can also be being detected according to unit 304, and the first monitoring unit detects that the auxiliary takes
When the operating status of business device is presence, data are write to secondary server；
First dilatation server management module, for according to determination unit included in the first dilatation management module
301st, unit 302, indicating member 303, monitoring unit 305, acquiring unit 306 and transmitting element are chosen, in preset time
The dilatation server for being registered to the management server is managed, wherein, the determination unit 301 chooses unit 302, refers to
Show that the function of unit 303, monitoring unit 305, acquiring unit 306 and transmitting element has been described specifically above, do not do herein
It repeats.
The secondary server can include：
Second Data write. module, second Data write. module include the second receiving unit and the second retransmission unit；
Second receiving unit is used for：Receive the data that write data unit 304 writes in the first dilatation server management module；
Second retransmission unit for when receiving the dispatch command that the second data dispatch module is sent to the data that receive into
Row forwarding；
Second data dispatch module for the data received by by second Data write. module, is dispatched to corresponding
In ground dilatation server, wherein, the second data dispatch module includes：Target write data unit and the second monitoring unit；Institute
The write data requests to dilatation server write-in data can detected by stating target write data unit, and the second monitoring unit is examined
When the operating status for measuring the dilatation server is presence, data are write to the dilatation server；
Secondary server elects module, for electing secondary server from at least two dilatations server；
Second dilatation server management module, for receiving the instruction that the first dilatation server management module is sent,
And second Data write. module, data dispatch module, secondary server election module are managed according to described instruction,
And the memory space occupation proportion for monitoring each dilatation server, and monitored results are sent to the first dilatation service
Monitoring unit 305 in device management module.
It should be noted that herein, relational terms such as first and second and the like are used merely to a reality
Body or operation are distinguished with another entity or operation, are deposited without necessarily requiring or implying between these entities or operation
In any this actual relation or order.Moreover, term " comprising ", "comprising" or its any other variant are intended to
Non-exclusive inclusion, so that process, method, article or equipment including a series of elements not only will including those
Element, but also including other elements that are not explicitly listed or further include as this process, method, article or equipment
Intrinsic element.In the absence of more restrictions, the element limited by sentence "including a ...", it is not excluded that
Also there are other identical elements in process, method, article or equipment including the element.
Each embodiment in this specification is described using relevant mode, identical similar portion between each embodiment
Point just to refer each other, and the highlights of each of the examples are difference from other examples.It is real especially for system
For applying example, since it is substantially similar to embodiment of the method, so description is fairly simple, related part is referring to embodiment of the method
Part explanation.
The foregoing is merely illustrative of the preferred embodiments of the present invention, is not intended to limit the scope of the present invention.It is all
Any modifications, equivalent replacements and improvements are made within the spirit and principles in the present invention, are all contained in protection scope of the present invention
It is interior.
Claims (11)
1. a kind of cloud storage system expansion method, which is characterized in that applied to the management server in cloud storage system, including：
Determine to be registered at least two dilatation servers of the management server in preset time；
Secondary server is chosen from at least two dilatations server, and is indicated described in the secondary server management at least
Two dilatation servers, wherein, the management server is actually determined in the secondary server, not to when described default
The interior any dilatation server write-in data for being registered to the management server；
When detecting write data requests, data are write to the secondary server, so that the secondary server will receive
Data write at least two dilatations server according to load balancing principle；
The memory space occupation proportion of at least two dilatations server is monitored by the secondary server；
When the memory space occupation proportion for monitoring at least two dilatations server reaches first threshold, management is obtained
The administration authority of at least two dilatation server.
2. according to the method described in claim 1, it is characterized in that, auxiliary clothes are chosen from at least two dilatations server
The step of business device, including：
Target dilatation server in at least two dilatations server is determined as secondary server, the target dilatation clothes
Device be engaged in as first dilatation server for being registered to the management server in the preset time.
3. according to the method described in claim 1, it is characterized in that, auxiliary clothes are chosen from at least two dilatations server
The step of business device, including：
The dilatation server that at least two dilatations server is elected, is chosen for secondary server, wherein, it is described auxiliary
Server is helped as storage performance parameter institute of at least two dilatations server based on received each dilatation server
Elect what is come.
4. according to claim 1-3 any one of them methods, which is characterized in that writing data to the secondary server
Before step, further include：
Initialization and/or formatting commands are sent to the secondary server, so that the secondary server is received by
Initialization and/or formatting commands, each dilatation server is initialized and/or formatted.
5. according to claim 1-3 any one of them methods, which is characterized in that the data that the secondary server will receive
The step of at least two dilatations server being write according to load balancing principle, including：
The data received are write the secondary server itself and other dilatation servers by the secondary server, and are detected
Whether the memory space occupation proportion of the secondary server and other dilatation servers arrives second threshold；
If it is not, continue to write to data to the dilatation server of not up to described second threshold；
If reaching the second threshold, data are write to the secondary server itself and other described dilatation servers, directly
When reaching the first threshold to the memory space occupation proportion of the secondary server and other dilatation servers, stop
Data are write to the secondary server and other dilatation servers, wherein, the second threshold is less than the first threshold.
6. a kind of cloud storage system flash chamber, which is characterized in that applied to the management server in cloud storage system, including：
Determination unit, for determining to be registered at least two dilatation servers of the management server in preset time；
Unit is chosen, for choosing secondary server from at least two dilatations server；
Indicating member is used to indicate the secondary server and manages at least two dilatations server, wherein, the management clothes
Business device is actually determined in the secondary server, not to any that the management server is registered in the preset time
Dilatation server writes data；
Write data unit, for when detecting write data requests, data being write to the secondary server, so that the auxiliary
The data received are write at least two dilatations server by server according to load balancing principle；
Monitoring unit occupies ratio for monitoring the memory space of at least two dilatations server by the secondary server
Example；
Acquiring unit, for reaching the first threshold when the memory space occupation proportion for monitoring at least two dilatations server
During value, the administration authority for managing at least two dilatation server is obtained.
7. device according to claim 6, which is characterized in that the selection unit is specifically used for：
Target dilatation server in at least two dilatations server is determined as secondary server, the target dilatation clothes
Device be engaged in as first dilatation server for being registered to the management server in the preset time.
8. device according to claim 6, which is characterized in that the selection unit is specifically used for：
The dilatation server that at least two dilatations server is elected, is chosen for secondary server, wherein, it is described auxiliary
Server is helped as storage performance parameter institute of at least two dilatations server based on received each dilatation server
Elect what is come.
9. according to claim 6-8 any one of them devices, which is characterized in that described device further includes：
Transmitting element before write data unit writes data to the secondary server, is sent out to the secondary server
Initialization and/or formatting commands are sent, so that the secondary server refers to according to received initialization and/or formatting
Order, is initialized and/or is formatted to each dilatation server.
10. according to claim 6-8 any one of them devices, which is characterized in that in write data unit to the auxiliary
After server write-in data, the data received are write described at least two by the secondary server according to load balancing principle
The step of dilatation server, includes：
The data received are write the secondary server itself and other dilatation servers by the secondary server, and are detected
Whether the memory space occupation proportion of the secondary server and other dilatation servers arrives second threshold；
If it is not, continue to write to data to the dilatation server of not up to described second threshold；
If reaching the second threshold, data are write to the secondary server itself and other described dilatation servers, directly
When reaching the first threshold to the memory space occupation proportion of the secondary server and other dilatation servers, stop
Data are write to the secondary server and other dilatation servers, wherein, the second threshold is less than the first threshold.
11. a kind of cloud storage system, including management server and multiple dilatation servers, which is characterized in that the management service
Device is used for：
Determine to be registered at least two dilatation servers of the management server in preset time；
Secondary server is chosen from at least two dilatations server, and is indicated described in the secondary server management at least
Two dilatation servers, wherein, the management server is actually determined in the secondary server, not to when described default
The interior any dilatation server write-in data for being registered to the management server；
When detecting write data requests, data are write to the secondary server, so that the secondary server will receive
Data write at least two dilatations server according to load balancing principle；
The memory space occupation proportion of at least two dilatations server is monitored by the secondary server；
When the memory space occupation proportion for monitoring at least two dilatations server reaches first threshold, management is obtained
The administration authority of at least two dilatation server.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611066896.9A CN108111566B (en) | 2016-11-25 | 2016-11-25 | Cloud storage system capacity expansion method and device and cloud storage system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611066896.9A CN108111566B (en) | 2016-11-25 | 2016-11-25 | Cloud storage system capacity expansion method and device and cloud storage system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108111566A true CN108111566A (en) | 2018-06-01 |
| CN108111566B CN108111566B (en) | 2020-11-06 |
Family
ID=62204678
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201611066896.9A Active CN108111566B (en) | 2016-11-25 | 2016-11-25 | Cloud storage system capacity expansion method and device and cloud storage system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108111566B (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110333953A (en) * | 2019-07-11 | 2019-10-15 | 中国工商银行股份有限公司 | Data storage resource dispatching method and device |
| CN111208952A (en) * | 2020-02-13 | 2020-05-29 | 河南文正电子数据处理有限公司 | Storage system capacity expansion method, readable storage medium and computing device |
| CN111258710A (en) * | 2020-01-09 | 2020-06-09 | 同盾控股有限公司 | System maintenance method and device |
| CN112019577A (en) * | 2019-05-29 | 2020-12-01 | 中国移动通信集团重庆有限公司 | Exclusive cloud storage implementation method and device, computing equipment and computer storage medium |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20070022087A1 (en) * | 2005-07-25 | 2007-01-25 | Parascale, Inc. | Scalable clustered storage system |
| CN102664914A (en) * | 2012-03-22 | 2012-09-12 | 北京英孚斯迈特信息技术有限公司 | IS/DFS-Image distributed file storage query system |
| CN103810244A (en) * | 2013-12-09 | 2014-05-21 | 北京理工大学 | Distributed data storage system expansion method based on data distribution |
| CN104023246A (en) * | 2014-04-28 | 2014-09-03 | 深圳英飞拓科技股份有限公司 | Private video data cloud-storage system and method |
| CN105162859A (en) * | 2015-08-20 | 2015-12-16 | 湖南亿谷科技发展股份有限公司 | Dynamic server dilatation system and method |
| CN105657066A (en) * | 2016-03-23 | 2016-06-08 | 天津书生云科技有限公司 | Load rebalance method and device used for storage system |
-
2016
- 2016-11-25 CN CN201611066896.9A patent/CN108111566B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20070022087A1 (en) * | 2005-07-25 | 2007-01-25 | Parascale, Inc. | Scalable clustered storage system |
| CN102664914A (en) * | 2012-03-22 | 2012-09-12 | 北京英孚斯迈特信息技术有限公司 | IS/DFS-Image distributed file storage query system |
| CN103810244A (en) * | 2013-12-09 | 2014-05-21 | 北京理工大学 | Distributed data storage system expansion method based on data distribution |
| CN104023246A (en) * | 2014-04-28 | 2014-09-03 | 深圳英飞拓科技股份有限公司 | Private video data cloud-storage system and method |
| CN105162859A (en) * | 2015-08-20 | 2015-12-16 | 湖南亿谷科技发展股份有限公司 | Dynamic server dilatation system and method |
| CN105657066A (en) * | 2016-03-23 | 2016-06-08 | 天津书生云科技有限公司 | Load rebalance method and device used for storage system |
Non-Patent Citations (1)
| Title |
|---|
| 高帅，等: "基于轮转部署的 ＲAID6 分布式存储系统扩容方案", 《计算机应用与软件》 * |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112019577A (en) * | 2019-05-29 | 2020-12-01 | 中国移动通信集团重庆有限公司 | Exclusive cloud storage implementation method and device, computing equipment and computer storage medium |
| CN112019577B (en) * | 2019-05-29 | 2023-04-07 | 中国移动通信集团重庆有限公司 | Exclusive cloud storage implementation method and device, computing equipment and computer storage medium |
| CN110333953A (en) * | 2019-07-11 | 2019-10-15 | 中国工商银行股份有限公司 | Data storage resource dispatching method and device |
| CN111258710A (en) * | 2020-01-09 | 2020-06-09 | 同盾控股有限公司 | System maintenance method and device |
| CN111258710B (en) * | 2020-01-09 | 2023-03-31 | 同盾控股有限公司 | System maintenance method and device |
| CN111208952A (en) * | 2020-02-13 | 2020-05-29 | 河南文正电子数据处理有限公司 | Storage system capacity expansion method, readable storage medium and computing device |
| CN111208952B (en) * | 2020-02-13 | 2022-07-12 | 河南文正电子数据处理有限公司 | Storage system capacity expansion method, readable storage medium and computing device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108111566B (en) | 2020-11-06 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8423746B2 (en) | Storage system and management method thereof | |
| CN108111566A (en) | A kind of cloud storage system expansion method, device and cloud storage system | |
| US7934071B2 (en) | Method of managing storage capacity in a storage system, a storage device and a computer system | |
| US8452923B2 (en) | Storage system and management method thereof | |
| US20110173310A1 (en) | System and method for managing switch and information handling system sas protocol communication | |
| CN103685608B (en) | A kind of method and device for automatically configuring secure virtual machine IP address | |
| CN107404417A (en) | A kind of processing method of monitoring data, processing unit and processing system | |
| CN109151028A (en) | A kind of distributed memory system disaster recovery method and device | |
| CN112965879A (en) | Data processing method and device, electronic equipment and readable storage medium | |
| CN109101357A (en) | A kind of detection method and device of OSD failure | |
| CN106502760B (en) | A kind of virtual machine compatibility strategy visualization method and device | |
| CN110633046A (en) | Storage method and device of distributed system, storage equipment and storage medium | |
| CN110244901A (en) | Method for allocating tasks and device, distributed memory system | |
| CN106471470A (en) | A kind of method and apparatus of the network function based on affinity of model-driven | |
| CN110457263A (en) | A kind of date storage method and device | |
| CN107453932A (en) | A kind of distributed memory system management method and its device | |
| CN110209526A (en) | A kind of accumulation layer synchronization system and storage medium | |
| US9785505B1 (en) | Communicative building management system for data loss prevention | |
| CN108459910A (en) | A kind of method and apparatus for deleting resource | |
| CN116615719A (en) | Techniques to generate configurations for electrically isolating fault domains in a data center | |
| US9826043B2 (en) | Method to protect storage systems from discontinuity due to device misconfiguration | |
| CN108089968A (en) | A kind of method of host's machine monitoring virtual-machine data storehouse state | |
| CN110034951A (en) | The failure switching method and iSCSI major heading device of iscsi target device | |
| CN110321077A (en) | A kind of management method and device of centrally stored file | |
| CN111506360B (en) | External equipment access system and method of real-time data processing system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |