CN108008913B - Management node-based capacity expansion method and device and storage system - Google Patents
Management node-based capacity expansion method and device and storage system Download PDFInfo
- Publication number
- CN108008913B CN108008913B CN201610953392.2A CN201610953392A CN108008913B CN 108008913 B CN108008913 B CN 108008913B CN 201610953392 A CN201610953392 A CN 201610953392A CN 108008913 B CN108008913 B CN 108008913B
- Authority
- CN
- China
- Prior art keywords
- management node
- newly added
- determining
- original
- data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/0614—Improving the reliability of storage systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0629—Configuration or reconfiguration of storage systems
- G06F3/0631—Configuration or reconfiguration of storage systems by allocating resources to storage systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0638—Organizing or formatting or addressing of data
- G06F3/064—Management of blocks
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/067—Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
Abstract
The embodiment of the invention discloses a capacity expansion method, a capacity expansion device and a storage system based on management nodes. That is to say, in the process of capacity expansion by applying the scheme, the data index is reallocated to all management nodes (the original management node and the newly added management node) in the system, instead of searching a part of the data index from the original management node and migrating the searched data index to the newly added management node, so that the situation that the data index is lost in the capacity expansion process can be avoided.
Description
Technical Field
The present invention relates to the field of data storage technologies, and in particular, to a capacity expansion method, an apparatus, and a storage system based on a management node.
Background
Storage systems typically include management nodes and storage nodes: the storage nodes are physical media for storing data, and each storage node comprises a plurality of storage blocks; the management node stores a data index (which can be understood as a storage path of data in a storage block), and manages the data stored in each storage block of the storage node according to the data index.
With the continuous increase of stored data, data indexes are more and more, and the storage pressure of management nodes is also more and more. The existing capacity expansion scheme based on management nodes generally includes: adding a new management node, and dividing part of storage blocks in the original system to the management node for management; determining a data index corresponding to the part of the storage block; and searching the determined data index in the management node of the original system, and migrating the searched data index to the newly added management node.
However, when the scheme is applied to capacity expansion, the condition of data index loss is easily caused in the processes of searching and migration, and once the condition is caused, unknown errors can occur when the subsequent newly-added management node manages the data stored in the storage block.
Disclosure of Invention
Embodiments of the present invention provide a management node-based capacity expansion method, apparatus, and storage system, so as to avoid a situation that data indexes are lost in a capacity expansion process.
In order to achieve the above object, an embodiment of the present invention discloses a capacity expansion method based on a management node, which is applied to a proxy service device in a storage system, and the method includes:
determining the sum of the number of newly added management nodes and the number of original management nodes in the system;
according to the sum of the number, the storage blocks in the system are redistributed;
and aiming at each management node in the system, determining a first storage block allocated to each management node and a first data index corresponding to the first storage block, and sending the first data index to the management node.
Optionally, after the step of determining the sum of the number of the newly added management node and the number of the original management node in the system, the method may further include:
redistributing the service objects of the system according to the sum of the number;
for each management node in the system, determining a first service object allocated to the management node;
recording the corresponding relation between the management node and the first service object distributed for the management node;
the method may further comprise:
when receiving a data storage instruction sent by a service object, determining a management node corresponding to the service object according to the recorded corresponding relation so that the determined management node stores data according to the data storage instruction;
when a data reading instruction sent by a service object is received, determining a management node corresponding to the service object according to the recorded corresponding relation, so that the determined management node reads data according to the data reading instruction.
Optionally, before the step of determining the sum of the number of the newly added management node and the number of the original management node in the system, the method may further include:
determining candidate newly-added management nodes;
and judging whether the candidate newly added management node is compatible with the application environment of the original management node in the system, and if so, determining the candidate newly added management node as the newly added management node.
Optionally, after the step of determining the candidate new management node as the new management node, the method may further include:
and configuring the application environment of the newly added management node so that the application environment of the newly added management node is matched with the application environment of the original management node in the system.
Optionally, before the step of configuring the application environment of the newly added management node, the method further includes:
judging whether the application environment of the original management node in the system is abnormal or not;
if not, executing the step of configuring the application environment of the newly-added management node, and if so, outputting abnormal prompt information.
Optionally, before the step of determining the sum of the number of the newly added management node and the number of the original management node in the system, the method may further include:
setting an original management node and a newly-added management node in the system to be in an unconnected state so as to stop data interaction between the original management node and the newly-added management node in the system and a storage node in the system;
after the step of sending the first data index to the management node, the method may further include:
and setting the original management node and the newly added management node in the system to be in a connectable state so as to restore the data interaction between the original management node and the newly added management node in the system and the storage node in the system.
Optionally, before the step of sending the first data index to the management node, the method may further include:
adding equipment information of a newly added management node in the system;
the step of sending the first data index to the management node comprises:
and triggering each first data index to the corresponding management node according to the equipment information of the newly added management node and the pre-stored equipment information of the original management node in the system.
In order to achieve the above object, an embodiment of the present invention further discloses a capacity expansion device based on a management node, which is applied to a proxy service device in a storage system, where the capacity expansion device includes:
the first determining module is used for determining the sum of the number of the newly added management nodes and the number of the original management nodes in the system;
the first allocation module is used for reallocating the storage blocks in the system according to the sum of the number;
and the sending module is used for determining a first storage block allocated to each management node in the system and a first data index corresponding to the first storage block, and sending the first data index to the management node.
Optionally, the apparatus may further include:
the second distribution module is used for redistributing the service objects of the system according to the sum of the number;
a second determining module, configured to determine, for each management node in the system, a first service object allocated to the management node;
the recording module is used for recording the corresponding relation between the management node and the first service object distributed for the management node;
a third determining module, configured to determine, when receiving a data storage instruction sent by a service object, a management node corresponding to the service object according to the correspondence recorded by the recording module, so that the determined management node stores data according to the data storage instruction;
and the fourth determining module is used for determining the management node corresponding to the service object according to the corresponding relation recorded by the recording module when receiving a data reading instruction sent by the service object, so that the determined management node reads data according to the data reading instruction.
Optionally, the apparatus may further include:
a fifth determining module, configured to determine a candidate new management node;
the first judging module is used for judging whether the candidate newly-added management node is compatible with the application environment of the original management node in the system or not, and if so, the sixth determining module is triggered;
and the sixth determining module is used for determining the candidate new-added management node as the new-added management node.
Optionally, the apparatus may further include:
and the configuration module is used for configuring the application environment of the newly added management node so as to enable the application environment of the newly added management node to be matched with the application environment of the original management node in the system.
Optionally, the apparatus may further include:
the second judgment module is used for judging whether the application environment of the original management node in the system is abnormal or not; if not, triggering the configuration module, and if yes, triggering the output module;
and the output module is used for outputting the abnormal prompt information.
Optionally, the apparatus may further include:
the first setting module is used for setting an original management node and a newly added management node in the system into a non-connectable state before determining the sum of the number of the newly added management node and the original management node in the system, so that the original management node and the newly added management node in the system stop data interaction with a storage node in the system;
and the second setting module is used for setting the original management node and the newly added management node in the system into a connectable state after the first data index is sent to the management node, so that the original management node and the newly added management node in the system recover the data interaction with the storage node in the system.
Optionally, the apparatus may further include:
the adding module is used for adding the equipment information of the newly added management node in the system;
the sending module may be specifically configured to:
and aiming at each management node in the system, determining a first storage block allocated to each management node and a first data index corresponding to the first storage block, and initiating and sending the first data index to the management node according to the equipment information of the newly added management node and the equipment information of the original management node in the system, which is stored in advance.
In order to achieve the above object, an embodiment of the present invention further discloses a storage system, including: a proxy service device and a management node, wherein,
the proxy service equipment is used for determining the sum of the number of the newly added management nodes and the number of the original management nodes in the storage system; according to the sum of the number, the storage blocks in the system are redistributed; aiming at each management node in the system, determining a first storage block allocated to each management node and a first data index corresponding to the first storage block, and sending the first data index to the management node;
and the management node is used for receiving the data index sent by the proxy service equipment and managing the storage block in the system according to the received data index.
Optionally, the proxy service device may be any management node in the system.
By applying the embodiment of the invention, the storage system is provided with the proxy service equipment, after the management node is newly added, the proxy service equipment redistributes the storage blocks in the system, determines the first storage block allocated to each management node in the system and the first data index corresponding to the first storage block, and sends the first data index to the management node. That is to say, in the process of capacity expansion by applying the scheme, the data index is reallocated to all management nodes (the original management node and the newly added management node) in the system, instead of searching a part of the data index from the original management node and migrating the searched data index to the newly added management node, so that the situation that the data index is lost in the capacity expansion process can be avoided.
Of course, it is not necessary for any product or method of practicing the invention to achieve all of the above-described advantages at the same time.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
Fig. 1 is a schematic structural diagram of a memory system according to an embodiment of the present invention;
fig. 2 is a schematic flowchart of a capacity expansion method based on a management node according to an embodiment of the present invention;
fig. 3 is a schematic structural diagram of a capacity expansion device based on a management node according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
In order to solve the foregoing technical problem, embodiments of the present invention provide a capacity expansion method and apparatus based on a management node, which may be applied to a proxy service device in a storage system. The storage system may be as shown in fig. 1, including a proxy service device and a management node (management node 1, management node 2 … …, management node N). Alternatively, the proxy service device may also be a management node, or the system may further include other devices such as a storage node, which is not limited herein. First, a detailed description is given below of the capacity expansion method based on the management node according to the embodiment of the present invention.
Fig. 2 is a schematic flowchart of a capacity expansion method based on a management node according to an embodiment of the present invention, where the method includes:
s201: and determining the sum of the number of the newly added management nodes and the number of the original management nodes in the system.
In this embodiment, before S201, the original management node and the newly added management node in the system may be set in an unconnected state, so that the original management node and the newly added management node in the system stop data interaction with the storage nodes in the system.
It can be understood that during the expansion process, the data in the management node needs to be adjusted, and if the data interaction with the storage node continues in the process, unpredictable errors may be generated. Therefore, the management node is set to be in a non-connectable state and then capacity expansion is performed.
In addition, before S201, a new management node is determined.
Specifically, the step of determining the newly added management node may include:
determining candidate newly-added management nodes; and judging whether the candidate newly added management node is compatible with the application environment of the original management node in the system, and if so, determining the candidate newly added management node as the newly added management node.
For ease of understanding, the following description is given by way of a simple example.
Assuming that the application environments of the original management nodes in the system are all Windows xp, if the application environment of the candidate new management node is linux, the candidate new management node is incompatible with the application environment of the original management nodes in the system. And if the application environment of the candidate new management node is Windows7 or Windows xp, the candidate new management node is compatible with the application environment of the original management node in the system.
The capacity expansion can be successful only if the application environments are compatible, so that only the candidate new management nodes compatible with the application environments are determined as the new management nodes.
In addition, after the step of determining the candidate new management node as the new management node, the method may further include:
and configuring the application environment of the newly added management node so as to match the application environment of the newly added management node with the application environment of the original management node in the system.
Continuing the above example, if the application environments of the original management nodes in the system are all Windows xp, and the application environment of the newly added management node is Windows7, in this case, the application environment of the newly added management node needs to be configured, which is convenient for better data interaction between the newly added management node and the original management node.
As an implementation manner, before configuring the application environment of the newly added management node, it may be determined whether the application environment of the original management node in the system is abnormal; if not, the application environment of the newly added management node is reconfigured, and if so, abnormal prompt information is output.
It can be understood that if the application environment of the original management node in the system is abnormal, the capacity expansion will usually fail. Therefore, before capacity expansion, the application environment of the original management node in the system is detected, if the application environment is abnormal, abnormal prompt information is output to remind relevant personnel to process, and if the application environment is not abnormal, the subsequent steps are continued.
S202: and reallocating the storage blocks in the system according to the sum of the number.
Assuming that the number of original management nodes in the system is 3, a new management node is added, that is, the sum of the numbers is 4, and the storage blocks in the system are allocated to 4.
It is understood that in the storage system, the management node manages the storage blocks in the storage nodes, reallocates the storage blocks, and divides the storage blocks under management for each management node.
S203: and aiming at each management node in the system, determining a first storage block allocated to each management node and a first data index corresponding to the first storage block, and sending the first data index to the management node.
The data index may be understood as a storage path of data stored in a storage block, and the management node manages the storage block based on the data index. Therefore, after the storage blocks are reallocated, the data index corresponding to the storage block under the management of each management node needs to be determined. And sending the data index to the corresponding management node.
It should be noted that, in the process of capacity expansion, the data stored in the storage block is not adjusted, and therefore, the specific content of the data index is not changed. In this embodiment, each management node stores a data index corresponding to each storage block under its management, and the proxy service device may store data indexes corresponding to all storage blocks in the system, so that the proxy service device may reallocate the data indexes corresponding to the storage blocks based on reallocation of the storage blocks.
Continuing with the above example, the number of original management nodes in the system is 3, management node 1, management node 2, and management node 3: the management node 1 manages the storage block A, B, C, the data index corresponding to the storage block a is a1, the data index corresponding to the storage block B is B1, and the data index corresponding to the storage block C is C1; the management node 2 manages the storage block D, E, the data index corresponding to the storage block D is D1, and the data index corresponding to the storage block E is E1; the management node 3 manages the storage block F, G, H, and the data index corresponding to the storage block F is F1, the data index corresponding to the storage block G is G1, and the data index corresponding to the storage block H is H1.
And adding a management node 4, redistributing the storage blocks by the agent service equipment, and supposing that the storage blocks A and B are allocated to the management node 1, the storage blocks C and D are allocated to the management node 2, the storage blocks E and F are allocated to the management node 3, and the storage blocks G and H are allocated to the management node 4. Accordingly, the proxy service apparatus reallocates the data indexes corresponding to the storage blocks, allocates the data indexes a1 and B1 to the management node 1, allocates the data indexes C1 and D1 to the management node 2, allocates the data indexes E1 and F1 to the management node 3, and allocates the data indexes G1 and H1 to the management node 4.
According to the above description, the proxy service device may be separately configured or may be a management node. If the proxy service equipment is independently arranged, each management node can clear the original data index in the management node, receive the data index redistributed by the proxy service equipment, and manage the redistributed storage blocks according to the redistributed data index. If the agent service equipment is a certain management node, clearing the original data index of each management node except the agent service equipment, receiving the data index redistributed by the agent service equipment, and managing the redistributed storage blocks according to the redistributed data index; in addition, the proxy service device also needs to manage the reallocated storage blocks according to the reallocated data indexes as a management node.
In this embodiment, before the data index is triggered to be sent to its corresponding management node, the device information of the management node newly added in the system may be added, and in addition, the proxy service device stores in advance the device information of the original management node in the system, so that the proxy service device may trigger the data index to its corresponding management node according to the device information of each management node.
The device information may be an IP address, a MAC address, identification information, etc. of the management node, which is not limited herein.
Therefore, the capacity expansion is completed, and the original management node and the newly added management node in the system can be set to be in a connectable state, so that the original management node and the newly added management node in the system recover the data interaction with the storage node in the system.
By applying the embodiment shown in fig. 2 of the present invention, the storage system is provided with the proxy service device, after the management node is newly added, the proxy service device reallocates the storage blocks in the system, determines, for each management node in the system, the first storage block allocated to the management node and the first data index corresponding to the first storage block, and sends the first data index to the management node. For example, it is assumed that in the process of capacity expansion of the system, the data index is reallocated to all management nodes (the original management node and the newly added management node) in the system, instead of searching a part of the data index from the original management node and migrating the searched data index to the newly added management node, so that the situation that the data index is lost in the process of capacity expansion can be avoided.
As an embodiment of the present invention, after S201, the method may further include:
redistributing the service objects of the system according to the sum of the number;
for each management node in the system, determining a first service object allocated to the management node;
recording the corresponding relation between the management node and the first service object distributed for the management node;
the method further comprises the following steps:
when receiving a data storage instruction sent by a service object, determining a management node corresponding to the service object according to the recorded corresponding relation so that the determined management node stores data according to the data storage instruction;
when a data reading instruction sent by a service object is received, determining a management node corresponding to the service object according to the recorded corresponding relation, so that the determined management node reads data according to the data reading instruction.
That is, in the present embodiment, not only the data index in the system but also the service object of the system is reallocated. A service object may be understood as a device that stores and reads data in the system. And distributing the service objects to each management node, wherein the management nodes provide services of storing, reading data and the like for the corresponding service objects.
The agent service device records the corresponding relation between the service object and the management node after redistribution, if the original management node and the newly added management node in the system are set to be in the non-connectable state in advance, the system can provide service for the service object after the original management node and the newly added management node in the system are set to be in the connectable state:
when the service object needs to store data, sending a data storage instruction to the proxy service equipment, after receiving the instruction, the proxy service equipment determines a management node corresponding to the service object sending the instruction according to the recorded corresponding relation, and the determined management node stores the data according to the instruction;
when the service object needs to read data, sending a data reading instruction to the proxy service equipment, after receiving the instruction, the proxy service equipment determines a management node corresponding to the service object sending the instruction according to the recorded corresponding relation, and the determined management node reads the data according to the instruction.
By applying the embodiment, after the management node is newly added, the service object of the system is redistributed, so that the service pressure of the original management node in the system is reduced.
Corresponding to the above method embodiment, an embodiment of the present invention further provides a capacity expansion device based on a management node.
Fig. 3 is a schematic structural diagram of a capacity expansion device based on a management node according to an embodiment of the present invention, where the structural diagram includes:
a first determining module 301, configured to determine a sum of the numbers of the newly added management nodes and the original management nodes in the system;
a first allocating module 302, configured to reallocate the memory blocks in the system according to the sum of the numbers;
a sending module 303, configured to determine, for each management node in the system, a first storage block allocated to the management node and a first data index corresponding to the first storage block, and send the first data index to the management node.
In this embodiment, the apparatus may further include: a second allocating module, a second determining module, a recording module, a third determining module, and a fourth determining module (not shown in the figure), wherein,
the second distribution module is used for redistributing the service objects of the system according to the sum of the number;
a second determining module, configured to determine, for each management node in the system, a first service object allocated to the management node;
the recording module is used for recording the corresponding relation between the management node and the first service object distributed for the management node;
a third determining module, configured to determine, when receiving a data storage instruction sent by a service object, a management node corresponding to the service object according to the correspondence recorded by the recording module, so that the determined management node stores data according to the data storage instruction;
and the fourth determining module is used for determining the management node corresponding to the service object according to the corresponding relation recorded by the recording module when receiving a data reading instruction sent by the service object, so that the determined management node reads data according to the data reading instruction.
In this embodiment, the apparatus may further include: a fifth determining module, a first judging module and a sixth determining module (not shown in the figure), wherein,
a fifth determining module, configured to determine a candidate new management node;
the first judging module is used for judging whether the candidate newly-added management node is compatible with the application environment of the original management node in the system or not, and if so, the sixth determining module is triggered;
and the sixth determining module is used for determining the candidate new-added management node as the new-added management node.
In this embodiment, the apparatus may further include:
and a configuration module (not shown in the figure) for configuring the application environment of the newly added management node so as to match the application environment of the newly added management node with the application environment of the original management node in the system.
In this embodiment, the apparatus may further include: a second judging module and an output module (not shown in the figure), wherein,
the second judgment module is used for judging whether the application environment of the original management node in the system is abnormal or not; if not, triggering the configuration module, and if yes, triggering the output module;
and the output module is used for outputting the abnormal prompt information.
In this embodiment, the apparatus may further include: a first setup module and a second setup module (not shown), wherein,
the first setting module is used for setting an original management node and a newly added management node in the system into a non-connectable state before determining the sum of the number of the newly added management node and the original management node in the system, so that the original management node and the newly added management node in the system stop data interaction with a storage node in the system;
and the second setting module is used for setting the original management node and the newly added management node in the system into a connectable state after the first data index is sent to the management node, so that the original management node and the newly added management node in the system recover the data interaction with the storage node in the system.
In this embodiment, the apparatus may further include:
an adding module (not shown in the figure) for adding the device information of the newly added management node in the system;
the sending module 303 may be specifically configured to:
and aiming at each management node in the system, determining a first storage block allocated to each management node and a first data index corresponding to the first storage block, and initiating and sending the first data index to the management node according to the equipment information of the newly added management node and the equipment information of the original management node in the system, which is stored in advance.
By applying the embodiment shown in fig. 3 of the present invention, the storage system is provided with the proxy service device, after the management node is newly added, the proxy service device reallocates the storage blocks in the system, determines, for each management node in the system, the first storage block allocated to the management node and the first data index corresponding to the first storage block, and sends the first data index to the management node. That is to say, in the process of capacity expansion by applying the scheme, the data index is reallocated to all management nodes (the original management node and the newly added management node) in the system, instead of searching a part of the data index from the original management node and migrating the searched data index to the newly added management node, so that the situation that the data index is lost in the capacity expansion process can be avoided.
An embodiment of the present invention further provides a storage system, as shown in fig. 1, including: a proxy service device and a management node (management node 1, management node 2 … … management node N), wherein,
the proxy service equipment is used for determining the sum of the number of the newly added management nodes and the number of the original management nodes in the storage system; according to the sum of the number, the storage blocks in the system are redistributed; aiming at each management node in the system, determining a first storage block allocated to each management node and a first data index corresponding to the first storage block, and sending the first data index to the management node;
and the management node is used for receiving the data index sent by the proxy service equipment and managing the storage block in the system according to the received data index.
In this embodiment, the proxy service device may be any management node in the system, and certainly, the proxy service device may also be separately provided, which is not limited herein.
As an embodiment, the new management node may be determined as a proxy service device.
In this embodiment, the proxy service device may further be configured to:
after the sum of the number of the newly added management nodes and the number of the original management nodes in the system is determined, redistributing the service objects of the system according to the sum of the number;
for each management node in the system, determining a first service object allocated to the management node;
recording the corresponding relation between the management node and the first service object distributed for the management node;
when receiving a data storage instruction sent by a service object, determining a management node corresponding to the service object according to the recorded corresponding relation so that the determined management node stores data according to the data storage instruction;
when a data reading instruction sent by a service object is received, determining a management node corresponding to the service object according to the recorded corresponding relation, so that the determined management node reads data according to the data reading instruction.
In this embodiment, the proxy service device may further be configured to:
determining candidate newly-added management nodes before determining the sum of the number of the newly-added management nodes and the number of the original management nodes in the system;
and judging whether the candidate newly added management node is compatible with the application environment of the original management node in the system, and if so, determining the candidate newly added management node as the newly added management node.
In this embodiment, the proxy service device may further be configured to:
and after determining the candidate newly-added management node as the newly-added management node, configuring the application environment of the newly-added management node so as to enable the application environment of the newly-added management node to be matched with the application environment of the original management node in the system.
In this embodiment, the proxy service device may further be configured to:
before configuring the application environment of the newly-added management node, judging whether the application environment of the original management node in the system is abnormal or not;
if not, executing the step of configuring the application environment of the newly-added management node, and if so, outputting abnormal prompt information.
In this embodiment, the proxy service device may further be configured to:
before determining the sum of the number of the newly added management nodes and the number of the original management nodes in the system, setting the original management nodes and the newly added management nodes in the system to be in a non-connectable state so as to stop data interaction between the original management nodes and the newly added management nodes in the system and storage nodes in the system;
after the first data index is sent to the management node, the original management node and the newly added management node in the system are set to be in a connectable state, so that the original management node and the newly added management node in the system recover data interaction with the storage node in the system.
In this embodiment, the proxy service device may further be configured to:
adding equipment information of a newly added management node in the system before the first data index is sent to the management node;
and triggering each first data index to the corresponding management node according to the equipment information of the newly added management node and the pre-stored equipment information of the original management node in the system.
By applying the embodiment of the invention, the storage system is provided with the proxy service equipment, after the management node is newly added, the proxy service equipment redistributes the storage blocks in the system, determines the first storage block allocated to each management node in the system and the first data index corresponding to the first storage block, and sends the first data index to the management node. That is to say, in the process of capacity expansion by applying the scheme, the data index is reallocated to all management nodes (the original management node and the newly added management node) in the system, instead of searching a part of the data index from the original management node and migrating the searched data index to the newly added management node, so that the situation that the data index is lost in the capacity expansion process can be avoided.
It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
All the embodiments in the present specification are described in a related manner, and the same and similar parts among the embodiments may be referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, as for the apparatus embodiment, since it is substantially similar to the method embodiment, the description is relatively simple, and for the relevant points, reference may be made to the partial description of the method embodiment.
Those skilled in the art will appreciate that all or part of the steps in the above method embodiments may be implemented by a program to instruct relevant hardware to perform the steps, and the program may be stored in a computer-readable storage medium, which is referred to herein as a storage medium, such as: ROM/RAM, magnetic disk, optical disk, etc.
The above description is only for the preferred embodiment of the present invention, and is not intended to limit the scope of the present invention. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention shall fall within the protection scope of the present invention.
Claims (16)
1. A capacity expansion method based on a management node is applied to proxy service equipment in a storage system, and the method comprises the following steps:
determining the sum of the number of newly added management nodes and the number of original management nodes in the system;
according to the sum of the number, the storage blocks in the system are redistributed;
and aiming at each management node in the system, determining a first storage block allocated to each management node and a first data index corresponding to the first storage block, and sending the first data index to the management node.
2. The method of claim 1, wherein after the step of determining the sum of the number of the new management node and the original management node in the system, further comprising:
redistributing the service objects of the system according to the sum of the number;
for each management node in the system, determining a first service object allocated to the management node;
recording the corresponding relation between the management node and the first service object distributed for the management node;
the method further comprises the following steps:
when receiving a data storage instruction sent by a service object, determining a management node corresponding to the service object according to the recorded corresponding relation so that the determined management node stores data according to the data storage instruction;
when a data reading instruction sent by a service object is received, determining a management node corresponding to the service object according to the recorded corresponding relation, so that the determined management node reads data according to the data reading instruction.
3. The method of claim 1, further comprising, before the step of determining the sum of the number of newly added management nodes and the number of original management nodes in the system:
determining candidate newly-added management nodes;
and judging whether the candidate newly added management node is compatible with the application environment of the original management node in the system, and if so, determining the candidate newly added management node as the newly added management node.
4. The method of claim 3, wherein after the step of determining the candidate new management node as a new management node, the method further comprises:
and configuring the application environment of the newly added management node so that the application environment of the newly added management node is matched with the application environment of the original management node in the system.
5. The method of claim 4, further comprising, before the step of configuring the application environment of the newly added management node:
judging whether the application environment of the original management node in the system is abnormal or not;
if not, executing the step of configuring the application environment of the newly-added management node, and if so, outputting abnormal prompt information.
6. The method of claim 1, further comprising, before the step of determining the sum of the number of newly added management nodes and the number of original management nodes in the system:
setting an original management node and a newly-added management node in the system to be in an unconnected state so as to stop data interaction between the original management node and the newly-added management node in the system and a storage node in the system;
after the step of sending the first data index to the management node, further comprising:
and setting the original management node and the newly added management node in the system to be in a connectable state so as to restore the data interaction between the original management node and the newly added management node in the system and the storage node in the system.
7. The method of claim 1, further comprising, prior to the step of sending the first data index to the management node:
adding equipment information of a newly added management node in the system;
the step of sending the first data index to the management node comprises:
and triggering each first data index to the corresponding management node according to the equipment information of the newly added management node and the pre-stored equipment information of the original management node in the system.
8. A capacity expansion device based on a management node is applied to a proxy service device in a storage system, and the device comprises:
the first determining module is used for determining the sum of the number of the newly added management nodes and the number of the original management nodes in the system;
the first allocation module is used for reallocating the storage blocks in the system according to the sum of the number;
and the sending module is used for determining a first storage block allocated to each management node in the system and a first data index corresponding to the first storage block, and sending the first data index to the management node.
9. The apparatus of claim 8, further comprising:
the second distribution module is used for redistributing the service objects of the system according to the sum of the number;
a second determining module, configured to determine, for each management node in the system, a first service object allocated to the management node;
the recording module is used for recording the corresponding relation between the management node and the first service object distributed for the management node;
a third determining module, configured to determine, when receiving a data storage instruction sent by a service object, a management node corresponding to the service object according to the correspondence recorded by the recording module, so that the determined management node stores data according to the data storage instruction;
and the fourth determining module is used for determining the management node corresponding to the service object according to the corresponding relation recorded by the recording module when receiving a data reading instruction sent by the service object, so that the determined management node reads data according to the data reading instruction.
10. The apparatus of claim 8, further comprising:
a fifth determining module, configured to determine a candidate new management node;
the first judging module is used for judging whether the candidate newly-added management node is compatible with the application environment of the original management node in the system or not, and if so, the sixth determining module is triggered;
and the sixth determining module is used for determining the candidate new-added management node as the new-added management node.
11. The apparatus of claim 10, further comprising:
and the configuration module is used for configuring the application environment of the newly added management node so as to enable the application environment of the newly added management node to be matched with the application environment of the original management node in the system.
12. The apparatus of claim 11, further comprising:
the second judgment module is used for judging whether the application environment of the original management node in the system is abnormal or not; if not, triggering the configuration module, and if yes, triggering the output module;
and the output module is used for outputting the abnormal prompt information.
13. The apparatus of claim 8, further comprising:
the first setting module is used for setting an original management node and a newly added management node in the system into a non-connectable state before determining the sum of the number of the newly added management node and the original management node in the system, so that the original management node and the newly added management node in the system stop data interaction with a storage node in the system;
and the second setting module is used for setting the original management node and the newly added management node in the system into a connectable state after the first data index is sent to the management node, so that the original management node and the newly added management node in the system recover the data interaction with the storage node in the system.
14. The apparatus of claim 8, further comprising:
the adding module is used for adding the equipment information of the newly added management node in the system;
the sending module is specifically configured to:
and aiming at each management node in the system, determining a first storage block allocated to each management node and a first data index corresponding to the first storage block, and initiating and sending the first data index to the management node according to the equipment information of the newly added management node and the equipment information of the original management node in the system, which is stored in advance.
15. A storage system, comprising: a proxy service device and a management node, wherein,
the proxy service equipment is used for determining the sum of the number of the newly added management nodes and the number of the original management nodes in the storage system; according to the sum of the number, the storage blocks in the system are redistributed; aiming at each management node in the system, determining a first storage block allocated to each management node and a first data index corresponding to the first storage block, and sending the first data index to the management node;
and the management node is used for receiving the data index sent by the proxy service equipment and managing the storage block in the system according to the received data index.
16. The system of claim 15, wherein the proxy service device is any management node in the system.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610953392.2A CN108008913B (en) | 2016-10-27 | 2016-10-27 | Management node-based capacity expansion method and device and storage system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610953392.2A CN108008913B (en) | 2016-10-27 | 2016-10-27 | Management node-based capacity expansion method and device and storage system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108008913A CN108008913A (en) | 2018-05-08 |
| CN108008913B true CN108008913B (en) | 2020-12-18 |
Family
ID=62047351
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610953392.2A Active CN108008913B (en) | 2016-10-27 | 2016-10-27 | Management node-based capacity expansion method and device and storage system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108008913B (en) |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109743388A (en) * | 2018-12-29 | 2019-05-10 | 税友软件集团股份有限公司 | The child node management method and correlation technique and device of a kind of distributed data collection |
| CN112995257B (en) * | 2019-12-16 | 2022-08-02 | 中国电信股份有限公司 | Cache expansion method and device based on cloud storage architecture and storage medium |
| CN111562889B (en) * | 2020-05-14 | 2023-05-02 | 杭州海康威视系统技术有限公司 | Data processing method, device, system and storage medium |
| CN114647388B (en) * | 2022-05-24 | 2022-08-12 | 杭州优云科技有限公司 | Distributed block storage system and management method |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102013991A (en) * | 2009-09-08 | 2011-04-13 | 华为技术有限公司 | Method, management equipment and system for automatically expanding capacity |
| CN102045189A (en) * | 2009-10-16 | 2011-05-04 | 中国移动通信集团北京有限公司 | Network management system and method |
| CN102460439A (en) * | 2009-04-30 | 2012-05-16 | 网络存储技术公司 | Data distribution through capacity leveling in a striped file system |
| CN102710438A (en) * | 2012-05-28 | 2012-10-03 | 华为技术有限公司 | Node management method, device and system |
| CN103944964A (en) * | 2014-03-27 | 2014-07-23 | 上海云数信息科技有限公司 | Distributed system and method carrying out expansion step by step through same |
| CN105450727A (en) * | 2015-11-03 | 2016-03-30 | 浪潮(北京)电子信息产业有限公司 | Network communication method and network communication architecture |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20040230862A1 (en) * | 2003-05-16 | 2004-11-18 | Arif Merchant | Redundant data assigment in a data storage system |
-
2016
- 2016-10-27 CN CN201610953392.2A patent/CN108008913B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102460439A (en) * | 2009-04-30 | 2012-05-16 | 网络存储技术公司 | Data distribution through capacity leveling in a striped file system |
| CN102013991A (en) * | 2009-09-08 | 2011-04-13 | 华为技术有限公司 | Method, management equipment and system for automatically expanding capacity |
| CN102045189A (en) * | 2009-10-16 | 2011-05-04 | 中国移动通信集团北京有限公司 | Network management system and method |
| CN102710438A (en) * | 2012-05-28 | 2012-10-03 | 华为技术有限公司 | Node management method, device and system |
| CN103944964A (en) * | 2014-03-27 | 2014-07-23 | 上海云数信息科技有限公司 | Distributed system and method carrying out expansion step by step through same |
| CN105450727A (en) * | 2015-11-03 | 2016-03-30 | 浪潮(北京)电子信息产业有限公司 | Network communication method and network communication architecture |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108008913A (en) | 2018-05-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108008913B (en) | Management node-based capacity expansion method and device and storage system | |
| US11586673B2 (en) | Data writing and reading method and apparatus, and cloud storage system | |
| US7404036B2 (en) | Rebalancing of striped disk data | |
| CN110287197B (en) | Data storage method, migration method and device | |
| US20090210464A1 (en) | Storage management system and method thereof | |
| WO2017218364A1 (en) | Priority-based resource allocation | |
| CN109002259B (en) | Hard disk allocation method, system, device and storage medium of homing group | |
| CN107239412B (en) | Storage space configuration method based on Thin-LUN, data writing method and storage equipment | |
| CN106897342B (en) | Data verification method and equipment | |
| CN103324533A (en) | distributed data processing method, device and system | |
| CN107967117B (en) | Data storage, reading and cleaning method and device and cloud storage system | |
| US9851960B2 (en) | Tenant allocation in multi-tenant software applications | |
| WO2019170011A1 (en) | Task allocation method and device, and distributed storage system | |
| JP6975153B2 (en) | Data storage service processing method and equipment | |
| CN112243044A (en) | Container address allocation method and device | |
| CN109033365B (en) | Data processing method and related equipment | |
| CN109271376A (en) | Database upgrade method, apparatus, equipment and storage medium | |
| CN104468641B (en) | A kind of business datum moving method, device and cloud storage system | |
| CN111399761B (en) | Storage resource allocation method, device and equipment, and storage medium | |
| CN113676511A (en) | Cloud storage method, system, equipment and storage medium | |
| CN109634524B (en) | Data partition configuration method, device and equipment of data processing daemon | |
| CN109039939B (en) | Load sharing method and device | |
| CN107770190B (en) | Authority management method and device | |
| CN107395721B (en) | Method and system for expanding metadata cluster | |
| US7979551B2 (en) | Enhancing availability of remote applications |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |