CN116319841A - Distributed storage dynamic capacity expansion method and device and electronic equipment - Google Patents
Distributed storage dynamic capacity expansion method and device and electronic equipment Download PDFInfo
- Publication number
- CN116319841A CN116319841A CN202310124993.2A CN202310124993A CN116319841A CN 116319841 A CN116319841 A CN 116319841A CN 202310124993 A CN202310124993 A CN 202310124993A CN 116319841 A CN116319841 A CN 116319841A
- Authority
- CN
- China
- Prior art keywords
- configuration
- storage
- target configuration
- original
- storage node
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1097—Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/067—Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/08—Configuration management of networks or network elements
- H04L41/0803—Configuration setting
- H04L41/0813—Configuration setting characterised by the conditions triggering a change of settings
- H04L41/0816—Configuration setting characterised by the conditions triggering a change of settings the condition being an adaptation, e.g. in response to network events
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/08—Configuration management of networks or network elements
- H04L41/0866—Checking the configuration
- H04L41/0869—Validating the configuration within one network element
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/104—Peer-to-peer [P2P] networks
- H04L67/1044—Group management mechanisms
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- Computing Systems (AREA)
- Mathematical Physics (AREA)
- Human Computer Interaction (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The application relates to the field of storage, in particular to a distributed storage dynamic capacity expansion method, a device and equipment, wherein the method comprises the following steps: generating target configuration based on the newly-added information, and storing the target configuration in an original storage node in a storage cluster; then detecting whether the target configuration is compliant, and updating the original configuration of the original storage node based on the target configuration when the target configuration is compliant, so that the original configuration is operated based on the updated configuration; and before updating the configuration, running based on the original configuration. Therefore, before updating the configuration, the original configuration is used for providing service, the normal operation of the storage cluster is ensured, after the compliance of the target configuration is detected, the original configuration is updated based on the target configuration, so that the normal operation of the cluster is ensured after the updating configuration is switched, the service is stopped only in a short time in the process of switching the updating configuration, the service stopping time of the storage cluster when the storage node is newly added is greatly shortened, and the stability of the storage cluster is improved.
Description
Technical Field
The invention relates to the technical field of storage, in particular to a distributed storage dynamic expansion method, a distributed storage dynamic expansion device and electronic equipment.
Background
With the development of distributed technology, more and more enterprises use disk spaces on a plurality of machines in the enterprises through a network, and form a virtual storage device, namely a storage cluster, wherein data are stored in each storage node in the cluster in a scattered manner, namely a distributed storage system, so that the reliability, availability and access efficiency of the system are greatly improved.
However, in the prior art, when the storage cluster is expanded, that is, when a new storage device is used as a storage node of the storage cluster, the storage cluster service needs to be stopped for a long time or the expansion process is complex, so that the stability and the service effect of the storage cluster are affected, and the service of a user is affected.
Disclosure of Invention
In order to solve the technical problems at least to a certain extent, the invention provides a distributed storage dynamic capacity expansion method, a distributed storage dynamic capacity expansion device and distributed storage dynamic capacity expansion equipment.
In a first aspect, an embodiment of the present application provides a distributed storage dynamic capacity expansion method, including:
responding to a storage node newly-added request of a preset storage cluster, and determining newly-added information;
generating target configuration based on the newly-added information, and storing the target configuration into an original storage node in the storage cluster;
detecting whether the target configuration is compliant, and updating the original configuration of the original storage node based on the target configuration when the target configuration is compliant, so that the original storage node operates based on the updated configuration;
before updating the original configuration, the original storage nodes all operate based on the original configuration.
Optionally, the generating the target configuration based on the newly added information includes:
based on the newly-added information, determining the IP and the port of newly-added storage equipment corresponding to the newly-added request of the storage node;
the target configuration includes the IP and ports of the original storage node and the newly added storage node.
Optionally, the method further comprises:
and saving the target configuration to the newly added storage node so that the newly added storage node can operate based on the target configuration.
Optionally, the detecting whether the target configuration is compliant includes:
detecting whether the target configuration meets the operation requirement of each storage node;
if the target configuration meets the operation requirement of the storage nodes in the preset number range, determining that the target configuration is compliant;
and if the target configuration does not meet the operation requirements of the storage nodes in the preset number range, determining that the target configuration is not compliant.
Optionally, the target configuration further includes the number of newly added storage nodes.
Optionally, the detecting whether the target configuration meets the operation requirement of each storage node includes:
detecting whether the number of newly added storage nodes meets the operation requirement of the storage nodes in a preset number range or not;
if the number of the newly added storage nodes meets the operation requirement of the storage nodes in a preset number range, determining that the target configuration is compliant;
and if the number of the newly added storage nodes does not meet the operation requirement of the storage nodes in the preset number range, determining that the target configuration is not compliant.
Optionally, the method further comprises:
if the target configuration is not legal, an abnormal warning is sent out;
the anomaly alert is used to alert a worker to change the number of newly added storage nodes.
Optionally, the method further comprises receiving a configuration switching instruction;
the detecting whether the target configuration is compliant, and when the target configuration is compliant, updating the original configuration of the original storage node based on the target configuration includes:
and after receiving the configuration switching instruction, detecting whether the target configuration is compliant, and updating the original configuration of the original storage node based on the target configuration when the target configuration is compliant.
In a second aspect, an embodiment of the present application further provides a distributed storage dynamic capacity expansion device, including:
the acquisition module is used for responding to a storage node newly-added request of a preset storage cluster and determining newly-added information;
the calculation module is used for generating target configuration based on the newly-added information and storing the target configuration into the original storage nodes in the storage cluster;
the detection switching module is used for detecting whether the target configuration is in compliance or not, and updating the original configuration of the original storage node based on the target configuration when the target configuration is in compliance, so that the original storage node operates based on the updated configuration;
before updating the original configuration, the original storage nodes all operate based on the original configuration.
In a third aspect, embodiments of the present application further provide an electronic device, including: a memory and a processor, and a computer program stored on the memory and executable on the processor, which when executed by the processor, implements a distributed storage dynamic expansion method as described above.
The distributed storage dynamic capacity expansion method provided by the application generates target configuration based on the newly-added information and stores the target configuration in the original storage nodes in the storage cluster; then detecting whether the target configuration is compliant, and updating the original configuration of the original storage node based on the target configuration when the target configuration is compliant, so that the original configuration is operated based on the updated configuration; and before updating the configuration, running based on the original configuration. Therefore, before updating the configuration, the original configuration is used for providing service, the normal operation of the storage cluster is ensured, after the compliance of the target configuration is detected, the original configuration is updated based on the target configuration, so that the normal operation of the cluster is ensured after the updating configuration is switched, the service is stopped only in a short time in the process of switching the updating configuration, the service stopping time of the storage cluster is greatly shortened when the storage node is newly added, the stability of the storage cluster is improved, the influence on user service is avoided, and the user experience is improved.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and together with the description, serve to explain the principles of the invention. Furthermore, these drawings and the written description are not intended to limit the scope of the inventive concept in any way, but to illustrate the inventive concept to those skilled in the art by referring to the specific embodiments.
Fig. 1 is a flow chart of a distributed storage dynamic capacity expansion method according to an embodiment of the present application;
fig. 2 is a schematic diagram of adding storage nodes in an original storage cluster in the distributed storage dynamic capacity expansion method provided in the embodiment of the present application;
fig. 3 is a schematic diagram of a target configuration stored in an original storage cluster in the distributed storage dynamic capacity expansion method provided in the embodiment of the present application;
fig. 4 is a schematic diagram of a switching configuration in an original storage cluster in the distributed storage dynamic capacity expansion method provided in the embodiment of the present application;
FIG. 5 is a flow chart of a method for dynamic capacity expansion of distributed storage according to another embodiment of the present application;
fig. 6 is a schematic structural diagram of a distributed storage dynamic capacity expansion device provided in the present application;
fig. 7 is a schematic structural diagram of an electronic device provided in the present application.
Detailed Description
For the purpose of making the objects, technical solutions and advantages of the present invention more apparent, the technical solutions in the embodiments of the present invention will be clearly and completely described in the following in conjunction with the embodiments of the present invention, and it is apparent that the described embodiments are some embodiments of the present invention, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention. The following embodiments and features of the embodiments may be combined with each other without conflict.
Method embodiment:
fig. 1 is a flow chart of a distributed storage dynamic capacity expansion method provided in an embodiment of the present application, as shown in fig. 1, where the distributed storage dynamic capacity expansion method provided in the embodiment of the present application may specifically include:
s101, determining newly-added information in response to a newly-added request of a storage node of a preset storage cluster.
Specifically, the storage node newly-added request may be generated and sent by an operation maintainer of the storage cluster based on actual requirements, and is used for adding newly-added storage equipment into the storage cluster to serve as a newly-added storage node of the storage cluster, so that the storage cluster is expanded. The newly-added information may include the number of newly-added storage devices to correspond to the number of storage nodes to be added, or may include basic information of each newly-added storage device, etc.
S102, generating target configuration based on the newly-added information, and storing the target configuration in the original storage nodes in the storage cluster.
Specifically, based on the obtained newly-added information, generating a target configuration, namely, a new configuration containing newly-added storage node information, wherein the target configuration can comprise the number of the newly-added storage nodes, the information such as the IP and the ports of each newly-added storage node, and the like. After the target configuration is generated, the target configuration is saved to the original storage node within the storage cluster.
And S103, detecting whether the target configuration is compliant, and updating the original configuration of the original storage node based on the target configuration when the target configuration is compliant, so that the original storage node operates based on the updated configuration.
Wherein, prior to updating the original configuration, the original storage nodes are all operated based on the original configuration.
Specifically, after the target configuration is issued and stored to the original storage node, the target configuration is not validated, and at this time, the original storage node still operates in its original configuration, i.e. the original configuration, and provides services to the outside. After the target configuration is issued to the original storage node, whether the target configuration is compliant or not is detected, if the target configuration comprises whether the newly added storage node can cause abnormal operation of the original storage node, if the newly added storage node can not cause abnormal operation of the original storage node, the target configuration is compliant is determined; if the newly added storage node can cause abnormal operation or even direct incapacitation of the original storage node, the target configuration is determined to be non-compliance.
When the target configuration compliance is determined, updating the original configuration of the original storage nodes based on the target configuration, so that the configuration in the original storage nodes comprises the configuration of the newly added storage nodes, the original storage nodes can operate based on the new configuration to provide services, and meanwhile, the newly added storage nodes can also operate based on the target configuration to provide services, and the capacity expansion of the storage clusters is completed.
It should be noted that, in the process of detecting whether the target configuration is compliant, the operation of the original cluster is not affected, and the original cluster can still provide services based on the original configuration, so as to avoid the influence of shutdown on the service.
The distributed storage dynamic capacity expansion method provided by the application generates target configuration based on newly-added information and stores the target configuration in an original storage node in a storage cluster; then detecting whether the target configuration is compliant, and updating the original configuration of the original storage node based on the target configuration when the target configuration is compliant, so that the original configuration is operated based on the updated configuration; and before updating the configuration, running based on the original configuration. Therefore, before updating the configuration, the original configuration is used for providing service, the normal operation of the storage cluster is ensured, after the compliance of the target configuration is detected, the original configuration is updated based on the target configuration, so that the normal operation of the cluster is ensured after the updating configuration is switched, the service is stopped only in a short time in the process of switching the updating configuration, the service stopping time of the storage cluster is greatly shortened when the storage node is newly added, the stability of the storage cluster is improved, the influence on user service is avoided, and the user experience is improved.
In some embodiments of the present application, the process of generating the target configuration based on the new information may include: combining the information of the newly added storage node with the information of the original storage node, thereby obtaining target configuration comprising the information of the newly added storage node and the information of the original storage node.
The newly-added storage node information includes the number of newly-added storage nodes, information such as the IP and the port of each newly-added storage node, and even basic information of newly-added storage equipment corresponding to each newly-added storage node. The newly added storage node takes newly added storage equipment as a main body, and the storage node after a preset relation is constructed between the newly added storage equipment and the original storage node in the storage cluster can be generated automatically by a system when related personnel input or the newly added storage equipment is added into the storage cluster.
The information of the original storage nodes can comprise configuration in each original storage node in the storage cluster, the configuration comprises how many storage nodes are in the storage cluster, even relations among the nodes, and the like, and the configuration can be directly called from the original storage cluster.
At this time, after detecting the compliance of the target configuration, the original configuration in the original storage node can be directly replaced by the target configuration, and the target configuration is validated, so that the original configuration of the original storage node is updated, and the original storage node operates based on the updated configuration, namely the target configuration, to provide services.
In other embodiments of the present application, the target configuration may only include information of the newly added storage node, that is, the original storage node is not included, and at this time, after detecting that the target configuration is compliant, the new configuration including information of the newly added storage node and the original storage node is determined based on the original configuration in each original storage node, and the original configuration is replaced by the new configuration, so as to complete updating of the original configuration of the original storage node, so that the original storage node operates based on the updated configuration, and provide services.
In the following embodiments, the target configuration is taken as an example including information of the new storage node and the original storage node, and other flows in the scheme of the present application are described, and when the target configuration including only the new storage node is used for subsequent flows, it is only necessary to increase the corresponding original configuration when the original configuration of the original storage node is updated based on the target configuration.
It can be appreciated that when the target configuration is saved to the original storage node in the storage cluster, the target configuration is not validated, and the target configuration and the original configuration exist in the original storage node at the same time, and because the target configuration is not validated, the original storage node still operates based on the original configuration to provide services.
Further, the distributed storage dynamic capacity expansion method provided by the application further comprises the following steps: the target configuration is saved to the newly added storage node so that the newly added storage node can operate based on the target configuration.
Specifically, the target configuration is stored in the newly added storage node, so that the newly added storage node can operate based on the target configuration. For example, after detecting target configuration compliance, the target configuration is validated in the newly added storage node, thereby enabling the newly added storage node to operate and provide services based on the target configuration.
In this application, the operation of using the newly added storage device as the newly added storage node may be performed in any one of the above links, for example, after receiving the newly added storage node request. At this time, the target configuration may be stored in the newly added storage node while the target configuration is stored in the original storage node, so that when whether the target configuration is in compliance is detected later, whether the target configuration is applied to both the newly added storage node and the original storage node is in compliance can be detected simultaneously, and when the target configuration is in compliance, the new configuration in the newly added storage node and the original storage node is updated and validated, so as to improve the efficiency of increasing the storage node.
Fig. 2 is a schematic diagram of adding a storage node to an original storage cluster in the distributed storage dynamic capacity expansion method provided in the embodiment of the present application, in fig. 2, a left block diagram is a schematic diagram of a storage cluster (original cluster) when no storage node is added, and in fig. 2, a right block diagram is a schematic diagram of a storage cluster after a storage node is added, as shown in fig. 2:
before no storage node is added, the original storage cluster includes n storage nodes, such as storage node-a-1 and storage node-a-2, until storage node-a-n, where these storage nodes are the original storage nodes mentioned in the foregoing embodiments, and each original storage node includes configuration data, that is, the original configuration shown in fig. 2, where the storage nodes in the storage cluster operate and provide services based on the original configuration.
After receiving the request of the newly added storage node, the corresponding newly added storage device is set as the newly added storage node in the storage cluster, such as storage node-B-1 and storage node-B-1 in fig. 2, until storage node-B-m. At this time, since there is no original configuration in the newly added storage node, the target configuration can be initially saved to the newly added storage node, so as to improve efficiency. It should be noted that, at this time, the saved target configuration is not validated, that is, the original storage node operates based on the original configuration, and the newly added storage node does not operate. Wherein the configuration within the solid line box in the storage node is an operational configuration and the configuration within the dashed line box is an inactive, non-operational configuration.
Further, the target configuration is then saved to the original storage node, with the state still inactive. At this time, the original storage node includes both the original configuration and the target configuration, and operates to provide services based on the original configuration. As particularly shown in fig. 3.
After the target configuration detection is completed and the target configuration is compliant, the configuration in each original storage node is updated based on the target configuration, for example, the original configuration may be deleted, the target configuration is validated at the same time, and finally, the configurations in all storage nodes (including the newly added storage node and the original storage node) are new configurations, namely, the target configuration, so that all storage nodes operate with the target configuration to provide services, and the capacity expansion of the storage cluster is completed, as shown in fig. 4.
In some embodiments of the present application, detecting whether the target configuration is compliant may include: detecting whether the target configuration meets the operation requirement of each storage node; if the target configuration meets the operation requirement of the storage nodes in the preset number range, determining that the target configuration is compliant; and if the target configuration does not meet the operation requirements of the storage nodes in the preset number range, determining that the target configuration is not compliant.
Specifically, in the storage cluster, the operation of each storage node has certain requirements, such as the storage capacity of the storage node, the state setting of the storage node, the number of the storage nodes and the like, and the storage node can normally operate only when the above conditions are met, so that the storage cluster can normally provide services. Therefore, in the present application, after the target configuration is saved to the storage node, it needs to be detected whether the newly added storage node meets the operation requirement of each storage node.
In practical application, whether the target configuration meets the operation requirement of each storage node can be detected one by one, and when the target configuration meets the operation requirement of the storage nodes in the preset number range, the target configuration compliance is determined, and when the target configuration does not meet the operation requirement of the storage nodes in the preset number range, the target configuration non-compliance is determined. Of course, in other embodiments of the present application, in order to ensure perfect operation of the storage cluster, it may also be configured to determine that the target configuration is compliant when the target configuration meets the operation requirements of all storage nodes, and determine that the target configuration is non-compliant when the target configuration does not meet the operation requirements of all storage nodes.
Further, in some embodiments, determining whether the target configuration is compliant may be based on the number of newly added storage nodes, including: detecting whether the number of newly added storage nodes meets the operation requirement of the storage nodes in a preset number range or not; if the number of the storage nodes is increased newly to meet the operation requirement of the storage nodes in the preset number range, determining that the target configuration is compliant; if the number of the storage nodes is increased, and the operation requirement of the storage nodes in the preset number range is not met, determining that the target configuration is not compliant.
Specifically, as each storage node in the storage cluster, there is a certain requirement on how many storage nodes are included in the storage cluster, and there is a fault tolerance range. For example, when the number of the newly added storage nodes is 10, the 10 newly added storage nodes are within the fault tolerance range, and at this time, it may be determined that the operation requirements of the storage nodes are satisfied; each storage node is then individually tested to determine if the target configuration meets the operational requirements of a predetermined number of storage nodes.
In other embodiments of the present application, considering the consistency of each storage node, it may be further determined that the target configuration is compliant after detecting whether the target configuration meets a certain or some storage nodes, so as to greatly reduce the calculation pressure and improve the detection efficiency.
Based on the above embodiment, the distributed storage dynamic capacity expansion method provided by the present application may further include sending an abnormal warning when the target configuration is not compliant, so as to remind a worker to change the number of newly added storage nodes.
Specifically, when the target configuration is not compliant, an anomaly alert may be issued, where the anomaly alert is used to alert a user or a related maintenance operator to change the state and number of newly added storage nodes, etc., so that the new target configuration is compliant, and then a process of subsequently updating the storage node configuration is performed. For example, the relevant staff is reminded to increase or decrease the number of the newly-increased storage nodes, so that when the number of the newly-increased storage nodes is inappropriate, reminding is timely sent out, and the storage cluster expansion accuracy and efficiency are improved.
In some embodiments of the present application, it may also be determined when to perform a switch between the detected and old configuration based on instructions from the relevant staff or user. Namely, receiving a switching detection instruction, starting to detect whether the target configuration is in compliance, and automatically updating the configuration to disable the original configuration or enable the new configuration to be validated when the target configuration is in compliance or after receiving other additional control instructions.
Specifically, for example, after the target configuration is stored in the storage node, no operation may be performed, a control instruction is waited, after the control instruction of the related person is received, detection of the target configuration is started, and after the target configuration compliance is detected, the configuration in the storage node is updated, for example, the original configuration in the storage node is switched to the target configuration and is the effective target configuration.
Fig. 5 is a flow chart of a dynamic capacity expansion method for distributed storage according to another embodiment of the present application, as shown in fig. 5, in this embodiment, the method includes:
the method comprises the steps of adding the new storage equipment into a storage cluster based on the new storage equipment and a new storage node request, and using the new storage equipment as the new storage node of the storage cluster.
Then, the target configuration is saved to all storage nodes (including the original storage nodes and the newly added storage nodes in the storage cluster) and loaded, but the target configuration is not validated at this time, and the target configuration and the original configuration exist in the original storage nodes at the same time, because the target configuration is not validated, the original storage nodes operate according to the original configuration to provide services, and the newly added storage nodes do not operate.
And then after receiving a control instruction such as a switching or updating instruction sent by a related person, detecting whether the target configuration is compliant, if not, sending a related warning to remind the related person to change the number or state of the newly-added storage equipment and the newly-added storage nodes and the like until detecting the target configuration compliance generated based on the changed newly-added storage equipment and nodes.
After the target configuration compliance is detected, configuration updating and switching are carried out, wherein the method comprises the steps of deleting or setting the original configuration in the original storage node to be invalid, replacing the original configuration with the target configuration, enabling the target configuration to be effective, directly effective and newly increasing the target configuration in the storage node, and enabling all the storage nodes to operate in the new configuration, namely the target configuration, so that configuration switching is completed, and dynamic capacity expansion of the storage cluster is realized.
Device example:
based on the same inventive concept, the present application further provides a distributed storage dynamic capacity expansion device, and fig. 6 is a schematic structural diagram of the distributed storage dynamic capacity expansion device provided in the present application, as shown in fig. 6, where the device includes:
an obtaining module 61, configured to determine newly added information in response to a newly added request of a storage node of a preset storage cluster;
the computing module 62 is configured to generate a target configuration based on the newly added information, and store the target configuration in an original storage node in the storage cluster;
a detection switching module 63, configured to detect whether the target configuration is compliant, and update the original configuration of the original storage node based on the target configuration when the target configuration is compliant, so that the original storage node operates based on the updated configuration;
wherein the original storage nodes are all operated based on the original configuration before replacing the original configuration of the original storage nodes with the target configuration.
The specific implementation manner of the distributed storage dynamic capacity expansion device provided in this embodiment of the present application may refer to the implementation manner of the distributed storage dynamic capacity expansion method in any embodiment, which is not described herein.
Electronic device embodiment:
based on the same inventive concept, the present application further provides an electronic device, and fig. 7 is a schematic structural diagram of the electronic device provided in the present application, as shown in fig. 7, where the device includes: comprising a memory 71 and a processor 7, and a computer program stored on the memory 71 and executable on the processor 71, which, when executed by the processor 71, implements a distributed storage dynamic expansion method as provided in the method embodiments described above.
The specific implementation manner of the electronic device provided in the embodiment of the present application may refer to the implementation manner of the distributed storage dynamic capacity expansion method in any embodiment, which is not described herein.
It is to be understood that the same or similar parts in the above embodiments may be referred to each other, and that in some embodiments, the same or similar parts in other embodiments may be referred to.
It should be noted that in the description of the present invention, the terms "first," "second," and the like are used for descriptive purposes only and are not to be construed as indicating or implying relative importance. Furthermore, in the description of the present invention, unless otherwise indicated, the meaning of "plurality" means at least two.
Any process or method descriptions in flow charts or otherwise described herein may be understood as representing modules, segments, or portions of code which include one or more executable instructions for implementing specific logical functions or steps of the process, and further implementations are included within the scope of the preferred embodiment of the present invention in which functions may be executed out of order from that shown or discussed, including substantially concurrently or in reverse order, depending on the functionality involved, as would be understood by those reasonably skilled in the art of the present invention.
It is to be understood that portions of the present invention may be implemented in hardware, software, firmware, or a combination thereof. In the above-described embodiments, the various steps or methods may be implemented in software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, may be implemented using any one or combination of the following techniques, as is well known in the art: discrete logic circuits having logic gates for implementing logic functions on data signals, application specific integrated circuits having suitable combinational logic gates, programmable Gate Arrays (PGAs), field Programmable Gate Arrays (FPGAs), and the like.
Those of ordinary skill in the art will appreciate that all or a portion of the steps carried out in the method of the above-described embodiments may be implemented by a program to instruct related hardware, where the program may be stored in a computer readable storage medium, and where the program, when executed, includes one or a combination of the steps of the method embodiments.
In addition, each functional unit in the embodiments of the present invention may be integrated in one processing module, or each unit may exist alone physically, or two or more units may be integrated in one module. The integrated modules may be implemented in hardware or in software functional modules. The integrated modules may also be stored in a computer readable storage medium if implemented in the form of software functional modules and sold or used as a stand-alone product.
The above-mentioned storage medium may be a read-only memory, a magnetic disk or an optical disk, or the like.
In the description of the present specification, a description referring to terms "one embodiment," "some embodiments," "examples," "specific examples," or "some examples," etc., means that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the present invention. In this specification, schematic representations of the above terms do not necessarily refer to the same embodiments or examples. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples.
While embodiments of the present invention have been shown and described above, it will be understood that the above embodiments are illustrative and not to be construed as limiting the invention, and that variations, modifications, alternatives and variations may be made to the above embodiments by one of ordinary skill in the art within the scope of the invention.
Claims (10)
1. A distributed storage dynamic expansion method, comprising:
responding to a storage node newly-added request of a preset storage cluster, and determining newly-added information;
generating target configuration based on the newly-added information, and storing the target configuration into an original storage node in the storage cluster;
detecting whether the target configuration is compliant, and updating the original configuration of the original storage node based on the target configuration when the target configuration is compliant, so that the original storage node operates based on the updated configuration;
before updating the original configuration, the original storage nodes all operate based on the original configuration.
2. The distributed storage dynamic expansion method of claim 1, wherein generating a target configuration based on the newly added information comprises:
based on the newly-added information, determining the IP and the port of newly-added storage equipment corresponding to the newly-added request of the storage node;
the target configuration includes the IP and ports of the original storage node and the newly added storage node.
3. The distributed storage dynamic expansion method of claim 2, further comprising:
and saving the target configuration to the newly added storage node so that the newly added storage node can operate based on the target configuration.
4. A distributed storage dynamic expansion method according to any of claims 1 or 3, wherein said detecting whether said target configuration is compliant comprises:
detecting whether the target configuration meets the operation requirement of each storage node;
if the target configuration meets the operation requirement of the storage nodes in the preset number range, determining that the target configuration is compliant;
and if the target configuration does not meet the operation requirements of the storage nodes in the preset number range, determining that the target configuration is not compliant.
5. The method of claim 4, wherein the target configuration further includes a number of newly added storage nodes.
6. The distributed storage dynamic expansion method of claim 5, wherein said detecting whether the target configuration meets the operational requirement of each storage node comprises:
detecting whether the number of newly added storage nodes meets the operation requirement of the storage nodes in a preset number range or not;
if the number of the newly added storage nodes meets the operation requirement of the storage nodes in a preset number range, determining that the target configuration is compliant;
and if the number of the newly added storage nodes does not meet the operation requirement of the storage nodes in the preset number range, determining that the target configuration is not compliant.
7. The distributed storage dynamic expansion method of claim 6, further comprising:
if the target configuration is not legal, an abnormal warning is sent out;
the anomaly alert is used to alert a worker to change the number of newly added storage nodes.
8. The distributed storage dynamic expansion method of claim 1, further comprising receiving a configuration switch instruction;
the detecting whether the target configuration is compliant, and when the target configuration is compliant, updating the original configuration of the original storage node based on the target configuration includes:
and after receiving the configuration switching instruction, detecting whether the target configuration is compliant, and updating the original configuration of the original storage node based on the target configuration when the target configuration is compliant.
9. A distributed storage dynamic capacity expansion device, comprising:
the acquisition module is used for responding to a storage node newly-added request of a preset storage cluster and determining newly-added information;
the calculation module is used for generating target configuration based on the newly-added information and storing the target configuration into the original storage nodes in the storage cluster;
the detection switching module is used for detecting whether the target configuration is in compliance or not, and updating the original configuration of the original storage node based on the target configuration when the target configuration is in compliance, so that the original storage node operates based on the updated configuration;
before updating the original configuration, the original storage nodes all operate based on the original configuration.
10. An electronic device comprising a memory and a processor, and a computer program stored on the memory and executable on the processor, which when executed by the processor, implements the distributed storage dynamic expansion method of any of claims 1 to 8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310124993.2A CN116319841A (en) | 2023-02-06 | 2023-02-06 | Distributed storage dynamic capacity expansion method and device and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310124993.2A CN116319841A (en) | 2023-02-06 | 2023-02-06 | Distributed storage dynamic capacity expansion method and device and electronic equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN116319841A true CN116319841A (en) | 2023-06-23 |
Family
ID=86835156
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310124993.2A Pending CN116319841A (en) | 2023-02-06 | 2023-02-06 | Distributed storage dynamic capacity expansion method and device and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116319841A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116599841A (en) * | 2023-07-18 | 2023-08-15 | 联通沃音乐文化有限公司 | Large-scale cloud storage system capacity expansion method, device, equipment and storage medium |
-
2023
- 2023-02-06 CN CN202310124993.2A patent/CN116319841A/en active Pending
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116599841A (en) * | 2023-07-18 | 2023-08-15 | 联通沃音乐文化有限公司 | Large-scale cloud storage system capacity expansion method, device, equipment and storage medium |
| CN116599841B (en) * | 2023-07-18 | 2023-10-13 | 联通沃音乐文化有限公司 | Large-scale cloud storage system capacity expansion method, device, equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109471770B (en) | System management method and device | |
| CN1770707B (en) | Apparatus and method for quorum-based power-down of unresponsive servers in a computer cluster | |
| JP6325001B2 (en) | Method and system using recursive event listeners in nodes of hierarchical data structures | |
| CN110874261B (en) | Availability system, method, and storage medium storing program | |
| WO2021072847A1 (en) | Method and apparatus for monitoring condition of computer network, computer device, and storage medium | |
| CN116319841A (en) | Distributed storage dynamic capacity expansion method and device and electronic equipment | |
| CN112199240B (en) | Method for switching nodes during node failure and related equipment | |
| CN108170507A (en) | Virtual application management method/system, computer readable storage medium and server-side | |
| CN114531373A (en) | Node state detection method, node state detection device, equipment and medium | |
| JP5282569B2 (en) | Management device, management system, management method, and management program | |
| CN101878620A (en) | Modifying system routing information in link based systems | |
| EP2843555A1 (en) | Information processing system and method for processing failure | |
| CN111031126B (en) | Cluster cache sharing method, system, equipment and storage medium | |
| CN115576737B (en) | Abnormality detection method, abnormality detection device, electronic device, and storage medium | |
| CN115687026A (en) | Multi-node server fault early warning method, device, equipment and medium | |
| CN115268785A (en) | Management method and device applied to distributed storage system and storage medium | |
| CN113746655B (en) | Backup state determination method, device and system | |
| CN111367885A (en) | Database management system, database management method, storage medium, and electronic device | |
| CN112035250A (en) | High-availability local area network service management method, equipment and deployment architecture | |
| CN112433875A (en) | Middleware-based database operation method and device and terminal equipment | |
| CN114531492B (en) | Service calling method, device, storage medium and computer equipment | |
| CN115470303B (en) | Database access method, device, system, equipment and readable storage medium | |
| CN117149095B (en) | NAS-based cluster management method, NAS-based cluster management device, computer equipment and media | |
| CN111901415B (en) | Data processing method and system, computer readable storage medium and processor | |
| CN113900890B (en) | Method, device, equipment and medium for collecting server component information |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |