CN116074326A - Distributed storage system, path switching method and device, electronic equipment and medium - Google Patents
Distributed storage system, path switching method and device, electronic equipment and medium Download PDFInfo
- Publication number
- CN116074326A CN116074326A CN202211665520.5A CN202211665520A CN116074326A CN 116074326 A CN116074326 A CN 116074326A CN 202211665520 A CN202211665520 A CN 202211665520A CN 116074326 A CN116074326 A CN 116074326A
- Authority
- CN
- China
- Prior art keywords
- storage node
- path
- load state
- storage
- state
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1001—Protocols in which an application is distributed across nodes in the network for accessing one among a plurality of replicated servers
- H04L67/1004—Server selection for load balancing
- H04L67/1008—Server selection for load balancing based on parameters of servers, e.g. available memory or workload
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1097—Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
Abstract
The invention discloses a distributed storage system and a path switching method thereof, wherein the method comprises the following steps: determining a first load state corresponding to the path of the storage node according to the received access request; acquiring a second load state of other storage node paths belonging to the same virtual block storage equipment as the storage node path according to the first load state as a preset load state; selecting a storage node path meeting preset conditions based on the first load state and the second load state; the access request is processed based on the selected storage node path. When the local path load state is the preset load state, the path switching of the access request is triggered on the storage node, so that the path optimization effect which is not perceived by the user is achieved on the storage node. Because the path reselection is realized based on the load conditions of the local path and other storage nodes, the continuous abnormal problem caused by the limitation of the calculation resources or the network resources of single or partial nodes can be reduced, and the availability satisfaction degree of the storage system is improved.
Description
Technical Field
The present invention relates to the field of storage technologies, and in particular, to a distributed storage system, a path switching method, a path switching device, an electronic device, and a medium.
Background
In a multi-path scenario of a distributed storage system, the high availability of storage often depends on the multi-path software of the client to realize the path failover, that is, after the client sends an access request, the client retries the original path or switches paths according to the returned error code.
However, in the operation process, the problem of abnormal continuous request is often caused by limited computing resources or limited network resources of a single storage node or part of storage nodes, so that the client cannot normally access the storage system, and the use experience of the user on the storage system is affected.
Disclosure of Invention
The invention aims at providing a distributed storage system, a path switching method, a device, electronic equipment and a storage medium aiming at the defects of the prior art, and the aim is achieved through the following technical scheme.
The first aspect of the present invention proposes a path switching method applied to a storage node, the method comprising:
determining a first load state corresponding to the path of the storage node according to the received access request;
acquiring a second load state of other storage node paths belonging to the same virtual block storage equipment as the storage node path according to the first load state as a preset load state;
selecting a storage node path meeting preset conditions based on the first load state and the second load state;
the access request is processed based on the selected storage node path.
Based on the path switching method of the distributed storage system described in the first aspect, the present invention has at least the following advantages or benefits:
after receiving the access request, the storage node in the distributed storage system firstly determines the load state of the local path, and when the load state of the local path meets a certain preset load state, triggers the path switching of the access request, namely, by acquiring the load states of other storage node paths belonging to the same virtual block storage device as the local path, then realizes path reselection based on the load states of the local path and the load states of other storage node paths, and processes the access request based on the selected path, thereby realizing path optimization based on the actual load condition of the path on the storage node, avoiding the return of request abnormality to the client side, and having the effect of non-perception path reselection to the client side. And because the path reselection is realized based on the load state of the local path and the load states of other storage nodes when the path reselection is performed, the problem of continuous request abnormality caused by the limitation of the calculation resources of a single storage node or part of storage nodes or the limitation of the network resources can be reduced, and the availability satisfaction degree of a user to a storage system is improved.
A second aspect of the present invention proposes a path switching device for application to a storage node, the device comprising:
the local path state determining module is used for determining a first load state corresponding to the path of the storage node according to the received access request;
the interconnection path state acquisition module acquires a second load state of other storage node paths belonging to the same virtual block storage device as the storage node path according to the first load state as a preset load state;
the path selection module is used for selecting a storage node path meeting preset conditions based on the first load state and the second load state;
and the request processing module is used for processing the access request based on the selected storage node path.
A third aspect of the present invention proposes a distributed storage system, the system comprising a plurality of storage nodes and a management and control system;
the management and control system is configured to determine, from the plurality of storage nodes, a storage node path corresponding to the same LUN identifier, and store the storage node paths, so as to aggregate storage nodes where the storage node paths corresponding to the same LUN identifier are located into a virtual block storage device;
the storage node is configured to perform the steps of the method according to the first aspect described above.
Based on the above-mentioned distributed storage system according to the third aspect, the present invention has at least the following advantages or benefits:
the management and control system is additionally arranged in the distributed storage system and is responsible for managing metadata of storage node paths identified by the same LUN, so that when the storage nodes in the distributed storage system trigger path reselection, other storage node paths belonging to the same virtual block storage equipment with the storage node paths can be obtained from the management and control system, path reselection is carried out based on the load condition of the storage node paths and the load condition of other storage node paths, and therefore, the path optimization which is not perceived by a user is realized on the storage nodes, the problem of continuous request abnormality caused by the limitation of computational resources or the limitation of network resources of single storage nodes or partial storage nodes is reduced, and the availability satisfaction degree of the user on the storage system is improved.
A fourth aspect of the invention proposes an electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, said processor implementing the steps of the method according to the first aspect described above when said program is executed.
A fifth aspect of the invention proposes a computer readable storage medium having stored thereon a computer program which when executed by a processor implements the steps of the method according to the first aspect described above.
Drawings
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the description serve to explain the invention and do not constitute a limitation on the invention. In the drawings:
FIG. 1 is a schematic diagram of a distributed storage system architecture according to a prior art scheme;
FIG. 2 is a schematic diagram of the architecture of a distributed storage system according to an exemplary embodiment of the present invention;
FIG. 3 is a flow chart of an embodiment of a path switching method according to the present invention shown in the embodiment of FIG. 1;
fig. 4 is a schematic structural view of a path switching device according to an exemplary embodiment of the present invention;
fig. 5 is a schematic diagram showing a hardware structure of an electronic device according to an exemplary embodiment of the present invention;
fig. 6 is a schematic diagram illustrating a structure of a storage medium according to an exemplary embodiment of the present invention.
Detailed Description
Reference will now be made in detail to exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, the same numbers in different drawings refer to the same or similar elements, unless otherwise indicated. The implementations described in the following exemplary examples do not represent all implementations consistent with the invention. Rather, they are merely examples of apparatus and methods consistent with aspects of the invention as detailed in the accompanying claims.
The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. As used in this specification and the appended claims, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It should also be understood that the term "and/or" as used herein refers to and encompasses any or all possible combinations of one or more of the associated listed items.
It should be understood that although the terms first, second, third, etc. may be used herein to describe various information, these information should not be limited by these terms. These terms are only used to distinguish one type of information from another. For example, first information may also be referred to as second information, and similarly, second information may also be referred to as first information, without departing from the scope of the invention. The word "if" as used herein may be interpreted as "at … …" or "at … …" or "responsive to a determination", depending on the context.
Referring to the schematic architecture of the distributed storage system of the existing scheme shown in fig. 1, a host side client APP initiates an access request, a multi-path software MultPath selects a storage node path according to a block storage device accessed by the access request, and transmits the access request to the selected storage node path through a SCSI (Small Computer System Interface )/NVMe (Non-Volatile Memory express, nonvolatile memory standard) protocol layer below the block storage device layer to process the access request. Under the condition that the selected storage node path cannot normally process the access request within a certain time, the multipath software of the host side client performs the original path retry or the switched path retry according to the Error codes (such as IO Hang, IO Timeout, IO Error and the like) returned by the SCSI/NVMe protocol layer.
The inventor finds that for the practical application process of the existing scheme, when path switching is performed by multipath software of the host side client, path optimization cannot be performed based on practical load conditions such as computing resources of storage nodes, network traffic and the like, and the problem of continuous return errors is often caused by limited computing resources or limited network resources of single or partial storage nodes, so that the problem of access interruption of the host side client is caused, and user experience is reduced.
In order to solve the problem of continuously returning errors in the abnormal scenario, the present application proposes an improved distributed storage system, which is shown in fig. 2, and includes a plurality of storage nodes (4 storage nodes are shown in fig. 2) and a management and control system.
The management and control system is used for managing a plurality of storage node paths corresponding to the same LUN (Logical Unit Number ) identifier, that is, the management and control system determines and stores the storage node paths corresponding to the same LUN identifier in a plurality of storage nodes, so as to aggregate the storage nodes corresponding to the same LUN identifier into a virtual block storage device, for example, the management and control system schedules LUN a, and learns that LUN a is respectively mounted on storage node 0, storage node 1, storage node 2 and storage node 3, so that the corresponding relation between LUN a and the storage node 0 path, the storage node 1 path, the storage node 2 path and the storage node 3 path is used as metadata for storage, that is, storage node 0, storage node 1, storage node 2 and storage node 3 are aggregated into a virtual block storage device.
For each storage node, a distributed storage high availability multipath data plane component operates, the processing logic of which is: after receiving the access request, determining a first load state of the storage node path according to the access request, if the first load state is a preset load state, determining other storage node paths belonging to the same virtual block storage device as the storage node path from the management and control system, acquiring a second load state of the other storage node paths, selecting a storage node path meeting preset conditions based on the first load state and the second load state, and processing the access request based on the selected storage node path.
Based on the description, the management and control system is additionally arranged in the distributed storage system to manage the metadata of the storage node paths identified by the same LUN so as to realize path switching on the storage nodes, when the storage node triggers the path reselection, other storage node paths belonging to the same virtual block storage equipment with the storage node paths can be acquired from the management and control system, and the path reselection is performed based on the load condition of the storage node paths and the load condition of other storage node paths, so that the path optimization which is not perceived by a user is realized on the storage nodes, the problem of continuous request abnormality caused by the limitation of the calculation resources or the limitation of the network resources of single storage node or part of storage nodes is reduced, and the availability satisfaction degree of the user on the storage system is improved.
In an optional embodiment, the management and control system may further monitor the load status of the storage node paths corresponding to the same LUN identifier, that is, periodically obtain and store the load status of the storage node paths corresponding to the same LUN identifier, so that the management and control system may learn the health condition of each storage node path in real time.
In order to better understand the present application solution, a path switching solution of the system will be clearly and completely described below in conjunction with the above-mentioned distributed storage system shown in fig. 2.
Fig. 3 is a flowchart illustrating an embodiment of a path switching method according to the present invention, which is applied to a storage node in a distributed storage system, and is implemented by a high-availability multi-path data plane component on the storage node, and as shown in fig. 3, the path switching method includes the following steps:
step 301: and determining a first load state corresponding to the path of the storage node according to the received access request.
The access request is an IO request based on SCSI/NVMe protocol sent by a client side of a host machine, and the access request is transmitted to the storage node after a path on the storage node is selected by multi-path software according to a block storage device accessed by the access request in the client side of the host machine.
Those skilled in the art will appreciate that the process of selecting paths by multipath software in a host-side client may be implemented using prior art techniques, which are not specifically limited in this application.
In one implementation, a LUN identification to be accessed may be determined according to an access request, and then a first load state of a path of the storage node corresponding to the LUN identification may be determined.
Specifically, the access request carries information of the block storage device to be accessed, and the LUN identifier corresponding to the information of the block storage device can be obtained according to the mapping relationship between the locally stored block storage device and the LUN identifier. Because the LUN identification indicates a logic disk, certain computing resources and network resources are allocated for the logic disk on the storage node, when an access request for accessing the logic disk exists, the allocated computing resources and network resources are utilized to process the access request, and therefore, the access path aiming at the LUN identification is the path of the access request on the storage node
In this embodiment of the present application, the first load state is obtained according to a current load condition of the present storage node path, and can represent a current health condition of the present storage node path.
Based on the current load information, a first load state determining process for the storage node path corresponding to the LUN identifier is performed by acquiring the current load information of the storage node path corresponding to the LUN identifier, and then determining the first load state based on the current load information.
The current load information of the storage node path is the occupancy rate of the computing resources and the occupancy rate of the network resources allocated by the storage node to the logical disk indicated by the LUN identifier.
Specifically, the current load information may include CPU occupancy, bandwidth occupancy, and storage occupancy. The CPU occupancy rate and the storage occupancy rate may represent occupancy rates of computing resources, and the bandwidth occupancy rate may represent occupancy rates of network resources.
In a specific embodiment, on the basis that the current load information includes a CPU occupancy rate, a bandwidth occupancy rate and a storage occupancy rate, for a process of determining a first load state based on the current load information, the CPU occupancy rate may be compared with a corresponding threshold range, the bandwidth occupancy rate may be compared with the corresponding threshold range, and the storage occupancy rate may be compared with the corresponding threshold range, and if the CPU occupancy rate, the bandwidth occupancy rate and the storage occupancy rate are all less than the lower limit value of the corresponding threshold range, the first load state may be determined to be a normal state; if any one of the CPU occupancy rate, the bandwidth occupancy rate and the storage occupancy rate is larger than the upper limit value of the corresponding threshold range, determining that the first load state is an abnormal state; and if the CPU occupancy rate, the bandwidth occupancy rate and the storage occupancy rate are not larger than the upper limit value of the corresponding threshold range and at least one of the CPU occupancy rate, the bandwidth occupancy rate and the storage occupancy rate is in the corresponding threshold range, determining that the first load state is a standby state.
In the normal state, the storage node path can process the access request in time, in the standby state, the occupancy rate of the computing resource and/or the network resource of the storage node path is higher, the access request needs to be queued for processing, and in the abnormal state, the computing resource and/or the network resource of the storage node path are severely limited, and the access request cannot be processed normally.
The above description shows that the load states of the paths on the storage nodes are all obtained by calculation on the storage nodes according to the current load conditions, so that the performance loss caused by sending the load information to other nodes to calculate the load states is avoided.
Step 302: and acquiring a second load state of other storage node paths belonging to the same virtual block storage equipment as the storage node path according to the first load state as a preset load state.
Specifically, based on the description of step 301, there are three load states of the storage node path: the normal state, the standby state and the abnormal state are respectively indicated that the computing resources of the storage node path are limited and/or the network resources are limited, and the path switching is necessarily triggered, so that the preset load state is the abnormal state or the standby state.
In an alternative embodiment, since metadata of each storage node path corresponding to the same LUN identifier is maintained on the management and control system of the distributed storage system, each storage node path corresponding to the LUN identifier to be accessed may be queried from the management and control system, where the storage node paths include the present storage node path and other storage node paths, and further, the second load state corresponding to the other storage node paths is determined.
In one example, since the load states of the paths of the storage nodes are all obtained by calculation on the own node, the own storage node can be connected with other storage nodes corresponding to the paths of other storage nodes in a communication manner, and the second load states corresponding to the paths of other storage nodes are queried from the other storage nodes, so that the real-time performance of the load states can be ensured.
Illustratively, a RPC (Remote Procedure Call ) mechanism may be employed between storage nodes to effect a communication connection.
In another example, since the management and control system is also responsible for managing the load status of each storage node path, the management and control system can also query the second load status corresponding to other storage node paths, so that the performance loss caused by the load status query between the storage nodes can be reduced.
The communication connection between the storage node and the management and control system may also be implemented by using an RPC mechanism.
Step 303: and selecting a storage node path meeting preset conditions based on the first load state and the second load state.
Specifically, the preset condition may be to preferentially select a storage node path with a normal load state, then select a storage node path with a standby load state, and finally select a storage node path with an abnormal load state. That is, the priority order of the path load states is a normal state, a standby state, and an abnormal state in this order.
In a specific embodiment, according to the existence of a normal state in the first load state and the second load state, a storage node path corresponding to the normal state is selected, and according to the existence of a standby state in the first load state and the second load state, a storage node path corresponding to the standby state is selected.
For example, referring to fig. 2, it is assumed that the present storage node path corresponding to the LUN a to be accessed of the access request is a storage node 0 path, and the corresponding other storage node paths include: when the load state of the storage node 1 path, the storage node 2 path, and the storage node 3 path is abnormal, the load state of the storage node 1 path is standby, the load state of the storage node 2 path is normal, and the load state of the storage node 3 path is normal, so that the storage node 2 path or the storage node 3 path can be selected.
Specifically, if the first load state of the storage node path is the standby state in the case that the normal state is not present but the standby state is present in the first load state and the second load state, the storage node path can be continuously selected, so as to reduce performance loss caused by transmission of the access request between the storage nodes.
Further, if neither a normal state nor a standby state exists in the first load state and the second load state, the present storage node path is also continued to be selected.
Step 304: the access request is processed based on the selected storage node path.
Specifically, if the selected storage node path is the own storage node path, the access request is processed through the own storage node path, and if the selected storage node path is other storage node paths, the access request is forwarded to other storage nodes corresponding to the other storage node paths.
Thus, after the storage node in the path switching flow distributed storage system shown in fig. 3 receives the access request, the load state of the local path is determined first, and when the load state of the local path meets a certain preset load state, the path switching of the access request is triggered, that is, by acquiring the load states of other storage node paths belonging to the same virtual block storage device as the local path, then, the path reselection is realized based on the load states of the local path and the load states of the other storage node paths, and the access request is processed based on the selected path, so that the path optimization is realized on the storage node based on the actual load condition of the path, the request abnormality does not need to be returned to the client, and the effect of non-perceived path reselection can be realized for the client side. And because the path reselection is realized based on the load state of the local path and the load states of other storage nodes when the path reselection is performed, the problem of continuous request abnormality caused by the limitation of the calculation resources of a single storage node or part of storage nodes or the limitation of the network resources can be reduced, and the availability satisfaction degree of a user to a storage system is improved.
Based on the embodiment shown in fig. 3, it can be understood that the high-availability multi-path data plane component on the storage node mainly includes four functional modules of path management, path health monitoring, path selection, and RPC communication. The path management function module is used for managing the path of the storage node corresponding to the LUN identifier mounted on the storage node; the path health condition monitoring function module is used for calculating the load state of the path of the storage node at regular time according to the load information of the path of the storage node; the path selection function module is used for triggering path switching when a first load state corresponding to the path of the storage node is an abnormal state or a standby state; the RPC communication function module is used for communicating with other storage nodes or communicating with a management and control system.
The invention also provides an embodiment of the distributed storage system and a path switching device thereof corresponding to the embodiment of the distributed storage system and the path switching method thereof.
Fig. 4 is a schematic structural diagram of a path switching device according to an exemplary embodiment of the present invention, where the device is configured to perform the path switching method provided in any one of the foregoing embodiments, and as shown in fig. 4, the path switching device includes:
a local path state determining module 410, configured to determine a first load state corresponding to the path of the storage node according to the received access request;
the interconnection path state obtaining module 420 obtains a second load state of other storage node paths belonging to the same virtual block storage device as the present storage node path according to the first load state as a preset load state;
a path selection module 430, configured to select a storage node path that meets a preset condition based on the first load state and the second load state;
a request processing module 440 for processing the access request based on the selected storage node path.
The implementation process of the functions and roles of each unit in the above device is specifically shown in the implementation process of the corresponding steps in the above method, and will not be described herein again.
For the device embodiments, reference is made to the description of the method embodiments for the relevant points, since they essentially correspond to the method embodiments. The apparatus embodiments described above are merely illustrative, wherein the elements illustrated as separate elements may or may not be physically separate, and the elements shown as elements may or may not be physical elements, may be located in one place, or may be distributed over a plurality of network elements. Some or all of the modules may be selected according to actual needs to achieve the purposes of the present invention. Those of ordinary skill in the art will understand and implement the present invention without undue burden.
The embodiment of the invention also provides electronic equipment corresponding to the path switching method provided by the embodiment, so as to execute the path switching method.
Fig. 5 is a hardware configuration diagram of an electronic device according to an exemplary embodiment of the present invention, the electronic device including: a communication interface 601, a processor 602, a memory 603 and a bus 604; wherein the communication interface 601, the processor 602 and the memory 603 perform communication with each other via a bus 604. The processor 602 may perform the path switching method described above by reading and executing machine executable instructions in the memory 603 corresponding to the control logic of the path switching method, the details of which are referred to in the above embodiments and will not be further described here.
The memory 603 referred to herein may be any electronic, magnetic, optical, or other physical storage device that may contain stored information, such as executable instructions, data, or the like. In particular, the memory 603 may be RAM (Random Access Memory ), flash memory, a storage drive (e.g., hard drive), any type of storage disk (e.g., optical disk, DVD, etc.), or a similar storage medium, or a combination thereof. The communication connection between the system network element and at least one other network element is achieved through at least one communication interface 601 (which may be wired or wireless), the internet, a wide area network, a local network, a metropolitan area network, etc. may be used.
The processor 602 may be an integrated circuit chip having signal processing capabilities. In implementation, the steps of the above method may be performed by integrated logic circuitry in hardware or instructions in software in the processor 602. The processor 602 may be a general-purpose processor, including a central processing unit (Central Processing Unit, CPU), a network processor (Network Processor, NP), etc.; but may also be a Digital Signal Processor (DSP), application Specific Integrated Circuit (ASIC), an off-the-shelf programmable gate array (FPGA) or other programmable logic device, discrete gate or transistor logic device, discrete hardware components. The disclosed methods, steps, and logic blocks in the embodiments of the present application may be implemented or performed. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like. The steps of a method disclosed in connection with the embodiments of the present application may be embodied directly in hardware, in a decoded processor, or in a combination of hardware and software modules in a decoded processor.
The electronic device provided by the embodiment of the application and the path switching method provided by the embodiment of the application are the same in the invention conception, and have the same beneficial effects as the method adopted, operated or realized by the electronic device.
The present embodiment also provides a computer readable storage medium corresponding to the path switching method provided in the foregoing embodiment, referring to fig. 6, the computer readable storage medium is shown as an optical disc 30, on which a computer program (i.e. a program product) is stored, where the computer program, when executed by a processor, performs the path switching method provided in any of the foregoing embodiments.
It should be noted that examples of the computer readable storage medium may also include, but are not limited to, a phase change memory (PRAM), a Static Random Access Memory (SRAM), a Dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), a Read Only Memory (ROM), an Electrically Erasable Programmable Read Only Memory (EEPROM), a flash memory, or other optical or magnetic storage medium, which will not be described in detail herein.
The computer readable storage medium provided by the above embodiments of the present application and the path switching method provided by the embodiments of the present application have the same advantageous effects as the method adopted, operated or implemented by the application program stored therein, because of the same inventive concept.
Other embodiments of the invention will be apparent to those skilled in the art from consideration of the specification and practice of the invention disclosed herein. This invention is intended to cover any variations, uses, or adaptations of the invention following, in general, the principles of the invention and including such departures from the present disclosure as come within known or customary practice within the art to which the invention pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the invention being indicated by the following claims.
It should also be noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article or apparatus that comprises the element.
The foregoing description of the preferred embodiments of the invention is not intended to be limiting, but rather to enable any modification, equivalent replacement, improvement or the like to be made within the spirit and principles of the invention.
Claims (14)
1. A method of path switching, the method comprising:
determining a first load state corresponding to the path of the storage node according to the received access request;
acquiring a second load state of other storage node paths belonging to the same virtual block storage equipment as the storage node path according to the first load state as a preset load state;
selecting a storage node path meeting preset conditions based on the first load state and the second load state;
the access request is processed based on the selected storage node path.
2. The method of claim 1, wherein determining the first load state of the storage node path based on the received access request comprises:
determining a logic unit LUN identification to be accessed according to the access request;
and determining a first load state of the storage node path corresponding to the LUN identification.
3. The method of claim 2, wherein the determining the first load state of the LUN-identified corresponding local storage node path comprises:
acquiring current load information of the storage node path corresponding to the LUN identification;
a first load state is determined based on the current load information.
4. A method according to claim 3, wherein the current load information comprises CPU occupancy, bandwidth occupancy, and storage occupancy;
the determining a first load state based on the current load information includes:
determining that the first load state is a normal state according to the CPU occupancy rate, the bandwidth occupancy rate and the storage occupancy rate are smaller than the lower limit value of the corresponding threshold range;
determining that the first load state is an abnormal state according to the fact that any one of the CPU occupancy rate, the bandwidth occupancy rate and the storage occupancy rate is larger than the upper limit value of the corresponding threshold range;
and determining that the first load state is a standby state according to the fact that the CPU occupancy rate, the bandwidth occupancy rate and the storage occupancy rate are not larger than the upper limit value of the corresponding threshold range and at least one of the CPU occupancy rate, the bandwidth occupancy rate and the storage occupancy rate is located in the corresponding threshold range.
5. The method of claim 4, wherein the predetermined load state according to the first load state comprises:
the first load state is an abnormal state or a standby state.
6. The method of claim 2, wherein the obtaining a second load state of other storage node paths belonging to the same virtual block storage device as the present storage node path comprises:
inquiring each storage node path corresponding to the LUN identification from a management and control system, wherein each storage node path comprises a storage node path and other storage node paths, the management and control system is responsible for managing a plurality of storage node paths corresponding to the same LUN identification, and storage nodes of each storage node path in the plurality of storage node paths are aggregated into a virtual block storage device;
and determining a second load state corresponding to the other storage node paths.
7. The method of claim 6, wherein determining the second load state corresponding to the other storage node path comprises:
inquiring a second load state corresponding to the other storage node paths from the management and control system, wherein the management and control system is also responsible for managing the load state of each storage node path; and/or the number of the groups of groups,
and inquiring a second load state corresponding to the other storage node paths from the other storage nodes corresponding to the other storage node paths.
8. The method of claim 1, wherein selecting a storage node path that meets a preset condition based on the first load state and the second load state comprises:
selecting a storage node path corresponding to a normal state according to the existence of the normal state in the first load state and the second load state;
and selecting a storage node path corresponding to the standby state according to the fact that the first load state and the second load state are not in the normal state but in the standby state.
9. The method of claim 1, wherein the processing the access request based on the selected storage node path comprises:
according to the selected storage node path as the storage node path, processing the access request through the storage node path;
and forwarding the access request to other storage nodes corresponding to other storage node paths according to the selected storage node path as the other storage node path.
10. A path switching apparatus for use with a storage node, the apparatus comprising:
the local path state determining module is used for determining a first load state corresponding to the path of the storage node according to the received access request;
the interconnection path state acquisition module acquires a second load state of other storage node paths belonging to the same virtual block storage device as the storage node path according to the first load state as a preset load state;
the path selection module is used for selecting a storage node path meeting preset conditions based on the first load state and the second load state;
and the request processing module is used for processing the access request based on the selected storage node path.
11. A distributed storage system, the system comprising a plurality of storage nodes and a management and control system;
the management and control system is configured to determine, from the plurality of storage nodes, a storage node path corresponding to the same logical unit LUN identifier, and store the storage node path, where the storage node path corresponding to the same LUN identifier is located, in order to aggregate the storage nodes into a virtual block storage device;
the storage node being adapted to perform the steps of the method according to any of claims 1-9.
12. The system of claim 11, wherein the management and control system is further configured to periodically obtain and store a load status of a storage node path corresponding to the same LUN identification.
13. An electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the processor executes the program to implement the steps of the method according to any one of claims 1-9.
14. A computer readable storage medium having stored thereon a computer program, wherein the program is executed by a processor to implement the steps of the method of any of claims 1-9.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211665520.5A CN116074326A (en) | 2022-12-23 | 2022-12-23 | Distributed storage system, path switching method and device, electronic equipment and medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211665520.5A CN116074326A (en) | 2022-12-23 | 2022-12-23 | Distributed storage system, path switching method and device, electronic equipment and medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN116074326A true CN116074326A (en) | 2023-05-05 |
Family
ID=86170876
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211665520.5A Pending CN116074326A (en) | 2022-12-23 | 2022-12-23 | Distributed storage system, path switching method and device, electronic equipment and medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116074326A (en) |
-
2022
- 2022-12-23 CN CN202211665520.5A patent/CN116074326A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8972773B2 (en) | Cache data processing using cache cluster with configurable modes | |
| US9430308B2 (en) | Operational status of network nodes | |
| US9916275B2 (en) | Preventing input/output (I/O) traffic overloading of an interconnect channel in a distributed data storage system | |
| US7970861B2 (en) | Load balancing in a distributed computing environment | |
| CN110365748B (en) | Service data processing method and device, storage medium and electronic device | |
| US10657119B1 (en) | Fleet node management system | |
| US9311066B1 (en) | Managing update deployment | |
| US20190158422A1 (en) | Analyzing resource placement fragmentation for capacity planning | |
| US10554520B2 (en) | Data path monitoring in a distributed storage network | |
| US10165048B2 (en) | Data copy storage method, terminal apparatus, and server apparatus | |
| US7680129B2 (en) | Preemptive retransmission of buffered data in a network | |
| JP6859340B2 (en) | Equipment, systems and methods for retrieving, processing and updating global information | |
| US10205775B2 (en) | Server selection in a highly available network | |
| US8239570B2 (en) | Using link send and receive information to select one of multiple links to use to transfer data for send and receive operations | |
| WO2018121456A1 (en) | Data storage method, server and storage system | |
| WO2015157706A2 (en) | Connectivity-aware storage controller load balancing | |
| US20150220438A1 (en) | Dynamic hot volume caching | |
| WO2016082078A1 (en) | Path management system, device and method | |
| US20220329522A1 (en) | Adaptive resilient network communication | |
| US20150378856A1 (en) | Storage system, storage device, control method and control program of storage device, management device, and control method and storage medium | |
| CN113794764A (en) | Request processing method and medium for server cluster and electronic device | |
| CN116074326A (en) | Distributed storage system, path switching method and device, electronic equipment and medium | |
| CN107491270B (en) | Resource access method and device of multi-control storage system | |
| JP7429792B2 (en) | Data transmission methods, terminals and computer-readable storage media | |
| CN116113011A (en) | Network connection method and device and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |