CN111464622A - Volume mapping processing method and device in distributed storage system - Google Patents
Volume mapping processing method and device in distributed storage system Download PDFInfo
- Publication number
- CN111464622A CN111464622A CN202010238541.3A CN202010238541A CN111464622A CN 111464622 A CN111464622 A CN 111464622A CN 202010238541 A CN202010238541 A CN 202010238541A CN 111464622 A CN111464622 A CN 111464622A
- Authority
- CN
- China
- Prior art keywords
- access path
- data
- gateway
- access
- storage system
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1097—Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L12/00—Data switching networks
- H04L12/66—Arrangements for connecting between networks having differing types of switching systems, e.g. gateways
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/14—Session management
- H04L67/141—Setup of application sessions
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a volume mapping processing method and device in a distributed storage system. Wherein, the method comprises the following steps: creating an access path; a plurality of devices of the distributed storage system are mapped to an access path to provide data interaction between the plurality of devices through the access path. The invention solves the technical problems of complicated gateway configuration process, large amount of repeated work and low efficiency in the distributed storage system in the related technology.
Description
Technical Field
The present invention relates to the field of data processing, and in particular, to a volume mapping processing method and apparatus in a distributed storage system.
Background
In a distributed storage system including a plurality of server nodes, there are generally a data node and a gateway node, where the data node is responsible for storing data, and the gateway node is responsible for providing an access interface such as iSCSI interface, FC interface, etc. to the outside, and an external device may be connected to the gateway node to access data in the distributed storage system. When a plurality of gateways are configured, the gateways need to be configured one by one, and the configuration steps of each gateway are the same, so that the configuration process is complicated, a large amount of repeated work is performed, and the efficiency is low.
In view of the above problems, no effective solution has been proposed.
Disclosure of Invention
The embodiment of the invention provides a volume mapping processing method and device in a distributed storage system, which are used for at least solving the technical problems of complex gateway configuration process, large amount of repeated work and low efficiency in the distributed storage system in the related technology.
According to an aspect of the embodiments of the present invention, there is provided a volume mapping processing method in a distributed storage system, including: creating an access path; mapping a plurality of devices of a distributed storage system to the access path to provide data interaction between the plurality of devices through the access path, wherein the devices comprise volumes of the distributed storage system.
Optionally, mapping a plurality of the devices of the distributed storage system to the access path to provide data interaction between the plurality of the devices through the access path includes: mapping a plurality of gateways in the distributed storage system to the access path to establish data connection between the access path and the plurality of gateways; mapping a plurality of volumes of the distributed storage system to the access path to establish data connections of the volumes with a plurality of the gateways through the access path.
Optionally, after mapping the plurality of devices of the distributed storage system to the access path to provide data interaction between the plurality of devices through the access path, the method further includes: mapping a plurality of clients to the access path to establish data connections of the plurality of clients and the plurality of gateways through the access path.
Optionally, mapping a plurality of gateways in the distributed storage system to the access path includes: and adding a plurality of gateways into the nodes of the access path, wherein the access path comprises a plurality of nodes, and the plurality of gateways respectively correspond to one node.
Optionally, mapping a plurality of gateways in the distributed storage system to the access path includes: opening a gateway service of a gateway to be used, wherein the gateway service comprises one of the following: and starting communication service, and configuring the identification of the node of the access path for the gateway.
Optionally, after mapping the plurality of volumes of the distributed storage system to the access path, the method includes: and sending the identity information of the plurality of volumes to the gateway which needs to be used through the access path so that the gateway accesses the volume corresponding to the identity information through the access path according to the identity information.
Optionally, after mapping the plurality of volumes of the distributed storage system to the access path, the method includes: and sending the information of the plurality of clients to the gateway which needs to be used through the access path, so that the gateway establishes data connection with the client corresponding to the information through the access path and the communication service.
According to another aspect of the embodiments of the present invention, there is also provided a data access method for a distributed storage system, including: receiving a data access request sent by a client through a created access path, wherein the client is mapped to the access path, and a plurality of clients are established in data connection with the access path; sending the data access request to a corresponding gateway through the access path, wherein a plurality of gateways are mapped to the access path, and establish data access between the access path and the plurality of gateways, and the plurality of gateways comprise the gateway corresponding to the access request; transmitting data sent by the gateway responding to the data access request to a volume corresponding to the data through the access path, wherein a plurality of volumes are mapped to the access path, and the data connection between the volumes and the gateway is established through the access path; sending the return data of the volume responding to the data to the gateway through the access path; and sending the return data received by the gateway to the client through the access path.
Optionally, receiving, by the created access path, the data access request sent by the client includes: receiving the data access request through a node corresponding to the gateway in the access path, wherein a plurality of gateways are added into the node of the access path, the access path comprises a plurality of nodes, and the plurality of gateways respectively correspond to one node; sending the data access request to a corresponding gateway through the access path comprises: sending the data access request to the gateway through the nodes of the access path.
According to another aspect of the embodiments of the present invention, there is also provided a volume mapping processing apparatus in a distributed storage system, including: a creation module for creating an access path; a mapping module for mapping a plurality of devices of the distributed storage system to the access path to provide data interaction between the plurality of devices through the access path, wherein the devices comprise volumes of the distributed storage system.
According to another aspect of the embodiments of the present invention, there is also provided a data access apparatus of a distributed storage system, including: the system comprises a receiving module, a sending module and a receiving module, wherein the receiving module is used for receiving a data access request sent by a client through a created access path, the client is mapped to the access path, the data connection between the client and the access path is established, and the number of the clients is multiple; a first sending module, configured to send the data access request to a corresponding gateway through the access path, where a plurality of gateways are mapped to the access path, and establish data access between the access path and the plurality of gateways, where the plurality of gateways include a gateway corresponding to the access request; a second sending module, configured to forward, through the access path, data sent by the gateway in response to the data access request to a volume corresponding to the data, where multiple volumes are mapped to the access path, and a data connection between the volume and the gateway is established through the access path; a third sending module, configured to send, to the gateway, the return data of the volume response to the data through the access path; and the fourth sending module is used for sending the return data received by the gateway to the client through the access path.
According to another aspect of the embodiments of the present invention, a storage medium is further provided, where the storage medium includes a stored program, and when the program runs, a device where the storage medium is located is controlled to execute the volume mapping processing method in the distributed storage system.
According to another aspect of the embodiments of the present invention, there is further provided a processor, where the processor is configured to execute a program, where the program executes to execute the volume mapping processing method in the distributed storage system according to any one of the above.
In the embodiment of the invention, the creation of an access path is adopted; the method comprises the steps of mapping a plurality of devices of the distributed storage system to an access path to provide data interaction among the devices through the access path, wherein the devices comprise volumes of the distributed storage system, and data connection is established among the devices in the distributed storage system through the access path, so that the aim of rapidly configuring the devices is fulfilled, the technical effects of simplifying a configuration process and improving efficiency are achieved, and the technical problems of complex gateway configuration process, large amount of repeated work and low efficiency in the distributed storage system in the related technology are solved.
Drawings
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this application, illustrate embodiment(s) of the invention and together with the description serve to explain the invention without limiting the invention. In the drawings:
FIG. 1 is a flow chart of a volume mapping processing method in a distributed storage system according to an embodiment of the present invention;
FIG. 2 is a flow chart of a method of data access for a distributed storage system according to an embodiment of the present invention;
FIG. 3 is a flow diagram of a gateway configuration for a prior art distributed storage system according to an embodiment of the present invention;
FIG. 4 is a schematic diagram of a prior art distributed storage system connected to a client, according to an embodiment of the present invention;
FIG. 5 is a flow diagram of a gateway configuration for a distributed storage system according to an embodiment of the present invention;
FIG. 6 is a schematic diagram of a distributed storage system connected to a client according to an embodiment of the present invention;
FIG. 7 is a schematic diagram of a volume map processing apparatus in a distributed storage system according to an embodiment of the present invention;
fig. 8 is a schematic diagram of a data access device of a distributed storage system according to an embodiment of the present invention.
Detailed Description
In order to make the technical solutions of the present invention better understood, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
It should be noted that the terms "first," "second," and the like in the description and claims of the present invention and in the drawings described above are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the invention described herein are capable of operation in sequences other than those illustrated or described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
Technical terms appearing in the present embodiment are explained and explained below.
The Access Path, is a concept in the distributed cluster proposed for the first time in this embodiment, and is a carrier that specifies that the Client can Access the target storage Volume through the Gateway servers, and is responsible for establishing a mapping relationship among the Client (Client), the storage Volume (Volume), and the Gateway servers (Gateway). There are 2 or more than 2 paths in one access path, and one path represents the mapping relationship between the client server and one gateway.
The Gateway refers to a Gateway server, and the cluster provides data access service to the outside through the Gateway.
Volume, logical entity that the user application stores data directly, provides elastic storage at the block device level.
The Client, can access the terminal of the storage system, can be connected to the gateway node through the ISCSI or FC protocol, and then access the data on the Volume in the storage.
iSCSI, Internet Small Computer System Interface, also known as IP-SAN, is a storage technology based on the Internet and SCSI-3 protocol.
L ocal SCSI, local SCSI interface.
FC, Fiber Channel, is a point-to-point, switched loop interface that stores externally provided data.
In accordance with an embodiment of the present invention, there is provided a method embodiment of a mapping process method in a distributed storage system, it should be noted that the steps illustrated in the flowchart of the accompanying drawings may be performed in a computer system such as a set of computer-executable instructions, and that while a logical order is illustrated in the flowchart, in some cases the steps illustrated or described may be performed in an order different than here.
Fig. 1 is a flowchart of a volume mapping processing method in a distributed storage system according to an embodiment of the present invention, and as shown in fig. 1, the method includes the following steps:
step S102, an access path is established;
step S104, mapping a plurality of devices of the distributed storage system to an access path so as to provide data interaction among the plurality of devices through the access path, wherein the devices comprise volumes of the distributed storage system.
Through the steps, the access path is created; the method comprises the steps of mapping a plurality of devices of the distributed storage system to an access path, establishing data connection among the devices in the distributed storage system through the access path in a mode of providing data interaction among the devices through the access path, and achieving the purpose of rapidly configuring the devices, thereby achieving the technical effects of simplifying a configuration process and improving efficiency, and further solving the technical problems of complex gateway configuration process, a large amount of repeated work and low efficiency in the distributed storage system in the related technology.
The distributed storage system may include a plurality of devices, data access is performed among the plurality of devices, and when the client performs the back-off of the distributed storage system, a required device needs to be configured, and data access is performed in the distributed storage system through the configured device. Therefore, a configuration device is required to be configured each time the client accesses the distributed storage system to realize data access, so that the process is complex, the steps are complex, and a large amount of repeated work is generated. Therefore, in this embodiment, an access path is created first, the multiple devices in the distributed storage system are mapped on the access path through the access path, and data connections of the multiple devices are established through the access path, so that the client can directly configure the relevant devices through the access path and directly obtain data through the access path.
Specifically, the plurality of devices of the distributed storage system may include a plurality of gateways and a volume, where the gateways are used to provide access services to devices outside the distributed storage system, such as the client. The volume may be a plurality of volumes, and the volumes are used to store different data.
Optionally, mapping the plurality of devices of the distributed storage system to the access path to provide data interaction between the plurality of devices through the access path includes: mapping a plurality of gateways in the distributed storage system to access paths to establish data connection between the access paths and the plurality of gateways; mapping a plurality of volumes of the distributed storage system to an access path to establish data connections of the volumes with a plurality of gateways through the access path.
And mapping the plurality of gateways to the access paths so as to establish data connection between the access paths and the plurality of gateways, sending the data access request to the access paths by the client, and automatically forwarding the data access request to the gateway corresponding to the data access request by the access paths. The number of the gateways is multiple, the gateways are all arranged in the access path, the client needs to use one gateway in one data access, and the data access request can include the identifier of the gateway needing to be used, so that the network hanger needing to be used is accessed according to the identifier, the configuration process of the gateway is simplified, and the data access efficiency is improved.
The type of the access path may be one of iSCSI, L ocal SCSI and FC 3 for both iSCSI and L ocal SCSI, an iqn (iSCSI qualified name) number is generated, and also an iSCSI ID name, according to the iqn number, a gateway may be added to the nodes of the scope root path.
The volume is mapped to the access path, the gateway is also mapped to the access path, data connection between the gateway and the volume is established through the access path, the gateway receives the data access request sent by the client, responds to the data access request to obtain data of the relevant volume, accordingly, the data corresponding to the data access request are obtained from the volume and sent to the client through the access path, and therefore the process of obtaining the data through the gateway is simplified, and the data access efficiency is improved.
Optionally, after mapping the plurality of devices of the distributed storage system to the access path to provide data interaction between the plurality of devices through the access path, the method further includes: and mapping the plurality of clients to the access path so as to establish data connection between the plurality of clients and the plurality of gateways through the access path.
The client is mapped to the access path, and the data connection between the client and the distributed storage system is established through the access path, specifically, the data connection between the gateway and the client is established, so that the client can conveniently send a data access request, and the data access efficiency is improved.
Optionally, mapping a plurality of gateways in the distributed storage system to the access path includes: adding a plurality of gateways into nodes of an access path, wherein the access path comprises a plurality of nodes, and the plurality of gateways respectively correspond to one node.
The plurality of gateways can be mapped to the access path in a mode that the gateways are added into the nodes of the access path, the access path comprises a plurality of nodes, the number of the nodes is more than or equal to that of the gateways, each gateway is guaranteed to have a corresponding node on the access path, the mapping relation between the nodes of the access path and the gateways is guaranteed, and then the data connection between the access path and the gateways is guaranteed to be established.
Optionally, after mapping a plurality of gateways in the distributed storage system to the access path, the method includes: opening a gateway service of a gateway to be used, wherein the gateway service comprises one of the following: communication services are initiated and the gateway is configured with the identity of the nodes of the access path.
The communication service starting comprises a communication function of a starting gateway, and the network manager can communicate through a plurality of communication protocols. The node may be identified as iqn. Therefore, the nodes of the access path can be accurately mapped with the gateway, and the accuracy and efficiency of data access are improved.
Optionally, after mapping the plurality of volumes of the distributed storage system to the access path, the method includes: and sending the identity information of the plurality of volumes to a gateway which needs to be used through the access path, so that the gateway accesses the volumes corresponding to the identity information through the access path according to the identity information.
The identity information of the volume can be ID information of the volume, and the corresponding volume is determined through the ID information, so that the volume is determined quickly and accurately, and the accuracy and efficiency of data access are ensured.
Optionally, after mapping the plurality of volumes of the distributed storage system to the access path, the method includes: and sending the information of the plurality of clients to a gateway to be used through the access path, so that the gateway establishes data connection with the client corresponding to the information through the access path and through the communication service.
Fig. 2 is a flowchart of a data access method of a distributed storage system according to an embodiment of the present invention, and as shown in fig. 2, according to another aspect of the embodiment of the present invention, there is also provided a data access method of a distributed storage system, including the following steps:
step S202, receiving a data access request sent by a client through the created access path, wherein the client is mapped to the access path, and data connection between the client and the access path is established, and the number of the clients is multiple;
step S204, sending the data access request to the corresponding gateways through the access paths, wherein the plurality of gateways are mapped to the access paths, the access paths and the data access of the plurality of gateways are established, and the plurality of gateways comprise the gateways corresponding to the access requests;
step S206, data sent by the gateway responding to the data access request is forwarded to the volume corresponding to the data through the access path, wherein a plurality of volumes are mapped to the access path, and the data connection between the volumes and the gateway is established through the access path;
step S208, sending the return data of the volume response data to the gateway through the access path;
step S210, sending the return data received by the gateway to the client through the access path.
Through the steps, a data access request sent by a client is received through the created access path, wherein the client is mapped to the access path, the data connection between the client and the access path is established, and the number of the clients is multiple; sending the data access request to corresponding gateways through access paths, wherein a plurality of gateways are mapped to the access paths, the access paths and the data access of the plurality of gateways are established, and the plurality of gateways comprise gateways corresponding to the access requests; transmitting data sent by the gateway responding to the data access request to a volume corresponding to the data through an access path, wherein a plurality of volumes are mapped to the access path, and the data connection between the volumes and the gateway is established through the access path; sending the return data of the volume response data to the gateway through the access path; the method comprises the steps of sending return data received by a gateway to a client through an access path, establishing data connection between a plurality of gateways and a plurality of volumes in a distributed storage system through the access path, and establishing data connection with the plurality of clients through a mapping mode, so that the aim of rapidly configuring the gateway is fulfilled, the technical effects of simplifying a configuration process and improving efficiency are achieved, and the technical problems of complex gateway configuration process, a large amount of repeated work and low efficiency in the distributed storage system in the related technology are solved.
Optionally, receiving, by the created access path, the data access request sent by the client includes: receiving a data access request through a node corresponding to a gateway in an access path, wherein a plurality of gateways are added into the node of the access path, the access path comprises a plurality of nodes, and the plurality of gateways respectively correspond to one node; sending the data access request to the corresponding gateway through the access path includes: and sending the data access request to the gateway through the nodes of the access path.
It should be noted that this embodiment also provides an alternative implementation, which is described in detail below.
Fig. 3 is a flowchart of a gateway configuration of a distributed storage system in the prior art according to an embodiment of the present invention, and as shown in fig. 3, the distributed storage system in this embodiment configures 2 gateways, mounts 2 volumes, and maps 3 clients, and a general configuration flow is as follows: selecting a machine as a gateway node 1; the iSCSI or FC service is started on the gateway node 1; mapping volume 1 and clients 1, 2, 3 on gateway node 1; mapping the volume 2 and the clients 1, 2, 3 on the gateway node 1; selecting a machine as a gateway node 2; starting iSCSI or FC service on the gateway node 2; mapping the volume 1 and the clients 1, 2, 3 on the gateway node 2; volume 2 and clients 1, 2, 3 are mapped on gateway node 2. It can be seen that the first 4 steps and the last 4 steps in the flowchart are almost the same flow, and if a gateway node is further added, the same 4 steps need to be repeated.
Fig. 4 is a schematic diagram of a prior art distributed storage system connected to clients according to an embodiment of the present invention, and the topology of the gateway, volume, and client map in the final cluster is shown in fig. 4.
As can be seen from the above description, 1, in the existing distributed storage system or cluster, each gateway node in the system needs to be configured and managed separately, and the configuration process is complicated. 2. If the number of gateways reaches 3 or more than 3, a large amount of repeated work is required. 3. The topology network mapped by the gateway, the volume and the client is messy and is not easy to manage. 4. When different protocols (such as ISSC, FC) are required to be supported, the service which cannot be communicated needs to be opened at the gateway, and the operation is complicated.
In the implementation process, the embodiment provides an access path, and the access path specifies which volume volumes in the system can be accessed by the client through which gateway nodes.
The access path can solve the following problems:
1. the complicated flow of gateway configuration, volume and client mapping is greatly simplified, especially when the number of the three resources is large.
2. The three topological structures are simplified, so that the disordered mesh structure is changed into a tree structure.
3. iSCSI, L ocal SCSI, FC 3 type interfaces may be provided simultaneously.
Client multipath access patterns may be automatically adapted.
The access path is a carrier for specifying which XDC gateways the client group can access the target storage volume through, and is responsible for establishing a mapping relation among the client group, the block storage volume and the gateway server.
The access path is responsible for establishing mapping relations among a Client (Client), a storage Volume (Volume) and a Gateway server (Gateway).
There are 2 or more than 2 paths in one access path, and one path represents the mapping relation between the client server and one gateway
Fig. 5 is a flowchart of gateway configuration of the distributed storage system according to the embodiment of the present invention, and as shown in fig. 5, after an access path exists, a mapping structure configuration process including 2 gateways, mounting 3 volumes, and mapping 3 clients is as follows:
creating an access path; adding the gateways 1 and 2 into an access path; mapping volumes 1, 2, 3 to access paths; clients 1, 2, 3 are mapped to access paths.
Detailed procedure explanation:
1. an access path is created, the type of access path may be one of iSCSI, L ocal SCSI, FC 3 for both iSCSI and L ocal SCSI, a iqn number is generated.
2. And adding a node which needs to provide access to the outside as a gateway into the access path, and after the node is successfully added, starting a gateway service on the selected node, wherein the service is responsible for starting an iscsi target end, configuring mapping of a client and a volume and the like. At this step, iqn generated at the previous step will be automatically configured on the target of all gateway nodes.
3. An access path to which the volume is mapped. After mapping the volume to the access path, the access path sends the volume information to the gateway node, and after receiving the volume information, the gateway service on the gateway node sets the lunID and other information of the volume.
4. After the configuration is completed, the client can access the data on the volume through an iSCSI, L ocal SCSI or FC interface.
Fig. 6 is a schematic diagram of a distributed storage system connected to a client according to an embodiment of the present invention, and a tree topology finally formed after an access path is provided is shown in fig. 6.
The embodiment provides an Access Path (Access Path) in a cluster, wherein the Access Path provides a method for centralized management of mapping relations among gateway nodes, volumes and clients in the cluster, greatly simplifies the operation process of similar products, can simultaneously support iSCSI, L cal SCSI and FC 3 protocol interfaces in one resource, only needs to start one gateway service, and other similar products need to be respectively started or configured, generates iqn by the Access Path, and distributes iqn to different nodes of the Access Path.
Compared with the prior art, in the step of establishing the access path, the embodiment can simultaneously add a plurality of gateways, a plurality of volumes and a plurality of clients, thereby greatly simplifying the configured operation flow, one access path can simultaneously support iSCSI, L ocalSCSI and FC 3 protocols, services do not need to be respectively started on each gateway node, and the access path ensures that the mapping topological structures of the gateways, the volumes and the clients become clear and is convenient for monitoring and management.
Fig. 7 is a schematic diagram of a volume mapping processing apparatus in a distributed storage system according to an embodiment of the present invention, and as shown in fig. 7, according to another aspect of the embodiment of the present invention, there is also provided a mapping processing apparatus in a distributed storage system, including: a creation module 72 and a mapping module 74, which are described in detail below.
A creation module 72 for creating an access path; and a mapping module 74, connected to the creating module 72, for mapping a plurality of devices of the distributed storage system to an access path to provide data interaction between the plurality of devices through the access path, wherein the devices include volumes of the distributed storage system.
Through the above devices, the creation module 72 is used to create the access path; the mapping module 74 maps the devices of the distributed storage system to the access path, and establishes data connection between the devices of the distributed storage system through the access path in a manner of providing data interaction between the devices through the access path, thereby achieving the purpose of rapidly configuring the devices, simplifying the configuration process, improving the technical effect of efficiency, and further solving the technical problems of tedious gateway configuration process, a large amount of repeated work and low efficiency in the distributed storage system in the related art.
Fig. 8 is a schematic diagram of a data access apparatus of a distributed storage system according to an embodiment of the present invention, and as shown in fig. 8, according to another aspect of the embodiment of the present invention, there is also provided a data access apparatus of a distributed storage system, including: a receiving module 802, a first sending module 804, a second sending module 806, a third sending module 808, and a fourth sending module 810. The apparatus is described in detail below.
A receiving module 802, configured to receive, through a created access path, a data access request sent by a client, where the client is mapped to the access path, and a plurality of clients are established in data connection with the access path; a first sending module 804, connected to the receiving module 802, configured to send a data access request to a corresponding gateway through an access path, where a plurality of gateways are mapped to the access path, and establish data access between the access path and the plurality of gateways, where the plurality of gateways include a gateway corresponding to the access request; a second sending module 806, connected to the first sending module 804, configured to forward data sent by the gateway in response to the data access request to a volume corresponding to the data through an access path, where multiple volumes are mapped to the access path, and a data connection between the volume and the gateway is established through the access path; a third sending module 808, connected to the second sending module 806, configured to send the return data of the volume response data to the gateway through the access path; and a fourth sending module 810, connected to the third sending module 808, configured to send the return data received by the gateway to the client through the access path.
By the device, a receiving module 802 is adopted to receive a data access request sent by a client through a created access path, wherein the client is mapped to the access path, and a plurality of clients are established in data connection with the access path; the first sending module 804 sends the data access request to the corresponding gateway through the access path, wherein the plurality of gateways are mapped to the access path, the access path and the data access of the plurality of gateways are established, and the plurality of gateways comprise the gateway corresponding to the access request; the second sending module 806 forwards the data sent by the gateway responding to the data access request to a volume corresponding to the data through an access path, where a plurality of volumes are mapped to the access path, and a data connection between the volume and the gateway is established through the access path; the third sending module 808 sends the return data of the volume response data to the gateway through the access path; the fourth sending module 810 sends the return data received by the gateway to the client through the access path, establishes data connection between the plurality of gateways and the plurality of volumes in the distributed storage system through the access path, and establishes data connection with the plurality of clients through a mapping manner, so that the purpose of rapidly configuring the gateway is achieved, the technical effects of simplifying the configuration process and improving the efficiency are achieved, and the technical problems of tedious gateway configuration process, a large amount of repeated work and low efficiency in the distributed storage system in the related art are solved.
According to another aspect of the embodiments of the present invention, there is also provided a storage medium, where the storage medium includes a stored program, and when the program runs, a device in which the storage medium is located is controlled to execute the mapping processing method in the distributed storage system in any one of the above.
According to another aspect of the embodiments of the present invention, there is also provided a processor, where the processor is configured to execute a program, where the program executes a mapping processing method in the distributed storage system according to any one of the foregoing embodiments.
The above-mentioned serial numbers of the embodiments of the present invention are merely for description and do not represent the merits of the embodiments.
In the above embodiments of the present invention, the descriptions of the respective embodiments have respective emphasis, and for parts that are not described in detail in a certain embodiment, reference may be made to related descriptions of other embodiments.
In the embodiments provided in the present application, it should be understood that the disclosed technology can be implemented in other ways. The above-described embodiments of the apparatus are merely illustrative, and for example, the division of the units may be a logical division, and in actual implementation, there may be another division, for example, multiple units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, units or modules, and may be in an electrical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.
The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a removable hard disk, a magnetic or optical disk, and other various media capable of storing program codes.
The foregoing is only a preferred embodiment of the present invention, and it should be noted that, for those skilled in the art, various modifications and decorations can be made without departing from the principle of the present invention, and these modifications and decorations should also be regarded as the protection scope of the present invention.
Claims (13)
1. A volume mapping processing method in a distributed storage system is characterized by comprising the following steps:
creating an access path;
mapping a plurality of devices of a distributed storage system to the access path to provide data interaction between the plurality of devices through the access path, wherein the devices comprise volumes of the distributed storage system.
2. The method of claim 1, wherein mapping the plurality of devices of the distributed storage system to the access path to provide data interaction between the plurality of devices through the access path comprises:
mapping a plurality of gateways in the distributed storage system to the access path to establish data connection between the access path and the plurality of gateways;
mapping a plurality of volumes of the distributed storage system to the access path to establish data connections of the volumes with a plurality of the gateways through the access path.
3. The method of claim 2, further comprising, after mapping the plurality of devices of the distributed storage system to the access path to provide data interaction between the plurality of devices via the access path:
mapping a plurality of clients to the access path to establish data connections of the plurality of clients and the plurality of gateways through the access path.
4. The method of claim 3, wherein mapping the plurality of gateways in the distributed storage system to the access path comprises:
and adding a plurality of gateways into the nodes of the access path, wherein the access path comprises a plurality of nodes, and the plurality of gateways respectively correspond to one node.
5. The method of claim 4, wherein mapping the plurality of gateways in the distributed storage system to the access path comprises:
opening a gateway service of a gateway to be used, wherein the gateway service comprises one of the following: and starting communication service, and configuring the identification of the node of the access path for the gateway.
6. The method of claim 5, wherein mapping the plurality of volumes of the distributed storage system to the access path comprises:
and sending the identity information of the plurality of volumes to the gateway which needs to be used through the access path so that the gateway accesses the volume corresponding to the identity information through the access path according to the identity information.
7. The method of claim 5, wherein mapping the plurality of volumes of the distributed storage system to the access path comprises:
and sending the information of the plurality of clients to the gateway which needs to be used through the access path, so that the gateway establishes data connection with the client corresponding to the information through the access path and the communication service.
8. A data access method for a distributed storage system, comprising:
receiving a data access request sent by a client through a created access path, wherein the client is mapped to the access path, and a plurality of clients are established in data connection with the access path;
sending the data access request to a corresponding gateway through the access path, wherein a plurality of gateways are mapped to the access path, and establish data access between the access path and the plurality of gateways, and the plurality of gateways comprise the gateway corresponding to the access request;
transmitting data sent by the gateway responding to the data access request to a volume corresponding to the data through the access path, wherein a plurality of volumes are mapped to the access path, and the data connection between the volumes and the gateway is established through the access path;
sending the return data of the volume responding to the data to the gateway through the access path;
and sending the return data received by the gateway to the client through the access path.
9. The method of claim 8, wherein receiving the data access request sent by the client through the created access path comprises:
receiving the data access request through a node corresponding to the gateway in the access path, wherein a plurality of gateways are added into the node of the access path, the access path comprises a plurality of nodes, and the plurality of gateways respectively correspond to one node;
sending the data access request to a corresponding gateway through the access path comprises:
sending the data access request to the gateway through the nodes of the access path.
10. A volume mapping processing apparatus in a distributed storage system, comprising:
a creation module for creating an access path;
a mapping module for mapping a plurality of devices of the distributed storage system to the access path to provide data interaction between the plurality of devices through the access path, wherein the devices comprise volumes of the distributed storage system.
11. A data access apparatus of a distributed storage system, comprising:
the system comprises a receiving module, a sending module and a receiving module, wherein the receiving module is used for receiving a data access request sent by a client through a created access path, the client is mapped to the access path, the data connection between the client and the access path is established, and the number of the clients is multiple;
a first sending module, configured to send the data access request to a corresponding gateway through the access path, where a plurality of gateways are mapped to the access path, and establish data access between the access path and the plurality of gateways, where the plurality of gateways include a gateway corresponding to the access request;
a second sending module, configured to forward, through the access path, data sent by the gateway in response to the data access request to a volume corresponding to the data, where multiple volumes are mapped to the access path, and a data connection between the volume and the gateway is established through the access path;
a third sending module, configured to send, to the gateway, the return data of the volume response to the data through the access path;
and the fourth sending module is used for sending the return data received by the gateway to the client through the access path.
12. A storage medium, characterized in that the storage medium includes a stored program, and when the program runs, a device in which the storage medium is located is controlled to execute the volume mapping processing method in the distributed storage system according to any one of claims 1 to 7.
13. A processor, configured to execute a program, wherein the program executes to perform the volume mapping processing method in the distributed storage system according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010238541.3A CN111464622B (en) | 2020-03-30 | 2020-03-30 | Volume mapping processing method and device in distributed storage system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010238541.3A CN111464622B (en) | 2020-03-30 | 2020-03-30 | Volume mapping processing method and device in distributed storage system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111464622A true CN111464622A (en) | 2020-07-28 |
| CN111464622B CN111464622B (en) | 2023-07-14 |
Family
ID=71685074
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010238541.3A Active CN111464622B (en) | 2020-03-30 | 2020-03-30 | Volume mapping processing method and device in distributed storage system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111464622B (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112087517A (en) * | 2020-09-10 | 2020-12-15 | 星辰天合（北京）数据科技有限公司 | Processing method and processing device for storage cluster and electronic equipment |
| CN112395264A (en) * | 2020-11-26 | 2021-02-23 | 深圳市杉岩数据技术有限公司 | Processing method for mapping between logical target and volume in distributed storage system |
| CN113568753A (en) * | 2021-07-30 | 2021-10-29 | 北京天融信网络安全技术有限公司 | Access path determining method and device, electronic equipment and readable storage medium |
| CN113630450A (en) * | 2021-07-26 | 2021-11-09 | 深圳市杉岩数据技术有限公司 | Access control method of distributed storage system and distributed storage system |
Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20060277383A1 (en) * | 2005-06-03 | 2006-12-07 | Lefthand Networks, Inc. | System for Providing Multi-path Input/Output in a Clustered Data Storage Network |
| EP1962178A2 (en) * | 2007-02-23 | 2008-08-27 | Hitachi, Ltd. | Storage system and management method thereof |
| CN203299803U (en) * | 2013-06-05 | 2013-11-20 | 南京信核数据科技有限公司 | Multi-path read-write system |
| US20140047139A1 (en) * | 2012-08-09 | 2014-02-13 | Hitachi, Ltd. | Method and apparatus to migrate existing data among storage systems |
| CN103765406A (en) * | 2011-06-30 | 2014-04-30 | 亚马逊科技公司 | Methods and apparatus for remotely updating executing processes |
| CN103930879A (en) * | 2011-06-30 | 2014-07-16 | 亚马逊科技公司 | Shadowing storage gateway |
| US8793343B1 (en) * | 2011-08-18 | 2014-07-29 | Amazon Technologies, Inc. | Redundant storage gateways |
| WO2014141466A1 (en) * | 2013-03-15 | 2014-09-18 | 株式会社日立製作所 | Computer system |
| CN106168884A (en) * | 2011-08-26 | 2016-11-30 | 威睿公司 | Access the computer system of object storage system |
| CN106293501A (en) * | 2015-06-25 | 2017-01-04 | 中兴通讯股份有限公司 | Data read-write method and device |
| CN109672714A (en) * | 2017-10-17 | 2019-04-23 | 中移(苏州)软件技术有限公司 | A kind of data processing method and distributed memory system of distributed memory system |
| CN109981768A (en) * | 2019-03-21 | 2019-07-05 | 上海霄云信息科技有限公司 | I/o multipath planning method and equipment in distributed network storage system |
| CN110351099A (en) * | 2018-04-04 | 2019-10-18 | 柯尼卡美能达株式会社 | Communication system, Platform Server and computer-readable recording medium |
-
2020
- 2020-03-30 CN CN202010238541.3A patent/CN111464622B/en active Active
Patent Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20060277383A1 (en) * | 2005-06-03 | 2006-12-07 | Lefthand Networks, Inc. | System for Providing Multi-path Input/Output in a Clustered Data Storage Network |
| EP1962178A2 (en) * | 2007-02-23 | 2008-08-27 | Hitachi, Ltd. | Storage system and management method thereof |
| CN103765406A (en) * | 2011-06-30 | 2014-04-30 | 亚马逊科技公司 | Methods and apparatus for remotely updating executing processes |
| CN103930879A (en) * | 2011-06-30 | 2014-07-16 | 亚马逊科技公司 | Shadowing storage gateway |
| US8793343B1 (en) * | 2011-08-18 | 2014-07-29 | Amazon Technologies, Inc. | Redundant storage gateways |
| CN106168884A (en) * | 2011-08-26 | 2016-11-30 | 威睿公司 | Access the computer system of object storage system |
| US20140047139A1 (en) * | 2012-08-09 | 2014-02-13 | Hitachi, Ltd. | Method and apparatus to migrate existing data among storage systems |
| WO2014141466A1 (en) * | 2013-03-15 | 2014-09-18 | 株式会社日立製作所 | Computer system |
| CN203299803U (en) * | 2013-06-05 | 2013-11-20 | 南京信核数据科技有限公司 | Multi-path read-write system |
| CN106293501A (en) * | 2015-06-25 | 2017-01-04 | 中兴通讯股份有限公司 | Data read-write method and device |
| CN109672714A (en) * | 2017-10-17 | 2019-04-23 | 中移(苏州)软件技术有限公司 | A kind of data processing method and distributed memory system of distributed memory system |
| CN110351099A (en) * | 2018-04-04 | 2019-10-18 | 柯尼卡美能达株式会社 | Communication system, Platform Server and computer-readable recording medium |
| CN109981768A (en) * | 2019-03-21 | 2019-07-05 | 上海霄云信息科技有限公司 | I/o multipath planning method and equipment in distributed network storage system |
Non-Patent Citations (2)
| Title |
|---|
| JOSHUA HARE等: "Transparent flow migration through splicing for multi-homed vehicular Internet gateways", 《2013 IEEE VEHICULAR NETWORKING CONFERENCE》 * |
| 肖瑶等: "一种GRID路由协议的网关选取方法", 《电视技术》 * |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112087517A (en) * | 2020-09-10 | 2020-12-15 | 星辰天合（北京）数据科技有限公司 | Processing method and processing device for storage cluster and electronic equipment |
| CN112087517B (en) * | 2020-09-10 | 2023-10-27 | 北京星辰天合科技股份有限公司 | Storage cluster processing method and processing device and electronic equipment |
| CN112395264A (en) * | 2020-11-26 | 2021-02-23 | 深圳市杉岩数据技术有限公司 | Processing method for mapping between logical target and volume in distributed storage system |
| CN112395264B (en) * | 2020-11-26 | 2024-05-28 | 深圳市杉岩数据技术有限公司 | Processing method for mapping between logical targets and volumes in distributed storage system |
| CN113630450A (en) * | 2021-07-26 | 2021-11-09 | 深圳市杉岩数据技术有限公司 | Access control method of distributed storage system and distributed storage system |
| CN113630450B (en) * | 2021-07-26 | 2024-03-15 | 深圳市杉岩数据技术有限公司 | Access control method of distributed storage system and distributed storage system |
| CN113568753A (en) * | 2021-07-30 | 2021-10-29 | 北京天融信网络安全技术有限公司 | Access path determining method and device, electronic equipment and readable storage medium |
| CN113568753B (en) * | 2021-07-30 | 2024-02-09 | 北京天融信网络安全技术有限公司 | Access path determination method, device, electronic equipment and readable storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111464622B (en) | 2023-07-14 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111464622B (en) | Volume mapping processing method and device in distributed storage system | |
| CN109218047B (en) | Network slice processing method and device, communication system and storage medium | |
| EP3905598B1 (en) | Message processing method and apparatus, control plane device, and computer storage medium | |
| CN107710196B (en) | Method and system for managing resource object | |
| CN110635987B (en) | Message transmission method, device, equipment and machine readable storage medium | |
| CN109561054B (en) | Data transmission method, controller and access device | |
| CN103795768B (en) | The method and apparatus of remote access | |
| WO2018218977A1 (en) | Method for orchestrating software defined network, and sdn controller | |
| CN110580256A (en) | Method, device and system for identifying application identifier | |
| EP3229413B1 (en) | Cross-domain cooperative method, cooperative device and control device for network as a service business | |
| WO2018024121A1 (en) | Network function (nf) management method and nf management device | |
| WO2015143794A1 (en) | Creating and upgrading methods, server, terminal, upgrading system, and storage media | |
| CN109391969A (en) | Network management and system | |
| CN110519348A (en) | A kind of mostly service distributed type assemblies deployment system and method | |
| CN106713493A (en) | System and method for constructing distributed file system in cluster environment | |
| CN112583628A (en) | Method and system for calling core network capability | |
| US20220060560A1 (en) | Cloud communication method and apparatus | |
| CN113645304A (en) | Data service processing method and related equipment | |
| CN111585786A (en) | Realization of secret-free building method of big data cluster | |
| CN105071965B (en) | A kind of management system of the network equipment | |
| CN103997479A (en) | Asymmetric service IP proxy method and equipment | |
| CN106911769B (en) | Cloud platform routing data processing method and physical server of cloud platform | |
| CN102833287B (en) | The method of visit data resource in distributed file system and distributed file system | |
| CN106330492B (en) | A kind of method, apparatus and system configuring user equipment forwarding table | |
| CN109962834B (en) | Information processing method, system, terminal and computer storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information |
Address after: 100094 101, floors 1-5, building 7, courtyard 3, fengxiu Middle Road, Haidian District, Beijing Applicant after: Beijing Xingchen Tianhe Technology Co.,Ltd. Address before: 100097 room 806-1, block B, zone 2, Jinyuan times shopping center, indigo factory, Haidian District, Beijing Applicant before: XSKY BEIJING DATA TECHNOLOGY Corp.,Ltd. |
|
| CB02 | Change of applicant information | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |