CN111464622B - Volume mapping processing method and device in distributed storage system - Google Patents
Volume mapping processing method and device in distributed storage system Download PDFInfo
- Publication number
- CN111464622B CN111464622B CN202010238541.3A CN202010238541A CN111464622B CN 111464622 B CN111464622 B CN 111464622B CN 202010238541 A CN202010238541 A CN 202010238541A CN 111464622 B CN111464622 B CN 111464622B
- Authority
- CN
- China
- Prior art keywords
- access path
- access
- gateways
- gateway
- data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1097—Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L12/00—Data switching networks
- H04L12/66—Arrangements for connecting between networks having differing types of switching systems, e.g. gateways
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/14—Session management
- H04L67/141—Setup of application sessions
Abstract
The invention discloses a volume mapping processing method and device in a distributed storage system. Wherein the method comprises the following steps: creating an access path; the plurality of devices of the distributed storage system are mapped to the access path to provide data interactions between the plurality of devices through the access path. The invention solves the technical problems of complex gateway configuration process, a large number of repeated operations and low efficiency in the distributed storage system in the related technology.
Description
Technical Field
The present invention relates to the field of data processing, and in particular, to a method and apparatus for processing volume mapping in a distributed storage system.
Background
In a distributed storage system comprising a plurality of server nodes, there will generally be data nodes and gateway nodes, where the data nodes are responsible for storing data, and the gateway nodes are responsible for providing external access interfaces, such as iSCSI, FC interfaces, etc., and external devices may connect to the gateway nodes to access the data in the distributed storage system. When a plurality of gateways are configured, the gateways are required to be configured one by one, and the configuration steps of each gateway are the same, so that the configuration process is complicated, a large number of repeated operations are performed, and the efficiency is low.
In view of the above problems, no effective solution has been proposed at present.
Disclosure of Invention
The embodiment of the invention provides a volume mapping processing method and device in a distributed storage system, which at least solve the technical problems of complex gateway configuration process, a large number of repeated operations and low efficiency in the distributed storage system in the related technology.
According to an aspect of an embodiment of the present invention, there is provided a volume mapping processing method in a distributed storage system, including: creating an access path; mapping a plurality of devices of a distributed storage system to the access path to provide data interactions between the plurality of devices through the access path, wherein the devices comprise volumes of the distributed storage system.
Optionally, mapping the plurality of devices of the distributed storage system to the access path to provide data interaction between the plurality of devices through the access path includes: mapping a plurality of gateways in the distributed storage system to the access paths to establish data connections of the access paths with the plurality of gateways; mapping a plurality of volumes of the distributed storage system to the access path to establish data connections of the volumes with a plurality of the gateways through the access path.
Optionally, after mapping the plurality of devices of the distributed storage system to the access path to provide data interaction between the plurality of devices through the access path, the method further includes: mapping a plurality of clients to the access path to establish data connections of the plurality of clients with the plurality of gateways through the access path.
Optionally, mapping the plurality of gateways in the distributed storage system to the access path includes: and adding a plurality of gateways into nodes of the access path, wherein the access path comprises a plurality of nodes, and the gateways respectively correspond to one node.
Optionally, after mapping the plurality of gateways in the distributed storage system to the access paths, the method includes: opening a gateway service of a gateway to be used, wherein the gateway service comprises one of the following components: and starting communication service, and configuring the identification of the node of the access path for the gateway.
Optionally, after mapping the plurality of volumes of the distributed storage system to the access paths, the method includes: and sending the identity information of the volumes to the gateway to be used through the access path, so that the gateway accesses the volumes corresponding to the identity information through the access path according to the identity information.
Optionally, after mapping the plurality of volumes of the distributed storage system to the access path, the method includes: and sending the information of a plurality of clients to the gateway to be used through the access path, so that the gateway establishes data connection through the communication service through the clients corresponding to the information through the access path.
According to another aspect of the embodiment of the present invention, there is also provided a data access method of a distributed storage system, including: receiving a data access request sent by a client through a created access path, wherein the client is mapped to the access path, and data connection between the client and the access path is established, and the number of the clients is multiple; sending the data access request to a corresponding gateway through the access path, wherein a plurality of gateways are mapped to the access path, data access between the access path and the gateways is established, and the gateways comprise the gateways corresponding to the access request; forwarding data sent by the gateway in response to the data access request to a volume corresponding to the data through the access path, wherein a plurality of volumes are mapped to the access path, and data connection between the volumes and the gateway is established through the access path; sending the returned data of the volume responding to the data to the gateway through the access path; and sending the return data received by the gateway to the client through the access path.
Optionally, receiving the data access request sent by the client through the created access path includes: receiving the data access request through a node corresponding to the gateway in the access path, wherein a plurality of gateways are added into the node of the access path, the access path comprises a plurality of nodes, and the gateways respectively correspond to one node; sending the data access request to the corresponding gateway through the access path includes: and sending the data access request to the gateway through the node of the access path.
According to another aspect of the embodiment of the present invention, there is also provided a volume mapping processing apparatus in a distributed storage system, including: the creation module is used for creating an access path; a mapping module for mapping a plurality of devices of the distributed storage system to the access path to provide data interactions between the plurality of devices through the access path, wherein the devices comprise volumes of the distributed storage system.
According to another aspect of the embodiment of the present invention, there is also provided a data access apparatus of a distributed storage system, including: the receiving module is used for receiving a data access request sent by a client through the created access path, wherein the client is mapped to the access path, and data connection between the client and the access path is established, and the number of the clients is multiple; the first sending module is used for sending the data access request to a corresponding gateway through the access path, wherein a plurality of gateways are mapped to the access path, the data access of the access path and the gateways is established, and the gateways comprise the gateways corresponding to the access request; the second sending module is used for forwarding data sent by the gateway in response to the data access request to a volume corresponding to the data through the access path, wherein a plurality of volumes are mapped to the access path, and data connection between the volumes and the gateway is established through the access path; a third sending module, configured to send, to the gateway, returned data of the volume in response to the data through the access path; and the fourth sending module is used for sending the return data received by the gateway to the client through the access path.
According to another aspect of the embodiments of the present invention, there is further provided a storage medium, where the storage medium includes a stored program, and when the program runs, the device where the storage medium is controlled to execute the volume mapping processing method in the distributed storage system according to any one of the foregoing methods.
According to another aspect of the embodiments of the present invention, there is further provided a processor, where the processor is configured to execute a program, where the program executes any one of the above methods for volume mapping processing in a distributed storage system.
In the embodiment of the invention, the creation of an access path is adopted; the method comprises the steps of mapping a plurality of devices of the distributed storage system to an access path to provide data interaction among the plurality of devices through the access path, wherein the devices comprise volumes of the distributed storage system, and establishing data connection among the plurality of devices in the distributed storage system through the access path, so that the aim of rapidly configuring the plurality of devices is fulfilled, the configuration process is simplified, the technical effect of improving the efficiency is realized, and the technical problems of complex gateway configuration process, a large number of repeated operations and low efficiency in the distributed storage system in the related art are solved.
Drawings
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this application, illustrate embodiments of the invention and together with the description serve to explain the invention and do not constitute a limitation on the invention. In the drawings:
FIG. 1 is a flow chart of a method of volume mapping processing in a distributed storage system according to an embodiment of the present invention;
FIG. 2 is a flow chart of a method of data access for a distributed storage system according to an embodiment of the present invention;
FIG. 3 is a flow chart of a gateway configuration of a prior art distributed storage system according to an embodiment of the present invention;
FIG. 4 is a schematic diagram of a prior art distributed storage system connected to a client according to an embodiment of the present invention;
FIG. 5 is a flow chart of a gateway configuration of a distributed storage system according to an embodiment of the present invention;
FIG. 6 is a schematic diagram of a distributed storage system connected to clients according to an embodiment of the present invention;
FIG. 7 is a schematic diagram of a volume mapping processing apparatus in a distributed storage system according to an embodiment of the present invention;
fig. 8 is a schematic diagram of a data access apparatus of a distributed storage system according to an embodiment of the present invention.
Detailed Description
In order that those skilled in the art will better understand the present invention, a technical solution in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in which it is apparent that the described embodiments are only some embodiments of the present invention, not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the present invention without making any inventive effort, shall fall within the scope of the present invention.
It should be noted that the terms "first," "second," and the like in the description and the claims of the present invention and the above figures are used for distinguishing between similar objects and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used may be interchanged where appropriate such that the embodiments of the invention described herein may be implemented in sequences other than those illustrated or otherwise described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
Technical terms appearing in this embodiment are explained and explained below.
The Access Path, is the first proposed concept in the distributed cluster in this embodiment, and is a carrier that designates that clients can Access the target storage Volume through those Gateway servers, and is responsible for establishing a mapping relationship among the clients (clients), the storage volumes (volumes), and the Gateway servers (Gateway). There are 2 or more paths in one access path, one path representing the mapping relationship of the client server and one gateway.
Gateway, means Gateway server, the cluster provides data access service to outside through Gateway.
Volume, logical entity that the user application directly stores data, provides for block device-level elastic storage.
The Client, can access the terminals of the storage system, can connect to the gateway node through ISCSI or FC protocol, and then access the data on the Volume in storage.
iSCSI, internet Small Computer System Interface Internet Small computer System interface, also known as IP-SAN, is a storage technology based on the Internet and SCSI-3 protocols.
Local SCSI, local SCSI interface.
FC, fiber Channel, fibre Channel, is a point-to-point, switched loop interface that stores the provisioning externally.
According to an embodiment of the present invention, there is provided a method embodiment of a mapping processing method in a distributed storage system, it should be noted that, the steps illustrated in the flowchart of the drawings may be performed in a computer system such as a set of computer executable instructions, and, although a logical order is illustrated in the flowchart, in some cases, the steps illustrated or described may be performed in an order different from that herein.
FIG. 1 is a flow chart of a volume mapping processing method in a distributed storage system according to an embodiment of the present invention, as shown in FIG. 1, the method includes the steps of:
step S102, creating an access path;
step S104, mapping a plurality of devices of the distributed storage system to an access path to provide data interaction between the plurality of devices through the access path, wherein the devices comprise volumes of the distributed storage system.
Through the steps, an access path is created; the method comprises the steps of mapping a plurality of devices of the distributed storage system to an access path, establishing data connection between the plurality of devices in the distributed storage system through the access path in a mode of providing data interaction among the plurality of devices through the access path, and achieving the purpose of rapidly configuring the plurality of devices, thereby realizing the technical effects of simplifying the configuration process and improving the efficiency, and further solving the technical problems of complicated gateway configuration process, a large number of repeated operations and low efficiency in the distributed storage system in the related art.
The distributed storage system may include a plurality of devices, and when the client side needs to configure the required devices in the distributed storage system according to Fan Genshang, the data access is performed in the distributed storage system through the configured devices. Therefore, each time the client accesses the distributed storage system, the configuration device is needed to realize data access, the process is complex, the steps are complex, and a large amount of repeated work is generated. Therefore, in this embodiment, an access path is created first, a plurality of devices in the distributed storage system are mapped on the access path through the access path, and data connection of the plurality of devices is established through the access path, so that the client can directly configure related devices through the access path, and directly acquire data through the access path.
In particular, the plurality of devices of the distributed storage system may include a gateway and a volume, where the gateway may be a plurality of gateways, and the gateway is configured to provide access services to devices outside the distributed storage system, such as the client. The volume may be plural and the volume is used to store different data.
Optionally, mapping the plurality of devices of the distributed storage system to the access path to provide data interaction between the plurality of devices through the access path includes: mapping a plurality of gateways in the distributed storage system to the access paths to establish data connections of the access paths with the plurality of gateways; a plurality of volumes of the distributed storage system are mapped to the access paths to establish data connections of the volumes with the plurality of gateways through the access paths.
Mapping the plurality of gateways to access paths, thereby establishing data connection between the access paths and the plurality of gateways, sending a data access request to the access paths by the client, and automatically forwarding the data access request to the gateway corresponding to the data access request by the access paths. The plurality of gateways are arranged in the access path, one gateway is needed to be used in one data access of the client, and the data access request can comprise the identification of the gateway to be used, so that the network hanger to be used is accessed according to the identification, the configuration process of the gateway is simplified, and the data access efficiency is improved.
The type of the access path may be one of iSCSI, local SCSI, FC 3. For both iSCSI and Local SCSI types, a iqn (iSCSI qualified name) number will be generated, which is also an iSCSI identifier. A gateway according to iqn may be added to the nodes of the root path of the scope.
The volume is mapped to the access path, the gateway is also mapped to the access path, and then the data connection between the gateway and the volume is established through the access path, the gateway receives the data access request sent by the client, and responds to the data access request to acquire the data of the related volume, so that the data corresponding to the data access request is acquired from the volume, and is sent to the client through the access path, thereby simplifying the process of acquiring the data by the gateway and further improving the data access efficiency.
Optionally, after mapping the plurality of devices of the distributed storage system to the access path to provide data interaction between the plurality of devices through the access path, further comprising: the plurality of clients are mapped to the access path to establish data connections of the plurality of clients with the plurality of gateways through the access path.
The client is mapped to the access path, the data connection between the client and the distributed storage system is established through the access path, and specifically, the data connection between the gateway and the client is established, so that the client can conveniently send the data access request, and the data access efficiency is improved.
Optionally, mapping the plurality of gateways in the distributed storage system to the access paths includes: and adding a plurality of gateways into the nodes of the access path, wherein the access path comprises a plurality of nodes, and the plurality of gateways respectively correspond to one node.
The plurality of gateways can be mapped to the access path by adding the gateway into the nodes of the access path, the access path comprises a plurality of nodes, the number of the nodes is more than or equal to that of the gateways, each gateway is guaranteed to have corresponding nodes on the access path, the mapping relation between the nodes of the access path and the gateways is guaranteed, and further the data connection between the access path and the gateways is guaranteed to be established.
Optionally, after mapping the plurality of gateways in the distributed storage system to the access paths, the method includes: opening a gateway service of a gateway to be used, wherein the gateway service comprises one of the following: and starting communication service, and configuring the identification of the node of the access path for the gateway.
The communication service is started, including the communication function of the starting gateway, and the network manager can communicate through a plurality of communication protocols. The node may be identified by the iqn number. Therefore, the nodes of the access path can be ensured to be accurately mapped with the gateway, and the accuracy and the efficiency of data access are further improved.
Optionally, after mapping the plurality of volumes of the distributed storage system to the access paths, the method includes: and sending the identity information of the plurality of volumes to a gateway to be used through the access path, so that the gateway accesses the volumes corresponding to the identity information through the access path according to the identity information.
The identity information of the volume can be the ID information of the volume, and the corresponding volume is determined through the ID information, so that the volume is rapidly and accurately determined, and the accuracy and the efficiency of data access are ensured.
Optionally, after mapping the plurality of volumes of the distributed storage system to the access paths, the method includes: and sending the information of the plurality of clients to a gateway to be used through the access path, so that the gateway establishes data connection through the communication service through the client corresponding to the information through the access path.
Fig. 2 is a flowchart of a data access method of a distributed storage system according to an embodiment of the present invention, and as shown in fig. 2, according to another aspect of an embodiment of the present invention, there is also provided a data access method of a distributed storage system, including the steps of:
step S202, receiving a data access request sent by a client through a created access path, wherein the client is mapped to the access path, and data connection between the client and the access path is established, and the number of the clients is multiple;
step S204, sending the data access request to the corresponding gateway through the access path, wherein a plurality of gateways are mapped to the access path, establishing the access path and the data access of the plurality of gateways, and the plurality of gateways comprise the gateway corresponding to the access request;
step S206, forwarding the data sent by the gateway in response to the data access request to the volume corresponding to the data through the access path, wherein a plurality of volumes are mapped to the access path, and the data connection between the volumes and the gateway is established through the access path;
step S208, sending the returned data of the volume response data to the gateway through the access path;
step S210, the return data received by the gateway is sent to the client through the access path.
Through the steps, the data access request sent by the client is received through the created access path, wherein the client is mapped to the access path, the data connection between the client and the access path is established, and the number of the clients is multiple; transmitting the data access request to the corresponding gateway through the access path, wherein the plurality of gateways are mapped to the access path, the access path and the data access of the plurality of gateways are established, and the plurality of gateways comprise the gateway corresponding to the access request; forwarding data sent by the gateway in response to the data access request to a volume corresponding to the data through an access path, wherein a plurality of volumes are mapped to the access path, and data connection between the volumes and the gateway is established through the access path; sending the returned data of the volume response data to the gateway through the access path; the method comprises the steps of sending returned data received by a gateway to a client through an access path, establishing data connection between a plurality of gateways and a plurality of volumes in a distributed storage system through the access path, and establishing data connection with a plurality of clients through a mapping mode, so that the purpose of rapidly configuring the gateway is achieved, the technical effects of simplifying the configuration process and improving the efficiency are achieved, and the technical problems of complicated gateway configuration process, a large number of repeated operations and low efficiency in the distributed storage system in the related art are solved.
Optionally, receiving the data access request sent by the client through the created access path includes: receiving a data access request through a node corresponding to a gateway in an access path, wherein a plurality of gateways are added into the node of the access path, the access path comprises a plurality of nodes, and the plurality of gateways correspond to one node respectively; sending the data access request to the corresponding gateway via the access path comprises: the data access request is sent to the gateway through the node of the access path.
It should be noted that this embodiment also provides an alternative implementation, and this implementation is described in detail below.
Fig. 3 is a flowchart of gateway configuration of a distributed storage system according to the prior art according to an embodiment of the present invention, and as shown in fig. 3, the distributed storage system of the present embodiment configures 2 gateways, mounts 2 volumes, and maps 3 clients, and a general configuration flow is as follows: selecting a machine as gateway node 1; opening iSCSI or FC services at gateway node 1; mapping the volume 1 and clients 1,2,3 on the gateway node 1; mapping volumes 2 and clients 1,2,3 on gateway node 1; selecting a machine as gateway node 2; opening iSCSI or FC services at gateway node 2; mapping the volume 1 and clients 1,2,3 on the gateway node 2; the volume 2 and clients 1,2,3 are mapped on the gateway node 2. It can be seen that the first 4 steps and the last 4 steps in the flow chart are almost identical flows, and if one wants to join a gateway node again, the same 4 steps need to be repeated.
FIG. 4 is a schematic diagram of a prior art distributed storage system connected to clients, with the topology of the final intra-cluster gateway, volume, client mapping as shown in FIG. 4, according to an embodiment of the present invention.
In the existing distributed storage system or cluster, each gateway node in the system needs to be configured and managed respectively, and the configuration process is complicated. 2. If the number of gateways reaches 3 or more, a lot of repeated work is required. 3. The topology network mapped by the gateway, the volume and the client is messy and is not well managed. 4. When different protocols (such as ISCSC and FC) are to be supported, services which are not available are required to be started at the gateway, and the operation is complicated.
In the implementation procedure, this embodiment proposes an access path, which specifies which volume volumes in the system can be accessed by the client through which gateway nodes.
The access path can solve the following problems:
1. the complex flow of gateway configuration, volume and client mapping is greatly simplified, especially when the number of three resources is relatively large.
2. The three topological structures are simplified, so that the disordered net structure is changed into a tree structure.
3. iSCSI, local SCSI, FC 3 type interfaces may be provided simultaneously.
The client multipath access pattern may be automatically adapted.
The access path is a carrier for specifying which XDC gateways can access the target storage volume by the client group, and is responsible for establishing a mapping relationship among the client group, the block storage volume, and the gateway server.
The access path is responsible for establishing a mapping relationship between a Client (Client), a storage Volume (Volume), and a Gateway server (Gateway).
There are 2 or more paths in an access path, one path representing the mapping relationship between a client server and a gateway
Fig. 5 is a flowchart of gateway configuration of the distributed storage system according to an embodiment of the present invention, and after having access paths, as shown in fig. 5, a mapping structure configuration procedure including 2 gateways, mounting 3 volumes, and mapping 3 clients is as follows:
creating an access path; adding the gateways 1 and 2 into the access path; mapping volumes 1, 2, 3 to access paths; clients 1, 2, 3 are mapped to the access paths.
Detailed explanation of steps:
1. an access path is created, and the type of the access path can be one of iSCSI, local SCSI and FC 3. For both iSCSI and Local SCSI types, a iqn number will be generated.
2. And taking the node which needs to provide access to the outside as a gateway to join the access path, and starting a gateway service on the selected node after the access is successful, wherein the service is responsible for starting the iscsi target end, configuring the mapping of the client and the volume and the like. At this step, iqn generated in the previous step is automatically configured to be at the target of all gateway nodes.
3. Access path mapping volumes. After mapping the volume to the access path, the access path sends the volume information to the gateway node, and after receiving the volume information, the gateway service on the gateway node sets the lunID of the volume and other information.
4. The client is mapped to an access path. After mapping, the access path will send the information of the client to the gateway node, and after receiving the information of the client, the service on the node will configure the mapping relationship between the volume and the client. After configuration is completed, the client may access the data on the volume through iSCSI, local SCSI, or FC interfaces.
FIG. 6 is a schematic diagram of a connection between a distributed storage system and a client, according to an embodiment of the present invention, with access paths, resulting in a tree topology as shown in FIG. 6.
The embodiment provides an Access Path (Access Path) in the cluster, and the Access Path provides a method for centrally managing the mapping relation among gateway nodes, volumes and clients in the cluster; greatly simplifying the operation flow of the similar products. The access path can simultaneously support iSCSI, local SCSI and FC 3 protocol interfaces in one resource, only one gateway service needs to be started, and other similar products need to be started or configured respectively. The access path generates a iqn and assigns this iqn to different nodes of the access path.
Compared with the related art, in the step of creating the access path, the method can add a plurality of gateways, a plurality of volumes and a plurality of clients at the same time, so that the operation flow of configuration is greatly simplified. One access path can simultaneously support iSCSI, local SCSI and FC 3 protocols, and each gateway node does not need to be respectively started with service. The access path enables the topology structure of the gateway, the volume and the client to be clear, and is convenient to monitor and manage.
FIG. 7 is a schematic diagram of a volume mapping processing apparatus in a distributed storage system according to an embodiment of the present invention, as shown in FIG. 7, according to another aspect of the embodiment of the present invention, there is further provided a mapping processing apparatus in a distributed storage system, including: the creation module 72 and the mapping module 74 are described in detail below.
A creation module 72 for creating an access path; a mapping module 74 is coupled to the creation module 72 for mapping the plurality of devices of the distributed storage system to an access path to provide data interaction between the plurality of devices through the access path, wherein the devices comprise volumes of the distributed storage system.
By the above means, an access path is created using the creation module 72; the mapping module 74 maps the multiple devices of the distributed storage system to the access path, so as to provide data interaction among the multiple devices through the access path, and establish data connection among the multiple devices in the distributed storage system through the access path, thereby achieving the purpose of quickly configuring the multiple devices, further achieving the technical effects of simplifying the configuration process and improving the efficiency, and further solving the technical problems of complicated gateway configuration process, a large number of repeated operations and low efficiency in the distributed storage system in the related art.
Fig. 8 is a schematic diagram of a data access apparatus of a distributed storage system according to an embodiment of the present invention, and as shown in fig. 8, according to another aspect of an embodiment of the present invention, there is further provided a data access apparatus of a distributed storage system, including: a receiving module 802, a first transmitting module 804, a second transmitting module 806, a third transmitting module 808, and a fourth transmitting module 810. The device will be described in detail below.
A receiving module 802, configured to receive, through the created access path, a data access request sent by a client, where the client maps to the access path, and establishes a data connection between the client and the access path, and the number of clients is multiple; a first sending module 804, connected to the receiving module 802, configured to send a data access request to a corresponding gateway through an access path, where a plurality of gateways map to the access path, establish data access between the access path and the plurality of gateways, and the plurality of gateways include the gateway corresponding to the access request; a second sending module 806, connected to the first sending module 804, configured to forward, through an access path, data sent by the gateway in response to the data access request to a volume corresponding to the data, where the volumes are mapped to the access path, and establish data connection between the volumes and the gateway through the access path; a third sending module 808, connected to the second sending module 806, and configured to send the return data of the volume response data to the gateway through the access path; and a fourth sending module 810, connected to the third sending module 808, configured to send the return data received by the gateway to the client through the access path.
By the device, the receiving module 802 is adopted to receive the data access request sent by the client through the created access path, wherein the client is mapped to the access path, the data connection between the client and the access path is established, and the number of the clients is multiple; the first sending module 804 sends the data access request to the corresponding gateway through the access path, wherein the plurality of gateways map to the access path, establish the access path and the data access of the plurality of gateways, and the plurality of gateways comprise the gateway corresponding to the access request; the second sending module 806 forwards the data sent by the gateway in response to the data access request to the volume corresponding to the data through the access path, wherein the volumes are mapped to the access path, and data connection between the volumes and the gateway is established through the access path; the third sending module 808 sends the return data of the volume response data to the gateway through the access path; the fourth sending module 810 establishes data connection between a plurality of gateways and a plurality of volumes in the distributed storage system through the access path in a manner of sending the returned data received by the gateway to the client through the access path, and establishes data connection with a plurality of clients through a mapping manner, thereby achieving the purpose of rapidly configuring the gateway, further realizing the technical effects of simplifying the configuration process and improving the efficiency, and further solving the technical problems of complicated gateway configuration process, a large number of repeated operations and low efficiency in the distributed storage system in the related art.
According to another aspect of the embodiment of the present invention, there is further provided a storage medium, where the storage medium includes a stored program, and when the program runs, the device where the storage medium is controlled to execute the mapping processing method in the distributed storage system of any one of the above items.
According to another aspect of the embodiment of the present invention, there is further provided a processor, configured to execute a program, where the program executes the mapping processing method in the distributed storage system of any one of the foregoing aspects.
The foregoing embodiment numbers of the present invention are merely for the purpose of description, and do not represent the advantages or disadvantages of the embodiments.
In the foregoing embodiments of the present invention, the descriptions of the embodiments are emphasized, and for a portion of this disclosure that is not described in detail in this embodiment, reference is made to the related descriptions of other embodiments.
In the several embodiments provided in the present application, it should be understood that the disclosed technology content may be implemented in other manners. The above-described embodiments of the apparatus are merely exemplary, and the division of the units, for example, may be a logic function division, and may be implemented in another manner, for example, a plurality of units or components may be combined or may be integrated into another system, or some features may be omitted, or not performed. Alternatively, the coupling or direct coupling or communication connection shown or discussed with each other may be through some interfaces, units or modules, or may be in electrical or other forms.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
In addition, each functional unit in the embodiments of the present invention may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit. The integrated units may be implemented in hardware or in software functional units.
The integrated units, if implemented in the form of software functional units and sold or used as stand-alone products, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention may be embodied essentially or in part or all of the technical solution or in part in the form of a software product stored in a storage medium, including instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a Read-Only Memory (ROM), a random access Memory (RAM, random Access Memory), a removable hard disk, a magnetic disk, or an optical disk, or other various media capable of storing program codes.
The foregoing is merely a preferred embodiment of the present invention and it should be noted that modifications and adaptations to those skilled in the art may be made without departing from the principles of the present invention, which are intended to be comprehended within the scope of the present invention.
Claims (9)
1. A method for processing volume mapping in a distributed storage system, comprising:
creating an access path, wherein the access path is a carrier for specifying through which XDC gateways a client group can access a volume and is used for establishing a mapping relation among the client group, the volume and the XDC gateways, and the type of the access path is one of iSCSI, local SCSI and FC;
mapping a plurality of devices of a distributed storage system to the access path to provide data interactions between the plurality of devices through the access path includes: mapping a plurality of gateways in the distributed storage system to the access paths to establish data connections of the access paths with the plurality of gateways; mapping a plurality of volumes of the distributed storage system to the access path to establish data connections of the volumes with a plurality of the gateways through the access path; mapping a plurality of gateways in the distributed storage system to the access path includes: adding a plurality of gateways into nodes of the access path, wherein the access path comprises a plurality of nodes, and the gateways respectively correspond to one node; after mapping a plurality of gateways in a distributed storage system to the access paths, comprising: opening a gateway service of a gateway to be used, wherein the gateway service comprises one of the following components: starting communication service, and configuring the identification of the node of the access path for the gateway;
After mapping the plurality of devices of the distributed storage system to the access path to provide data interaction between the plurality of devices through the access path, further comprising: mapping a plurality of clients to the access path to establish data connections of the plurality of clients with the plurality of gateways through the access path.
2. The method of claim 1, wherein after mapping the plurality of volumes of the distributed storage system to the access paths, comprising:
and sending the identity information of the volumes to the gateway to be used through the access path, so that the gateway accesses the volumes corresponding to the identity information through the access path according to the identity information.
3. The method of claim 1, wherein after mapping the plurality of volumes of the distributed storage system to the access path, comprising:
and sending the information of a plurality of clients to the gateway to be used through the access path, so that the gateway establishes data connection through the communication service through the clients corresponding to the information through the access path.
4. A method for accessing data in a distributed storage system, comprising:
receiving a data access request sent by a client through a created access path, wherein the client is mapped to the access path, data connection between the client and the access path is established, the number of the client is multiple, the access path is a carrier for designating which XDC gateways can access a volume through a client group, the carrier is used for establishing a mapping relation among the client group, the volume and the XDC gateways, and the type of the access path is one of iSCSI, local SCSI and FC;
sending the data access request to a corresponding gateway through the access path, wherein a plurality of gateways are mapped to the access path, data access between the access path and the gateways is established, and the gateways comprise the gateways corresponding to the access request; mapping a plurality of gateways in the distributed storage system to the access path includes: adding a plurality of gateways into nodes of the access path, wherein the access path comprises a plurality of nodes, and the gateways respectively correspond to one node; after mapping a plurality of gateways in a distributed storage system to the access paths, comprising: opening a gateway service of a gateway to be used, wherein the gateway service comprises one of the following components: starting communication service, and configuring the identification of the node of the access path for the gateway;
Forwarding data sent by the gateway in response to the data access request to a volume corresponding to the data through the access path, wherein a plurality of volumes are mapped to the access path, and data connection between the volumes and the gateway is established through the access path; after mapping the plurality of devices of the distributed storage system to the access path to provide data interaction between the plurality of devices through the access path, further comprising: mapping a plurality of clients to the access path to establish data connections of the plurality of clients with the plurality of gateways through the access path;
sending the returned data of the volume responding to the data to the gateway through the access path;
and sending the return data received by the gateway to the client through the access path.
5. The method of claim 4, wherein receiving the data access request sent by the client via the created access path comprises:
receiving the data access request through a node corresponding to the gateway in the access path, wherein a plurality of gateways are added into the node of the access path, the access path comprises a plurality of nodes, and the gateways respectively correspond to one node;
Sending the data access request to the corresponding gateway through the access path includes:
and sending the data access request to the gateway through the node of the access path.
6. A volume mapping processing apparatus in a distributed storage system, comprising:
the system comprises a creation module, a storage module and a storage module, wherein the creation module is used for creating an access path, wherein the access path is a carrier for designating through which XDC gateways a client group can access a volume and is used for establishing a mapping relation among the client group, the volume and the XDC gateways, and the type of the access path is one of iSCSI, local SCSI and FC;
a mapping module for mapping a plurality of devices of the distributed storage system to the access path to provide data interactions between the plurality of devices through the access path, wherein the devices comprise volumes of the distributed storage system, the mapping module comprising: mapping a plurality of gateways in the distributed storage system to the access paths to establish data connections of the access paths with the plurality of gateways; mapping a plurality of volumes of the distributed storage system to the access path to establish data connections of the volumes with a plurality of the gateways through the access path; mapping a plurality of gateways in the distributed storage system to the access path includes: adding a plurality of gateways into nodes of the access path, wherein the access path comprises a plurality of nodes, and the gateways respectively correspond to one node; after mapping a plurality of gateways in a distributed storage system to the access paths, comprising: opening a gateway service of a gateway to be used, wherein the gateway service comprises one of the following components: starting communication service, and configuring the identification of the node of the access path for the gateway;
After mapping the plurality of devices of the distributed storage system to the access path to provide data interaction between the plurality of devices through the access path, further comprising: mapping a plurality of clients to the access path to establish data connections of the plurality of clients with the plurality of gateways through the access path.
7. A data access apparatus for a distributed storage system, comprising:
a receiving module, configured to receive a data access request sent by a client through a created access path, where the client maps to the access path, and establishes a data connection between the client and the access path, where the number of clients is multiple, the access path is a carrier that specifies through which XDC gateways a client group can access a volume, and is used to establish a mapping relationship between the client group, the volume, and the XDC gateways, and a type of the access path is one of iSCSI, local SCSI, and FC;
the first sending module is used for sending the data access request to a corresponding gateway through the access path, wherein a plurality of gateways are mapped to the access path, the data access of the access path and the gateways is established, and the gateways comprise the gateways corresponding to the access request; mapping a plurality of gateways in the distributed storage system to the access path includes: adding a plurality of gateways into nodes of the access path, wherein the access path comprises a plurality of nodes, and the gateways respectively correspond to one node; after mapping a plurality of gateways in a distributed storage system to the access paths, comprising: opening a gateway service of a gateway to be used, wherein the gateway service comprises one of the following components: starting communication service, and configuring the identification of the node of the access path for the gateway;
The second sending module is used for forwarding data sent by the gateway in response to the data access request to a volume corresponding to the data through the access path, wherein a plurality of volumes are mapped to the access path, and data connection between the volumes and the gateway is established through the access path; after mapping the plurality of devices of the distributed storage system to the access path to provide data interaction between the plurality of devices through the access path, further comprising: mapping a plurality of clients to the access path to establish data connections of the plurality of clients with the plurality of gateways through the access path;
a third sending module, configured to send, to the gateway, returned data of the volume in response to the data through the access path;
and the fourth sending module is used for sending the return data received by the gateway to the client through the access path.
8. A storage medium comprising a stored program, wherein the program, when run, controls a device on which the storage medium resides to execute the volume mapping processing method in the distributed storage system of any one of claims 1 to 3.
9. A processor, characterized in that the processor is configured to run a program, wherein the program when run performs the volume mapping processing method in the distributed storage system of any one of claims 1 to 3.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010238541.3A CN111464622B (en) | 2020-03-30 | 2020-03-30 | Volume mapping processing method and device in distributed storage system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010238541.3A CN111464622B (en) | 2020-03-30 | 2020-03-30 | Volume mapping processing method and device in distributed storage system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111464622A CN111464622A (en) | 2020-07-28 |
| CN111464622B true CN111464622B (en) | 2023-07-14 |
Family
ID=71685074
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010238541.3A Active CN111464622B (en) | 2020-03-30 | 2020-03-30 | Volume mapping processing method and device in distributed storage system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111464622B (en) |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112087517B (en) * | 2020-09-10 | 2023-10-27 | 北京星辰天合科技股份有限公司 | Storage cluster processing method and processing device and electronic equipment |
| CN113630450B (en) * | 2021-07-26 | 2024-03-15 | 深圳市杉岩数据技术有限公司 | Access control method of distributed storage system and distributed storage system |
| CN113568753B (en) * | 2021-07-30 | 2024-02-09 | 北京天融信网络安全技术有限公司 | Access path determination method, device, electronic equipment and readable storage medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP1962178A2 (en) * | 2007-02-23 | 2008-08-27 | Hitachi, Ltd. | Storage system and management method thereof |
| CN203299803U (en) * | 2013-06-05 | 2013-11-20 | 南京信核数据科技有限公司 | Multi-path read-write system |
| US8793343B1 (en) * | 2011-08-18 | 2014-07-29 | Amazon Technologies, Inc. | Redundant storage gateways |
| CN106293501A (en) * | 2015-06-25 | 2017-01-04 | 中兴通讯股份有限公司 | Data read-write method and device |
Family Cites Families (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7529816B2 (en) * | 2005-06-03 | 2009-05-05 | Hewlett-Packard Development Company, L.P. | System for providing multi-path input/output in a clustered data storage network |
| US9294564B2 (en) * | 2011-06-30 | 2016-03-22 | Amazon Technologies, Inc. | Shadowing storage gateway |
| US8706834B2 (en) * | 2011-06-30 | 2014-04-22 | Amazon Technologies, Inc. | Methods and apparatus for remotely updating executing processes |
| US8650359B2 (en) * | 2011-08-26 | 2014-02-11 | Vmware, Inc. | Computer system accessing object storage system |
| US8832334B2 (en) * | 2012-08-09 | 2014-09-09 | Hitachi, Ltd. | Method and apparatus to migrate existing data among storage systems based on a traffic amount that does not exceed a preset threshold |
| WO2014141466A1 (en) * | 2013-03-15 | 2014-09-18 | 株式会社日立製作所 | Computer system |
| CN109672714B (en) * | 2017-10-17 | 2022-02-25 | 中移(苏州)软件技术有限公司 | Data processing method of distributed storage system and distributed storage system |
| JP2019186658A (en) * | 2018-04-04 | 2019-10-24 | コニカミノルタ株式会社 | Communication system, platform server, and program |
| CN109981768B (en) * | 2019-03-21 | 2021-12-07 | 上海霄云信息科技有限公司 | IO multi-path planning method and device in distributed network storage system |
-
2020
- 2020-03-30 CN CN202010238541.3A patent/CN111464622B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP1962178A2 (en) * | 2007-02-23 | 2008-08-27 | Hitachi, Ltd. | Storage system and management method thereof |
| US8793343B1 (en) * | 2011-08-18 | 2014-07-29 | Amazon Technologies, Inc. | Redundant storage gateways |
| CN203299803U (en) * | 2013-06-05 | 2013-11-20 | 南京信核数据科技有限公司 | Multi-path read-write system |
| CN106293501A (en) * | 2015-06-25 | 2017-01-04 | 中兴通讯股份有限公司 | Data read-write method and device |
Non-Patent Citations (2)
| Title |
|---|
| Transparent flow migration through splicing for multi-homed vehicular Internet gateways;Joshua Hare等;《2013 IEEE Vehicular Networking Conference》;全文 * |
| 一种GRID路由协议的网关选取方法;肖瑶等;《电视技术》;全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111464622A (en) | 2020-07-28 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111464622B (en) | Volume mapping processing method and device in distributed storage system | |
| CN110635987B (en) | Message transmission method, device, equipment and machine readable storage medium | |
| CN107710196B (en) | Method and system for managing resource object | |
| WO2018218977A1 (en) | Method for orchestrating software defined network, and sdn controller | |
| EP3905598B1 (en) | Message processing method and apparatus, control plane device, and computer storage medium | |
| US11687354B2 (en) | Virtual machine management using onboarding operations and openstack control | |
| CN102404418B (en) | Method, device and system for distributing IP (internet protocol) address for user terminal | |
| CN109561054B (en) | Data transmission method, controller and access device | |
| CN106878199B (en) | Configuration method and device of access information | |
| US11856065B2 (en) | Data transmission for service integration between a virtual private cloud and an intranet | |
| CN103516542A (en) | Network system, and management apparatus and switch thereof | |
| TWI577164B (en) | Scalable address resolution | |
| CN110519348A (en) | A kind of mostly service distributed type assemblies deployment system and method | |
| CN113645304B (en) | Data service processing method and related equipment | |
| CN104639497B (en) | Remotely access configuration method, remote access method, device and system | |
| CN108965094A (en) | A kind of virtual machine network connection method and device | |
| CN108683659A (en) | Multi-protocol data communication means and device | |
| CN105071965B (en) | A kind of management system of the network equipment | |
| US10608942B1 (en) | Reducing routes based on network traffic utilization | |
| US20220060560A1 (en) | Cloud communication method and apparatus | |
| CN111901386B (en) | Method, system, equipment and readable storage medium for processing remote files | |
| CN106330492B (en) | A kind of method, apparatus and system configuring user equipment forwarding table | |
| EP3503484A1 (en) | Message transmission method, device and network system | |
| CN102833287B (en) | The method of visit data resource in distributed file system and distributed file system | |
| CN107493181B (en) | Indication method and device of virtual expansion port |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information | ||
| CB02 | Change of applicant information |
Address after: 100094 101, floors 1-5, building 7, courtyard 3, fengxiu Middle Road, Haidian District, Beijing Applicant after: Beijing Xingchen Tianhe Technology Co.,Ltd. Address before: 100097 room 806-1, block B, zone 2, Jinyuan times shopping center, indigo factory, Haidian District, Beijing Applicant before: XSKY BEIJING DATA TECHNOLOGY Corp.,Ltd. |
|
| GR01 | Patent grant | ||
| GR01 | Patent grant |