WO2022116766A1

WO2022116766A1 - Data storage system and construction method therefor

Info

Publication number: WO2022116766A1
Application number: PCT/CN2021/128409
Authority: WO
Inventors: 潘道华
Original assignee: 中兴通讯股份有限公司
Priority date: 2020-12-04
Filing date: 2021-11-03
Publication date: 2022-06-09
Also published as: CN114610690A

Abstract

A data storage system and a construction method therefor. The data storage system (100) comprises an HDFS server node (110), a central node (120), and an NFS client node (130), wherein the HDFS server node (110) is configured with an NFS service function; the central node (120) is configured with an HDFS client (121) and an NFS server (122), the HDFS client (121) is used for accessing shared information provided by the HDFS server node (110), and the NFS server (122) is used for providing an access entry for accessing the shared information by means of the HDFS client (121); and the NFS client node (130) is configured to access the shared information by means of the access entry.

Description

Data storage system and its construction method

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is based on the Chinese patent application with the application number of 202011404986.0 and the filing date of December 4, 2020, and claims the priority of the Chinese patent application. The entire content of the Chinese patent application is incorporated herein by reference.

technical field

The embodiments of the present application relate to, but are not limited to, the technical field of data processing, and in particular, relate to a data storage system and a construction method thereof.

Background technique

When any system is used commercially, data is the core value of the system. Some data are centrally stored in the database, and some data are stored in the form of files on the disk. Regardless of the storage form, data security, maintenance and operation Etc. is a complex and very important thing. In the related art, a common way is to use hardware (such as a disk array, etc.) or software (such as shared storage, etc.) to store data. The way of using hardware often requires additional hardware configuration, which makes the cost relatively high; while the way of using software often has the problem of poor security, and with the complexity of the network environment, the workload of data maintenance also increases. Then it became huge. Therefore, how to solve the problems existing in the related technologies is an urgent matter to be solved.

SUMMARY OF THE INVENTION

The following is an overview of the topics detailed in this article. This summary is not intended to limit the scope of protection of the claims.

The embodiments of the present application provide a data storage system and a construction method thereof, which can maintain high cost performance while improving the security of data storage.

In a first aspect, an embodiment of the present application provides a data storage system, including: a distributed file system (Hadoop Distributed File System, HDFS) server node configured with a network file system (Network File System, NFS) service function; The central node is in communication connection with the HDFS server node, the central node is configured with an HDFS client and an NFS server, the HDFS client is used to access the shared information provided by the HDFS server node, the The NFS server is used to provide an access portal for accessing the shared information through the HDFS client; the NFS client node is connected to the central node in communication, and the NFS client node is configured to access the shared information through the access portal. shared information.

In a second aspect, an embodiment of the present application further provides a method for constructing a data storage system, including: deploying an HDFS server node, and configuring an NFS service function on the HDFS server node; deploying a central node so that the central node communicate with the HDFS server node; configure an HDFS client on the central node, wherein the HDFS client is used to access the shared information provided by the HDFS server node; configure the NFS service on the central node The NFS server is used to provide an access portal for accessing the shared information through the HDFS client; deploy an NFS client node, so that the NFS client node is connected to the central node in communication, and The NFS client node is configured to access the shared information through the access portal.

Other features and advantages of the present application will be set forth in the description which follows, and in part will be apparent from the description, or may be learned by practice of the present application. The objectives and other advantages of the application may be realized and attained by the structure particularly pointed out in the description, claims and drawings.

Description of drawings

The accompanying drawings are used to provide a further understanding of the technical solutions of the present application, and constitute a part of the specification. They are used to explain the technical solutions of the present application together with the embodiments of the present application, and do not constitute a limitation on the technical solutions of the present application.

1 is a schematic diagram of a data storage system provided by an embodiment of the present application;

2 is a schematic diagram of a data storage system provided by another embodiment of the present application;

3 is a flowchart of a method for constructing a data storage system provided by an embodiment of the present application;

4 is a flowchart of deploying an HDFS server node in a construction method provided by another embodiment of the present application;

5 is a flowchart of configuring an HDFS client on a central node in a construction method provided by another embodiment of the present application;

6 is a flowchart of configuring an NFS server in a central node in a construction method provided by another embodiment of the present application;

FIG. 7 is a flowchart of a method for constructing a data storage system provided by a specific example of the present application.

Detailed ways

In order to make the purpose, technical solutions and advantages of the present application more clearly understood, the present application will be described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application, but not to limit the present application.

It should be noted that although the functional modules are divided in the schematic diagram of the device, and the logical sequence is shown in the flowchart, in some cases, the modules may be divided differently from the device, or executed in the order in the flowchart. steps shown or described.

The present application provides a data storage system and a construction method thereof. By adding a central node between a data storage-oriented HDFS server node and a user-oriented NFS client node, and configuring the HDFS client and NFS server on the central node , so that the central node is both the client of the HDFS server node and the server of the NFS client node. Therefore, the HDFS server node and the NFS client node can be set in different networks. For example, the HDFS server node can be set For the internal network with high security, set the NFS client node on the public network, so as to improve the security of data storage. In addition, because the HDFS server node and NFS client node can be located in different networks to improve the security of data storage, there is no need to use hardware methods such as disk arrays to achieve data storage, and no additional hardware configuration is required. Maintain a high price/performance ratio while improving the security of data storage.

The embodiments of the present application will be further described below with reference to the accompanying drawings.

As shown in FIG. 1 , FIG. 1 is a schematic diagram of a data storage system provided by an embodiment of the present application. In the example of FIG. 1 , the data storage system 100 includes an HDFS server node 110, a central node 120 and an NFS client node 130, wherein the HDFS server node 110 is communicatively connected to the central node 120, and the central node 120 is connected to the NFS client Node 130 is communicatively connected.

The HDFS server node 110 is configured with the NFS service function; the central node 120 is configured with an HDFS client 121 and an NFS server 122. The HDFS client is used to access the shared information provided by the HDFS server node, and the NFS server is used for to provide an access portal for accessing the shared information through the HDFS client; the NFS client node 130 is configured to access the shared information through the access portal. Since the central node 120 is configured with the HDFS client 121 and the NFS server 122, the central node 120 is both the client of the HDFS server node 110 and the server of the NFS client node 130. Therefore, the HDFS server node 110 and The NFS client nodes 130 can be located in different networks. For example, the HDFS server node 110 is located in an internal network with high security, and the NFS client node 130 is located in a public network with low security. The HDFS server node 110 stores data security. In addition, since the HDFS server node 110 and the NFS client node 130 can be located in different networks to improve the security of data storage, in the HDFS server node 110, there is no need to use a hardware method such as a disk array to realize data storage. Storage, without adding additional hardware configuration, can use software (such as shared storage, etc.) to store data, so as to achieve the purpose of maintaining high cost performance while improving the security of data storage.

The HDFS server node 110 is configured with a file storage system centered on the Hadoop file storage computing framework. When the number of HDFS server nodes 110 is multiple, a distributed file system can be constructed among the multiple HDFS server nodes 110 . Among them, Hadoop is a distributed system infrastructure. Users can use Hadoop to develop distributed programs without knowing the underlying details of distribution, and make full use of the advantages of clusters for high-speed computing and storage. The file storage system configured by the HDFS server node 110 includes HDFS components. The HDFS components have the advantages of high reliability, high scalability, high efficiency, high fault tolerance and low cost, and can be used to deploy on low-cost hardware configurations. , and provides high throughput to access application data, suitable for applications with very large data sets.

It should be noted that although the HDFS component can provide interfaces for operating the stored data files, these interfaces are not friendly enough for the use of the system. In the HDFS component in 110, the NFS service function is integrated and enabled, so that users can use NFS to access the shared information maintained by the HDFS component, so as to meet the user's simplicity, friendliness and convenience in use.

The central node 120 is configured with an HDFS client 121 for accessing the shared information provided by the HDFS server node 110 , and an NFS server 122 for providing an access portal for accessing the shared information through the HDFS client 121 . Among them, NFS is an application based on User Datagram Protocol (UDP) or Internet Protocol (Internet Protocol, IP), mainly using Remote Procedure Call (RPC) mechanism to access remote files operation, and the operation is independent of the machine, the operating system, and the underlying transport protocol. NFS can support sharing data files between multiple hosts, and can mount a directory or partition on another machine to the current machine. At this time, the data in a directory or partition on another machine can be accessed through the current machine. file as if accessing a data file on the local machine. Therefore, the NFS server 122 is a server program that can provide a certain directory or partition on the current machine for the NFS client to mount and use.

The NFS client node 130 can access the shared information in the HDFS server node 110 through the access portal provided by the NFS server 122 of the central node 120 . The NFS client node 130 is configured to be able to mount the access directory provided by the NFS server 122 locally, so that the user can access the shared information through the access directory. It is worth noting that if the instance currently mounted by the NFS client node 130 is abnormal, the NFS client node 130 can automatically complete the establishment of a new server link and automatically complete the mounting of the instance, so that the use is stable. The performance can be guaranteed, and the simplicity of use can also facilitate the use of users. Since the access directory mounted by the NFS client node 130 is still the directory maintained by the HDFS server node 110 in the end, the security of the data file can be guaranteed. It should be noted that the NFS client node 130 provides users with access to the shared information maintained by the HDFS server node 110 in the NFS mode. The NFS mode is friendly and simple to operate, and can provide convenient access for the use and processing of the data storage system 100. Way.

By adopting the data storage system 100 including the above-mentioned HDFS server node 110 , the central node 120 and the NFS client node 130 , the respective advantages of HDFS and NFS can be integrated to provide users with friendly and simple operations, and combined with the HDFS server The multi-layer deployment of the node 110, the central node 120 and the NFS client node 130 can improve the security of data storage and maintain a relatively high cost performance in a complex environment where multiple networks are mixed.

In one embodiment, the NFS server 122 can provide an access directory for accessing the shared information in the HDFS server node 110 through the HDFS client 121 , wherein the access directory is a mapping directory of the shared information in the central node 120 .

It should be noted that the access directory provided by the NFS server 122 is the mapping directory in the central node 120 of the directory shared by the HDFS server node 110 in the NFS manner. Users can use it, so that data storage can be realized in the direction of cloudification, so that the elastic deployment of the data storage system 100 can be realized.

In one embodiment, the NFS client node 130 is further configured to perform the following operations:

When an access request for accessing shared information is obtained, the central node 120 requests the shared information from the HDFS server node 110 according to the access request, and after obtaining the shared information from the HDFS server node 110 through the central node 120, the shared information is displayed .

Based on the data storage system 100 in the above embodiment, when a user operates in the NFS client node 130 to access the shared information stored in the HDFS server node 110, the NFS client node 130 will obtain the corresponding access request, At this time, the NFS client node 130 will request the corresponding shared information from the HDFS server node 110 through the central node 120 according to the access request. When the HDFS server node 110 receives the access request, the HDFS server node 110 will pass the central node 110 The node 120 feeds back the corresponding shared information to the NFS client node 130, and when the NFS client node 130 receives the shared information, it can display the shared information to the user. As a specific example, when a user operates in the NFS client node 130 to access a shared directory in the HDFS server node 110, it is as convenient and fast as accessing a local directory, thereby improving the user experience.

In addition, in an embodiment, as shown in FIG. 2 , there may be multiple HDFS server nodes 110 and NFS client nodes 130 in the data storage system 100 , and the multiple HDFS server nodes 110 are respectively connected to the central node 120 . For communication connection, the central node 120 is connected to each NFS client node 130 respectively, wherein, the HDFS server node 110 can be deployed in the internal network with higher security, and the NFS client node 130 can be deployed in the external network for users to use . It should be noted that different NFS client nodes 130 may be deployed in different external networks, which is not specifically limited in this embodiment. The multiple HDFS server nodes 110 are independent of each other, and the data files stored by each HDFS server node 110 are different. In addition, the externally shared directory of each HDFS server node 110 can be stored in each HDFS server node 110. It is mounted on an NFS client node 130, therefore, a user can use any NFS client node 130 to access data files stored in any HDFS server node 110 through the central node 120.

It should be noted that the architecture of the data storage system described in the above embodiments is for the purpose of illustrating the technical solutions of the embodiments of the present application more clearly, and does not constitute a limitation on the technical solutions provided by the embodiments of the present application. Personnel know that, with the evolution of the system architecture and the emergence of new application scenarios, the technical solutions provided in the embodiments of the present application are also applicable to similar technical problems.

It can be understood by those skilled in the art that the architecture of the data storage system shown in FIG. 1 and FIG. 2 does not constitute a limitation to the embodiments of the present application, and may include more or less components than those shown in the figure, or a combination of certain components may be included. some components, or a different arrangement of components.

Based on the architecture of the data storage system in the above embodiments, various embodiments of the construction method of the data storage system are proposed.

As shown in Figure 3, Figure 3 is a flowchart of a construction method of a data storage system provided by an embodiment of the present application, and the construction method includes but is not limited to the following steps:

Step S100, deploying an HDFS server node, and configuring the NFS service function on the HDFS server node;

Step S200, deploying a central node, so that the central node is communicatively connected to the HDFS server node;

Step S300, configure an HDFS client on the central node, wherein the HDFS client is used to access the shared information provided by the HDFS server node;

Step S400, configure an NFS server at the central node, wherein the NFS server is used to provide an access portal for accessing shared information through an HDFS client;

Step S500, deploying an NFS client node so that the NFS client node is connected to the central node in communication, and configuring the NFS client node to access shared information through an access portal.

It should be noted that the HDFS server node is configured with an HDFS component. By integrating and enabling the NFS service function in the HDFS component, users can use NFS to access the shared information maintained by the HDFS server node. It is simple, friendly and convenient for users to use. It is worth noting that the HDFS component can be configured in the HDFS server node by referring to the official HDFS configuration method, which is not specifically limited in this embodiment.

It should be noted that, by configuring an HDFS client on the central node for accessing the shared information provided by the HDFS server node, and configuring an NFS server for providing an access entry for accessing the shared information through the HDFS client, the central The node is not only the client of the HDFS server node, but also the server of the NFS client node. Therefore, the HDFS server node and the NFS client node can be located in different networks. For example, the HDFS server node is set to a higher security. In the internal network of HDFS, and the NFS client node is set in the public network with low security, which can improve the security of the data stored by the HDFS server node.

It should be noted that by configuring the NFS client node to be able to access the shared information stored by the HDFS server node through the access portal provided by the NFS server, users can access the shared information stored in HDFS by operating the NFS client node. Shared information in server nodes. For example, when a user operates on the NFS client node and accesses the shared information stored in the HDFS server node, the NFS client node will obtain the corresponding access request, and at this time, the NFS client node will follow the access request. The central node requests the corresponding shared information from the HDFS server node. When the HDFS server node receives the access request, the HDFS server node will feed back the corresponding shared information to the NFS client node through the central node. After receiving the shared information, the shared information can be displayed to the user. Therefore, for the user, when the user operates on the NFS client node to access the shared directory in the HDFS server node, it is as convenient and fast as accessing the local directory, thereby improving the user experience.

By adopting the construction method including the above steps S100, S200, S300, S400 and S500, deploy the data storage-oriented HDFS server node, the user-oriented NFS client node and the HDFS server node for connecting to the HDFS server node and The central node of the NFS client node, and the HDFS client and NFS server are configured on the central node, so that the central node is both the client of the HDFS server node and the server of the NFS client node, so that the HDFS server node is The NFS client node and the NFS client node can be located in different networks. For example, the HDFS server node can be set on the internal network with high security, and the NFS client node can be set on the public network with low security. Therefore, data storage can be improved. security. In addition, since the HDFS server node and NFS client node can be located in different networks to improve the security of data storage, there is no need to use hardware methods such as disk arrays to store data, and no additional hardware configuration is required, so that the Maintain a high price/performance ratio while improving the security of data storage.

In one embodiment, the access entry is an access directory, and the access directory is a mapping directory of shared information in the central node.

It should be noted that the access directory provided by the NFS server is the mapping directory of the directory shared by the HDFS server node in the NFS mode in the central node. Data storage can be implemented in the direction of cloudification, enabling flexible deployment of data storage systems.

In addition, in an embodiment, in step S500, configuring the NFS client node to access the shared information through the access portal may include, but is not limited to, the following steps:

Configure the NFS client node so that the NFS client node mounts the access directory locally to access shared information through the access directory.

It can be understood that since the access directory provided by the NFS server is the mapping directory of the shared information in the HDFS server node on the central node, the NFS client node is configured so that the NFS client node will access the directory. It is mounted locally. When the user needs to access the shared information in the HDFS server node, he can directly operate the access directory mounted on the NFS client node, which is as convenient and fast as accessing the local directory, so it can improve the user's experience. Use experience.

It is worth noting that if the currently mounted instance of the NFS client node is abnormal, the NFS client node can automatically complete the establishment of a new server link and automatically complete the mounting of the instance, so that the stability of use can be improved. It is guaranteed, and the simplicity of use can also facilitate the use of users. Since the access directory mounted by the NFS client node is still the directory maintained by the HDFS server node, the security of data files can be guaranteed. It should be noted that the NFS client node provides users with access to the shared information maintained by the HDFS server node in the NFS mode. The NFS mode is friendly and simple to operate, and can provide a convenient access mode for the use and processing of the data storage system.

In addition, in an embodiment, as shown in FIG. 4 , step S100 may include, but is not limited to, the following steps:

Step S110, install the HDFS server in the HDFS server node;

Step S120, setting the configuration data of the HDFS server, so that the HDFS server supports the NFS service function;

Step S130: Restart the HDFS server node, so that the HDFS server node starts the NFS service function.

It can be understood that the HDFS server node is a data storage center that applies HDFS. Therefore, the HDFS server needs to be installed in the HDFS server node. Although the HDFS server can provide interfaces for operating the stored data files, these interfaces are not friendly enough for the system. After installation, you can modify the configuration data of the HDFS server to increase the NFS service function parameters, so that the HDFS server can support the NFS service function. After completing the setting operation of the configuration data of the HDFS server, when the configuration is normal, you can restart the HDFS server node to enable the HDFS server in the HDFS server node to start the NFS service function, thereby providing users with access using NFS. The shared information maintained by the HDFS server node is simple, friendly and convenient for users to use.

In addition, in an embodiment, as shown in FIG. 5 , in step S300, configuring the HDFS client on the central node may include but not be limited to the following steps:

Step S310, install the HDFS client on the central node;

Step S320, import the configuration data of the HDFS server to the HDFS client, so that the HDFS client can access the shared information of the HDFS server node through the HDFS server.

It is understandable that by installing the HDFS client on the central node and importing the configuration data of the HDFS server to the HDFS client, the central node can access the HDFS server in the HDFS server node through the HDFS client, so as to satisfy user needs. Requirements for accessing shared information stored by HDFS server nodes. In addition, by configuring the HDFS client on the central node, the central node can obtain the directory or partition where the shared information of the HDFS server node is located, so that the central node can provide the directory or partition to the NFS server in subsequent steps. NFS client node to mount, so as to realize the construction of the entire data storage system.

In addition, in an embodiment, as shown in FIG. 6 , the configuration of the NFS server at the central node in step S400 may include, but is not limited to, the following steps:

Step S410, install the NFS server on the central node;

Step S420, setting the configuration data of the NFS server, so that the NFS server provides an access entry for accessing the shared information through the HDFS client;

Step S430, restart the central node, so that the central node enables the NFS server.

It can be understood that when the NFS server needs to be configured on the central node, the NFS server can be installed on the central node first, and then the configuration data of the NFS server can be modified (such as adding relevant configuration parameters of the NFS service), so that the NFS server can provide The access portal for HDFS clients to access shared information. After completing the setting operation of the configuration data of the NFS server, when the configuration is normal, the central node can be restarted to enable the NFS server.

It should be noted that after completing the above steps S310, S320, and steps S410, S420, and S430, all deployment operations on the central node are completed. At this time, the central node is configured with an HDFS client and an NFS server. , therefore, the central node is not only the client of the HDFS server node, but also the server of the NFS client node, that is, the central node can separate the HDFS server node and the NFS client node into different networks. Therefore, the HDFS service The end node and NFS client node can be located in different networks. For example, the HDFS server node can be set in the internal network with high security, while the NFS client node can be set in the public network with low security. . Since the HDFS server node can be set in the internal network with high security, the security of data storage can be improved. In addition, since the HDFS server node and NFS client node can be located in different networks to improve the security of data storage, in the HDFS server node, there is no need to use hardware methods such as disk arrays to store data. Additional hardware configuration needs to be added, and data can be stored in the form of software (such as shared storage, etc.), so as to achieve the purpose of maintaining high cost performance while improving the security of data storage.

In order to more clearly describe the specific steps and processes of the construction method of the data storage system in the above-mentioned embodiments, a specific example is used for description below.

Example one:

As shown in FIG. 7 , FIG. 7 is a flowchart of a method for constructing a data storage system provided by a specific example. In Figure 7, the HDFS server node is a single node, and the NFS server of the central node uses an independent image for users to access and operate. The HDFS server node, central node and NFS client node are all deployed in the same high security Internal network. The construction method of the data storage system includes step S11, step S12 and step S13.

Step S11, install the HDFS server in the HDFS server node, and modify the configuration data of the HDFS server node, so that the HDFS server node supports the NFS service function, when the configuration is completed, restart the HDFS server node to start the NFS service function .

In step S11, for the method of configuring the HDFS server node, you can refer to the official configuration method. If the configuration is normal, you can use the showmount command to view the information of the shared directory provided by the HDFS server node.

Step S12, deploying the central node, installing the HDFS client on the central node, and importing the relevant configuration data of the HDFS server into the HDFS client; installing the NFS server, modifying the relevant configuration data of the NFS server at the same time, and adding the relevant NFS service functions. Configuration; when the configuration is complete, restart the central node.

In step S12, after importing the relevant configuration data of the HDFS server node into the HDFS client, the directory information of the HDFS server node can be viewed through the HDFS client command. After the NFS server is enabled, if the configuration of the central node is normal, you can view the shared directory information provided by the HDFS server node through the showmount command.

Step S13, deploy the NFS client node, install the NFS client in the NFS client node, and mount the shared directory provided by the NFS server of the central node to the NFS client.

In step S13, after the deployment of the NFS client node is completed, when the user initiates an operation to access the shared directory provided by the HDFS server node through the NFS client of the NFS client node, it is like accessing the local directory of the NFS client node Just as simple, friendly and convenient.

Example two:

Referring to the architecture of the data storage system shown in Figure 2, the number of HDFS server nodes is multiple, the number of NFS client nodes is also multiple, the central node and each HDFS server node and each NFS client node communication connection. Among them, the HDFS server node is deployed on the internal network with high security, and the NFS client node is deployed on the external network for users to use. It is worth noting that different NFS client nodes can be deployed on different external networks. The construction method of the data storage system includes the following steps:

The first step is to deploy and start multiple HDFS server nodes in the internal network, and configure each HDFS server node to support the NFS service function.

In this step, you can refer to the official configuration method for the configuration of each HDFS server node. After the configuration is completed, restart each HDFS server node to start the NFS service function. If the configuration is normal, you can use the showmount command to view each Information about shared directories provided by an HDFS server node.

The second step is to deploy the central node, install the HDFS client on the central node, and import the relevant configuration data of each HDFS server node into the HDFS client; install the NFS server, and at the same time modify the relevant configuration data of the NFS server, add relevant Related configuration of NFS service function.

In this step, if the configuration is normal, restart the central node, so that the central node enables the HDFS client and the NFS server. If the operation is normal, you can use the HDFS client command to view the directory information of each HDFS server node, and you can also use the showmount command to view the shared directory information provided by each HDFS server node. It is worth noting that the functions of the HDFS client and NFS server of the central node are independent of each other, and related configuration operations are independent of each other, so they can be made into an independent image for rapid deployment in a cloud environment.

The third step is to deploy multiple NFS client nodes in the external network, install the NFS client in each NFS client node, and mount the shared directory provided by the NFS server of the central node to each NFS respectively. client.

In this step, after the deployment of all NFS client nodes is completed, the user can use any NFS client node to access the shared directory provided by any HDFS server node through the central node. When a user can initiate an operation to access the shared directory provided by the HDFS server node through the NFS client of the NFS client node, it is as simple, friendly and convenient as accessing the local directory of the NFS client node.

The embodiments of the present application include: a data storage system includes an HDFS server node, a central node, and an NFS client node, wherein the HDFS server node is configured with an NFS service function; the central node is communicatively connected to the HDFS server node, and the central node is configured with an NFS service function. There are HDFS client and NFS server. The HDFS client is used to access the shared information provided by the HDFS server node, and the NFS server is used to provide the access portal for accessing the shared information through the HDFS client; the NFS client node communicates with the central node To connect, NFS client nodes are configured to access shared information through an access portal. According to the solution provided by the embodiments of the present application, by adding a central node between the data storage-oriented HDFS server node and the user-oriented NFS client node, and configuring the HDFS client and NFS server on the central node, the central node is both The client of the HDFS server node is also the server of the NFS client node. Therefore, the HDFS server node and the NFS client node can be located in different networks. For example, the HDFS server node can be set to a higher security. The internal network of the NFS client node is set on the public network, which can improve the security of data storage. In addition, since the HDFS server node and NFS client node can be located in different networks to improve the security of data storage, there is no need to use hardware methods such as disk arrays to store data, and no additional hardware configuration is required, so that the Maintain a high price/performance ratio while improving the security of data storage.

Those of ordinary skill in the art can understand that all or some of the steps and systems in the methods disclosed above can be implemented as software, firmware, hardware, and appropriate combinations thereof. Some or all physical components may be implemented as software executed by a processor, such as a central processing unit, digital signal processor or microprocessor, or as hardware, or as an integrated circuit, such as an application specific integrated circuit . Such software may be distributed on computer-readable media, which may include computer storage media (or non-transitory media) and communication media (or transitory media). As is known to those of ordinary skill in the art, the term computer storage media includes both volatile and nonvolatile implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data flexible, removable and non-removable media. Computer storage media include, but are not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disk (DVD) or other optical disk storage, magnetic cartridges, magnetic tape, magnetic disk storage or other magnetic storage devices, or may Any other medium used to store desired information and which can be accessed by a computer. In addition, communication media typically embodies computer readable instructions, data structures, program modules, or other data in a modulated data signal such as a carrier wave or other transport mechanism, and can include any information delivery media, as is well known to those of ordinary skill in the art .

The above is a specific description of several embodiments of the present application, but the present application is not limited to the above-mentioned embodiments, and those skilled in the art can also make various equivalent modifications or replacements on the premise of not violating the spirit of the present application. Equivalent modifications or substitutions are included within the scope defined by the claims of the present application.

Claims

A data storage system comprising:

The distributed file system HDFS server node is configured with the network file system NFS service function;

The central node is in communication connection with the HDFS server node, the central node is configured with an HDFS client and an NFS server, the HDFS client is used to access the shared information provided by the HDFS server node, the The NFS server is used to provide an access entry for accessing the shared information through the HDFS client;

An NFS client node is connected in communication with the central node, and the NFS client node is configured to access the shared information through the access portal.
The data storage system according to claim 1, wherein the NFS server is configured to provide an access directory for accessing the shared information through the HDFS client, wherein the access directory is where the shared information is stored. The mapping directory of the central node described above.
The data storage system according to claim 2, wherein the NFS client node is configured to mount the access directory locally, so as to access the shared information through the access directory.
The data storage system according to any one of claims 1 to 3, wherein the NFS client node is further configured to: when acquiring an access request for accessing the shared information, pass the central node through the central node according to the access request Request the shared information from the HDFS server node, and display the shared information after obtaining the shared information from the HDFS server node through the central node.
A construction method of a data storage system, comprising:

Deploy the HDFS server node, and configure the NFS service function on the HDFS server node;

Deploying a central node so that the central node communicates with the HDFS server node;

Configure an HDFS client on the central node, wherein the HDFS client is used to access the shared information provided by the HDFS server node;

An NFS server is configured on the central node, wherein the NFS server is used to provide an access entry for accessing the shared information through the HDFS client;

An NFS client node is deployed, so that the NFS client node is communicatively connected to the central node, and the NFS client node is configured to access the shared information through the access portal.
The construction method according to claim 5, wherein the access entry is an access directory, and the access directory is a mapping directory of the shared information in the central node.
The construction method according to claim 6, wherein the configuring the NFS client node to access the shared information through the access portal comprises:

The NFS client node is configured so that the NFS client node mounts the access directory locally, so as to access the shared information through the access directory.
The construction method according to claim 5, wherein the deploying an HDFS server node, and configuring the NFS service function on the HDFS server node, comprises:

Install the HDFS server in the HDFS server node;

Setting the configuration data of the HDFS server so that the HDFS server supports the NFS service function;

Restart the HDFS server node, so that the HDFS server node starts the NFS service function.
The construction method according to claim 8, wherein the configuring an HDFS client on the central node comprises:

Install the HDFS client on the central node;

Import the configuration data of the HDFS server to the HDFS client, so that the HDFS client can access the shared information of the HDFS server node through the HDFS server.
The construction method according to claim 9, wherein the configuring the NFS server on the central node comprises:

Install an NFS server on the central node;

Setting the configuration data of the NFS server so that the NFS server provides an access entry for accessing the shared information through the HDFS client;

Restart the central node, so that the central node enables the NFS server.