CN114124960A - Parallel cluster file system dual-network deployment method, system, terminal and storage medium - Google Patents
Parallel cluster file system dual-network deployment method, system, terminal and storage medium Download PDFInfo
- Publication number
- CN114124960A CN114124960A CN202111258272.8A CN202111258272A CN114124960A CN 114124960 A CN114124960 A CN 114124960A CN 202111258272 A CN202111258272 A CN 202111258272A CN 114124960 A CN114124960 A CN 114124960A
- Authority
- CN
- China
- Prior art keywords
- network
- node
- name
- client
- address
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 33
- 230000003068 static effect Effects 0.000 claims abstract description 54
- 230000005540 biological transmission Effects 0.000 claims abstract description 12
- 238000004590 computer program Methods 0.000 claims description 3
- 238000004891 communication Methods 0.000 description 8
- 238000010586 diagram Methods 0.000 description 5
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 238000006467 substitution reaction Methods 0.000 description 3
- 230000006870 function Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 238000006243 chemical reaction Methods 0.000 description 1
- 230000007812 deficiency Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000009434 installation Methods 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/18—File system types
- G06F16/182—Distributed file systems
- G06F16/1824—Distributed file systems implemented using Network-attached Storage [NAS] architecture
- G06F16/183—Provision of network file services by network file servers, e.g. by using NFS, CIFS
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/18—File system types
- G06F16/1858—Parallel file systems, i.e. file systems supporting multiple processors
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/08—Configuration management of networks or network elements
- H04L41/0803—Configuration setting
- H04L41/0823—Configuration setting characterised by the purposes of a change of settings, e.g. optimising configuration for enhancing reliability
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1097—Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/2866—Architectures; Arrangements
- H04L67/30—Profiles
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
- H04L69/08—Protocols for interworking; Protocol conversion
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computer Security & Cryptography (AREA)
- Computer And Data Communications (AREA)
Abstract
The invention provides a dual-network deployment method, a dual-network deployment system, a dual-network deployment terminal and a dual-network deployment storage medium of a parallel cluster file system, which relate to the field of storage and comprise the following steps: deploying a first network card and a second network card at all service end nodes of the parallel cluster file system, and writing the name of the first network card and the name of the second network card into a network configuration file of the service end nodes; configuring the network addresses of the main nodes of the first network and the second network into management node names in a host name query static table of the service end node; configuring the network addresses of the main nodes of the first network and the second network into management node names in a host name query static table of the client node; and switching the transmission network based on the host name query static table of the service end node and the management node specified by the host name query static table of the client end node. The invention meets the requirement that a cluster environment shares a set of BeeGFS parallel cluster file system under the condition that multiple computing networks exist simultaneously.
Description
Technical Field
The invention relates to the technical field of file storage, in particular to a parallel cluster file system dual-network deployment method, a system, a terminal and a storage medium.
Background
The BeeGFS is a high-performance parallel file system, uses a distributed metadata architecture, and has scalability and flexibility to meet the requirements of services; the meta service of the BeeGFS is used for maintaining and managing the stripe information of the files and the specific storage positions of the files by users, and the storage service of the BeeGFS is used for dividing each file into a specified block size and deploying the file onto a plurality of storage servers after striping.
The standardized BeeGFS parallel cluster file system deployment only supports one network which can be used for computing communication, if a cluster environment relates to two or more than two computing networks, the two networks are physically connected through hardware equipment (the transmission speed is limited by the rate of intermediate conversion equipment), if the cluster environment is gigabit and tera dual-network environments, the gigabit and tera dual-network environments are still good, but if the cluster environment is a network with different protocols, the gigabit and tera dual-network environments are difficult to implement (such as an IB network and an Ethernet of an InfiniBand protocol).
Disclosure of Invention
In view of the above-mentioned deficiencies of the prior art, the present invention provides a dual-network deployment method, system, terminal and storage medium for a parallel cluster file system, so as to solve the above-mentioned technical problems.
In a first aspect, the present invention provides a dual-network deployment method for a parallel cluster file system, including:
deploying a first network card and a second network card at all service end nodes of the parallel cluster file system, and writing the name of the first network card and the name of the second network card into a network configuration file of the service end nodes;
configuring the network addresses of the main nodes of the first network and the second network into management node names in a host name query static table of the service end node;
configuring the network addresses of the main nodes of the first network and the second network into management node names in a host name query static table of the client node;
and switching the transmission network based on the host name query static table of the service end node and the management node specified by the host name query static table of the client end node.
Further, deploying a first network card and a second network card at all the service end nodes of the parallel cluster file system, and writing the name of the first network card and the name of the second network card into the network configuration file of the service end node, including:
and deploying IB network cards and Ethernet cards at all the service end nodes of the parallel cluster file system, and writing the IB network card names and the Ethernet card names deployed by the service nodes into the network configuration files of the service nodes.
Further, configuring the network addresses of the master nodes of the first network and the second network in a host name lookup static table of the service end node as management node names, comprising:
deploying a master node network address and a management node name of a first network of a server, storing the server node address and a corresponding storage node name, applying a client node address of the first network and a corresponding first client node name;
and deploying the network address and the management node name of the main node of the second network of the server, storing the service node address and the corresponding storage node name, and applying the client node address of the second network and the corresponding second client node name.
Further, configuring the network addresses of the master nodes of the first network and the second network as management node names in a host name lookup static table of the client node, including:
deploying a main node network address and a management node name, a storage service node address and a corresponding storage node name, a local node address and a node name of a first network at a client applying the first network;
and deploying the network address of the main node and the name of the management node, the address of the storage service node and the name of the corresponding storage node, the address of the local node and the name of the node of the second network at the client applying the second network.
Further, switching the transmission network based on the host name query static table of the service end node and the management node specified by the host name query static table of the client end node, comprising:
setting a first network to be preferentially applied at a management node;
the management node judges the network types suitable for the client according to the client host name query static table, if the client is suitable for one network type, the network suitable for the client is adopted to connect the client and the server, and if the client is suitable for the first network and the second network, the first network is adopted to connect the client and the server.
In a second aspect, the present invention provides a dual-network deployment system for a parallel cluster file system, including:
the network card configuration unit is used for deploying a first network card and a second network card at all the service end nodes of the parallel cluster file system and writing the name of the first network card and the name of the second network card into a network configuration file of the service end nodes;
the master configuration unit is used for configuring the network addresses of the master nodes of the first network and the second network into management node names in a host name query static table of the service end node;
the slave configuration unit is used for configuring the network addresses of the master nodes of the first network and the second network into management node names in a host name query static table of the client node;
and the deployment enabling unit is used for switching the transmission network based on the host name query static table of the service end node and the management node specified by the host name query static table of the client end node.
Further, the network card configuration unit is configured to:
and deploying IB network cards and Ethernet cards at all the service end nodes of the parallel cluster file system, and writing the IB network card names and the Ethernet card names deployed by the service nodes into the network configuration files of the service nodes.
Further, the master configuration unit is configured to:
deploying a master node network address and a management node name of a first network of a server, storing the server node address and a corresponding storage node name, applying a client node address of the first network and a corresponding first client node name;
and deploying the network address and the management node name of the main node of the second network of the server, storing the service node address and the corresponding storage node name, and applying the client node address of the second network and the corresponding second client node name.
Further, the slave configuration unit is configured to:
deploying a main node network address and a management node name, a storage service node address and a corresponding storage node name, a local node address and a node name of a first network at a client applying the first network;
and deploying the network address of the main node and the name of the management node, the address of the storage service node and the name of the corresponding storage node, the address of the local node and the name of the node of the second network at the client applying the second network.
Further, the deployment enabling unit is configured to:
setting a first network to be preferentially applied at a management node;
the management node judges the network types suitable for the client according to the client host name query static table, if the client is suitable for one network type, the network suitable for the client is adopted to connect the client and the server, and if the client is suitable for the first network and the second network, the first network is adopted to connect the client and the server.
In a third aspect, a terminal is provided, including:
a processor, a memory, wherein,
the memory is used for storing a computer program which,
the processor is used for calling and running the computer program from the memory so as to make the terminal execute the method of the terminal.
In a fourth aspect, a computer storage medium is provided having stored therein instructions that, when executed on a computer, cause the computer to perform the method of the above aspects.
The parallel cluster file system dual-network deployment method, the system, the terminal and the storage medium have the advantages that the dual-network cards are deployed at all service end nodes of the parallel cluster file system, the names of the second dual-network cards are written into the network configuration files of the service end nodes, the host name query static table of the service end nodes configures the network addresses of the main nodes of the first network and the second network as management node names, the host name query static table of the client end nodes configures the network addresses of the main nodes of the first network and the second network as management node names, and the transmission network is switched based on the deployed management nodes specified by the host name query static table of the service end nodes and the host name query static table of the client end nodes. The invention realizes the requirement that a cluster environment shares one set of BeeGFS parallel cluster file system under the condition that IB computing network, trillion computing network, gigabit computing network and other multiple computing networks exist simultaneously, avoids the problem that the multiple sets of computing networks in the cluster environment can be deployed only by corresponding to the multiple sets of BeeGFS parallel cluster file systems or needing to purchase expensive hardware equipment to access physical networks with different protocols, meets the requirements of clients, increases the probability of client selection and reduces the cost of a scheme.
In addition, the invention has reliable design principle, simple structure and very wide application prospect.
Drawings
In order to more clearly illustrate the embodiments or technical solutions in the prior art of the present invention, the drawings used in the description of the embodiments or prior art will be briefly described below, and it is obvious for those skilled in the art that other drawings can be obtained based on these drawings without creative efforts.
FIG. 1 is a schematic flow diagram of a method of one embodiment of the invention.
FIG. 2 is a schematic block diagram of a system of one embodiment of the present invention.
Fig. 3 is a schematic structural diagram of a terminal according to an embodiment of the present invention.
Detailed Description
In order to make those skilled in the art better understand the technical solution of the present invention, the technical solution in the embodiment of the present invention will be clearly and completely described below with reference to the drawings in the embodiment of the present invention, and it is obvious that the described embodiment is only a part of the embodiment of the present invention, and not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The following explains key terms appearing in the present invention.
IB network: the developed network is designed according to the open standard InfiniBand specification. InfiniBand is a new interconnect technology developed by Intel corporation to simplify the connection of servers to servers and their associated peripherals, reduce latency, and enhance interoperability, typically 40G, 56G, 100G, 200G, 300G, etc.
Ethernet: the ethernet standard is an old and lively standard. Since the adoption of the ethernet protocol by the IEEE as a standard in 1982, 20 years of weather have passed. In the 20 years, ethernet technology as a link layer standard of lan has surpassed the token bus, token ring and other technologies, and becomes a real standard of lan. 10Gbit/s Ethernet is also known as gigabit Ethernet.
FIG. 1 is a schematic flow diagram of a method of one embodiment of the invention. The execution subject in fig. 1 may be a dual-network deployment system of a parallel cluster file system.
As shown in fig. 1, the method includes:
The invention can appoint the BeeGFS management node name but not the IP method by deploying BeeGFS metadata service (meta) and BeeGFS storage data service (storage) on the premise of not increasing hardware equipment and changing the existing cluster architecture, so that when the priority network is unavailable, the system is automatically switched to the next best network, the Ethernet protocol and the InfiniBand protocol are automatically converted, and the data communication is prevented from going away from the management network with lower performance by the configuration file; (for example, if the IB network is a priority network ten-trillion network and is a second-best network, some clients can automatically judge that the IB network is unavailable only when the IB network is a ten-trillion network, and the IB network is converted into the ten-trillion network after the InfiniBand protocol is switched to the Ethernet protocol), the deployment requirement of the dual-computing network or the multi-computing network is met.
In order to facilitate understanding of the present invention, the parallel cluster file system dual-network deployment method provided by the present invention is further described below with reference to the principle of the parallel cluster file system dual-network deployment method of the present invention and the process of performing dual-network deployment on the parallel cluster file system in the embodiment.
Specifically, the parallel cluster file system dual-network deployment method includes:
s1, deploying a first network card and a second network card at all the service end nodes of the parallel cluster file system, and writing the name of the first network card and the name of the second network card into the network configuration file of the service end nodes.
And deploying IB network cards and Ethernet cards at all the service end nodes of the parallel cluster file system, and writing the IB network card names and the Ethernet card names deployed by the service nodes into the network configuration files of the service nodes.
Firstly, a BeeGFS parallel cluster file system server network needs to contain networks of all clients (if the clients have independent IB network nodes and independent ten-gigabit network nodes, all the nodes of the server need to be configured with IB networks and ten-gigabit network cards), BeegFS-7.1.5 version is deployed and used, and BeegFS server OS uses CentOS7.8 minimum installation.
In order to ensure that the dual-network configuration of the BeeGFS parallel cluster file system takes effect, IB network card names and ten-gigabit network card names are added to all BeeGFS service end nodes/etc/BeeGFS/BeeGFS-mgmtd-ethfile so as to ensure that data cannot be transmitted through a management network with a lower rate.
S2, configuring the network addresses of the master nodes of the first network and the second network as management node names in the host name lookup static table of the service end node.
Deploying a master node network address and a management node name of a first network of a server, storing the server node address and a corresponding storage node name, applying a client node address of the first network and a corresponding first client node name; and deploying the network address and the management node name of the main node of the second network of the server, storing the service node address and the corresponding storage node name, and applying the client node address of the second network and the corresponding second client node name.
BeeGFS server/etc/hosts file configuration IB network and trillion network addresses are resolved into a host name, which is convenient for realizing dual-network configuration through host name resolution, for example:
an IB network
10.10.10.200 ibmds01 BeeGFS service end main node IB address
10.10.10.201 iboss01 BeeGFS server storage node IB address
10.10.10.1 ibnode01 IB network client node
Network of ten million, one, two, or three
10.10.11.200 ibmds01 BeeGFS service end main node trillion address
10.10.11.201 iboss01 BeeGFS server storage node trillion address
10.10.11.1 ENode02 tera network client node
And S3, configuring the network addresses of the main nodes of the first network and the second network into management node names in a host name query static table of the client node.
Deploying a main node network address and a management node name, a storage service node address and a corresponding storage node name, a local node address and a node name of a first network at a client applying the first network; and deploying the network address of the main node and the name of the management node, the address of the storage service node and the name of the corresponding storage node, the address of the local node and the name of the node of the second network at the client applying the second network.
Client/etc/hosts file configuration, the BeeGFS server master node IB network and the trillion network address both resolve into one hostname (such as mds01), and other nodes differentiate and resolve the hostname, for example:
an IB network
10.10.10.200 ibmds01 BeeGFS service end main node IB address
10.10.10.201 iboss01 BeeGFS server storage node IB address
10.10.10.1 ibnode01 IB network client node
Network of ten million, one, two, or three
10.10.11.200 ibmds01 BeeGFS service end main node trillion address
10.10.11.201 eoss01 BeeGFS server storage node trillion address
10.10.11.1 ENode02 tera network client node
S4, based on the host name inquiry static table of the service end node and the management node appointed by the host name inquiry static table of the client end node, the transmission network is switched.
Setting a first network to be preferentially applied at a management node; the management node judges the network types suitable for the client according to the client host name query static table, if the client is suitable for one network type, the network suitable for the client is adopted to connect the client and the server, and if the client is suitable for the first network and the second network, the first network is adopted to connect the client and the server.
When the BeeGFS server is deployed, the IP addresses of all designated host nodes are changed into host names (such as ibmds01), after deployment is completed, two networks can simultaneously perform external services through internal analysis of/etc/hosts table, for example, the service address is ibmds01, the IB network can be accessed, the trillion network can be accessed, and therefore the IB network client and the trillion network client can both access the mounted BeeGFS parallel cluster file system. When the priority network (IB network) is unavailable, the system is automatically switched to a second-priority network (Ethernet), the InfiniBand protocol and the Ethernet protocol are automatically converted, seamless connection is realized, and the BeeGFS parallel file system mounted on the client can be normally used during protocol or network switching.
In the embodiment, by a method of designating BeeGFS management node names instead of IP when BeeGFS metadata services (meta) and BeeGFS storage data services (storage) are deployed, when a priority network is unavailable, a system is automatically switched to a next-best-priority network, an Ethernet protocol and an InfiniBand protocol are automatically converted, and a management network with low performance is prevented from being used for data communication through a configuration file; (for example, if the IB network is a priority network ten-trillion network and is a second-best network, some clients can automatically judge that the IB network is unavailable only when the IB network is a ten-trillion network, and the IB network is converted into the ten-trillion network after the InfiniBand protocol is switched to the Ethernet protocol), the deployment requirement of the dual-computing network or the multi-computing network is met.
As shown in fig. 2, the system 200 includes:
the network card configuration unit 210 is configured to deploy a first network card and a second network card at all service end nodes of the parallel cluster file system, and write a name of the first network card and a name of the second network card into a network configuration file of the service end node;
a master configuration unit 220, configured to configure, in the host name lookup static table of the service end node, the master network addresses of the first network and the second network as management node names;
a slave configuration unit 230, configured to configure the master node network addresses of the first network and the second network as management node names in a host name lookup static table of the client node;
and the deployment enabling unit 240 is used for switching the transmission network based on the host name query static table of the service end node and the management node specified by the host name query static table of the client end node.
Optionally, as an embodiment of the present invention, the network card configuration unit is configured to:
and deploying IB network cards and Ethernet cards at all the service end nodes of the parallel cluster file system, and writing the IB network card names and the Ethernet card names deployed by the service nodes into the network configuration files of the service nodes.
Optionally, as an embodiment of the present invention, the master configuration unit is configured to:
deploying a master node network address and a management node name of a first network of a server, storing the server node address and a corresponding storage node name, applying a client node address of the first network and a corresponding first client node name;
and deploying the network address and the management node name of the main node of the second network of the server, storing the service node address and the corresponding storage node name, and applying the client node address of the second network and the corresponding second client node name.
Optionally, as an embodiment of the present invention, the slave configuration unit is configured to:
deploying a main node network address and a management node name, a storage service node address and a corresponding storage node name, a local node address and a node name of a first network at a client applying the first network;
and deploying the network address of the main node and the name of the management node, the address of the storage service node and the name of the corresponding storage node, the address of the local node and the name of the node of the second network at the client applying the second network.
Optionally, as an embodiment of the present invention, the deployment enabling unit is configured to:
setting a first network to be preferentially applied at a management node;
the management node judges the network types suitable for the client according to the client host name query static table, if the client is suitable for one network type, the network suitable for the client is adopted to connect the client and the server, and if the client is suitable for the first network and the second network, the first network is adopted to connect the client and the server.
Fig. 3 is a schematic structural diagram of a terminal 300 according to an embodiment of the present invention, where the terminal 300 may be used to execute the parallel cluster file system dual-network deployment method according to the embodiment of the present invention.
Among them, the terminal 300 may include: a processor 310, a memory 320, and a communication unit 330. The components communicate via one or more buses, and those skilled in the art will appreciate that the architecture of the servers shown in the figures is not intended to be limiting, and may be a bus architecture, a star architecture, a combination of more or less components than those shown, or a different arrangement of components.
The memory 320 may be used for storing instructions executed by the processor 310, and the memory 320 may be implemented by any type of volatile or non-volatile storage terminal or combination thereof, such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk. The executable instructions in memory 320, when executed by processor 310, enable terminal 300 to perform some or all of the steps in the method embodiments described below.
The processor 310 is a control center of the storage terminal, connects various parts of the entire electronic terminal using various interfaces and lines, and performs various functions of the electronic terminal and/or processes data by operating or executing software programs and/or modules stored in the memory 320 and calling data stored in the memory. The processor may be composed of an Integrated Circuit (IC), for example, a single packaged IC, or a plurality of packaged ICs connected with the same or different functions. For example, the processor 310 may include only a Central Processing Unit (CPU). In the embodiment of the present invention, the CPU may be a single operation core, or may include multiple operation cores.
A communication unit 330, configured to establish a communication channel so that the storage terminal can communicate with other terminals. And receiving user data sent by other terminals or sending the user data to other terminals.
The present invention also provides a computer storage medium, wherein the computer storage medium may store a program, and the program may include some or all of the steps in the embodiments provided by the present invention when executed. The storage medium may be a magnetic disk, an optical disk, a read-only memory (ROM) or a Random Access Memory (RAM).
Therefore, the invention deploys the double network cards at all the service end nodes of the parallel cluster file system, writes the names of the second double network cards into the network configuration files of the service end nodes, simultaneously configures the network addresses of the main nodes of the first network and the second network into the management node names in the host name query static table of the service end nodes, configures the network addresses of the main nodes of the first network and the second network into the management node names in the host name query static table of the client end nodes, and switches the transmission network based on the deployed management nodes specified by the host name query static table of the service end nodes and the host name query static table of the client end nodes. The invention realizes the requirement that a cluster environment shares one set of BeeGFS parallel cluster file system under the condition that IB computing network, ten-gigabit computing network, gigabit computing network and other multiple computing networks exist simultaneously, avoids the problem that the multiple sets of computing networks in the cluster environment can be deployed only by corresponding to the multiple sets of BeeGFS parallel cluster file systems or needing to purchase expensive hardware equipment to access physical networks with different protocols, meets the requirements of clients, increases the probability of client selection, and reduces the cost of the scheme.
Those skilled in the art will readily appreciate that the techniques of the embodiments of the present invention may be implemented as software plus a required general purpose hardware platform. Based on such understanding, the technical solutions in the embodiments of the present invention may be embodied in the form of a software product, where the computer software product is stored in a storage medium, such as a usb disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and the like, and the storage medium can store program codes, and includes instructions for enabling a computer terminal (which may be a personal computer, a server, or a second terminal, a network terminal, and the like) to perform all or part of the steps of the method in the embodiments of the present invention.
The same and similar parts in the various embodiments in this specification may be referred to each other. Especially, for the terminal embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant points can be referred to the description in the method embodiment.
In the embodiments provided in the present invention, it should be understood that the disclosed system and method can be implemented in other ways. For example, the above-described system embodiments are merely illustrative, and for example, the division of the units is only one logical functional division, and other divisions may be realized in practice, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, systems or units, and may be in an electrical, mechanical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit.
Although the present invention has been described in detail by referring to the drawings in connection with the preferred embodiments, the present invention is not limited thereto. Various equivalent modifications or substitutions can be made on the embodiments of the present invention by those skilled in the art without departing from the spirit and scope of the present invention, and these modifications or substitutions are within the scope of the present invention/any person skilled in the art can easily conceive of the changes or substitutions within the technical scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.
Claims (10)
1. A dual-network deployment method of a parallel cluster file system is characterized by comprising the following steps:
deploying a first network card and a second network card at all service end nodes of the parallel cluster file system, and writing the name of the first network card and the name of the second network card into a network configuration file of the service end nodes;
configuring the network addresses of the main nodes of the first network and the second network into management node names in a host name query static table of the service end node;
configuring the network addresses of the main nodes of the first network and the second network into management node names in a host name query static table of the client node;
and switching the transmission network based on the host name query static table of the service end node and the management node specified by the host name query static table of the client end node.
2. The method of claim 1, wherein deploying the first network card and the second network card at all the server-side nodes of the parallel cluster file system, and writing the name of the first network card and the name of the second network card into the network configuration file of the server-side nodes comprises:
and deploying IB network cards and Ethernet cards at all the service end nodes of the parallel cluster file system, and writing the IB network card names and the Ethernet card names deployed by the service nodes into the network configuration files of the service nodes.
3. The method of claim 1, wherein configuring the master node network addresses of the first network and the second network in a hostname lookup static table of the service end node as administrative node names comprises:
deploying a master node network address and a management node name of a first network of a server, storing the server node address and a corresponding storage node name, applying a client node address of the first network and a corresponding first client node name;
and deploying the network address and the management node name of the main node of the second network of the server, storing the service node address and the corresponding storage node name, and applying the client node address of the second network and the corresponding second client node name.
4. The method of claim 3, wherein configuring the master node network addresses of the first network and the second network in a host name lookup static table of the client node to each manage node name comprises:
deploying a main node network address and a management node name, a storage service node address and a corresponding storage node name, a local node address and a node name of a first network at a client applying the first network;
and deploying the network address of the main node and the name of the management node, the address of the storage service node and the name of the corresponding storage node, the address of the local node and the name of the node of the second network at the client applying the second network.
5. The method of claim 1, wherein switching the transport network based on the service end node's hostname lookup static table and the management node specified by the client end node's hostname lookup static table comprises:
setting a first network to be preferentially applied at a management node;
the management node judges the network types suitable for the client according to the client host name query static table, if the client is suitable for one network type, the network suitable for the client is adopted to connect the client and the server, and if the client is suitable for the first network and the second network, the first network is adopted to connect the client and the server.
6. A parallel cluster file system dual-network deployment system is characterized by comprising:
the network card configuration unit is used for deploying a first network card and a second network card at all the service end nodes of the parallel cluster file system and writing the name of the first network card and the name of the second network card into a network configuration file of the service end nodes;
the master configuration unit is used for configuring the network addresses of the master nodes of the first network and the second network into management node names in a host name query static table of the service end node;
the slave configuration unit is used for configuring the network addresses of the master nodes of the first network and the second network into management node names in a host name query static table of the client node;
and the deployment enabling unit is used for switching the transmission network based on the host name query static table of the service end node and the management node specified by the host name query static table of the client end node.
7. The system of claim 6, wherein the network card configuration unit is configured to:
and deploying IB network cards and Ethernet cards at all the service end nodes of the parallel cluster file system, and writing the IB network card names and the Ethernet card names deployed by the service nodes into the network configuration files of the service nodes.
8. The system of claim 6, wherein the master configuration unit is configured to:
deploying a master node network address and a management node name of a first network of a server, storing the server node address and a corresponding storage node name, applying a client node address of the first network and a corresponding first client node name;
and deploying the network address and the management node name of the main node of the second network of the server, storing the service node address and the corresponding storage node name, and applying the client node address of the second network and the corresponding second client node name.
9. A terminal, comprising:
a processor;
a memory for storing instructions for execution by the processor;
wherein the processor is configured to perform the method of any one of claims 1-5.
10. A computer-readable storage medium, in which a computer program is stored which, when being executed by a processor, carries out the method according to any one of claims 1-5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111258272.8A CN114124960B (en) | 2021-10-27 | 2021-10-27 | Parallel cluster file system double-network deployment method, system, terminal and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111258272.8A CN114124960B (en) | 2021-10-27 | 2021-10-27 | Parallel cluster file system double-network deployment method, system, terminal and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114124960A true CN114124960A (en) | 2022-03-01 |
| CN114124960B CN114124960B (en) | 2023-08-08 |
Family
ID=80377305
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111258272.8A Active CN114124960B (en) | 2021-10-27 | 2021-10-27 | Parallel cluster file system double-network deployment method, system, terminal and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114124960B (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9811530B1 (en) * | 2013-06-29 | 2017-11-07 | EMC IP Holding Company LLC | Cluster file system with metadata server for storage of parallel log structured file system metadata for a shared file |
| CN111294232A (en) * | 2018-12-07 | 2020-06-16 | 慧与发展有限责任合伙企业 | Client server model for multiple document editors |
| CN111858538A (en) * | 2020-06-19 | 2020-10-30 | 苏州浪潮智能科技有限公司 | Method, device, equipment and medium for configuring BeeGFS quota by cluster |
| CN112235136A (en) * | 2020-10-10 | 2021-01-15 | 苏州浪潮智能科技有限公司 | Network file system backup method, system, terminal and storage medium |
| CN113132489A (en) * | 2021-04-22 | 2021-07-16 | 中国工商银行股份有限公司 | Method, device, computing equipment and medium for downloading file |
-
2021
- 2021-10-27 CN CN202111258272.8A patent/CN114124960B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9811530B1 (en) * | 2013-06-29 | 2017-11-07 | EMC IP Holding Company LLC | Cluster file system with metadata server for storage of parallel log structured file system metadata for a shared file |
| CN111294232A (en) * | 2018-12-07 | 2020-06-16 | 慧与发展有限责任合伙企业 | Client server model for multiple document editors |
| CN111858538A (en) * | 2020-06-19 | 2020-10-30 | 苏州浪潮智能科技有限公司 | Method, device, equipment and medium for configuring BeeGFS quota by cluster |
| CN112235136A (en) * | 2020-10-10 | 2021-01-15 | 苏州浪潮智能科技有限公司 | Network file system backup method, system, terminal and storage medium |
| CN113132489A (en) * | 2021-04-22 | 2021-07-16 | 中国工商银行股份有限公司 | Method, device, computing equipment and medium for downloading file |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114124960B (en) | 2023-08-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9999030B2 (en) | Resource provisioning method | |
| CN107566533B (en) | Internal and external network file sharing system based on NAS (network attached storage) | |
| EP3854038A1 (en) | Segment routing with fast reroute for container networking | |
| CN110809760B (en) | Resource pool management method and device, resource pool control unit and communication equipment | |
| CN112398936B (en) | Kubernetes-based multi-network card container implementation method and system | |
| CN114172905B (en) | Cluster network networking method, device, computer equipment and storage medium | |
| CN105260377A (en) | Updating method and system based on hierarchical storage | |
| CN110196843A (en) | A kind of document distribution method and container cluster based on container cluster | |
| US8995424B2 (en) | Network infrastructure provisioning with automated channel assignment | |
| CN112600903A (en) | Elastic virtual network card migration method | |
| CN106686117B (en) | Data storage processing system and method of distributed computing cluster | |
| CN115314353A (en) | Device and method for realizing single-pod multi-network card based on kubernets | |
| US10148516B2 (en) | Inter-networking device link provisioning system | |
| CN108270856B (en) | Virtual management system of logic CPE (customer premises equipment) based on Docker technology and configuration method thereof | |
| CN112583655B (en) | Data transmission method and device, electronic equipment and readable storage medium | |
| CN112491592A (en) | Storage resource grouping method, system, terminal and storage medium | |
| CN111355602B (en) | Resource object management method and device | |
| CN114124960A (en) | Parallel cluster file system dual-network deployment method, system, terminal and storage medium | |
| US20050039179A1 (en) | Trunked customized connectivity process for installing software onto an information handling system | |
| CN112910939B (en) | Data processing method and related device | |
| CN116155890B (en) | Method and device for realizing distributed file system | |
| CN113992683B (en) | Method, system, equipment and medium for realizing effective isolation of double networks in same cluster | |
| CN113395361B (en) | Load balancing access domain name coordination method, system, terminal and storage medium | |
| CN111082975B (en) | Method, system and equipment for increasing domain based on inCloud Manager | |
| CN107124411A (en) | Virtual private cloud implementation method, device and system under classic network environment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |