CN113268254A - Cluster system installation method and device, electronic equipment and storage medium - Google Patents
Cluster system installation method and device, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN113268254A CN113268254A CN202110524899.7A CN202110524899A CN113268254A CN 113268254 A CN113268254 A CN 113268254A CN 202110524899 A CN202110524899 A CN 202110524899A CN 113268254 A CN113268254 A CN 113268254A
- Authority
- CN
- China
- Prior art keywords
- cluster
- operating system
- nodes
- diskless
- sending
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 62
- 238000009434 installation Methods 0.000 title claims abstract description 53
- 238000010367 cloning Methods 0.000 claims description 20
- 238000005192 partition Methods 0.000 claims description 19
- 230000005540 biological transmission Effects 0.000 claims description 12
- 238000004806 packaging method and process Methods 0.000 claims description 8
- 238000004590 computer program Methods 0.000 claims description 7
- 230000008569 process Effects 0.000 abstract description 18
- 238000010586 diagram Methods 0.000 description 9
- 238000005516 engineering process Methods 0.000 description 6
- 238000011084 recovery Methods 0.000 description 5
- 230000006870 function Effects 0.000 description 4
- 238000011900 installation process Methods 0.000 description 4
- 230000009471 action Effects 0.000 description 3
- 230000002159 abnormal effect Effects 0.000 description 2
- 239000002184 metal Substances 0.000 description 2
- 238000006467 substitution reaction Methods 0.000 description 2
- 230000001360 synchronised effect Effects 0.000 description 2
- 230000004888 barrier function Effects 0.000 description 1
- VQLYBLABXAHUDN-UHFFFAOYSA-N bis(4-fluorophenyl)-methyl-(1,2,4-triazol-1-ylmethyl)silane;methyl n-(1h-benzimidazol-2-yl)carbamate Chemical compound C1=CC=C2NC(NC(=O)OC)=NC2=C1.C=1C=C(F)C=CC=1[Si](C=1C=CC(F)=CC=1)(C)CN1C=NC=N1 VQLYBLABXAHUDN-UHFFFAOYSA-N 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000012423 maintenance Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000002085 persistent effect Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 230000002441 reversible effect Effects 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F8/00—Arrangements for software engineering
- G06F8/60—Software deployment
- G06F8/61—Installation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/08—Configuration management of networks or network elements
- H04L41/0803—Configuration setting
- H04L41/084—Configuration by using pre-existing information, e.g. using templates or copying from other elements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/08—Configuration management of networks or network elements
- H04L41/0876—Aspects of the degree of configuration automation
- H04L41/0886—Fully automatic configuration
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/08—Configuration management of networks or network elements
- H04L41/0889—Techniques to speed-up the configuration process
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/08—Configuration management of networks or network elements
- H04L41/0893—Assignment of logical groups to network elements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/02—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/104—Peer-to-peer [P2P] networks
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1095—Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Software Systems (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Automation & Control Theory (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Stored Programmes (AREA)
Abstract
The application provides a cluster system installation method, a device, electronic equipment and a storage medium, wherein the method comprises the following steps: sending a diskless system to the nodes in the cluster to be deployed so that the nodes in the cluster to be deployed start to operate by using the diskless system, and returning an operation success message; receiving an operation success message sent by a node in a cluster to be deployed; analyzing a target address of the diskless system from the successful operation message; and acquiring the operating system file, and sending the operating system file to a target node corresponding to the target address. In the implementation process, the diskless system is distributed to the nodes in the cluster to be deployed and operated, so that the nodes in the cluster to be deployed do not need to be configured with information such as node addresses, the information such as target addresses can be analyzed from the operation success information, the problem of manual node-by-node configuration operation is solved, and the deployment and installation speed of the operating system of the cluster nodes is effectively improved.
Description
Technical Field
The present application relates to the technical field of installation of a cluster system, a computer system, and an operating system, and in particular, to a method and an apparatus for installing a cluster system, an electronic device, and a storage medium.
Background
A computer cluster (also referred to as a cluster) refers to a group of loosely or tightly connected computers that work together and need to be installed with an operating system and cooperative software to cooperate together, and the cooperative computers may also be referred to as cluster nodes. Because these computers work in concert, they can be viewed in many ways as a single system; computer clusters are different from grid computers, and each node is set by the computer cluster to execute the same task and is controlled and scheduled by software.
At present, operating system deployment and installation are performed on all bare metal nodes (i.e., server nodes not installed with an operating system) in a cluster, mostly by manually performing single-node installation, or after node address information of a Preboot execution Environment (PXE) service is manually configured, an operating system is installed through a PXE service network. However, in a specific practical process, it is found that, since both of the two methods involve manually performing a node-by-node configuration operation or a deployment operation, the speed of deploying the operating system of all the nodes of the cluster in the two methods is slow.
Disclosure of Invention
An object of the embodiments of the present application is to provide a cluster system installation method, an apparatus, an electronic device, and a storage medium, which are used to solve the problem that an operating system deploying all nodes of a cluster is slow.
The embodiment of the application provides a cluster system installation method, which comprises the following steps: sending a diskless system to the nodes in the cluster to be deployed so that the nodes in the cluster to be deployed start to operate by using the diskless system, and returning an operation success message; receiving an operation success message sent by a node in a cluster to be deployed; analyzing a target address of the diskless system from the successful operation message; and acquiring an operating system file, and sending the operating system file to a target node corresponding to the target address, wherein the operating system file is used for being installed by the target node. In the implementation process, the diskless system is distributed to the nodes in the cluster to be deployed and operated, so that the nodes in the cluster to be deployed do not need to be configured with information such as node addresses, the information such as target addresses can be analyzed from the operation success information, the problem of manual node-by-node configuration operation is solved, and the deployment and installation speed of the operating system of the cluster nodes is effectively improved.
Optionally, in this embodiment of the present application, sending a diskless system to a node in a cluster to be deployed includes: all nodes in the cluster are controlled using an extreme cloud administrator toolkit xCAT service and sent a diskless system to all nodes. In the implementation process, all nodes in the cluster are controlled by using the xCAT service, and the diskless system is sent to all the nodes, so that the convenience of managing all the nodes in the cluster is improved, and the deployment and installation speed of the operating system of the cluster nodes is effectively improved.
Optionally, in this embodiment of the present application, sending a diskless system to a node in a cluster to be deployed includes: and sending the diskless system to all the nodes in the cluster to be deployed in a load balancing mode by using a hypertext transfer protocol. In the implementation process, the non-disk system is sent to all the nodes in the cluster to be deployed in a load balancing mode by using the hypertext transfer protocol, so that the abnormal condition that the cluster nodes cannot enter the non-disk system due to overtime node requests caused by excessive connection number is avoided, and the deployment and installation speed of the operating system of the cluster nodes is effectively improved.
Optionally, in this embodiment of the present application, sending an operating system file to a target node corresponding to a target address includes: the operating system file is sent to the target node using a point-to-point network transport protocol. In the implementation process, the operating system file is sent to the target node by using the point-to-point network transmission protocol, so that the large-scale file synchronous downloading in the large-scale cluster is realized, and meanwhile, the downloading time is basically not changed along with the increase of the number of the nodes, so that the image distribution efficiency of the operating system file is improved, and the deployment and installation speed of the operating system of the cluster nodes is finally improved.
Optionally, in this embodiment of the present application, before sending the operating system file to the target node corresponding to the target address, the method further includes: and packaging an application program, a driver and a system file in the operating system as mirror images in a partition cloning manner to obtain the operating system file. In the implementation process, by introducing a multifunctional partition cloning technology to the cloning and mirror image recovery of the operating system file, when the original operating system file is damaged and needs to be recovered, the view angle of the operating system recovery is effectively reduced, and finally the operating system deployment and installation speed of the cluster node is improved.
Optionally, in this embodiment of the present application, after sending the operating system file to the target node corresponding to the target address, the method further includes: and the target node acquires the operating system files in a partition cloning mode through the diskless system and uses the operating system files for installation. In the implementation process, the target node obtains the operating system file in a partition cloning mode through the diskless system and uses the operating system file for installation, so that compared with the traditional cloning technology, more storage space can be saved.
The embodiment of the present application further provides a cluster system installation apparatus, including: the diskless system sending module is used for sending a diskless system to the nodes in the cluster to be deployed so as to enable the nodes in the cluster to be deployed to start running by using the diskless system and return a running success message; the successful message receiving module is used for receiving the operation successful message sent by the nodes in the cluster to be deployed; the target address analyzing module is used for analyzing a target address of the diskless system from the successful operation message; and the system file sending module is used for acquiring the operating system file and sending the operating system file to a target node corresponding to the target address, wherein the operating system file is used for being installed by the target node.
Optionally, in an embodiment of the present application, the diskless system sending module includes: the first system sending module is used for controlling all nodes in the cluster by using an extreme cloud administrator tool box xCAT service and sending the diskless system to all the nodes.
Optionally, in an embodiment of the present application, the diskless system sending module includes: and the second system sending module is used for sending the diskless system to all the nodes in the cluster to be deployed in a load balancing mode by using a hypertext transfer protocol.
Optionally, in an embodiment of the present application, the system file sending module includes: and the point-to-point protocol sending module is used for sending the operating system file to the target node by using a point-to-point network transmission protocol.
Optionally, in this embodiment of the present application, the cluster system installation apparatus further includes: and the system file packaging module is used for packaging the application program, the driver program and the system file in the operating system as mirror images in a partition cloning mode to obtain the operating system file.
Optionally, in this embodiment of the present application, the cluster system installation apparatus further includes: and the system file installation module is used for obtaining the operating system files by the target node in a partition cloning mode through the diskless system and installing the operating system files.
An embodiment of the present application further provides an electronic device, including: a processor and a memory, the memory storing processor-executable machine-readable instructions, the machine-readable instructions when executed by the processor performing the method as described above.
Embodiments of the present application also provide a storage medium having a computer program stored thereon, where the computer program is executed by a processor to perform the method as described above.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are required to be used in the embodiments of the present application will be briefly described below, it should be understood that the following drawings only illustrate some embodiments of the present application and therefore should not be considered as limiting the scope, and that those skilled in the art can also obtain other related drawings based on the drawings without inventive efforts.
Fig. 1 is a schematic flow chart of a cluster system installation method provided in an embodiment of the present application;
fig. 2 is a schematic diagram illustrating an overall architecture of xCAT service operation in a cluster according to an embodiment of the present application;
fig. 3 is a schematic structural diagram of a cluster system installation apparatus provided in an embodiment of the present application;
fig. 4 is a schematic structural diagram of an electronic device provided in an embodiment of the present application.
Detailed Description
The technical solution in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application.
Before introducing the cluster system installation method provided by the embodiment of the present application, some concepts related in the embodiment of the present application are introduced:
the diskless system is a technology for transmitting data through a network and starting and running the system by utilizing the transmitted data, and a computer using the diskless system does not use a hard disk of the computer to obtain a starting system, but obtains a mirror image of the starting system through a specified server of the network, and downloads the mirror image back to the computer for machine starting. Meanwhile, the data is not required to be read by using a traditional hard disk, but is read by a server on a network.
An Extreme Cloud Administration Toolkit (xCAT) is an open source tool for the deployment, expansion and management of automated bare metal servers and virtual machines. xCAT herein may provide complete management functionality for clusters, renderers, grid infrastructure, cloud centers, or data centers, etc., including but not limited to: the system comprises a batch installation Operating System (OS), a batch deployment diskless system, node configuration information management and synchronization, a batch management node executing commands in parallel, and the like.
Load balancing (Load balancing), also known as Load balancing, is a computer technology used to distribute Load across a plurality of computers working in coordination, i.e., across a cluster of computers, network connections, CPUs, disk drives, or other resources, to achieve the goals of optimizing resource usage, maximizing throughput, minimizing response time, and avoiding overload; using multiple server components with load balancing, instead of a single component, may increase reliability through redundancy.
Cluster network refers to network devices and connected networks that communicate with each other among the internal devices of a computer cluster, where the cluster network may be a network in a wide area network (e.g., internet) or a local area network.
It should be noted that the cluster system installation method provided in the embodiments of the present application may be executed by an electronic device, where the electronic device refers to a device terminal or a server having a function of executing a computer program, and the server is, for example, an x86 server.
Before introducing the cluster system installation method provided by the embodiment of the present application, an application scenario applicable to the cluster system installation method is introduced, where the application scenario includes but is not limited to: in the process of building and deploying a large-scale cluster, the cluster system installation method is used for installing an operating system for each computer node in the cluster, or the cluster system installation method is used for accelerating the operating system file transmission and operating system installation process of the cluster nodes, or the cluster system installation method is used for accelerating the building and deploying process of the large-scale cluster.
Please refer to fig. 1, which is a schematic flow diagram of a cluster system installation method provided in an embodiment of the present application; the cluster system installation method has the main idea that the diskless system is distributed to the nodes in the cluster to be deployed and operated, so that the node address information does not need to be configured to the nodes in the cluster to be deployed, the target address information can be analyzed from the operation success message, the problem of manually performing node-by-node configuration operation is avoided, and the operation system deployment and installation speed of the cluster nodes is effectively improved; the cluster system installation method may include:
step S110: and the electronic equipment sends the diskless system to the nodes in the cluster to be deployed so as to enable the nodes in the cluster to be deployed to start running by using the diskless system, and returns a running success message.
It will be appreciated that before sending a diskless system, the diskless system also needs to be acquired; there are many ways to acquire a diskless system including: in the first acquisition mode, an image file of the diskless system is made in a partition cloning mode, so as to obtain the diskless system, and partition cloning software or tools that can be used are as follows: WinImage, UltraISO or AnyToISO, etc. By introducing a multifunctional partition cloning technology into the cloning and image recovery of operating system files (such as Centos7.6 system or ubuntu system, etc.), when the original operating system files are damaged and need to be recovered, the view angle of the operating system recovery is effectively reduced, and finally the operating system deployment and installation speed of the cluster nodes is increased. The second acquisition mode is that the diskless system sent by other terminal equipment is received, and the diskless system is stored in a file system or mobile storage equipment; the third obtaining mode is to obtain a prestored diskless system, and specifically includes: acquiring a diskless system from a file system or acquiring the diskless system from a mobile storage device; in the fourth acquisition mode, the diskless system on the internet is acquired by using software such as a browser.
There are many embodiments of the step S110, including but not limited to:
in a first embodiment, an xCAT service is used to control all nodes in a cluster and send a diskless system to all nodes, for example: the xCAT service is deployed in the cluster, so that one electronic device in the cluster can control all nodes in the cluster through the xCAT service; then, the electronic device may send a diskless system to a node in the cluster to be deployed through the xCAT service, the node in the cluster to be deployed starts to operate by using the diskless system, and after the operation is successful, an Internet Protocol (IP) address or a Media Access Control (MAC) address of the current diskless system is encapsulated into an operation success message, and then the operation success message is returned to the electronic device. All nodes in the cluster are controlled by using the xCAT service, and the diskless system is sent to all the nodes, so that the convenience of managing all the nodes in the cluster is improved, and the deployment and installation speed of the operating system of the cluster nodes is effectively improved.
In a second implementation manner, a hypertext Transfer Protocol (HTTP) is used to send a diskless system to all nodes in a cluster to be deployed in a Load balancing manner, in a specific implementation process, one xCAT service node may be used to implement Load balancing of the HTTP, so that an xCAT service node directly sends a diskless system to a large number (e.g., 10000) of cluster nodes in an HTTP Load balancing manner, and an operating system for deploying the cluster nodes does not need to be manually written and configured for each xCAT service node, thereby greatly reducing the xCAT service deployment workload and the maintenance workload.
Please refer to fig. 2, which is a schematic diagram illustrating an overall architecture of xCAT service operation in a cluster according to an embodiment of the present application; certainly, in a specific process, multiple service nodes may be configured through xCAT to implement liability balancing of HTTP, specifically, for example: the HTTP service is installed and deployed on a plurality of electronic devices in a cluster, and the xCAT adopts a configuration service Node (Server Node) for hierarchical management, so that the xCAT can be used for realizing load balance of cluster Node recovery, and the xCAT is used for building the load balance service among the plurality of electronic devices for deploying the HTTP service. Actually, the number of xCAT services to be deployed may be determined according to the number of specific cluster nodes, and 500 cluster nodes may configure one xCAT service node, or more than 10000 cluster nodes may configure more than 20 xCAT service nodes. Therefore, a plurality of xCAT service nodes need to be configured for a large-scale scenario (for example, 10000 or more cluster nodes), which can effectively improve the distribution speed of diskless system files and the control speed of cluster nodes. Then, a plurality of electronic devices deploying the HTTP service send the diskless system to the nodes in the cluster to be deployed in a load balancing manner, the nodes in the cluster to be deployed start to operate by using the diskless system, and after the operation is successful, an operation success message is returned to the electronic devices.
In a specific implementation process, a large-scale (the node scale can reach more than 2000) cluster node simultaneous installation system can be realized through HTTP load balancing, and file downloading can be distributed to different HTTP service nodes through HTTP load balancing, so that a high concurrency effect is realized, and the image distribution efficiency and the file transmission efficiency of operating system files are greatly accelerated. By using the hypertext transfer protocol to send the diskless system to all the nodes in the cluster to be deployed in a load balancing manner, the abnormal situation that the cluster nodes cannot enter the diskless system due to overtime node requests caused by excessive connection number is avoided, and the deployment and installation speed of the operating system of the cluster nodes is effectively improved.
After step S110, step S120 is performed: and the electronic equipment receives an operation success message sent by the nodes in the cluster to be deployed.
The embodiment of step S120 described above is, for example: after the electronic device sends the diskless system to the cluster node in the cluster to be deployed, the cluster node first receives the diskless system sent by the electronic device and operates the diskless system in its own memory. If the cluster node is successfully started and runs the diskless operating system, acquiring an IP address or an MAC address of the cluster node in a cluster network, then packaging the IP address or the MAC address as a target address to be a successful running message, and then sending the successful running message to the electronic equipment; then, the electronic device receives a running success message sent by a cluster node in the cluster to be deployed.
After step S120, step S130 is performed: and the electronic equipment analyzes the target address of the operation of the diskless system from the operation success message.
The target address refers to an identification address of a cluster node operated by the diskless system in the cluster network, where the target address may be an IPv4 address or an IPv6 address allocated by a server operating a Dynamic Host Configuration Protocol (DHCP) in the cluster network, or may be a Host name or a MAC address of a compute node in the cluster network.
The embodiment of step S130 described above is, for example: the electronic device parses the target address of the diskless system from the successful running message, where the parsing process and the encapsulating process are corresponding, for example: if the IP address is encapsulated as a successful operation message in a preset format, the electronic device needs to parse the IP address of the diskless system from the successful operation message in the preset format, where the preset format includes but is not limited to: eXtensible Markup Language (XML), or script Object Notation (JSON), etc.
After step S130, step S140 is performed: the electronic equipment acquires the operating system file and sends the operating system file to a target node corresponding to the target address, wherein the operating system file is used for being installed by the target node.
There are many ways to acquire the operating system file in step S140, including but not limited to: in the first acquisition mode, an application program, a driver program and a system file in an operating system are packaged as images in a partition cloning mode to obtain an operating system file. And the second acquisition mode is to receive the operating system files sent by other terminal equipment and store the operating system files into a file system or a mobile storage device. The third obtaining mode is to obtain a prestored operating system file, specifically, for example: acquiring an operating system file from a file system or acquiring the operating system file from a mobile storage device; in the fourth acquisition mode, the operating system files on the internet are acquired by using software such as a browser.
There are many ways to send the os file in step S140, including but not limited to the following:
a first sending method, which sends an operating System File to a target node corresponding to a target address through a Network File System (NFS), includes: after the cluster node is started according to the diskless system and enters the diskless system, the cluster node remotely mounts the operating system file on the electronic device in an NFS mode, and the cluster node can acquire the operating system file in the NFS mode after the cluster node is remotely mounted. Among them, NFS is actually a Distributed File System (DFS), and the available Distributed File systems include but are not limited to: GFS, HDFS, Ceph, Lustre, MogileFS, MooseFS, FastDFS, TFS, GridFS, and the like. After the cluster node acquires the operating system file, the cluster node can also use the operating system file to install an operating system; the installation process of the operating system specifically includes: according to the predefined configuration information, acquiring a kernel file (such as initramfs) and a hardware driver (such as a hardware driver of an accelerator card) from an operating system file, and starting to install the operating system according to the booting of the kernel file. After the kernel file and the hardware driver installation are completed, the user's self-defined script can be read to complete the software installation of the self-defined part (such as a parallel compiling environment, a dependent database and a corresponding application program, etc.).
A second sending method may use a Peer-To-Peer (Peer To Peer, abbreviated as P2P) network transmission protocol To send an operating system file To a target node corresponding To a target address, where the sending method specifically includes: and one electronic device in the cluster is made to acquire the operating system file, and is controlled to send the operating system file to a target node corresponding to the target address by using a P2P network transmission protocol, and after the target node receives the operating system file, the operating system of the target node can be installed by using the operating system file. In a specific practical process, the HTTP load balancing may be used in combination with a P2P network transmission protocol, and the HTTP load balancing may be used in combination with a P2P network transmission protocol, so as to increase the speed at which cluster nodes enter a diskless system, thereby accelerating the deployment and installation process of all cluster nodes in the cluster system.
In the implementation process, the operating system file is sent to the target node by using the point-to-point network transmission protocol, so that the large-scale file synchronous downloading in the large-scale cluster is realized, and meanwhile, the downloading time is basically not changed along with the increase of the number of the nodes, so that the image distribution efficiency of the operating system file is improved, and the deployment and installation speed of the operating system of the cluster nodes is finally improved.
It can be understood that after sending the operating system file to the target node corresponding to the target address, the method further includes:
after step S140, step S150 is performed: and the target node acquires the operating system files in a partition cloning mode through the diskless system and uses the operating system files for installation.
The embodiment of the step S150 is, for example: after the target node runs the diskless system, the target node may receive an operating system file first, and perform system installation by using the received operating system file, and specifically, may install the operating system of the target node in one of the persistent storage media (for example, hard disk storage or magnetic disk storage) of the target node; the operating system file may be an image file packaged in a partition clone (PartClone), and the specific command of the partition clone (PartClone) includes, for example: fsck/dev/nvme0n1p1, partclone, vfat-d-c-s/dev/nvme0n1p1-o/root/nvme0n1p1. img. The above-mentioned method using the partition cloning (PartClone) includes, for example: firstly, all files (such as application programs, drivers, system files and the like in an operating system) are prepared and packaged again, the complete operating system image file can be obtained only by packaging once, and xCAT configuration files, script writing and the like required by subsequent installation are not required, so that the technical barrier of use is remarkably reduced. The operating system files are obtained by the target node through the diskless system in a partition cloning mode and are installed by using the operating system files, and compared with the traditional cloning technology, the method can save more storage space.
In the implementation process, firstly, the diskless system is sent to the nodes in the cluster to be deployed so that the nodes in the cluster to be deployed start to operate by using the diskless system, then, the target address of the operation of the diskless system is analyzed from the received operation success message of the nodes, and finally, the operating system files are sent to the target nodes corresponding to the target address so that the target nodes receive and install the operating system files. That is to say, by distributing and operating the diskless system to the nodes in the cluster to be deployed, the nodes in the cluster to be deployed do not need to be configured with information such as node addresses, and the like, and the information such as target addresses and the like can be analyzed from the operation success message, so that the problem of manually performing node-by-node configuration operation is avoided, and the deployment and installation speed of the operating system of the cluster nodes is effectively improved. Furthermore, by combining HTTP load balancing and a P2P network transmission protocol, the speed of the cluster nodes entering the diskless system is increased, and therefore the deployment and installation processes of all the cluster nodes in the cluster system are accelerated.
Please refer to fig. 3, which illustrates a schematic structural diagram of a cluster system installation apparatus provided in the embodiment of the present application; the embodiment of the present application provides a cluster system installation apparatus 200, including:
a diskless system sending module 210, configured to send a diskless system to a node in the cluster to be deployed, so that the node in the cluster to be deployed starts to operate by using the diskless system, and returns an operation success message.
A success message receiving module 220, configured to receive an operation success message sent by a node in the cluster to be deployed.
And the target address resolution module 230 is configured to resolve the target address of the diskless system from the operation success message.
The system file sending module 240 is configured to obtain an operating system file, and send the operating system file to a target node corresponding to the target address, where the operating system file is used to be installed by the target node.
Optionally, in this embodiment of the present application, the diskless system sending module may include:
and the first system sending module is used for controlling all nodes in the cluster by using xCAT service and sending the diskless system to all the nodes.
Optionally, in this embodiment of the present application, the diskless system sending module may further include:
and the second system sending module is used for sending the diskless system to all the nodes in the cluster to be deployed in a load balancing mode by using a hypertext transfer protocol.
Optionally, in an embodiment of the present application, the system file sending module includes:
and the point-to-point protocol sending module is used for sending the operating system file to the target node by using a point-to-point network transmission protocol.
Optionally, in this embodiment of the present application, the cluster system installation apparatus further includes:
and the system file packaging module is used for packaging the application program, the driver program and the system file in the operating system as mirror images in a partition cloning mode to obtain the operating system file.
Optionally, in this embodiment of the present application, the cluster system installation apparatus may further include:
and the system file installation module is used for obtaining the operating system files by the target node in a partition cloning mode through the diskless system and installing the operating system files.
It should be understood that the apparatus corresponds to the above-mentioned cluster system installation method embodiment, and is capable of executing the steps related to the above-mentioned method embodiment, and the specific functions of the apparatus may be referred to the above description, and a detailed description is appropriately omitted here to avoid redundancy. The device includes at least one software functional module that can be stored in memory in the form of software or firmware (firmware) or be solidified in the operating system of the device.
Please refer to fig. 4 for a schematic structural diagram of an electronic device according to an embodiment of the present application. An electronic device 400 provided in an embodiment of the present application includes: a processor 410 and a memory 420, the memory 420 storing machine-readable instructions executable by the processor 410, the machine-readable instructions when executed by the processor 410 performing the method as above.
The embodiment of the present application also provides a storage medium 430, where the storage medium 430 stores a computer program, and the computer program is executed by the processor 410 to perform the method as above.
The storage medium 430 may be implemented by any type of volatile or nonvolatile storage device or combination thereof, such as a Static Random Access Memory (SRAM), an Electrically Erasable Programmable Read-Only Memory (EEPROM), an Erasable Programmable Read-Only Memory (EPROM), a Programmable Read-Only Memory (PROM), a Read-Only Memory (ROM), a magnetic Memory, a flash Memory, a magnetic disk, or an optical disk.
In the embodiments provided in the present application, it should be understood that the disclosed apparatus and method may be implemented in other ways. The apparatus embodiments described above are merely illustrative, and for example, the flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of apparatus, methods and computer program products according to various embodiments of the present application. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved.
In addition, functional modules of the embodiments in the present application may be integrated together to form an independent part, or each module may exist separately, or two or more modules may be integrated to form an independent part.
In this document, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions.
The above description is only an alternative embodiment of the embodiments of the present application, but the scope of the embodiments of the present application is not limited thereto, and any person skilled in the art can easily conceive of changes or substitutions within the technical scope of the embodiments of the present application, and all the changes or substitutions should be covered by the scope of the embodiments of the present application.
Claims (10)
1. A cluster system installation method is characterized by comprising the following steps:
sending a diskless system to nodes in a cluster to be deployed so that the nodes in the cluster to be deployed start to operate by using the diskless system, and returning an operation success message;
receiving the operation success message sent by the nodes in the cluster to be deployed;
analyzing a target address of the diskless system from the successful operation message;
and acquiring an operating system file, and sending the operating system file to a target node corresponding to the target address, wherein the operating system file is used for being installed by the target node.
2. The method of claim 1, wherein sending a diskless system to a node in a cluster to be deployed comprises:
using an extreme cloud administrator tool box xCAT service to control all nodes in a cluster and send the diskless system to all nodes.
3. The method of claim 1, wherein sending a diskless system to a node in a cluster to be deployed comprises:
and sending the diskless system to all nodes in the cluster to be deployed in a load balancing mode by using a hypertext transfer protocol.
4. The method of claim 1, wherein sending the operating system file to the target node corresponding to the target address comprises:
and sending the operating system file to the target node by using a point-to-point network transmission protocol.
5. The method according to claim 1, further comprising, before said sending the operating system file to the target node corresponding to the target address:
and packaging an application program, a driver and a system file in the operating system as mirror images in a partition cloning manner to obtain the operating system file.
6. The method of claim 1, further comprising, after the sending the operating system file to the target node corresponding to the target address:
and the target node obtains the operating system files in a partition cloning mode through the diskless system and uses the operating system files for installation.
7. A cluster system installation apparatus, comprising:
the system comprises a diskless system sending module, a deployment module and a configuration module, wherein the diskless system sending module is used for sending a diskless system to nodes in a cluster to be deployed so as to enable the nodes in the cluster to be deployed to start running by using the diskless system and return a running success message;
a success message receiving module, configured to receive the operation success message sent by the node in the cluster to be deployed;
the target address analyzing module is used for analyzing the target address of the diskless system from the successful operation message;
and the system file sending module is used for acquiring an operating system file and sending the operating system file to a target node corresponding to the target address, wherein the operating system file is used for being installed by the target node.
8. The apparatus of claim 7, wherein the diskless sending module comprises:
the first system sending module is used for controlling all nodes in the cluster by using an extreme cloud administrator tool box xCAT service and sending the diskless system to all the nodes.
9. An electronic device, comprising: a processor and a memory, the memory storing machine-readable instructions executable by the processor, the machine-readable instructions, when executed by the processor, performing the method of any of claims 1 to 6.
10. A storage medium, characterized in that the storage medium has stored thereon a computer program which, when executed by a processor, performs the method according to any one of claims 1 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110524899.7A CN113268254A (en) | 2021-05-13 | 2021-05-13 | Cluster system installation method and device, electronic equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110524899.7A CN113268254A (en) | 2021-05-13 | 2021-05-13 | Cluster system installation method and device, electronic equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113268254A true CN113268254A (en) | 2021-08-17 |
Family
ID=77230759
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110524899.7A Pending CN113268254A (en) | 2021-05-13 | 2021-05-13 | Cluster system installation method and device, electronic equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113268254A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114189436A (en) * | 2021-12-08 | 2022-03-15 | 深圳Tcl新技术有限公司 | Multi-cluster configuration deployment method and device, electronic equipment and storage medium |
| CN115525302A (en) * | 2022-09-23 | 2022-12-27 | 北京大学 | Deployment method and device of large-scale digital object warehouse cluster |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110493028A (en) * | 2019-06-28 | 2019-11-22 | 浪潮电子信息产业股份有限公司 | A kind of clustered deploy(ment) method, system, device and computer readable storage medium |
| CN112445495A (en) * | 2019-08-28 | 2021-03-05 | 曙光信息产业(北京)有限公司 | Mirroring and recovery method for high-performance computing cluster nodes |
-
2021
- 2021-05-13 CN CN202110524899.7A patent/CN113268254A/en active Pending
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110493028A (en) * | 2019-06-28 | 2019-11-22 | 浪潮电子信息产业股份有限公司 | A kind of clustered deploy(ment) method, system, device and computer readable storage medium |
| CN112445495A (en) * | 2019-08-28 | 2021-03-05 | 曙光信息产业(北京)有限公司 | Mirroring and recovery method for high-performance computing cluster nodes |
Non-Patent Citations (3)
| Title |
|---|
| LEONNEW: "LINUX如何克隆硬盘", pages 1 - 3, Retrieved from the Internet <URL:https://blog.csdn.net/leonnew/article/details/104819028?spm=1001.2014.3001.5502> * |
| 文洮等: "高性能计算集群搭建与应用", 30 September 2019, 同济大学出版社, pages: 103 - 107 * |
| 李林昊;沈记全;: "基于镜像的集群系统的部署方法研究与实现", 科技创新导报, no. 31, 1 November 2008 (2008-11-01) * |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114189436A (en) * | 2021-12-08 | 2022-03-15 | 深圳Tcl新技术有限公司 | Multi-cluster configuration deployment method and device, electronic equipment and storage medium |
| CN114189436B (en) * | 2021-12-08 | 2024-04-30 | 深圳Tcl新技术有限公司 | Multi-cluster configuration deployment method and device, electronic equipment and storage medium |
| CN115525302A (en) * | 2022-09-23 | 2022-12-27 | 北京大学 | Deployment method and device of large-scale digital object warehouse cluster |
| CN115525302B (en) * | 2022-09-23 | 2023-06-09 | 北京大学 | Deployment method and device for large-scale digital object warehouse cluster |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109976774B (en) | Block link point deployment method, device, equipment and storage medium | |
| CN111741134B (en) | System and method for quickly constructing virtual machine in large-scale scene of network shooting range | |
| CN108089913B (en) | Virtual machine deployment method of super-fusion system | |
| CN111782232A (en) | Cluster deployment method and device, terminal equipment and storage medium | |
| CN101778136B (en) | Method for installing operating systems for client through remote real-time monitoring of network | |
| CN109067599B (en) | Cluster deployment method and device | |
| CN108628716B (en) | Information receiving and managing system, method and device | |
| CN106549789B (en) | Method and system for realizing server installation | |
| CN112445865B (en) | Method and device for automatically deploying block chain network and cloud computing platform | |
| CN107800580B (en) | Method, server and system for monitoring installation state of large-batch operating systems | |
| CN112328262A (en) | Deployment method, system and device of operating system and electronic equipment | |
| CN113268254A (en) | Cluster system installation method and device, electronic equipment and storage medium | |
| CN103685496A (en) | Transmission method and device of file data | |
| CN115604120A (en) | Multi-cloud cluster resource sharing method, device, equipment and storage medium | |
| CN112702441B (en) | Container-based access data processing method, device, system and storage medium | |
| CN111800511B (en) | Synchronous login state processing method, system, equipment and readable storage medium | |
| CN112948008A (en) | Ironic based physical bare computer management method | |
| CN112256289A (en) | Automatic deployment method, device and equipment | |
| CN115758334A (en) | Cloud application access method and device, electronic equipment and storage medium | |
| CN111431951A (en) | Data processing method, node equipment, system and storage medium | |
| CN100386726C (en) | Method and system for renewing long-distance operation and control of computer platform system programe | |
| CN112241323A (en) | Computing resource discovery and management method and system based on FPGA server | |
| CN111008043A (en) | Server starting method of cloud platform and terminal | |
| CN115766717B (en) | Automatic deployment method, device, equipment and medium for super-fusion distributed system | |
| CN113472599B (en) | Data communication method and system of network node |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20220424 Address after: 210000 No. 33, Qiuyun Road, Qiaolin street, Pukou District, Nanjing, Jiangsu Province Applicant after: Zhongke Shuguang (Nanjing) Computing Technology Co.,Ltd. Address before: Building 36, yard 8, Dongbei Wangxi Road, Haidian District, Beijing Applicant before: Dawning Information Industry (Beijing) Co.,Ltd. |
|
| TA01 | Transfer of patent application right |