CN111625496A - Method, device and equipment for deploying distributed file system in virtual machine environment - Google Patents
Method, device and equipment for deploying distributed file system in virtual machine environment Download PDFInfo
- Publication number
- CN111625496A CN111625496A CN202010442858.9A CN202010442858A CN111625496A CN 111625496 A CN111625496 A CN 111625496A CN 202010442858 A CN202010442858 A CN 202010442858A CN 111625496 A CN111625496 A CN 111625496A
- Authority
- CN
- China
- Prior art keywords
- client node
- virtual client
- file system
- distributed file
- virtual
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/11—File system administration, e.g. details of archiving or snapshots
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/18—File system types
- G06F16/182—Distributed file systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F8/00—Arrangements for software engineering
- G06F8/60—Software deployment
- G06F8/61—Installation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/455—Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
- G06F9/45533—Hypervisors; Virtual machine monitors
- G06F9/45558—Hypervisor-specific management and integration aspects
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/455—Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
- G06F9/45533—Hypervisors; Virtual machine monitors
- G06F9/45558—Hypervisor-specific management and integration aspects
- G06F2009/45595—Network integration; Enabling network access in virtual machine instances
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Abstract
The embodiment of the invention discloses a method, a device and equipment for deploying a distributed file system in a virtual machine environment. The method comprises the following steps: authenticating each virtual client node according to the network address of the virtual client node; sending an instruction to the authenticated virtual client node to control the authenticated virtual client node to install a software package of the distributed file system; and generating a configuration file of the distributed file system based on the virtual client nodes provided with the software package, and controlling each virtual client node to configure according to the configuration file. The technical scheme provided by the embodiment of the invention realizes the simple and efficient automatic deployment process of the distributed file system, improves the expandability and flexibility of the distributed file system, and provides more convenience for the user to test and rebuild the distributed file system.
Description
Technical Field
The embodiment of the invention relates to the technical field of computer storage, in particular to a method, a device and equipment for deploying a distributed file system in a virtual machine environment.
Background
The distributed file system Ceph can provide a unified storage architecture of three storage services, namely object storage, block storage and file system storage, can meet simplified deployment and operation and maintenance on the premise of meeting different application requirements, and has high reliability and high expansibility, so that the distributed file system Ceph is more and more widely applied to the fields of big data, cloud computing, mass storage and the like.
However, the Ceph is a relatively large system, components and workflow of the Ceph are very complex, and the deployment scheme recommended by the Ceph official is a manual deployment scheme, so that the operation is complex, the configuration task is multiple, and professional technicians are required to operate the deployment scheme. Some semi-automatic deployment schemes also exist in the prior art, but more preliminary preparation and manual configuration processes are still needed, and the method is generally only suitable for a specific operating system, does not have universality, and is difficult to use and popularize.
Disclosure of Invention
The embodiment of the invention provides a deployment method, a deployment device and deployment equipment of a distributed file system in a virtual machine environment, so as to realize a simple and efficient automatic deployment process of the distributed file system Ceph.
In a first aspect, an embodiment of the present invention provides a deployment method of a distributed file system in a virtual machine environment, which is applied to a virtual server node, and the method includes:
authenticating each virtual client node according to the network address of the virtual client node;
sending an instruction to the authenticated virtual client node to control the authenticated virtual client node to install a software package of the distributed file system;
and generating a configuration file of the distributed file system based on the virtual client nodes provided with the software package, and controlling each virtual client node to configure according to the configuration file.
In a second aspect, an embodiment of the present invention further provides a device for deploying a distributed file system in a virtual machine environment, where the device is applied to a virtual server node, and the device includes:
the node authentication module is used for authenticating each virtual client node according to the network address of the virtual client node;
the system installation module is used for sending an instruction to the authenticated virtual client node so as to control the authenticated virtual client node to install the software package of the distributed file system;
and the system configuration module is used for generating a configuration file of the distributed file system based on the virtual client nodes provided with the software package and controlling each virtual client node to carry out configuration according to the configuration file.
In a third aspect, an embodiment of the present invention further provides a computer device, where the computer device includes:
one or more processors;
a memory for storing one or more programs;
when the one or more programs are executed by the one or more processors, the one or more processors implement the deployment method of the distributed file system in the virtual machine environment provided by any embodiment of the invention.
In a fourth aspect, an embodiment of the present invention further provides a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements the deployment method of the distributed file system in a virtual machine environment, provided by any embodiment of the present invention.
The embodiment of the invention provides a deployment method of a distributed file system in a virtual machine environment, which is characterized in that a virtual server node authenticates each virtual client node according to the network address of the virtual client node, after authentication, the virtual server node sends an installation instruction to the virtual client node to control the virtual client node to install a software package of the distributed file system, after installation is completed, the virtual server node generates a configuration file, and controls the virtual client node to configure the distributed file system. The embodiment of the invention realizes the simple and efficient automatic deployment process of the distributed file system by utilizing the server management tool (Saltstack), improves the expandability and the flexibility of the distributed file system, and provides more convenience for the test and the reconstruction of the distributed file system for a user by completing the deployment process of the distributed file system in the environment of the virtual machine.
Drawings
Fig. 1A is a flowchart of a deployment method of a distributed file system in a virtual machine environment according to an embodiment of the present invention;
fig. 1B is a schematic diagram of a basic architecture of a server management tool, saltswitch, according to a first embodiment of the present invention;
FIG. 1C is a diagram illustrating node function types of nodes in the distributed file system according to the first embodiment of the present invention;
fig. 2 is a flowchart of a deployment method of a distributed file system in a virtual machine environment according to a second embodiment of the present invention;
fig. 3 is a schematic structural diagram of a deployment apparatus of a distributed file system in a virtual machine environment according to a third embodiment of the present invention;
fig. 4 is a schematic structural diagram of a computer device according to a fourth embodiment of the present invention.
Detailed Description
The present invention will be described in further detail with reference to the accompanying drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the invention and are not limiting of the invention. It should be further noted that, for the convenience of description, only some of the structures related to the present invention are shown in the drawings, not all of the structures.
Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. The terminology used in the description of the invention herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. As used herein, the term "and/or" includes any and all combinations of one or more of the associated listed items. In the description of the present invention, "a plurality" means at least two, e.g., two, three, etc., unless specifically limited otherwise.
Before discussing exemplary embodiments in more detail, it should be noted that some exemplary embodiments are described as processes or methods depicted as flowcharts. Although a flowchart may describe the steps as a sequential process, many of the steps can be performed in parallel, concurrently or simultaneously. In addition, the order of the steps may be rearranged. The process may be terminated when its operations are completed, but may have additional steps not included in the figure. The processes may correspond to methods, functions, procedures, subroutines, and the like.
Example one
Fig. 1A is a flowchart of a deployment method of a distributed file system in a virtual machine environment, which is applied to a virtual server node according to an embodiment of the present invention. The embodiment is applicable to the case of deploying the distributed file system, and the method may be executed by a deployment apparatus of the distributed file system in a virtual machine environment, where the deployment apparatus may be implemented by hardware and/or software, and may be generally integrated in a computer device. As shown in fig. 1A, the method specifically includes the following steps:
s11, authenticating each virtual client node based on the virtual client node' S network address.
Where a virtual client node is in the sense of a virtual server node, virtualization herein means that deployment of the distributed file system is done in a virtual machine environment, i.e., with the virtual machine as a saltswitch's server node and client node. Optionally, the Virtual Machine environment is a Kernel-based Virtual Machine (KVM) Virtual Machine environment, and the KVM is an open-source system virtualization module, is completely virtualized based on hardware, and has better manageability and higher performance than other Virtual Machine environments.
The virtual server node is a manager node (master) in the saltswitch and the virtual client node is a managed node (minus) in the saltswitch, optionally one or more, and at least one virtual client node. The saltswitch is a Server infrastructure management tool, has functions of configuration management, remote execution, monitoring and the like, and is a topological architecture adopting a Server-Client (C/S) model from a small number of local network systems to a plurality of data centers, so that the response speed of a Client can be improved, and the configuration process is simpler, wherein the basic architecture of the saltswitch is shown in fig. 1B. In the Saltstack service process, all the virtual client nodes can simultaneously receive the commands sent by the virtual service node in real time, meanwhile, the communication of the virtual service node is only a set of light-weight instructions, and the virtual client nodes locally store all the commands which can be executed, so that the commands can be immediately executed and the results can be quickly returned.
In the process that the virtual server node authenticates the virtual client node, handshake initiated by the virtual client node and a carried client public key are received and authenticated through a salt-key command, and then the virtual server node returns the server public key and an Advanced Encryption Standard (AES) key to each virtual client node according to a network address corresponding to each virtual client node, so that authentication of each virtual client node is completed, and communication between the virtual server node and the virtual client node is realized. The AES key is generated by encrypting by using a corresponding client public key, so that decryption can be performed only by a corresponding virtual service end node, and the safety of a communication process is ensured.
Optionally, before authenticating each virtual client node according to the network address of the virtual client node, the method further includes: and starting the Saltstack management service according to the image file installed on the virtual machine. Wherein the image file is a customized image file of a related software package including Saltstack, and the image files installed on the virtual machines as the virtual service end node and the virtual client node are different. Before installation, the roles of the virtual machines can be determined according to the selection of a user, namely the virtual machines which are respectively used as a virtual service end node and a virtual client node are determined, and one or more virtual machines can be randomly determined to be the virtual service end node directly, and other virtual machines for deploying the distributed file system are determined to be the virtual client nodes. After the Saltstack's management service is initiated, a virtual client node-initiated handshake may be received to begin the authentication process. After the authentication is completed, the deployment process of the whole distributed file system can be realized between the virtual service end node and the virtual client end node of the Saltstack service through a Request-Reply model (Request-Reply) of a message queue (zeroMQ).
Optionally, after authenticating each virtual client node according to the network address of the virtual client node, the method further includes: and carrying out secret-free operation and time synchronization operation on the virtual client node. Specifically, a Secure Shell (SSH) key may be set for the virtual server node and sent to each virtual client node for storage, so that the virtual server node may log in each virtual server node without a password. Time synchronization of the virtual server node and all virtual client nodes is then achieved by configuring Network Time Protocol (NTP) services on the virtual server node and all virtual client nodes.
And S12, sending an instruction to the authenticated virtual client node to control the authenticated virtual client node to install the software package of the distributed file system.
In this embodiment, the distributed file system may be Ceph. After the authentication of the virtual client nodes is completed, an installation instruction can be sent to each virtual client node to control each virtual client node to install a software package of the distributed file system, wherein the software package is stored locally in each virtual client node in advance. Specifically, the installation and subsequent deployment configuration process can be implemented by using a Ceph-deploy tool, wherein the Ceph-deploy is a part of a storage system defined in Ceph and is used for conveniently configuring and managing a Ceph storage cluster. While controlling the installation of the virtual client node, the virtual server node may also perform installation of software packages for the distributed file system.
Optionally, before controlling the authenticated virtual client node to install the software package of the distributed file system, the method further includes: an installation process on the virtual client node is planned. In particular, the planning process may include allocating storage disks and log disks for each virtual client node, among others.
Optionally, after sending an instruction to the authenticated virtual client node to control the authenticated virtual client node to install the software package of the distributed file system, the method further includes: determining a node function type of the virtual client node according to the resource usage of the virtual client node, wherein the node function type comprises: a monitor, an object memory, and a monitor-cum-object memory.
Specifically, after the virtual server node completes the installation of the software of the distributed file system, i.e. a Monitor (Monitor) is created on the virtual server node, which is used for monitoring, managing and coordinating the working processes of other virtual server nodes and virtual client nodes in the whole distributed system environment, so as to ensure the data consistency in the whole distributed environment. Optionally, in the cluster of the distributed file system, the number of the nodes of which the node function type includes the monitor may be multiple, so that the whole distributed file system can still stably work in case of some node failures, and optionally, the number of the nodes of which the node function type includes the monitor may be odd, so as to form arbitration, wherein the nodes include virtual service end nodes and/or virtual client nodes.
After the virtual server node finishes the installation of the software of the distributed file system, at least one Object Storage Device (OSD) is also created on the virtual server node at the same time for storing data and objects in the cluster, processing the copying, recovery, backfilling and rebalancing of the cluster data, sending heartbeats to other OSD nodes in the cluster, providing monitoring information to a Monitor, and the like, namely the node function type of the virtual server node is Monitor and Object Storage (Monitor & OSD). When the distributed file system storage cluster has two copies of the setting data, the number of the OSD nodes is set to be at least two, so that the cluster reaches an active and clean (active + clean) state.
After controlling the virtual client nodes to complete installation of the software package, the node function type of each virtual client node can be determined according to the resource usage of each virtual client node. Specifically, as shown in fig. 1C, it may be determined that the node function type is Monitor, OSD or both Monitor and OSD by querying a disk availability status of each virtual client node, and may determine the number of OSDs that need to be created on the virtual client node, and the like. After determining the node function type of each virtual client node, a corresponding instruction may be sent to each virtual client node to control each virtual client node to create a corresponding number of monitors and/or OSDs. Optionally, OSDs may be created for all virtual client nodes to improve the storage capability of the distributed file system.
Optionally, after determining the node function type of the virtual client node, a metadata server MDS may be created for each virtual server node and the virtual client node, and is used to provide metadata calculation, caching, and synchronization for the distributed file system, so that the distributed file system uses the file system storage solution CephFS. Where the metadata is stored in the OSD nodes and the MDS is similar to a proxy cache server for the metadata.
Optionally, after sending an instruction to the authenticated virtual client node to control the authenticated virtual client node to install the software package of the distributed file system, the method further includes: and acquiring the installation progress and the running state of the distributed file system on the virtual client node.
Specifically, after controlling the virtual client node to install the software package, an installation progress query instruction may be sent to each virtual client node being installed, so as to obtain an installation progress of the software package on each virtual client node, which may specifically be an installed percentage mode or an installed file number mode, and the like. Meanwhile, an operation state checking instruction can be sent to each virtual client node to collect the states of each virtual server node and each virtual client node on the distributed file system, and further judge whether the cluster state is normal. Optionally, the operation state may include: cluster health status, cluster use status, Monitor status, OSD status, homing PG status, Monitor arbitration status, etc.
And S13, generating a configuration file of the distributed file system based on the virtual client node installed with the software package, and controlling each virtual client node to carry out configuration according to the configuration file.
Specifically, the virtual server node may generate a configuration file of the distributed file system according to a situation of deploying the virtual client node, where the configuration parameter in the configuration file may include: a network environment used within the cluster, a public network environment providing access for users, the number of copies of the logical partitions Pool in the cluster, the length of the object name, the size of the log, and the path of the cluster data store, among other things. After generating the configuration file, configuration instructions may be sent to each virtual client node to control each virtual client node to configure according to the configuration file.
Optionally, generating a configuration file of the distributed file system based on the virtual client node installed with the software package includes: and generating a configuration file according to the parameter configuration of the user on a graphical interface of the virtual service end node, wherein the parameter which is not configured by the user adopts a default value.
Specifically, the personalized configuration of the distributed file system cluster can be graphically displayed to the user on the virtual server node, and according to the actual configuration record parameter values of the user for each configuration parameter, after the user confirms that the configuration is completed, the personalized configuration parameter items of the distributed file system cluster can be determined, and the parameter items which are not changed by other users can adopt the parameter default values stored by the system. After the parameter configuration of the user is received, a configuration file can be generated according to the configuration of the user and the parameter default value, and each virtual client node is controlled to be configured according to the configuration file.
According to the technical scheme provided by the embodiment of the invention, a simple and efficient automatic deployment process of the distributed file system is realized by utilizing a server management tool (Saltstack), the expandability and the flexibility of the distributed file system are improved, and meanwhile, more convenience is provided for a user to test and rebuild the distributed file system by completing the deployment process of the distributed file system in a virtual machine environment.
Example two
Fig. 2 is a flowchart of a deployment method of a distributed file system in a virtual machine environment according to a second embodiment of the present invention, which is applied to a virtual server node. The technical solution of this embodiment is further refined on the basis of the above technical solution, and specifically, in this embodiment, before controlling the virtual client node to configure the distributed file system, the running environment of each virtual client node may be checked to determine whether the running environment of each virtual client node can satisfy the configuration condition of the distributed file system, so as to better implement the configuration process of the distributed file system. Before controlling each virtual client node to configure according to the configuration file, the method further comprises the following steps: it is checked whether the running environment of the virtual client node meets the configuration conditions of the distributed file system. Correspondingly, as shown in fig. 2, the method specifically includes the following steps:
s21, authenticating each virtual client node based on the virtual client node' S network address.
And S22, sending an instruction to the authenticated virtual client node to control the authenticated virtual client node to install the software package of the distributed file system.
S23, checking whether the running environment of the virtual client node meets the configuration condition of the distributed file system.
In particular, after the authentication of the virtual client node is completed, a context check instruction may be sent to each virtual client node to check whether the running context of each virtual machine as a virtual client node can satisfy the configuration condition of the distributed file system, i.e., the condition for configuring the distributed file system cluster. Optionally, the configuration conditions include: network connection condition, NTP service condition, cluster server time and time zone consistency, firewall policy, disk array condition and the like. And if the reply returned by the virtual client node is received and meets the configuration condition, further generating a configuration file and sending the configuration file to each virtual client node for configuration. By checking the running environment of the virtual client node in advance, the failure of configuration of the virtual client node can be reduced, and the running state can be known before configuration, so that the state problem can be processed in time.
And S24, if yes, generating a configuration file of the distributed file system based on the virtual client node installed with the software package, and controlling each virtual client node to carry out configuration according to the configuration file.
And S25, if the running environment of at least one virtual client node does not meet the configuration condition, controlling the unsatisfied virtual client node to clean the running environment.
Specifically, if the running environment of at least one virtual client node in each virtual client node does not satisfy the configuration condition of the distributed file system, an environment cleaning instruction is sent to the virtual client node which does not satisfy the configuration condition, so as to solve the existing state problem. Optionally, for other virtual client nodes meeting the configuration condition, the configuration process of the system may be performed first, so as to reduce the influence on the configuration progress of the overall system due to the state problem of a few virtual client nodes.
S26, the operation environment of the virtual client node whose operation environment does not satisfy the configuration condition is checked again, and if not, the administrator is notified to perform configuration.
After the virtual client node which does not satisfy the configuration condition completes the environment cleaning process, after receiving a cleaning completion message returned by the virtual client node, sending an environment check instruction to the virtual client node which does not satisfy the configuration condition again to check whether the operating environment satisfies the configuration condition of the distributed file system again, and if the reply returned by the virtual client node is that the configuration condition is satisfied, further generating a configuration file and sending the configuration file to each virtual client node which does not complete the configuration for configuration. If the configuration condition of the distributed file system cannot be met, the administrator can be informed to configure the running environment, and can determine whether further configuration needs to be carried out on the virtual client node and parameters and the like required by configuration according to the configuration condition of the administrator, and particularly, the administrator can be informed to carry out configuration on the virtual server node and send the content of the configuration of the administrator to the specified virtual client node.
According to the technical scheme provided by the embodiment of the invention, the running environments of the virtual client nodes are checked in advance to determine whether the running environments of the virtual client nodes can meet the configuration conditions of the distributed file system, the running environments of the virtual client nodes which do not meet the configuration conditions are cleaned, and the virtual client nodes which are still not met after cleaning are notified to an administrator for configuration, so that the failure condition of the configuration of the virtual client nodes is reduced, the running states of the virtual client nodes are known before configuration, and the state problem is processed in time.
EXAMPLE III
Fig. 3 is a schematic structural diagram of a deployment apparatus of a distributed file system in a virtual machine environment according to a third embodiment of the present invention, which is applied to a virtual server node. The apparatus, which may be implemented by hardware and/or software, may be generally integrated in a computer device and configured to perform the method for deploying a distributed file system in a virtual machine environment according to any embodiment of the present invention. As shown in fig. 3, the apparatus includes:
a node authentication module 31, configured to authenticate each virtual client node according to the network address of the virtual client node;
the system installation module 32 is configured to send an instruction to the authenticated virtual client node to control the authenticated virtual client node to install the software package of the distributed file system;
and the system configuration module 33 is configured to generate a configuration file of the distributed file system based on the virtual client node to which the software package is installed, and control each virtual client node to perform configuration according to the configuration file.
According to the technical scheme provided by the embodiment of the invention, a simple and efficient automatic deployment process of the distributed file system is realized by utilizing a server management tool (Saltstack), the expandability and the flexibility of the distributed file system are improved, and meanwhile, more convenience is provided for a user to test and rebuild the distributed file system by completing the deployment process of the distributed file system in a virtual machine environment.
On the basis of the foregoing technical solution, optionally, the deployment apparatus of the distributed file system in a virtual machine environment further includes:
the function determining module is used for determining the node function type of the virtual client node according to the resource use condition of the virtual client node after sending an instruction to the authenticated virtual client node to control the authenticated virtual client node to install the software package of the distributed file system, wherein the node function type comprises the following steps: a monitor, an object memory, and a monitor-cum-object memory.
On the basis of the foregoing technical solution, optionally, the deployment apparatus of the distributed file system in a virtual machine environment further includes:
and the configuration management module is used for performing secret-free operation and time synchronization operation on the virtual client nodes after authenticating each virtual client node according to the network address of the virtual client node.
On the basis of the foregoing technical solution, optionally, the deployment apparatus of the distributed file system in a virtual machine environment further includes:
and the environment management module is used for checking whether the running environment of each virtual client node meets the configuration condition of the distributed file system or not before controlling each virtual client node to carry out configuration according to the configuration file.
On the basis of the above technical solution, optionally, the environment management module is further configured to:
after checking whether the running environment of the virtual client node meets the configuration condition of the distributed file system, if the running environment of at least one virtual client node does not meet the configuration condition, controlling the unsatisfied virtual client node to clean the running environment;
and checking the running environment of the virtual client node of which the running environment does not meet the configuration condition again, and if the running environment is not met, informing an administrator to perform configuration.
On the basis of the foregoing technical solution, optionally, the deployment apparatus of the distributed file system in a virtual machine environment further includes:
and the system state acquisition module is used for transmitting an instruction to the authenticated virtual client node to control the authenticated virtual client node to install the software package of the distributed file system, and then acquiring the installation progress and the running state of the distributed file system on the virtual client node.
On the basis of the above technical solution, optionally, the system configuration module 33 includes:
and the configuration file generating unit is used for generating a configuration file according to the parameter configuration performed by the user on the graphical interface of the virtual service end node, wherein the parameter which is not configured by the user adopts a default value.
The deployment device of the distributed file system in the virtual machine environment provided by the embodiment of the invention can execute the deployment method of the distributed file system in the virtual machine environment provided by any embodiment of the invention, and has corresponding functional modules and beneficial effects of the execution method.
It should be noted that, in the embodiment of the device for deploying a distributed file system in a virtual machine environment, each unit and each module included in the distributed file system are only divided according to functional logic, but are not limited to the above division as long as corresponding functions can be implemented; in addition, specific names of the functional units are only for convenience of distinguishing from each other, and are not used for limiting the protection scope of the present invention.
Example four
Fig. 4 is a schematic structural diagram of a computer device according to a fourth embodiment of the present invention, which shows a block diagram of an exemplary computer device suitable for implementing the embodiment of the present invention. The computer device shown in fig. 4 is only an example, and should not bring any limitation to the function and the scope of use of the embodiments of the present invention. As shown in fig. 4, the computer apparatus includes a processor 41, a memory 42, an input device 43, and an output device 44; the number of the processors 41 in the computer device may be one or more, one processor 41 is taken as an example in fig. 4, the processor 41, the memory 42, the input device 43 and the output device 44 in the computer device may be connected by a bus or in other ways, and the connection by the bus is taken as an example in fig. 4.
The memory 42 is used as a computer readable storage medium for storing software programs, computer executable programs, and modules, such as program instructions/modules corresponding to the deployment method of the distributed file system in the virtual machine environment in the embodiment of the present invention (for example, the node authentication module 31, the system installation module 32, and the system configuration module 33 in the deployment apparatus of the distributed file system in the virtual machine environment). The processor 41 executes various functional applications and data processing of the computer device by executing software programs, instructions and modules stored in the memory 42, that is, implements the deployment method of the distributed file system in the virtual machine environment.
The memory 42 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required for at least one function; the storage data area may store data created according to use of the computer device, and the like. Further, the memory 42 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid state storage device. In some examples, memory 42 may further include memory located remotely from processor 41, which may be connected to the mobile terminal through a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The input means 43 may be used for receiving user-entered values of configuration parameters and may also be used for receiving control signals or response signals transmitted by other system nodes and for generating key signal inputs related to user settings and function control of the computer device. The output device 44 may be configured to send a control signal or a response signal to other system nodes, and may further include a display device such as a display screen, which may be configured to display the parameter items to be configured to the user.
EXAMPLE five
An embodiment of the present invention further provides a storage medium containing computer-executable instructions, where the computer-executable instructions, when executed by a computer processor, are configured to perform a method for deploying a distributed file system in a virtual machine environment, where the method includes:
authenticating each virtual client node according to the network address of the virtual client node;
sending an instruction to the authenticated virtual client node to control the authenticated virtual client node to install a software package of the distributed file system;
and generating a configuration file of the distributed file system based on the virtual client nodes provided with the software package, and controlling each virtual client node to configure according to the configuration file.
Storage medium-any of various types of memory devices or storage devices. The term "storage medium" is intended to include: mounting media such as CD-ROM, floppy disk, or tape devices; computer system memory or random access memory such as DRAM, DDR RAM, SRAM, EDO RAM, Lanbas (Rambus) RAM, etc.; non-volatile memory such as flash memory, magnetic media (e.g., hard disk or optical storage); registers or other similar types of memory elements, etc. The storage medium may also include other types of memory or combinations thereof. In addition, the storage medium may be located in the computer system in which the program is executed, or may be located in a different second computer system connected to the computer system through a network (such as the internet). The second computer system may provide the program instructions to the computer for execution. The term "storage medium" may include two or more storage media that may reside in different locations, such as in different computer systems that are connected by a network. The storage medium may store program instructions (e.g., embodied as a computer program) that are executable by one or more processors.
Of course, the storage medium containing the computer-executable instructions provided by the embodiments of the present invention is not limited to the method operations described above, and may also perform related operations in the deployment method of the distributed file system in the virtual machine environment provided by any embodiment of the present invention.
A computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.
Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.
From the above description of the embodiments, it is obvious for those skilled in the art that the present invention can be implemented by software and necessary general hardware, and certainly, can also be implemented by hardware, but the former is a better embodiment in many cases. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which may be stored in a computer-readable storage medium, such as a floppy disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a FLASH Memory (FLASH), a hard disk or an optical disk of a computer, and includes several instructions for enabling a computer device (which may be a personal computer, a server, or a network device) to execute the methods according to the embodiments of the present invention.
It is to be noted that the foregoing is only illustrative of the preferred embodiments of the present invention and the technical principles employed. It will be understood by those skilled in the art that the present invention is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the invention. Therefore, although the present invention has been described in greater detail by the above embodiments, the present invention is not limited to the above embodiments, and may include other equivalent embodiments without departing from the spirit of the present invention, and the scope of the present invention is determined by the scope of the appended claims.
Claims (10)
1. A deployment method of a distributed file system in a virtual machine environment is applied to a virtual server node, and is characterized by comprising the following steps:
authenticating each virtual client node according to the network address of the virtual client node;
sending an instruction to the authenticated virtual client node to control the authenticated virtual client node to install a software package of the distributed file system;
and generating a configuration file of the distributed file system based on the virtual client node provided with the software package, and controlling each virtual client node to carry out configuration according to the configuration file.
2. The method for deploying a distributed file system in a virtual machine environment according to claim 1, wherein after the sending an instruction to the authenticated virtual client node to control the authenticated virtual client node to perform installation of a software package of the distributed file system, the method further comprises:
determining a node function type of the virtual client node according to the resource usage of the virtual client node, wherein the node function type comprises: a monitor, an object memory, and a monitor-cum-object memory.
3. The method for deploying a distributed file system in a virtual machine environment according to claim 1, wherein after authenticating each of the virtual client nodes according to the network address of the virtual client node, the method further comprises:
and carrying out secret-free operation and time synchronization operation on the virtual client node.
4. The method for deploying a distributed file system in a virtual machine environment according to claim 1, wherein before said controlling each of the virtual client nodes to configure according to the configuration file, the method further comprises:
checking whether the running environment of the virtual client node meets the configuration condition of the distributed file system.
5. The method for deploying a distributed file system in a virtual machine environment according to claim 4, further comprising, after said checking whether the running environment of the virtual client node satisfies the configuration condition of the distributed file system:
if the running environment of at least one virtual client node does not meet the configuration condition, controlling the unsatisfied virtual client node to clean the running environment;
and checking the running environment of the virtual client node of which the running environment does not meet the configuration condition again, and if the running environment is not met, informing an administrator to perform configuration.
6. The method for deploying a distributed file system in a virtual machine environment according to claim 1, wherein after the sending an instruction to the authenticated virtual client node to control the authenticated virtual client node to perform installation of a software package of the distributed file system, the method further comprises:
and acquiring the installation progress and the running state of the distributed file system on the virtual client node.
7. The method for deploying the distributed file system in the virtual machine environment according to claim 1, wherein the generating the configuration file of the distributed file system based on the virtual client node on which the software package is installed comprises:
and generating the configuration file according to the parameter configuration of the user on a graphical interface of the virtual service end node, wherein the parameter which is not configured by the user adopts a default value.
8. A distributed file system deployment device in a virtual machine environment is applied to a virtual server node, and is characterized by comprising:
the node authentication module is used for authenticating each virtual client node according to the network address of the virtual client node;
the system installation module is used for sending an instruction to the authenticated virtual client node so as to control the authenticated virtual client node to install a software package of the distributed file system;
and the system configuration module is used for generating a configuration file of the distributed file system based on the virtual client node provided with the software package and controlling each virtual client node to carry out configuration according to the configuration file.
9. A computer device, comprising:
one or more processors;
a memory for storing one or more programs;
when executed by the one or more processors, cause the one or more processors to implement a method for deploying a distributed file system in a virtual machine environment as claimed in any one of claims 1 to 7.
10. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out a method for deploying a distributed file system according to any one of claims 1 to 7 in a virtual machine environment.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010442858.9A CN111625496B (en) | 2020-05-22 | 2020-05-22 | Deployment method, device and equipment of distributed file system in virtual machine environment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010442858.9A CN111625496B (en) | 2020-05-22 | 2020-05-22 | Deployment method, device and equipment of distributed file system in virtual machine environment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111625496A true CN111625496A (en) | 2020-09-04 |
| CN111625496B CN111625496B (en) | 2023-08-15 |
Family
ID=72271074
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010442858.9A Active CN111625496B (en) | 2020-05-22 | 2020-05-22 | Deployment method, device and equipment of distributed file system in virtual machine environment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111625496B (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112783610A (en) * | 2021-01-30 | 2021-05-11 | 柏科数据技术（深圳）股份有限公司 | Saltstack-based Ceph deployment host node |
| CN112860276A (en) * | 2021-01-28 | 2021-05-28 | 北京北信源软件股份有限公司 | Distributed file system deployment method, device, server and storage medium |
| CN114443066A (en) * | 2021-12-24 | 2022-05-06 | 苏州浪潮智能科技有限公司 | Client installation method and device for big data cluster and storage medium |
| CN114584600A (en) * | 2022-01-20 | 2022-06-03 | 国网青海省电力公司 | Data audit monitoring system |
| CN114816444A (en) * | 2021-01-28 | 2022-07-29 | 网联清算有限公司 | Method and device for deploying monitoring program, electronic equipment and storage medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20130219387A1 (en) * | 2012-02-22 | 2013-08-22 | Vmware, Inc. | Establishing secure two-way communications in a virtualization platform |
| US8739257B1 (en) * | 2012-03-28 | 2014-05-27 | Emc Corporation | Managing authentication of virtual clients |
| CN110413285A (en) * | 2019-07-29 | 2019-11-05 | 深圳前海达闼云端智能科技有限公司 | Method for deploying cloud service and method for developing cloud service |
| CN110597596A (en) * | 2019-08-15 | 2019-12-20 | 苏州浪潮智能科技有限公司 | VMware-based service authentication method, equipment and readable medium |
-
2020
- 2020-05-22 CN CN202010442858.9A patent/CN111625496B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20130219387A1 (en) * | 2012-02-22 | 2013-08-22 | Vmware, Inc. | Establishing secure two-way communications in a virtualization platform |
| US8739257B1 (en) * | 2012-03-28 | 2014-05-27 | Emc Corporation | Managing authentication of virtual clients |
| CN110413285A (en) * | 2019-07-29 | 2019-11-05 | 深圳前海达闼云端智能科技有限公司 | Method for deploying cloud service and method for developing cloud service |
| CN110597596A (en) * | 2019-08-15 | 2019-12-20 | 苏州浪潮智能科技有限公司 | VMware-based service authentication method, equipment and readable medium |
Non-Patent Citations (1)
| Title |
|---|
| 运维饺子: "使用saltstack给minion自动化安装httpd及配置管理" * |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112860276A (en) * | 2021-01-28 | 2021-05-28 | 北京北信源软件股份有限公司 | Distributed file system deployment method, device, server and storage medium |
| CN114816444A (en) * | 2021-01-28 | 2022-07-29 | 网联清算有限公司 | Method and device for deploying monitoring program, electronic equipment and storage medium |
| CN112783610A (en) * | 2021-01-30 | 2021-05-11 | 柏科数据技术（深圳）股份有限公司 | Saltstack-based Ceph deployment host node |
| CN114443066A (en) * | 2021-12-24 | 2022-05-06 | 苏州浪潮智能科技有限公司 | Client installation method and device for big data cluster and storage medium |
| CN114584600A (en) * | 2022-01-20 | 2022-06-03 | 国网青海省电力公司 | Data audit monitoring system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111625496B (en) | 2023-08-15 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111625496B (en) | Deployment method, device and equipment of distributed file system in virtual machine environment | |
| CN111625497B (en) | Deployment method, device and equipment of distributed file system and storage medium | |
| US10698717B2 (en) | Accelerator virtualization method and apparatus, and centralized resource manager | |
| US9535609B2 (en) | Automatically managing the storage of a virtual machine | |
| JP6712318B2 (en) | Method, apparatus, and computer program for managing multiple VPN tunnels between a first cloud and a second cloud in a hybrid cloud environment | |
| US7418702B2 (en) | Concurrent web based multi-task support for control management system | |
| JP6707153B2 (en) | Secure configuration of cloud computing nodes | |
| EP2862065B1 (en) | Intermediary virtual machine task management | |
| US9817657B2 (en) | Integrated software development and deployment architecture and high availability client-server systems generated using the architecture | |
| EP2622484B1 (en) | Debugger launch and attach on compute clusters | |
| KR20190082926A (en) | Messaging Protocol Communication Management | |
| JP2017112607A (en) | Dynamically defined virtual private network tunnel in hybrid cloud environments | |
| CN106911648B (en) | Environment isolation method and equipment | |
| EP3780485A1 (en) | Accessing security hardware keys | |
| US9021008B1 (en) | Managing targeted scripts | |
| US8903096B2 (en) | Security key distribution in a cluster | |
| US10122602B1 (en) | Distributed system infrastructure testing | |
| CN112035062A (en) | Migration method of local storage of cloud computing, computer equipment and storage medium | |
| CN110545320A (en) | Intranet data interaction method and equipment | |
| CN112506705B (en) | Distributed storage configuration information backup method and device | |
| CN110221910B (en) | Method and apparatus for performing MPI jobs | |
| Gulotta | Real time, dynamic cloud offloading for self-driving vehicles with secure and reliable automatic switching between local and edge computing | |
| CN116192853B (en) | Multi-cluster management method | |
| CN103118141B (en) | A kind of cloud dispositions method towards multinode | |
| CN112506704B (en) | Configuration information backup method and device for gateway of Internet of things |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information |
Address after: No.3333 Liuxian Avenue, Fuguang community, Taoyuan Street, Nanshan District, Shenzhen, Guangdong 518000 Applicant after: BAIKE DATA TECHNOLOGY (SHENZHEN) CO.,LTD. Address before: 518000 room 701-c, 7th floor, bike technology, No.9, Keke Road, high tech Zone, Nanshan District, Shenzhen City, Guangdong Province Applicant before: BAIKE DATA TECHNOLOGY (SHENZHEN) CO.,LTD. |
|
| CB02 | Change of applicant information | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |