CN114489701A

CN114489701A - Configuration method and device of artificial intelligence software deployment environment and electronic equipment

Info

Publication number: CN114489701A
Application number: CN202210109118.2A
Authority: CN
Inventors: 刘坚
Original assignee: 4Paradigm Beijing Technology Co Ltd
Current assignee: 4Paradigm Beijing Technology Co Ltd
Priority date: 2022-01-28
Filing date: 2022-01-28
Publication date: 2022-05-13

Abstract

The embodiment of the application discloses a configuration method and device of an artificial intelligence software deployment environment and electronic equipment, relates to the technical field of artificial intelligence, and aims to improve the configuration efficiency of the artificial intelligence software deployment environment. The method comprises the following steps: the current node analyzes a preset first configuration file and determines role information of a target node; the preset first configuration file comprises role information of nodes; the current node determines the environment configuration information of the target node according to the role information of the target node; and the current node sends the environment configuration information to the target node so that the target node receives the environment configuration information and executes environment configuration operation according to the environment configuration information. The method and the device are suitable for configuring the deployment environment of the artificial intelligence software.

Description

Configuration method and device of artificial intelligence software deployment environment and electronic equipment

Technical Field

The present application relates to the field of artificial intelligence technologies, and in particular, to a configuration method and apparatus for an artificial intelligence software deployment environment, an electronic device, a readable storage medium, and a deployment system.

Background

With the development of the technology, artificial intelligence software is mostly distributed architecture, so that when the artificial intelligence software is deployed, a plurality of nodes are involved, and the roles (functions) of the nodes are different, so that the environments for deploying the artificial intelligence software by each node are different, and for such situations, in the prior art, the plurality of nodes need to be manually configured one by one, which results in lower configuration efficiency of the artificial intelligence software deployment environment.

Disclosure of Invention

In view of this, embodiments of the present application provide a configuration method, an apparatus, an electronic device, a readable storage medium, and a deployment system for an artificial intelligence software deployment environment, which can improve configuration efficiency of the artificial intelligence software deployment environment.

In a first aspect, an embodiment of the present application provides a configuration method for an artificial intelligence software deployment environment, which is applied to a current node, and includes: analyzing a preset first configuration file, and determining role information of a target node; the preset first configuration file comprises role information of nodes; determining environment configuration information of the target node according to the role information of the target node; and sending the environment configuration information to the target node so that the target node receives the environment configuration information and executes environment configuration operation according to the environment configuration information.

According to a specific implementation manner of the embodiment of the present application, the determining the environment configuration information of the target node according to the role information of the target node includes: determining an environment configuration task corresponding to the role information according to the role information of the target node; and analyzing the environment configuration task to obtain environment configuration information corresponding to the environment configuration task.

According to a specific implementation manner of the embodiment of the application, an automatic operation and maintenance tool runs on the current node; the determining, according to the role information of the target node, an environment configuration task corresponding to the role information includes: according to the role information of the target node, determining an environment configuration task corresponding to the role information in a second configuration file of the automatic operation and maintenance tool; and the configuration file is arranged with an environment configuration task corresponding to the role information.

According to a specific implementation manner of the embodiment of the application, the target nodes comprise at least two target nodes; the determining the environment configuration information of the target node according to the role information of the target node comprises: determining the environment configuration information of each target node in the at least two target nodes as first environment configuration information according to the role information of the at least two target nodes; the sending the environment configuration information to the target node to enable the target node to receive the environment configuration information and execute environment configuration operation according to the environment configuration information includes: and sending the first environment configuration information to the at least two target nodes, so that the at least two target nodes respectively receive the first environment configuration information and respectively execute environment configuration operation according to the first environment configuration information.

According to a specific implementation manner of the embodiment of the application, the environment configuration information includes resource package information and installation or configuration information corresponding to the resource package; the sending the environment configuration information to the target node to enable the target node to receive the environment configuration information and execute environment configuration operation according to the environment configuration information includes: sending the resource package information in the environment configuration information and installation or configuration information corresponding to the resource package to the target node; receiving an acquisition request for the resource packet sent by the target node; and sending the resource packet to the target node according to the acquisition request so that the target node installs or configures the resource packet according to the installation or configuration information corresponding to the resource packet.

According to a specific implementation manner of the embodiment of the present application, if the acquisition request includes an IP address and the port number, before the sending the resource packet to the target node according to the acquisition request, the method further includes: establishing an offline source and creating a transmission service, wherein the offline source comprises the resource package; sending offline source configuration information to the target node, wherein the offline source configuration information comprises an IP address of a current node and a port number corresponding to the transmission service; the sending the resource packet to the target node according to the acquisition request includes: determining the transmission service according to the IP address and the port number in the acquisition request; and sending the resource packet to the target node according to the transmission service.

According to a specific implementation manner of the embodiment of the present application, the environment configuration information includes at least one of: the method comprises the following steps of password-free login information, operating system kernel upgrading information, firewall upgrading information, selinux upgrading information, docker configuration optimization, kubernets configuration optimization, software dependence package installation information, installation user information, offline source configuration information, Hosts installation configuration information, disk partition mounting information, JDK installation configuration information, NFS installation configuration information, NTP installation configuration information, Hadoop installation configuration information, middleware installation configuration information, GPU drive installation information, Mysql installation configuration information and CDH5.14.2(scm) installation configuration information.

In a second aspect, an embodiment of the present application provides a configuration method for an artificial intelligence software deployment environment, which is applied to a target node, and includes: receiving environment configuration information sent by a current node; wherein the environment configuration information is determined by the current node according to the role information of the target node; and executing environment configuration operation according to the environment configuration information.

According to a specific implementation manner of the embodiment of the application, the environment configuration information includes resource package information and installation or configuration information corresponding to the resource package; the receiving the environment configuration information sent by the current node includes: receiving the resource package information in the environment configuration information sent by the current node and the installation or configuration information corresponding to the resource package; the executing the environment configuration operation according to the environment configuration information comprises: sending an acquisition request for the resource packet to the current node according to the resource packet information; receiving the resource packet sent by the current node; and installing or configuring the resource package according to the corresponding installation or configuration information of the resource package.

According to a specific implementation manner of the embodiment of the present application, before the receiving the resource packet sent by the current node, the method further includes: receiving offline source configuration information sent by the current node, wherein the offline source configuration information comprises an IP address of the current node and a port number corresponding to a transmission service; the sending the request for acquiring the resource packet to the current node according to the resource packet information includes: and sending an acquisition request for the resource packet to the current node according to the resource packet information, wherein the acquisition request comprises an IP address and the port number, so that the current node determines the transmission service according to the IP address and the port number.

In a third aspect, an embodiment of the present application provides a configuration apparatus for an artificial intelligence software deployment environment, which is applied to a current node, and includes: the analysis module is used for analyzing a preset first configuration file and determining role information of the target node; the preset first configuration file comprises role information of nodes; the determining module is used for determining the environment configuration information of the target node according to the role information of the target node; a first sending module, configured to send the environment configuration information to the target node, so that the target node receives the environment configuration information, and executes an environment configuration operation according to the environment configuration information.

According to a specific implementation manner of the embodiment of the present application, the determining module includes: the determining submodule is used for determining an environment configuration task corresponding to the role information according to the role information of the target node; and the analysis submodule is used for analyzing the environment configuration task to obtain environment configuration information corresponding to the environment configuration task.

According to a specific implementation manner of the embodiment of the application, an automatic operation and maintenance tool runs on the current node; the determining submodule is specifically configured to: according to the role information of the target node, determining an environment configuration task corresponding to the role information in a second configuration file of the automatic operation and maintenance tool; and the configuration file is arranged with an environment configuration task corresponding to the role information.

According to a specific implementation manner of the embodiment of the application, the target nodes comprise at least two target nodes; the determining module is specifically configured to: determining the environment configuration information of each target node in the at least two target nodes as first environment configuration information according to the role information of the at least two target nodes; the first sending module is specifically configured to: and sending the first environment configuration information to the at least two target nodes, so that the at least two target nodes respectively receive the first environment configuration information and respectively execute environment configuration operation according to the first environment configuration information.

According to a specific implementation manner of the embodiment of the application, the environment configuration information includes resource package information and installation or configuration information corresponding to the resource package; the first sending module includes: the first sending submodule is used for sending the resource package information in the environment configuration information and the installation or configuration information corresponding to the resource package to the target node; the receiving submodule is used for receiving the acquisition request of the resource packet sent by the target node; and the second sending submodule is used for sending the resource packet to the target node according to the acquisition request so that the target node installs or configures the resource packet according to the installation or configuration information corresponding to the resource packet.

According to a specific implementation manner of the embodiment of the present application, if the obtaining request includes an IP address and the port number, the apparatus further includes: the establishing module is used for establishing an offline source and establishing transmission service before the second sending submodule sends the resource packet to the target node according to the acquisition request; wherein the offline source comprises the resource package; a second sending module, configured to send offline source configuration information to the target node, where the offline source configuration information includes an IP address of a current node and a port number corresponding to the transmission service; the second sending submodule is specifically configured to: determining the transmission service according to the IP address and the port number in the acquisition request; and sending the resource packet to the target node according to the transmission service.

According to a specific implementation manner of the embodiment of the present application, the environment configuration information includes at least one of the following: the method comprises the following steps of password-free login information, operating system kernel upgrading information, firewall upgrading information, selinux upgrading information, docker configuration optimization, kubernets configuration optimization, software dependence package installation information, installation user information, offline source configuration information, Hosts installation configuration information, disk partition mounting information, JDK installation configuration information, NFS installation configuration information, NTP installation configuration information, Hadoop installation configuration information, middleware installation configuration information, GPU drive installation information, Mysql installation configuration information and CDH5.14.2(scm) installation configuration information.

In a fourth aspect, an embodiment of the present application provides a configuration apparatus for an artificial intelligence software deployment environment, which is applied to a target node, and includes: the first receiving module is used for receiving the environment configuration information sent by the current node; the environment configuration information is determined by the current node according to the role information of the target node; and the execution module is used for executing the environment configuration operation according to the environment configuration information.

According to a specific implementation manner of the embodiment of the application, the environment configuration information includes resource package information and installation or configuration information corresponding to the resource package; the first receiving module comprises: the receiving submodule is used for receiving the resource package information in the environment configuration information sent by the current node and the installation or configuration information corresponding to the resource package; the execution module includes: the sending submodule is used for sending an acquisition request of the resource packet to the current node according to the resource packet information; a receiving sub-module for receiving the data,

the resource packet is used for receiving the resource packet sent by the current node; and the installation or configuration module is used for installing or configuring the resource package according to the installation or configuration information corresponding to the resource package.

According to a specific implementation manner of the embodiment of the present application, the apparatus further includes: a second receiving module, configured to receive, before the receiving sub-module receives the resource packet sent by the current node, offline source configuration information sent by the current node, where the offline source configuration information includes an IP address of the current node and a port number corresponding to a transmission service; the sending submodule is specifically configured to: and sending an acquisition request for the resource packet to the current node according to the resource packet information, wherein the acquisition request comprises an IP address and the port number, so that the current node determines the transmission service according to the IP address and the port number.

In a fifth aspect, an embodiment of the present application provides an electronic device, where the electronic device includes: the device comprises a shell, a processor, a memory, a circuit board and a power circuit, wherein the circuit board is arranged in a space enclosed by the shell, and the processor and the memory are arranged on the circuit board; a power supply circuit for supplying power to each circuit or device of the electronic apparatus; the memory is used for storing executable program codes; the processor executes a program corresponding to the executable program code by reading the executable program code stored in the memory, and is used for executing the configuration method of the artificial intelligence software deployment environment according to any one of the foregoing implementation modes.

In a sixth aspect, an embodiment of the present application provides a computer-readable storage medium, where the computer-readable storage medium stores one or more programs, and the one or more programs are executable by one or more processors to implement the configuration method for an artificial intelligence software deployment environment according to any one of the foregoing implementation manners.

In a seventh aspect, a deployment system of artificial intelligence software in an embodiment of the present application includes: a first node and a second node; the first node is used for analyzing a preset first configuration file and determining role information of a target node; the preset first configuration file comprises role information of nodes; determining environment configuration information of the target node according to the role information of the target node; sending the environment configuration information to the target node; and the second node is used for receiving the environment configuration information and executing environment configuration operation according to the environment configuration information.

According to a specific implementation manner of the embodiment of the present application, the first node includes: the analysis module is specifically used for analyzing a preset first configuration file and determining role information of the second node; the preset first configuration file comprises role information of nodes; a determining module, configured to determine environment configuration information of the second node according to the role information of the second node; a sending module, configured to send the environment configuration information to the second node; the second node comprises: and the execution module is specifically used for receiving the environment configuration information and executing environment configuration operation according to the environment configuration information.

According to a specific implementation manner of the embodiment of the present application, the determining module includes: the determining submodule is used for determining an environment configuration task corresponding to the role information according to the role information of the second node; and the analysis submodule is used for analyzing the environment configuration task to obtain environment configuration information corresponding to the environment configuration task.

According to a specific implementation manner of the embodiment of the application, an automatic operation and maintenance tool runs on the first node; the determining submodule is specifically configured to: according to the role information of the second node, determining an environment configuration task corresponding to the role information in a second configuration file of the automatic operation and maintenance tool; and the configuration file is arranged with an environment configuration task corresponding to the role information.

According to a specific implementation manner of the embodiment of the present application, the second nodes include at least two second nodes; the determining module is specifically configured to: determining that the environment configuration information of each second node in the at least two second nodes is first environment configuration information according to the role information of the at least two second nodes; the sending module is specifically configured to: the first node sends the first environment configuration information to the at least two second nodes; the execution module of each second node is specifically configured to: and receiving the first environment configuration information, and executing environment configuration operation according to the first environment configuration information.

According to a specific implementation manner of the embodiment of the application, the environment configuration information includes resource package information and installation or configuration information corresponding to the resource package; the execution module includes: the receiving submodule is used for receiving the resource package information in the environment configuration information and the installation or configuration information corresponding to the resource package; the obtaining submodule is used for obtaining the resource packet from the first node according to the resource packet information; and the installation or configuration sub-module is used for installing or configuring the resource package according to the installation or configuration information corresponding to the resource package.

According to a specific implementation manner of the embodiment of the present application, before the second node acquires the resource package from the first node according to the resource package information, the execution module further includes: the creating submodule is used for creating an offline source and creating transmission service before the obtaining submodule obtains the resource packet from the first node according to the resource packet information; wherein the offline source comprises the resource package; a sending submodule, configured to send offline source configuration information to the second node, where the offline source configuration information includes an IP address of a current node and a port number corresponding to the transmission service; the obtaining submodule is specifically configured to: and acquiring the resource packet from the first node through the IP address and the port number according to the resource packet information.

According to the configuration method, the configuration device, the electronic device, the readable storage medium and the deployment system of the artificial intelligence software deployment environment, the current node analyzes the preset first configuration file, determines the role information of the target node, the current node determines the environment configuration information of the target node according to the role information of the target node and sends the information to the target node, and the target node executes environment configuration operation according to the environment configuration information after receiving the environment configuration information.

Drawings

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present application, and other drawings can be obtained by those skilled in the art without creative efforts.

FIG. 1 is a schematic flowchart illustrating a configuration method for an artificial intelligence software deployment environment according to an embodiment of the present disclosure;

FIG. 2 is an architecture diagram of an artificial intelligence software deployment delivery provided by an embodiment of the present application;

FIG. 3 is a schematic structural diagram of a deployment system of artificial intelligence software according to an embodiment of the present application;

fig. 4 is a schematic structural diagram of an electronic device according to an embodiment of the present application.

Detailed Description

The embodiments of the present application will be described in detail below with reference to the accompanying drawings. It should be understood that the embodiments described are only a few embodiments of the present application, and not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.

When the existing proprietary deployment delivery of Artificial Intelligence (AI) software is delivered, the following pain points exist in the deployment stage: 1. the client provides various server and virtual machine instances, the same operating system version is inconsistent, the installation method is inconsistent, the system kernel version is different, the kernel parameter configuration is different, the video card model is different, and the like, which causes great challenges for software installation compatibility and reduces deployment delivery efficiency and quality; 2. off-line: for customers with strict requirements on network security, such as finance, banks, military industry and the like, installation and deployment need to be carried out off line, and a large amount of external network resources are needed for a standardized part; batch and accuracy: the AI product has higher computational demand, more server instances are needed for software deployment, and in the process, if no automatic and batch operation mode exists, manual installation and configuration are carried out manually, so that a great amount of time waste and accuracy loss are inevitably caused; diversity: AI software and application scenes are various, and a plurality of personalized requirements are also provided for deployment and delivery, which puts forward high requirements for deployment tools, and iteration and component addition are required to be continuously performed on the framework to meet the personalized requirements for deployment and delivery of existing and continuously added products.

In view of the above, the present application provides a configuration method of an AI software deployment environment to solve the above problems.

In order to make those skilled in the art better understand the technical concepts, embodiments and advantages of the examples of the present application, the following detailed description is given by way of specific examples.

An embodiment of the present application provides a configuration method for an artificial intelligence software deployment environment, including: the current node analyzes a preset first configuration file and determines role information of a target node; the preset first configuration file comprises role information of nodes; the current node determines the environment configuration information of the target node according to the role information of the target node; the current node sends the environment configuration information to the target node; and the target node receives the environment configuration information and executes environment configuration operation according to the environment configuration information, so that the configuration efficiency of the artificial intelligent software deployment environment can be improved.

Fig. 1 is a schematic flowchart of a configuration method of an artificial intelligence software deployment environment according to an embodiment of the present application, and as shown in fig. 1, the configuration method of the artificial intelligence software deployment environment according to the embodiment may include:

s101, the current node analyzes a preset first configuration file and determines role information of a target node.

Artificial Intelligence (AI) software may be an application that uses a computer to simulate certain mental processes and intelligent behaviors of a human.

The AI software in this embodiment may be a distributed architecture and needs to be deployed on multiple nodes. The current node is one of the plurality of nodes on which the AI software is deployed, and the target node is the node on which the AI software is to be deployed. It is understood that the current node may also be the target node.

In this embodiment, the preset first configuration file includes role information of the node.

The role information of the nodes included in the preset first configuration file can be determined according to the device resources provided by the user before the AI software is deployed, specifically, the installation topology and the architecture of the AI software are provided according to the number of the nodes (servers) provided by the user and the network connection condition, the roles are allocated to each node, and different nodes can have multiple roles. In some examples, according to the role (function) division of the nodes in the AI software operation process, the nodes are mainly divided into: k8s (kubernets) management nodes, k8s performance nodes, middleware nodes, Hadoop (Hadoop) management nodes, Hadoop function nodes, offline source deployment nodes, and/or mysql deployment nodes, among others.

S102, the current node determines the environment configuration information of the target node according to the role information of the target node.

In the process of deploying or operating the AI software, nodes in different roles need to have different environments.

The environment configuration information in this embodiment is used to perform environment configuration on the target node.

S103, the current node sends environment configuration information to the target node.

In this embodiment, the environment configuration information is sent from the current node to the target node.

And S104, the target node receives the environment configuration information and executes environment configuration operation according to the environment configuration information.

After receiving the environment configuration information, the target node may perform an environment configuration operation according to the environment configuration information, thereby implementing configuration of the environment of the target node.

In this embodiment, the current node parses a preset first configuration file, determines role information of a target node, and then the current node determines environment configuration information of the target node according to the role information of the target node and sends the information to the target node, and after receiving the environment configuration information, the target node performs environment configuration operation according to the environment configuration information.

The present application further embodiment is basically the same as the above embodiments, except that the determining, by the current node of the present embodiment, the environment configuration information of the target node according to the role information of the target node (S102), may include:

s102a, the current node determines the environment configuration task corresponding to the role information according to the role information of the target node.

The environment configuration task can be a code which is written by using a code and is related to the environment of the configuration target node, and other functional modules can be called in the task to complete corresponding functions.

In some examples, an automated operation and maintenance tool is running at the current node.

In some examples, the determining, by the current node, the environment configuration task corresponding to the role information according to the role information of the target node (S102a), may include:

and the current node determines an environment configuration task corresponding to the role information in a second configuration file of the automatic operation and maintenance tool according to the role information of the target node.

In the second configuration file of this embodiment, the environment configuration tasks corresponding to the role information are arranged, and the number of the arranged tasks may be multiple, so that the corresponding tasks can be arranged according to various personalized requirements of the AI software and the application scene, the operation threshold is reduced, the trial-and-error cost is reduced, the logic of the software covers the cost of making mistakes by personnel, and the difficulty in using the tool is greatly reduced.

The automatic operation and maintenance tool may be an anchor, puppet, saltstack, or the like.

The present embodiment will be specifically described with an anchor as an example.

The infrastructure is an automatic operation and maintenance tool developed based on Python, and can realize functions of batch system configuration, batch program deployment, batch operation commands and the like. The ansables do not need to install clients/agents on the remote host because they are based on SSH to communicate with other hosts, where SSH is a secure shell protocol, a secure protocol built on an application layer basis.

It can be understood that, in this embodiment, a linux operating system may be run on the target host, and the operating system is provided with an SSH module, and the operating system may specifically be redhat (centos): 7.5, 7.6, 7.8, 8.2.

The configuration file of the anchor may be a playbook, which is essentially a file having a specific organization format, and the syntax format may be YAML, and the playbook is a container for organizing a plurality of tasks, and the plurality of tasks may be arranged in the playbook.

Multiple tasks can be scheduled in playlist in infrastructure, so that personalized requirements of AI software and application scenes are met.

S102b, analyzing the environment configuration task to obtain environment configuration information corresponding to the environment configuration task.

And analyzing the environment configuration task to obtain environment configuration information corresponding to the environment configuration task.

In another embodiment of the present application, the same as the above embodiment, except that in this embodiment, the target node includes at least two target nodes;

in this embodiment, the determining, by the current node, the environment configuration information of the target node according to the role information of the target node (S102), may include:

s102c, the current node determines, according to the role information of the at least two target nodes, that the environment configuration information of each of the at least two target nodes includes first environment configuration information.

The current node determines the environment configuration information of each target node according to the role information of at least two target nodes, where the environment configuration information of each target node in this embodiment is the same environment configuration information, that is, the first environment configuration information.

In some cases, such as at least two target nodes having the same role, or even if at least two target nodes have not completely the same role, but at least two target nodes need to provide the same environment for the AI software deployment, at least part of the same configuration information may be the same for each of the at least two target nodes, that is, in such a case, the same configuration information may be configured for each of the at least two target nodes.

In some examples, the server and/or the virtual machine instance provided by the client are various, such as different versions of the same operating system, different installation methods, different versions of system kernels, different kernel parameter configurations, and different models of the graphics card, and the environment information in the AI deployment environment required for the at least two target nodes is the same, so that the same environment configuration information can be sent to the at least two target nodes, and the same environment can be configured in the at least two target nodes according to the same environment configuration information.

On the basis of S102c, the sending, by the current node of this embodiment, the environment configuration information to the target node (S103), may include:

the current node sends first environment configuration information to at least two target nodes.

The current node sends first environment configuration information to at least two target nodes, and provides a basis for carrying out environment configuration on a plurality of target hosts.

The target node of this embodiment receives the environment configuration information, and performs an environment configuration operation according to the environment configuration information (S104), which may include:

and the at least two target nodes respectively receive the first environment configuration information and respectively execute environment configuration operation according to the first environment configuration information.

The at least two target nodes respectively receive the first environment configuration information sent by the current node and respectively execute environment configuration operation according to the first environment configuration information, so that the current node performs environment configuration on the plurality of target hosts in batch, and the accuracy, consistency and efficiency of the environment configuration of the target nodes are improved.

Another embodiment of the present application is basically the same as the above embodiments, except that the environment configuration information in this embodiment includes resource package information and installation or configuration information corresponding to the resource package.

The target node in this embodiment receives the environment configuration information, and performs an environment configuration operation according to the environment configuration information (S104), which may include:

s104a, the target node receives the resource package information in the environment configuration information and the installation or configuration information corresponding to the resource package.

And the target node receives the resource packet information in the environment configuration information sent by the current node and the installation or configuration information corresponding to the resource packet.

S104b, the target node acquires the resource package from the current node according to the resource package information.

It is to be understood that the current node may have a resource package stored or obtained for acquisition by the target node.

In some examples, before the target node acquires the resource package from the current node according to the resource package information (S104b), the method may further include:

s104c, the current node establishes an offline source and creates a transport service.

The offline source in this embodiment includes a resource package, so that the needed resource package can be provided for the AI software deployment environment in the offline environment.

S104d, the current node sends the offline source configuration information to the target node.

The offline source configuration information in this embodiment includes an IP address of the current node and a port number corresponding to the transport service.

After the transmission service is established, the current node sends offline source configuration information including the IP address of the current node and the port number corresponding to the transmission service to the target node.

Correspondingly, the obtaining, by the target node of this embodiment, the resource package from the current node according to the resource package information (S104b), may include:

and the target node sends an acquisition request for the resource packet to the current node according to the resource packet information, wherein the acquisition request comprises an IP address and a port number, the current node determines a transmission service according to the IP address and the port number, and then the current node sends the resource packet to the target node according to the transmission service.

The target node acquires the resource packet from the current node through the IP address and the port number according to the resource packet information, the resource packet is provided by an offline source created by the current node, and the resource packet does not need to be acquired through an external network in the process of configuring the environment, so that the problem of information leakage is avoided, and the safety of AI software deployment is improved.

S104e, the target node installs or configures the resource package according to the corresponding installation or configuration information of the resource package.

And after the target node acquires the resource package from the current node, installing or configuring the resource package according to the installation or configuration information corresponding to the resource package.

In some examples, the environmental configuration information includes at least one of: secret-free login information, operating System kernel upgrade information, firewall upgrade information, SElinux (Security-Enhanced Linux) upgrade information, docker (application container engine) configuration optimization, kubernets configuration optimization, Software dependent package installation information, installation user information, offline source configuration information, Hosts installation configuration information, disk partition mount information, JDK (Java Development Kit) installation configuration information, NFS (Network File System ) installation configuration information, NTP (Network Time Protocol) installation configuration information, Hadoop (Hadoop) installation configuration information, middleware installation configuration information, GPU (Graphics Processing, image processor) drive Unit installation information, Mysql installation configuration information, CDH5.14.2 (Software configuration management) installation information.

The AI software deployment environment is configured according to the environment configuration information, so that the compatibility of installing AI software can be improved.

The following describes the embodiments of the present application in detail with reference to a specific example.

Fig. 2 is an architecture diagram of an AI software deployment delivery provided in an embodiment of the present application.

The types of the deployment nodes in this embodiment are variously divided into: k8s cluster (cluster management, application performance), Hadoop cluster (management node, performance node), various middleware cluster (self-research: rtidb, febb, open source: zookeeper, kafka, mysql, etc.).

In order to meet the environment requirement of the AI software deployment, the environment deployment software is installed on one node of a plurality of nodes, wherein the node is the current node. The environment deployment software has the following functions: 1. initializing a batch system: kernel parameters, service management (firewall, selinux), installation configuration optimization (docker, k8s), and basic package installation; 2. automatic disk partition mounting: carrying out partition mounting on the disks in batches; 3. the environment management comprises JDK automatic installation configuration, yum (yellow dog update modified, a front-end software package manager) automatic configuration, hosts, GPU driving, kernel upgrading (aiming at k8s stability) and NFS; 4. application installation: mysql single point rapid deployment, CDH5.14.2(scm) automatic installation.

The environment deployment software of the embodiment serves as a tool set, provides pluggable capability, and can be used for installing the AI product in other ways such as manual operation and the like aiming at the scene which cannot be covered by the tool temporarily, so that the advantages that the environment deployment software and the AI software can be iterated independently without mutual influence and blocking; the environment deployment software also comprises a large number of self-extensible tool sets, and can be added quickly according to actual requirements, so that the requirement of quick iteration of the conventional AI product is met.

Before deploying the AI software, the following operations are required:

1. and giving the installation topology and the specific role of each server.

2. And configuring and installing the environment deployment software according to the specific information.

3. And carrying out batch initialization on all nodes in one node.

4. Personalized tool selection is performed according to the node role, for example: the K8s work node needs to upgrade the kernel of the operating system, the middleware node needs to install and configure JDK, Hadoop needs to be configured and installed on the exclusive node, and each role cluster needs to complete personalized disk mounting in batch.

After the AI software installation is completed, batch operation and maintenance checks are performed, for example: checking the disk mounting information of the server in batches: ansh "df-hT".

Through the above operation of the present embodiment, the AI service installation deployment is reduced from one week to less than 4 hours.

An embodiment of the present application provides a deployment system for artificial intelligence software, including: a first node and a second node; the first node is used for analyzing a preset first configuration file and determining role information of a target node; the preset first configuration file comprises role information of nodes; determining environment configuration information of the target node according to the role information of the target node; sending the environment configuration information to the target node; the second node is used for receiving the environment configuration information and executing environment configuration operation according to the environment configuration information, so that the configuration efficiency of the artificial intelligence software deployment environment can be improved.

The configuration device for an artificial intelligence software deployment environment provided in an embodiment of the present application is applied to a current node, and may include: the analysis module is used for analyzing a preset first configuration file and determining role information of the target node; the preset first configuration file comprises role information of nodes; the determining module is used for determining the environment configuration information of the target node according to the role information of the target node; a first sending module, configured to send the environment configuration information to the target node, so that the target node receives the environment configuration information, and executes an environment configuration operation according to the environment configuration information.

The apparatus of this embodiment may be configured to execute a technical solution corresponding to the action step of the current node in the method embodiment shown in fig. 1, and the implementation principle and the technical effect are similar, which are not described herein again.

The device of the embodiment determines the role information of the target node by analyzing a preset first configuration file; the preset first configuration file comprises role information of nodes, the environment configuration information of the target node is determined according to the role information of the target node, the environment configuration information is sent to the target node, so that the target node receives the environment configuration information, and environment configuration operation is executed according to the environment configuration information, so that the configuration efficiency of an artificial intelligence software deployment environment can be improved, and further, the efficiency of AI software deployment is improved conveniently.

As an optional implementation, the determining module includes: the determining submodule is used for determining an environment configuration task corresponding to the role information according to the role information of the target node; and the analysis submodule is used for analyzing the environment configuration task to obtain environment configuration information corresponding to the environment configuration task.

As an optional implementation, an automatic operation and maintenance tool is operated at the current node; the determining submodule is specifically configured to: according to the role information of the target node, determining an environment configuration task corresponding to the role information in a second configuration file of the automatic operation and maintenance tool; and the configuration file is arranged with an environment configuration task corresponding to the role information.

As an optional embodiment, the target node comprises at least two target nodes; the determining module is specifically configured to: determining the environment configuration information of each target node in the at least two target nodes as first environment configuration information according to the role information of the at least two target nodes; the first sending module is specifically configured to: and sending the first environment configuration information to the at least two target nodes, so that the at least two target nodes respectively receive the first environment configuration information and respectively execute environment configuration operation according to the first environment configuration information.

As an optional implementation manner, the environment configuration information includes resource package information and installation or configuration information corresponding to the resource package; the first sending module includes: the first sending submodule is used for sending the resource package information in the environment configuration information and the installation or configuration information corresponding to the resource package to the target node; the receiving submodule is used for receiving an acquisition request for the resource packet sent by the target node; and the second sending submodule is used for sending the resource packet to the target node according to the acquisition request so that the target node installs or configures the resource packet according to the installation or configuration information corresponding to the resource packet.

As an optional implementation manner, if the obtaining request includes an IP address and the port number, the apparatus further includes: the establishing module is used for establishing an offline source and establishing transmission service before the second sending submodule sends the resource packet to the target node according to the acquisition request; wherein the offline source comprises the resource package; a second sending module, configured to send offline source configuration information to the target node, where the offline source configuration information includes an IP address of a current node and a port number corresponding to the transmission service; the second sending submodule is specifically configured to: determining the transmission service according to the IP address and the port number in the acquisition request; and sending the resource packet to the target node according to the transmission service.

As an optional implementation, the environment configuration information includes at least one of: the method comprises the following steps of password-free login information, operating system kernel upgrading information, firewall upgrading information, selinux upgrading information, docker configuration optimization, kubernets configuration optimization, software dependence package installation information, installation user information, offline source configuration information, Hosts installation configuration information, disk partition mounting information, JDK installation configuration information, NFS installation configuration information, NTP installation configuration information, Hadoop installation configuration information, middleware installation configuration information, GPU drive installation information, Mysql installation configuration information and CDH5.14.2(scm) installation configuration information.

The apparatus of the foregoing embodiment may be configured to execute a technical solution corresponding to the action step of the current node in the foregoing method embodiment, and the implementation principle and the technical effect of the apparatus are similar, which are not described herein again.

The configuration device for an artificial intelligence software deployment environment provided in an embodiment of the present application is applied to a target node, and may include: the first receiving module is used for receiving the environment configuration information sent by the current node; wherein the environment configuration information is determined by the current node according to the role information of the target node; and the execution module is used for executing the environment configuration operation according to the environment configuration information.

The apparatus of this embodiment may be configured to execute a technical solution corresponding to the action step of the target node in the method embodiment shown in fig. 1, and the implementation principle and the technical effect are similar, which are not described herein again.

The device of the embodiment receives the environment configuration information sent by the current node; the environment configuration information is determined by the current node according to the role information of the target node, and the environment configuration operation is executed according to the environment configuration information, so that the configuration efficiency of the artificial intelligence software deployment environment can be improved, and further, the efficiency of AI software deployment is improved conveniently.

As an optional implementation manner, the environment configuration information includes resource package information and installation or configuration information corresponding to the resource package; the first receiving module comprises: the receiving submodule is used for receiving the resource package information in the environment configuration information sent by the current node and the installation or configuration information corresponding to the resource package; the execution module includes: the sending submodule is used for sending an acquisition request of the resource packet to the current node according to the resource packet information; the receiving submodule is used for receiving the resource packet sent by the current node; and the installation or configuration module is used for installing or configuring the resource package according to the installation or configuration information corresponding to the resource package.

As an optional embodiment, the apparatus further comprises: a second receiving module, configured to receive, before the receiving sub-module receives the resource packet sent by the current node, offline source configuration information sent by the current node, where the offline source configuration information includes an IP address of the current node and a port number corresponding to a transmission service; the sending submodule is specifically configured to: and sending an acquisition request for the resource packet to the current node according to the resource packet information, wherein the acquisition request comprises an IP address and the port number, so that the current node determines the transmission service according to the IP address and the port number.

The apparatus of the foregoing embodiment may be configured to execute a technical solution corresponding to the action step of the target node in the foregoing method embodiment, and the implementation principle and the technical effect of the apparatus are similar and will not be described herein again.

Fig. 3 is a schematic structural diagram of a deployment system of artificial intelligence software according to an embodiment of the present application, and as shown in fig. 3, the deployment system of artificial intelligence software according to this embodiment may include: a first node and a second node; the first node 10 is configured to parse a preset first configuration file and determine role information of a target node; the preset first configuration file comprises role information of nodes; determining environment configuration information of the target node according to the role information of the target node; sending the environment configuration information to the target node; the second node 12 is configured to receive the environment configuration information, and execute an environment configuration operation according to the environment configuration information.

In the deployment system of this embodiment, the first node may be configured to execute the action step of the current node in the method embodiment shown in fig. 1, and the second node may be configured to execute the action step of the target node in the method embodiment shown in fig. 1, which have similar implementation principles and technical effects, and are not described here again.

The deployment system of this embodiment determines role information of a target node by parsing a preset first configuration file by a current node, and the current node then determines environment configuration information of the target node according to the role information of the target node and sends the information to the target node, and after receiving the environment configuration information, the target node performs environment configuration operation according to the environment configuration information.

As an optional implementation, the first node includes: the analysis module is specifically used for analyzing a preset first configuration file and determining role information of the second node; the preset first configuration file comprises role information of nodes; a determining module, configured to determine environment configuration information of the second node according to the role information of the second node; a sending module, configured to send the environment configuration information to the second node; the second node comprises: and the execution module is specifically used for receiving the environment configuration information and executing environment configuration operation according to the environment configuration information.

As an optional implementation, the determining module includes: the determining submodule is used for determining an environment configuration task corresponding to the role information according to the role information of the second node; and the analysis submodule is used for analyzing the environment configuration task to obtain environment configuration information corresponding to the environment configuration task.

As an optional implementation manner, an automatic operation and maintenance tool runs on the first node; the determining submodule is specifically configured to: according to the role information of the second node, determining an environment configuration task corresponding to the role information in a second configuration file of the automatic operation and maintenance tool; and the configuration file is arranged with an environment configuration task corresponding to the role information.

As an optional embodiment, the second nodes include at least two second nodes; the determining module is specifically configured to: determining that the environment configuration information of each second node in the at least two second nodes is first environment configuration information according to the role information of the at least two second nodes; the sending module is specifically configured to: the first node sends the first environment configuration information to the at least two second nodes; the execution module of each second node is specifically configured to: and receiving the first environment configuration information, and executing environment configuration operation according to the first environment configuration information.

As an optional implementation manner, the environment configuration information includes resource package information and installation or configuration information corresponding to the resource package; the execution module includes: the receiving submodule is used for receiving the resource package information in the environment configuration information and the installation or configuration information corresponding to the resource package; the obtaining submodule is used for obtaining the resource packet from the first node according to the resource packet information; and the installation or configuration sub-module is used for installing or configuring the resource package according to the installation or configuration information corresponding to the resource package.

As an optional implementation manner, before the second node acquires the resource package from the first node according to the resource package information, the execution module further includes: the creating submodule is used for creating an offline source and creating transmission service before the obtaining submodule obtains the resource packet from the first node according to the resource packet information; wherein the offline source comprises the resource package; a sending submodule, configured to send offline source configuration information to the second node, where the offline source configuration information includes an IP address of a current node and a port number corresponding to the transmission service; the obtaining submodule is specifically configured to: and acquiring the resource packet from the first node through the IP address and the port number according to the resource packet information.

As an optional implementation, the environment configuration information includes at least one of: secret-free login information, operating system kernel upgrading information, firewall upgrading information, selinux upgrading information, docker configuration optimization, kubernets configuration optimization, software dependency package installation information, installation user information, offline source configuration information, Hosts installation configuration information, disk partition mounting information, JDK installation configuration information, NFS installation configuration information, NTP installation configuration information, Hadoop installation configuration information, middleware installation configuration information, GPU drive installation information, Mysql installation configuration information and CDH5.14.2(scm) installation configuration information.

In the deployment system of the foregoing embodiment, the first node may be configured to execute the action step of the current node in the foregoing method embodiment, and the second node may be configured to execute the action step of the target node in the foregoing method embodiment, which has similar implementation principles and technical effects, and therefore, details are not described here again.

Fig. 4 is a schematic structural diagram of an electronic device according to an embodiment of the present application, and as shown in fig. 4, the electronic device may include: the electronic device comprises a shell 61, a processor 62, a memory 63, a circuit board 64 and a power circuit 65, wherein the circuit board 64 is arranged inside a space enclosed by the shell 61, and the processor 62 and the memory 63 are arranged on the circuit board 64; a power supply circuit 65 for supplying power to each circuit or device of the electronic apparatus; the memory 63 is used to store executable program code; the processor 62 reads the executable program code stored in the memory 63 to run the program corresponding to the executable program code, so as to implement any configuration method provided in the foregoing embodiments, and therefore, corresponding advantageous technical effects can also be achieved. The electronic device may be a first node (current node) and/or a second node (target node), and performs the action steps of the current node and/or the target node, which is not limited in this embodiment of the present application.

The above electronic devices exist in a variety of forms, including but not limited to:

(1) a mobile communication device: such devices are characterized by mobile communications capabilities and are primarily targeted at providing voice, data communications. Such terminals include: smart phones (e.g., iphones), multimedia phones, functional phones, and low-end phones, among others.

(2) Ultra mobile personal computer device: the equipment belongs to the category of personal computers, has calculation and processing functions and generally has the characteristic of mobile internet access. Such terminals include: PDA, MID, and UMPC devices, etc., such as ipads.

(3) A portable entertainment device: such devices can display and play multimedia content. This type of device comprises: audio, video players (e.g., ipods), handheld game consoles, electronic books, and smart toys and portable car navigation devices.

(4) A server: the device for providing the computing service comprises a processor, a hard disk, a memory, a system bus and the like, and the server is similar to a general computer architecture, but has higher requirements on processing capacity, stability, reliability, safety, expandability, manageability and the like because of the need of providing high-reliability service.

(5) And other electronic equipment with data interaction function.

Accordingly, an embodiment of the present application further provides a computer-readable storage medium, where one or more programs are stored, and the one or more programs can be executed by one or more processors to implement any configuration method of an artificial intelligence software deployment environment provided in the foregoing embodiment, so that corresponding technical effects can also be achieved, which has been described in detail above and will not be described herein again.

It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.

All the embodiments in the present specification are described in a related manner, and the same and similar parts among the embodiments may be referred to each other, and each embodiment focuses on the differences from the other embodiments.

In particular, as for the apparatus embodiment, since it is substantially similar to the method embodiment, the description is relatively simple, and for the relevant points, reference may be made to the partial description of the method embodiment.

For convenience of description, the above devices are described separately in terms of functional division into various units/modules. Of course, the functionality of the units/modules may be implemented in one or more software and/or hardware implementations when the present application is implemented.

It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by a computer program, which can be stored in a computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. The storage medium may be a magnetic disk, an optical disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), or the like.

The above description is only for the specific embodiments of the present application, but the scope of the present application is not limited thereto, and any changes or substitutions that can be easily conceived by those skilled in the art within the technical scope of the present application should be covered within the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims

1. A configuration method of an artificial intelligence software deployment environment is applied to a current node, and comprises the following steps:

analyzing a preset first configuration file, and determining role information of a target node; the preset first configuration file comprises role information of nodes;

determining environment configuration information of the target node according to the role information of the target node;

and sending the environment configuration information to the target node so that the target node receives the environment configuration information and executes environment configuration operation according to the environment configuration information.

2. The method of claim 1, wherein the determining the environmental configuration information of the target node according to the role information of the target node comprises:

determining an environment configuration task corresponding to the role information according to the role information of the target node;

3. The method of claim 2, wherein an automatic operation and maintenance tool is running at the current node; the determining, according to the role information of the target node, an environment configuration task corresponding to the role information includes:

according to the role information of the target node, determining an environment configuration task corresponding to the role information in a second configuration file of the automatic operation and maintenance tool; and the configuration file is arranged with an environment configuration task corresponding to the role information.

4. The method of claim 1, wherein the target node comprises at least two target nodes;

the determining the environment configuration information of the target node according to the role information of the target node comprises:

determining the environment configuration information of each target node in the at least two target nodes as first environment configuration information according to the role information of the at least two target nodes;

the sending the environment configuration information to the target node to enable the target node to receive the environment configuration information and execute environment configuration operation according to the environment configuration information includes:

and sending the first environment configuration information to the at least two target nodes, so that the at least two target nodes respectively receive the first environment configuration information and respectively execute environment configuration operation according to the first environment configuration information.

5. A configuration method of an artificial intelligence software deployment environment is applied to a target node and comprises the following steps:

receiving environment configuration information sent by a current node; wherein the environment configuration information is determined by the current node according to the role information of the target node;

and executing environment configuration operation according to the environment configuration information.

6. A configuration device of artificial intelligence software deployment environment is characterized in that, applied to a current node, the configuration device comprises:

the analysis module is used for analyzing a preset first configuration file and determining role information of the target node; the preset first configuration file comprises role information of nodes;

the determining module is used for determining the environment configuration information of the target node according to the role information of the target node;

a first sending module, configured to send the environment configuration information to the target node, so that the target node receives the environment configuration information, and executes an environment configuration operation according to the environment configuration information.

7. A configuration device of artificial intelligence software deployment environment is characterized in that, applied to a target node, the configuration device comprises:

the first receiving module is used for receiving the environment configuration information sent by the current node; wherein the environment configuration information is determined by the current node according to the role information of the target node;

and the execution module is used for executing the environment configuration operation according to the environment configuration information.

8. An electronic device, characterized in that the electronic device comprises: the device comprises a shell, a processor, a memory, a circuit board and a power circuit, wherein the circuit board is arranged in a space enclosed by the shell, and the processor and the memory are arranged on the circuit board; a power supply circuit for supplying power to each circuit or device of the electronic apparatus; the memory is used for storing executable program codes; the processor executes a program corresponding to the executable program code by reading the executable program code stored in the memory, for performing the configuration method of the artificial intelligence software deployment environment of any one of the preceding claims 1-5.

9. A computer-readable storage medium, wherein the computer-readable storage medium stores one or more programs which are executable by one or more processors to implement the method for configuring an artificial intelligence software deployment environment of any one of the preceding claims 1-5.

10. A system for deploying artificial intelligence software, comprising: a first node and a second node;

the first node is used for analyzing a preset first configuration file and determining role information of a target node;

the preset first configuration file comprises role information of nodes; determining environment configuration information of the target node according to the role information of the target node; sending the environment configuration information to the target node;

and the second node is used for receiving the environment configuration information and executing environment configuration operation according to the environment configuration information.