WO2021017301A1 - Management method and apparatus based on kubernetes cluster, and computer-readable storage medium - Google Patents

Management method and apparatus based on kubernetes cluster, and computer-readable storage medium Download PDF

Info

Publication number
WO2021017301A1
WO2021017301A1 PCT/CN2019/118007 CN2019118007W WO2021017301A1 WO 2021017301 A1 WO2021017301 A1 WO 2021017301A1 CN 2019118007 W CN2019118007 W CN 2019118007W WO 2021017301 A1 WO2021017301 A1 WO 2021017301A1
Authority
WO
WIPO (PCT)
Prior art keywords
cluster
kubernetes
business
configuration information
control
Prior art date
Application number
PCT/CN2019/118007
Other languages
French (fr)
Chinese (zh)
Inventor
琚汝强
Original Assignee
平安科技(深圳)有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 平安科技(深圳)有限公司 filed Critical 平安科技(深圳)有限公司
Publication of WO2021017301A1 publication Critical patent/WO2021017301A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F8/00Arrangements for software engineering
    • G06F8/60Software deployment
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46Multiprogramming arrangements
    • G06F9/50Allocation of resources, e.g. of the central processing unit [CPU]
    • G06F9/5005Allocation of resources, e.g. of the central processing unit [CPU] to service a request
    • G06F9/5027Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L41/00Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
    • H04L41/04Network management architectures or arrangements
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L41/00Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
    • H04L41/08Configuration management of networks or network elements
    • H04L41/0803Configuration setting
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network

Definitions

  • This application relates to the field of cloud deployment technology, and in particular to a management method, device and computer-readable storage medium based on a Kubernetes cluster.
  • Kubernetes is an open source container orchestration engine, and it is also a containerized application used to manage multiple hosts in the cloud platform. Kubernetes supports automated deployment, large-scale scalability, and application containerized management. When deploying an application in a production environment, multiple instances of the application are usually deployed to load balance application requests. In Kubernetes, we can create multiple containers, each container runs an application instance, and then through the built-in load balancing strategy to achieve the management, discovery, and access to this group of application instances, and these details do not require operation and maintenance Personnel to carry out complex manual configuration and processing.
  • Container Service provides a general-purpose Kubernetes-based container application management platform, but the current platform only provides a general environment for managing containers, and exposes too much Kubernetes expertise to users, which makes the learning cost of users higher. It is not convenient for users to switch from the original cloud host deployment to containerized deployment.
  • This application provides a management method, device and computer-readable storage medium based on a Kubernetes cluster, the main purpose of which is to solve the technical problem of how to switch from cloud host deployment to containerized deployment.
  • this application provides a management method based on a Kubernetes cluster.
  • the method includes the following steps: determining configuration information required by the Kubernetes cluster; wherein the Kubernetes cluster includes a business cluster and a control cluster, and the configuration information includes Node configuration items; enable corresponding container services according to the configuration information; create corresponding business clusters according to the configuration information; deploy corresponding application containers according to the configuration information; wherein, the container services are enabled according to the configuration information
  • the steps include: creating a control cluster in a designated virtual private cloud (Virtual Private Cloud, VPC); wherein, the control cluster is used to deploy and manage each application program in the business cluster;
  • the step of information deployment of the corresponding application container includes: configuring each application in the business cluster with the configuration items of the selected node; the step of creating the corresponding business cluster according to the configuration information includes: specifying the nodes included in the business cluster Data and business name; call the cloud host creation interface; create the cloud host; add all the cloud hosts to the business cluster as
  • this application also provides a management device based on a Kubernetes cluster.
  • the device includes a memory and a processor.
  • the memory stores a management program based on the Kubernetes cluster that can run on the processor.
  • the management program based on the Kubernetes cluster is executed by the processor, the steps of the management method based on the Kubernetes cluster as described above are implemented.
  • this application also provides a computer-readable storage medium on which a management program based on a Kubernetes cluster is stored, and the management program based on a Kubernetes cluster can be used by one or more The processor executes to implement the steps of the management method based on the Kubernetes cluster as described above.
  • the Kubernetes cluster-based management method, device and computer-readable storage medium proposed in this application can create a control cluster, create a business cluster, and deploy in a designated VPC by enabling the container service after configuring the configuration information required by the cluster.
  • Application container without the need to create control clusters, create business clusters, deploy application containers and other deployment operations in the cloud host, thus realizing the switch from cloud host deployment to containerized deployment, which is convenient for business management.
  • FIG. 1 is a schematic flow diagram of a management method based on a Kubernetes cluster provided by an embodiment of this application;
  • FIG. 2 is a schematic flowchart of step C in FIG. 1;
  • FIG. 3 is a schematic diagram of the internal structure of a management device based on a Kubernetes cluster provided by an embodiment of the application;
  • FIG. 4 is a schematic diagram of modules of a management program based on a Kubernetes cluster in a management device based on a Kubernetes cluster provided by an embodiment of the application.
  • This application provides a management method based on a Kubernetes cluster.
  • the banking system includes a configuration management system and a banking business subsystem, and the banking system has a project path corresponding to each project.
  • FIG. 1 it is a schematic flowchart of a management method based on a Kubernetes cluster provided by an embodiment of this application. The method can be executed by a device, and the device can be implemented by software and/or hardware.
  • the management method based on the Kubernetes cluster includes:
  • Step A Determine the configuration information required by the Kubernetes cluster.
  • the Kubernetes cluster includes a business cluster and a control cluster.
  • the service cluster is used to provide an operating environment for container applications
  • the control cluster is used to deploy and manage each application or service in the service cluster
  • the control cluster is also called a service management cluster.
  • the "determining the configuration information required by the Kubernetes cluster” in step A may include, but is not limited to: configuration information of basic resources, configuration information of the cluster size, configuration information of the cluster network, and configuration of nodes Configuration information of items and Kubernetes applications;
  • the configuration information of the basic resources includes: whether the cluster is highly available, availability zone, cloud host billing method, cluster area, cloud host mirroring, key pair, node specifications, and external network;
  • the configuration information of the cluster scale refers to the configuration information of the Kubernetes cluster scale, which includes: the number of master nodes and the number of slave nodes;
  • the configuration information of the cluster network is the configuration information of the Kubernetes cluster network, which includes: business network type, network segment address, subnet mask, gateway, virtual private cloud (VPC) that requires container service, network Plugins, etc.;
  • VPC virtual private cloud
  • the configuration information of the Kubernetes application includes: Kubernetes version.
  • step A includes:
  • Step B Activate the corresponding container service according to the configuration information.
  • step B includes:
  • control cluster is used to deploy and manage each application program in the business cluster.
  • control cluster includes at least one group of kubernetes control plane components, and each group of kubernetes control plane components may include, but are not limited to, kube-apiserver, kube-controller-manager, kube-scheduler, Etcd, etc. .
  • kube-apiserver API server, used to expose Kubernetes API; any resource request/call operation is performed through the interface provided by kube-apiserver;
  • kube-controller-manager controller manager
  • kube-scheduler Container scheduler, used to monitor newly created Pods that are not assigned to nodes, and select a node for Pod;
  • Etcd Key-value database, used to store cluster data.
  • control cluster further includes at least one set of kubernetes service components, and each set of kubernetes service components may include, but is not limited to, components such as kube-proxy, kube-dns, tiller, addons, and flannel.
  • the kubernetes service component is explained as follows:
  • kube-proxy Forward proxy, which implements Kubernetes service abstraction by maintaining network rules on the host and performing connection forwarding;
  • kube-dns refers to the cluster DNS (Domain Name Server), which is a domain name server, used to provide DNS records for Kubernetes services;
  • addons refers to addons, which are used to implement cluster pod and services functions
  • flannel It is a network plug-in in the kubernetes cluster.
  • the step "create a control cluster in the designated VPC" includes a monitoring step, wherein the monitoring step includes:
  • the cloud host performance index includes: the host's CPU usage rate, MEM usage rate, etc.
  • the monitoring step further includes: collecting the existence and survivability indicators of Kubernetes components and containers.
  • the monitoring step includes the monitoring of the control cluster node and the monitoring of the service cluster; specifically, the monitoring step includes: monitoring the survivability of all components and containers on the control cluster node; in the monitoring step It also includes: monitoring the application containers on the business cluster.
  • control cluster and the business cluster include a monitoring agent
  • the cloud host performance index is collected by the monitoring agent running on the control cluster and the business cluster, and the collected cloud host performance index is displayed on the interface graphic .
  • the monitoring agent is a monitoring program.
  • the step of "creating a control cluster in the designated VPC" further includes: a log step; specifically, the log step includes: generating a log when the container service module creates the control cluster;
  • the logs include cloud host logs, management cluster component logs, and pod logs.
  • the log step further includes: converging all logs to the log cloud through the monitoring agent.
  • the step of "creating a control cluster in a designated VPC" also includes an alerting step: when a component of the control cluster is abnormal, or a component or a pod in the business cluster is abnormal, an alert message is sent to relevant personnel.
  • the alarm message can be sent to relevant personnel in the form of email, telephone, short message, etc.
  • the alerting step includes: when the viability of all components and containers on the control cluster node is abnormal, sending an alert message to relevant personnel.
  • the alerting step further includes: sending an alert message to relevant personnel when the alert of the application container on the business cluster is abnormal, for example, sending an alert message to the relevant personnel when the pod is abnormal.
  • Step C Create a corresponding business cluster according to the configuration information.
  • the step C includes:
  • Step C1 Specify the number of nodes and business names included in the business cluster
  • Step C2 Call the cloud host to create an interface
  • Step C3 Create a cloud host
  • Step C4 Add all cloud hosts to the business cluster as nodes running on the business container.
  • Kubernetes service nodes can also be added or deleted later.
  • the step C4 includes:
  • the components required by the Kubernetes service node may be: flannel, docker, kube-proxy, application container, etc.
  • docker is an open source application container engine for running containers.
  • an Etcd storage system is used to store the information of each node.
  • the Etcd can quickly and effectively add or delete the current information of each Kubernetes node.
  • the service container can be scheduled to the designated node in the VPC, after the step C4, the method further includes:
  • the step C includes: creating a namespace resource object. Among them, one or more applications are deployed to a business cluster.
  • Step D Deploy the corresponding application container according to the configuration information.
  • the step D includes: configuring each application program with configuration items of the selected node.
  • the configuration item includes: specifying the spec.nodeSelector field in the deployment.
  • deployment is a resource object of Kubernetes, which is used to better solve the problem of Pod scheduling; pod represents an application; deployment is used to manage Kubernetes stateless applications; spec.nodeSelector allows pods to be scheduled to configure specific labels On the host.
  • one or more applications have their own dedicated operating environment, and the one or more applications are isolated from other applications; the resources of the application will not be preempted by other applications, and abnormal problems between the two applications , It is only possible because of abnormal interface calls, not because of resource preemption; through this isolation method, the efficiency of problem location can be improved, which is conducive to collaboration between teams.
  • the Kubernetes cluster-based management method proposed in this application solves the technical problem of how to switch from cloud host deployment to containerized deployment, does not require users to master Kubernetes professional knowledge, and reduces user learning costs; this application manages business through business clusters, Let many traditional users quickly use the Kubernetes-based container service to manage container applications, which facilitates rapid deployment from cloud host deployment to containerized deployment; this application also creates business clusters based on business modules to facilitate management of business modules; users are using In the process, you only need to create your own business cluster, and you can deploy containerized services in it.
  • the application also provides a management device based on a Kubernetes cluster.
  • FIG. 3 it is a schematic diagram of the internal structure of a Kubernetes cluster-based management device provided by an embodiment of this application.
  • the management device based on the Kubernetes cluster may be a PC (Personal Computer, personal computer), or a terminal device such as a smart phone, a tablet computer, or a portable computer.
  • the Kubernetes cluster-based management device includes at least a memory 11, a processor 12, a network interface 13, and a communication bus 14.
  • the memory 11 includes at least one type of computer-readable storage medium, and the computer-readable storage medium includes flash memory, hard disk, multimedia card, card-type memory (for example, SD or DX memory, etc.), magnetic memory, and magnetic disk. , CD, etc.
  • the memory 11 may be an internal storage unit of a management device based on a Kubernetes cluster, such as a hard disk of the management device based on a Kubernetes cluster.
  • the memory 11 may also be an external storage device of a management device based on a Kubernetes cluster, such as a plug-in hard disk or a smart media card (SMC) equipped on a management device based on a Kubernetes cluster.
  • SMC smart media card
  • the memory 11 may also include both an internal storage unit of a management device based on a Kubernetes cluster and an external storage device.
  • the memory 11 can be used not only to store application software and various data installed in the management device based on the Kubernetes cluster, such as the code of the management program based on the Kubernetes cluster, etc., but also to temporarily store the data that has been output or will be output. .
  • the processor 12 may be a central processing unit (CPU), controller, microcontroller, microprocessor, or other data processing chip, which is used to run data stored in the memory 11 Program code or processing data, such as executing management programs based on Kubernetes clusters.
  • CPU central processing unit
  • controller microcontroller
  • microprocessor or other data processing chip, which is used to run data stored in the memory 11
  • Program code or processing data such as executing management programs based on Kubernetes clusters.
  • the network interface 13 may optionally include a standard wired interface and a wireless interface (such as a WI-FI interface), and is usually used to establish a communication connection between the Kubernetes cluster-based management device and other electronic devices.
  • a standard wired interface and a wireless interface such as a WI-FI interface
  • the communication bus 14 is used to realize the connection and communication between these components.
  • Figure 3 only shows a Kubernetes cluster-based management device with components 11 to 14 and a Kubernetes cluster-based management program. Those skilled in the art can understand that the structure shown in Figure 3 does not constitute management of a Kubernetes-based cluster
  • the definition of the device may include fewer or more components than shown, or a combination of certain components, or different component arrangements.
  • the storage 11 stores a management program based on the Kubernetes cluster; when the processor 12 executes the management program based on the Kubernetes cluster stored in the storage 11 Implement the following steps:
  • Step A Determine the configuration information required by the Kubernetes cluster.
  • the "determining the configuration information required by the Kubernetes cluster” in step A may include, but is not limited to: configuration information of basic resources, configuration information of the cluster size, configuration information of the cluster network, and configuration of nodes Configuration information of items and Kubernetes applications;
  • the configuration information of the basic resources includes: whether the cluster is highly available, availability zone, cloud host billing method, cluster area, cloud host mirroring, key pair, node specifications, and external network;
  • the configuration information of the cluster size includes: the number of master nodes and the number of slave nodes;
  • the configuration information of the cluster network includes: business network type, network segment address, subnet mask, gateway, VPC that needs to activate container service, network plug-in, etc.;
  • the configuration information of the Kubernetes application includes: Kubernetes version.
  • step A includes:
  • VPC Virtual Private Cloud
  • Step B Activate the corresponding container service according to the configuration information.
  • step B includes:
  • control cluster is used to deploy and manage each application program in the business cluster.
  • control cluster includes at least one group of kubernetes control plane components, and each group of kubernetes control plane components may include, but are not limited to, kube-apiserver, kube-controller-manager, kube-scheduler, Etcd, etc. .
  • kube-apiserver API server, used to expose Kubernetes API; any resource request/call operation is performed through the interface provided by kube-apiserver;
  • kube-controller-manager controller manager
  • kube-scheduler Container scheduler, used to monitor newly created Pods that are not assigned to nodes, and select a node for Pod;
  • Etcd Key-value database, used to store cluster data.
  • control cluster also includes at least one set of kubernetes service components, and each set of kubernetes service components may include, but is not limited to, components such as kube-proxy, kube-dns, tiller, addons, and flannel.
  • the kubernetes service component is explained as follows:
  • kube-proxy Forward proxy, which implements Kubernetes service abstraction by maintaining network rules on the host and performing connection forwarding;
  • kube-dns refers to the cluster DNS (Domain Name Server), which is a domain name server, used to provide DNS records for Kubernetes services;
  • addons refers to addons, which are used to implement cluster pod and services functions
  • flannel It is a network plug-in in the kubernetes cluster.
  • the step "create a control cluster in the designated VPC" includes a monitoring step, wherein the monitoring step includes:
  • the cloud host performance index includes: the host's CPU usage rate, MEM usage rate, etc.
  • the monitoring step further includes: collecting the existence and survivability indicators of Kubernetes components and containers.
  • the monitoring step includes the monitoring of the control cluster node and the monitoring of the service cluster; specifically, the monitoring step includes: monitoring the survivability of all components and containers on the control cluster node; in the monitoring step It also includes: monitoring the application containers on the business cluster.
  • control cluster and the business cluster include a monitoring agent
  • the cloud host performance index is collected by the monitoring agent running on the control cluster and the business cluster, and the collected cloud host performance index is displayed on the interface graphic .
  • the monitoring agent is a monitoring program.
  • the step of "creating a control cluster in the designated VPC" further includes: a log step; specifically, the log step includes: generating a log when the container service module creates the control cluster;
  • the logs include cloud host logs, management cluster component logs, and pod logs.
  • the log step further includes: converging all logs to the log cloud through the monitoring agent.
  • the step of "creating a control cluster in a designated VPC" also includes an alerting step: when a component of the control cluster is abnormal, or a component or a pod in the business cluster is abnormal, an alert message is sent to relevant personnel.
  • the alarm message can be sent to relevant personnel in the form of email, telephone, short message, etc.
  • the alarm step includes: controlling the alarm of the cluster node and the alarm of the business cluster; specifically, the alarm step includes: when the viability of all components and containers on the control cluster node is abnormal, sending an alarm message Relevant personnel.
  • the alerting step further includes: sending an alert message to relevant personnel when the application container on the business cluster is abnormal, for example, sending an alert message to the relevant personnel when the pod is abnormal.
  • Step C Create a corresponding business cluster according to the configuration information.
  • step C includes:
  • Step C1 Specify the number of nodes and business names included in the business cluster
  • Step C2 Call the cloud host to create an interface
  • Step C3 Create a cloud host
  • Step C4 Add all cloud hosts to the business cluster as nodes running on the business container.
  • Kubernetes service nodes can also be added or deleted later.
  • the step C4 includes:
  • the components required by the Kubernetes service node may be: flannel, docker, kube-proxy, application container, etc.
  • docker is an open source application container engine for running containers.
  • the service container can be scheduled to the designated node in the VPC, after the step C4, the method further includes:
  • the step C includes: creating a namespace resource object. Among them, one or more applications are deployed to a business cluster.
  • Step D Deploy the corresponding application container according to the configuration information.
  • the step D includes: configuring each application program with configuration items of the selected node.
  • the configuration item includes: specifying the spec.nodeSelector field in the deployment.
  • deployment is a resource object of Kubernetes, which is used to better solve the problem of Pod scheduling; pod represents an application; deployment is used to manage Kubernetes stateless applications; spec.nodeSelector allows pods to be scheduled to configure specific labels On the host.
  • one or more applications have their own dedicated operating environment, and the one or more applications are isolated from other applications; the resources of the application will not be preempted by other applications, and abnormal problems between the two applications , It is only possible because of abnormal interface calls, not because of resource preemption; through this isolation method, the efficiency of problem location can be improved, which is conducive to collaboration between teams.
  • FIG. 4 is a schematic diagram of program modules of a Kubernetes cluster-based management program in an embodiment of a Kubernetes cluster-based management device of this application.
  • the management program based on the Kubernetes cluster can be divided into a configuration module 10, a container service module 20, a creation module 30, a deployment module 40, a monitoring module 50, an alarm module 60, and a log module 70, exemplarily :
  • the configuration module 10 is used to determine configuration information required by the Kubernetes cluster.
  • the configuration module 10 is also used to determine the VPC that needs to activate the container service, determine whether the Kubernetes cluster is highly available, and determine the Kubernetes version.
  • the container service module 20 is configured to activate corresponding container services according to the configuration information.
  • the creation module 30 is used to create a corresponding business cluster according to the configuration information.
  • the deployment module 40 is configured to deploy a corresponding application container according to the configuration information.
  • the monitoring module 50 is used to collect cloud host performance indicators, and is used to display interface graphics according to the collected cloud host performance indicators.
  • the monitoring module 50 adopts cAdvisor, which is a daemon process for collecting, aggregating, and outputting container operation indicators.
  • cAdvisor is a daemon process for collecting, aggregating, and outputting container operation indicators.
  • Various performance data of Docker in the Kubernetes cluster can be obtained through cAdvisor.
  • the alarm module 60 is configured to send an alarm message to relevant personnel when an abnormality occurs in a component of the control cluster, or when an abnormality occurs in a component or a pod in the business cluster.
  • the log module 70 is configured to generate a log when the container service module creates a control cluster.
  • the creation module 30 is also used to specify the number of nodes and business names contained in the business cluster; it is also used to call the cloud host creation interface after specifying the number of nodes and business names contained in the business cluster; and to call the cloud host creation Create a cloud host after the interface; it is used to add all the cloud hosts to the business cluster after the cloud host is created, as a node for the business container to run.
  • the service container can be scheduled to the designated node in the VPC, and the creation module 30 is also used to configure designated service labels for all nodes.
  • the deployment module 40 is also used to configure the configuration items of the selected node for each application.
  • the configuration item includes: specifying the spec.nodeSelector field in the deployment.
  • an Etcd storage system is used to store the information of each node.
  • the Etcd can quickly and effectively add or delete the current information of each Kubernetes node.
  • configuration module 10 container service module 20, creation module 30, deployment module 40, monitoring module 50, alarm module 60, and log module 70 implement functions or operation steps that are substantially the same as those in the foregoing embodiment when executed. This will not be repeated here.
  • an embodiment of the present application also proposes a computer-readable storage medium, which stores a management program based on a Kubernetes cluster, and the management program based on a Kubernetes cluster can be executed by one or more processors To achieve the following operations:
  • Step A Determine the configuration information required by the Kubernetes cluster
  • Step B Activate the corresponding container service according to the configuration information
  • Step C Create a corresponding business cluster according to the configuration information
  • Step D Deploy the corresponding application container according to the configuration information.
  • step A includes:
  • the step B includes: creating a control cluster in the designated VPC.
  • the step of "creating a control cluster in the designated VPC" includes a monitoring step, wherein the monitoring step includes:
  • the monitoring step further includes: collecting the existence and survivability indicators of Kubernetes components and containers.
  • the step of "creating a control cluster in the designated VPC" further includes a log step, wherein the log step includes: generating a log when the container service module creates the control cluster;
  • the step of "creating a control cluster in a designated VPC" also includes an alerting step: when a component of the control cluster is abnormal, or a component or a pod in the business cluster is abnormal, an alert message is sent to relevant personnel.
  • the step C includes:
  • Step C1 Specify the number of nodes and business names included in the business cluster
  • Step C2 Call the cloud host to create an interface
  • Step C3 Create a cloud host
  • Step C4 Add all cloud hosts to the business cluster as nodes running on the business container.
  • step C4 it further includes:
  • Step C5 Configure designated service labels for all nodes.
  • step D includes: configuring configuration items of the selected node for each application.
  • the Kubernetes cluster-based management method, device, and computer-readable storage medium proposed in this application enable the container service after configuring the configuration information required by the cluster, create a business cluster, deploy application containers, and create a control cluster in a designated VPC ;
  • This application solves the technical problem of how to switch from cloud host deployment to containerized deployment, does not require users to master Kubernetes professional knowledge, and reduces user learning costs; this application manages services through business clusters, allowing many traditional users to quickly use
  • the container service based on Kubernetes is used to manage container applications to facilitate rapid deployment from cloud host deployment to containerized deployment; this application also creates business clusters based on business modules to facilitate management of business modules; users only need to create their own during use Business clusters, and containerized services can be deployed in them.

Abstract

A management method and apparatus based on a Kubernetes cluster, and a computer-readable storage medium. The method comprises: determining configuration information required by a Kubernetes cluster, opening a container service, creating a service cluster, and deploying an application container, wherein the step "opening a container service" comprises: creating a control cluster in a specified VPC, and the configuration information comprises: configuration information of a basic resource, configuration information of a cluster size, configuration information of a cluster network, and configuration information of a Kubernetes application. The method solves the technical problem of how to switch from cloud host deployment to containerized deployment. By only creating a service cluster, a containerized service can be deployed therein, and a user does not need to master professional knowledge of Kubernetes, thereby reducing the learning costs of the user and facilitating service management.

Description

基于Kubernetes集群的管理方法、装置及计算机可读存储介质Management method, device and computer readable storage medium based on Kubernetes cluster
本申请要求于2019年7月30日提交中国专利局,申请号为201910704915.3、发明名称为“基于Kubernetes集群的管理方法、装置及计算机可读存储介质”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。This application claims the priority of a Chinese patent application filed with the Chinese Patent Office on July 30, 2019, the application number is 201910704915.3, and the invention title is "Kubernetes cluster-based management methods, devices and computer-readable storage media". The entire content Incorporated in this application by reference.
技术领域Technical field
本申请涉及云部署技术领域,尤其涉及一种基于Kubernetes集群的管理方法、装置及计算机可读存储介质。This application relates to the field of cloud deployment technology, and in particular to a management method, device and computer-readable storage medium based on a Kubernetes cluster.
背景技术Background technique
Kubernetes是开源的一个容器编排引擎,也是一个用于管理云平台中多个主机上的容器化的应用。Kubernetes支持自动化部署、大规模可伸缩、应用容器化管理。在生产环境中部署一个应用程序时,通常要部署该应用的多个实例以便对应用请求进行负载均衡。在Kubernetes中,我们可以创建多个容器,每个容器里面运行一个应用实例,然后通过内置的负载均衡策略,实现对这一组应用实例的管理、发现、访问,而这些细节都不需要运维人员去进行复杂的手工配置和处理。Kubernetes is an open source container orchestration engine, and it is also a containerized application used to manage multiple hosts in the cloud platform. Kubernetes supports automated deployment, large-scale scalability, and application containerized management. When deploying an application in a production environment, multiple instances of the application are usually deployed to load balance application requests. In Kubernetes, we can create multiple containers, each container runs an application instance, and then through the built-in load balancing strategy to achieve the management, discovery, and access to this group of application instances, and these details do not require operation and maintenance Personnel to carry out complex manual configuration and processing.
目前大部分公有云厂商都有提供容器服务,且都提供了基于Kubernetes的企业级容器应用管理服务,支持一键部署Kubernetes集群。容器服务提供了一个通用的基于Kubernetes的容器应用管理平台,但目前这样的平台,只提供了一个管理容器的通用环境,并且将太多Kubernetes专业知识暴露给用户,使得用户的学习成本较高,不方便用户从原来的云主机部署,切换到容器化部署。At present, most public cloud vendors provide container services, and all provide enterprise-level container application management services based on Kubernetes, and support one-click deployment of Kubernetes clusters. Container Service provides a general-purpose Kubernetes-based container application management platform, but the current platform only provides a general environment for managing containers, and exposes too much Kubernetes expertise to users, which makes the learning cost of users higher. It is not convenient for users to switch from the original cloud host deployment to containerized deployment.
发明内容Summary of the invention
本申请提供一种基于Kubernetes集群的管理方法、装置及计算机可读存储介质,其主要目的旨在解决如何从云主机部署切换到容器化部署的技术问题。This application provides a management method, device and computer-readable storage medium based on a Kubernetes cluster, the main purpose of which is to solve the technical problem of how to switch from cloud host deployment to containerized deployment.
为实现上述目的,本申请提供一种基于Kubernetes集群的管理方法,该方法包括如下步骤:确定Kubernetes集群所需的配置信息;其中,所述Kubernetes集群包括业务集群和控制集群,所述配置信息包括节点的配置项;根据所述配置信息开通相应的容器服务;根据所述配置信息创建相应的业务集群;根据所述配置信息部署相应的应用容器;其中,所述根据所述配置信息开通容器服务的步骤包括:在指定的虚拟私有云(Virtual Private Cloud,VPC)中创建控制集群;其中,所述控制集群用于部署和管理所述业务集群内的每个应用程序;所述根据所述配置信息部署相应的应用容器的步骤包括:给业务集群内的每个应用程序配置好选择节点的配置项;所述根据所述配置信息创建相应的业务集群的步骤包括:指定业务集群所包含的节点数和业务名称;调用云主机创建接口;创建云主机;将所有云主机添加到业务集群中,作为业务容器运行的节点。In order to achieve the above objective, this application provides a management method based on a Kubernetes cluster. The method includes the following steps: determining configuration information required by the Kubernetes cluster; wherein the Kubernetes cluster includes a business cluster and a control cluster, and the configuration information includes Node configuration items; enable corresponding container services according to the configuration information; create corresponding business clusters according to the configuration information; deploy corresponding application containers according to the configuration information; wherein, the container services are enabled according to the configuration information The steps include: creating a control cluster in a designated virtual private cloud (Virtual Private Cloud, VPC); wherein, the control cluster is used to deploy and manage each application program in the business cluster; The step of information deployment of the corresponding application container includes: configuring each application in the business cluster with the configuration items of the selected node; the step of creating the corresponding business cluster according to the configuration information includes: specifying the nodes included in the business cluster Data and business name; call the cloud host creation interface; create the cloud host; add all the cloud hosts to the business cluster as the nodes of the business container.
为实现上述目的,本申请还提供一种基于Kubernetes集群的管理装置,所述装置包括存储器和处理器,所述存储器存储有可在所述处理器上运行的基于Kubernetes集群的管理程序,所述基于Kubernetes集群的管理程序被所述处理器执行时实现如上所述基于Kubernetes集群的管理方法的步骤。In order to achieve the above objective, this application also provides a management device based on a Kubernetes cluster. The device includes a memory and a processor. The memory stores a management program based on the Kubernetes cluster that can run on the processor. When the management program based on the Kubernetes cluster is executed by the processor, the steps of the management method based on the Kubernetes cluster as described above are implemented.
此外,为实现上述目的,本申请还提供一种计算机可读存储介质,所述计算机可读存储介质上存储有基于Kubernetes集群的管理程序,所述基于Kubernetes集群的管理程序可被一个或者多个处理器执行,以实现如上所述基于Kubernetes集群的管理方法的步骤。In addition, in order to achieve the above-mentioned purpose, this application also provides a computer-readable storage medium on which a management program based on a Kubernetes cluster is stored, and the management program based on a Kubernetes cluster can be used by one or more The processor executes to implement the steps of the management method based on the Kubernetes cluster as described above.
本申请提出的基于Kubernetes集群的管理方法、装置及计算机可读存储介质,通过在配置集群所需的配置信息后开通容器服务,从而可以在指定的 VPC中创建控制集群、创建业务集群、并部署应用容器,而不需要在云主机中进行创建控制集群、创建业务集群、部署应用容器等部署操作,从而实现了从云主机部署切换到容器化部署,方便业务管理。The Kubernetes cluster-based management method, device and computer-readable storage medium proposed in this application can create a control cluster, create a business cluster, and deploy in a designated VPC by enabling the container service after configuring the configuration information required by the cluster. Application container, without the need to create control clusters, create business clusters, deploy application containers and other deployment operations in the cloud host, thus realizing the switch from cloud host deployment to containerized deployment, which is convenient for business management.
附图说明Description of the drawings
图1为本申请一实施例提供的基于Kubernetes集群的管理方法的流程示意图;FIG. 1 is a schematic flow diagram of a management method based on a Kubernetes cluster provided by an embodiment of this application;
图2为图1中的步骤C的流程示意图;FIG. 2 is a schematic flowchart of step C in FIG. 1;
图3为本申请一实施例提供的基于Kubernetes集群的管理装置的内部结构示意图;3 is a schematic diagram of the internal structure of a management device based on a Kubernetes cluster provided by an embodiment of the application;
图4为本申请一实施例提供的基于Kubernetes集群的管理装置中基于Kubernetes集群的管理程序的模块示意图。4 is a schematic diagram of modules of a management program based on a Kubernetes cluster in a management device based on a Kubernetes cluster provided by an embodiment of the application.
本申请目的的实现、功能特点及优点将结合实施例,参照附图做进一步说明。The realization, functional characteristics, and advantages of the purpose of this application will be further described in conjunction with the embodiments and with reference to the accompanying drawings.
具体实施方式Detailed ways
应当理解,此处所描述的具体实施例仅仅用以解释本申请,并不用于限定本申请。It should be understood that the specific embodiments described here are only used to explain the application, and are not used to limit the application.
本申请提供一种基于Kubernetes集群的管理方法。本实施例中,银行系统中包括配置管理系统和银行业务子系统,银行系统中有对应每一项目的项目路径。参照图1所示,为本申请一实施例提供的基于Kubernetes集群的管理方法的流程示意图。该方法可以由一个装置执行,该装置可以由软件和/或硬件实现。This application provides a management method based on a Kubernetes cluster. In this embodiment, the banking system includes a configuration management system and a banking business subsystem, and the banking system has a project path corresponding to each project. Referring to FIG. 1, it is a schematic flowchart of a management method based on a Kubernetes cluster provided by an embodiment of this application. The method can be executed by a device, and the device can be implemented by software and/or hardware.
在本实施例中,所述基于Kubernetes集群的管理方法包括:In this embodiment, the management method based on the Kubernetes cluster includes:
步骤A:确定Kubernetes集群所需的配置信息。其中,所述Kubernetes集群包括业务集群和控制集群。所述业务集群用于为容器应用提供运行环境, 所述控制集群用于部署和管理业务集群内的每个应用程序或者业务等,所述所述控制集群也称为业务管理集群。Step A: Determine the configuration information required by the Kubernetes cluster. Wherein, the Kubernetes cluster includes a business cluster and a control cluster. The service cluster is used to provide an operating environment for container applications, the control cluster is used to deploy and manage each application or service in the service cluster, and the control cluster is also called a service management cluster.
更进一步地,所述步骤A中所述“确定Kubernetes集群所需的配置信息”可以包括,但不限于包括:基础资源的配置信息、集群规模的配置信息、集群网络的配置信息、节点的配置项和Kubernetes应用的配置信息;Furthermore, the "determining the configuration information required by the Kubernetes cluster" in step A may include, but is not limited to: configuration information of basic resources, configuration information of the cluster size, configuration information of the cluster network, and configuration of nodes Configuration information of items and Kubernetes applications;
其中,所述基础资源的配置信息包括:集群是否为高可用、可用区、云主机计费方式、集群区域、云主机镜像、密钥对、节点规格、外部网络;Wherein, the configuration information of the basic resources includes: whether the cluster is highly available, availability zone, cloud host billing method, cluster area, cloud host mirroring, key pair, node specifications, and external network;
所述集群规模的配置信息是指Kubernetes集群规模的配置信息,其包括:主节点个数和从节点个数;The configuration information of the cluster scale refers to the configuration information of the Kubernetes cluster scale, which includes: the number of master nodes and the number of slave nodes;
所述集群网络的配置信息是Kubernetes集群网络的配置信息,其包括:业务网络类型、网段地址、子网掩码、网关、需要开通容器服务的虚拟私有云(Virtual Private Cloud,VPC)、网络插件等;The configuration information of the cluster network is the configuration information of the Kubernetes cluster network, which includes: business network type, network segment address, subnet mask, gateway, virtual private cloud (VPC) that requires container service, network Plugins, etc.;
所述Kubernetes应用的配置信息包括:Kubernetes版本。The configuration information of the Kubernetes application includes: Kubernetes version.
进一步地,所述步骤A包括:Further, the step A includes:
确定需要开通容器服务的VPC;Determine the VPC that needs to activate the container service;
确定Kubernetes集群是否为高可用;及Determine whether the Kubernetes cluster is highly available; and
确定Kubernetes版本。Determine the Kubernetes version.
步骤B:根据所述配置信息开通相应的容器服务。Step B: Activate the corresponding container service according to the configuration information.
进一步地,所述步骤B包括:Further, the step B includes:
在指定的VPC中创建控制集群。其中,所述控制集群用于部署和管理所述业务集群内的每个应用程序。Create a control cluster in the specified VPC. Wherein, the control cluster is used to deploy and manage each application program in the business cluster.
更进一步地,所述控制集群包括至少一组kubernetes控制面的组件,每组kubernetes控制面的组件可以包括,但不限于包括:kube-apiserver、kube-controller-manager、kube-scheduler、Etcd等组件。Furthermore, the control cluster includes at least one group of kubernetes control plane components, and each group of kubernetes control plane components may include, but are not limited to, kube-apiserver, kube-controller-manager, kube-scheduler, Etcd, etc. .
其中,所述kubernetes控制面的组件解释如下:The components of the kubernetes control plane are explained as follows:
kube-apiserver:API服务器,用于暴露Kubernetes API;任何的资源请求/调用操作都是通过kube-apiserver提供的接口进行;kube-apiserver: API server, used to expose Kubernetes API; any resource request/call operation is performed through the interface provided by kube-apiserver;
kube-controller-manager:控制器管理器;kube-controller-manager: controller manager;
kube-scheduler:容器调度器,用于监视新创建没有分配到节点的Pod,为Pod选择一个节点;kube-scheduler: Container scheduler, used to monitor newly created Pods that are not assigned to nodes, and select a node for Pod;
Etcd:键值数据库,用于保存集群数据。Etcd: Key-value database, used to store cluster data.
更进一步地,所述控制集群还包括至少一组kubernetes服务组件,每组kubernetes服务组件可以包括,但不限于包括:kube-proxy、kube-dns、tiller、addons、flannel等组件。Furthermore, the control cluster further includes at least one set of kubernetes service components, and each set of kubernetes service components may include, but is not limited to, components such as kube-proxy, kube-dns, tiller, addons, and flannel.
其中,所述kubernetes服务组件解释如下:Among them, the kubernetes service component is explained as follows:
kube-proxy:向前代理,通过在主机上维护网络规则并执行连接转发来实现Kubernetes服务抽象;kube-proxy: Forward proxy, which implements Kubernetes service abstraction by maintaining network rules on the host and performing connection forwarding;
kube-dns:是指集群DNS(Domain Name Server),是域名服务器,用于为Kubernetes services提供DNS记录;kube-dns: refers to the cluster DNS (Domain Name Server), which is a domain name server, used to provide DNS records for Kubernetes services;
tiller:是Helm的服务端组件,Helm是Kubernetes的包管理工具;tiller: is the server-side component of Helm, and Helm is the package management tool of Kubernetes;
addons:是指addons插件,用于实现集群pod和Services功能;addons: refers to addons, which are used to implement cluster pod and services functions;
flannel:是kubernetes集群中的网络插件。flannel: It is a network plug-in in the kubernetes cluster.
优选地,所述步骤“在指定的VPC中创建控制集群”包括监控步骤,其中,所述监控步骤包括:Preferably, the step "create a control cluster in the designated VPC" includes a monitoring step, wherein the monitoring step includes:
采集云主机性能指标;及Collect cloud host performance indicators; and
根据采集到的云主机性能指标做界面图形展示。Display the interface graphics based on the collected cloud host performance indicators.
其中,在一实施例中,所述云主机性能指标包括:主机的CPU使用率,MEM使用率等。Wherein, in an embodiment, the cloud host performance index includes: the host's CPU usage rate, MEM usage rate, etc.
进一步地,所述监控步骤还包括:采集Kubernetes组件和容器的存在性、存活性指标。Further, the monitoring step further includes: collecting the existence and survivability indicators of Kubernetes components and containers.
进一步地,所述监控步骤中包括控制集群节点的监控和业务集群的监控;具体地,所述监控步骤中包括:对控制集群节点上的所有组件和容器进行存活性监控;所述监控步骤中还包括:对业务集群上的应用容器进行监控。Further, the monitoring step includes the monitoring of the control cluster node and the monitoring of the service cluster; specifically, the monitoring step includes: monitoring the survivability of all components and containers on the control cluster node; in the monitoring step It also includes: monitoring the application containers on the business cluster.
具体地,在本实施例中,控制集群和业务集群中包括监控agent,通过控制集群和业务集群上运行的监控agent,采集云主机性能指标,并将采集到的云主机性能指标做界面图形展示。其中,监控agent是一种监控程序。Specifically, in this embodiment, the control cluster and the business cluster include a monitoring agent, and the cloud host performance index is collected by the monitoring agent running on the control cluster and the business cluster, and the collected cloud host performance index is displayed on the interface graphic . Among them, the monitoring agent is a monitoring program.
进一步地,所述步骤“在指定的VPC中创建控制集群”还包括:日志步骤;具体地,所述日志步骤包括:当所述容器服务模块创建控制集群时生成日志;Further, the step of "creating a control cluster in the designated VPC" further includes: a log step; specifically, the log step includes: generating a log when the container service module creates the control cluster;
其中,所述日志包括云主机的日志、管理集群组件日志和pod的日志。The logs include cloud host logs, management cluster component logs, and pod logs.
优选地,为了方便用户不用登录到云主机就可以查看自己关注的日志,所述日志步骤还包括:通过监控agent将所有日志统一汇聚到日志云。Preferably, in order to facilitate the user to view the logs of his concern without logging in to the cloud host, the log step further includes: converging all logs to the log cloud through the monitoring agent.
所述步骤“在指定的VPC中创建控制集群”还包括警报步骤:当控制集群的组件出现异常时,或者业务集群中的组件或者pod出现异常时,发送警报消息给相关人员。优选地,所述警报消息可以通过邮件、电话、短信等形式发送给相关人员。The step of "creating a control cluster in a designated VPC" also includes an alerting step: when a component of the control cluster is abnormal, or a component or a pod in the business cluster is abnormal, an alert message is sent to relevant personnel. Preferably, the alarm message can be sent to relevant personnel in the form of email, telephone, short message, etc.
进一步地,所述警报步骤包括:当控制集群节点上的所有组件和容器的存活性出现异常时,发送警报消息给相关人员。所述警报步骤还包括:当业务集群上的应用容器的警报出现异常时,发送警报消息给相关人员,例如,当pod出现异常时发送警报消息给相关人员。Further, the alerting step includes: when the viability of all components and containers on the control cluster node is abnormal, sending an alert message to relevant personnel. The alerting step further includes: sending an alert message to relevant personnel when the alert of the application container on the business cluster is abnormal, for example, sending an alert message to the relevant personnel when the pod is abnormal.
步骤C:根据所述配置信息创建相应的业务集群。Step C: Create a corresponding business cluster according to the configuration information.
进一步地,请参阅图2,所述步骤C包括:Further, referring to Figure 2, the step C includes:
步骤C1:指定业务集群所包含的节点数和业务名称;Step C1: Specify the number of nodes and business names included in the business cluster;
步骤C2:调用云主机创建接口;Step C2: Call the cloud host to create an interface;
步骤C3:创建云主机;Step C3: Create a cloud host;
步骤C4:将所有云主机添加到业务集群中,作为业务容器运行的节点。Step C4: Add all cloud hosts to the business cluster as nodes running on the business container.
其中,在执行所述步骤C1的过程中,也可以在后续添加或者删除Kubernetes业务节点。Wherein, in the process of performing step C1, Kubernetes service nodes can also be added or deleted later.
具体地,所述步骤C4包括:Specifically, the step C4 includes:
在创建完云主机后,将云主机添加到业务集群;After creating the cloud host, add the cloud host to the business cluster;
给云主机安装上Kubernetes业务节点所需的组件;Install the components required by the Kubernetes business node on the cloud host;
将集群节点、网络等信息存储在Etcd中。Store cluster nodes, network and other information in Etcd.
优选地,所述Kubernetes业务节点所需的组件可以是:flannel、docker、kube-proxy、应用容器等。其中,docker是一个开源的应用容器引擎,用于运行容器。Preferably, the components required by the Kubernetes service node may be: flannel, docker, kube-proxy, application container, etc. Among them, docker is an open source application container engine for running containers.
优选地,在本实施例中,采用Etcd存储系统存储各节点信息。通过所述Etcd能够快速有效地添加或者删除当前各个Kubernetes节点的信息。Preferably, in this embodiment, an Etcd storage system is used to store the information of each node. The Etcd can quickly and effectively add or delete the current information of each Kubernetes node.
进一步地,为了方便在创建core应用时,所述业务容器能调度到VPC中指定的节点上,所述步骤C4之后还包括:Further, in order to facilitate the creation of the core application, the service container can be scheduled to the designated node in the VPC, after the step C4, the method further includes:
步骤C5:给所有节点配置指定的业务标签。例如,app=core。Step C5: Configure designated service labels for all nodes. For example, app=core.
进一步地,为了隔离应用程序,所述步骤C包括:创建一个namespace(命名空间)资源对象。其中,将一个或者多个应用程序部署到一个业务集群中。Further, in order to isolate the application program, the step C includes: creating a namespace resource object. Among them, one or more applications are deployed to a business cluster.
步骤D:根据所述配置信息部署相应的应用容器。Step D: Deploy the corresponding application container according to the configuration information.
优选地,为了确保所述应用容器创建成功后,能顺利调度到指定的节点上,所述步骤D包括:给每个应用程序配置好选择节点的配置项。优选地,在本实施例中,所述配置项包括:指定deployment中的spec.nodeSelector字 段。Preferably, in order to ensure that the application container can be successfully scheduled to the designated node after the application container is successfully created, the step D includes: configuring each application program with configuration items of the selected node. Preferably, in this embodiment, the configuration item includes: specifying the spec.nodeSelector field in the deployment.
其中,deployment是Kubernetes的一种资源对象,用来更好的解决Pod的编排问题;pod代表一个应用;deployment是用来管理Kubernetes无状态应用的;spec.nodeSelector是让pod调度到配置特定标签的主机上。Among them, deployment is a resource object of Kubernetes, which is used to better solve the problem of Pod scheduling; pod represents an application; deployment is used to manage Kubernetes stateless applications; spec.nodeSelector allows pods to be scheduled to configure specific labels On the host.
优选地,一个或者多个应用程序有自己专属的运行环境,该一个或者多个应用程序与其它应用程序隔离;应用程序的资源不会被其它应用程序抢占,两个应用程序之间的异常问题,只可能因为接口调用异常,而不会因为资源抢占导致异常;通过这种隔离方式,可以提升问题定位效率,利于团队之间的协作。Preferably, one or more applications have their own dedicated operating environment, and the one or more applications are isolated from other applications; the resources of the application will not be preempted by other applications, and abnormal problems between the two applications , It is only possible because of abnormal interface calls, not because of resource preemption; through this isolation method, the efficiency of problem location can be improved, which is conducive to collaboration between teams.
本申请提出的基于Kubernetes集群的管理方法解决了如何从云主机部署切换到容器化部署的技术问题,不需要用户掌握Kubernetes的专业知识,降低用户学习成本;本申请通过业务集群来管理业务,能让众多的传统用户快速使用基于Kubernetes的容器服务来管理容器应用,方便完成从云主机部署到容器化部署的快速部署;本申请还根据业务模块创建业务集群,从而方便管理业务模块;用户在使用过程中只需要创建自己的业务集群,并可将已容器化的业务部署其中。The Kubernetes cluster-based management method proposed in this application solves the technical problem of how to switch from cloud host deployment to containerized deployment, does not require users to master Kubernetes professional knowledge, and reduces user learning costs; this application manages business through business clusters, Let many traditional users quickly use the Kubernetes-based container service to manage container applications, which facilitates rapid deployment from cloud host deployment to containerized deployment; this application also creates business clusters based on business modules to facilitate management of business modules; users are using In the process, you only need to create your own business cluster, and you can deploy containerized services in it.
本申请还提供一种基于Kubernetes集群的管理装置。参照图3所示,为本申请一实施例提供的基于Kubernetes集群的管理装置的内部结构示意图。The application also provides a management device based on a Kubernetes cluster. Referring to FIG. 3, it is a schematic diagram of the internal structure of a Kubernetes cluster-based management device provided by an embodiment of this application.
在本实施例中,所述基于Kubernetes集群的管理装置可以是PC(Personal Computer,个人电脑),也可以是智能手机、平板电脑、便携计算机等终端设备。该基于Kubernetes集群的管理装置至少包括存储器11、处理器12、网络接口13以及通信总线14。In this embodiment, the management device based on the Kubernetes cluster may be a PC (Personal Computer, personal computer), or a terminal device such as a smart phone, a tablet computer, or a portable computer. The Kubernetes cluster-based management device includes at least a memory 11, a processor 12, a network interface 13, and a communication bus 14.
其中,所述存储器11至少包括一种类型的计算机可读存储介质,所述计算机可读存储介质包括闪存、硬盘、多媒体卡、卡型存储器(例如,SD或DX存储器等)、磁性存储器、磁盘、光盘等。所述存储器11在一些实施例中可以是基于Kubernetes集群的管理装置的内部存储单元,例如该基于 Kubernetes集群的管理装置的硬盘。所述存储器11在另一些实施例中也可以是基于Kubernetes集群的管理装置的外部存储设备,例如基于Kubernetes集群的管理装置上配备的插接式硬盘,智能存储卡(Smart Media Card,SMC),安全数字(Secure Digital,SD)卡,闪存卡(Flash Card)等。进一步地,所述存储器11还可以既包括基于Kubernetes集群的管理装置的内部存储单元也包括外部存储设备。所述存储器11不仅可以用于存储安装于基于Kubernetes集群的管理装置的应用软件及各类数据,例如基于Kubernetes集群的管理程序的代码等,还可以用于暂时地存储已经输出或者将要输出的数据。Wherein, the memory 11 includes at least one type of computer-readable storage medium, and the computer-readable storage medium includes flash memory, hard disk, multimedia card, card-type memory (for example, SD or DX memory, etc.), magnetic memory, and magnetic disk. , CD, etc. In some embodiments, the memory 11 may be an internal storage unit of a management device based on a Kubernetes cluster, such as a hard disk of the management device based on a Kubernetes cluster. In other embodiments, the memory 11 may also be an external storage device of a management device based on a Kubernetes cluster, such as a plug-in hard disk or a smart media card (SMC) equipped on a management device based on a Kubernetes cluster. Secure Digital (SD) card, Flash Card, etc. Further, the memory 11 may also include both an internal storage unit of a management device based on a Kubernetes cluster and an external storage device. The memory 11 can be used not only to store application software and various data installed in the management device based on the Kubernetes cluster, such as the code of the management program based on the Kubernetes cluster, etc., but also to temporarily store the data that has been output or will be output. .
所述处理器12在一些实施例中可以是一中央处理器(Central Processing Unit,CPU)、控制器、微控制器、微处理器或其他数据处理芯片,用于运行所述存储器11中存储的程序代码或处理数据,例如执行基于Kubernetes集群的管理程序等。In some embodiments, the processor 12 may be a central processing unit (CPU), controller, microcontroller, microprocessor, or other data processing chip, which is used to run data stored in the memory 11 Program code or processing data, such as executing management programs based on Kubernetes clusters.
所述网络接口13可选的可以包括标准的有线接口、无线接口(如WI-FI接口),通常用于在该基于Kubernetes集群的管理装置与其他电子设备之间建立通信连接。The network interface 13 may optionally include a standard wired interface and a wireless interface (such as a WI-FI interface), and is usually used to establish a communication connection between the Kubernetes cluster-based management device and other electronic devices.
所述通信总线14用于实现这些组件之间的连接通信。The communication bus 14 is used to realize the connection and communication between these components.
图3仅示出了具有组件11至14以及基于Kubernetes集群的管理程序的基于Kubernetes集群的管理装置,本领域技术人员可以理解的是,图3示出的结构并不构成对基于Kubernetes集群的管理装置的限定,可以包括比图示更少或者更多的部件,或者组合某些部件,或者不同的部件布置。Figure 3 only shows a Kubernetes cluster-based management device with components 11 to 14 and a Kubernetes cluster-based management program. Those skilled in the art can understand that the structure shown in Figure 3 does not constitute management of a Kubernetes-based cluster The definition of the device may include fewer or more components than shown, or a combination of certain components, or different component arrangements.
在图3所示的基于Kubernetes集群的管理装置实施例中,所述存储器11中存储有基于Kubernetes集群的管理程序;所述处理器12执行所述存储器11中存储的基于Kubernetes集群的管理程序时实现如下步骤:In the embodiment of the Kubernetes cluster-based management device shown in FIG. 3, the storage 11 stores a management program based on the Kubernetes cluster; when the processor 12 executes the management program based on the Kubernetes cluster stored in the storage 11 Implement the following steps:
步骤A:确定Kubernetes集群所需的配置信息。Step A: Determine the configuration information required by the Kubernetes cluster.
更进一步地,所述步骤A中所述“确定Kubernetes集群所需的配置信息”可以包括,但不限于包括:基础资源的配置信息、集群规模的配置信息、集 群网络的配置信息、节点的配置项和Kubernetes应用的配置信息;Furthermore, the "determining the configuration information required by the Kubernetes cluster" in step A may include, but is not limited to: configuration information of basic resources, configuration information of the cluster size, configuration information of the cluster network, and configuration of nodes Configuration information of items and Kubernetes applications;
其中,所述基础资源的配置信息包括:集群是否为高可用、可用区、云主机计费方式、集群区域、云主机镜像、密钥对、节点规格、外部网络;Wherein, the configuration information of the basic resources includes: whether the cluster is highly available, availability zone, cloud host billing method, cluster area, cloud host mirroring, key pair, node specifications, and external network;
所述集群规模的配置信息包括:主节点个数和从节点个数;The configuration information of the cluster size includes: the number of master nodes and the number of slave nodes;
所述集群网络的配置信息包括:业务网络类型、网段地址、子网掩码、网关、需要开通容器服务的VPC、网络插件等;The configuration information of the cluster network includes: business network type, network segment address, subnet mask, gateway, VPC that needs to activate container service, network plug-in, etc.;
所述Kubernetes应用的配置信息包括:Kubernetes版本。The configuration information of the Kubernetes application includes: Kubernetes version.
进一步地,所述步骤A包括:Further, the step A includes:
确定需要开通容器服务的VPC(Virtual Private Cloud,虚拟私有云);Determine the VPC (Virtual Private Cloud) that needs to activate the container service;
确定Kubernetes集群是否为高可用;及Determine whether the Kubernetes cluster is highly available; and
确定Kubernetes版本。Determine the Kubernetes version.
步骤B:根据所述配置信息开通相应的容器服务。Step B: Activate the corresponding container service according to the configuration information.
进一步地,所述步骤B包括:Further, the step B includes:
在指定的VPC中创建控制集群。其中,所述控制集群用于部署和管理所述业务集群内的每个应用程序。Create a control cluster in the specified VPC. Wherein, the control cluster is used to deploy and manage each application program in the business cluster.
更进一步地,所述控制集群包括至少一组kubernetes控制面的组件,每组kubernetes控制面的组件可以包括,但不限于包括:kube-apiserver、kube-controller-manager、kube-scheduler、Etcd等组件。Furthermore, the control cluster includes at least one group of kubernetes control plane components, and each group of kubernetes control plane components may include, but are not limited to, kube-apiserver, kube-controller-manager, kube-scheduler, Etcd, etc. .
其中,所述kubernetes控制面的组件解释如下:The components of the kubernetes control plane are explained as follows:
kube-apiserver:API服务器,用于暴露Kubernetes API;任何的资源请求/调用操作都是通过kube-apiserver提供的接口进行;kube-apiserver: API server, used to expose Kubernetes API; any resource request/call operation is performed through the interface provided by kube-apiserver;
kube-controller-manager:控制器管理器;kube-controller-manager: controller manager;
kube-scheduler:容器调度器,用于监视新创建没有分配到节点的Pod,为Pod选择一个节点;kube-scheduler: Container scheduler, used to monitor newly created Pods that are not assigned to nodes, and select a node for Pod;
Etcd:键值数据库,用于保存集群数据。Etcd: Key-value database, used to store cluster data.
更进一步地,所述控制集群还包括至少一组kubernetes服务组件,每组kubernetes服务组件可以包括,但不限于包括:kube-proxy、kube-dns、tiller、addons、flannel等组件。Furthermore, the control cluster also includes at least one set of kubernetes service components, and each set of kubernetes service components may include, but is not limited to, components such as kube-proxy, kube-dns, tiller, addons, and flannel.
其中,所述kubernetes服务组件解释如下:Among them, the kubernetes service component is explained as follows:
kube-proxy:向前代理,通过在主机上维护网络规则并执行连接转发来实现Kubernetes服务抽象;kube-proxy: Forward proxy, which implements Kubernetes service abstraction by maintaining network rules on the host and performing connection forwarding;
kube-dns:是指集群DNS(Domain Name Server),是域名服务器,用于为Kubernetes services提供DNS记录;kube-dns: refers to the cluster DNS (Domain Name Server), which is a domain name server, used to provide DNS records for Kubernetes services;
tiller:是Helm的服务端组件,Helm是Kubernetes的包管理工具;tiller: is the server-side component of Helm, and Helm is the package management tool of Kubernetes;
addons:是指addons插件,用于实现集群pod和Services功能;addons: refers to addons, which are used to implement cluster pod and services functions;
flannel:是kubernetes集群中的网络插件。flannel: It is a network plug-in in the kubernetes cluster.
优选地,所述步骤“在指定的VPC中创建控制集群”包括监控步骤,其中,所述监控步骤包括:Preferably, the step "create a control cluster in the designated VPC" includes a monitoring step, wherein the monitoring step includes:
采集云主机性能指标;及Collect cloud host performance indicators; and
根据采集到的云主机性能指标做界面图形展示。Display the interface graphics based on the collected cloud host performance indicators.
其中,在一实施例中,所述云主机性能指标包括:主机的CPU使用率,MEM使用率等。Wherein, in an embodiment, the cloud host performance index includes: the host's CPU usage rate, MEM usage rate, etc.
进一步地,所述监控步骤还包括:采集Kubernetes组件和容器的存在性、存活性指标。Further, the monitoring step further includes: collecting the existence and survivability indicators of Kubernetes components and containers.
进一步地,所述监控步骤中包括控制集群节点的监控和业务集群的监控;具体地,所述监控步骤中包括:对控制集群节点上的所有组件和容器进行存活性监控;所述监控步骤中还包括:对业务集群上的应用容器进行监控。Further, the monitoring step includes the monitoring of the control cluster node and the monitoring of the service cluster; specifically, the monitoring step includes: monitoring the survivability of all components and containers on the control cluster node; in the monitoring step It also includes: monitoring the application containers on the business cluster.
具体地,在本实施例中,控制集群和业务集群中包括监控agent,通过控制集群和业务集群上运行的监控agent,采集云主机性能指标,并将采集到的云主机性能指标做界面图形展示。其中,监控agent是一种监控程序。Specifically, in this embodiment, the control cluster and the business cluster include a monitoring agent, and the cloud host performance index is collected by the monitoring agent running on the control cluster and the business cluster, and the collected cloud host performance index is displayed on the interface graphic . Among them, the monitoring agent is a monitoring program.
进一步地,所述步骤“在指定的VPC中创建控制集群”还包括:日志步骤;具体地,所述日志步骤包括:当所述容器服务模块创建控制集群时生成日志;Further, the step of "creating a control cluster in the designated VPC" further includes: a log step; specifically, the log step includes: generating a log when the container service module creates the control cluster;
其中,所述日志包括云主机的日志、管理集群组件日志和pod的日志。The logs include cloud host logs, management cluster component logs, and pod logs.
优选地,为了方便用户不用登录到云主机就可以查看自己关注的日志,所述日志步骤还包括:通过监控agent将所有日志统一汇聚到日志云。Preferably, in order to facilitate the user to view the logs of his concern without logging in to the cloud host, the log step further includes: converging all logs to the log cloud through the monitoring agent.
所述步骤“在指定的VPC中创建控制集群”还包括警报步骤:当控制集群的组件出现异常时,或者业务集群中的组件或者pod出现异常时,发送警报消息给相关人员。优选地,所述警报消息可以通过邮件、电话、短信等形式发送给相关人员。The step of "creating a control cluster in a designated VPC" also includes an alerting step: when a component of the control cluster is abnormal, or a component or a pod in the business cluster is abnormal, an alert message is sent to relevant personnel. Preferably, the alarm message can be sent to relevant personnel in the form of email, telephone, short message, etc.
进一步地,所述警报步骤包括:控制集群节点的警报和业务集群的警报;具体地,所述警报步骤包括:当控制集群节点上的所有组件和容器的存活性出现异常时,发送警报消息给相关人员。Further, the alarm step includes: controlling the alarm of the cluster node and the alarm of the business cluster; specifically, the alarm step includes: when the viability of all components and containers on the control cluster node is abnormal, sending an alarm message Relevant personnel.
所述警报步骤还包括:当业务集群上的应用容器出现异常时,发送警报消息给相关人员,例如,当pod出现异常时发送警报消息给相关人员。The alerting step further includes: sending an alert message to relevant personnel when the application container on the business cluster is abnormal, for example, sending an alert message to the relevant personnel when the pod is abnormal.
步骤C:根据所述配置信息创建相应的业务集群。Step C: Create a corresponding business cluster according to the configuration information.
进一步地,所述步骤C包括:Further, the step C includes:
步骤C1:指定业务集群所包含的节点数和业务名称;Step C1: Specify the number of nodes and business names included in the business cluster;
步骤C2:调用云主机创建接口;Step C2: Call the cloud host to create an interface;
步骤C3:创建云主机;Step C3: Create a cloud host;
步骤C4:将所有云主机添加到业务集群中,作为业务容器运行的节点。Step C4: Add all cloud hosts to the business cluster as nodes running on the business container.
其中,在执行所述步骤C1的过程中,也可以在后续添加或者删除Kubernetes业务节点。Wherein, in the process of performing step C1, Kubernetes service nodes can also be added or deleted later.
具体地,所述步骤C4包括:Specifically, the step C4 includes:
在创建完云主机后,将云主机添加到业务集群;After creating the cloud host, add the cloud host to the business cluster;
给云主机安装上Kubernetes业务节点所需的组件;Install the components required by the Kubernetes business node on the cloud host;
将集群节点、网络等信息存储在Etcd中。Store cluster nodes, network and other information in Etcd.
优选地,所述Kubernetes业务节点所需的组件可以是:flannel、docker、kube-proxy、应用容器等。其中,docker是一个开源的应用容器引擎,用于运行容器。Preferably, the components required by the Kubernetes service node may be: flannel, docker, kube-proxy, application container, etc. Among them, docker is an open source application container engine for running containers.
进一步地,为了方便在创建core应用时,所述业务容器能调度到VPC中指定的节点上,所述步骤C4之后还包括:Further, in order to facilitate the creation of the core application, the service container can be scheduled to the designated node in the VPC, after the step C4, the method further includes:
步骤C5:给所有节点配置指定的业务标签。例如,app=core。Step C5: Configure designated service labels for all nodes. For example, app=core.
进一步地,为了隔离应用程序,所述步骤C包括:创建一个namespace(命名空间)资源对象。其中,将一个或者多个应用程序部署到一个业务集群中。Further, in order to isolate the application program, the step C includes: creating a namespace resource object. Among them, one or more applications are deployed to a business cluster.
步骤D:根据所述配置信息部署相应的应用容器。Step D: Deploy the corresponding application container according to the configuration information.
优选地,为了确保所述应用容器创建成功后,能顺利调度到指定的节点上,所述步骤D包括:给每个应用程序配置好选择节点的配置项。优选地,在本实施例中,所述配置项包括:指定deployment中的spec.nodeSelector字段。Preferably, in order to ensure that the application container can be successfully scheduled to the designated node after the application container is successfully created, the step D includes: configuring each application program with configuration items of the selected node. Preferably, in this embodiment, the configuration item includes: specifying the spec.nodeSelector field in the deployment.
其中,deployment是Kubernetes的一种资源对象,用来更好的解决Pod的编排问题;pod代表一个应用;deployment是用来管理Kubernetes无状态应用的;spec.nodeSelector是让pod调度到配置特定标签的主机上。Among them, deployment is a resource object of Kubernetes, which is used to better solve the problem of Pod scheduling; pod represents an application; deployment is used to manage Kubernetes stateless applications; spec.nodeSelector allows pods to be scheduled to configure specific labels On the host.
优选地,一个或者多个应用程序有自己专属的运行环境,该一个或者多个应用程序与其它应用程序隔离;应用程序的资源不会被其它应用程序抢占,两个应用程序之间的异常问题,只可能因为接口调用异常,而不会因为资源抢占导致异常;通过这种隔离方式,可以提升问题定位效率,利于团队之间的协作。Preferably, one or more applications have their own dedicated operating environment, and the one or more applications are isolated from other applications; the resources of the application will not be preempted by other applications, and abnormal problems between the two applications , It is only possible because of abnormal interface calls, not because of resource preemption; through this isolation method, the efficiency of problem location can be improved, which is conducive to collaboration between teams.
例如,参照图4所示,为本申请基于Kubernetes集群的管理装置一实施例中的基于Kubernetes集群的管理程序的程序模块示意图。在该实施例中,所述基于Kubernetes集群的管理程序可以被分割为配置模块10、容器服务模块20、创建模块30、部署模块40、监控模块50、警报模块60以及日志模块70,示例性地:For example, referring to FIG. 4, which is a schematic diagram of program modules of a Kubernetes cluster-based management program in an embodiment of a Kubernetes cluster-based management device of this application. In this embodiment, the management program based on the Kubernetes cluster can be divided into a configuration module 10, a container service module 20, a creation module 30, a deployment module 40, a monitoring module 50, an alarm module 60, and a log module 70, exemplarily :
所述配置模块10用于确定Kubernetes集群所需的配置信息。所述配置模块10还用于确定需要开通容器服务的VPC、确定Kubernetes集群是否为高可用、及确定Kubernetes版本。The configuration module 10 is used to determine configuration information required by the Kubernetes cluster. The configuration module 10 is also used to determine the VPC that needs to activate the container service, determine whether the Kubernetes cluster is highly available, and determine the Kubernetes version.
所述容器服务模块20用于根据所述配置信息开通相应的容器服务。The container service module 20 is configured to activate corresponding container services according to the configuration information.
所述创建模块30用于根据所述配置信息创建相应的业务集群。The creation module 30 is used to create a corresponding business cluster according to the configuration information.
所述部署模块40用于根据所述配置信息部署相应的应用容器。The deployment module 40 is configured to deploy a corresponding application container according to the configuration information.
所述监控模块50用于采集云主机性能指标,及用于根据采集到的云主机性能指标做界面图形展示。The monitoring module 50 is used to collect cloud host performance indicators, and is used to display interface graphics according to the collected cloud host performance indicators.
所述监控模块50采用cAdvisor,cAdvisor是一个用于收集、聚合处理和输出容器运行指标的守护进程,通过cAdvisor能获取Kubernetes集群中Docker各种性能数据。The monitoring module 50 adopts cAdvisor, which is a daemon process for collecting, aggregating, and outputting container operation indicators. Various performance data of Docker in the Kubernetes cluster can be obtained through cAdvisor.
所述警报模块60用于当控制集群的组件出现异常时,或者业务集群中的组件或者pod出现异常时,发送警报消息给相关人员。The alarm module 60 is configured to send an alarm message to relevant personnel when an abnormality occurs in a component of the control cluster, or when an abnormality occurs in a component or a pod in the business cluster.
所述日志模块70用于当所述容器服务模块创建控制集群时生成日志。The log module 70 is configured to generate a log when the container service module creates a control cluster.
所述创建模块30还用于指定业务集群所包含的节点数和业务名称;还用于在指定业务集群所包含的节点数和业务名称后调用云主机创建接口;及用于在调用云主机创建接口后创建云主机;并用于在创建云主机后将所有云主机添加到业务集群中,作为业务容器运行的节点。The creation module 30 is also used to specify the number of nodes and business names contained in the business cluster; it is also used to call the cloud host creation interface after specifying the number of nodes and business names contained in the business cluster; and to call the cloud host creation Create a cloud host after the interface; it is used to add all the cloud hosts to the business cluster after the cloud host is created, as a node for the business container to run.
进一步地,为了方便在创建core应用时,所述业务容器能调度到VPC中指定的节点上,所述创建模块30还用于给所有节点配置指定的业务标签。Further, in order to facilitate the creation of the core application, the service container can be scheduled to the designated node in the VPC, and the creation module 30 is also used to configure designated service labels for all nodes.
优选地,为了确保所述应用容器创建成功后,能顺利调度到指定的节点 上,所述部署模块40还用于给每个应用程序配置好选择节点的配置项。优选地,在本实施例中,所述配置项包括:指定deployment中的spec.nodeSelector字段。Preferably, in order to ensure that the application container can be successfully scheduled to the designated node after the application container is successfully created, the deployment module 40 is also used to configure the configuration items of the selected node for each application. Preferably, in this embodiment, the configuration item includes: specifying the spec.nodeSelector field in the deployment.
优选地,本实施例中,采用Etcd存储系统存储各节点信息。通过所述Etcd能够快速有效地添加或者删除当前各个Kubernetes节点的信息。Preferably, in this embodiment, an Etcd storage system is used to store the information of each node. The Etcd can quickly and effectively add or delete the current information of each Kubernetes node.
上述配置模块10、容器服务模块20、创建模块30、部署模块40、监控模块50、警报模块60以及日志模块70等程序模块被执行时所实现的功能或操作步骤与上述实施例大体相同,在此不再赘述。The above-mentioned configuration module 10, container service module 20, creation module 30, deployment module 40, monitoring module 50, alarm module 60, and log module 70 implement functions or operation steps that are substantially the same as those in the foregoing embodiment when executed. This will not be repeated here.
此外,本申请实施例还提出一种计算机可读存储介质,所述计算机可读存储介质上存储有基于Kubernetes集群的管理程序,所述基于Kubernetes集群的管理程序可被一个或多个处理器执行,以实现如下操作:In addition, an embodiment of the present application also proposes a computer-readable storage medium, which stores a management program based on a Kubernetes cluster, and the management program based on a Kubernetes cluster can be executed by one or more processors To achieve the following operations:
步骤A:确定Kubernetes集群所需的配置信息;Step A: Determine the configuration information required by the Kubernetes cluster;
步骤B:根据所述配置信息开通相应的容器服务;Step B: Activate the corresponding container service according to the configuration information;
步骤C:根据所述配置信息创建相应的业务集群;Step C: Create a corresponding business cluster according to the configuration information;
步骤D:根据所述配置信息部署相应的应用容器。Step D: Deploy the corresponding application container according to the configuration information.
其中,所述步骤A包括:Wherein, the step A includes:
确定需要开通容器服务的VPC;Determine the VPC that needs to activate the container service;
确定Kubernetes集群是否为高可用;及Determine whether the Kubernetes cluster is highly available; and
确定Kubernetes版本。Determine the Kubernetes version.
所述步骤B包括:在指定的VPC中创建控制集群。The step B includes: creating a control cluster in the designated VPC.
优选地,所述步骤“在指定的VPC中创建控制集群”包括监控步骤,其中所述监控步骤包括:Preferably, the step of "creating a control cluster in the designated VPC" includes a monitoring step, wherein the monitoring step includes:
采集云主机性能指标;及Collect cloud host performance indicators; and
根据采集到的云主机性能指标做界面图形展示。Display the interface graphics based on the collected cloud host performance indicators.
进一步地,所述监控步骤还包括:采集Kubernetes组件和容器的存在性、 存活性指标。Further, the monitoring step further includes: collecting the existence and survivability indicators of Kubernetes components and containers.
进一步地,所述步骤“在指定的VPC中创建控制集群”还包括:日志步骤,其中,所述日志步骤包括:当所述容器服务模块创建控制集群时生成日志;Further, the step of "creating a control cluster in the designated VPC" further includes a log step, wherein the log step includes: generating a log when the container service module creates the control cluster;
所述步骤“在指定的VPC中创建控制集群”还包括警报步骤:当控制集群的组件出现异常时,或者业务集群中的组件或者pod出现异常时,发送警报消息给相关人员。The step of "creating a control cluster in a designated VPC" also includes an alerting step: when a component of the control cluster is abnormal, or a component or a pod in the business cluster is abnormal, an alert message is sent to relevant personnel.
优选地,所述步骤C包括:Preferably, the step C includes:
步骤C1:指定业务集群所包含的节点数和业务名称;Step C1: Specify the number of nodes and business names included in the business cluster;
步骤C2:调用云主机创建接口;Step C2: Call the cloud host to create an interface;
步骤C3:创建云主机;及Step C3: Create a cloud host; and
步骤C4:将所有云主机添加到业务集群中,作为业务容器运行的节点。Step C4: Add all cloud hosts to the business cluster as nodes running on the business container.
进一步地,所述步骤C4之后还包括:Further, after the step C4, it further includes:
步骤C5:给所有节点配置指定的业务标签。Step C5: Configure designated service labels for all nodes.
进一步地,所述步骤D包括:给每个应用程序配置好选择节点的配置项。Further, the step D includes: configuring configuration items of the selected node for each application.
本申请计算机可读存储介质具体实施方式与上述基于Kubernetes集群的管理装置和方法各实施例基本相同,在此不作累述。The specific implementation of the computer-readable storage medium of this application is basically the same as the above-mentioned embodiments of the Kubernetes cluster-based management device and method, and will not be repeated here.
本申请提出的基于Kubernetes集群的管理方法、装置及计算机可读存储介质,通过在配置集群所需的配置信息后开通容器服务,创建业务集群,并部署应用容器,在指定的VPC中创建控制集群;本申请解决了如何从云主机部署切换到容器化部署的技术问题,不需要用户掌握Kubernetes的专业知识,降低用户学习成本;本申请通过业务集群来管理业务,能让众多的传统用户快速使用基于Kubernetes的容器服务来管理容器应用,方便完成从云主机部署到容器化部署的快速部署;本申请还根据业务模块创建业务集群,从而方便管理业务模块;用户在使用过程中只需要创建自己的业务集群,并可将已容器化的业务部署其中。The Kubernetes cluster-based management method, device, and computer-readable storage medium proposed in this application enable the container service after configuring the configuration information required by the cluster, create a business cluster, deploy application containers, and create a control cluster in a designated VPC ; This application solves the technical problem of how to switch from cloud host deployment to containerized deployment, does not require users to master Kubernetes professional knowledge, and reduces user learning costs; this application manages services through business clusters, allowing many traditional users to quickly use The container service based on Kubernetes is used to manage container applications to facilitate rapid deployment from cloud host deployment to containerized deployment; this application also creates business clusters based on business modules to facilitate management of business modules; users only need to create their own during use Business clusters, and containerized services can be deployed in them.
需要说明的是,上述本申请实施例序号仅仅为了描述,不代表实施例的优劣。并且本文中的术语“包括”、或者其任何其他变体意在涵盖非排他性的包含,从而使得包括一系列要素的过程、装置、物品或者方法不仅包括那些要素,而且还包括没有明确列出的其他要素,或者是还包括为这种过程、装置、物品或者方法所固有的要素。在没有更多限制的情况下,由语句“包括一……”限定的要素,并不排除在包括该要素的过程、装置、物品或者方法中还存在另外的相同要素。It should be noted that the serial numbers of the above embodiments of the present application are only for description, and do not represent the advantages and disadvantages of the embodiments. And the term "including" or any other variants thereof in this article is intended to cover non-exclusive inclusion, so that a process, device, article or method including a series of elements not only includes those elements, but also includes those that are not explicitly listed Other elements, or also include elements inherent to this process, device, article, or method. If there are no more restrictions, the element defined by the sentence "including one..." does not exclude the existence of other identical elements in the process, device, article, or method that includes the element.
通过以上的实施方式的描述,本领域的技术人员可以清楚地了解到上述实施例方法可借助软件加必需的通用硬件平台的方式来实现,当然也可以通过硬件,但很多情况下前者是更佳的实施方式。基于这样的理解,本申请的技术方案本质上或者说对现有技术做出贡献的部分可以以软件产品的形式体现出来,该计算机软件产品存储在如上所述的一个存储介质(如ROM/RAM、磁碟、光盘)中,包括若干指令用以使得一台终端设备(可以是手机,计算机,服务器,或者网络设备等)执行本申请各个实施例所述的方法。Through the description of the above embodiments, those skilled in the art can clearly understand that the method of the above embodiments can be implemented by means of software plus the necessary general hardware platform. Of course, it can also be implemented by hardware, but in many cases the former is better.的实施方式。 Based on this understanding, the technical solution of this application essentially or the part that contributes to the existing technology can be embodied in the form of a software product, and the computer software product is stored in a storage medium (such as ROM/RAM) as described above. , Magnetic disk, optical disk), including several instructions to make a terminal device (which can be a mobile phone, a computer, a server, or a network device, etc.) execute the method described in each embodiment of the present application.
以上仅为本申请的优选实施例,并非因此限制本申请的专利范围,凡是利用本申请说明书及附图内容所作的等效结构或等效流程变换,或直接或间接运用在其他相关的技术领域,均同理包括在本申请的专利保护范围内。The above are only preferred embodiments of this application, and do not limit the scope of this application. Any equivalent structure or equivalent process transformation made using the content of the description and drawings of this application, or directly or indirectly used in other related technical fields , The same reason is included in the scope of patent protection of this application.

Claims (20)

  1. 一种基于Kubernetes集群的管理方法,其特征在于,所述基于Kubernetes集群的管理方法包括如下步骤:A management method based on Kubernetes cluster, characterized in that, the management method based on Kubernetes cluster includes the following steps:
    确定Kubernetes集群所需的配置信息;其中,所述Kubernetes集群包括业务集群和控制集群,所述配置信息包括节点的配置项;Determining configuration information required by a Kubernetes cluster; wherein the Kubernetes cluster includes a business cluster and a control cluster, and the configuration information includes configuration items of nodes;
    根据所述配置信息开通相应的容器服务;Activate the corresponding container service according to the configuration information;
    根据所述配置信息创建相应的业务集群;Create a corresponding business cluster according to the configuration information;
    根据所述配置信息部署相应的应用容器;Deploy a corresponding application container according to the configuration information;
    其中,所述根据所述配置信息开通相应的容器服务的步骤包括:在指定的虚拟私有云VPC中创建控制集群;其中,所述控制集群用于部署和管理所述业务集群内的每个应用程序;Wherein, the step of opening the corresponding container service according to the configuration information includes: creating a control cluster in a designated virtual private cloud VPC; wherein, the control cluster is used to deploy and manage each application in the business cluster program;
    所述根据所述配置信息部署相应的应用容器的步骤包括:给所述业务集群内的每个应用程序配置好选择节点的配置项;The step of deploying the corresponding application container according to the configuration information includes: configuring each application in the business cluster with configuration items of the selected node;
    所述根据所述配置信息创建相应的业务集群的步骤包括:The step of creating a corresponding business cluster according to the configuration information includes:
    指定业务集群所包含的节点数和业务名称;Specify the number of nodes and business names included in the business cluster;
    调用云主机创建接口;Call the cloud host to create an interface;
    创建云主机;Create a cloud host;
    将所有云主机添加到业务集群中,作为业务容器运行的节点。Add all cloud hosts to the business cluster as nodes running on business containers.
  2. 如权利要求1所述的基于Kubernetes集群的管理方法,其特征在于,所述控制集群包括至少一组kubernetes控制面的组件,每组kubernetes控制面的组件包括:kube-apiserver、kube-controller-manager、kube-scheduler、Etcd。The Kubernetes cluster-based management method of claim 1, wherein the control cluster includes at least one group of kubernetes control plane components, and each group of kubernetes control plane components includes: kube-apiserver, kube-controller-manager , Kube-scheduler, Etcd.
  3. 如权利要求1或2所述的基于Kubernetes集群的管理方法,其特征在于,所述确定Kubernetes集群所需的配置信息的步骤包括:The Kubernetes cluster-based management method according to claim 1 or 2, wherein the step of determining the configuration information required by the Kubernetes cluster comprises:
    确定需要开通容器服务的虚拟私有云VPC;Determine the virtual private cloud VPC that needs to activate the container service;
    确定Kubernetes集群是否为高可用;及Determine whether the Kubernetes cluster is highly available; and
    确定Kubernetes版本。Determine the Kubernetes version.
  4. 如权利要求1或2所述的基于Kubernetes集群的管理方法,其特征在于,所述在指定的VPC中创建控制集群的步骤包括监控步骤,所述监控步骤包括:The Kubernetes cluster-based management method according to claim 1 or 2, wherein the step of creating a control cluster in a designated VPC includes a monitoring step, and the monitoring step includes:
    采集云主机性能指标;及Collect cloud host performance indicators; and
    根据采集到的云主机性能指标做界面图形展示。Display the interface graphics based on the collected cloud host performance indicators.
  5. 如权利要求4所述的基于Kubernetes集群的管理方法,其特征在于,所述监控步骤还包括:采集Kubernetes组件和容器的存在性、存活性指标。The Kubernetes cluster-based management method according to claim 4, wherein the monitoring step further comprises: collecting the existence and survivability indicators of Kubernetes components and containers.
  6. 如权利要求1或2所述的基于Kubernetes集群的管理方法,其特征在于,所述在指定的VPC中创建控制集群的步骤包括:日志步骤,所述日志步骤包括:当创建控制集群时生成日志。The Kubernetes cluster-based management method according to claim 1 or 2, wherein the step of creating a control cluster in a designated VPC includes: a log step, and the log step includes: generating a log when the control cluster is created .
  7. 如权利要求1或2所述的基于Kubernetes集群的管理方法,其特征在于,所述在指定的VPC中创建控制集群的步骤包括警报步骤,其中,所述警报步骤包括:当控制集群的组件出现异常时,或者业务集群中的组件或者pod出现异常时,发送警报消息给相关人员;The Kubernetes cluster-based management method according to claim 1 or 2, wherein the step of creating a control cluster in a designated VPC includes an alerting step, wherein the alerting step includes: when a component of the control cluster appears When there is an exception, or when a component or pod in the business cluster is abnormal, send an alert message to the relevant personnel
    所述警报步骤还包括:当控制集群节点上的所有组件和容器的存活性出现异常和/或The alerting step further includes: when the viability of all components and containers on the control cluster node is abnormal and/or
    业务集群上的应用容器出现异常时,发送警报消息给相关人员。。When the application container on the business cluster is abnormal, an alert message is sent to the relevant personnel. .
  8. 如权利要求1所述的基于Kubernetes集群的管理方法,其特征在于,在所述将所有云主机添加到业务集群中作为业务容器运行的节点的步骤之后,所述根据所述配置信息创建相应的业务集群的步骤还包括:给所有节点配置指定的业务标签。The Kubernetes cluster-based management method according to claim 1, wherein after the step of adding all cloud hosts to the business cluster as a node running as a business container, the corresponding configuration information is created according to the configuration information. The steps of business clustering also include: configuring designated business labels for all nodes.
  9. 一种基于Kubernetes集群的管理装置,其特征在于,该装置包括存储器和处理器,所述存储器存储有可在所述处理器上运行的基于Kubernetes集群的管理程序,所述基于Kubernetes集群的管理程序被所述处理器执行时实现如下步骤:A management device based on a Kubernetes cluster, characterized in that the device includes a memory and a processor, the memory stores a Kubernetes cluster-based management program that can run on the processor, and the Kubernetes cluster-based management program When executed by the processor, the following steps are implemented:
    确定Kubernetes集群所需的配置信息;其中,所述Kubernetes集群包括业务集群和控制集群,所述配置信息包括节点的配置项;Determining configuration information required by a Kubernetes cluster; wherein the Kubernetes cluster includes a business cluster and a control cluster, and the configuration information includes configuration items of nodes;
    根据所述配置信息开通相应的容器服务;Activate the corresponding container service according to the configuration information;
    根据所述配置信息创建相应的业务集群;Create a corresponding business cluster according to the configuration information;
    根据所述配置信息部署相应的应用容器;Deploy a corresponding application container according to the configuration information;
    其中,所述根据所述配置信息开通相应的容器服务的步骤包括:在指定的虚拟私有云VPC中创建控制集群;其中,所述控制集群用于部署和管理所述业务集群内的每个应用程序;Wherein, the step of opening the corresponding container service according to the configuration information includes: creating a control cluster in a designated virtual private cloud VPC; wherein, the control cluster is used to deploy and manage each application in the business cluster program;
    所述根据所述配置信息部署相应的应用容器的步骤包括:给所述业务集群内的每个应用程序配置好选择节点的配置项;The step of deploying the corresponding application container according to the configuration information includes: configuring each application in the business cluster with configuration items of the selected node;
    所述根据所述配置信息创建相应的业务集群的步骤包括:The step of creating a corresponding business cluster according to the configuration information includes:
    指定业务集群所包含的节点数和业务名称;Specify the number of nodes and business names included in the business cluster;
    调用云主机创建接口;Call the cloud host to create an interface;
    创建云主机;Create a cloud host;
    将所有云主机添加到业务集群中,作为业务容器运行的节点。Add all cloud hosts to the business cluster as nodes running on business containers.
  10. 如权利要求9所述的基于Kubernetes集群的管理装置,其特征在于,所述控制集群包括至少一组kubernetes控制面的组件,每组kubernetes控制面的组件包括:kube-apiserver、kube-controller-manager、kube-scheduler、Etcd。The Kubernetes cluster-based management device according to claim 9, wherein the control cluster includes at least one group of kubernetes control plane components, and each group of kubernetes control plane components includes: kube-apiserver, kube-controller-manager , Kube-scheduler, Etcd.
  11. 如权利要求9或10所述的基于Kubernetes集群的管理装置,其特征在于,所述确定Kubernetes集群所需的配置信息的步骤包括:The Kubernetes cluster-based management device according to claim 9 or 10, wherein the step of determining the configuration information required by the Kubernetes cluster comprises:
    确定需要开通容器服务的虚拟私有云VPC;Determine the virtual private cloud VPC that needs to activate the container service;
    确定Kubernetes集群是否为高可用;及Determine whether the Kubernetes cluster is highly available; and
    确定Kubernetes版本。Determine the Kubernetes version.
  12. 如权利要求9或10所述的基于Kubernetes集群的管理装置,其特征在于,所述在指定的VPC中创建控制集群的步骤包括监控步骤,所述监控步骤包括:The Kubernetes cluster-based management device according to claim 9 or 10, wherein the step of creating a control cluster in a designated VPC includes a monitoring step, and the monitoring step includes:
    采集云主机性能指标;及Collect cloud host performance indicators; and
    根据采集到的云主机性能指标做界面图形展示。Display the interface graphics based on the collected cloud host performance indicators.
  13. 如权利要求12所述的基于Kubernetes集群的管理装置,其特征在于,所述监控步骤还包括:采集Kubernetes组件和容器的存在性、存活性指标。The Kubernetes cluster-based management device according to claim 12, wherein the monitoring step further comprises: collecting the existence and survivability indicators of Kubernetes components and containers.
  14. 如权利要求9或10所述的基于Kubernetes集群的管理装置,其特征在于,所述在指定的VPC中创建控制集群的步骤包括:日志步骤,所述日志步骤包括:当创建控制集群时生成日志。The Kubernetes cluster-based management device according to claim 9 or 10, wherein the step of creating a control cluster in a designated VPC comprises: a logging step, and the logging step comprises: generating a log when the control cluster is created .
  15. 如权利要求9或10所述的基于Kubernetes集群的管理装置,其特征在于,所述在指定的VPC中创建控制集群的步骤包括警报步骤,其中,所述警报步骤包括:当控制集群的组件出现异常时,或者业务集群中的组件或者pod出现异常时,发送警报消息给相关人员;The Kubernetes cluster-based management device according to claim 9 or 10, wherein the step of creating a control cluster in a designated VPC includes an alerting step, wherein the alerting step includes: when a component of the control cluster appears When there is an exception, or when a component or pod in the business cluster is abnormal, send an alert message to the relevant personnel
    所述警报步骤还包括:当控制集群节点上的所有组件和容器的存活性出现异常和/或The alerting step also includes: when the viability of all components and containers on the control cluster node is abnormal and/or
    业务集群上的应用容器出现异常时,发送警报消息给相关人员。。When the application container on the business cluster is abnormal, an alert message is sent to the relevant personnel. .
  16. 如权利要求9所述的基于Kubernetes集群的管理装置,其特征在于,在所述将所有云主机添加到业务集群中作为业务容器运行的节点的步骤之后,所述根据所述配置信息创建相应的业务集群的步骤还包括:给所有节点配置指定的业务标签。The Kubernetes cluster-based management device according to claim 9, characterized in that, after the step of adding all cloud hosts to the business cluster as a node running as a business container, the corresponding configuration information is created according to the configuration information. The steps of business clustering also include: configuring designated business labels for all nodes.
  17. 一种计算机可读存储介质,其特征在于,所述计算机可读存储介质上存储有基于Kubernetes集群的管理程序,所述基于Kubernetes集群的管理程序可被一个或者多个处理器执行,以实现如下步骤:A computer-readable storage medium, characterized in that a Kubernetes cluster-based management program is stored on the computer-readable storage medium, and the Kubernetes cluster-based management program can be executed by one or more processors to achieve the following step:
    确定Kubernetes集群所需的配置信息;其中,所述Kubernetes集群包括业务集群和控制集群,所述配置信息包括节点的配置项;Determining configuration information required by a Kubernetes cluster; wherein the Kubernetes cluster includes a business cluster and a control cluster, and the configuration information includes configuration items of nodes;
    根据所述配置信息开通相应的容器服务;Activate the corresponding container service according to the configuration information;
    根据所述配置信息创建相应的业务集群;Create a corresponding business cluster according to the configuration information;
    根据所述配置信息部署相应的应用容器;Deploy a corresponding application container according to the configuration information;
    其中,所述根据所述配置信息开通相应的容器服务的步骤包括:在指定的虚拟私有云VPC中创建控制集群;其中,所述控制集群用于部署和管理所述业务集群内的每个应用程序;Wherein, the step of opening the corresponding container service according to the configuration information includes: creating a control cluster in a designated virtual private cloud VPC; wherein, the control cluster is used to deploy and manage each application in the business cluster program;
    所述根据所述配置信息部署相应的应用容器的步骤包括:给所述业务集群内的每个应用程序配置好选择节点的配置项;The step of deploying the corresponding application container according to the configuration information includes: configuring each application in the business cluster with configuration items of the selected node;
    所述根据所述配置信息创建相应的业务集群的步骤包括:The step of creating a corresponding business cluster according to the configuration information includes:
    指定业务集群所包含的节点数和业务名称;Specify the number of nodes and business names included in the business cluster;
    调用云主机创建接口;Call the cloud host to create an interface;
    创建云主机;Create a cloud host;
    将所有云主机添加到业务集群中,作为业务容器运行的节点。Add all cloud hosts to the business cluster and serve as nodes running on business containers.
  18. 如权利要求17所述的计算机可读存储介质,其特征在于,所述控制集群包括至少一组kubernetes控制面的组件,每组kubernetes控制面的组件包括:kube-apiserver、kube-controller-manager、kube-scheduler、Etcd。The computer-readable storage medium of claim 17, wherein the control cluster includes at least one group of kubernetes control plane components, and each group of kubernetes control plane components includes: kube-apiserver, kube-controller-manager, kube-scheduler, Etcd.
  19. 如权利要求17或18所述的基于Kubernetes集群的管理装置,其特征在于,所述确定Kubernetes集群所需的配置信息的步骤包括:The management device based on a Kubernetes cluster according to claim 17 or 18, wherein the step of determining the configuration information required by the Kubernetes cluster comprises:
    确定需要开通容器服务的虚拟私有云VPC;Determine the virtual private cloud VPC that needs to activate the container service;
    确定Kubernetes集群是否为高可用;及Determine whether the Kubernetes cluster is highly available; and
    确定Kubernetes版本。Determine the Kubernetes version.
  20. 如权利要求17或18所述的计算机可读存储介质,其特征在于,所述在指定的VPC中创建控制集群的步骤包括监控步骤,所述监控步骤包括:The computer-readable storage medium according to claim 17 or 18, wherein the step of creating a control cluster in a designated VPC includes a monitoring step, and the monitoring step includes:
    采集云主机性能指标;及Collect cloud host performance indicators; and
    根据采集到的云主机性能指标做界面图形展示。Display the interface graphics based on the collected cloud host performance indicators.
PCT/CN2019/118007 2019-07-30 2019-11-13 Management method and apparatus based on kubernetes cluster, and computer-readable storage medium WO2021017301A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201910704915.3 2019-07-30
CN201910704915.3A CN110531987A (en) 2019-07-30 2019-07-30 Management method, device and computer readable storage medium based on Kubernetes cluster

Publications (1)

Publication Number Publication Date
WO2021017301A1 true WO2021017301A1 (en) 2021-02-04

Family

ID=68660594

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2019/118007 WO2021017301A1 (en) 2019-07-30 2019-11-13 Management method and apparatus based on kubernetes cluster, and computer-readable storage medium

Country Status (2)

Country Link
CN (1) CN110531987A (en)
WO (1) WO2021017301A1 (en)

Families Citing this family (28)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10812337B2 (en) 2018-06-15 2020-10-20 Vmware, Inc. Hierarchical API for a SDDC
US10942788B2 (en) 2018-06-15 2021-03-09 Vmware, Inc. Policy constraint framework for an sddc
US11086700B2 (en) 2018-08-24 2021-08-10 Vmware, Inc. Template driven approach to deploy a multi-segmented application in an SDDC
CN111327681A (en) * 2020-01-21 2020-06-23 北京工业大学 Cloud computing data platform construction method based on Kubernetes
CN111367950B (en) * 2020-02-28 2023-08-08 上海欣巴自动化科技股份有限公司 Distributed AGV scheduling system and scheduling method based on Kubernetes
CN111427625B (en) * 2020-03-23 2023-03-24 中国—东盟信息港股份有限公司 Method for constructing Kubernetes container cloud external load balancer based on dynamic routing
CN115380514B (en) 2020-04-01 2024-03-01 威睿有限责任公司 Automatic deployment of network elements for heterogeneous computing elements
CN111787063B (en) * 2020-06-02 2023-05-16 深圳前海移联科技有限公司 Channel route management method for business service
CN113839974A (en) * 2020-06-23 2021-12-24 海尔数字科技(上海)有限公司 Container platform charging method and system
CN111782370B (en) * 2020-06-30 2022-12-06 平安科技(深圳)有限公司 Kubernetes multi-cluster management system, method, terminal and storage medium
CN113872997B (en) * 2020-06-30 2022-08-26 华为技术有限公司 Container group POD reconstruction method based on container cluster service and related equipment
CN111859428B (en) * 2020-07-22 2022-07-19 成都安恒信息技术有限公司 Containerization-based secret key storage method and system
US11803408B2 (en) 2020-07-29 2023-10-31 Vmware, Inc. Distributed network plugin agents for container networking
US11863352B2 (en) 2020-07-30 2024-01-02 Vmware, Inc. Hierarchical networking for nested container clusters
CN111897541B (en) * 2020-08-03 2021-08-17 汇链通供应链科技(上海)有限公司 Software interaction platform and method for automatically deploying resources in cloud environment
CN111984270A (en) * 2020-08-20 2020-11-24 第四范式(北京)技术有限公司 Application deployment method and system
CN112015753B (en) * 2020-08-31 2023-10-31 北京易捷思达科技发展有限公司 Monitoring system and method suitable for containerized deployment of open source cloud platform
CN112187925A (en) * 2020-09-28 2021-01-05 江苏银承网络科技股份有限公司 Offline cluster management method and device for big data platform
CN112565475B (en) * 2020-12-01 2023-07-11 成都精灵云科技有限公司 Ip address allocation method for adding new node in container cluster service layer
CN112671602B (en) * 2020-12-14 2023-07-04 北京金山云网络技术有限公司 Data processing method, device, system, equipment and storage medium of edge node
CN112328456B (en) * 2021-01-04 2021-12-03 北京电信易通信息技术股份有限公司 Cluster resource monitoring system based on service discovery
US11606254B2 (en) 2021-06-11 2023-03-14 Vmware, Inc. Automatic configuring of VLAN and overlay logical switches for container secondary interfaces
CN113419819B (en) * 2021-06-25 2023-09-08 重庆紫光华山智安科技有限公司 Container management method, device, equipment and medium
CN113568684A (en) * 2021-09-23 2021-10-29 中国电子科技集团公司第十五研究所 Application hosting method, device and equipment and big data system
CN113934711B (en) * 2021-12-16 2022-03-15 天津南大通用数据技术股份有限公司 Method for automatically deploying gbase8s cluster
US20230231741A1 (en) 2022-01-14 2023-07-20 Vmware, Inc. Per-namespace ip address management method for container networks
US11848910B1 (en) 2022-11-11 2023-12-19 Vmware, Inc. Assigning stateful pods fixed IP addresses depending on unique pod identity
US11831511B1 (en) 2023-01-17 2023-11-28 Vmware, Inc. Enforcing network policies in heterogeneous systems

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109491674A (en) * 2018-11-07 2019-03-19 李斌 A kind of method and system of the automatic deployment service in Kubernetes cluster
US20190095253A1 (en) * 2017-09-22 2019-03-28 Vmware, Inc. Cluster updating using temporary update-monitor pod
CN109885316A (en) * 2019-02-18 2019-06-14 国家计算机网络与信息安全管理中心 Hdfs-hbase dispositions method and device based on kubernetes
CN109981351A (en) * 2019-03-06 2019-07-05 浪潮通用软件有限公司 A kind of private clound dispositions method

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105376303B (en) * 2015-10-23 2018-11-06 深圳前海达闼云端智能科技有限公司 Docker implementation system and communication method thereof
CN108549580B (en) * 2018-03-30 2023-04-14 平安科技(深圳)有限公司 Method for automatically deploying Kubernets slave nodes and terminal equipment
CN108809722B (en) * 2018-06-13 2022-03-22 郑州云海信息技术有限公司 Method, device and storage medium for deploying Kubernetes cluster
CN109150987B (en) * 2018-07-27 2021-11-30 北京友普信息技术有限公司 Two-layer container cluster elastic expansion method based on host layer and container layer
CN109800055A (en) * 2018-12-27 2019-05-24 北京航天智造科技发展有限公司 Container dispatches method of combination and system

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20190095253A1 (en) * 2017-09-22 2019-03-28 Vmware, Inc. Cluster updating using temporary update-monitor pod
CN109491674A (en) * 2018-11-07 2019-03-19 李斌 A kind of method and system of the automatic deployment service in Kubernetes cluster
CN109885316A (en) * 2019-02-18 2019-06-14 国家计算机网络与信息安全管理中心 Hdfs-hbase dispositions method and device based on kubernetes
CN109981351A (en) * 2019-03-06 2019-07-05 浪潮通用软件有限公司 A kind of private clound dispositions method

Also Published As

Publication number Publication date
CN110531987A (en) 2019-12-03

Similar Documents

Publication Publication Date Title
WO2021017301A1 (en) Management method and apparatus based on kubernetes cluster, and computer-readable storage medium
WO2021017279A1 (en) Cluster security management method and apparatus based on kubernetes and network domain, and storage medium
US11683221B1 (en) Automatic generation of template for provisioning services in a hosted computing environment
US20210314273A1 (en) Enabling multi-tenant virtual servers in a cloud system
CN107181808B (en) Private cloud system and operation method
CN104360878B (en) A kind of method and device of application software deployment
WO2019057055A1 (en) Task processing method and apparatus, electronic device, and storage medium
CN110908658A (en) Micro-service and micro-application system, data processing method and device
CN104160376A (en) Offline provisioning of virtual machines
CN110324169A (en) A kind of method and apparatus of interface management
CN106293847B (en) A kind of method of virtual platform supporting
US10908970B1 (en) Data interface for secure analytic data system integration
TW201243617A (en) Cloud computing-based service management system
US11336504B2 (en) Intent-based distributed alarm service
CN108009010B (en) Management device, system, method, electronic device and storage medium for thin client
CN113486095A (en) Civil aviation air traffic control cross-network safety data exchange management platform
CN110417741A (en) A kind of method and apparatus of filtering safe group
WO2024082990A1 (en) Network system, service mesh configuration method, storage medium, and electronic device
US11336502B2 (en) Deriving network device and host connection
EP4024761A1 (en) Communication method and apparatus for multiple management domains
US11561995B2 (en) Multitenant database instance view aggregation
CN114756301A (en) Log processing method, device and system
CN112068953A (en) Cloud resource fine management traceability system and method
CN107347024A (en) A kind of method and apparatus for storing Operation Log
US9501528B2 (en) Efficient response of common information model (CIM) server

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19939489

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19939489

Country of ref document: EP

Kind code of ref document: A1