CN113849243A

CN113849243A - Network plane acceleration method and system

Info

Publication number: CN113849243A
Application number: CN202110710993.1A
Authority: CN
Inventors: 薛少宁
Original assignee: Inspur Software Technology Co Ltd
Current assignee: Inspur Software Technology Co Ltd
Priority date: 2021-06-25
Filing date: 2021-06-25
Publication date: 2021-12-28

Abstract

The invention provides a network plane acceleration method and a system, comprising the following steps: determining that the Kube-OVN network plug-in is a network plug-in of kubernetes pod; installing a Multus plug-in a kubernets cluster; deploying a user mode network plug-in Userspace CNI, and mounting a vhost-user socket into a kubernets container; creating a preset network resource object based on OVS-DPDK; and calling the kubernets cluster to deploy the pod. The invention realizes the OVS-DPDK acceleration network plane of pod and realizes the network forwarding with high performance through the network technology based on kubernets and DPDK.

Description

Network plane acceleration method and system

Technical Field

The present invention relates to the field of network technologies, and in particular, to a network plane acceleration method and system.

Background

Kubernetes, abbreviated K8 s. The Kubernets aims to make the application of container deployment simple and efficient, and provides a mechanism for application deployment, planning, updating and maintenance.

In kubernets, networks are a very important area. Kubernets itself does not provide a network solution, but provides the CNI specification. These specifications are followed by many CNI plug-ins (e.g., Flannel, Calico, etc.). Any of these plug-ins can be used and deployed on a cluster to provide a network solution. However, with the increasing application scenarios, the requirements of users on the container network are higher and higher. These scenarios include, but are not limited to, container-based VNFs, such as vRouter, vFirewall, etc., various services on network nodes within a data center, such as LB, VPN, etc., telecommunication network elements requiring a high performance network, such as upf, etc. Under these scenarios, certain requirements are placed on the performance of the container network, such as high bandwidth, low latency, and as little network jitter as possible.

At present, a container network is constructed on the whole kernel network protocol stack, and is isolated by using namespace, which is limited by the kernel network protocol stack, and the performance optimization space of a data layer is very small.

Disclosure of Invention

The invention provides a network plane acceleration method and a network plane acceleration system, which are used for overcoming the defects in the prior art.

In a first aspect, the present invention provides a network plane acceleration method, including:

determining that the Kube-OVN network plug-in is a network plug-in of kubernetes pod;

installing a Multus plug-in a kubernets cluster;

deploying a user mode network plug-in Userspace CNI, and mounting a vhost-user socket into a kubernets container;

creating a preset network resource object based on OVS-DPDK;

and calling the kubernets cluster to deploy the pod.

In one embodiment, the determining that the Kube-OVN network plug-in is a kubernets pod network plug-in includes:

and determining the version of OVS-DPDK adopted by the Kube-OVN network plug-in, and adding and configuring OVS-DPDK parameters.

In one embodiment, the OVS-DPDK is used to provide the vhost-user socket.

In one embodiment, the installing a Multus plugin in a kubernets cluster includes:

the Multus plug-in provides a plurality of network interfaces for the kubernetes pod, combines a plurality of CNI plug-in units, and configures different types of networks for the kubernetes pod;

and designating Kube-OVN as a main network of the Multus plugin by modifying the preset configuration file of the Multus plugin.

In an embodiment, the creating a preset network resource object based on OVS-DPDK includes:

and creating a network resource object OVS-DPDK-br0 of the network AttachmentDefinition of the OVS-DPDK, and determining that the network type is userspace.

In one embodiment, the invoking the kubernets cluster deployment pod includes:

determining the network type of the pod to be ovs-dpdk-br0 in the pod deployment script annotation;

and after the pod is successfully created, checking a pod network interface, testing pod connectivity, running a TestPMD program, and testing the functional integrity of the OVS-DPDK.

In one embodiment, the OVS-DPDK is deployed on a virtual machine platform or a physical machine platform.

In a second aspect, the present invention further provides a network plane acceleration system, including:

the determining module is used for determining that the Kube-OVN network plug-in is a network plug-in of kubernetes pod;

the installation module is used for installing a Multus plug-in the kubernets cluster;

the deployment module is used for deploying a user mode network plug-in Userspace CNI and mounting a vhost-user socket into the inside of the kubernets container;

the device comprises a creating module, a processing module and a processing module, wherein the creating module is used for creating a preset network resource object based on OVS-DPDK;

and the calling module is used for calling the kubernets cluster deployment pod.

In a third aspect, the present invention further provides an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, where the processor executes the computer program to implement the steps of the network plane acceleration method according to any one of the above aspects.

In a fourth aspect, the present invention also provides a non-transitory computer readable storage medium having stored thereon a computer program which, when executed by a processor, performs the steps of the network plane acceleration method as described in any of the above.

According to the network plane acceleration method and system provided by the invention, the OVS-DPDK acceleration network plane of pod is realized through the network technology based on kubernets and DPDK, and high-performance network forwarding is realized.

Drawings

In order to more clearly illustrate the technical solutions of the present invention or the prior art, the drawings needed for the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and those skilled in the art can also obtain other drawings according to the drawings without creative efforts.

Fig. 1 is a schematic flow chart of a network plane acceleration method provided by the present invention;

FIG. 2 is a schematic diagram of a network plane acceleration architecture provided by the present invention;

FIG. 3 is a schematic diagram of a network plane acceleration system provided by the present invention;

fig. 4 is a schematic structural diagram of an electronic device provided in the present invention.

Detailed Description

In order to make the objects, technical solutions and advantages of the present invention clearer, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings, and it is obvious that the described embodiments are some, but not all embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

Aiming at the problems in the prior art, the invention realizes the function that a kubernets platform supports a OVS-DPDK acceleration container network based on a kubernets technology and a network plug-in cni, realizes the support of a container with higher dependence on network performance, realizes the high reliability of the network through an OVS-DPDK network, and solves the problem of high-performance forwarding of a network plane.

Fig. 1 is a schematic flow chart of a network plane acceleration method provided by the present invention, as shown in fig. 1, including:

s1, determining that the Kube-OVN network plug-in is a network plug-in of kubernetes pod;

s2, installing a Multus plug-in the kubernets cluster;

s3, deploying a user mode network plug-in Userspace CNI, and mounting a vhost-user socket into a kubernets container;

s4, creating a preset network resource object based on OVS-DPDK;

and S5, calling the kubernets cluster to deploy the pod.

Specifically, the invention provides a solution for realizing a high-performance OVS-DPDK accelerated network plane, and solves the problem that a telecommunication network element deploys a high-performance network plane on a kubernets platform. The method comprises the following steps:

the method is characterized in that a kube-ovn network plug-in is used as a network plug-in of a pod, a version of ovs-dpdk is adopted in the kube-ovn, and relevant parameters for configuring the dpdk, such as large-page memory, bound cores and the like, need to be added when the kube-ovn is installed. Kube-ovn at ovs-dpdk for providing a vhost-user socket;

install multus plug-ins in the kubernets cluster. multus may provide multiple network interfaces for a pod operating in kubernets, which may combine multiple CNI cards together to configure different types of networks for the pod. Modifying the multus configuration file deltadates to designate kube-ovn as the master network of multus;

deploying a user mode network plug-in Userspace CNI for mounting a vhost-user socket into a kubernets container through configuration;

creating a network resource object ovs-dpdk-br0 of the network AttachmentDefinition of ovs-dpdk, wherein the network type is userspace;

and deploying the pod, configuring pod annotation, and adding ovs-dpdk-br0 network configuration to the pod.

Here, Kube-OVN is an open source enterprise-level cloud native kubernets container network deployment system, which greatly enhances the security, maintainability, manageability and performance of a kubernets container network by translating mature network functions in the OpenStack field to kubernets, and brings a unique value for the ecological landing of kubernets.

Kube-OVN can provide capability support of complex application scenes such as cross-cloud network management, interconnection and intercommunication of traditional network architecture and infrastructure, edge cluster landing and the like, relieve elbow detents of performance and safety monitoring faced by Kubernets network, provide the most mature network base for a system based on the original design of Kubernets architecture, and improve stability and usability of users to Kubernets ecological Runtime.

The invention realizes the OVS-DPDK acceleration network plane of pod and realizes the network forwarding with high performance through the network technology based on kubernets and DPDK.

Based on any of the above embodiments, the determining that the Kube-OVN network plugin is a network plugin of kubernets pod includes:

the determining that the Kube-OVN network plugin is a network plugin of kubernets pod includes:

Wherein the OVS-DPDK is configured to provide the vhost-user socket.

Wherein the installing of the Multus plugin in the kubernets cluster comprises:

Wherein, the creating of the preset network resource object based on the OVS-DPDK comprises:

Wherein the invoking the kubernets cluster deployment pod comprises:

The OVS-DPDK is deployed on a virtual machine platform or a physical machine platform.

Specifically, a network card which is officially supported by using the dpdk, such as 82599, XL710 and the like of Intel, needs to be installed on the physical machine, and an Intel VT-x function which supports virtualization is started at the bios.

And starting configurations such as iommu, large-page memory and the like in the operating system of the physical machine, and configuring a sufficient amount of 1G large-page memory.

The physical machine deploys OpenStack, and the OpenStack creates a shader configuration with 1G large pages, core binding, core isolation and NUMA crossing; OpenStack uses a network card officially supported by dpdk to create a network; a virtual machine is created using the network and the navigator.

And opening a 1G large-page memory in the virtual machine, adding the configuration of the large-page memory in the grub file, updating the grub, restarting the virtual machine, and confirming that the large-page memory is effective.

The kubernets system is deployed and installed and comprises 1 controller node and three worker nodes.

Deploying a kube-ovn network plug-in with ovs-dpdk; in the installation and deployment stage, a version with the dpdk of 19.11 is selected for deployment. And creating a default subnet, a node subnet and a custom subnet.

And (4) deploying multus multi-network plug-ins in the kubernets cluster. Since the ovs-dpdk provides a vhost-user socket that does not fit as a default network for kubernets pod. We retain the OVS interface provided by kube-ovn, using multus to add socket interface requests for dpdk. During installation, the deltadates of the multus profile are modified to ensure that kube-ovn is the default network plug-in for all pods.

Deploying userpace-cni, compiling userpace-cni-network-plugin, and placing the generated userpace in network plug-in directory/opt/cni/bin. Since userpace-cni needs to call the ovs-vsctl command of ovs-dpsk to configure the network, and dpsk is deployed in the container, there is no such command at host, by custom configuring ovs-vsctl command on host, when the host executes the command, ovs-vsctl command is called in the container by docker exec command. A network resource object ovs-dpdk-br0 of the network AttachmentDefinition of ovs-dpdk interface is created, so that a network interface ovs-dpdk can be requested in the spec of the pod, and the specific architecture can refer to the schematic diagram of FIG. 2.

Calling the kubernets cluster to create the pod, and specifying the network type of the pod in the pod deployment script annotation as ovs-dpdk-br 0.

And after the Pod is successfully created, entering the Pod, checking a Pod network interface, testing connectivity of the Pod, running a TestPMD program, and testing ovs-dpdk functional integrity.

It should be noted that the present invention is not limited to the ovs-dpdk network plane implemented in the virtual machine platform deployment container, but also includes the ovs-dpdk network plane implemented in the physical machine platform deployment container.

The network plane acceleration system provided by the present invention is described below, and the network plane acceleration system described below and the network plane acceleration method described above may be referred to correspondingly.

Fig. 3 is a schematic structural diagram of a network plane acceleration system provided by the present invention, as shown in fig. 3, including: a determination module 31, an installation module 32, a deployment module 33, a creation module 34, and a calling module 35, wherein:

the determining module 31 is used for determining that the Kube-OVN network plug-in is a network plug-in of kubernetes pod; the installation module 32 is configured to install a Multus plugin in the kubernets cluster; the deployment module 33 is configured to deploy a user mode network plug-in userpace CNI, and mount a vhost-user socket inside a kubernets container; the creating module 34 is configured to create a preset network resource object based on OVS-DPDK; the calling module 35 is configured to call the kubernets cluster deployment pod.

Fig. 4 illustrates a physical structure diagram of an electronic device, which may include, as shown in fig. 4: a processor (processor)410, a communication Interface 420, a memory (memory)430 and a communication bus 440, wherein the processor 410, the communication Interface 420 and the memory 430 are communicated with each other via the communication bus 440. The processor 410 may invoke logic instructions in the memory 430 to perform a network plane acceleration method comprising: determining that the Kube-OVN network plug-in is a network plug-in of kubernetes pod; installing a Multus plug-in a kubernets cluster; deploying a user mode network plug-in Userspace CNI, and mounting a vhost-user socket into a kubernets container; creating a preset network resource object based on OVS-DPDK; and calling the kubernets cluster to deploy the pod.

In addition, the logic instructions in the memory 430 may be implemented in the form of software functional units and stored in a computer readable storage medium when the software functional units are sold or used as independent products. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.

In another aspect, the present invention also provides a computer program product comprising a computer program stored on a non-transitory computer-readable storage medium, the computer program comprising program instructions which, when executed by a computer, enable the computer to perform the network plane acceleration method provided by the above methods, the method comprising: determining that the Kube-OVN network plug-in is a network plug-in of kubernetes pod; installing a Multus plug-in a kubernets cluster; deploying a user mode network plug-in Userspace CNI, and mounting a vhost-user socket into a kubernets container; creating a preset network resource object based on OVS-DPDK; and calling the kubernets cluster to deploy the pod.

In yet another aspect, the present invention also provides a non-transitory computer readable storage medium having stored thereon a computer program, which when executed by a processor is implemented to perform the network plane acceleration method provided above, the method comprising: determining that the Kube-OVN network plug-in is a network plug-in of kubernetes pod; installing a Multus plug-in a kubernets cluster; deploying a user mode network plug-in Userspace CNI, and mounting a vhost-user socket into a kubernets container; creating a preset network resource object based on OVS-DPDK; and calling the kubernets cluster to deploy the pod.

The above-described embodiments of the apparatus are merely illustrative, and the units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment. One of ordinary skill in the art can understand and implement it without inventive effort.

Through the above description of the embodiments, those skilled in the art will clearly understand that each embodiment can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware. With this understanding in mind, the above-described technical solutions may be embodied in the form of a software product, which can be stored in a computer-readable storage medium such as ROM/RAM, magnetic disk, optical disk, etc., and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the methods described in the embodiments or some parts of the embodiments.

Finally, it should be noted that: the above examples are only intended to illustrate the technical solution of the present invention, but not to limit it; although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions of the embodiments of the present invention.

Claims

1. A network plane acceleration method, comprising:

installing a Multus plug-in a kubernets cluster;

creating a preset network resource object based on OVS-DPDK;

and calling the kubernets cluster to deploy the pod.

2. The method of claim 1, wherein the determining that the Kube-OVN network plug-in is a kubernetes pod network plug-in comprises:

3. The network plane acceleration method of claim 2, wherein the OVS-DPDK is configured to provide the vhost-user socket.

4. The network plane acceleration method of claim 1, wherein installing a Multus plugin in a kubernets cluster comprises:

5. The network plane acceleration method of claim 1, wherein the creating of the preset network resource object based on OVS-DPDK comprises:

6. The network plane acceleration method of claim 1, wherein the invoking the kubernets cluster deployment pod comprises:

7. The network plane acceleration method of any one of claims 1 to 6, wherein the OVS-DPDK is deployed on a virtual machine platform or a physical machine platform.

8. A network plane acceleration system, comprising:

9. An electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the processor when executing the program implements the steps of the network plane acceleration method according to any of claims 1 to 7.

10. A non-transitory computer readable storage medium, having stored thereon a computer program, when being executed by a processor, for implementing the steps of the network plane acceleration method according to any of the claims 1 to 7.