WO2020108537A1

WO2020108537A1 - Software-defined virtual network-based resource allocation system

Info

Publication number: WO2020108537A1
Application number: PCT/CN2019/121299
Authority: WO
Inventors: 王洋; 叶志勇; 须成忠
Original assignee: 深圳先进技术研究院
Priority date: 2018-11-30
Filing date: 2019-11-27
Publication date: 2020-06-04
Also published as: CN109614229B; CN109614229A

Abstract

The present application relates to a software-defined virtual network-based resource allocation system. The software-defined virtual network-based resource allocation system comprises a physical host. The physical host comprises a virtual machine and a central network controller. The central network controller is used for configuring a programmable control panel for a network I/O operation of the virtual machine. A network card resource allocation state of the virtual machine is identified via the programmable control panel and the programmable control panel is installed in the virtual machine. The central network controller controls the network I/O operation of the virtual machine via a software-defined means on the basis of the identifier of the virtual machine. The present application combines the respective advantages of semi-virtualization and single thread I/O virtualization, allows the use of any scheduling policy to sense a load state of the virtual machine on the basis of data of the virtual machine and the dynamic scheduling of network card resources of the virtual machine, thus not only increasing the network performance of the virtual machine, but also ensuring the scalability and manageability of the virtual machine.

Description

A software-defined virtual network resource allocation system

Technical field

This application belongs to the field of computer virtualization technology, and particularly relates to a software-defined virtual network resource allocation system.

Background technique

In the data center, network resources are a scarce and highly competitive resource. Due to the correlation between computing nodes in the data center, data transmission and communication collaboration between nodes is required between multiple computing nodes in the cluster to jointly complete computing tasks, especially for application services based on big data. In order to complete a request, it is necessary to Frequent communication and data exchanges between application servers have made multiple servers highly competitive in the originally scarce network resources. In addition, due to the separation of computing nodes and storage nodes in the data center, data storage and reading essentially become network access operations, which increase the burden on network I/O. Therefore, the rational scheduling of network resources in the data center and the improvement of network performance are an urgent problem to be solved.

To improve the performance of the data center network, network I/O virtualization is the key technology to solve this problem. Currently, several mainstream network I/O virtualization methods include:

1) The paravirtualization method has good network management and scalability, but because of its long I/O request path, its performance is poor;

2). Whether the hardware-assisted virtualization method is Pass-through technology or single-root I/O virtualization technology, the intervention of the virtual machine monitor is bypassed, which can achieve the I/O performance close to the physical machine, but it makes the virtual The machine occupies the I/O device alone reduces the hardware reuse and software scalability.

3). A method based on the hybrid I/O model is proposed to optimize the network performance of the data center, mainly to find a way to combine the paravirtualized flexible network management functions and the high performance of single-root I/O virtualization. However, due to the complexity of the data center network environment and the lack of overall perception of network data, it is difficult for users or network administrators to reasonably schedule and optimize virtual network resources.

In summary, in the prior art, there are some limitations in the deployment of data center network I/O virtualization in the following two aspects: First, the network I/O operation of the virtual machine monitor lacks its own in the network data Global role awareness, lost the opportunity to improve the network performance of some network-intensive virtual machines, while making other non-network-intensive virtual machines unnecessary to occupy single-root I/O virtualized network card resources with better performance; second, data The center's network I/O operations are not flexible enough to cope with the network environment. That is to say, many data centers currently use static fixed allocation methods when allocating network card resources to virtual machines. They lack flexible dynamic control and cannot be based on changes in the network environment. However, different network card resources are allocated to virtual machines of different network types, thereby affecting the overall network performance of the system.

Summary of the invention

The present application provides a software-defined virtual network resource allocation system, which aims to solve at least a certain degree of one of the above technical problems in the prior art.

In order to solve the above problems, this application provides the following technical solutions:

A software-defined virtual network resource allocation system, including a physical host, the physical host includes a virtual machine and a central network controller; the central network controller is used to set programmable for network I/O operations of the virtual machine A control panel, marking the allocation of network card resources of the virtual machine through the programmable control panel, and installing the programmable control panel on the virtual machine, and the central network controller based on the marking of the virtual machine, through Control the network I/O operations of the virtual machine in a software-defined manner.

The technical solution adopted in the embodiment of the present application further includes: the programmable control panel uses the central network controller to formulate a rule table and a trigger table to perform network I/O control of the virtual machine:

Rule table: used to record the allocation rules and policies of the virtual machine network card resources based on the label mechanism, and use the labels to mark the allocation of the virtual machine network card resources;

Trigger table: Used to record performance triggers based on the action trigger mechanism.

The technical solution adopted in the embodiment of the present application further includes: the virtual machine further includes a network control module, and the network control module is configured to schedule and allocate network card resources of the virtual machine according to a rule table and a trigger table in the programmable control panel.

The technical solution adopted in the embodiments of the present application further includes: the network card resources of the virtual machine include a single root I/O virtualized VF network card and a paravirtualized network card, and the virtual machine uses Bonding driving technology to virtualize a single root I/O The VF network card and the paravirtualized network card are bound as a logical network card, and the single root I/O virtualized VF network card is set as the master device, and the paravirtualized network card is set as the slave device. The network control module passes the single root I /O virtualized VF network card is hot-swappable to switch the single root I/O virtualized VF network card and paravirtualized network card.

The technical solution adopted in the embodiment of the present application further includes: the network control module hot-plugging the single I/O virtualized VF network card and the para-virtualized network card through single I/O virtualized VF network card specifically: : When removing the VF of the virtual machine, the network control module notifies the virtual hot plug controller of the physical host to trigger a virtual hot removal event of the single root I/O virtualization device of the selected virtual machine; the virtual machine shuts down the The driver of the virtual machine single root I/O virtualization device and stop using the virtual machine single root I/O virtualization device in response to the virtual hot removal event; the activation of the NIC of the Bonding drive technology is automatically performed by the single root I/O virtualization VF NIC Switch to a paravirtualized network card; when a VF is allocated to the virtual machine, the network control module notifies the virtual hot plug controller of the physical host to trigger a virtual hot addition event of a single root I/O virtualization device of the virtual machine; The virtual machine loads a single root I/O virtualized VF network card driver and selects a new VF to start working.

The technical solution adopted in the embodiment of the present application further includes: the label of the virtual machine includes VF and vNet, where VF indicates whether the virtual machine uses a single root I/O to virtualize the VF network card, and if VF is true, it indicates that the The virtual machine uses a single root I/O virtualized VF network card. If VF is false, it indicates that the virtual machine does not use a single root I/O virtualized VF network card; vNet indicates whether the virtual machine uses a paravirtualized network card. If vNet True, indicates that the virtual machine uses a paravirtualized network card, if vNet is false, it indicates that the virtual machine does not use a paravirtualized network card; if both VF and vNet are true, it indicates that the virtual machine uses only a single root I /O virtualized VF network card.

The technical solution adopted in the embodiment of the present application further includes: the physical host further includes a data collection module, and the data collection module is used to obtain network information and operation status data of the virtual machine, and transmit the network information and operation status data To the central network controller, wherein the running state data includes the running time of the virtual machine, the blocking time of the virtual machine, and the waiting time of the virtual machine.

The technical solution adopted in the embodiment of the present application further includes: the manner in which the data collection module obtains network information is: the virtual machine reads the interface file provided by the Linux system to obtain the network information of the virtual machine, and at the end of each sampling period The obtained network information is sent to the data collection module; the data collection module subtracts the total traffic sent and received this time minus the total traffic sent and received last time to obtain the sum of the traffic sent and received in the current sampling period, and then samples the current The sum of the period of sending and receiving traffic divided by the bandwidth of the network card to obtain the bandwidth utilization of the virtual machine of this sampling period.

The technical solution adopted in the embodiments of the present application further includes: the central network controller further includes a topology information record table, and the topology information record table is used to record virtual machine status and topology structure information of data exchange between the virtual machines.

The technical solution adopted in the embodiment of the present application further includes: the central network controller further includes a data statistics table, and the data statistics table is used to record virtual machine network information and operating state data obtained by the data collection module.

Compared with the prior art, the beneficial effects produced by the embodiments of the present application are as follows: The software-defined virtual network resource allocation system of the embodiments of the present application integrates the hardware network card resources of the virtual machine through the bonding driving technology, and the software These resources are defined, combining the advantages of paravirtualization and single-root I/O virtualization. You can use any scheduling strategy to perceive the load status of the virtual machine based on the data of the virtual machine, and dynamically schedule the network card resources of the virtual machine. Improve the network performance of the virtual machine, and ensure the scalability and management of the virtual machine. In addition, this application combines hot-swap technology and Bonding drive technology to activate the backup mode, and dynamically switch between single-root I/O virtualized NICs and para-virtualized NICs to solve the problem of online migration of virtual machines with single-root I/O virtualized devices. .

BRIEF DESCRIPTION

FIG. 1 is a schematic structural diagram of a software-defined virtual network resource allocation system according to an embodiment of the present application.

detailed description

In order to make the purpose, technical solutions and advantages of the present application more clear, the present application will be described in further detail in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application, and are not used to limit the present application.

In response to the problems in the prior art, the software-defined virtual network resource allocation system of the embodiment of the present application solves the problem by using the control panel and the data panel that operate the node network I/O (input/output) of the data center cluster Coupling, unified management of the network card resources of the data nodes, allowing the control panel and the central network controller to be exchanged in a programmable manner to achieve the purpose of simultaneously controlling network I/O operations and virtual network resource allocation.

Specifically, please refer to FIG. 1, which is a schematic structural diagram of a software-defined virtual network resource allocation system according to an embodiment of the present application. The software-defined virtual network resource allocation system according to an embodiment of the present application includes a physical host, and the physical host includes multiple virtual machines, a data collection module, and a central network controller.

Specifically, the virtual machine includes a programmable control panel and a network control module;

Programmable control panel: On the basis of the labeling mechanism, a programmable control panel is set for the network I/O operation of each virtual machine through the central network controller of the physical host, and the network of each virtual machine is programmable through the programmable control panel The resource allocation is marked, and the central network controller controls the corresponding network I/O operations according to the marking of each virtual machine. In the embodiment of the present application, the programmable control panel uses the central network controller to formulate two forms for network I/O control:

1) Rule table, used to record the allocation rules and policies of virtual machine network card resources, that is, specify the allocation of network card resources for each virtual machine;

2) Trigger table, used to record performance triggers, that is, to record various trigger events for network resources. The programmable control panel of each virtual machine is used by the central network controller to control the operation of the virtual machine network I/O in a software-defined manner.

Network control module: used to schedule and allocate the network card resources of each virtual machine according to the table formulated in the programmable control panel. Among them, the network card resources of the virtual machine include a single root I/O virtualized VF network card and a paravirtualized network card. This application uses the activation backup mode of the Bonding drive technology to bind the two network cards into a logical network card, and The root I/O virtualized VF network card is set as the master device, and the paravirtualized network card is set as the slave device. The network control module uses the single root I/O virtualized VF network card hot swap to switch the specific network card resources used by the virtual machine. , Realize the dynamic switch between single root I/O virtualized VF network card and paravirtualized network card. When the network control module allocates network card resources, if the programmable control panel specifies that the virtual machine works with a single I/O virtualized VF network card, then the paravirtualized network card is switched to a single I/O virtualized VF network card. The programmable control panel stipulates that the virtual machine works with a paravirtualized network card, and then deprives its VF to work with a paravirtualized network card.

Specifically, the hot plugging process of the virtual machine single root I/O virtualized VF network card is as follows: (1) When the VF of the virtual machine needs to be removed, the network control module notifies the virtual hot plug controller of the physical host to trigger selection Virtual hot removal event of a virtual machine single root I/O virtualization device; (2) The virtual machine turns off the driver of the virtual machine single root I/O virtualization device and stops using the virtual machine single root I/O virtualization device to Respond to the virtual hot removal event; (3) The activated network card of Bonding drive technology is automatically switched from a single I/O virtualized VF network card to a paravirtualized network card; (4) When a VF needs to be assigned to a virtual machine, the network control module notifies The virtual hot-swap controller of the physical host triggers the virtual hot-add event of the virtual machine single-root I/O virtualization device; (5) The virtual machine loads the single-root I/O virtualized VF network card driver and selects a new VF to start working.

Data collection module: used to obtain the network information of all virtual machines, obtain the running status data of all virtual machines through Xenmon, and transmit the network information and running status data to the central network controller. The method for the data collection module to obtain network information is specifically: the virtual machine on the physical host reads the interface file /proc/net/dev provided by the Linux system to obtain the network information of the virtual machine, and the network information will be obtained at the end of each sampling period Send to the data collection module through Xenstore. The running status data obtained by the data collection module includes getten_time (the running time of the virtual machine), blocked_time (the blocking time of the virtual machine), waiting_time (the waiting time of the virtual machine), and so on. In the embodiment of the present application, the data collection module subtracts the total traffic sent and received this time minus the total traffic sent and received last time is the sum of the traffic sent and received in this sampling period, and divides the sum of traffic sent and received in this sampling period by the sum The NIC bandwidth is the bandwidth utilization of the virtual machine for the current sampling period.

Central network controller: The central network controller is connected downward to the programmable control panel of the virtual machine and upward to the virtual network scheduler. It is used to control the network I/O operations of each virtual machine according to the network card resource allocation of each virtual machine. ; Among them, the virtual network scheduler is a network card resource provided to users or administrators to schedule virtual machines.

Specifically, the central network controller includes:

Topology information record form: used to record the status of all virtual machines in the physical host and the topology information of the data exchange between each virtual machine;

Rule table: used to record the allocation rules and policies of virtual machine network card resources defined by administrators or users to optimize system network performance based on the label mechanism, and use tags to mark the allocation of network card resources of each virtual machine accordingly; rule table It will be installed in the programmable control panel of each virtual machine, and the network control module in the virtual machine will provide the corresponding network I/O operation according to the virtual machine's label; from the overall performance of the data center node, different virtual machine load pairs The demand for network resources is different. For virtual machines with large network resource requirements, a single-root I/O virtualized network card with better performance is allocated to it, thereby improving the overall network performance of the system by enhancing network-intensive virtual machines. On the contrary, for non-network-intensive virtual machines, only paravirtualized NICs with lower performance need to be allocated to them. Therefore, based on the labeling mechanism, by marking the allocation of network card resources of different virtual machines, the virtual machine In the network I/O operation, the corresponding operation is performed according to the label of each virtual machine.

In the embodiment of the present application, the label of a virtual machine includes two types of VF and vNet, where VF specifies whether the virtual machine uses a single root I/O to virtualize a VF network card. If VF is true, it indicates that the virtual machine uses a single root I/O O virtualized VF network card, if VF is false, it means that the virtual machine does not use a single I/O virtualized VF network card; vNet indicates whether the virtual machine uses a paravirtualized network card, if vNet is true, it indicates that the virtual machine uses a paravirtualized network card If vNet is false, it indicates that the virtual machine does not use a paravirtualized network card; if VF and vNet are both true, it indicates that the virtual machine only uses a single root I/O virtualized VF network card to work.

Trigger form: used to record performance triggers based on the action trigger mechanism, that is, record various trigger events for network resources, provide active rules for network card resources, and communicate the trigger form to the programmable control panel of each virtual machine. The network control module will perform specific network I/O operations according to the active rules in the trigger table; among them, the trigger table can be regarded as an expansion of the rule table. To help users or administrators define resource management strategies and control the programmable control panel, this application uses programmable action to perform programmable control. Performance triggers control the specific network I/O operations of each virtual machine based on changes in performance indicators. For example, when the bandwidth utilization rate of a virtual machine is greater than 50%, the network card used by the virtual machine is switched to a single root I/O virtualized VF network card, so as to optimize or manage system network resources.

Data statistics table: used to record network information and running status data of all virtual machines obtained from the data collection module.

In summary, this application does not modify the scheduling program of the virtual machine monitor itself, but is a supplement to the virtual machine monitor scheduling system, and can be applied to any virtualization platform, such as Xen and KVM.

The software-defined virtual network resource allocation system of the embodiment of the present application integrates the hardware network card resources of the virtual machine through the bonding driving technology, and defines these resources in the form of software, combining paravirtualization and single root I/O The advantages of virtualization can use any scheduling strategy to perceive the load status of the virtual machine based on the data of the virtual machine, and dynamically schedule the network card resources of the virtual machine, which can not only improve the network performance of the virtual machine, but also ensure the scalability of the virtual machine. And manageability. In addition, this application combines hot-swap technology and Bonding drive technology to activate the backup mode, and dynamically switch between single-root I/O virtualized NICs and para-virtualized NICs to solve the problem of online migration of virtual machines with single-root I/O virtualized devices. .

The above is only the preferred embodiment of the present invention. It should be pointed out that for those of ordinary skill in the art, without departing from the principles of the present invention, several improvements and retouches can be made. These improvements and retouches also It should be regarded as the protection scope of the present invention.

Claims

A software-defined virtual network resource allocation system, including a physical host, characterized in that the physical host includes a virtual machine and a central network controller; the central network controller is used for network I/O of the virtual machine Operate and set a programmable control panel, mark the allocation of network card resources of the virtual machine through the programmable control panel, and install the programmable control panel on the virtual machine, and the central network controller is based on the virtual machine Mark to control the network I/O operations of the virtual machine in a software-defined manner.
The software-defined virtual network resource allocation system according to claim 1, wherein the programmable control panel formulates a rule table and a trigger table to perform network I/O control of the virtual machine through the central network controller:

Rule table: used to record the allocation rules and policies of the virtual machine network card resources based on the label mechanism, and use the labels to mark the allocation of the virtual machine network card resources;

Trigger table: Used to record performance triggers based on the action trigger mechanism.
The software-defined virtual network resource allocation system according to claim 2, characterized in that the virtual machine further includes a network control module, the network control module is configured to use a rule table and a trigger table in the programmable control panel Scheduling and allocating network card resources of virtual machines.
The software-defined virtual network resource allocation system according to claim 3, wherein the network card resources of the virtual machine include a single root I/O virtualized VF network card and a paravirtualized network card, and the virtual machine uses Bonding The driving technology binds a single root I/O virtualized VF network card and a paravirtualized network card as a logical network card, and sets a single root I/O virtualized VF network card as a master device, and a paravirtualized network card as a slave device The network control module switches the single-root I/O virtualized VF network card and the para-virtualized network card through single-root I/O virtualized VF network card hot swap.
The software-defined virtual network resource allocation system according to claim 4, wherein the network control module hot-plugs the single-root I/O virtualized VF through a single-root I/O virtualized VF network card The switching between the NIC and the paravirtualized NIC is specifically: when the VF of the virtual machine is removed, the network control module notifies the virtual hot-swap controller of the physical host to trigger the virtual hot of the single root I/O virtualization device of the selected virtual machine Remove event; the virtual machine turns off the driver of the single root I/O virtualization device of the virtual machine and stops using the single root I/O virtualization device of the virtual machine in response to the virtual hot removal event; the activation of the network card by the Bonding drive technology consists of A single-root I/O virtualized VF network card is automatically switched to a para-virtualized network card; when a VF is assigned to the virtual machine, the network control module notifies the virtual hot-swap controller of the physical host to trigger a single-root I/O virtual machine virtual machine Virtual hot add event of a virtualized device; the virtual machine loads a single root I/O virtualized VF network card driver and selects a new VF to start working.
The software-defined virtual network resource allocation system according to claim 4 or 5, wherein the label of the virtual machine includes VF and vNet, where VF indicates whether the virtual machine uses a single root I/O virtual VF network card. If VF is true, it indicates that the virtual machine uses a single I/O virtualized VF network card. If VF is false, it indicates that the virtual machine does not use a single I/O virtualized VF network card; vNet indicates that Whether the virtual machine uses a paravirtualized network card. If vNet is true, it indicates that the virtual machine uses a paravirtualized network card. If vNet is false, it indicates that the virtual machine does not use a paravirtualized network card. If VF and vNet are both True, indicating that the virtual machine uses only a single I/O virtualized VF network card.
The software-defined virtual network resource allocation system according to claim 6, wherein the physical host further includes a data collection module, the data collection module is used to obtain network information and operating status data of the virtual machine, and The network information and the operating state data are transmitted to the central network controller, where the operating state data includes the running time of the virtual machine, the blocking time of the virtual machine, and the waiting time of the virtual machine.
The software-defined virtual network resource allocation system according to claim 7, wherein the data collection module obtains network information by: the virtual machine reads the interface file provided by the Linux system to obtain the network of the virtual machine Information, at the end of each sampling period, the obtained network information is sent to the data collection module; the data collection module subtracts the total traffic sent and received this time minus the total traffic sent and received last time to obtain the transmission and The total received traffic, dividing the total sent and received traffic in the current sampling period by the network card bandwidth to obtain the bandwidth utilization of the virtual machine in the current sampling period.
The software-defined virtual network resource allocation system according to claim 7, wherein the central network controller further includes a topology information record table, and the topology information record table is used to record virtual machine status and each virtual machine Topology information for data exchange between.
The software-defined virtual network resource allocation system according to claim 9, wherein the central network controller further comprises a data statistics table, and the data statistics table is used to record the virtual machine acquired by the data collection module Network information and operating status data.