WO2014000437A1

WO2014000437A1 - Virtual interrupt management method and apparatus in distributed virtual system

Info

Publication number: WO2014000437A1
Application number: PCT/CN2013/070591
Authority: WO
Inventors: 王海波
Original assignee: 华为技术有限公司
Priority date: 2012-06-30
Filing date: 2013-01-17
Publication date: 2014-01-03
Also published as: CN102799465A; CN102799465B

Abstract

The present invention provides a virtual interrupt management method and apparatus in a distributed virtual system. The method comprises: a virtual BIOS module establishing in an ACPI table a connection relationship between global virtual interrupt pins and interrupt pins of virtual PCI devices, any one of the global virtual interrupt pins corresponding to an interrupt pin of one or more virtual PCI devices belonging to the same physical node; an operating system of a virtual machine acquiring the ACPI table, and running, according to the ACPI table, an instruction of setting a target vCPU for the global virtual interrupt pins in the ACPI table; a distributed virtual machine monitor that intercepts the instruction determining, according to distributed interrupt pin information, a physical node where a local virtual interrupt pin corresponding to the global virtual interrupt pin is located, and saving a relationship between the local virtual interrupt pin and the target vCPU according to the instruction, the target vCPU being used for processing an interrupt on the local virtual interrupt pin.

Description

Virtual interrupt management method and device for distributed virtualization system

TECHNICAL FIELD Embodiments of the present invention relate to computer technologies, and in particular, to a virtual interrupt management method and apparatus for a distributed virtualization system. Background technique

As shown in Figure 1A, in a non-virtualized environment, each peripheral is interconnected (Peripheral)

Component Interconnect (PCI) devices Devi, Dev2... .Devn, need to send an interrupt to inform the operating system after completing one of their own work, this is achieved by connecting the PCI device to the interrupt pin of the interrupt controller. For example, connect to the interrupt pin of the 10 Advanced Programmable Interrupt Controller (IO-APIC). At the time of system startup, the Basic Input/Output System (BIO S) writes advanced configuration and power management interfaces to the internal memory (Advanced).

The Configuration and Power Interface (ACPI) table method informs the operating system of all PCI device information, including the connection relationship between the interrupt pins of all PCI devices and the interrupt pins of the interrupt controller. After the operating system is booted, the interrupt pin of the PCI device is set, and the interrupt of the PCI device is transferred to a specified physical CPU for processing. The ACPI table may be a Differentiated System Description Table (DSDT) table. In a distributed virtualization environment, the Distributed Virtual Machine Monitor (D VMM) also needs to simulate the interrupted connection relationship of virtual PCI devices. First, a device model (DM) of each physical node in a distributed virtualization environment allocates a bus number Bus and a device number Device to the virtual PCI device when the virtual PCI device is created, and determines the virtual PCI. The device's own interrupt pin number, Intx. Secondly, when the virtual machine is started, the virtual BIOS (Virtual Basic Input/Output System, vBIOS for short) will notify the virtual PCI device of the operating system device number as Device through the ACPI table in the memory. The Intx interrupt pin is connected to which global virtual interrupt pin of the Virtual I/O Advanced Programmable Interrupt Controller (vIO-APIC). Finally, DVMM simulates the interrupt pin number of the virtual PCI device to which the global virtual interrupt pin in the global vIO-APIC is connected. In an existing distributed virtualization system, a global virtual interrupt pin of a virtual machine may be connected to an interrupt pin of a virtual PCI device in a plurality of physical nodes, as shown in FIG. 1B, in a physical node. The interrupt pin of the virtual PCI device with the device number and interrupt pin number (0, 1) is connected to the interrupt pin of the virtual PCI device with the device number and interrupt pin number (8, 0) in the other physical node. On the 17th global virtual interrupt pin of a virtual machine. Then, when the operating system sets the global virtual interrupt pin of the 17th, the DVMM running the setting command intercepts the setting operation of the global virtual interrupt pin of the 17th, and needs to send to multiple physical nodes. The data packet is used to synchronize the interrupt pins of all virtual PCI devices connected to the 17th global virtual interrupt pin, for example, (0, 1) and (8, 0), and send the synchronously set data packets. When a virtual machine's set instruction is intercepted, its next instruction will be executed after the previous instruction has been simulated, so the longer it takes to simulate the setup instruction, the slower the virtual machine will run. Simulating a setup command requires simultaneous setup between multiple nodes, which takes longer, and the synchronization between different physical nodes can have a significant impact on virtual machine performance. SUMMARY OF THE INVENTION Embodiments of the present invention provide a virtual interrupt management method and apparatus for a distributed virtualization system, which are used to solve a problem in that a virtual PCI device in a plurality of physical nodes is connected to the same global virtual The interrupt pin causes a defect in performance degradation.

In one aspect, an embodiment of the present invention provides a virtual interrupt management method for a distributed virtualization system, including:

The virtual BIOS module of the virtual machine establishes a connection relationship between the global virtual interrupt pin and the interrupt pin of the virtual peripheral device interconnect PCI device in the ACPI table of the advanced configuration and the power management interface, wherein the global virtual interrupt pin is a virtual interrupt One or more interrupt pins on the foot controller, any one of the global virtual interrupt pins corresponding to one or more of the same physical node An interrupt pin of the virtual PCI device; the virtual interrupt pin controller is provided for an operating system of the virtual machine;

The operating system of the virtual machine acquires the ACPI table, and according to the ACPI table, runs an instruction to set a target virtual central processing unit vCPU for the global virtual interrupt pin in the ACPI table; intercepting the distributed instruction a virtual machine monitor, configured to determine, according to the distributed interrupt pin information, a physical node where the local virtual interrupt pin corresponding to the global virtual interrupt pin is located, where the local virtual interrupt pin is located on the physical node and used to simulate the global virtual An interrupt pin, the distributed interrupt pin information includes a connection relationship between a global virtual interrupt pin and an interrupt pin of the virtual PCI device, and a virtual PCI device and a local virtual interrupt pin included in each physical node;

The distributed virtual machine monitor on the physical node where the local virtual interrupt pin is located, according to the instruction, the correspondence between the local virtual interrupt pin and the target vCPU is saved, where the target vCPU is used. Interrupting the interrupt on the local virtual interrupt pin.

In another aspect, an embodiment of the present invention provides a virtual interrupt management device of a distributed virtualization system, including a virtual machine and a plurality of distributed virtual machine monitors deployed on different physical nodes.

The virtual machine includes: a virtual BIOS module and an operating system;

The virtual BIOS module is configured to establish, in an ACPI table, a connection relationship between a global virtual interrupt pin on the virtual machine and an interrupt pin of the virtual PCI device, where any one of the global virtual interrupt pins corresponds to An interrupt pin of one or more of the virtual PCI devices of the same physical node;

The operating system is configured to obtain the ACPI table, and run according to the ACPI table.

The global virtual interrupt pin in the ACPI table sets an instruction of the target vCPU; the first distributed virtual machine monitor of the plurality of distributed virtual machine monitors is configured to intercept an instruction of the operating system to set a target vCPU, according to The distributed interrupt pin information determines a physical node where the local virtual interrupt pin corresponding to the global virtual interrupt pin is located, and the local virtual interrupt pin is located on the physical node and is used to simulate the global virtual interrupt pin. The distributed interrupt pin information includes a connection relationship between a global virtual interrupt pin and an interrupt pin of the virtual PCI device, and each physical node includes a virtual PCI device and a local virtual interrupt pin for which the respective physical node is responsible; a second distributed virtual machine monitor of the plurality of distributed virtual machine monitors for saving the Corresponding relationship between the local virtual interrupt pin and the target vCPU, the second distributed virtual machine monitor being a distributed virtual machine monitor on the physical node where the local virtual interrupt pin is located. A virtual interrupt management method and device for a distributed virtualization system provided by an embodiment of the present invention, a virtual virtual interrupt pin written by a virtual BIOS module in an ACPI table corresponds to a local virtual interrupt pin on the same physical node, that is, a global The virtual interrupt pin is simulated by a local virtual interrupt pin on the same physical node. Therefore, when the global virtual interrupt pin is set, the operating system does not need to send synchronously set data packets to different nodes, which improves the distribution. The performance of a virtualized system.

DRAWINGS

1A is a schematic diagram of a PCI device interrupt connection architecture in a non-virtualized environment provided by the prior art; FIG. 1B is a schematic diagram of a virtual PCI device interrupt connection architecture in a distributed virtualization environment provided by the prior art;

2 is a distributed virtualization structure according to an embodiment of the present invention;

3 is a flowchart of a method for managing a virtual interrupt pin of a distributed virtualization system according to an embodiment of the present invention;

4 is a schematic structural diagram of a virtual PCI device interrupt connection according to an embodiment of the present invention;

5 is a flowchart of a virtual interrupt pin management method of another distributed virtualization system according to an embodiment of the present invention;

6 is a flowchart of a method for managing a virtual interrupt pin of a distributed virtualization system according to an embodiment of the present invention;

FIG. 7 is a schematic diagram of a virtual interrupt pin management structure of a distributed virtualization system according to an embodiment of the present invention. detailed description

Virtualization technology is a decoupling method that separates the underlying hardware devices from the upper operating system and applications. It introduces the Virtual Machine Monitor (VMM) layer to directly manage the underlying hardware resources and create and underlying hardware. An unrelated virtual machine (VM) is used by upper operating systems and applications. Virtual machines do not have real physical devices, and software interrupt controllers and physical devices are required to form virtual interrupt controllers and virtual devices. Before the operating system starts, the virtual BIOS writes an ACPI table in the memory allocated to the owning virtual machine. After the operating system is started, the virtual device can be set and used by commands. After intercepting these instructions of the operating system, the VMM sets the virtual device or simulates the physical device according to the instructions of the operating system, and returns the simulation result to the virtual machine.

Distributed virtualization technology is a technology that reassembles resources from multiple physical machines into a virtual machine in a virtual way. That is, the virtual hardware of distributed virtual machines is distributed at different nodes in order to use different nodes. Hardware device on. FIG. 2 is a schematic diagram of a distributed virtualization structure according to an embodiment of the present invention. The distributed virtualization architecture shown in Figure 2 includes a VM layer, a DVMM layer, and a physical node layer. Each physical node includes hardware resources such as processors, memory, disks, network cards, and peripherals. Each physical node is deployed with a DVMM. When a virtual machine is created, the DVMM deployed on each physical node creates the required virtual hardware devices for the virtual machines at the physical nodes to which they belong. The virtual machine runs on a physical node in the same time period. DVMM mainly includes three modules: CPU virtualization, memory virtualization and I/O virtualization. It achieves the aggregation of physical resources based on virtual resource aggregation. I/O virtualization simulates PCI devices and their interrupted connections in a non-virtualized environment. DVMM does not allow all of these actions to operate directly on the physical hardware when the operating system is installed and running on the virtual machine, and the hardware resources are initialized and used. Instead, the access behavior is simulated and the access behavior is simulated. The access to the virtual hardware ultimately uses the virtual hardware as a proxy to operate the real physical hardware, ensuring the isolation between different virtual machines and the correct use of the virtual machine for hardware resources. The DVMM layer directly manages the local underlying hardware resources and cooperates with the DVMM on other nodes through network communication to make the virtual machine have a cross-section. The ability to access resources. Specifically, when a distributed virtual machine monitor of a node intercepts an instruction of a virtual machine operating system, first determining which node the virtual hardware (including the pin of the virtual interrupt controller) operated by the instruction is on, and then performing the desired The operation is transmitted to the node through the communication module to simulate, for example, to the virtual hardware that sets the virtual hardware or operates the virtual hardware to simulate.

FIG. 3 is a flowchart of a method for managing a virtual interrupt pin of a distributed virtualization system according to an embodiment of the present invention. FIG. 4 is a schematic structural diagram of a virtual PCI device interrupt connection according to an embodiment of the present invention. As shown in Figure 4, the virtual interrupt controller provided by the VM is global vIO-APIC. The interrupt pin on the global vIO-APIC is called the global virtual interrupt pin, and the virtual OS only has the global virtual interrupt controller provided by the VM. The interrupt pin of each virtual PCI device is connected to a global virtual interrupt pin on the global virtual interrupt controller. The virtual interrupt controller provided by the DVMM on each physical node is a local vIO-APIC. The interrupt pin on the local vIO-APIC is called a local virtual interrupt pin, which is simulated by a local virtual interrupt controller on each physical node. Global virtual interrupt pin, the interrupt pin of each virtual PCI device is connected to a local virtual interrupt pin on the local virtual interrupt controller. One physical node has multiple virtual PCI devices, one virtual PCI device can have multiple interrupt pins, and one virtual PCI device can also be connected to multiple local virtual interrupt pins on the local vIO-APIC. The DM module registers the PCI bus number and device number of the virtual PCI device created in each physical node, and the device numbers of the virtual PCI devices on all physical nodes are uniformly numbered, and the local vIO-APIC on each physical node is localized. Virtual interrupt pins can be individually numbered. The interrupt structure provided by the VM to the virtual machine operating system is the connection relationship between the virtual interrupt pin of the virtual PCI device included in the VM and the global virtual interrupt pin on the global vIO-APIC. The interrupt structure provided by the DVMM deployed on one physical node is the connection relationship between the interrupt pin of the virtual PCI device included in the physical node and the local virtual interrupt pin on the local vIO-APIC managed by the physical node. For example, in the interrupt structure learned by the virtualization operating system, the Intx number interrupt pin of the virtual PCI device with the device number Device is connected to the global virtual interrupt pin of the gsi number in the global vIO-APIC; The interrupt structure saved on the physical node where the virtual PCI device of the device resides is the device number. The Intx interrupt pin of the virtual PCI device of Device is connected to the local virtual interrupt pin of the xth in the local vIO-APIC, that is, on the physical node, the part of the Xth in the local vIO-APIC is used. The virtual interrupt pin emulates the global virtual interrupt pin of the gsi in global vIO-APIC. When the virtual machine operating system is going to set a global virtual interrupt pin, the DVMM intercepts the operation and simulates setting the global virtual interrupt pin in the specified physical node, and the specified physical node is connected to the The physical node of the global virtual interrupt pin of the global virtual interrupt pin.

As shown in FIG. 3, the method provided in this embodiment includes:

Step 31: The virtual BIOS module of the virtual machine establishes a connection relationship between the global virtual interrupt pin and the interrupt pin of the virtual PCI device in the ACPI table, where the global virtual interrupt pin is a virtual interrupt pin controller. Or a plurality of interrupt pins, any one of the global virtual interrupt pins corresponding to an interrupt pin of one or more of the virtual PCI devices belonging to the same physical node; the virtual interrupt pin controller is Provided by the operating system of the virtual machine;

The virtual BIOS module of the distributed virtualization system can write the ACPI to the virtual memory of the virtual machine. After the ACPI table is written to virtual memory, the virtual machine operating system can obtain the ACPI table from the memory, and according to the ACPI table, it can be known which virtual interrupt pin is connected to which virtual interrupt pin on which virtual PCI device. In all connections recorded in the ACPI table, any global virtual interrupt pin is connected to the interrupt pin of one or more virtual PIC devices on the same physical node. That is, virtual PCI devices on different physical nodes are not connected to the same global virtual interrupt pin. Therefore, the same global virtual interrupt pin is implemented by a local virtual interrupt pin on a physical node. For example, connect the Intx interrupt pin of the virtual PCI device with the device number Device to the global virtual interrupt pin of the gsi-number in the global vIO-APIC. The connection relationship in the ACPI table can be expressed as (virtual PCI device number). Device, interrupt pin number Intx, global virtual interrupt pin number gsi).

As shown in Figure 4, the global virtual interrupt pin of global vIO-APIC is connected to the Intxl interrupt pin of the virtual PCI device vDEVl on the NODE1 node and the Intx3 interrupt of the virtual PCI device VDEV12 on the NODE1 node. Foot, global vIO-APIC No. 20 global virtual The interrupt pin is connected to the Intxl interrupt pin of the virtual PCI device VDEV21 on the NODE2 node and the Intxl interrupt pin of the virtual PCI device VDEV22 on the NODE2 node. From the above connection relationship, it can be known that the global virtual interrupt pin of the global vIO-APIC is connected to the virtual PCI device on the NODE1 node, and the global virtual interrupt pin of the global vIO-APIC is connected to the virtual node on the NODE2 node. PCI device.

There are several ways to connect a global virtual interrupt pin to an interrupt pin on a virtual PCI device on the same physical node. Preferably, the virtual BIOS module divides all global virtual interrupt pins into a plurality of mutually disjoint subsets, and when allocating a local virtual interrupt pin on one physical node, interrupts all PCI devices of the same physical node. The pins are mapped in a subset. Therefore, the interrupt pins of all PCI devices of a physical node in the ACPI table are connected in a subset. For example, the device number of the virtual PCI device on the physical node 0 is between 0 and 10. The device number of the virtual PCI device on the physical node 1 is between 11 and 13. The device number of the virtual PCI device on the physical node 2 is 14~: 16, ..., the device number of the virtual PCI device on node 7 is between 29 and 31, and the interrupt pin of PCI device 0~10 (that is, all PCI device interrupt pins of node 0) will Connect directly to the 16~26 vIO-APIC pins; the interrupt pins of the 11~13 PCI devices (ie all PCI device interrupt pins on node 1) will be directly connected to the vIO-APIC pins 27~29; 29~31 The interrupt pin of the PCI device (that is, all PCI device interrupt pins on node 7) is directly connected to the vIO-APIC pins 45~47. Pins 0~15 of vIO-APIC are used for special purposes. If all global virtual interrupt pins are divided into multiple disjoint subsets, and the interrupt pins of all PCI devices of one physical node are corresponding to one subset, the operating system can set the subset within the subset at a time. All global virtual interrupt pins do not need to be set up multiple times to set these global virtual interrupt pins because the local virtual interrupt pins that emulate these global virtual interrupt pins are on the same physical node. Thus, the performance of the virtual machine can be improved.

Optionally, the virtual BIOS module can also connect the interrupt pins of all virtual PCI devices on one physical node to the same global virtual interrupt pin, that is, all local virtual interrupt pins on one physical node in the ACPI table. Corresponds to a global virtual interrupt pin. Step 32: The operating system of the virtual machine acquires the ACPI table, and according to the ACPI table, runs an instruction to set a target vCPU for the global virtual interrupt pin in the ACPI table.

The virtual machine's operating system determines the target Virtual Central Processing Unit (vCPU) that handles the interrupt on each global virtual interrupt pin based on the virtual PCI device to which the global virtual interrupt pin is connected in the APCI table. For example, a virtual PCI device connected to a global interrupt pin in the APCI table is a virtual mouse, and the virtual machine operating system will handle the interrupt of the virtual PCI device. The target vCPU can be set to multiple vCPUs, while another global in the APCI table. The virtual PCI device connected to the interrupt pin is a virtual hard disk, and the virtual machine operating system will handle the interrupt of the virtual PCI device. The target vCPU can be set to a vCPU. When the virtual machine operating system setting processes a vCPU interrupted on the global virtual interrupt pin, it sends a set command to the global virtual interrupt controller, which is used to set which vCPU to handle the interrupt generated on the global virtual interrupt pin.

It should be noted that each global virtual interrupt pin in the APCI table needs to be set with a target vCPU, which may be processed one by one or batch processing. In the following embodiments, for the sake of easy understanding, the specific one is A global virtual interrupt pin setting vCPU is taken as an example. Those skilled in the art can fully understand that in each step of the following embodiments, the same processing can be simultaneously performed for all global virtual interrupt pins in the APCI table.

Step 33: The distributed virtual machine monitor intercepting the instruction, determining, according to the distributed interrupt pin information, a physical node where the local virtual interrupt pin corresponding to the global virtual interrupt pin is located, the local virtual interrupt pin Located on a physical node and used to simulate the global virtual interrupt pin, the distributed interrupt pin information includes a connection relationship between a global virtual interrupt pin and an interrupt pin of a virtual PCI device, and a virtual PCI device included in each physical node. And local virtual interrupt pins.

The distributed interrupt pin information can be recorded in the storage system of the distributed virtualization system: one is the connection relationship between each global virtual interrupt pin and the interrupt pin of the virtual PCI device on the physical node, and the connection relationship is The connection relationship is the same in the ACPI table. The other is a virtual PCI device and a local virtual interrupt pin included in each physical node. The distributed interrupt pin information may not be stored in the physical node to which the DVMM that intercepts the virtual machine operating system setting instruction belongs, intercepting the virtual The DVMM of the operating system setting command can cooperate with the DVMM to obtain distributed interrupt pin information from other physical nodes.

In the physical node, the local virtual interrupt pin connected to the interrupt pin of the virtual PCI device emulates the global virtual interrupt pin connected to the interrupt pin of the virtual PCI device on the physical node. As shown in Figure 4, deployed in the interrupt structure provided by DVMM on the NODE1 node, the Intxl interrupt pin of the virtual PCI device vDEV1 on the NODE1 node is connected to the local virtual interrupt of the local vIO-APIC on the NODE1 node. Pin, the Intx3 interrupt pin of the virtual PCI device VDEV12 on the NODE1 node is connected to the local virtual interrupt pin No. 6 of the local vIO-APIC on the NODE1 node. As shown in Figure 4, deployed in the interrupt structure provided by DVMM on the NODE2 node, the Intxl interrupt pin of the virtual PCI device vDEV21 on the NODE2 node is connected to the local virtual interrupt of the local vIO-APIC on the NODE2 node. Pin, the Intxl interrupt pin of the virtual PCI device VDEV22 on the NODE2 node is connected to the local virtual interrupt pin No. 10 of the local vIO-APIC on the NODE2 node.

When the virtual machine operating system sets a global virtual interrupt pin to the target vCPU that processes the interrupt generated on it, the DVMM deployed on the physical node running the virtual machine operating system intercepts the setting command of the global interrupt virtual pin of the virtual machine operating system. The interrupt pin of the virtual PCI device corresponding to the global virtual interrupt pin is determined according to the connection relationship between each global virtual interrupt pin and the interrupt pin of the virtual PCI device on the physical node. The physical node where the analog local virtual interrupt pin is located can be determined by recording the virtual PCI device included in each physical node and the local virtual interrupt pin responsible for each physical node.

Step 34: The DVMM on the physical node where the local virtual interrupt pin is located saves the correspondence between the local virtual interrupt pin and the target vCPU according to the instruction, where the target vCPU is used to process the local part. An interrupt on the virtual interrupt pin.

When the physical node where the local virtual interrupt pin is located and the local physical node of the DVMM that intercepts the operating system setting instruction are the same physical node, the DVMM that intercepts the operating system setting instruction saves the local virtual interrupt pin and processes the local virtual Interrupt target on interrupt pin The vCPU correspondence is stored, for example, in the interrupt processing vCPU table, and the target vCPU that handles the interrupt on the local virtual interrupt pin is the target vCPU set in the instruction of the operating system. After an interrupt is generated on the interrupt pin of the virtual PCI device connected to the local virtual interrupt pin, the DVMM on the physical node where the local virtual interrupt pin is located can process the vCPU table according to the saved interrupt to determine which vCPU to process. An interrupt on this local virtual interrupt pin. When the physical node where the local virtual interrupt pin is located is not the same physical node as the local physical node where the DVMM that intercepts the operating system setting instruction is located, the DVMM that intercepts the operating system setting instruction sends a setting instruction to the local virtual interrupt pin. a remote physical node, where the DVMM of the remote physical node saves the correspondence between the local virtual interrupt pin and the target vCPU, for example, stored in an interrupt processing vCPU table, thereby being connected to the local virtual interrupt pin. After the virtual PCI device generates an interrupt, the DVMM of the remote physical node processes the vCPU table according to the saved interrupt to determine which vCPU is to handle the interrupt on the local virtual interrupt pin.

In the method provided by the embodiment, the virtual BIOS module writes a global virtual interrupt pin in the ACPI table to the interrupt pin of one or more virtual PIC devices on the same physical node, that is, a global virtual interrupt pin is configured. The local virtual interrupt pin on the same physical node is simulated. Since the interrupt pins of the virtual PCI device of different physical nodes are not connected to the same global virtual interrupt pin, the virtual machine operating system sets the global virtual interrupt. When pins are used, there is no need to send packets for synchronization settings to different physical nodes, which improves the performance of the distributed virtualization system.

Further, if the DVMM of the physical node where the local virtual interrupt pin is located in step 35, determining, according to an instruction of the operating system, that the target vCPU that is interrupted on the local virtual interrupt pin is a vCPU on the remote physical node, the local virtual After the DVMM of the physical node where the interrupt pin is located receives the interrupt on the local virtual interrupt pin, the vCPU table is processed according to the saved interrupt, and the interrupt is transferred to the target vCPU of the remote physical node for processing, resulting in a longer processing time. This non-localized way of handling interrupts can have a large impact on the performance of the virtual machine. In order to avoid the interruption of the processing by the non-local vCPU, the embodiment of the present invention further provides the following method to implement the interrupt localization processing: As shown in FIG. 5, step 34 may include: Step 340: The DVMM of the physical node where the local virtual interrupt pin is located determines whether the physical node where the target vCPU is located is a local physical node according to the instruction. If the step 341 is performed, otherwise step 342 is performed.

Step 341: Save the correspondence between the local virtual interrupt pin and the target vCPU in the instruction. Step 342: If more than one vCPU is included on the local physical node, modify the target vCPU in the set instruction to the vCPU on the local physical node, and save the correspondence between the local virtual interrupt pin and the modified target vCPU.

If the DVMM of the physical node where the local virtual interrupt pin is located, the physical node of the target vCPU where the interrupt generated on the global interrupt pin is set to be processed according to the setting instruction is not the local physical node, and the local physical node includes multiple vCPUs, according to The load status of the local vCPU changes the target vCPU in the set instruction that handles the interrupt generated on the global interrupt pin that is set to the vCPU on the local physical node. After the interrupt is generated on the local virtual interrupt pin that simulates the global virtual interrupt pin, the local DVMM passes the interrupt to the vCPU on the local physical node for processing, and does not need to pass the interrupt to the remote physical node for processing, reducing the The communication pressure between nodes reduces the impact of interrupts on virtual machine performance and improves the performance of virtual machines during the interruption process.

FIG. 6 is a flowchart of a method for managing a virtual interrupt pin of a distributed virtualization system according to an embodiment of the present invention. This embodiment is an embodiment which is further refined in the corresponding embodiment of FIG. As shown in FIG. 6, the method provided in this embodiment includes:

Step 60: The virtual BIOS module of the virtual machine establishes a connection relationship between the global virtual interrupt pin and the interrupt pin of the virtual PCI device in the ACPI table, where the global virtual interrupt pin is a virtual interrupt pin controller. Or a plurality of interrupt pins, any one of the global virtual interrupt pins corresponding to an interrupt pin of one or more of the virtual PCI devices belonging to the same physical node; the virtual interrupt pin controller is Provided by the operating system of the virtual machine;

Step 61: The operating system of the virtual machine acquires the ACPI table, and according to the ACPI table, sets a global virtual interrupt pin in the ACPI table to set an instruction of the target vCPU.

Step 62: The DVMM intercepting the instruction determines the according to the distributed virtual interrupt information. Simulates the local virtual interrupt pin of the global virtual interrupt pin that is set.

Step 63: The DVMM that intercepts the instruction determines, according to the distributed virtual interrupt information, whether the physical node where the local virtual interrupt pin is located is a local physical node where the DVMM is located.

If the physical node where the local virtual interrupt pin is located is a local physical node, the DVMM that intercepts the operating system command performs step 641, step 642, and step 643, otherwise the DVMM that intercepts the operating system command performs step 65.

Step 641: Determine, according to the instruction, whether the physical node where the vCPU is located in the global interrupt pin that is set to be set is a local physical node. If the step is performed, otherwise step 643 is performed.

Step 642: Processing the target of the interrupt generated on the global interrupt pin that is set. The physical node where the vCPU is located is a local physical node, and the corresponding relationship between the local virtual interrupt pin and the target vCPU is saved according to the setting instruction.

Step 643: Handling the interrupt generated on the global interrupt pin that is set is the physical node of the vCPU that is not the local physical node and the local physical node includes more than one vCPU, which will handle the interrupt generated on the global interrupt pin that is set. The target vCPU is modified to be the target vCPU on the local physical node, and the corresponding relationship between the local virtual interrupt pin and the modified target vCPU is saved.

Step 65: The DVMM intercepting the instruction sends the instruction to the remote physical node where the local virtual interrupt pin is located. The remote physical node that receives the instruction performs step 641, step

642 and step 643.

FIG. 7 is a schematic structural diagram of a virtual interrupt management apparatus of a distributed virtualization system according to an embodiment of the present invention. As shown in FIG. 7, the apparatus includes: a virtual machine and a plurality of distributed virtual machine monitors deployed on different physical nodes. The virtual machine includes a virtual BIOS module 70 and an operating system 71. The distributed virtual machine monitor can be a first distributed virtual machine monitor 72 and a second distributed virtual machine monitor 73.

The virtual BIOS module 70 is configured to establish, in an ACPI table, a connection relationship between a global virtual interrupt pin on a virtual machine and an interrupt pin of the virtual PCI device, where the global virtual interrupt pin is in the Any one of the corresponding ones corresponds to an interrupt pin of one or more of the virtual PCI devices belonging to the same physical node. The virtual BIOS module 70 can write the ACPI table to the virtual memory of the virtual machine. Preferably, the virtual BIOS module is specifically configured to divide the global virtual interrupt pin into a plurality of mutually disjoint subsets, and establish a connection relationship between the global virtual interrupt pin and an interrupt pin of the virtual PCI device. The interrupt pins of all virtual PCI devices belonging to the same physical node are connected in the same subset. Or the virtual BIOS module is specifically configured to establish a connection relationship between the global virtual interrupt pin and an interrupt pin of the virtual PCI device, where all virtual PCI device interrupt pins on the same physical node are in the same global virtual Interrupt pin.

The operating system 71 is configured to obtain the ACPI table, and execute an instruction to set a target vCPU for the global virtual interrupt pin in the ACPI table according to the ACPI table.

The first distributed virtual machine monitor 72 of the plurality of distributed virtual machine monitors is configured to intercept an instruction of the operating system to set a target vCPU, and determine the global virtual interrupt pin according to the distributed interrupt pin information. a physical node where the corresponding local virtual interrupt pin is located, the local virtual interrupt pin is located on the physical node and used to simulate the global virtual interrupt pin, and the distributed interrupt pin information includes the virtual machine The connection relationship between the global virtual interrupt pin and the interrupt pin of the virtual PCI device on the physical node, and the virtual PCI device included in each physical node and the local virtual interrupt pin responsible for each physical node.

Further, the first distributed virtual machine monitor 72 is further configured to: when determining that the physical node where the local virtual interrupt pin is located is not a local physical node, send the instruction to the physical node where the local virtual interrupt pin is located Distributed virtual machine monitor.

a second distributed virtual machine monitor 73 of the plurality of distributed virtual machine monitors, configured to save a correspondence between the local virtual interrupt pin and the target vCPU according to the instruction, the second distribution The virtual machine monitor is a distributed virtual machine monitor on the physical node where the local virtual interrupt pin is located.

Further, the second distributed virtual machine monitor 73 is further configured to connect to an interrupt on the interrupt pin of the virtual PCI device on the local virtual interrupt pin, and then save according to the physical node where the physical node is located. The local virtual interrupt pin is associated with the target vCPU that processes the interrupt on the local virtual interrupt pin, and the interrupt on the local virtual interrupt pin is transmitted to the target vCPU.

In the device provided in this embodiment, the same global virtual interrupt pin in the ACPI table of the virtual BIOS module is written to the local virtual interrupt pin on the same physical node, that is, a global virtual interrupt pin is the same. The local virtual interrupt pin on a physical node is simulated. Therefore, when the global virtual interrupt pin is set, the operating system does not need to send synchronously set data packets to different nodes, which improves the performance of the distributed virtualization system.

To avoid the phenomenon of non-local processing interruption, that is, to avoid the interruption generated on the local interrupt pin by the vCPU on the remote physical node, the second distributed virtual machine monitor has the following functions:

The second distributed virtual machine monitor 73 is further configured to save the local virtual interrupt pin and the local virtual interrupt pin when determining that the physical node where the target vCPU is located is a local physical node according to the instruction The corresponding relationship of the target vCPU on the interrupt. The target vCPU that handles the interrupt on the local virtual interrupt pin is the vCPU in the instruction of the operating system.

The second distributed virtual machine monitor 73 is further configured to: when determining, according to the instruction, that the physical node where the target vCPU is located is not a local physical node and the local physical node includes more than one vCPU, The target vCPU is modified to be a vCPU on the local physical node, and the corresponding relationship between the local virtual interrupt pin and the modified target vCPU is saved.

A person skilled in the art can understand that all or part of the steps of implementing the above method embodiments may be completed by using hardware related to program instructions, and the foregoing program may be stored in a computer readable storage medium, and the program is executed when executed. The foregoing storage medium includes: ROM, RAM, magnetic disk or optical disk, and the like, which can store various program codes. Finally, the above embodiments are only used to illustrate the technical solution of the present invention. The invention is not limited thereto; although the invention has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that the technical solutions described in the foregoing embodiments may still be modified, or Equivalent replacement of some of the technical features of the present invention is not included in the scope of the technical solutions of the embodiments of the present invention.

Claims

Claim

A virtual interrupt management method for a distributed virtualization system, comprising: a virtual BIOS module of a virtual machine establishing a global virtual interrupt pin and a virtual peripheral device interconnect PCI device in an advanced configuration and a power management interface ACPI table; The connection relationship of the interrupt pins, wherein the global virtual interrupt pin is one or more interrupt pins on the virtual interrupt pin controller, and any one of the global virtual interrupt pins corresponds to the same one An interrupt pin of one or more of the virtual PCI devices of the physical node; the virtual interrupt pin controller is provided for an operating system of the virtual machine;

The operating system of the virtual machine acquires the ACPI table, and according to the ACPI table, runs an instruction to set a target virtual central processing unit vCPU for the global virtual interrupt pin in the ACPI table;

a distributed virtual machine monitor intercepting the instruction, determining, according to the distributed interrupt pin information, a physical node where the local virtual interrupt pin corresponding to the global virtual interrupt pin is located, where the local virtual interrupt pin is located at a physical node And used to simulate the global virtual interrupt pin, the distributed interrupt pin information includes a connection relationship between a global virtual interrupt pin and an interrupt pin of a virtual PCI device, and a virtual PCI device and a partial virtual virtual machine included in each physical node. An interrupt virtual machine monitor, wherein the distributed virtual machine monitor on the physical node where the local virtual interrupt pin is located stores a correspondence between the local virtual interrupt pin and the target vCPU according to the instruction, where the target The vCPU is used to handle interrupts on the local virtual interrupt pin.

2. The method according to claim 1, wherein the distributed virtual machine monitor on the physical node where the local virtual interrupt pin is located saves the local virtual interrupt pin and the The corresponding relationship of the target vCPU includes:

If the distributed virtual machine monitor that intercepts the instruction determines that the physical node where the local virtual interrupt pin corresponding to the global virtual interrupt pin is located is the physical node where the virtual virtual interrupt pin is located, the intercepting the instruction a distributed virtual machine monitor, configured to save the local virtual interrupt pin when the physical node where the target vCPU is located is a local physical node according to the instruction Correspondence relationship of the target vCPU.

The method according to claim 1 or 2, wherein the distributed virtual machine monitor on the physical node where the local virtual interrupt pin is located saves the local virtual interrupt pin according to the instruction The corresponding relationship of the target vCPU includes:

If the distributed virtual machine monitor that intercepts the instruction determines that the physical node where the local virtual interrupt pin corresponding to the global virtual interrupt pin is located is not the physical node where the virtual virtual interrupt pin is located, the intercepting the instruction The distributed virtual machine monitor notifies the distributed virtual machine monitor on the physical node where the local virtual interrupt pin is located to set the instruction, and the distributed virtual machine monitor of the physical node where the local virtual interrupt pin is located, Determining, according to the instruction, that the target vCPU is not a local physical node and the local physical node includes more than one vCPU, modifying the target vCPU in the instruction to a vCPU on the local physical node And storing a correspondence between the local virtual interrupt pin and the modified target vCPU.

The method according to claim 1, 2 or 3, wherein the establishing a connection relationship between the global virtual interrupt pin and the interrupt pin of the virtual PCI device is specifically:

Dividing the global virtual interrupt pin into a plurality of mutually disjoint subsets, establishing a connection relationship between the global virtual interrupt pin and an interrupt pin of the virtual PCI device, where the virtual device belongs to the same physical machine The interrupt pins of the PCI device are connected in the same subset.

The method according to claim 1, 2 or 3, wherein in the ACPI table, the interrupt pins of all the virtual PCI devices on the same physical node are connected to one of the global virtual interrupt references. foot.

The method according to any one of claims 1 to 5, further comprising: after the interrupt is generated on an interrupt pin of the virtual PCI device connected to the local virtual interrupt pin, the partial virtual The distributed virtual machine monitor on the physical node where the interrupt pin is located, according to the corresponding relationship between the local virtual interrupt pin held by the physical node and the target vCPU that is interrupted on the local virtual interrupt pin, The local virtual interrupt pin The interrupt is passed to the target vCPU.

7. A virtual interrupt management device for a distributed virtualization system, comprising a virtual machine and a plurality of distributed virtual machine monitors deployed on different physical nodes. It is characterized by:

The virtual machine includes: a virtual BIOS module and an operating system;

The operating system is configured to acquire the ACPI table, and execute an instruction to set a target vCPU for a global virtual interrupt pin in the ACPI table according to the ACPI table; in the multiple distributed virtual machine monitors a first distributed virtual machine monitor, configured to intercept an instruction of the operating system to set a target vCPU, and determine, according to the distributed interrupt pin information, a physical node where the local virtual interrupt pin corresponding to the global virtual interrupt pin is located, where The local virtual interrupt pin is located on the physical node and is used to simulate the global virtual interrupt pin, and the distributed interrupt pin information includes a connection relationship between a global virtual interrupt pin and an interrupt pin of the virtual PCI device, and a virtual PCI device included in each physical node and a local virtual interrupt pin responsible for each physical node;

a second distributed virtual machine monitor of the plurality of distributed virtual machine monitors, configured to save a correspondence between the local virtual interrupt pin and the target vCPU according to the instruction, the second distributed The virtual machine monitor is a distributed virtual machine monitor on the physical node where the local virtual interrupt pin is located.

8. Apparatus according to claim 7 wherein:

The second distributed virtual machine monitor is further configured to: when determining that the physical node where the target vCPU is located is a local physical node according to the instruction, saving a correspondence between the local virtual interrupt pin and the target vCPU;

The second distributed virtual machine monitor is further configured to determine the target according to the instruction When the physical node where the vCPU is located is not a local physical node and the local physical node includes more than one vCPU, the target vCPU in the instruction is modified to be a vCPU on the local physical node, and the local virtual is saved. The correspondence between the interrupt pin and the modified target CPU.

9. Apparatus according to claim 8 wherein:

The first distributed virtual machine monitor is further configured to: when determining that the physical node where the local virtual interrupt pin is located is not a local physical node, send the instruction to the physical node where the local virtual interrupt pin is located Distributed virtual machine monitor.

The device according to claim 7, 8 or 9, wherein the virtual BIOS has a connection relationship between the global virtual interrupt pin and an interrupt pin of the virtual PCI device, wherein the same physical entity belongs to the same physical The interrupt pins of all virtual PCI devices of the machine are connected in the same subset.

The device according to claim 7, 8 or 9, wherein the virtual BIOS module is specifically configured to establish a connection relationship between the global virtual interrupt pin and an interrupt pin of the virtual PCI device, wherein the same one The interrupt pins of all virtual PCI devices on the physical node are connected to the same global virtual interrupt pin.

The device according to any one of claims 7 to 11, wherein the second distributed virtual machine monitor is configured to connect an interrupt of the virtual PCI device on the local virtual interrupt pin. After an interrupt is generated on the pin, the interrupt on the local virtual interrupt pin is transmitted according to the correspondence between the local virtual interrupt pin held by the physical node and the target vCPU that processes the interrupt on the local virtual interrupt pin. Go to the target vCPU.