WO2012119390A1

WO2012119390A1 - Virtual machine migration notification method and system

Info

Publication number: WO2012119390A1
Application number: PCT/CN2011/078397
Authority: WO
Inventors: 郑若滨
Original assignee: 华为技术有限公司
Priority date: 2011-08-15
Filing date: 2011-08-15
Publication date: 2012-09-13
Also published as: CN103430149A; CN103430149B

Abstract

Provided are a virtual machine migration notification method and system. A destination control node updates an IP routing table according to a first ARP message containing the address of a VM to be migrated sent by a destination server, and sends the updated IP address routing information about the VM to be migrated to a source control node using a first routing protocol message; and the source control node updates the IP routing table according to the first routing protocol message and sends the address of the VM to be migrated to a source server using a second ARP message. The application of the virtual machine migration method and system in the present invention can reduce the bandwidth occupied by the control signalling.

Description

Virtual machine migration notification method and system

Technical field

The embodiments of the present invention relate to communication technologies, and in particular, to a virtual machine (VM) migration method and system. Background technique

With the continuous development of computer technology and communication technology, Data Center (DC) network has been more and more widely used.

In a DC network, multiple VMs are set up on the server for calculation. When a server's load is too large or fails, the VMs set up on the server need to be migrated to other servers. At the time of VM migration, the Media Access Control (MAC) address of the VM to be migrated is notified to the relevant node in the DC network by means of an address resolution protocol (ARP) message. As each of the DCs includes a large number of VMs, the existing VM migration method can form a broadcast storm in the DC network. The control signaling related to the migration occupies a large amount of network bandwidth, which causes waste of network bandwidth resources. Summary of the invention

The embodiment of the present invention provides a virtual machine migration notification method, which is used to solve the defects in the prior art and save bandwidth occupied by control signaling.

The embodiment of the present invention further provides a virtual machine migration system, which is used to solve the defects in the prior art and save bandwidth occupied by control signaling.

The embodiment of the invention provides a virtual machine VM migration method, including:

The target server starts the VM to be migrated and sends the media access control MAC address and the internet protocol IP address of the VM to be migrated to the target control node by using the first address resolution protocol ARP message; the target control node is updated according to the first ARP message. IP routing table, through the first road Sending, by the protocol packet, the IP address routing information of the VM to be migrated to the source control node, where the IP address routing information of the VM to be migrated includes the IP address of the VM to be migrated and the IP address of the target control node. ;

The source control node updates the IP routing table according to the IP address of the VM to be migrated and the IP address of the target control node in the first routing protocol packet, and sends the VM to be migrated to the source server by using the second ARP message. IP address or IP address and MAC address.

The embodiment of the invention further provides a virtual machine VM migration system, including:

a target server, configured to start a VM to be migrated and send a media access control MAC address and an internet protocol IP address of the VM to be migrated to the target control node by using a first address resolution protocol ARP message;

a target control node, configured to update an IP routing table according to the first ARP message, and send, by using the first routing protocol packet, the IP address routing information of the VM to be migrated after the update, and the IP of the VM to be migrated after the update The address routing information includes an IP address of the VM to be migrated and an IP address of the target control node;

The source control node is configured to update the IP routing table according to the IP address of the VM to be migrated and the IP address of the target control node in the first routing protocol packet, and send the to-be-migrated to the source server by using the second ARP message. The IP address or IP address and MAC address of the VM;

And a source server, configured to receive the second ARP message from the source control node. In the ARP protocol, a routing protocol is used in the interaction process between the sites, and the target control node and the source control node perform mutual triggering and conversion between the ARP message and the routing protocol message. Therefore, the ARP protocol packet is restricted to each site, and the ARP protocol is prevented from being sent to the DC interconnection network between the sites. Therefore, the broadcast storm caused by the broadcast of the ARP message in the DC Internet is avoided, thereby saving the broadcast. Control the bandwidth occupied by signaling. DRAWINGS In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the embodiments or the description of the prior art will be briefly described below. Obviously, the drawings in the following description are only It is a certain embodiment of the present invention, and other drawings can be obtained from those skilled in the art without any creative work.

1 is a flowchart of a virtual machine migration notification method according to Embodiment 1 of the present invention;

2 is a schematic structural diagram of a network according to Embodiment 2 of the present invention and Embodiment 3 of the present invention;

3 is a signaling flowchart of a virtual machine migration notification method according to Embodiment 2 of the present invention;

4 is a signaling flowchart of a virtual machine migration notification method according to Embodiment 3 of the present invention;

FIG. 5 is a schematic structural diagram of a virtual machine migration system according to Embodiment 4 of the present invention; FIG.

6 is a schematic structural diagram of a target control node 52 according to Embodiment 5 of the present invention;

FIG. 7 is a schematic structural diagram of a source control node 53 according to Embodiment 6 of the present invention. detailed description

The technical solutions in the embodiments of the present invention are clearly and completely described in the following with reference to the accompanying drawings in the embodiments of the present invention. It is a partial embodiment of the invention, and not all of the embodiments. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without creative efforts are within the scope of the present invention.

FIG. 1 is a flowchart of a virtual machine migration notification method according to Embodiment 1 of the present invention. As shown in Figure 1, the method includes the following process.

Step 101: The target server starts the VM to be migrated and sends a MAC address and an Internet Protocol (IP) address of the VM to be migrated to the target control node by using the first ARP message.

The target server refers to the server where the migrated VM is located. The target control node is the control node of the site where the migrated VM is located, and may be the Customer Edge (CE) router or the carrier edge (Provider Edge) of the site where the migrated VM is located. Edge, referred to as PE) router. In the first embodiment of the present invention and the subsequent embodiments, the ARP message may be a Gratuitous ARP (GARP).

Step 102: The target control node updates the IP routing table according to the first ARP message, and sends the updated IP address routing information of the VM to be migrated to the source control node by using the first routing protocol packet.

The source control node is the control node of the site where the VM before the migration is located, and may be the CE router or PE router of the site where the VM is located before the migration.

In this step, the IP address routing information of the VM to be migrated after the update includes the IP address of the VM to be migrated and the IP address of the target control node. In the first embodiment of the present invention and the following embodiments, the routing protocol packet refers to a packet that is sent by using a routing protocol. The routing protocol may be a Border Gateway Protocol (BGP) or an intermediate system. Internediate System to Intermediate System (IS-IS) protocol.

According to the ARP and the routing protocol, an ARP message can only contain the address of one VM, and a routing protocol message can include the addresses of multiple VMs. Therefore, when the target control node receives multiple first ARP messages, it can The address of the VM in the multiple first ARP messages is integrated into a first routing protocol message and sent to the source control node. Each site uses its own control node as the edge node for information interaction. The above scheme is adopted, and routing protocol packets are used between the sites to integrate ARP messages for multiple VMs in each site into one routing protocol packet. The routing protocol packets are used to transmit messages between sites. Compared with the transmission of each ARP message between sites, the use of routing protocol packets for centralized aggregation can greatly reduce the amount of message transmission between sites. .

Step 103: The source control node updates the IP routing table according to the IP address of the VM to be migrated and the IP address of the target control node in the first routing protocol packet, and sends the IP address of the VM to be migrated to the source server through the second ARP message, or A combination of an IP address and a MAC address.

The source server is the server where the VM before migration is located.

In the first embodiment of the present invention, in the VM migration control process, the ARP protocol is adopted in the interaction process in each site, and the ARP protocol is a data link layer protocol, and each site is used. The interaction process between the ARP message and the routing protocol message is triggered and converted by the target control node and the source control node. Therefore, the ARP protocol packet is restricted to each site, and the ARP protocol is avoided from being sent to the DC internet between sites. Because an ARP message can only be used for one address, and one routing protocol message can include multiple addresses. Therefore, by using a routing protocol message instead of an ARP message in the DC internet, the ARP message band is avoided in the DC internet. The incoming broadcast storm saves the bandwidth occupied by control signaling.

FIG. 2 is a schematic structural diagram of a network according to Embodiment 2 of the present invention and Embodiment 3 of the present invention. As shown in Figure 2, the network is a DC network that supports VM migration. The network includes three sites. The three sites are connected to one PE router through their respective CE routers, and the three PE routers are connected to form a DC internetwork. Specifically, the first station includes a first server, and a plurality of VMs, such as VM11 and VM12, are disposed on the first server, and the first station includes a first CE router, and the first CE router is connected to the first A PE router; taking the second station as the second server as an example, setting a plurality of VMs on the second server, such as VM21, etc., and the second station includes a second CE router, and the second CE router is connected to the second For example, the third station includes a third server, and the third server is configured with multiple VMs, such as VM31, and the third station includes a third CE router, and the third CE router is connected to the third PE. router. The first PE router, the second PE router, and the third PE router are connected to each other. In the following second embodiment of the present invention and the third embodiment of the present invention, the virtual machine migration notification method in the first embodiment of the present invention is applied to the network architecture shown in FIG. 2 as an example, and the first embodiment of the present invention is described in detail. Virtual machine migration notification method. In the second embodiment of the present invention and the third embodiment of the present invention, the migration of the VM 12 on the first server to the third server is taken as an example. The virtual machine to be migrated is VM12; the first server is the source server, and the first CE router is used. For the source CE router, the first PE router is the source PE router; the third server is the target server, the third CE router is the target CE router, and the third PE router is the target PE router. The source control node may be the first CE router, and correspondingly, the target control node is the third CE router. Alternatively, the source control node can be the first PE The router, correspondingly, the target control node is a third PE router. The above two cases are specifically described below by using the second embodiment of the present invention and the third embodiment of the present invention.

FIG. 3 is a signaling flowchart of a virtual machine migration notification method according to Embodiment 2 of the present invention. In the second embodiment of the present invention, the control node is a CE router, and an ARP proxy function is set on each CE router.

Taking the process of migrating from the first server in the first site to the third server in the third site as an example, the first site is the source site, the first server is the source server, and the first CE router is the source CE router; The third site is the target site, the third server is the target server, and the third CE router is the target CE router. As shown in FIG. 3, the method includes the following process.

Step 301: The first CE router acquires, by using an ARP message, a mapping relationship between a MAC address and an IP address of the VM12 of the first server from the first server.

In this step, each CE router obtains the mapping relationship between the MAC address and the IP address of the VM in the site corresponding to its own server through the ARP message. Specifically, the first server sends an ARP message to the first CE router, where the message includes a mapping relationship between the MAC address and the IP address of the VM in the first site; the first CE router receives the ARP message from the first server, according to the ARP The message acquires the mapping between the MAC address and the IP address of the VM in the first site, and the second CE router obtains the mapping between the MAC address and the IP address of the VM in the second site from the second server by using the ARP message, and the third CE router passes the ARP. The message acquires a mapping relationship between the MAC address and the IP address of the VM in the third site from the third server. In the second embodiment of the present invention, the process of migrating from the first server in the first site to the third server in the third site is taken as an example. Therefore, in this step, the first CE router passes the ARP message. The first server acquires a mapping relationship between a MAC address and an IP address of the VM in the first site. The mapping between the MAC address and the IP address of the VM in the first site, which is obtained by the first CE router, includes the mapping between the MAC address and the IP address of the VM12, as the VM12 is located in the first site.

In this step, after obtaining the mapping relationship between the MAC address and the IP address of the VM in the corresponding site, each CE router also according to the MAC address of the VM in the corresponding site. A mapping relationship between IP addresses, which stores a mapping table of MAC addresses and IP addresses. The first CE router is still taken as an example. Table 1 is a mapping table of MAC addresses and IP addresses of the first CE router. In Table 1 and the following tables of the various embodiments of the present invention, @ represents the specific content of the address. After the first CE router obtains the mapping relationship between the MAC address and the IP address of the VM in the first site from the first server by using the ARP message, the foregoing mapping relationship is stored in Table 1. The mapping relationship between the MAC address and the IP address of the VM 12 of the first server is included in Table 1. Table 1 Mapping table of MAC address and IP address of the first CE router

Step 302: The first CE router sends the IP address routing information of the VM12 of the first server to the third CE router through the routing protocol message.

In this step, each CE router sends the IP address routing information of the VM of its corresponding site to other CE routers through routing protocol packets. Specifically, the first CE router sends the IP address routing information of the VM of the first site to the second CE router and the third CE router by using the routing protocol packet, and the second CE router sends the routing protocol packet to the first CE router and the first The third CE router sends the IP address routing information of the VM of the second site, and the third CE router sends the IP address routing information of the VM of the third site to the first CE router and the second CE router by using the routing protocol packet. In the second embodiment of the present invention, only the process of migrating from the first server in the first site to the third server in the third site is taken as an example. Therefore, in this step, only the first CE router passes the route. The protocol packet sends the IP address routing information of the VM of the first site to the third CE router as an example. The specific process of the other CE routers sending the IP address routing information of the VMs of the corresponding sites may refer to the first CE router sending the IP address routing information of the VMs of the first site. The implementation is not repeated here.

Specifically, the specific process of the first CE router sending the IP address routing information of the VM of the first site to the third CE router by using the routing protocol packet includes: First, the first CE router sets the IP address of the VM in the first site and the first The IP address of a CE router constitutes the IP address routing information of the first site. In the second embodiment of the present invention, the pre-migration VM 12 is located in the first server in the first site and belongs to the VM in the first site. Therefore, the IP address routing information of the VM of the first site where the first CE router is located is , including the IP address routing information of the VM12 of the first server. Specifically, the IP address routing information of the VM12 of the first server includes an IP address of the VM12 of the first server and an IP address of the first CE router. Then, the first CE router sends the IP address routing information of the VM of the first station to the third CE router through the routing protocol message. The first CE router sends the IP address routing information of the VM12 of the first server in the first station to the third CE router by sending the IP address routing information of the VM of the first site.

In this step, after each CE router sends the IP address routing information of the VM of its corresponding site to other CE routers through routing protocol packets, the other CE routers store their own information according to the IP address routing information of the obtained VMs of the site. IP routing table, and update the mapping table of its stored MAC address and IP address. See Table 2 to Table 5, where: Table 2 is the IP routing table of the third CE router; Table 3 is the IP routing table of the second CE router; Table 4 is the IP routing table of the first CE router; Table 5 is the second Mapping table of MAC addresses and IP addresses of CE routers.

IP routing table of the third CE router

IP routing table of the second CE router

CE router IP routing table

Mapping table of MAC address and IP address of the second CE router

Step 303: The third server sends the MAC address and the IP address of the VM12 of the third server to the node between the third server and the third CE router through the ARP message. In this step, the node between the third server and the third CE router may include a switch, a hub, a router, and the like. When the first server is overloaded or fails, the VM 12 in the first server needs to be migrated to the third server. In this case, the migration process of VM12 can be manually triggered by the network administrator, or the migration process of VM12 can be triggered by the first server. The VM12 migration process specifically includes the following steps: First, the third server starts a VM whose MAC address and IP address are the same as the MAC address and IP address of the VM12 of the first server. In the second embodiment of the present invention, the VM started by the third server will eventually replace the VM 12 of the first server, which is also referred to as VM12. The MAC address and IP address of the VM 12 of the third server are the same as the MAC address and IP address of the VM 12 of the first server, respectively. Then, the third server sends an ARP message to the node between the third server and the third CE router, where the ARP message carries the MAC address and IP address of the VM 12 of the third server.

Step 304: The node between the third server and the third CE router learns the MAC address of the VM 12 of the third server and updates the MAC address forwarding table.

In this step, the ARP message sent by the third server in the foregoing step 303 is broadcasted in the third station, and all nodes in the third station, that is, all nodes between the third server and the third CE router, will learn. The MAC address of the VM 12 to the third server, and the respective MAC address forwarding table is updated according to the MAC address.

Step 305: The third CE router acquires the MAC address and the IP address of the VM 12 of the third server from the node between the third server and the third CE router through the ARP message.

In this step, the node between the third server and the third CE router forwards the ARP message to the third CE router, so that the MAC address and the IP address of the VM12 carrying the third server sent by the third server in step 303 are obtained. The ARP message is received by the third CE router.

Step 306: The third CE router updates the IP routing table and obtains the next hop address corresponding to the IP address of the VM12 of the third server.

In this step, the third CE router updates the IP routing table stored in the third CE router according to the obtained IP address and MAC address of the VM12 of the third server. And, the third CE in step 305 The ARP message obtained by the router triggers the third CE router to check the IP routing table, and obtains the next hop address corresponding to the IP address of the VM 12 of the third server. In the second embodiment of the present invention, the next hop address corresponding to the IP address of the VM 12 of the third server is the IP address of the first CE router.

Step 307: The third CE router sends the updated IP address routing information of the VM12 of the third server to the first CE router and the second CE router by using the routing protocol packet.

In this step, first, as the third CE router, the IP address of the VM12 of the third server and the IP address of the third CE router constitute the updated IP address routing information of the VM 12 of the third server. And, the third CE router updates the IP routing table stored by itself according to the IP address routing information of the VM12 of the updated third server. See Table 6, Table 6 for the updated IP routing table of the third CE router. Then, the third CE router initiates a routing protocol packet by using the action of obtaining the ARP message in step 305, and sends the updated IP address routing information of the VM 12 of the third server to the other CE router through the routing protocol packet. The node, for example, is sent to the first CE router and the second CE router. Specifically, the foregoing routing protocol may adopt BGP or IS-IS protocol. Updated IP routing table of the third CE router

Step 308: The first CE router updates the IP routing table.

In this step, after receiving the routing protocol packet in step 307, the first CE router queries the IP routing table stored by the first CE router according to the IP address of the VM12 of the third server. Since the IP address of the VM12 of the third server is the same as the IP address of the VM12 of the first server, after inquiry, The first CE router finds that the IP address routing information of the VM 12 of the first server consisting of the IP address of the VM 12 and the IP address of the first CE router already exists in the table. The IP routing table stored by the first CE router is queried according to the IP address routing information of the VM12 of the third server. The first CE router learns that the VM12 is migrated from the local first site to another station, and the first CE router follows the route of step 307. The IP address routing information of the VM12 of the updated third server carried in the protocol packet updates the IP routing table, and the IP address of the VM12 and the next hop address in the table constitute a new IP address routing information. In the second embodiment of the present invention, the next hop address of the VM 12 is the IP address of the third CE router. See Table 7, Table 7 is the IP routing table of the updated second CE router. IP routing table of the second CE router

In addition, in step 308, the first CE router learns that the VM 12 is migrated from the local first site to another station according to the routing protocol message, and then proceeds to step 309, where the first CE router triggers according to the routing protocol packet. ARP message.

Step 309: The first CE router sends the IP address of the VM 12 or the IP address and MAC address of the VM 12 to the node between the first server and the first CE router through the ARP message.

In this step, the specific implementation manner is as follows: The first CE router triggers an ARP message, where the ARP message carries the IP address of the VM12. The first CE router broadcasts the triggered ARP message to the first station, and is used to notify the node in the first station to release related resources of the VM 12 belonging to the first server, for example, computing resources or storage resources, and the like. Broadcast the ARP in the first site The message, the node between the first server and the first CE router will receive the ARP message. In the above process, the first CE router may first query the mapping table of the MAC address and the IP address stored by the first CE router according to the IP address of the VM 12, and obtain the MAC address of the VM 12. Then, the first CE router triggers an ARP message, where the ARP message carries the IP address and MAC address of the VM12. The ARP message can also be used to update the MAC address forwarding table of each node in the first site. The ARP message is broadcast in the first station, and the node between the first server and the first CE router receives the ARP message.

In this step, in the case of adopting any one of the foregoing two implementation manners, the ARP message used in the foregoing manner may be extended by using an operation code (OP Code) of the existing ARP message. to realise. The specific extension method is: assigning a set value to the OP code of the ARP message, and indicating the related resources of the VM belonging to the first server and having the same address as the IP address carried by the ARP message. Among them, related resources can include computing resources or storage resources, and so on.

Step 310: The node between the first server and the first CE router learns the MAC address of the VM 12 and updates the MAC address forwarding table.

In this step, the node between the first server and the first CE router receives the ARP message in step 309. Specifically, the ARP message in step 309 is carried in an Ethernet (Ethernet, hereinafter referred to as ETH) frame and transmitted to a node between the first server and the first CE router, where the ETH frame includes the MAC address of the VM 12, and the first server The node with the first CE router relearns the MAC address of the VM 12 and updates the respective MAC address forwarding table according to the learned MAC address of the VM 12.

Step 31: The first server receives the ARP message forwarded by the node between the first server and the first CE router, obtains the IP address of the VM12, or obtains the IP address and MAC address of the VM12.

Step 312: The first server releases related resources of the VM 12 of the first server. In this step, after receiving the ARP message triggered by the first CE router in step 309, the first server releases the related resources of the VM 12 belonging to the first server. The related resources may include computing resources or storage resources, and the like.

After step 307, the following step 313 can also be performed. The steps 308 to 312 are performed in the above sequence, and the step 313 can be performed before, after or simultaneously with the step 308 to the step 312.

Step 313: The second CE router updates the IP routing table.

In this step, after receiving the routing protocol packet in step 307, the second CE router queries the IP routing table stored by the second CE router according to the IP address of the VM12 of the third server. Since the IP address of the VM12 of the third server is the same as the IP address of the VM12 of the first server, after querying, the second CE router finds that the IP address of the VM12 and the IP address of the first CE router already exist in the table. The IP address routing information of a server's VM12. According to the above query result, since the IP address of the VM 12 does not correspond to the local address of the second CE router, that is, the IP address of the second CE router is not corresponding, the second CE router learns that the VM 12 is not migrated from the local second site. . Therefore, the second CE router updates the IP routing table only according to the IP address routing information of the updated VM12 of the third server carried in the routing protocol message in step 307, and the IP address of the VM12 in the table is compared with the third CE router. The IP address constitutes a new IP address routing information. See Table 8, Table 8 for the updated IP routing table of the first CE router.

Moreover, in step 313, since the second CE router learns that the VM 12 is not migrated from the local second site, after step 313, the second CE router does not trigger the IP address carrying the VM 12 or the IP address carrying the VM 12. ARP message with MAC address.

In the specific process of the second embodiment of the present invention, if there is no node between the first server and the first control node and a node between the third server and the third control node, steps 303 and 304 may be omitted. The third server sends the MAC address and IP address of the VM12 of the third server directly to the third CE router through the ARP message. IP routing table of the CE router

Using the VM migration method described above, the VM 12 is migrated from the first server in the first site to the third server in the third site. Take the VM 21 in the second server of the second site as an example of communication with the VM 12.

Before VM12 migration, VM12 is located in the first server in the first site, and the communication process between VM21 and VM12 is as follows.

Step 3a: The second CE router acquires an IP packet from the VM21.

In this step, first, the VM 21 sends an ARP message carrying the IP address of the VM 12 to the second CE router, and requests the MAC address of the VM 12 from the second CE router through the message. Then, the second CE router acts as an ARP proxy, and queries the mapping table of the MAC address and IP address of the second CE router itself, as shown in Table 5. According to the mapping table of the MAC address and the IP address of the second CE router, the second CE router replies the MAC address of the second CE router to the VM 21 as the MAC address of the VM 12. Then, the VM 21 sends an IP packet to the second CE router, and the destination IP address of the IP packet is the IP address of the VM 12. Specifically, the IP packet is sent to the second CE router, and the destination MAC address of the ETH packet is the MAC address of the second CE router.

Step 3b: The second CE router encapsulates the IP packet into an IP tunnel to the first CE router.

In this step, the second CE router receives the IP packet in step 3a, and the purpose of the IP packet is The IP address is the IP address of VM12. The second CE router queries the IP routing table of the second CE router itself, as shown in Table 3. According to the IP address of the VM12, the query obtains the next hop as the first CE router. Then, the second CE router encapsulates the IP packet into an IP tunnel to the first CE router. Specifically, the destination address of the IP tunnel is an IP address of the first CE router, and the source address is an IP address of the second CE router.

Step 3c: The first CE router obtains an IP packet carried in the IP tunnel.

In this step, the first CE router receives the encapsulated packet from the second CE router, removes the IP tunnel encapsulation, and obtains an IP packet. The destination IP address of the obtained IP packet is the IP address of the VM12.

Step 3d: The first CE router sends an IP packet to the VM12 in the first server.

In this step, the first CE router queries the IP routing table of the first CE router according to the IP address of the obtained IP packet, and refers to Table 4. When the first CE router queries that the next hop is local, the first CE router sends the IP packet in the first station, and the destination IP address of the IP packet is the IP address of the VM12. The VM 12 located in the first server in the first site receives the IP packet.

The above steps 3a to 3d are the data transfer process before the VM12 migration, and are executed before the above step 307. After the above steps 307 to 309 are performed, the VM 12 is migrated. After VM12 migration, VM12 is located in the third server in the third site, and the communication process between VM21 and VM12 is as follows.

After the VM12 is migrated, the data transmission process of the first CE router includes the following steps 3e to 3h.

Step 3e: The first CE router obtains an IP packet that is carried in the IP tunnel.

In this step, after the first CE router receives the routing protocol packet of step 307, if the first CE router also receives the IP tunnel carried by the IP address of the first CE router and the destination IP address is VM12. For IP packets with IP addresses, follow the steps below.

Step 3f: The first CE router encapsulates the IP packet into the IP tunnel to the third CE router. Road.

In this step, the first CE router queries the IP routing table of the first CE router according to the IP address of the VM12. Referring to Table 8, the next hop address corresponding to the IP address of the VM12 is the IP address of the third CE router. Then, the first CE router encapsulates the IP packet whose destination IP address is the IP address of the VM12 into the IP tunnel to the third CE router. The destination address of the IP tunnel is the IP address of the third CE router, and the source address is the The IP address of a CE router. After the second CE router receives the routing protocol packet later than the first CE router, by performing this step, it can ensure that after the VM 12 is migrated, the data transmission process does not drop packets, and the data transmission is ensured correctly.

Step 3g: The third CE router obtains the IP packet carried in the IP tunnel.

In this step, the third CE router receives the encapsulated packet from the first CE router, removes the IP tunnel encapsulation, and obtains an IP packet. The destination IP address of the obtained IP packet is the IP address of the VM12.

Step 3h: The third CE router sends an IP packet to the VM12 in the third server.

In this step, the third CE router queries the IP routing table of the third CE router according to the IP address of the obtained IP packet, and refers to Table 6. The third CE router queries that the next hop is local, and the third CE router sends the IP packet in the third station, and the destination IP address of the IP packet is the IP address of the VM12. The VM 12 in the third server located in the third site receives the IP packet.

After the VM12 is migrated, the data transmission process of the second CE router includes the following steps 3i to 3k. Steps 3i through 3k can be performed before, after or simultaneously with steps 3e through 3h.

Step 3i: The second CE router encapsulates the IP packet into an IP tunnel to the third CE router. In this step, after the second CE router receives the routing protocol packet of step 307, if the second CE router receives the IP packet from the IP address of the VM12 whose destination IP address is the VM12, the second CE router The IP routing table of the second CE router itself is queried according to the IP address of the VM12, as shown in Table 7. According to the IP address of VM12, the query obtains the IP address corresponding to VM12. The next hop address is the IP address of the third CE router. Then, the first CE router encapsulates the IP packet whose IP address is the IP address of the VM12 into the IP tunnel to the third CE router. The destination address of the IP tunnel is the IP address of the third CE router, and the source address is The IP address of the first CE router. With this step, the second CE router directly forwards the IP packet to be sent to the VM 12 to the third CE router.

Step 3j: The third CE router obtains the IP packet carried in the IP tunnel.

In this step, the third CE router receives the encapsulated packet from the second CE router, removes the IP tunnel encapsulation, and obtains an IP packet. The destination IP address of the obtained IP packet is the IP address of the VM12.

Step 3k: The third CE router sends an IP packet to the VM12 in the third server.

This step is the same as step 3h above, and is not described here.

In the second embodiment of the present invention, in the VM migration control process, the interaction process in the site adopts the ARP protocol, and the interaction process between the sites adopts a routing protocol. Therefore, when each CE router interacts with other nodes in the site where the CE router is located, the ARP protocol is adopted; when the first CE router that is the source CE router interacts with the third CE router that is the target CE router, the route is adopted. Protocol: The first CE router and the third CE router complete mutual triggering and conversion between the ARP message and the routing protocol message. Therefore, the ARP protocol packet is restricted to each site, and the ARP protocol is prevented from being sent to the DC internet. Because an ARP message can only be used for one address, and a routing protocol message can include multiple addresses. Therefore, by using a routing protocol message instead of an ARP message in the DC Internet, it is avoided to broadcast an ARP message band in the DC internet. The incoming broadcast storm saves the bandwidth occupied by control signaling.

FIG. 4 is a signaling flowchart of a virtual machine migration notification method according to Embodiment 3 of the present invention. In the third embodiment of the present invention, the ARP proxy function is set on each PE router by taking the control node as a PE router as an example. In the third embodiment of the present invention, the process of migrating from the first server in the first site to the third server in the third site is taken as an example, the first site is a source site, and the first server is a source server, One PE router is the source PE router; the third site is the target site, the third service The server is the target server, and the third PE router is the target PE router. For example, a VPN is formed by a multi-protocol label switching (MPLS) technology between PE routers. As shown in FIG. 4, the method includes the following process.

Step 401: The first PE router obtains a mapping relationship between the MAC address and the IP address of the VM12 of the first server from the first server by using an ARP message.

In this step, each PE router obtains the mapping relationship between the MAC address and the IP address of the VM in the corresponding site through the ARP message from its own server. Specifically, the first server sends an ARP message to the first CE router, where the message includes a mapping relationship between the MAC address and the IP address of the VM in the first site; the first CE router forwards the ARP message to the first PE router; The PE router receives the foregoing ARP message from the first CE router, and obtains a mapping relationship between the MAC address and the IP address of the VM in the first site according to the ARP message, and the second PE router acquires the VM in the second site from the second server by using the ARP message. The mapping between the MAC address and the IP address is obtained by the third PE router from the third server by using the ARP message to obtain the mapping relationship between the MAC address and the IP address of the VM in the third site. In the third embodiment of the present invention, the process of migrating from the first server in the first site to the third server in the third site is taken as an example. Therefore, in this step, the first PE router passes the ARP message. The first server acquires a mapping relationship between a MAC address and an IP address of the VM in the first site. The mapping between the MAC address and the IP address of the VM in the first site obtained by the first PE router includes the mapping between the MAC address and the IP address of the VM12.

In this step, after obtaining the mapping relationship between the MAC address and the IP address of the VM in the corresponding site, each PE router also stores the MAC address and the IP address in the corresponding site according to the mapping relationship between the MAC address and the IP address of the VM in the corresponding site. A mapping table of MAC addresses and IP addresses. Taking the first PE router as an example, Table 9 is a mapping table of the MAC address and IP address of the first PE router. After the first PE router acquires the mapping relationship between the MAC address and the IP address of the VM in the first site from the first server by using the ARP message, the foregoing mapping relationship is stored in Table 9. The mapping relationship between the MAC address and the IP address of the VM 12 of the first server is included in Table 9. Mapping table of MAC address and IP address of PE router

Step 402: The first PE router sends the IP address routing information of the VM12 of the first server to the third PE router by using the routing protocol packet.

In this step, each PE router sends the IP address routing information of the VM of its own site to other PE routers through routing protocol packets. Specifically, the first PE router sends the IP address routing information of the VM of the first site to the second PE router and the third PE router by using the routing protocol packet, and the second PE router sends the routing protocol packet to the first PE router and the first The third PE router sends the IP address routing information of the VM of the second site, and the third PE router sends the IP address routing information of the VM of the third site to the first PE router and the second PE router by using the routing protocol packet. In the third embodiment of the present invention, only the process of migrating from the first server in the first site to the third server in the third site is taken as an example. Therefore, in this step, only the first PE router passes the route. The protocol packet sends the IP address routing information of the VM of the first site to the third PE router as an example. The process of sending the IP address routing information of the VMs of the corresponding PEs of the other PEs may be implemented by referring to the process of sending the IP address routing information of the VMs of the first site by the first PE router, and details are not described herein.

Specifically, the specific process of the first PE router sending the IP address routing information of the VM of the first site to the third PE router by using the routing protocol packet includes: First, the first PE router sets the IP address of the VM in the first site and the first The IP address of a PE router constitutes the IP address routing information of the first site. In the third embodiment of the present invention, the VM 12 before the migration is located in the first server in the first site and belongs to the VM in the first site. Therefore, the IP address routing information of the VM of the first site formed by the first PE router is The information includes the IP address routing information of the VM12 of the first server. Specifically, the IP address routing information of the VM 12 of the first server includes an IP address of the VM 12 of the first server and an IP address of the first PE router. Then, the first PE router sends the IP address routing information of the VM of the first site to the third PE router through the routing protocol message. The first PE router sends the IP address routing information of the VM 12 of the first server in the first site to the third PE router by sending the IP address routing information of the VM of the first site.

In this step, after each PE router sends the IP address routing information of the VM of its corresponding site to other PE routers through routing protocol packets, the other PE routers store their own information according to the IP address routing information of the obtained VMs of the site. IP routing table, and update the mapping table of its stored MAC address and IP address. See Table 10 to Table 13, where: Table 10 is the IP routing table of the third PE router; Table 11 is the IP routing table of the second PE router; Table 12 is the IP routing table of the first PE router; Table 13 is the second Mapping table of MAC addresses and IP addresses of PE routers. In each of the above tables, "X" indicates a hexadecimal number; "-" indicates a default.

Specifically, in the embodiment of the present invention, the foregoing routing protocol may adopt a BGP protocol. The network between PE routers is the PSN. If the Packet Switching Network (PSN) is an MPLS network, the routing protocol may use a Multiprotocol (MP) BGP protocol to carry a Pseudowire (PW) label. IP routing table of the third PE router

IP routing table of the second PE router

Table 13 Mapping table of MAC addresses and IP addresses of the second PE router

Step 403: The third server sends the MAC address and the IP address of the VM12 of the third server to the node between the third server and the third PE router through the ARP message. In this step, when the first server is overloaded or fails, the VM 12 in the first server needs to be migrated to the third server. First, the third server starts a VM whose MAC address and IP address are the same as the MAC address and IP address of the VM12 of the first server. In the third embodiment of the present invention, the VM started by the third server will eventually replace the VM 12 of the first server, which is also referred to as VM12. The MAC address and IP address of the VM 12 of the third server are the same as the MAC address and IP address of the VM 12 of the first server, respectively. Then, the third server sends an ARP message to the node between the third server and the third PE router, where the ARP message carries the MAC address and IP address of the VM 12 of the third server.

Step 404: The node between the third server and the third PE router learns the MAC address of the VM 12 of the third server and updates the MAC address forwarding table.

In this step, the ARP message sent by the third server in the foregoing step 403 is broadcasted in the third station, and all nodes in the third station, that is, all nodes between the third server and the third PE router, will learn. The MAC address of the VM 12 to the third server, and the respective MAC address forwarding table is updated according to the MAC address.

Step 405: The third PE router acquires the MAC address and the IP address of the VM 12 of the third server from the node between the third server and the third PE router through the ARP message.

In this step, the ARP message of the MAC address and IP address of the VM12 carrying the third server sent by the third server in step 403 is received by the third PE router.

Step 406: The third PE router updates the IP routing table and obtains the next hop address corresponding to the IP address of the VM12 of the third server.

In this step, the third PE router updates the IP routing table stored in the third PE router according to the obtained IP address and MAC address of the VM12 of the third server. Moreover, the ARP message obtained by the third PE router in step 405 triggers the third PE router to check the IP routing table, and obtains the next hop address corresponding to the IP address of the VM12 of the third server. In the third embodiment of the present invention, the next hop address corresponding to the IP address of the VM12 of the third server is the IP address of the first PE router. Step 407: The third PE router sends the updated IP address routing information of the VM12 of the third server to the first PE router and the second PE router by using the routing protocol packet.

In this step, first, the third PE router combines the IP address of the VM12 of the third server with the IP address of the third PE router to form the IP address routing information of the VM12 of the updated third server. Moreover, the third PE router updates the IP routing table stored by itself according to the IP address routing information of the VM12 of the updated third server. See Table 14, Table 14 for the updated IP routing table of the third PE router. Then, the third PE router initiates a routing protocol packet by using the action of obtaining the ARP message in step 405, and sends the updated IP address routing information of the VM 12 of the third server to other PE routers through the routing protocol packet. The node, for example, is sent to the first PE router and the second PE router. Specifically, the foregoing routing protocol may adopt a BGP protocol. The routing protocol packet may also carry a set PW label, where the set PW label is used to indicate that the routing protocol packet is sent by the PE router other than the third PE router to the third PE router. For example, the set PW tag can be: x54321. Updated IP routing table of the third PE router

Step 408: The first PE router updates the IP routing table.

In this step, after receiving the routing protocol packet in step 407, the first PE router queries the IP routing table stored by the first PE router according to the IP address of the VM12 of the third server. Since the IP address of the VM12 of the third server is the same as the IP address of the VM12 of the first server, after inquiry, The first PE router finds that the IP address routing information of the VM 12 of the first server consisting of the IP address of the VM 12 and the IP address of the first PE router already exists in the table. Querying the IP routing table stored by the first PE router according to the IP address routing information of the VM12 of the third server, the first PE router learns that the VM12 is migrated from the local first site to another station, and the first PE router according to the route of step 407 The IP address routing information of the VM12 of the updated third server carried in the protocol packet updates the IP routing table, and the IP address of the VM12 in the table and the IP address of the third PE router form a new IP address routing information. Referring to Table 15, Table 15 is an updated IP routing table of the second PE router. The PW label of the VM12 is bound to the PW label set in the step 407 by the routing protocol packet in the step 407. The PW label bound to the IP address of the VM12 is x54321.

IP routing table of the second PE router

In addition, in step 408, the first PE router learns that the VM 12 is migrated from the local first site to another station according to the routing protocol message, and then proceeds to step 409, where the first PE router triggers according to the routing protocol packet. ARP message.

Step 409: The first PE router sends an IP address of the VM 12 or an IP address and a MAC address of the VM 12 to the node between the first server and the first PE router through an ARP message.

In this step, the specific implementation manner is as follows: The first PE router triggers an ARP message, where the ARP message carries the IP address of the VM12. The first PE router broadcasts the triggered ARP message to the first station, to notify the node in the first station to release the first server. VM12 related resources, such as computing resources or storage resources. When the ARP message is broadcast in the first station, the node between the first server and the first PE router receives the ARP message. In the above process, the first PE router may first query the mapping table of the MAC address and the IP address stored by the first PE router according to the IP address of the VM 12, and obtain the MAC address of the VM 12. Then, the first PE router triggers an ARP message, where the ARP message carries the IP address and MAC address of the VM 12. The ARP message can also be used to update the MAC address forwarding table of each node in the first site. When the ARP message is broadcast in the first station, the node between the first server and the first PE router receives the ARP message.

In this step, in the case of adopting any one of the foregoing two implementation manners, the ARP message used in the foregoing manner may be implemented by expanding an OP of an existing ARP message. The specific extension method is: assigning a set value to the OP of the ARP message, and indicating the related resources of the VM belonging to the first server and having the same address as the IP address carried by the ARP message. The related resources may include computing resources or storage resources, and the like.

Step 410: The node between the first server and the first PE router learns the MAC address of the VM 12 and updates the MAC address forwarding table.

In this step, all nodes in the first station relearn the MAC address of the VM12, and update the respective MAC address forwarding table according to the MAC address of the learned VM12.

Step 411: The first server receives an ARP message forwarded by a node between the first server and the first PE router, obtains an IP address of the VM12, or obtains an IP address and a MAC address of the VM12.

Step 412: The first server releases related resources of the VM12 of the first server.

In this step, after receiving the ARP message triggered by the first PE router in step 409, the first server releases the related resources of the VM12 belonging to the first server. The related resources may include computing resources or storage resources, and the like.

After step 407, the following step 413 can also be performed. Steps 408 to 412 are performed in the above order, and step 413 can be performed before, after or simultaneously from step 408 to step 412. Step 413: The second PE router updates the IP routing table.

In this step, after receiving the routing protocol packet in step 407, the second PE router queries the IP routing table stored by the second PE router according to the IP address of the VM12 of the third server. Since the IP address of the VM12 of the third server is the same as the IP address of the VM12 of the first server, after querying, the second PE router finds that the IP address of the VM12 and the IP address of the first PE router already exist in the table. The IP address routing information of a server's VM12. According to the above query result, since the IP address of the VM 12 does not correspond to the local address of the second PE router, that is, the IP address of the second PE router is not corresponding, the second PE router learns that the VM 12 is not migrated from the local second site. . Therefore, the second PE router only updates the IP routing table according to the IP address routing information of the updated VM12 of the third server carried in the routing protocol message in step 407, and the IP address of the VM12 in the table is related to the third PE router. The IP address constitutes a new IP address routing information. See Table 16. Table 16 shows the IP routing table of the updated first PE router. The IP address of the VM 12 is bound to the PW label set in step 407 by the second PE router by the routing protocol packet in step 407. For example, the PW label bound to the IP address of the VM 12 is X54321.

Moreover, in step 413, since the second PE router learns that the VM 12 is not migrated from the local second site, after the step 413, the second PE router does not trigger the IP address carrying the VM12 or the IP address carrying the VM12. ARP message with MAC address.

PE router IP routing table

In the foregoing specific process of the third embodiment of the present invention, if there is no node between the first server and the first control node and a node between the third server and the third control node, steps 403 and 404 may be omitted, by The third server sends the MAC address and IP address of the VM12 of the third server directly to the third PE router through the ARP message.

Using the VM migration method described above, the VM 12 is migrated from the first server in the first site to the third server in the third site. Take the VM21 in the second server of the second site and the VM12 as an example.

Step 4a: The second PE router obtains an IP packet from the VM21.

In this step, first, the VM 21 sends an ARP message carrying the IP address of the VM 12 to the second PE router, and requests the MAC address of the VM 12 from the second PE router through the message. Then, the second PE router acts as an ARP proxy, and queries the mapping table of the MAC address and IP address of the second PE router itself, as shown in Table 13. According to the mapping table of the MAC address and the IP address of the second PE router, the second PE router replies the MAC address of the second PE router to the VM 21 as the MAC address of the VM 12. Then, the VM 21 sends an IP packet to the second PE router, and the destination IP address of the IP packet is the IP address of the VM 12. Specifically, the IP packet is sent to the second PE router, and the destination MAC address of the ETH packet is the MAC address of the second PE router.

Step 4b: The second PE router encapsulates the IP packet into the MPLS tunnel to the first PE router.

In this step, the second PE router receives the IP packet in step 4a, and the destination IP address of the IP packet is the IP address of the VM 12. The second PE router queries the IP routing table of the second PE router itself, as shown in Table 11. According to the IP address of the VM12, the query obtains the next hop as the first PE router. Then, the second PE router adds the IP packet to the PW header and encapsulates the MPLS tunnel to the first PE router. Specifically, the destination address of the MPLS tunnel is the IP address of the first PE router. Address, the source address is the IP address of the second PE router.

Step 4c: The first PE router obtains an IP packet that is carried in the MPLS tunnel.

In this step, the first PE router receives the encapsulated packet from the second PE router, removes the MPLS tunnel encapsulation, and obtains an IP packet. The destination IP address of the obtained IP packet is the IP address of the VM12.

Step 4d: The first PE router sends an IP packet to the VM12 in the first server.

In this step, the first PE router queries the IP routing table of the first PE router according to the IP address of the obtained IP packet, and refers to Table 12. The first PE router sends the IP packet in the first site, and the destination IP address of the IP packet is the IP address of the VM12. The VM 12 located in the first server in the first site receives the IP packet.

The above steps 4a to 4d are the data transfer process before the VM12 migration, in the above steps.

Executed before 407. After the above steps 407 to 409 are performed, the VM 12 is migrated. After VM12 migration, VM12 is located in the third server in the third site, and the communication process between VM21 and VM12 is as follows.

After the VM12 is migrated, the data transmission process of the first PE router includes the following steps 4e to 4h.

Step 4e: The first PE router obtains an IP packet that is carried in the MPLS tunnel.

In this step, after the first PE router receives the routing protocol packet of step 407, if the first PE router also receives the MPLS tunnel carried by the IP address of the first PE router and the destination IP address is VM12. For IP packets with IP addresses, follow the steps below.

Step 4f: The first PE router encapsulates the IP packet into the MPLS tunnel to the third PE router.

In this step, the first PE router queries the IP routing table of the first PE router according to the IP address of the VM12. Referring to Table 16, the next hop address corresponding to the IP address of the VM12 is obtained as the IP address of the third PE router. And the query gets the set PW label, ie x54321. Then, the first PE router adds the PW header with the same IP address as the IP address of the VM12 whose destination IP address is the IP address of the VM12, and then encapsulates the MPLS tunnel to the third PE router. The purpose of the MPLS tunnel is The address is the IP address of the third PE router, and the source address is the IP address of the first PE router. After the second PE router receives the routing protocol packet later than the first PE router, by performing this step, it can be ensured that after the VM 12 is migrated, the data transmission process does not drop packets, and the data transmission is correct.

Step 4g: The third PE router obtains the IP packet carried in the MPLS tunnel.

In this step, the third PE router receives the encapsulated packet from the first PE router, removes the MPLS tunnel encapsulation, and obtains an IP packet. The destination IP address of the obtained IP packet is the IP address of the VM12.

Step 4h: The third PE router sends an IP packet to the VM12 in the third server.

In this step, the third PE router queries the IP routing table of the third PE router according to the IP address of the obtained IP packet, and refers to Table 14. The third PE router queries the next hop to be local, and the third PE router sends the IP packet in the third station, and the destination IP address of the IP packet is the IP address of the VM12. The VM 12 in the third server located in the third site receives the IP packet.

After the VM12 is migrated, the data transmission process of the second PE router includes the following steps 4i to 4k. Steps 4i through 4k can be performed before, after or simultaneously with steps 4e through 4h.

Step 4i: The second PE router encapsulates the IP packet into the MPLS tunnel to the third PE router.

In this step, after the second PE router receives the routing protocol packet of step 407, if the second PE router receives the IP packet from the IP address of the VM12 whose destination IP address is the VM12, the second PE router The IP routing table of the second PE router itself is queried according to the IP address of the VM12, as shown in Table 15. According to the IP address of the VM12, the query obtains the next hop address corresponding to the IP address of the VM12 as the IP address of the third PE router, and queries the obtained PW label, that is, x54321. . Then, the first PE router sets the destination IP address to the IP address of the VM12. After the IP packet is added to the PW header of the PW label, the MPLS tunnel is encapsulated in the MPLS tunnel to the third PE router. The destination address of the MPLS tunnel is the IP address of the third PE router, and the source address is the first PE. The IP address of the router. With this step, the second PE router directly forwards the IP packet to be sent to the VM 12 to the third PE router.

Step 4j: The third PE router obtains an IP packet that is carried in the MPLS tunnel.

In this step, the third PE router receives the encapsulated packet from the second PE router, removes the MPLS tunnel encapsulation, and obtains an IP packet. The destination IP address of the obtained IP packet is the IP address of the VM12.

Step 4k: The third PE router sends an IP packet to the VM12 in the third server.

This step is the same as step 4h above, and details are not described herein again.

In the above technical solution of the embodiment of the present invention, an MPLS-based DC interconnection network is taken as an example, wherein each PE router node carries an Ethernet frame to an MPLS tunnel of the DC interconnection network for transmission, as shown in step 407. A more optimized technical solution is that the IP packets of the PEs are directly carried on the IP tunnel of the DC internet. The optimized technical solution can further reduce the number of MAC entries.

In the third embodiment of the present invention, in the VM migration control process, the ARP proxy function is set on the PE router, thereby reducing the number of MAC entries of the site egress node and the switch inside the site. Moreover, the interaction process in the site adopts the ARP protocol, and the interaction process between the sites adopts a routing protocol. Therefore, when each PE router interacts with other nodes in the site where the PE router is located, the ARP protocol is adopted; when the first PE router that is the source PE router interacts with the third PE router that is the target PE router, the route is adopted. Protocol: The first PE router and the third PE router complete the mutual triggering and conversion between the ARP message and the routing protocol message. Therefore, the ARP protocol packet is restricted to each site, and the ARP protocol is prevented from being sent to the DC internet. Because an ARP message can only be used for one address, and one routing protocol message can include multiple addresses. Therefore, by using a routing protocol message instead of an ARP message in the DC internet, the ARP message band is avoided in the DC internet. Broadcast storms, saving control letters Let the occupied bandwidth.

On the basis of the foregoing technical solutions of the second embodiment of the present invention and the third embodiment of the present invention, specifically, the PE routers in the foregoing two embodiments may be disposed on a server, and the CE router may be disposed on the VM of the server, that is, The server is used as the PE router, and the VM on the server is used as the CE router. With the above settings, the server as a PE router will directly support routing protocols (such as BGP). The specific process of the virtual machine migration is the same as the process in the second embodiment of the present invention and the third embodiment of the present invention, except that the operation performed by the PE router in the second embodiment of the present invention and the third embodiment of the present invention is performed by the server, and the CE router performs the operation. The operation is performed by the VM on the server. Specifically, since the CE router is set on the VM of the server, there is no node between the server and the CE router. The specific process in the second embodiment or the third embodiment of the present invention is not included in the foregoing process. Step 303, step 304, step 403 and step 404, the third server directly sends the MAC address and IP address of the VM12 of the third server to the third CE router or the third PE router through the ARP message. With this configuration, the PE router does not belong to the carrier network between the PE routers. Therefore, the site is completely transparent to the carrier network between the PE routers. That is, the edge of the carrier network between the PE routers does not need to know the MAC address routing inside the site. .

FIG. 5 is a schematic structural diagram of a virtual machine migration system according to Embodiment 4 of the present invention. As shown in FIG. 5, the system includes at least: a target server 51, a target control node 52, a source control node 53, and a source server 54.

The target server 51 is configured to start the VM to be migrated and send the MAC address and IP address of the VM to be migrated to the target control node 52 through the first ARP message.

The target control node 52 is configured to update the IP routing table according to the first ARP message, send the IP address routing information of the VM to be migrated to the source control node 53 through the first routing protocol message, and update the IP address routing information of the VM to be migrated after the update. The IP address of the VM to be migrated and the IP address of the target control node 52 are included.

The source control node 53 is configured to update the IP routing table according to the IP address of the VM to be migrated and the IP address of the target control node 52 in the first routing protocol message, and serve the source through the second ARP message. The server 54 sends an IP address or an IP address and a MAC address of the VM to be migrated;

The source server 54 is configured to release related resources of the VM to be migrated according to the second ARP message.

On the basis of the foregoing technical solution, the source control node 53 is further configured to obtain, by using the third ARP message, the mapping relationship between the MAC address and the IP address of the VM to be migrated from the source server 54 to the target control node 52 through the second routing protocol message. The IP address routing information of the VM to be migrated is sent, and the IP address routing information includes an IP address of the VM to be migrated and an IP address of the source control node 53.

Based on the above technical solution, the system further includes: a node 55 between the target server and the target control node, and a node 56 between the source server and the source control node. The target server 51 is specifically configured to send, by using the first ARP message, the MAC address and the IP address of the VM to be migrated to the node 55 between the target server and the target control node. The node 55 between the target server and the target control node is specifically configured to learn the MAC address and IP address of the VM to be migrated and update the MAC address forwarding, and forward the first ARP message to the target control node 52. The source control node 53 is specifically configured to send, by using the second ARP message, the IP address or IP address and MAC address of the VM to be migrated to the node 56 between the source server and the source control node. The node 56 between the source server and the source control node is specifically configured to learn the MAC address of the VM to be migrated and update the MAC address forwarding table, and forward the second ARP message to the source server 54.

Based on the above technical solution, the system further includes: other control nodes 57. The target control node 52 is further configured to send, after the IP routing table is updated according to the first ARP message, the IP address routing information of the updated VM to be migrated to the other control node 57 by using the first routing protocol message. The other control node 57 is configured to update the IP routing table according to the IP address of the VM to be migrated in the first routing protocol message and the IP address of the target control node 52.

On the basis of the foregoing technical solution, the source control node 53 or other control node 57 is further configured to: after receiving the first routing protocol packet from the target control node 52, obtain the IP address of the packet as the IP address of the VM to be migrated. When the IP packet of the address is sent, the IP packet is sent to the target control node 52. The target control node 52 is also used to send an IP message to the target server 51.

Based on the above technical solution, the target control node 52, the source control node 53, and the like Its control node 57 is a CE router. The source control node 53 or other control node 57 is specifically configured to encapsulate the IP packet into the IP tunnel to the target CE router and send it to the target CE router.

Alternatively, on the basis of the foregoing technical solutions, the target control node 52, the source control node 53, and other control nodes 57 are all PE routers. The first routing protocol packet further includes: a PW label. The source control node 53 is also used to bind the IP address and PW label of the VM to be migrated. The source control node 53 or other control node 57 is specifically configured to add the same PW header to the IP packet as the PW label, and then encapsulate the MPLS tunnel to the target PE router and send it to the target PE router.

In the fourth embodiment of the present invention, in the VM migration system, the interaction process in each site adopts the ARP protocol, and the interaction process between the sites adopts a routing protocol, and the target control node 52 and the source control node 53 complete the ARP message. Mutual triggering and conversion with routing protocol messages. Therefore, the ARP protocol packets are restricted to each site, and the ARP protocol is prevented from being sent to the DC internet between sites. By replacing the ARP message with the routing protocol packet in the DC network, the broadcast storm caused by the broadcast of the ARP message in the DC Internet is avoided, which saves the bandwidth occupied by the control signaling.

FIG. 6 is a schematic structural diagram of a target control node 52 according to Embodiment 5 of the present invention. As shown in FIG. 6, the target control node 52 includes at least: an ARP module 521, a processing module 522, and a routing protocol module 523.

The ARP module 521 is configured to obtain, by using the first ARP message, the MAC address and the IP address of the VM to be migrated from the target server 51. The processing module 522 is configured to update the IP routing table according to the first ARP message. The routing protocol module 523 is configured to send the IP address routing information of the VM to be migrated to the source control node 53 through the first routing protocol message, and the IP address routing information of the VM to be migrated after the update includes the IP address and target control of the VM to be migrated. The IP address of node 52.

Based on the foregoing technical solution, the ARP module 521 is specifically configured to acquire a first ARP message forwarded from the target server 51 from a node between the target server 51 and the target control node 52.

On the basis of the foregoing technical solution, the routing protocol module 523 is further configured to send, by using the first routing protocol packet, the IP address routing information of the VM to be migrated after being updated to the other control node 57, after the update. The IP address routing information of the VM to be migrated includes the IP address of the VM to be migrated and the IP address of the target control node 52, so that the other control node 57 according to the IP address of the VM to be migrated and the target control node 52 in the first routing protocol message. The IP address updates the IP routing table.

Based on the above technical solutions, the target control node 52, the source control node 53, and other control nodes 57 are all CE routers.

Alternatively, on the basis of the above technical solutions, the target control node 52, the source control node 53 and the other control nodes 57 are all PE routers. The first routing protocol packet further includes: a PW label.

In the fifth embodiment of the present invention, the target control node 52 mutually triggers and translates the ARP message and the routing protocol message, so that the interaction process in the site corresponding to the target control node 52 adopts the ARP protocol, between the sites. The interaction process uses a routing protocol to limit the ARP packets to each site. This prevents the ARP protocol from being sent to the DC Internet between sites. By replacing the ARP message with the routing protocol packet in the DC network, the broadcast storm caused by the broadcast of the ARP message in the DC network is avoided, which saves the bandwidth occupied by the control signaling.

FIG. 7 is a schematic structural diagram of a source control node 53 according to Embodiment 6 of the present invention. As shown in FIG. 7, the source control node 53 includes at least: a routing protocol module 531, a processing module 532, and an ARP module 533.

The routing protocol module 531 is configured to obtain, by using the first routing protocol packet, the IP address routing information of the VM to be migrated from the target control node 52, and the IP address routing information of the VM to be migrated after the update includes the IP address of the VM to be migrated. The IP address of the target control node 52.

The processing module 532 is configured to update the IP routing table according to the IP address of the VM to be migrated in the first routing protocol message and the IP address of the target control node 52.

The ARP module 533 is configured to send the IP address or IP address and MAC address of the VM to be migrated to the source server 54 through the second ARP message, so that the source server 54 releases the related resources of the VM to be migrated.

Based on the foregoing technical solution, the ARP module 533 is specifically configured to pass the second ARP message. Sending the IP address or IP address and MAC address of the VM to be migrated to the node between the source server 54 and the source control node 53 to cause the node between the source server 54 and the source control node 53 to forward the second ARP message to the source server 54. .

Based on the foregoing technical solution, the ARP module 533 is specifically configured to broadcast a second ARP message to the source site, where the second ARP message includes an IP address of the VM to be migrated. Alternatively, the ARP module 533 is configured to query the stored MAC address and IP address mapping table according to the IP address of the VM to be migrated, obtain the MAC address of the VM to be migrated, and broadcast the second ARP message to the source site, where the second ARP message is sent. Includes the IP address and MAC address of the VM to be migrated.

Based on the foregoing technical solution, the node further includes: an IP packet module. The IP packet module is configured to obtain the IP address of the IP address of the VM to be migrated after the IP address of the VM to be migrated is obtained after the IP address of the VM to be migrated is obtained from the target control node 52. At the time of the message, an IP packet is sent to the target control node 52 to cause the target control node 52 to send an IP packet to the target server 51.

Based on the above technical solutions, the source control node 53 and the target control node 52 are both CE routers. The IP packet module is specifically configured to encapsulate the IP packet into an IP tunnel to the target CE router and send it to the target CE router.

Alternatively, based on the above technical solutions, both the source control node 53 and the target control node 52 are PE routers. The first routing protocol packet further includes: a PW label. The processing module 532 is also used to bind the IP address and PW label of the VM to be migrated. The IP packet module is specifically configured to add the same PW header to the IP packet as the PW label, and then encapsulate the MPLS tunnel to the target PE router and send it to the target PE router.

In the sixth embodiment of the present invention, the source control node 53 mutually triggers and translates the ARP message and the routing protocol message, so that the interaction process between the sites is performed by using the ARP protocol in the interaction process of the site corresponding to the source control node 53. The process uses a routing protocol to limit ARP packets to each site, avoiding the ARP protocol being sent to the DC internet between sites. By replacing the ARP message with a routing protocol message in the DC internet, the DC interconnection is avoided. The broadcast storm caused by the broadcast of ARP messages on the network saves the bandwidth occupied by control signaling. It should be noted that, for the foregoing method embodiments, for the sake of simple description, they are all expressed as a series of action combinations, but those skilled in the art should understand that the present invention is not limited by the described action sequence. Because certain steps may be performed in other sequences or concurrently in accordance with the present invention. In addition, those skilled in the art should also understand that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily required by the present invention.

In the above embodiments, the descriptions of the various embodiments are different, and the parts that are not detailed in a certain embodiment can be referred to the related descriptions of other embodiments.

A person skilled in the art can understand that all or part of the steps of implementing the above method embodiments may be completed by using hardware related to program instructions, and the foregoing program may be stored in a computer readable storage medium, and the program is executed when executed. The foregoing steps include the steps of the foregoing method embodiments; and the foregoing storage medium includes: a medium that can store program codes, such as a ROM, a RAM, a magnetic disk, or an optical disk.

It should be noted that the above embodiments are only for explaining the technical solutions of the present invention, and are not intended to be limiting; although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those skilled in the art that: The technical solutions described in the foregoing embodiments are modified, or some of the technical features are equivalently replaced. The modifications and substitutions do not depart from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

Rights request

A virtual machine VM migration method, comprising:

The target server starts the VM to be migrated and sends the media access control MAC address and the internet protocol IP address of the VM to be migrated to the target control node by using the first address resolution protocol ARP message; the target control node is updated according to the first ARP message. The IP routing table sends the IP address routing information of the VM to be migrated to the source control node by using the first routing protocol packet, and the IP address routing information of the VM to be migrated after the update includes the IP address and location of the VM to be migrated. The IP address of the target control node;

The method according to claim 1, wherein after the sending, by the second ARP message, the IP address or the IP address and the MAC address of the VM to be migrated to the source server, the method further includes: the source server according to the The second ARP message releases related resources of the VM to be migrated.

The method according to claim 1 or 2, wherein the target server starts the VM to be migrated and sends the MAC address and IP address of the VM to be migrated to the target control node by using the first ARP message. :

And obtaining, by the source control node, a mapping relationship between the MAC address and the IP address of the VM to be migrated from the source server by using the third ARP message;

The source control node sends the IP address routing information of the VM to be migrated to the target control node by using the second routing protocol packet, where the IP address routing information includes the IP address of the VM to be migrated and the IP address of the source control node. .

The method according to any one of claims 1 to 3, wherein the sending, by the first ARP message, the MAC address and the IP address of the VM to be migrated to the target control node includes: Transmitting, by the first ARP message, a MAC address and an IP address of the VM to be migrated to a node between the target server and the target control node; The node between the server and the target control node learns the MAC address and IP address of the VM to be migrated and updates the MAC address forwarding table; the node between the target server and the target control node forwards the number to the target control node An ARP message, so that the target control node acquires a MAC address and an IP address of the VM to be migrated;

The sending, by the second ARP message, the IP address or the IP address and the MAC address of the VM to be migrated to the source server, the method includes: the source control node sending, by using the second ARP message, the node between the source server and the source control node The IP address or the IP address and the MAC address of the VM to be migrated; the node between the source server and the source control node learns the MAC address of the VM to be migrated and updates the MAC address forwarding table; the source server and the source control node The node forwards the second ARP message to the source server, so that the source server acquires an IP address or an IP address and a MAC address of the VM to be migrated.

The method according to claim 4, wherein the source control node sends the IP address or IP address of the VM to be migrated to a node between the source server and the source control node by using the second ARP message. And the MAC address includes:

The source control node broadcasts the second ARP message to the source site, where the second ARP message includes the IP address of the VM to be migrated;

Or the source control node queries the mapping table of the MAC address and the IP address according to the IP address of the VM to be migrated, obtains the MAC address of the VM to be migrated, and broadcasts the second ARP message to the source site, where The second ARP message includes an IP address and a MAC address of the VM to be migrated.

The method according to claim 5, wherein after the target control node updates the IP routing table according to the first ARP message, the method further includes:

Sending, by the target control node, the IP address routing information of the VM to be migrated to the other control node by using the first routing protocol packet;

And the other control node updates the IP routing table according to the IP address of the VM to be migrated and the IP address of the target control node in the first routing protocol packet.

7. The method of claim 6 wherein:

The control node is a user edge CE router; the source control node or the other control node sends the IP packet to the target control node, including: the source CE router or other CE router encapsulates the IP packet The IP tunnel to the target CE router is sent to the target CE router;

Or the control node is a carrier edge PE router; the first routing protocol packet further includes: a pseudowire PW label; the source control node is to be migrated according to the first routing protocol packet Updating the IP routing table of the IP address of the VM and the IP address of the target control node further includes: the source PE router binding the IP address of the VM to be migrated and the PW label; the source control node or the other control node Sending the IP packet to the target control node includes: adding, by the source PE router, the same PW header as the PW label to the IP packet, and encapsulating the multi-protocol label switching MPLS tunnel to the target PE router Give the target PE router.

8. A virtual machine VM migration system, comprising:

And a source server, configured to receive the second ARP message from the source control node.

9. The system of claim 8 wherein:

The source server is further configured to release the correlation of the VM to be migrated according to the second ARP message. Resources.

10. A system according to claim 8 or claim 9 wherein:

The source control node is further configured to obtain, by using a third ARP message, a mapping relationship between a MAC address and an IP address of the VM to be migrated from the source server, and send the message to the target control node by using a second routing protocol packet. IP address routing information of the VM to be migrated, the IP address routing information includes an IP address of the VM to be migrated and an IP address of the source control node.

The system according to claim 8 or 9, further comprising: a node between the target server and the target control node and a node between the source server and the source control node;

The target server is specifically configured to send, by using the first ARP message, a MAC address and an IP address of the VM to be migrated to a node between the target server and the target control node;

The node between the target server and the target control node is specifically configured to learn the MAC address and the IP address of the VM to be migrated and update the MAC address forwarding table, and forward the first ARP message to the target control node;

The source control node is specifically configured to send, by using the second ARP message, an IP address or an IP address and a MAC address of the VM to be migrated to a node between the source server and the source control node;

The node between the source server and the source control node is specifically used to learn the VM to be migrated.

MAC address and updating the MAC address forwarding table, forwarding the second ARP cancellation to the source server

The system according to any one of claims 8 to 11, further comprising: other control nodes;

The target control node is further configured to: after the IP routing table is updated according to the first ARP message, send, by using the first routing protocol message, the IP address routing information of the updated VM to be migrated to the other control node. ;

And the other control node is configured to update the IP routing table according to the IP address of the VM to be migrated and the IP address of the target control node in the first routing protocol packet.

13. The system of claim 12, wherein The source control node or the other control node is further configured to: after receiving the first routing protocol packet from the target control node, obtain the IP address of the IP address of the VM to be migrated Transmitting the IP packet to the target control node;

The target control node is further configured to send the IP packet to the target server.

14. The system of claim 13 wherein:

The target control node, the source control node, and the other control nodes are all CE routers; the source control node or the other control node is specifically configured to encapsulate the IP packet into a target CE router. The IP tunnel is sent to the target CE router.

Or the target control node, the source control node, and the other control node are all PE routers; the first routing protocol packet further includes: a pseudowire PW label; the source control node is also used for binding Setting the IP address of the VM to be migrated and the PW label; the source control node or the other control node is specifically configured to add a PW header that is the same as the PW label to the IP packet, and then encapsulate the packet. The multi-protocol label switched MPLS tunnel to the target PE router is sent to the target PE router.