CN102884763B - Cross-data-center virtual machine migration method, service control gateway and system - Google Patents
Cross-data-center virtual machine migration method, service control gateway and system Download PDFInfo
- Publication number
- CN102884763B CN102884763B CN201280000865.7A CN201280000865A CN102884763B CN 102884763 B CN102884763 B CN 102884763B CN 201280000865 A CN201280000865 A CN 201280000865A CN 102884763 B CN102884763 B CN 102884763B
- Authority
- CN
- China
- Prior art keywords
- virtual machine
- data center
- gateway
- migration
- target
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/34—Network arrangements or protocols for supporting network services or applications involving the movement of software or configuration parameters
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/131—Protocols for games, networked simulations or virtual reality
Abstract
Embodiments of the invention provide a cross-data-center virtual machine migration method, a service control gateway and a cross-data-center virtual machine migration. The migration method comprises: a target service control gateway of a target data center receives virtual machine migration information sent by a source service control gateway of a source data center; the target service control gateway configures a response strategy, an internal data channel between an ingress router of the target data center and a target switch, and an external data channel between the target data center and a user on the target switch; the target service control gateway sends configuration success information to the source service control gateway; and the target service control gateway installs an virtual machine to be migrated on the target server and provides service for the user. According to the embodiments of the invention, the strategy of the target switch can be automatically installed, the external data channel from the user to the target data center can be automatically installed, and the internal data channel between the ingress router of the target data center and the target switch can be automatically installed, thereby achieving the automatic virtual machine migration across data centers.
Description
Technical field
The present invention relates to virtual machine migration technology, and in particular to a kind of method of the virtual machine (vm) migration across data center, Service controll gateway and system.
Background technology
Data center is as a kind of data integrated system, usually be made up of assemblies such as computing system, storage system, communication system, the network equipment, environmental control system and safety systems, it is usually used in calculating and the storage of other core business of company level, or the calculating of company organization's operation data and storage.Along with the appearance of the technology such as development and cloud computing/Distributed Calculation of science and technology, computing capability, storage etc. also become a kind of information technology service, provide to client.The abilities such as the network utilizing data center to possess, information technology, safety, can provide these to serve for client.
When utilizing data center's technology to provide service, usually virtual machine technique can be adopted.Virtual machine refers to have complete hardware system function by software simulation, and operates in the complete computer in a completely isolated environment.In dummy machine system, a physical server can run multiple virtual machine instance simultaneously, each virtual machine uses a part of physical resource in physical server, as CPU, internal memory etc.Mutually isolated between each virtual machine.In typical cloud data center server, each program load is often different to the demand of resource, and such as some load is that CPU is intensive, and some is memory-intensive.By multiple dissimilar application program, operate on different virtual machines, and be incorporated on physical server, the use of the resource of each dimension can be maximized, the computing capability of data center is maximized.
For large-scale application or across in the scene in geographical position, usually need to dispose multiple data center in different location, provide service simultaneously.For factors such as load balancing, energy consumption, maintenances, in the data in heart running, sometimes need some virtual machines to move to another server from certain physical server.This migration can be carry out between each physical server of interior portion in the data, also can be move between different pieces of information center.Such as, due to geographical position and the time difference, the loading level possibility difference at different pieces of information center is very large, at this time, can consider that in the data center heavy by load, part virtual machine (vm) migration goes to the data center that load is light; And for example, at night, the load of each data center is all light, at this time virtual machine can be concentrated and move to some data centers, and the physical server of other data center's free time can enter resting state to save energy consumption.
Due to each physical server can run multiple virtual machine, switch is therefore needed to be connected in the network of data center inside by each virtual machine.When actual deployment, the resource such as part CPU, internal memory can be marked on physical server, invent 1 software switch, also physical server can be directly connected to outside hardware switch.Mode due to software switch takies physical server resource, and the exchange capacity of software mode is limited, therefore adopts hardware switch mode can promote data center's performance.
In addition, can also in hardware switch, for each virtual machine configures different security strategies and/or service quality (Quality of Service, QoS) strategy, make user can according to tactful accesses virtual machine.
In prior art, can by Virtual Machine Manager software (as VMware) to the control of physical server, realize the online migration of virtual machine, virtual machine is moved in another physical server from a physical server, and do not interrupt service that virtual machine runs.
In the process realizing the embodiment of the present invention, inventor finds that prior art can only ensure the online migration of virtual machine, but when realizing the virtual machine (vm) migration across data center, automatically can not realize the configuration of network side.Therefore, before migration, need to rely on the configuration effort manually completed network.Such as, virtual machine (vm) migration software can not perception hardware switch be the security strategy of virtual machine configuration and/or qos policy, and switch that therefore cannot be corresponding to target physical server in transition process carries out the configuration of security strategy and/or qos policy; And for example, the network condition of virtual machine (vm) migration software not perception data central interior, cannot configure automatically to the network of target data central interior.These configuration efforts all need manually to complete, and when needs move a large amount of virtual machine, configuration amount is very huge, and easily makes mistakes.
Summary of the invention
The embodiment of the present invention provides a kind of virtual machine migration method across data center, Service controll gateway and system.
The kind that the embodiment of the present invention provides, across the virtual machine migration method of data center, comprising:
The destination service at target data center controls the virtual machine (vm) migration message that source Service controll gateway that gateway receives source data center sends, described virtual machine (vm) migration message comprise the mark of the virtual machine to be migrated policy information corresponding with the mark of described virtual machine to be migrated, destination server mark, for moving the mark of the data channel between the source data center of virtual machine and target data center;
Described destination service controls gateway according to the mark of described destination server, described policy information is configured in the target switch be connected with described destination server, and configures the internal data path between the ingress router at described target data center and described target switch in described target data central interior;
Described destination service controls gateway and sends configuration successful response message to described source Service controll gateway;
Described destination service controls gateway and selectes virtual machine (vm) migration passage according to the mark of described data channel, the virtual machine to be migrated that described source data center is sended over by described virtual machine (vm) migration passage is arranged on described destination server, and based on described internal data path for the user accessing described virtual machine to be migrated provides business service.
The virtual machine migration method across data that the embodiment of the present invention provides, comprising:
The source Service controll gateway at source data center controls gateway to the destination service at target data center and sends virtual machine (vm) migration message and carry out migration for described target data center and configure, described virtual machine (vm) migration message comprise the mark of the virtual machine to be migrated policy information corresponding with the mark of described virtual machine to be migrated, destination server mark, for moving the mark of the data channel between the source data center of virtual machine and target data center;
After the configuration successful response message receiving the transmission of described destination service control gateway, send virtual machine to be migrated to described target data center.
The destination service that the embodiment of the present invention provides controls gateway, comprising:
First functional module, for the virtual machine (vm) migration message that the source Service controll gateway receiving source data center sends, the mark that described virtual machine (vm) migration message comprises virtual machine to be migrated identifies corresponding policy information, the mark of destination server and the mark for moving the data channel between the source data center of virtual machine and target data center with described;
Second functional module, for the mark according to described destination server, described policy information is configured in the target switch be connected with described destination server, and configures the internal data path between the ingress router at described target data center and described target switch in described target data central interior;
3rd functional module, is arranged on described destination server for the virtual machine to be migrated sended at described source data center, and based on described internal data path for described user provides business service.
The source Service controll gateway that the embodiment of the present invention provides, comprising:
4th functional module, send virtual machine (vm) migration message and carry out migration for described target data center for controlling gateway to the destination service at target data center and configure, described virtual machine (vm) migration message comprise virtual machine to be migrated mark, with the described address information identifying corresponding policy information, the mark of destination server and the network access equipment of user;
Five-function module, for after the configuration successful response message receiving the transmission of described destination service control gateway, sends virtual machine to be migrated to described target data center.
The virtual machine (vm) migration system across data center that the embodiment of the present invention provides, comprising:
The source data center of mutual communication connection and target data center, as above any one destination service control gateway and source Service controll gateway.
The virtual machine migration method that the embodiment of the present invention provides, Service controll gateway and system, achieve in the virtual machine Autonomic Migration Framework process across data center, tactful Auto-mounting in target switch, user configures automatically to the network at target data center, network between the ingress router at target data center and target switch configures automatically, does not need artificial participation.
Accompanying drawing explanation
Fig. 1 is the schematic flow sheet of the present invention across the virtual machine migration method embodiment one of data center;
Fig. 2 is the schematic flow sheet of the present invention across the virtual machine migration method embodiment two of data center;
Fig. 3 A is the structural representation of the destination service control gateway of the embodiment of the present invention one;
Fig. 3 B Fig. 3 A destination service controls the structural representation of the second functional module of gateway;
Fig. 4 is the source Service controll gateway architecture schematic diagram of the embodiment of the present invention two;
Fig. 5 is the configuration diagram of the present invention across the virtual machine (vm) migration system of data center.
Embodiment
Fig. 1 is the schematic flow sheet of the present invention across the virtual machine migration method embodiment one of data center.As shown in Figure 1, across the virtual machine migration method of data center, should comprise the following steps:
Step S101: the destination service at target data center controls the virtual machine (vm) migration message that gateway (Service Control Gateway, SCG) receives the source Service controll gateway transmission at source data center.
Wherein, destination service controls gateway can by the control channel of target data central interior, perception target data central interior topology information, and can be configured the equipment of target data central interior; Meanwhile, the control plane that destination service control gateway also transmits network with outside, target data center communicates, and realizes transmitting network establishment of connection; Further, destination service controls gateway and can also communicate with target data center Virtual Machine Manager software (as VMware), performs virtual machine (vm) migration process as required.
Virtual machine (vm) migration message comprises: the mark of the mark of the virtual machine to be migrated policy information corresponding with mark, destination server, for moving the mark etc. of the data channel between the source data center of virtual machine and target data center.Wherein, if source Service controll gateway is preserved the installation policy information corresponding with virtual machine to be migrated on switches, then using this policy information as with policy information corresponding with virtual machine to be migrated in virtual machine (vm) migration message, otherwise, strategy corresponding with virtual machine to be migrated on the switch of Service controll gateway consults source, source.
The mark of virtual machine to be migrated can be such as the IP address of virtual machine.Migration destination server, for being about to the server receiving virtual machine to be migrated in target data central server cluster.The security strategy of virtual machine to be migrated and/or service quality (Quality of Service, QoS) strategy, refer to be configured in source data center the switch corresponding with virtual machine to be migrated on strategy, data center administrator can the access strategy of designated virtual machine, makes user can access corresponding virtual machine under policing rule.Security strategy, such as, can be: the port list of firewall configuration information, IP access list, permission access ... etc., but the embodiment of the present invention is not as limit.Qos policy can be such as classification policy (as based on UDP/TCP port classifications, based on source IP address classification etc.) to packet, to the priority level of every class packet and queuing policy ... etc., but the embodiment of the present invention is not as limit.
Step S102: destination service controls gateway according to virtual machine (vm) migration message, is configured in target switch by corresponding strategy, and configures the internal data path between the ingress router of target data center and target switch.Destination service controls gateway, i.e. target SCG, with the network equipment of target data central interior, as router, switch etc. are connected by internal control passage, the automatic configuration to the network equipment can be realized, and the annexation that can obtain between each server at target data center and switch, find the target switch corresponding with destination server according to this annexation, and corresponding strategy is configured in target switch.
If described target data central interior adopts ethernet technology, then target SCG is VLAN ID (the Virtual Local Area Network Identifier of the distribution correspondence of virtual machine to be migrated, VLANID), and VLAN ID is configured on target data central inlet router and target switch, set up internal data path according to VLAN ID.Owing to running Spanning-Tree Protocol (as 802.1aq) in target data central interior, therefore, increased a VLAN ID newly and Spanning-Tree Protocol perform after, the edge router at target data center is configured with the packet that newly assigned VLAN ID identifies, will is correctly forwarded in target switch; Target switch configures the packet that newly assigned VLAN ID identifies, also can be correctly forwarded on the edge router at target data center.
If target data central interior adopts Virtual Private LAN Segment (Virtual Private LANSegment, VPLS), then destination service controls gateway and calculates a negotiate marking commutation passage (Multi-Protocol Label Switching between ingress router and target switch, MPLS tunnel), and to each Joint Enterprise virtual-circuit label and the channel labels on negotiate marking commutation passage, set up internal data path according to virtual-circuit label and channel labels.Make the edge router at target data center by the packet of the virtual machine to be migrated of access, be correctly forwarded in target switch by this MPLS tunnel; The packet sent by virtual machine to be migrated, also can stamp virtual-circuit label and channel labels in target switch, is correctly forwarded on the edge switch at target data center by this MPLS tunnel.
In the present embodiment, if what adopt between user to data center is connection-oriented transmission network, then virtual machine (vm) migration message also comprises: the address information of the network access equipment of user, user access the bandwidth information needed for virtual machine to be migrated.Destination service controls gateway according to the address information of the network access equipment of user and bandwidth information, calculates the path between the ingress router at target data center and the network access equipment of user; Destination service controls gateway and initiates signaling protocol to ingress router, and the control plane of ingress router sends signaling message along described path, each node on this path is set up in transmission plane and intersects, thus set up external data passage.
Target SCG is by running control plane agreement, as ASON (AutomaticallySwitched Optical Network, ASON), expansion negotiate marking commutation (GeneralizedMulti-Protocol Label Switching, GMPLS) etc., be connected with the control plane of the transmission network between data center, the resource situation transmitting network can be obtained by Routing Protocol, transmission network is driven automatically to set up/revise/delete and wait operation by signaling protocol, external data passage between configuration target data center and the network access equipment of user.
If user is by IP access data center, because IP network is connectionless network, therefore do not need to drive and set up the connection of user to data center.
In general, personal user by IP network access data center, enterprise customer due to data volume large, thus by connection-oriented transmission network access data center, right the present invention not as limit, user can adopt any can the network insertion data center at access data center.
Step S103: destination service controls gateway sends response message from configuration successful to source Service controll gateway.
When the strategy of correspondence is configured in the target switch at target data center by target SCG, and after the internal data path completed between the ingress router at target data center and target switch configures, configuration successful response message is sent to source Service controll gateway (source Service Control Gateway, source SCG).
Step S104: destination service controls gateway according to the identification information of the data channel between source data center and target data center, selected virtual machine (vm) migration passage, virtual machine to be migrated is sent by this virtual machine (vm) migration passage, and be arranged on destination server, and based on internal data path for the user accessing virtual machine to be migrated provides business service.
In the above embodiment of the present invention, target SCG installs the strategy of the correspondence of corresponding virtual machine to be migrated on the switch that destination server is corresponding, and the internal data path configured between ingress router that target data center arrives to target switch, the forwarding that the packet of the virtual machine making access to be migrated can be correct between target switch and the ingress router at target data center.When user adopts IP network access data center, because IP network is wireless network, accesses virtual machine that therefore can be correct; When user adopts connection-oriented transmission network access data center, target SCG runs control plane agreement, pass through Routing Protocol, obtain the resource situation of the transmission network between source data center and target data center, external data passage between configuration target data center and the network access equipment of user, makes the accesses virtual machine that user can be correct.
Fig. 2 is the schematic flow sheet of the present invention across the virtual machine migration method embodiment two of data center.As shown in Figure 2, across the virtual machine migration method of data center, should comprise the following steps:
Step S201: the source Service controll gateway at source data center, to the destination service control gateway transmission virtual machine (vm) migration message at target data center, carries out migration configuration for target data center.
Virtual machine (vm) migration message comprises: the mark of virtual machine to be migrated with described identify corresponding policy information, destination server mark, for moving the mark of the data channel between the source data center of virtual machine and target data center.If source Service controll gateway is preserved the installation policy information corresponding with virtual machine to be migrated on switches, then using this policy information as with policy information corresponding with virtual machine to be migrated in virtual machine (vm) migration message, otherwise, strategy corresponding with virtual machine to be migrated on the switch of Service controll gateway consults source, source.Concrete, can see the virtual machine (vm) migration information of Fig. 1 embodiment.
The source Service controll gateway at source data center is receiving the migration order from the virtual machine (vm) migration order of webmaster or the result of decision of certain global decisions device, such as, source data center is performing after decision-making goes out to need the migration order of the virtual machine of migration after overall equalization algorithm receiving overall balance controller, target SCG to target data center sends virtual machine (vm) migration message, for target data center, the switch that destination server connects is configured, internal data path between the ingress router at target data center and target switch is configured.
If what adopt between user to data center is connection-oriented transmission network, then virtual machine (vm) migration message also comprises: the address information of the network access equipment of user, user access the bandwidth information needed for virtual machine to be migrated.Destination service controls gateway according to the address information of the network access equipment of user and bandwidth information, calculates the path between the ingress router at target data center and the network access equipment of user; Destination service controls gateway and initiates signaling protocol to ingress router, the control plane of ingress router sends signaling message along described path, each node on this path is set up in transmission plane intersect, thus set up the external data passage between target data center and the network access equipment of user.
Source Service controll gateway can by the control channel of source data central interior, perception source data central interior topology information, and can be configured the equipment of source data central interior; Meanwhile, source Service controll gateway also communicates with the control plane of source data center external data passage, realizes data channel establishment of connection; Further, source Service controll gateway can also communicate with source data center Virtual Machine Manager software (as VMware), performs virtual machine (vm) migration process as required.
Step S202: after the configuration successful response message receiving the transmission of destination service control gateway, send virtual machine to be migrated to target data center.
The source SCG at source data center, after the configuration successful response message receiving target SCG transmission, to Virtual Machine Manager software (as VMware) transmitting order to lower levels, carries out the migration of virtual machine by above-mentioned data channel.
If described user, such as by edge device (Customer Edge, CE) enterprise customer of access transmission network network, data center is linked into by connection-oriented transmission network, then after sending virtual machine to be migrated to target data center, source Service controll gateway is by control plane signaling protocol, and the ingress router to source data center sends signaling, the network access equipment deleting user to source data center edge router between external data passage.
In addition, before the source SCG at source data center sends virtual machine (vm) migration message after the order receiving virtual machine (vm) migration, whether the existing available and meet the data channel that bandwidth meets virtual machine (vm) migration of automatic decision source data center and target data center, if had, then select this data channel as virtual machine (vm) migration passage, and the mark this being used for the data channel of moving between the source data center of virtual machine and target data center in virtual machine (vm) migration message send to target SCG; If do not had, then source SCG drived control plane sets up data channel new between source data center and target data center, and using new data channel as virtual machine (vm) migration passage, and the mark this being used for the data channel of moving between the source data center of virtual machine and target data center in virtual machine (vm) migration message sends to target SCG.
Carried out the transmission of virtual machine (vm) migration message by original data channel or newly-established data channel, and after the response message of configuration successful receiving target SCG, carry out virtual machine (vm) migration by this passage.Whole transition process completes automatically, reduces human resources and is not easy to make mistakes.
Fig. 3 A is the structural representation of the target control gateway of the embodiment of the present invention one.As shown in Figure 3A, the destination service control gateway of the present embodiment comprises the first functional module 1, second functional module 2, the 3rd functional module 3.
First functional module 1, for the virtual machine (vm) migration message that the source Service controll gateway receiving source data center sends, virtual machine (vm) migration message comprise the mark of the virtual machine to be migrated policy information corresponding with mark, destination server mark, for moving the mark of the data channel between the source data center of virtual machine and target data center.Before source SCG at source data center sends virtual machine (vm) migration message after the order receiving virtual machine (vm) migration, first functional module 1 whether existing available and meeting the data channel that bandwidth meets virtual machine (vm) migration also for automatic decision source data center and target data center, if had, then select this data channel as virtual machine (vm) migration passage, and the mark this being used for the data channel of moving between the source data center of virtual machine and target data center in virtual machine (vm) migration message send to target SCG; If do not had, then the first functional module 1 drived control plane of source SCG sets up data channel new between source data center and target data center, using new data channel as virtual machine (vm) migration passage, and the mark this being used for the data channel of moving between the source data center of virtual machine and target data center in virtual machine (vm) migration message sends to target SCG.
Second functional module 2, for the mark according to destination server, policy information is configured in target switch that destination server connects, and the internal data path between the ingress router and target switch of target data central interior configuration target data center, this second functional module 2 is also for sending configuration successful response message to source data center.The network equipment of this second functional module 2 and target data central interior, as router, switch etc. are connected by internal control passage, the strategy corresponding according to virtual machine to be migrated in virtual machine (vm) migration message, tactful accordingly by target switch configuring this; And the internal data path between the edge router configuring target data center to target switch.
If user adopts connection-oriented transmission network access data center, then the virtual machine (vm) migration message of the reception of the first functional module also comprises: the address information of the network access equipment of user and user access the bandwidth information required for virtual machine to be migrated, second functional module 2 of target SCG also runs control plane agreement, (as ASON/GMPLS) is connected with the control plane of the transmission network between data center, therefore can obtain by Routing Protocol the resource situation transmitting network, transmission network is driven automatically to set up/revise/delete and wait operation by signaling protocol, the external data passage completed between the entrance route at target data center and destination router configures.
3rd functional module 3, is arranged on destination server for the virtual machine to be migrated sended at source data center, and based on internal data path and external data passage for user provides business service.The destination service of the present embodiment controls gateway, the virtual machine (vm) migration message that second functional module 2 receives according to the first module 1, the switch that destination server is corresponding is installed the strategy of the correspondence of corresponding virtual machine to be migrated, and the internal data path configured between ingress router that target data center arrives to target switch, the forwarding that the packet of the virtual machine making access to be migrated can be correct between target switch and the ingress router at target data center.When user adopts connection-oriented transport network access data center, external data passage between configuration target data center and the network access equipment of user, based on internal data path and external data passage, the packet of the virtual machine making access to be migrated can between target switch and the ingress router at target data center, correct between target data center and user forwarding, realize the virtual machine Autonomic Migration Framework across data center.
Fig. 3 B Fig. 3 A of the present invention destination service controls the structural representation of the second functional module of gateway.As shown in Figure 3 B.Above-mentioned destination service gateway, the second functional module 2 comprises first module 21, second unit 22.Wherein, first module 21, for the mark according to destination server, is configured in target switch that destination server connects by policy information; Second unit 22, for the internal data path between the ingress router and target switch of target data central interior configuration target data center.
Concrete, first module 21, by strategy corresponding for virtual machine to be migrated, is configured in target switch that destination server connects, makes the switch that user can be corresponding according to strategy access.
Second unit 22, comprises the first subelement and the second subelement.First subelement, if target data central interior adopts ethernet technology, then in target SCG, the first subelement is the VLAN ID VLAN ID of the distribution correspondence of virtual machine to be migrated, and VLAN ID is configured on target data central inlet router and target switch, set up internal data path according to VLAN ID.Owing to running Spanning-Tree Protocol (as 802.1aq) in target data central interior, therefore, increased a VLAN ID newly and Spanning-Tree Protocol perform after, the edge router at target data center is configured with the packet that newly assigned VLANID identifies, will is correctly forwarded in target switch; Target switch configures the packet that newly assigned VLAN ID identifies, also can be correctly forwarded on the edge router at target data center; Second subelement, if target data central interior adopts Virtual Private LAN Segment, then destination service controls the negotiate marking commutation passage of the second subunit computes one between ingress router and target switch (the Multi-Protocol Label Switching of gateway, MPLS tunnel), and to each Joint Enterprise virtual-circuit label and the channel labels on negotiate marking commutation passage, set up internal data path according to virtual-circuit label and channel labels.Make the edge router at target data center by the packet of the virtual machine to be migrated of access, be correctly forwarded in target switch by this MPLS tunnel; There is the packet that virtual machine to be migrated sends, also can stamp virtual-circuit label and channel labels in target switch, be correctly forwarded on the edge switch at target data center by this MPLS tunnel.
When user is by transmitting network access data center time, destination service gateway in above-described embodiment also comprises the 3rd unit 23,3rd unit 23 is for the address information of the network access equipment according to user and bandwidth information, calculate the path between the ingress router at target data center and the network access equipment of user, and initiate signaling protocol to ingress router; The control plane of ingress router sends signaling message along path, each node on path is set up in transmission plane and intersects, thus set up external data passage.The bandwidth information that user accesses virtual machine to be migrated is carried in virtual machine (vm) migration message.
Fig. 4 is the source Service controll gateway architecture schematic diagram of the embodiment of the present invention two.As shown in Figure 4, Service controll gateway in source comprises the 4th functional module 4 and five-function module 5.Wherein, 4th functional module 4 carries out migration configuration for controlling gateway transmission virtual machine (vm) migration message to the destination service at target data center for target data center, and virtual machine (vm) migration message comprises the mark of virtual machine to be migrated, the address information of policy information, the mark of destination server and the network access equipment of user corresponding with mark.If source Service controll gateway is preserved the installation policy information corresponding with virtual machine to be migrated on switches, then the 4th functional module 4 using this policy information as with policy information corresponding with virtual machine to be migrated in virtual machine (vm) migration message, otherwise, strategy corresponding with virtual machine to be migrated on the 4th functional module 4 query source switch.Five-function module 5, for after the configuration successful response message receiving the transmission of destination service control gateway, sends virtual machine to be migrated to target data center.
Concrete, the present embodiment is for executive agent illustrates with the source Service controll gateway at source data center.4th functional module 4 is receiving the virtual machine (vm) migration order of gateway, or receive overall balance controller perform overall equalization algorithm send virtual machine order after, 4th functional module 4 of the Service controll gateway at source data center sends virtual machine (vm) migration order to target SCG, and at target SCG, the strategy of correspondence is configured in target switch, configures internal data path, receive the configuration successful response message that SCG sends, send virtual machine to be migrated to target data center.
In the structure of above-mentioned source gateway, the 6th functional module can also be comprised, 6th functional module, for judging whether to exist between source data center and target data center available and bandwidth meets the data channel of virtual machine (vm) migration, if having, then selects this data channel; If no, then drived control plane sets up data channel new between source data center and target data center.
Source SCG, after receiving virtual machine (vm) migration order, before sending virtual machine (vm) migration message, judges whether there is the data channel that its available bandwidth meets virtual machine (vm) migration between source data center and target data center, have, then select this passage to target data center; Otherwise, 6th functional module of source Service controll gateway runs control plane agreement (as ASON/GMPLS agreement), be connected with the control plane of the transmission network at source data center and target data center, set up data channel, and send virtual machine to be migrated by this passage.
Fig. 5 is the configuration diagram of the present invention across the virtual machine (vm) migration system of data center.As shown in Figure 5, in the A of this source data center, each server is interconnected by router P1, P2, P3, wherein on 1 physical server A, runs 3 virtual machines V1, V2, V3; User can pass through customer edge (Customer Edge) access transmission network network; Source physical server A is connected with source switch A, switch A can each virtual machine in perception physics server A, and when each virtual machine of establishment, can for different virtual machines, switch A configures different security strategies and/or qos policy, makes user can according to security strategy and/or qos policy accesses virtual machine.
Source switch A (such as can adopt ethernet switch technology by the double layer network of A inside, source data center, or adopt VPLS technology etc.) be connected to edge router PE1, PE1 is connected to IP-based internet or the wide area network of data center outside further, or based on 1 layer or 2 layers of transmission network 1 exchanged.
User (such as personal user or enterprise customer) is linked into IP-based internet or wide area network by CE, or based on 1 layer or 2 layers of transmission network exchanged, the virtual machine in the A of visit data center, such as, access V2 and V3.Physical server A is also connected to by PE3 and transmits network 2, like this, can be realized the migration of virtual machine by transfer canal.In the present embodiment, part server, switch, router and edge router are just shown, right the present invention is not as limit.
Similarly, data center B also has similar framework.
Suppose that, based on certain demand (being such as the load needing equalization server), need virtual machine V2 and V3 of data center A to move in data center B, detailed process is as follows:
1, SCG A receives orders, and needs physical server B virtual machine V2 and V3 being moved to data center B.This order can, from webmaster, also can be the result of decision of certain global decisions device, and such as overall balance controller is after the overall equalization algorithm of execution, and decision-making goes out to need to move virtual machine, and sends migration order to SCG A.
2, SCG A judges currently between data center A and data center B whether exist available, and bandwidth enough connects (i.e. data channel) to carry out virtual machine (vm) migration, if had, then selects this connection; If no, then SCG A calculates the connection of 1 PE3-PE4, and drived control plane sets up this connection, then records the information (node, bandwidth information etc. as path process) of this connection.
3, simultaneously, SCG A inquires about security strategy corresponding to virtual machine V2 and V3 and/or qos policy information (strategy 2 and strategy 3) to switch A, and send virtual machine (vm) migration message to SCG B, this order comprises the mark (as used the IP address of virtual machine as mark) of the virtual machine that will move, the destination server (the physical server B of data center B) of migration, the security strategy that virtual machine is corresponding and/or qos policy, user profile is (as the CE of user access network, the address of PE5), business information (the bandwidth information required for business, only have when to adopt connection-oriented transmission network 1 between user to data center and just need this parameter) etc.,
4, SCG B is after receiving virtual machine (vm) migration message, is configured, comprises according to order to the equipment of data center B inside:
(1) collocation strategy 2 and strategy 3 on the switch b that physical server B is connected, act on V2 and V3 respectively; That is, switch b is when handle packet, when being the address of V2 for IP address, and implementation strategy 2; When being the address of V3 for IP address, implementation strategy 3;
(2) configuration data center B internal network.Existing OpenFlow agreement can be expanded between each network equipment in SCG B and data center B, other proprietary protocol also can be adopted to carry out network equipments configuration.
(2.1) if data center B inside adopts ethernet technology, then SCG B is that virtual machine V2 and V3 distributes new VLAN ID, and on ingress router PE2 and switch b, prepare this VLAN ID.Due to heart B internal operation in the data Spanning-Tree Protocol (as 802.1aq agreement), therefore increased 1 VLAN ID newly and Spanning-Tree Protocol perform after, PE2 stamps the packet of newly assigned VLAN ID, will be correctly forwarded on switch b; Switch b is stamped the packet of newly assigned VLANID, also correctly can be forwarded to PE2.
(2.2) if data center B inside adopts VPLS agreement, then SCG B calculates and determines a MPLS tunnel (as PE2-P6-switch b) between PE2 and switch b, and PE2, P6, switch b are configured respectively, set up MPLS tunnel, and distribute VC (Virtual Circuit, virtual circuit) label, make PE2 that the packet of access V2 and V3 is stamped VC label and MPLS tunnel label, be forwarded on switch b in this MPLS tunnel; From the packet that virtual machine V2 and V3 sends, also can stamp VC label and MPLS tunnel label on switch b, be forwarded on PE2 in this MPLStunnel.
If 5 users are linked into data center by transmitting network 1, then because transmission network is connection-oriented, therefore SCG B also needs to drive the connection of setting up between user to data center B by control plane.Be specially:
Run control plane agreement due to SCG B and be connected with the control plane transmitting network 1, therefore can obtain by Routing Protocol the information transmitting network 1.Therefore, the virtual machine (vm) migration message that SCG B sends according to SCG A, determines the bandwidth information etc. required for the address of Ingress node PE5, business, calculates the path between PE5 and PE2.Then, SCG B initiates signaling protocol to PE2, and the control plane of PE2 sends signaling message along the path of calculating, and each node of path process is set up in transmission plane and intersects, thus set up the connection of PE2 to PE5.
If 6 users are linked into data center by IP network, then because IP network is connectionless networks, therefore do not need to drive and set up the connection of user to data center.
7, SCG B is after completing above configuration, returns configuration successful response message to SCG A.
8, after SCG A is subject to success response message, to Virtual Machine Manager software (as VMware) transmitting order to lower levels, the connection utilizing selected in step 2 or set up, starts the migration carrying out virtual machine V2 and V3.
9, complete network configuration in step 7, after step 8 completes virtual machine (vm) migration, user just can pass through data center B accesses virtual machine V2 and V3.In addition, alternatively, if user is linked into data center by transmitting network 1, then SCG A can also utilize control plane signaling protocol, initiates signaling to PE1, removes original path between PE1 to PE5.
The virtual machine migration method that the embodiment of the present invention provides, Service controll gateway and system, across in data center's virtual machine (vm) migration process, achieve in the virtual machine Autonomic Migration Framework process across data center, tactful Auto-mounting in target switch, user configures automatically to the network at target data center, network between the ingress router at target data center and target switch configures automatically, does not need artificial participation.
Last it is noted that above each embodiment is only in order to illustrate technical scheme of the present invention, be not intended to limit; Although with reference to foregoing embodiments to invention has been detailed description, those of ordinary skill in the art is to be understood that: it still can be modified to the technical scheme described in foregoing embodiments, or carries out equivalent replacement to wherein some or all of technical characteristic; And these amendments or replacement, do not make the essence of appropriate technical solution depart from the scope of various embodiments of the present invention technical scheme.
Claims (10)
1. across a virtual machine migration method for data center, it is characterized in that, comprising:
The destination service at target data center controls the virtual machine (vm) migration message that source Service controll gateway that gateway receives source data center sends, described virtual machine (vm) migration message comprise the mark of the virtual machine to be migrated policy information corresponding with the mark of described virtual machine to be migrated, destination server mark, for moving the mark of the data channel between the source data center of virtual machine and target data center;
Described destination service controls gateway according to the mark of described destination server, described policy information is configured in the target switch be connected with described destination server, and configures the internal data path between the ingress router at described target data center and described target switch in described target data central interior;
Described destination service controls gateway and sends configuration successful response message to described source Service controll gateway;
Described destination service controls gateway and selectes virtual machine (vm) migration passage according to the mark of described data channel, the virtual machine to be migrated that described source data center is sended over by described virtual machine (vm) migration passage is arranged on described destination server, and based on described internal data path for the user accessing described virtual machine to be migrated provides business service.
2. method according to claim 1, is characterized in that, the internal data path that described target data central interior configures between the ingress router at described target data center and described target switch comprises:
If described target data central interior adopts ethernet technology, then described destination service controls gateway is that virtual machine to be migrated distributes corresponding VLAN ID VLAN ID, and described VLAN ID is configured on described ingress router and described target switch, set up internal data path according to described VLAN ID; Or
If described target data central interior adopts Virtual Private LAN Segment agreement, then described destination service control gateway calculates the negotiate marking commutation passage between a described ingress router and described target switch, and to each Joint Enterprise virtual-circuit label and the channel labels on described negotiate marking commutation passage, set up internal data path according to described virtual-circuit label and described channel labels.
3. the method described arbitrarily according to claim 1 or 2, it is characterized in that, if when described user adopts connection-oriented transmission network to be linked into described source data center, described virtual machine (vm) migration message also comprises: the address information of the network access equipment of described user and described user access the bandwidth information required for virtual machine to be migrated;
Described destination service gateway sets up the external data passage between described target data center and the network access equipment of described user according to the address information of the network access equipment of described user and the described user bandwidth information of accessing needed for virtual machine to be migrated, sets up described external data passage and is specially:
Described destination service controls gateway according to the address information of the network access equipment of described user and described bandwidth information, calculates the path between the ingress router at described target data center and the network access equipment of described user;
Described destination service controls gateway and initiates signaling protocol to described ingress router, the control plane of described ingress router sends signaling message along described path, each node on described path is set up in transmission plane intersect, thus set up described external data passage;
Described destination service controls gateway based on described internal data path and described external data passage for described user provides business service.
4. method according to claim 1, is characterized in that, in described method:
Described destination service controls gateway and selectes virtual machine (vm) migration passage according to the mark of described data channel, is specially:
If the mark being designated original data channel between described source data center and described target data center of described data channel, then described destination service controls gateway according to the mark of described data channel, this data channel selected as virtual machine (vm) migration passage, and sends described virtual machine to be migrated by described virtual machine (vm) migration passage;
If the destination service that is designated of described data channel controls gateway by identifying based on the newly-established data channel of control plane between described source data center and described target data center, then described destination service controls gateway according to the mark of described data channel, this newly-established data channel selected as virtual machine (vm) migration passage, and by the virtual machine described to be migrated of source data center transmission described in described virtual machine (vm) migration channel reception.
5. destination service controls a gateway, it is characterized in that, comprising:
First functional module, for the virtual machine (vm) migration message that the source Service controll gateway receiving source data center sends, the mark that described virtual machine (vm) migration message comprises virtual machine to be migrated identifies corresponding policy information, the mark of destination server and the mark for moving the data channel between the source data center of virtual machine and target data center with described;
Second functional module, for the mark according to described destination server, described policy information is configured in the target switch be connected with described destination server, and configures the internal data path between the ingress router at described target data center and described target switch in described target data central interior;
3rd functional module, is arranged on described destination server for the virtual machine to be migrated sended at described source data center, and based on described internal data path for described user provides business service.
6. destination service according to claim 5 controls gateway, and it is characterized in that, described second functional module comprises:
First module, for the mark according to described destination server, is configured in target switch that described destination server connects by described policy information;
Second unit, for configuring the internal data path between the ingress router at described target data center and described target switch in described target data central interior.
7. destination service according to claim 6 controls gateway, and it is characterized in that, described second unit comprises:
First subelement, if adopt ethernet technology for described target data central interior, then described destination service controls gateway is that virtual machine to be migrated distributes corresponding VLAN ID VLAN ID, and described VLAN ID is configured on described ingress router and described target switch, set up internal data path according to described VLANID;
Second subelement, if adopt Virtual Private LAN Segment agreement for described target data central interior, then described destination service control gateway calculates the negotiate marking commutation passage between a described ingress router and described target switch, and to each Joint Enterprise virtual-circuit label and the channel labels on described negotiate marking commutation passage, set up internal data path according to described virtual-circuit label and described channel labels.
8. destination service according to claim 6 controls gateway, it is characterized in that, if user adopts connection-oriented transmission network insertion source data center, the described virtual machine (vm) migration message of the reception of described first functional module also comprises: the address information of the network access equipment of described user and described user access the bandwidth information required for virtual machine to be migrated;
Described second functional module also comprises Unit the 3rd, described Unit the 3rd specifically for:
According to address information and the bandwidth information of the network access equipment of described user, calculate the path between the ingress router at described target data center and the network access equipment of described user, and initiate signaling protocol to described ingress router, the control plane of described ingress router sends signaling message along described path, each node on described path is set up in transmission plane intersect, thus set up external data passage; Described bandwidth information is carried in described virtual machine (vm) migration message.
9. destination service according to claim 5 controls gateway, it is characterized in that,
If the described mark being designated original data channel between described source data center and described target data center for moving the data channel between the source data center of virtual machine and target data center, then described first functional module is used for the mark according to described data channel, using described original data channel as virtual machine (vm) migration passage, and by described in described virtual machine (vm) migration channel reception source data center send virtual machine described to be migrated; Or
If the described destination service that is designated for moving the data channel between the source data center of virtual machine and target data center controls gateway by identifying based on the newly-established data channel of control plane between described source data center and described target data center, then described first functional module is used for the mark according to described data channel, using described newly-established data channel as virtual machine (vm) migration passage, and by described in described virtual machine (vm) migration channel reception source data center send virtual machine described to be migrated.
10. the virtual machine (vm) migration system across data center, it is characterized in that, comprise source data center and the target data center of communication connection mutually, comprise source Service controll gateway in described source data in the heart, comprise in the heart in described target data as arbitrary in claim 5-9 as described in destination service control gateway; Wherein, described source Service controll gateway, comprising:
4th functional module, send virtual machine (vm) migration message and carry out migration for described target data center for controlling gateway to the described destination service at described target data center and configure, described virtual machine (vm) migration message comprise virtual machine to be migrated mark, with the described address information identifying corresponding policy information, the mark of destination server and the network access equipment of user;
Five-function module, for after the configuration successful response message receiving the transmission of described destination service control gateway, sends virtual machine to be migrated to described target data center.
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| PCT/CN2012/077983 WO2014000292A1 (en) | 2012-06-30 | 2012-06-30 | Migration method, serving control gateway and system for virtual machine across data centres |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102884763A CN102884763A (en) | 2013-01-16 |
| CN102884763B true CN102884763B (en) | 2015-05-13 |
Family
ID=47484675
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201280000865.7A Active CN102884763B (en) | 2012-06-30 | 2012-06-30 | Cross-data-center virtual machine migration method, service control gateway and system |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN102884763B (en) |
| WO (1) | WO2014000292A1 (en) |
Families Citing this family (25)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103346900B (en) * | 2013-05-31 | 2016-12-28 | 华为技术有限公司 | Method for configuring route after live migration of virtual machine and gateway in big double layer network |
| CN103516554B (en) * | 2013-10-22 | 2017-01-18 | 杭州华三通信技术有限公司 | Method and equipment for VM (Virtual Machine) migration |
| CN103647849B (en) * | 2013-12-24 | 2017-02-08 | 华为技术有限公司 | Method and device for migrating businesses and disaster recovery system |
| EP3092741B1 (en) | 2014-01-09 | 2020-04-15 | Nokia Solutions and Networks Oy | Allocating virtual machines in a gateway coupled to a software-defined switch |
| CN104951352B (en) | 2014-03-31 | 2018-05-11 | 华为技术有限公司 | The moving method and equipment of a kind of data flow |
| EP3142306B1 (en) * | 2014-06-03 | 2019-01-09 | Huawei Technologies Co., Ltd. | Openflow communication method, system, controller, and service gateway |
| CN105227454B (en) * | 2014-06-18 | 2019-02-26 | 中兴通讯股份有限公司 | Virtual flow-line system and method |
| WO2016069382A1 (en) * | 2014-10-26 | 2016-05-06 | Microsoft Technology Licensing, Llc | Virtual overlay mobility using label based underlay network forwarding |
| WO2016077951A1 (en) | 2014-11-17 | 2016-05-26 | 华为技术有限公司 | Service migration method, apparatus and system for data center |
| CN105704045B (en) * | 2014-11-26 | 2019-05-28 | 华为技术有限公司 | The method of virtual machine location information synchronizing, gateway and system between data center's gateway |
| CN104601340B (en) * | 2014-12-02 | 2018-10-09 | 腾讯科技（深圳）有限公司 | It is a kind of across the data transmission method of IDC, equipment and system |
| CN104518993A (en) * | 2014-12-29 | 2015-04-15 | 华为技术有限公司 | Allocation method, device and system for communication paths of cloud network |
| CN104836849B (en) * | 2015-04-16 | 2018-02-09 | 新华三技术有限公司 | One kind registration virtual machine method and apparatus |
| CN106936681A (en) * | 2015-12-29 | 2017-07-07 | 中国移动通信集团公司 | A kind of data processing method and device |
| WO2017214856A1 (en) * | 2016-06-14 | 2017-12-21 | Intellectual Ventures Hong Kong Limited | Mitigation of cross-vm covert channel |
| CN107819811B (en) * | 2016-09-14 | 2021-05-18 | 阿里巴巴集团控股有限公司 | Data communication method, device and equipment |
| CN108023861B (en) * | 2016-11-03 | 2020-09-11 | 沈阳高精数控智能技术股份有限公司 | Industrial non-military area deployment and access method for open type numerical control system |
| CN106790713B (en) * | 2017-03-08 | 2019-09-20 | 中国人民解放军国防科学技术大学 | Across data center virtual machine migration method under cloud computing environment |
| WO2018201461A1 (en) * | 2017-05-05 | 2018-11-08 | 华为技术有限公司 | Method and device for migrating virtual machine and virtualization system |
| CN107294865B (en) * | 2017-07-31 | 2019-12-06 | 华中科技大学 | load balancing method of software switch and software switch |
| CN112791413B (en) * | 2021-02-04 | 2024-02-23 | 网易（杭州）网络有限公司 | Game prop data processing method and device, processor and electronic device |
| CN114143209B (en) * | 2021-11-08 | 2022-10-21 | 浙江大学 | System and method for controlling elastic expansion of channel in network measurement |
| CN114281246B (en) * | 2021-11-26 | 2023-08-25 | 苏州浪潮智能科技有限公司 | Cloud hard disk online migration method, device and equipment based on cloud management platform |
| CN114679461B (en) * | 2022-03-30 | 2023-02-14 | 浙江大学 | Cloud network session connectivity guarantee method and system for virtual machine live migration scene |
| CN115208813B (en) * | 2022-09-14 | 2022-11-25 | 腾讯科技（深圳）有限公司 | Method, device, equipment and storage medium for migrating border gateway protocol |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102118458A (en) * | 2011-03-10 | 2011-07-06 | 浪潮(北京)电子信息产业有限公司 | Method and system for live migration of virtual machine |
| CN102185774A (en) * | 2011-05-10 | 2011-09-14 | 中兴通讯股份有限公司 | Method, monitor and system for seamless migration of virtual machine |
| CN102314377A (en) * | 2010-06-30 | 2012-01-11 | 国际商业机器公司 | The method of accelerator and the migration of realization virtual support machine thereof |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20060069761A1 (en) * | 2004-09-14 | 2006-03-30 | Dell Products L.P. | System and method for load balancing virtual machines in a computer network |
-
2012
- 2012-06-30 CN CN201280000865.7A patent/CN102884763B/en active Active
- 2012-06-30 WO PCT/CN2012/077983 patent/WO2014000292A1/en active Application Filing
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102314377A (en) * | 2010-06-30 | 2012-01-11 | 国际商业机器公司 | The method of accelerator and the migration of realization virtual support machine thereof |
| CN102118458A (en) * | 2011-03-10 | 2011-07-06 | 浪潮(北京)电子信息产业有限公司 | Method and system for live migration of virtual machine |
| CN102185774A (en) * | 2011-05-10 | 2011-09-14 | 中兴通讯股份有限公司 | Method, monitor and system for seamless migration of virtual machine |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2014000292A1 (en) | 2014-01-03 |
| CN102884763A (en) | 2013-01-16 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102884763B (en) | Cross-data-center virtual machine migration method, service control gateway and system | |
| US11722410B2 (en) | Policy plane integration across multiple domains | |
| EP3824602B1 (en) | Multi-cloud connectivity using srv6 and bgp | |
| CN103516782B (en) | The distributed treatment of network equipment task | |
| CN107624240B (en) | Configuration of network elements for automated policy-based routing | |
| CN103997414B (en) | Generate method and the network control unit of configuration information | |
| EP2880829B1 (en) | Adaptive infrastructure for distributed virtual switch | |
| KR101473783B1 (en) | Method and apparatus for control of dynamic service chaining by using tunneling | |
| CN106713137B (en) | VPN method, device and system based on segmented routing and SDN technology | |
| US11190444B2 (en) | Configuration mechanisms in a switchless network | |
| US20170264496A1 (en) | Method and device for information processing | |
| CN103548376A (en) | Implementing EPC in a cloud computer with OPENFLOW data plane | |
| US10630508B2 (en) | Dynamic customer VLAN identifiers in a telecommunications network | |
| CN104584491A (en) | System and method providing distributed virtual routing and switching (DVRS) | |
| EP3621243B1 (en) | Virtual network creation method, apparatus and transport network system | |
| CN104584484A (en) | System and method providing policy based data center network automation | |
| CN104753713A (en) | SDN (Self-Defending Network) service deployment method and SDN controller | |
| CN107733795B (en) | Ethernet virtual private network EVPN and public network intercommunication method and device | |
| CN105162704A (en) | Multicast replication method and device in Overlay network | |
| CN104994019B (en) | A kind of horizontal direction interface system for SDN controllers | |
| CN112671811B (en) | Network access method and equipment | |
| US10015074B1 (en) | Abstract stack ports to enable platform-independent stacking | |
| CN108259292B (en) | Method and device for establishing tunnel | |
| WO2017169947A1 (en) | Operation device, communication system, and update method | |
| EP2278754B1 (en) | Method and system for network communications utilizing shared scalable resources |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant |