CN104954182B - A kind of method and apparatus for configuring Virtual Server Cluster - Google Patents
A kind of method and apparatus for configuring Virtual Server Cluster Download PDFInfo
- Publication number
- CN104954182B CN104954182B CN201510314351.4A CN201510314351A CN104954182B CN 104954182 B CN104954182 B CN 104954182B CN 201510314351 A CN201510314351 A CN 201510314351A CN 104954182 B CN104954182 B CN 104954182B
- Authority
- CN
- China
- Prior art keywords
- virtual
- address
- server
- virtual server
- multichannel
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 47
- 230000036541 health Effects 0.000 claims description 46
- GOLXNESZZPUPJE-UHFFFAOYSA-N spiromesifen Chemical compound CC1=CC(C)=CC(C)=C1C(C(O1)=O)=C(OC(=O)CC(C)(C)C)C11CCCC1 GOLXNESZZPUPJE-UHFFFAOYSA-N 0.000 claims description 13
- 230000005540 biological transmission Effects 0.000 claims description 6
- 239000011800 void material Substances 0.000 claims description 5
- 238000010586 diagram Methods 0.000 description 5
- 241000283070 Equus zebra Species 0.000 description 2
- 230000008859 change Effects 0.000 description 2
- 241000029811 Equus burchellii quagga Species 0.000 description 1
- 230000009471 action Effects 0.000 description 1
- 238000013459 approach Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000002349 favourable effect Effects 0.000 description 1
- 230000000977 initiatory effect Effects 0.000 description 1
- 238000007689 inspection Methods 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 238000011084 recovery Methods 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/08—Configuration management of networks or network elements
- H04L41/0803—Configuration setting
- H04L41/0823—Configuration setting characterised by the purposes of a change of settings, e.g. optimising configuration for enhancing reliability
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/08—Configuration management of networks or network elements
- H04L41/0803—Configuration setting
- H04L41/0823—Configuration setting characterised by the purposes of a change of settings, e.g. optimising configuration for enhancing reliability
- H04L41/0826—Configuration setting characterised by the purposes of a change of settings, e.g. optimising configuration for enhancing reliability for reduction of network costs
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L47/00—Traffic control in data switching networks
- H04L47/70—Admission control; Resource allocation
- H04L47/78—Architectures of resource allocation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L47/00—Traffic control in data switching networks
- H04L47/70—Admission control; Resource allocation
- H04L47/80—Actions related to the user profile or the type of traffic
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The embodiment provides a kind of method and apparatus for configuring Virtual Server Cluster.The described method includes：On multiple virtual servers in Virtual Server Cluster and the operation state Routing Protocol example on the routing device being connected with the multiple virtual server；Send the link information of corresponding virtual IP address to the routing device respectively from the multiple virtual server；According to the link information of corresponding virtual IP address, corresponding multichannel route of the generation for the multiple virtual server on the routing device；And route by multichannel, it will be assigned to corresponding virtual server with the corresponding service traffics of virtual IP address from the routing device.The present invention solves the problems, such as the performance bottleneck of single virtual server, and causes the extension of Virtual Server Cluster also to become simple and convenient, significantly reduces O＆M cost.
Description
The application is the divisional application of following patent application：
Application number：201210265130.9
The applying date：On July 27th, 2012
Denomination of invention：A kind of method and apparatus of configuration server cluster
Technical field
The present invention relates to virtual server, more particularly to a kind of side for being used to configure Virtual Server Cluster (cluster)
Method and device.
Background technology
Virtual server is as network access equipment, the load balancing of responsible flow, it is necessary to have high availability and height
Performance.High availability is by VRRP (Virtual Router Redundancy Protocol, virtual router redundance at present
Agreement) heart-beat protocol realizes.The purpose of VRRP heart-beat protocols design is to solve the Single Point of Faliure of static routing initiation
Problem.The core of VRRP is a selection agreement, the responsibility of a virtual router can be dynamically assigning on LAN
One in VRRP routers.The VRRP routers of control virtual router ip address are known as active router, it is responsible for forwarding number
These virtual ip address are arrived according to bag.Once active router is unavailable, this selection course provides for dynamic failure transfer
System, this allows for the IP address of virtual router can be as the first hop router of acquiescence of end host.Use the good of VRRP
Place is the availability for the default path for having higher, without configuring dynamic routing or route discovery association on each end host
View.
In order to use VRRP heart-beat protocols, virtual server has used User space program Keepalived in configuration.
Keepalived realizes VRRP heart-beat protocols, and when VRRP heartbeats change, is responsible for the management of VIP.
The general configuration of Virtual Server Cluster in the prior art is shown in Fig. 1：Using two virtual servers, virtually
VRRP heart-beat protocols are used between server, virtual IP address is bound on the main virtual server (priority=110) come is selected,
And externally provide service.And main virtual server periodically sends VRRP heartbeats, so as to standby virtual server (priority=90)
Know that main virtual server is still effective.Wherein, main virtual server is by the priority in VRRP heart-beat protocols
(Priority) for field come what is determined, priority maximum becomes main virtual server.
When the service routine of main virtual server breaks down, the state of two virtual servers can be changed into such as figure
State shown in 2：Standby virtual server monitors VRRP heartbeats, in the situation for the heartbeat message for not receiving main virtual server
Under, main virtual server is just automatically become, adapter virtual IP address, externally provides service.Then, standby virtual server is periodically sent
VRRP heartbeat messages.Subsequently, after the service recovery of main virtual server, can actively seize virtual on standby virtual server
IP, will also come back on main virtual server as main virtual server, flow again.Pass through the above process, Dang Yitai
When the service of virtual server is broken down, in addition virtual server can the service of soon taking over, realize height
Availability.
VRRP agreements are a kind of routing protocols, when being routed, can only have an active router into walking along the street
By forwarding.The scene that virtual server uses is corresponded to, a virtual IP address can only be bundled in a virtual clothes within a period of time
It is engaged on device, in this way, may result in following problem：
(1) single virtual server becomes performance bottleneck：Because the flow of specific virtual IP address within a certain period of time can only be by
It is forwarded on a virtual server, if the corresponding flow of the virtual IP address is very big, which will become performance bottle
Neck；
(2) extension of Virtual Server Cluster is complex：Under normal circumstances, two virtual servers can be used to form one
A cluster provides service, but as the increase of business number and flow, clustering performance can run into bottleneck, needs extension empty at this time
Intend server cluster, there are the following two kinds means to be extended：(a) cluster of two virtual server, its problem are created
It is to need artificially to divide business between multiple clusters, to carry out flow equalization, if some service traffics becomes larger, it is also necessary to
When be adjusted, (b) increase virtual server to original cluster, its problem be to need to be artificially each void of each delineation of activities
Intend the priority of server, to realize the high availability of the flow equalization of each virtual server and each business, Yi Santai
Exemplified by the cluster of virtual server (assuming that respectively virtual server A, virtual server B, virtual server C), it is assumed that the collection
Group undertakes three business (business 1, business 2, business 3).Under desired configuration, the priority that business 1 is set is：Virtual server
A->110, virtual server B->90, virtual server C->70；The priority that business 2 is set is virtual server B->110, it is empty
Plan server A->90, virtual server C->70；The priority that business 3 is set is virtual server C->110, virtual server
B->90, virtual server A->70.In this way, in the case of normal work, the flow of three business falls on three virtually respectively
On server.But if being further added by a virtual server D, then the priority of each business on virtual server D
Set just extremely complex and cumbersome.
The content of the invention
In order at least solve above-mentioned technical problem, the present invention provides a kind of method for configuring Virtual Server Cluster
And device.
According to a first aspect of the present invention, there is provided a kind of method for configuring Virtual Server Cluster, including：
It is connected on multiple virtual servers in Virtual Server Cluster and with the multiple virtual server
Routing device on operation state Routing Protocol example；
Send the link information of corresponding virtual IP address to the routing device respectively from the multiple virtual server；
According to the link information of corresponding virtual IP address, generation is for the multiple virtual clothes on the routing device
The corresponding multichannel route of business device；And
It is route, will be assigned to from the routing device with the corresponding service traffics of virtual IP address corresponding virtual by multichannel
Server.
Preferably, in the case where multichannel route is multichannel equivalent route, set by multichannel route from the route
Standby the step of being assigned to corresponding virtual server with the corresponding service traffics of virtual IP address, includes：It is of equal value by the multichannel
Route, corresponding virtual server will be evenly distributed to from the routing device with the corresponding service traffics of virtual IP address.
Preferably, described route by multichannel from the routing device will be assigned to the corresponding service traffics of virtual IP address
The step of corresponding virtual server, includes：It is route by the multichannel, will be corresponding with virtual IP address from the routing device
Service traffics are assigned to corresponding virtual server according to the priority of virtual server.
Preferably, the method further includes：Sent out respectively to the routing device from the multiple virtual server described
Before the step of sending the link information of corresponding virtual IP address, the virtual IP address is tied to corresponding virtual server.
Preferably, the method further includes：Sent out respectively to the routing device from the multiple virtual server described
Before the step of sending the link information of corresponding virtual IP address, forbid responding the request for the virtual IP address on virtual server
Message and forbid source address be the virtual IP address request message.
Preferably, the method further includes：In the link information according to corresponding virtual IP address in the route
After the step of generation is route for the corresponding multichannel of the multiple virtual server in equipment, and pass through multichannel described
Route from the routing device will be assigned to corresponding virtual server with the corresponding service traffics of virtual IP address the step of before,
Pair multiple real server being connected with the multiple virtual server carry out health examination.
Preferably, be connected with some virtual server and with the corresponding each real server of corresponding virtual IP address
In, will not be with the virtual IP address phase if the ratio of the real server of health examination failure is higher than pre-defined threshold value
Corresponding service traffics are assigned to the virtual server.
Preferably, be connected with some virtual server and with the corresponding each real server of corresponding virtual IP address
In, if there is the real server of health examination failure, and the ratio of the real server of health examination failure is less than pre-
The threshold value first defined, then reduce the priority of the virtual server.
According to a second aspect of the present invention, there is provided a kind of device for being used to configure Virtual Server Cluster, including：
Run module, on multiple virtual servers in Virtual Server Cluster and with it is the multiple virtual
Operation state Routing Protocol example on the routing device that server is connected；
Sending module, for sending corresponding virtual IP address to the routing device respectively from the multiple virtual server
Link information；
Generation module, for the link information according to corresponding virtual IP address, generates on the routing device and is used for
The corresponding multichannel route of the multiple virtual server；And
Distribution module, will be with virtual IP address corresponding service traffics point from the routing device for being route by multichannel
It is fitted on corresponding virtual server.
Preferably, in the case where multichannel route is multichannel equivalent route, the distribution module passes through the multichannel
Equivalent route, corresponding virtual server will be evenly distributed to from the routing device with the corresponding service traffics of virtual IP address.
Preferably, the distribution module is route by the multichannel, will be corresponding with virtual IP address from the routing device
Service traffics are assigned to corresponding virtual server according to the priority of virtual server.
Preferably, described device further includes：Binding module, in the sending module from the multiple virtual server
Before the link information of corresponding virtual IP address is sent to the routing device respectively, the virtual IP address is tied to corresponding virtual
Server.
Preferably, described device further includes：Disabled module, in the sending module from the multiple virtual server
Before sending the link information of corresponding virtual IP address to the routing device respectively, response is forbidden to be directed to institute on virtual server
State the request message of virtual IP address and forbid the request message that source address is the virtual IP address.
Preferably, described device further includes：Health examination module, in the generation module according to corresponding void
After the link information of plan IP generates the corresponding multichannel route for the multiple virtual server on the routing device,
And it route from the routing device and will be assigned to the corresponding service traffics of virtual IP address by multichannel in the distribution module
Before corresponding virtual server, pair multiple real server being connected with the multiple virtual server carry out healthy inspection
Look into.
Preferably, be connected with some virtual server and with the corresponding each real server of corresponding virtual IP address
In, if the ratio of the real server of health examination failure, higher than pre-defined threshold value, the distribution module will not be with
The corresponding service traffics of virtual IP address are assigned to the virtual server.
Preferably, be connected with some virtual server and with the corresponding each real server of corresponding virtual IP address
In, if there is the real server of health examination failure, and the ratio of the real server of health examination failure is less than pre-
The priority of the threshold value first defined, then the distribution module reduction virtual server.
The present invention provides a kind of method and apparatus for configuring Virtual Server Cluster.The present invention passes through business is empty
Intend the flow on IP averagely or be assigned to according to the priority of virtual server on multiple virtual servers, solve single void
Intend the performance bottleneck problem of server；Meanwhile according to an embodiment of the invention, the extension of Virtual Server Cluster also becomes simple
It is convenient：When needing to be extended Virtual Server Cluster, it is only necessary to increase the virtual server of respective numbers, and run
Dynamic routing protocol example, the service traffics in Virtual Server Cluster will be redistributed automatically, it is average or
Priority according to virtual server is assigned on all virtual servers (including newly-increased virtual server), is greatly dropped
Low O＆M cost.
Brief description of the drawings
According to the detailed description below in conjunction with attached drawing, above and other purpose and feature of the invention will become more clear
Chu, wherein：
Fig. 1 is the schematic block diagram generally configured of Virtual Server Cluster in the prior art；
Fig. 2 is the signal that generally configures of the Virtual Server Cluster when firmly virtual server breaks down in the prior art
Property block diagram；
Fig. 3 is the flow chart of the method according to an embodiment of the invention for being used to configure Virtual Server Cluster；
Fig. 4 is the block diagram of example system configuration according to an embodiment of the invention；And
Fig. 5 is the block diagram of the device according to an embodiment of the invention for being used to configure Virtual Server Cluster.
Embodiment
In the following detailed description, in order to illustrate with exemplary purpose, several details are described, in order to provide right
In the comprehensive understanding of each embodiment.However, for those of ordinary skills, can be in these no details
In the case of realize these embodiments.The component names used in the following description just for the sake of easily explanation, rather than in order to
Carry out any restrictions.
Fig. 3 is the flow chart of the method according to an embodiment of the invention for being used to configure Virtual Server Cluster.According to this
Invention, virtual server can include the virtual server based on various operating systems, such as the Virtual Service based on Linux
Device, the virtual server based on Unix, the virtual server based on Windows, virtual server based on Mac OS etc..
Hereinafter, by by taking the virtual server based on Linux as an example, exemplary description is carried out to the principle of the present invention, but this is described
It is merely exemplary, the scope of the present invention is not limited to this, and the principle of the present invention is readily applicable to based on other operation systems
The various virtual servers of system.
According to an embodiment of the invention, in the method 100 for configuring Virtual Server Cluster, at the beginning, step is performed
Rapid S101：It is being connected on multiple virtual servers in Virtual Server Cluster and with the multiple virtual server
Operation state Routing Protocol example on routing device.
According to an embodiment of the invention, the dynamic routing protocol can include routing information protocol (Routing
Information Protocol, RIP), Border Gateway Protocol (Border Gateway Protocol, BGP), it is open most
Short path priority protocol (Open Shortest Path First, OSPF) etc..Hereinafter, will by taking ospf protocol as an example,
Exemplary statement is carried out to the principle of the present invention, but this describes what is be merely exemplary, the principle of the present invention is equally applicable to
Other dynamic routing protocol.
First, it is real that ospf protocol is run on multiple virtual servers that be in the Virtual Server Cluster based on Linux
Example.According to an embodiment of the invention, can be realized using zebra the and ospfd components in Open-Source Tools quagga to OSPF
The renewal of local routing table is responsible in the support of agreement, wherein zebra, and ospfd is responsible for the realization of ospf agreements, and is transported with other
The equipment of row ospfd communicates.When configuring ospfd, it is necessary to the network segment of VIP is put into the region setting of ospfd.
In addition, will on the routing device being connected with the multiple virtual server operation state Routing Protocol example.
In addition, also equivalent route is configured on the routing device.According to an embodiment of the invention, the routing device can be with
It is router or interchanger.According to an embodiment of the invention, should be by the network card configuration of the multiple virtual server in difference
The network segment, also should be guaranteed that the OSPF examples of router/switch and each virtual server operation are not at ospf protocol definition
Identical region in.In addition, in order to enable each virtual server and router/switch normally to learn to neighborhood
And communicate, they need to set identical region and Authentication-Type.
After step slol, step S103 is performed：Sent out respectively to the routing device from the multiple virtual server
Send the link information of corresponding virtual IP address.
According to an embodiment of the invention, before step S103 is performed, step S1001 can be first carried out：Will be described virtual
IP is tied to corresponding virtual server.In order to enable ospf protocol to work normally, it is necessary to which virtual IP address is tied to local phase
On the input/output interface for the virtual server answered.
In addition, before step S103 is performed, step S1001 ' can also be first carried out：Forbid responding on virtual server
Request message for the virtual IP address and forbid the request message that source address is the virtual IP address.For example, can incite somebody to action
The arp_ignore of all network interface cards of virtual server is arranged to 1, i.e. forbids responding the arp request messages for virtual IP address, with
Prevent interference of the arp information to OSPF；And the arp_annouce that can set all network interface cards of virtual server is 2, i.e. is prohibited
Only source address is the request message of virtual IP address, this is also for preventing interference of the arp information to OSPF.
After step s 103, step S105 is performed：According to the link information of corresponding virtual IP address, in the route
Generation is route for the corresponding multichannel of the multiple virtual server in equipment.According to an embodiment of the invention, the multichannel
Route can be the multichannel route of multichannel equivalent route or non-equivalence.
Afterwards, step S107 is performed：It is route by multichannel, will be with the corresponding Business Stream of virtual IP address from the routing device
Amount is assigned to corresponding virtual server.Wherein, in the case where multichannel route is multichannel equivalent route, in step S107
In, by the multichannel equivalent route, phase will be evenly distributed to the corresponding service traffics of virtual IP address from the routing device
The virtual server answered.And in the case where multichannel route is non-equivalent route, then it is route by the multichannel, from described
Routing device will be assigned to corresponding Virtual Service with the corresponding service traffics of virtual IP address according to the priority of virtual server
Device.
For example, see Fig. 4, the block diagram of example system configuration according to an embodiment of the invention illustrated therein is.Such as Fig. 4 institutes
Show, Virtual Server Cluster provides service by the routing device being connected with them to client.Assuming that shared n virtual
IP-virtual IP address _ 1 to virtual IP address _ n, virtual server 1,2,3 is bound with virtual IP address _ 1, and the service traffics on virtual IP address _ 1 will divide
It is fitted on virtual server 1,2,3 this 3 virtual servers.Assuming that routing device is used for the multichannel road of virtual server 1,2,3
By being not equivalent route, and assume that virtual server 1,2,3 has 90,100,110 priority respectively.In the case,
It is route by the multichannel, will be distributed from the routing device with the corresponding service traffics in virtual IP address _ 1 according to above-mentioned priority
To virtual server 1,2,3.At this time, the virtual server 3 with limit priority (110) will be assigned to most Business Streams
Amount.It should be noted that said system configuration and the setting of each virtual server priority are only example, those skilled in the art's energy
It is enough to understand：The principle of the present invention is equally applicable to other system configurations and priority and sets.
According to an embodiment of the invention, after above-mentioned steps S105, before step S107, it can also carry out step
S106：Pair multiple real server being connected with the multiple virtual server carry out health examination.
Wherein, be connected with some virtual server and with the corresponding each real server of corresponding virtual IP address
In, will not be with the virtual IP address phase if the ratio of the real server of health examination failure is higher than pre-defined threshold value
Corresponding service traffics are assigned to the virtual server.
Alternatively, in the virtual server based on Linux, the health examination for real server is to pass through program
What keepalived was realized, in order to realize above-mentioned function, it is necessary to change keepalived programs：It is corresponding true in some virtual IP address
When the ratio of real server health examination failure is higher than pre-defined threshold value, ip orders are called to delete bound virtual IP address.
Still by taking the system configuration in Fig. 4 as an example, it is assumed that 1 rear end of virtual server includes three real server：True clothes
Be engaged in device a, b, c.Assuming that in health examination, real server a and b health examination failure, and real server c health examination into
Work(, it is assumed that above-mentioned pre-defined threshold value is 60%, then the ratio of the real server of health examination failure is higher than fixed in advance
The threshold value of justice, routing device just no longer will be assigned to virtual server 1 with the corresponding service traffics in virtual IP address _ 1.
According to an embodiment of the invention, it is being connected with some virtual server and corresponding with corresponding virtual IP address
In each real server, if there is health examination failure real server, and health examination failure real server
Ratio less than pre-defined threshold value, then reduce the priority of the virtual server.
Still by taking the system configuration in Fig. 4 as an example, if in health examination, real server a health examination failure, and it is true
Real server b and c health examination success, it is still assumed that above-mentioned pre-defined threshold value is 60%, and health examination at this time fails true
The ratio of real server can reduce the priority of virtual server 1, so as to reduce distribution at this time less than pre-defined threshold value
Service traffics to virtual IP address _ 1 of virtual server 1.
The present invention provides a kind of method for configuring Virtual Server Cluster.The present invention is by by business virtual IP address
Flow it is average or be assigned to according to the priority of virtual server on multiple virtual servers, solve single virtual service
The performance bottleneck problem of device；Meanwhile according to an embodiment of the invention, the extension of Virtual Server Cluster also becomes simple and convenient：
When needing to be extended Virtual Server Cluster, it is only necessary to increase the virtual server of respective numbers, and operation state
Routing Protocol example, the service traffics in Virtual Server Cluster will be redistributed automatically, it is average or according to
The priority of virtual server is assigned on all virtual servers (including newly-increased virtual server), is significantly reduced
O＆M cost.
Corresponding with above-mentioned method 100, present invention also offers a kind of device for being used to configure Virtual Server Cluster
200, referring to Fig. 5, which includes：
Run module 201, on multiple virtual servers in Virtual Server Cluster and with it is the multiple
Operation state Routing Protocol example on the routing device that virtual server is connected, the operation module 201 can be used in execution
State the step S101 in method 100；
Sending module 203, it is corresponding virtual for being sent respectively to the routing device from the multiple virtual server
The link information of IP, the sending module 203 can be used for performing the step S103 in the above method 100；
Generation module 205, for the link information according to corresponding virtual IP address, generates on the routing device and uses
It is route in the corresponding multichannel of the multiple virtual server, which can be used for performing in the above method 100
Step S105；And
Distribution module 207, will be with the corresponding service traffics of virtual IP address from the routing device for being route by multichannel
Corresponding virtual server is assigned to, which can be used for performing the step S107 in the above method 100.
In a preferred embodiment of the invention, in the case where multichannel route is multichannel equivalent route, the distribution
Module 207, will be with the corresponding service traffics mean allocation of virtual IP address from the routing device by the multichannel equivalent route
To corresponding virtual server.
In a preferred embodiment of the invention, the distribution module 207 is route by the multichannel, from the routing device
With the corresponding service traffics of virtual IP address corresponding virtual server will be assigned to according to the priority of virtual server.
In a preferred embodiment of the invention, described device 200 further includes binding module 2001, in the transmission mould
, will before block 203 sends the link information of corresponding virtual IP address to the routing device respectively from the multiple virtual server
The virtual IP address is tied to corresponding virtual server, which can be used for performing the step in the above method 100
Rapid S1001.
In a preferred embodiment of the invention, described device 200 further includes：Disabled module 2001 ', in the transmission
Before module 203 sends the link information of corresponding virtual IP address to the routing device respectively from the multiple virtual server,
That forbids the request message responded for the virtual IP address on virtual server and forbid source address for the virtual IP address please
Message is sought, which can be used for performing the step S1001 ' in the above method 100.
In a preferred embodiment of the invention, described device 200 further includes health examination module 206, in the life
Generated on the routing device according to the link information of corresponding virtual IP address into module 205 and virtually taken for the multiple
It is engaged in after the corresponding multichannel route of device, and route in the distribution module 207 by multichannel will be with from the routing device
The corresponding service traffics of virtual IP address are assigned to before corresponding virtual server, pair are connected with the multiple virtual server
Multiple real server carry out health examination, the health examination module 206 can be used for perform the above method 100 in step
S106。
In a preferred embodiment of the invention, it is being connected with some virtual server and opposite with corresponding virtual IP address
In each real server answered, if the ratio of the real server of health examination failure is higher than pre-defined threshold value, institute
The virtual server will not be assigned to the corresponding service traffics of the virtual IP address by stating distribution module 207.
In a preferred embodiment of the invention, it is being connected with some virtual server and opposite with corresponding virtual IP address
In each real server answered, if there is the real server of health examination failure, and the true of health examination failure takes
The ratio of business device reduces the priority of the virtual server less than pre-defined threshold value, the then distribution module 207.
Since above-mentioned each device embodiment is corresponding with aforementioned approaches method embodiment, no longer to each device embodiment into
Row is described in detail.
The present invention can realize in any suitable form, including hardware, software, firmware or their any combination.
Alternatively, the present invention can be implemented at least partially as operating on one or more processors and/or digital signal processor
Computer software.The device and module of the embodiment of the present invention can physically, functionally and logically with any appropriate
Mode realize.Each function according to the present invention can be in individual unit, in multiple units or be used as other functions
The part of unit is realized.Similarly, the present invention can realize in individual unit, or can be physically and functionally
It is distributed between different units and processor.
Although the present invention has been described in connection with some embodiments, but the present invention is not intended to be limited to spy set forth herein
Setting formula.On the contrary, the scope of the present invention is only limited by the claims that follow.In addition, although feature may look like knot
Close specific embodiment and be described, but it will be appreciated by those of ordinary skill in the art that, it can combine institute according to the present invention
The various features of the embodiment of description.In detail in the claims, word " comprising " is not precluded from the presence of other modules or step.
In addition, although being individually listed, but multiple modules or method and step can be by such as individual units or processor
Realize.In addition, although individually feature is possibly comprised in different claims, but these features possibly can be favourable
Ground is combined, and comprising being not meant to that the combination of feature is infeasible in different claims.In addition, feature
It is contained in a kind of claim categories (such as claim to a method) and is not meant to the category, but represents this feature
Other claim categories (such as device claim) can be equally suitably applied to.In addition, in claim feature it is suitable
Sequence is not meant to necessary any particular order.Also, the order of each step is not meant to these in claim to a method
Step must sequentially be performed according to this.On the contrary, these steps can perform in any suitable order.In addition, odd number shape
The statement of formula does not exclude plural number.Therefore, for " one ", "one", the reference of " first ", " second " etc. do not exclude
Plural number.Reference numeral in claim is only label, without that should be regarded as the limitation to the scope of claim.
The invention also discloses：
A1. a kind of method (100) for being used to configure Virtual Server Cluster, including：
It is connected on multiple virtual servers in Virtual Server Cluster and with the multiple virtual server
Routing device on operation state Routing Protocol example (S101)；
Send the link information of corresponding virtual IP address to the routing device respectively from the multiple virtual server
(S103)；
According to the link information of corresponding virtual IP address, generation is for the multiple virtual clothes on the routing device
The corresponding multichannel route (S105) of business device；And
It is route, will be assigned to from the routing device with the corresponding service traffics of virtual IP address corresponding virtual by multichannel
Server (S107).
A2. the method as described in A1, wherein in the case where multichannel route is multichannel equivalent route, passes through multichannel road
The step of by corresponding virtual server (S107) will be assigned to the corresponding service traffics of virtual IP address from the routing device
Including：By the multichannel equivalent route, will be evenly distributed to from the routing device with the corresponding service traffics of virtual IP address
Corresponding virtual server.
A3. the method as described in A1, described route by multichannel will be with the corresponding industry of virtual IP address from the routing device
Business assignment of traffic included to the step of corresponding virtual server (S107)：It is route by the multichannel, from the routing device
With the corresponding service traffics of virtual IP address corresponding virtual server will be assigned to according to the priority of virtual server.
A4. the method as any one of A1-3, further includes：It is described from the multiple virtual server respectively to institute
Before stating the step of routing device sends link information (S103) of corresponding virtual IP address, the virtual IP address is tied to accordingly
Virtual server (S1001).
A5. the method as any one of A1-3, further includes：It is described from the multiple virtual server respectively to institute
Before stating the step of routing device sends link information (S103) of corresponding virtual IP address, forbid responding pin on virtual server
Request message to the virtual IP address and forbid the request message (S1001 ') that source address is the virtual IP address.
A6. the method as any one of A1-3, further includes：
Generated in the link information according to corresponding virtual IP address on the routing device for the multiple
After the step of corresponding multichannel route (S105) of virtual server, and set described by multichannel route from the route
Before standby the step of corresponding virtual server (S107) will be assigned to the corresponding service traffics of virtual IP address,
Pair multiple real server being connected with the multiple virtual server carry out health examination (S106).
A7. the method as described in A6, wherein being connected with some virtual server and opposite with corresponding virtual IP address
In each real server answered, if the ratio of the real server of health examination failure is higher than pre-defined threshold value, no
The virtual server will be assigned to the corresponding service traffics of the virtual IP address.
A8. the method as described in A6, wherein being connected with some virtual server and opposite with corresponding virtual IP address
In each real server answered, if there is the real server of health examination failure, and the true of health examination failure takes
The ratio of business device is less than pre-defined threshold value, then reduces the priority of the virtual server.
A9. a kind of device (200) for being used to configure Virtual Server Cluster, including：
Run module (201), on multiple virtual servers in Virtual Server Cluster and with it is described more
Operation state Routing Protocol example on the routing device that a virtual server is connected；
Sending module (203), it is corresponding empty for being sent respectively to the routing device from the multiple virtual server
Intend the link information of IP；
Generation module (205), for the link information according to corresponding virtual IP address, generates on the routing device
Corresponding multichannel for the multiple virtual server is route；And
Distribution module (207), will be with the corresponding Business Stream of virtual IP address from the routing device for being route by multichannel
Amount is assigned to corresponding virtual server.
A10. the device as described in A9, wherein in the case where multichannel route is multichannel equivalent route, the distribution
Module (207), will be with the corresponding service traffics average mark of virtual IP address from the routing device by the multichannel equivalent route
It is fitted on corresponding virtual server.
A11. the device as described in A9, the distribution module (207) are route by the multichannel, will from the routing device
With the corresponding service traffics of virtual IP address corresponding virtual server is assigned to according to the priority of virtual server.
A12. the device as any one of A9-11, further includes：Binding module (2001), in the transmission mould
Before block (203) sends the link information of corresponding virtual IP address to the routing device respectively from the multiple virtual server,
The virtual IP address is tied to corresponding virtual server.
A13. the device as any one of A9-11, further includes：Disabled module (2001 '), in the transmission mould
Before block (203) sends the link information of corresponding virtual IP address to the routing device respectively from the multiple virtual server,
That forbids the request message responded for the virtual IP address on virtual server and forbid source address for the virtual IP address please
Seek message.
A14. the device as any one of A9-11, further includes：
Health examination module (206), for being believed in the generation module (205) according to the link of corresponding virtual IP address
The generation on the routing device is ceased to be used for after the corresponding multichannel route of the multiple virtual server, and at described point
It route from the routing device by multichannel with module (207) and will be assigned to corresponding void with the corresponding service traffics of virtual IP address
Before intending server, pair multiple real server being connected with the multiple virtual server carry out health examination.
A15. the device as described in A14, wherein be connected with some virtual server and with corresponding virtual IP address phase
In corresponding each real server, if the ratio of the real server of health examination failure is higher than pre-defined threshold value,
The distribution module (207) will not be assigned to the virtual server with the corresponding service traffics of the virtual IP address.
A16. the device as described in A14, wherein be connected with some virtual server and with corresponding virtual IP address phase
In corresponding each real server, if there is the real server of health examination failure, and health examination failure is true
The ratio of server reduces the priority of the virtual server less than pre-defined threshold value, the then distribution module (207).
Claims (18)
1. a kind of method (100) for being used to configure Virtual Server Cluster, including：
On multiple virtual servers in Virtual Server Cluster and on the road being connected with the multiple virtual server
By operation state Routing Protocol example (S101) in equipment, the virtual server and the routing device set identical region
And Authentication-Type；
Send the link information (S103) of corresponding virtual IP address to the routing device respectively from the multiple virtual server；
According to the link information of corresponding virtual IP address, generated on the routing device and be used for the multiple virtual server
Corresponding multichannel route (S105)；And
It is route by multichannel, corresponding Virtual Service will be assigned to the corresponding service traffics of virtual IP address from the routing device
Device (S107).
2. the method as described in claim 1, wherein in the case where multichannel route is multichannel equivalent route, passes through multichannel
Route will be assigned to the step of corresponding virtual server (S107) from the routing device with the corresponding service traffics of virtual IP address
Suddenly include：, will be with the corresponding service traffics mean allocation of virtual IP address from the routing device by the multichannel equivalent route
To corresponding virtual server.
3. the method as described in claim 1, described to pass through multichannel road in the case where multichannel route is non-equivalent route
The step of by corresponding virtual server (S107) will be assigned to the corresponding service traffics of virtual IP address from the routing device
Including：It is route by the multichannel, will be with the corresponding service traffics of virtual IP address according to virtual server from the routing device
Priority be assigned to corresponding virtual server.
4. such as the method any one of claim 1-3, further include：It is described from the multiple virtual server respectively to
Before the routing device sends the step of link information (S103) of corresponding virtual IP address, the virtual IP address is tied to accordingly
Virtual server (S1001).
5. such as the method any one of claim 1-3, further include：It is described from the multiple virtual server respectively to
Before the routing device sends the step of link information (S103) of corresponding virtual IP address, forbid responding on virtual server
Request message for the virtual IP address and forbid the request message (S1001 ') that source address is the virtual IP address.
6. such as the method any one of claim 1-3, further include：
Generated in the link information according to corresponding virtual IP address on the routing device for the multiple virtual
After the step of corresponding multichannel route (S105) of server, and will from the routing device in described route by multichannel
Before the step of corresponding virtual server (S107) being assigned to the corresponding service traffics of virtual IP address,
Pair multiple real server being connected with the multiple virtual server carry out health examination (S106).
7. method as claimed in claim 6, wherein be connected with some virtual server and with corresponding virtual IP address phase
In corresponding each real server, if the ratio of the real server of health examination failure is higher than pre-defined threshold value,
The virtual server will not be assigned to the corresponding service traffics of the virtual IP address.
8. method as claimed in claim 6, wherein be connected with some virtual server and with corresponding virtual IP address phase
In corresponding each real server, if there is the real server of health examination failure, and health examination failure is true
The ratio of server is less than pre-defined threshold value, then reduces the priority of the virtual server.
9. a kind of device (200) for being used to configure Virtual Server Cluster, including：
Run module (201), on multiple virtual servers in Virtual Server Cluster and with the multiple void
Intend operation state Routing Protocol example on the routing device that server is connected, the virtual server and the routing device are set
Put identical region and Authentication-Type；
Sending module (203), for sending corresponding virtual IP address to the routing device respectively from the multiple virtual server
Link information；
Generation module (205), for the link information according to corresponding virtual IP address, generates on the routing device and is used for
The corresponding multichannel route of the multiple virtual server；And
Distribution module (207), will be with virtual IP address corresponding service traffics point from the routing device for being route by multichannel
It is fitted on corresponding virtual server.
10. device as claimed in claim 9, wherein in the case where multichannel route is multichannel equivalent route, described point
With module (207) by the multichannel equivalent route, will be averaged from the routing device with the corresponding service traffics of virtual IP address
It is assigned to corresponding virtual server.
11. device as claimed in claim 9, in the case where multichannel route is non-equivalent route, the distribution module
(207) it is route by the multichannel, will be with the corresponding service traffics of virtual IP address according to virtual server from the routing device
Priority be assigned to corresponding virtual server.
12. such as the device any one of claim 9-11, further include：Binding module (2001), in the transmission
Module (203) from the multiple virtual server respectively to the routing device send corresponding virtual IP address link information it
Before, the virtual IP address is tied to corresponding virtual server.
13. such as the device any one of claim 9-11, further include：Disabled module (2001 '), in the transmission
Module (203) from the multiple virtual server respectively to the routing device send corresponding virtual IP address link information it
Before, forbid responding the request message for being directed to the virtual IP address on virtual server and forbid source address as the virtual IP address
Request message.
14. such as the device any one of claim 9-11, further include：
Health examination module (206), for being existed in the generation module (205) according to the link information of corresponding virtual IP address
After generation is for the corresponding multichannel route of the multiple virtual server on the routing device, and in the distribution mould
Block (207) is route from the routing device by multichannel will be assigned to corresponding virtual clothes with the corresponding service traffics of virtual IP address
It is engaged in before device, pair multiple real server being connected with the multiple virtual server carry out health examination.
15. device as claimed in claim 14, wherein be connected with some virtual server and with corresponding virtual IP address
In corresponding each real server, if the ratio of the real server of health examination failure is higher than pre-defined threshold value,
Then the distribution module (207) will not be assigned to the virtual server with the corresponding service traffics of the virtual IP address.
16. device as claimed in claim 14, wherein be connected with some virtual server and with corresponding virtual IP address
In corresponding each real server, if there is the real server of health examination failure, and health examination failure is true
The ratio of real server reduces the preferential of the virtual server less than pre-defined threshold value, the then distribution module (207)
Level.
17. a kind of device for being used to configure Virtual Server Cluster, including：
One or more processor；
Memory, has program stored therein, and when described program is performed by one or more of processors, described program makes described
Device for configuring Virtual Server Cluster performs the method as described in any one in claim 1-8.
18. a kind of computer-readable recording medium, the computer-readable recording medium storage has program, when described program is located
When managing device execution so that the processor performs the method as described in any one in claim 1-8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510314351.4A CN104954182B (en) | 2012-07-27 | 2012-07-27 | A kind of method and apparatus for configuring Virtual Server Cluster |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210265130.9A CN102821044B (en) | 2012-07-27 | 2012-07-27 | Method and device for configuring server cluster |
| CN201510314351.4A CN104954182B (en) | 2012-07-27 | 2012-07-27 | A kind of method and apparatus for configuring Virtual Server Cluster |
Related Parent Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201210265130.9A Division CN102821044B (en) | 2012-07-27 | 2012-07-27 | Method and device for configuring server cluster |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104954182A CN104954182A (en) | 2015-09-30 |
| CN104954182B true CN104954182B (en) | 2018-05-11 |
Family
ID=47304905
Family Applications (2)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201210265130.9A Active CN102821044B (en) | 2012-07-27 | 2012-07-27 | Method and device for configuring server cluster |
| CN201510314351.4A Active CN104954182B (en) | 2012-07-27 | 2012-07-27 | A kind of method and apparatus for configuring Virtual Server Cluster |
Family Applications Before (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201210265130.9A Active CN102821044B (en) | 2012-07-27 | 2012-07-27 | Method and device for configuring server cluster |
Country Status (1)
| Country | Link |
|---|---|
| CN (2) | CN102821044B (en) |
Families Citing this family (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102821044B (en) * | 2012-07-27 | 2015-07-01 | 北京奇虎科技有限公司 | Method and device for configuring server cluster |
| CN104168193B (en) * | 2014-08-12 | 2017-12-15 | 华为技术有限公司 | A kind of method and routing device of Virtual Router Redundancy Protocol fault detect |
| CN104410531B (en) * | 2014-12-11 | 2018-07-20 | 上海百事通信息技术股份有限公司 | The system architecture method of redundancy |
| CN105939239B (en) * | 2015-07-31 | 2020-05-12 | 杭州迪普科技股份有限公司 | Data transmission method and device of virtual network card |
| CN106559246B (en) | 2015-09-30 | 2020-01-10 | 新华三技术有限公司 | Cluster implementation method and server |
| CN105515979B (en) * | 2015-12-29 | 2019-05-21 | 新浪网技术(中国)有限公司 | Ospf OSPF inter-network equilibrium retransmission method and system |
| CN105827464B (en) * | 2016-05-16 | 2019-03-19 | 江南大学 | Can automatically dispose virtual router construction method |
| CN108156008B (en) * | 2016-12-05 | 2021-03-26 | 北京国双科技有限公司 | Server configuration method and device |
| CN107465562B (en) * | 2017-09-25 | 2020-03-06 | 郑州云海信息技术有限公司 | Method, device and equipment for CTDB custom distribution of virtual IP |
| CN108881435B (en) * | 2018-06-15 | 2021-12-03 | 广东美的制冷设备有限公司 | Real-time clock providing method, server, home appliance, system, and medium |
| CN111314098A (en) * | 2018-12-11 | 2020-06-19 | 杭州海康威视系统技术有限公司 | Method and device for realizing VIP address drift in HA system |
| CN112583721B (en) * | 2020-11-30 | 2023-04-18 | 五八到家有限公司 | Service request routing method, device and medium |
| CN112866107B (en) * | 2021-01-25 | 2023-07-18 | 网宿科技股份有限公司 | IP address notification method, traffic guidance method and network equipment |
| CN112995054B (en) * | 2021-03-03 | 2023-01-20 | 北京奇艺世纪科技有限公司 | Flow distribution method and device, electronic equipment and computer readable medium |
| CN115604275B (en) * | 2022-11-08 | 2023-03-10 | 合肥臻谱防务科技有限公司 | Virtual special server distribution method in information interaction network |
| CN116886777B (en) * | 2023-09-06 | 2024-01-26 | 苏州浪潮智能科技有限公司 | Service flow distribution method and device for container arrangement platform |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1829167A (en) * | 2006-04-19 | 2006-09-06 | 曾锃 | Load balancing method for large-scale distributed system based on virtual route |
| CN101009662A (en) * | 2007-01-31 | 2007-08-01 | 杭州华为三康技术有限公司 | Message processing method, system and device based on the load balance technology |
| CN101207561A (en) * | 2006-12-22 | 2008-06-25 | 华为技术有限公司 | Cluster manager, cluster system as well as cluster managing method |
| CN101217448A (en) * | 2008-01-18 | 2008-07-09 | 福建星网锐捷网络有限公司 | A method and system to realize gateway dynamic load sharing |
| CN102821044B (en) * | 2012-07-27 | 2015-07-01 | 北京奇虎科技有限公司 | Method and device for configuring server cluster |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101018159A (en) * | 2007-03-12 | 2007-08-15 | 杭州华为三康技术有限公司 | Load balance method under the multi-gateway environment and DHCP server |
| US8547844B2 (en) * | 2007-07-10 | 2013-10-01 | Telefonaktiebolaget L M Ericsson (Publ) | System and method for balancing IP gateway services |
| US9054943B2 (en) * | 2009-12-23 | 2015-06-09 | Citrix Systems, Inc. | Systems and methods for mixed mode handling of IPv6 and IPv4 traffic by a virtual server |
-
2012
- 2012-07-27 CN CN201210265130.9A patent/CN102821044B/en active Active
- 2012-07-27 CN CN201510314351.4A patent/CN104954182B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1829167A (en) * | 2006-04-19 | 2006-09-06 | 曾锃 | Load balancing method for large-scale distributed system based on virtual route |
| CN101207561A (en) * | 2006-12-22 | 2008-06-25 | 华为技术有限公司 | Cluster manager, cluster system as well as cluster managing method |
| CN101009662A (en) * | 2007-01-31 | 2007-08-01 | 杭州华为三康技术有限公司 | Message processing method, system and device based on the load balance technology |
| CN101217448A (en) * | 2008-01-18 | 2008-07-09 | 福建星网锐捷网络有限公司 | A method and system to realize gateway dynamic load sharing |
| CN102821044B (en) * | 2012-07-27 | 2015-07-01 | 北京奇虎科技有限公司 | Method and device for configuring server cluster |
Also Published As
| Publication number | Publication date |
|---|---|
| CN102821044A (en) | 2012-12-12 |
| CN104954182A (en) | 2015-09-30 |
| CN102821044B (en) | 2015-07-01 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104954182B (en) | A kind of method and apparatus for configuring Virtual Server Cluster | |
| CN102158386B (en) | Distributed load balance for system management program | |
| US10003534B2 (en) | Multiple active L3 gateways for logical networks | |
| US11005747B2 (en) | Method for implementing network virtualization and related apparatus and communications system | |
| US8855116B2 (en) | Virtual local area network state processing in a layer 2 ethernet switch | |
| CN102771094B (en) | Distributed routing framework | |
| CN102067533B (en) | Port grouping for association with virtual interfaces | |
| US10075329B2 (en) | Customizable high availability switchover control of application delivery controllers | |
| CN1914867B (en) | Interface bundles in virtual network devices | |
| CN102763380B (en) | For the system and method for routing packets | |
| US8549120B2 (en) | System and method for location based address assignment in the distribution of traffic in a virtual gateway | |
| US20150334696A1 (en) | Resource provisioning method | |
| CN102845035A (en) | Method of identifying destination in virtual environment | |
| CN102792644B (en) | For the system and method for routing packets | |
| CN102025630A (en) | Load balancing method and load balancing system | |
| CN106105162A (en) | Load equalizer based on switch | |
| JP5107339B2 (en) | System and method for active geographic redundancy | |
| CN104065553B (en) | Virtual network moving method and relevant device | |
| CN113709220B (en) | High-availability implementation method and system of virtual load equalizer and electronic equipment | |
| Cheng et al. | Application-aware SDN routing for big data networking | |
| CN105721328A (en) | VRRP load balancing method, VRRP load balancing device and router | |
| CN104243304B (en) | The data processing method of non-full-mesh topological structure, equipment and system | |
| CN106209634B (en) | Learning method and device of address mapping relation | |
| CN107547394A (en) | A kind of load-balancing device dispositions method more living and device | |
| CN110300073A (en) | Cascade target selecting method, polyplant and the storage medium of port |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20220725 Address after: Room 801, 8th floor, No. 104, floors 1-19, building 2, yard 6, Jiuxianqiao Road, Chaoyang District, Beijing 100015 Patentee after: BEIJING QIHOO TECHNOLOGY Co.,Ltd. Address before: 100088 room 112, block D, 28 new street, new street, Xicheng District, Beijing (Desheng Park) Patentee before: BEIJING QIHOO TECHNOLOGY Co.,Ltd. Patentee before: Qizhi software (Beijing) Co.,Ltd. |
|
| TR01 | Transfer of patent right |