A kind of CDN acceleration system and method realized using virtualization technology
Technical field
Accelerate the present invention relates to the framework of the real time contents such as audio-video distribution and method more particularly to a kind of CDN dynamic
System and method.
Background technique
As the user of internet is increasing, user constantly promotes audio-video live streaming image quality/sound quality requirement, is broadcast live
The code stream of content is constantly promoted, while online number is also continuously increased, and the requirement of bandwidth and concurrent online number becomes system gradually
The about bottleneck of this business.It is calculated with the code stream of 1Mbps, the bandwidth of 1G is only capable of 1000 user concurrents of support, and to guarantee 100
It is online while general-purpose family, it is necessary to which that the bandwidth of 1000G, for single programme televised live, this expense is very high
's.On the other hand, 1,000,000 concurrent streaming access, being also one for the performance of common server can not complete
Task.So currently generalling use server hierarchies adds the technology of client p2p to share the number concurrently accessed simultaneously and will take
One access of business device is transferred to client, to mitigate access pressure and reduce the consumption of bandwidth.Such as patent
CN201510150133.1 just uses the framework of this CDN+P2P, is grouped between player (client) as P2P, and takes
It is engaged in being layered networking using source server+CDN the distribution server is such between device.Source server replicates live content several
Part, it is distributed to the CDN server at edge, each CDN server is responsible for user's access of a part, while passing through deployment P2P's
Support server (tracker, NAT are penetrated) can access mutually between client by groups of clients at different networks,
It can be with direct request CDN server.
Based on this framework, further can by CDN server and P2P support server according to carrier network/or
Person is that region zones are different Autonomous Domains (AS), several p2p subnets is formed, as mentioned in patent CN201510006008.3
Networking mode.It is to be connected in domain inside AS, there are also low volume datas to transmit between AS, belongs to interdomain connection.
Field is virtualized in cloud computing, by the technology of virtualization by distributed unused computing resource, storage resource
It organizes, by network route switching, then is packaged into an entirety and invents a single virtual machine and used to user,
It is also a current hot spot, such as patent CN201410468455.6, provides for a kind of storage solution of virtualization.
By installing the control unit of virtual machine on the server, local file system is controlled, and receive to come the concentration tune of automatic network
Degree, the storage of several servers are virtualized into a big storage, externally provide unified access interface.I.e. external call is deposited
The interface of access, or the interface calculated are stored up, by centralized dispatching, storage access is either calculated into demand assignment to a certain
A node returns again to result to interface after completion task.
Despite the use of the mode of CDN+P2P effectively increases the scale of direct broadcast service, reduces the consumption of bandwidth,
But this technology also faces some problems, first is the CDN bandwidth that this framework still needs to consume certain scale.Such as
When live streaming starts, client needs first to have a certain amount of CDN bandwidth consumption, could drive the access of P2P, i.e. client needs elder generation
There are a certain number of contents from CDN server, the interaction of P2P could be carried out among clients;Client be it is unstable,
It can exit P2P network at any time, exit P2P network if it is crucial P2P node, also result in the biggish of burst
CDN access;If concurrent user's quantity is insufficient, client still needs directly to use the bandwidth of CDN.Second is this network knot
Structure be and using binding, that is to say, that selected the program of client, will determine CDN network server program and
Group-network construction.The degree of coupling that whole network is at all levels is larger.
On the other hand, in current virtualization practice, usually by the computing capability of junior unit (CPU), storage capacity is converged
It gathers, task is sent by a control module and gives certain a few junior unit, then pools a big task again after the completion
As a result.Polymerization for scattered bandwidth resources, then without corresponding practice scheme.
Summary of the invention
The invention proposes a kind of novel architectural schemes, relies on and be arranged in the special of last mile of internet and set
It is standby, specifically as certain can use uplink and downlink have more than needed bandwidth network insertion router, or equipped with virtualization program simultaneously
And the electronic equipment etc. that can be surfed the Internet, it is characterized in that it is of less demanding to computing capability and storage capacity, but in the bandwidth of operator
Using upper, in user side PC upper one layer, can long-time stable access internet, so can preferably utilize
The bandwidth of the uplink/downlink of operator.These equipment are put together by way of virtualization, providing various can customize
Service.
In the present invention, these equipment all indicate (real device) with physical equipment RD, they form a void together
Quasi- server VM (virtual machine).RD is regarded as the container of an offer network service in the present invention, i.e., it can
To install any network server (RD APP) met the requirements, on the other hand it is the output list an of network bandwidth again
Member, that is RD can provide bandwidth resources to internet.An agent broker program, i.e. RD are fitted on these RD
On be provided with agent module, the effect of agent module is to monitor the state of RD, mainly RD upstream and downstream bandwidth state, obtains RD
Operation load, to RD send instruct.It is the API of virtualization in the top of agent, is connection RD and virtualization scheduling unit
Bridge.RD equipped with same services program can be organized into a big virtual server, provide network clothes described above
Business.For the client for accessing VM by network protocol (rtmp/http/rtsp/hls/p2p agreement), what he experienced
It is exactly a true server.For the caller for using the upper layer interface UI, namely one by one true that he manages
Real server.
A kind of CDN acceleration system realized using virtualization technology provided by the invention, comprising: CDN server, virtual clothes
Business device and client,
The CDN server is used for data distributing to the virtual server;
The virtual server for will the data distribution that receive to client;
Wherein, physical equipment RD is provided in the virtual server, the physical equipment RD is for uplink and downlink to be had more than needed
Bandwidth aggregation get up.
Further, the virtual server further comprises the API of virtualization, and the API of the virtualization is used for root
Optimum physical equipment RD is returned according to the request of client.Further include virtualization scheduling unit, the virtual scheduling unit be used for
The virtual server sends scheduling information, and the virtual server further comprises the API of virtualization, the virtualization
API is for realizing the physical equipment RD and the interaction for virtualizing scheduling unit.The client be support P2P client or
The client of P2P is not supported.
Further, the virtual server further comprises agent module, and the agent module is for controlling object
Manage the interaction between equipment RD.
Further, the virtual server further comprises RD APP module, and the client is to support the visitor of P2P
Family end forms P2P network between client;The RD APP module is used to physical equipment RD being added to client P2P network
In, so that physical equipment RD and other RD APP and client P2P node is carried out data exchange.
It further, further include cloud auxiliary system, the virtual server is used to be communicated with cloud auxiliary system,
Obtain the information from source station.
Correspondingly, the present invention also provides a kind of CDN accelerated methods realized using virtualization technology, comprising:
6. a kind of CDN accelerated method realized using virtualization technology characterized by comprising
S1, CDN server are by data distributing to virtual server;
S2, virtual server are by the data distribution received to client;
Physical equipment RD, the bandwidth that the physical equipment RD has more than needed uplink and downlink are provided in S3, the virtual server
It gathers.
Further, the virtual server further comprises the API of virtualization, and the API of the virtualization is according to visitor
The request at family end returns to optimum physical equipment RD.
Further, the virtual server further comprises agent module, and the agent module control physics is set
Interaction between standby RD.The client is the client for supporting P2P or the client for not supporting P2P.
Further, the virtual server further comprises RD APP module, and the client is to support the visitor of P2P
Family end, the RD APP module make physical equipment RD and other RD for physical equipment RD to be added in client P2P network
APP and client P2P node carry out data exchange.
Further, the virtual server is communicated with cloud auxiliary system, obtains the information from source station.
It include CDN server, virtual server and P2P node in present system, the CDN server is used for data
It is issued to the virtual server;The virtual server is by the data distribution received to the P2P node;The virtual clothes
Physical equipment RD is provided in business device, the physical equipment RD gets up the bandwidth aggregation that uplink and downlink is had more than needed.
The present invention configures several virtual servers, and as the CDN node at edge, upper layer is original true CDN service
Device layer only needs a link video content can be issued on virtual server here, then is forwarded by virtual server
To client.By the dependence of original pair of CDN server, it is changed into the use to virtual server, greatly reduces CDN server
Bandwidth consumption.Since RD equipment is usually that can guarantee to network for a long time for 24 hours, plus by AS rank to client
End carries out overall scheduling, judges load balancing by AS scheduling logic, the accessibility of RD equipment, choose automatically optimal RD equipment to
Client provides service, can also be in the situation of the overall bandwidth deficiency of VM, and the automatic dilatation for realizing VM, network service can be used
Property is seen on the whole not less than the CDN server in conventional architectures.
The present invention mainly relies on the specific physical equipment RD for being arranged in last mile of internet, specific such as certain
It can use the network insertion router of uplink and downlink bandwidth more than needed, or equipped with virtualization program and can surf the Internet personal electric
Brain etc. puts together these equipment by way of virtualization, provides the various services that can be customized.Specific such as sound regards
Frequency direct broadcast service proposes that new framework and implementation method form a virtualization services using above equipment using the present invention
Layer and traditional CDN-P2P network combine, and CDN layers of substitution and client carry out data transmission, and can effectively reduce live streaming
Business relies on the bandwidth of CDN.Further, since the flexibility of framework, it can also be by disposing different applications on RD, to mention
For different network services.
Detailed description of the invention
It in order to more clearly explain the embodiment of the invention or the technical proposal in the existing technology and advantage, below will be to implementation
Example or attached drawing needed to be used in the description of the prior art are briefly described, it should be apparent that, the accompanying drawings in the following description is only
It is only some embodiments of the present invention, for those of ordinary skill in the art, without creative efforts,
It can also be obtained according to these attached drawings other attached drawings.
Fig. 1 is the structural block diagram of the CDN acceleration system provided in an embodiment of the present invention realized using virtualization technology;
Fig. 2 is the system architecture diagram of the CDN acceleration system provided in an embodiment of the present invention realized using virtualization technology;
Fig. 3 is the block diagram of the CDN accelerated method provided in an embodiment of the present invention realized using virtualization technology.
Specific embodiment
Following will be combined with the drawings in the embodiments of the present invention, and technical solution in the embodiment of the present invention carries out clear, complete
Site preparation description, it is clear that described embodiments are only a part of the embodiments of the present invention, instead of all the embodiments.It is based on
Embodiment in the present invention, those of ordinary skill in the art without making creative work it is obtained it is all its
His embodiment, shall fall within the protection scope of the present invention.
Embodiment:
Referring to Figure 1, several physical equipments RD forms a VM (virtual machine).RD in the present invention by
The container of an offer network service is provided as, i.e., it can install any network server (RD APP) met the requirements,
On the other hand it is the output unit of a network bandwidth again, that is RD can provide bandwidth resources to internet.RD and visitor
Family end carries out data interaction, agent module is fitted on these RD, the effect of agent module is to monitor the state of RD, main
If RD upstream and downstream bandwidth state, the operation load of RD is obtained, sends and instructs to RD.In the top of agent module, setting is virtual
The API of change, the API of virtualization are the bridges for connecting RD and virtualizing scheduling unit, are chosen automatically by the API of virtualization optimal
RD equipment to client provide service.The upper layer interface UI with virtualization scheduling unit communicate, virtualization scheduling unit with virtually
Server communication.RD equipped with same services program can be organized into a big virtual server, provide net described above
Network service.
For the client for accessing VM by network protocol (rtmp/http/rtsp/hls/p2p agreement), he experiences
What is arrived is exactly a true server.For the caller for using the upper layer interface UI, he manage namely one by one
Real server.Here VM can also be communicated with the auxiliary system in cloud, the information from source station be obtained, as video is straight
Content source is broadcast, the distribution server is broadcast live to become a virtual CDN in VM, such as rtmp, http, hls are provided to player,
Rtsp, dash service etc. also includes the transmission service etc. of p2p.
In a particular application, illustrated for audio-video live streaming is provided using VM and is accelerated: these virtual servers are made
It for a virtualization applications layer, and is added in traditional CDN-P2P network, instead of CDN layers in original framework and player
Data transport functions.In realization, according to different operator domains, several virtual servers are configured, the CDN as edge
Node, upper layer are original true CDN server layers, and a link is only needed video content can be issued to void here
Intend on server, then P2P client is transmitted to by virtual server.It in actual use, is the robustness for guaranteeing system, it can be with
Several links are further added by, guarantee that system can be with steady operation.Nonetheless, this framework is also by original pair of CDN server
It relies on, is changed into the use to virtual server, greatly reduces the bandwidth consumption of CDN server.Since RD equipment is usually
It can guarantee to network for a long time for 24 hours, in addition being sentenced by carrying out overall scheduling to client in AS rank by AS scheduling logic
Disconnected load balancing, the accessibility of RD equipment choose optimal RD equipment to client automatically and provide service, can also be in the whole of VM
The situation of body bandwidth deficiency, the automatic dilatation for realizing VM, the availability of network service are seen on the whole not less than in conventional architectures
CDN server.
In addition, it is general to be also used as one kind other than accelerating as the live streaming of the audio-video of CDN for this virtual server
Solution provides the network service of any bandwidth consumption type, such as an application is installed on VM, realizes that video is unpacked/beaten
Packet/mux/demux/ decoding/encoding etc., it can become a source video server again, receive from client encoder
Push stream, is packaged as other formats for its transcoding and is sent to other CDN nodes.Also such as by the APP on replacement RD, VM is also
Vpn, proxy service etc. can be provided.Due to selecting different RD APP programs that can provide different functions, client
In fact the selection of RD APP is only depended on, switching APP will be easy more than the framework of change server end.
Fig. 2 is referred to, to realize the functions such as above-mentioned virtualization and acceleration, in overall architecture, whole system is divided into 5
A+1 public module of privately owned module, totally 6 modules.Public module is exactly player module, this can be general broadcasting
Device is also possible to be integrated with the special player of specific function.
Central control logic (unique): externally providing the interface of system access, and the interface including graphical interfaces is also possible to
The interface of API form carrys out the operation of control system to the mode of operation of one entirety of external user, for example sets virtual machine
Application type, the runtime parameters such as virtual machine bandwidth needed.Central control logic can convert these external setting-ups to simultaneously
Control instruction is issued to different Autonomous Domains (AS), and the executive condition of acquisition instruction.
VM management module (each AS mono-): this is the control module of virtualization.Including RD resource pool, i.e. this AS is all can
To manage the RD total Database of control;The warehouse RD APP, i.e., all application journeys that network service can be provided being loaded on RD
The set of sequence;API agent server, this is to carry out the agency that API is interacted with RD, receives the information of RD, and send an instruction to
Corresponding RD;VM control logic, its input can come from the control logic of AS, for example need to establish a virtual server,
It is to run certain APP that it, which is configured, needs that how many bandwidth etc. reserved;VM control logic can also receive the API agent service come
The RD device status information that device forwards, and further update RD resource pool.Here RD can also share the status information of RD
AS control logic is given, decision judgement is done by it.
CDN management module (each AS mono-): this is the CDN layer in conventional architectures, covers CDN Edge Server, this
Ground database can also include that channel manages library, P2P management server, across AS domain browsing logic if it is video live broadcast service
The modules such as control.
RD business module (each RD mono-): RD is the minimum unit of virtualization here, and each RD represents one can be with
There is provided bandwidth equipment, above include two logic modules, an agent module, play virtualization control logic and RD it
Between interaction function served as bridge.Another module is RD APP, and by loading different APP, different network clothes are may be implemented in RD
Business function.Here the loading of APP is dynamic, in RD operation, by the interaction of agent and VM control logic, from the storehouse RD APP
It downloads and is loaded into local in library.Also it is desirably integrated into the firmware of RD, becomes a part of RD firmware.If realizing live streaming industry
Business, APP are exactly the application program for being similar to direct broadcast server, and the downlink bandwidth that can use RD is obtained from source node/CDN
Video content, and be packaged into different formats again and be distributed to client using the upstream bandwidth of RD.Special, RD can also lead to
RD APP is crossed some P2P network oneself is added to, number is then exchanged by the connection of P2P and others RD APP/ client
According to.Depend on and is realized with specific RD APP.
AS control logic: being the control axis at the end AS, is responsible for for central control instruction being handed down to VM control logic and CDN is controlled
Logic processed, and cloud scheduling API can be responded and give client to return to an optimal RD, thus complete when client issues request
At the outer ministry dispatching closed loop of virtualization.Particularly, since all client scheduling decisions are all responded by this module, in necessity
When, it can also be instructed by issuing some temporary schedulings at central control module, the access of client is imported into CDN collection
Group, plays the role of one and temporarily shunts.AS includes: corresponding with service in current AS to the decision logic of the transparent scheduling of client
VM be made of which RD, the load state of each RD (the mainly bandwidth conditions of uplink and downlink and the grading of the prestige of RD).Root
According to the information of specific VM, determine which best RD the access of client is oriented to.Particularly, AS control logic can also basis
Preset condition is issued to VM management module and is instructed, and is carried out dynamic capacity-expanding either volume reduction to VM, is reached to RD bandwidth resources most
Good use.
Client: can be general player, such as the universal playing of the primary player/android of jwplayer/ios
Device etc. is also possible to the player for supporting specific function such as p2p to accelerate.If client does not support p2p, then client only can
Data are obtained from some RD, if supporting p2p, the letter of other peer in p2p network can be obtained with the interaction of P2P server
Then breath establishes the connection with other peer.Depending on the type of RD APP, i.e. RD APP is and client player is mating makes
With.Other than the player for being used as audio-video, client can also be other application clients, such as the client of vpn
Deng as long as there is corresponding RD APP to interact with him.
Fig. 3 is referred to, based on upper module, the present invention provides a kind of acceleration sides CDN realized using virtualization technology
Method, comprising:
S1, CDN server are by data distributing to virtual server;
S2, virtual server are by the data distribution received to client;
Physical equipment RD, the bandwidth that the physical equipment RD has more than needed uplink and downlink are provided in S3, the virtual server
It gathers.
The present invention mainly relies on the specific physical equipment RD for being arranged in last mile of internet, specific such as certain
It can use the network insertion router of uplink and downlink bandwidth more than needed, or equipped with virtualization program and can surf the Internet personal electric
Brain etc. puts together these physical equipments RD by way of virtualization, provides the various services that can be customized.Utilize this
Invention proposes that new framework and implementation method form a virtualization services layer and traditional CDN-P2P using above equipment
Network combines, and CDN layer of substitution carries out data transmission with client, can effectively reduce live broadcast service to the bandwidth of CDN according to
Rely.Further, since the flexibility of framework, it can also be by disposing different applications on RD, to provide different network services.
The above is a preferred embodiment of the present invention, it is noted that for those skilled in the art
For, various improvements and modifications may be made without departing from the principle of the present invention, these improvements and modifications are also considered as
Protection scope of the present invention.