A kind of video cloud computing transmission method
Technical field
The present invention relates to multimedia cloud computing and Video Codec optimal design field, particularly a kind of method of video being carried out encoding and decoding in Internet Transmission.
Background technology
In recent years, cloud computing enters into people's life gradually as a kind of emerging technology, and it can provide various calculation services and stores service by the Internet.By using cloud computing, user can obtain service as using " huge " computer from cloud.User no longer stores data on the computer of oneself, but is stored in cloud, so just visit data anywhere or anytime.Along with the propelling in Web epoch, multi-media network rises in the mode of service.At present, multimedia service becomes more diversified, and multimedia is calculated has become a kind of new technique gradually, and it can edit, process various media contents, as image, video, audio frequency, image etc.Because multi-media network is served millions of users simultaneously, need a large amount of computational resources, for the demand of multimedia cloud computing, grow with each passing day.
In cloud, carry out multimedia processing and be faced with various challenges simultaneously.First, owing to there is multimedia and the service of multiple types, as video conference, editing picture, VoIP, video editing etc., media cloud must provide polytype multimedia service; Secondly, according to dissimilar quality of service requirement, media cloud must be able to meet various multimedia service quality; Again, according to different networks, media cloud must have different network characteristicses, and the content of multimedia matching with network can be provided, to adapt to the different bandwidth of heterogeneous networks and time delay; Finally, according to different terminals, as computer, cell phone etc. has the equipment of different multimedia processing capacity, media cloud must can adapt to dissimilar equipment.At present, video is becoming propagation on the Internet and is measuring maximum media, because the transmission bandwidth of current network is limited and various terminal processing capacity are different, particularly mobile terminal computing capability and finite energy, make Video coding and transmission problem seem particularly outstanding.
A kind of compensation process that the present invention proposes based on above problem just.
As everyone knows, the amount of calculation of multimedia video encoding and decoding is larger, and also higher to the requirement of transmission bandwidth.The present invention is in existing video encoding standard, on the basis of the H.264 and universal video encoding standard HEVC of future generation generally having used, limited and the transmission problem for terminal computing capability in network and a kind of solution of proposing, to reach the computing capability of each terminal of maximum using network and the object of the network bandwidth.
Summary of the invention
During for solution transmission of video, existing transmission method is subject to limit on transmission bandwidth, the technical problem that video information transmission is excessively slow, and the present invention proposes a kind of video cloud computing transmission method, comprises the steps:
The video source data that step s1:P2P network (Peer-to-Peer network, peer-to-peer network, is called for short P2P) receiver, video transmitting terminal sends;
Terminal in idle condition in step s2:P2P network judgement current network;
Step s3:P2P network is divided into some piece of video by each frame of video in video source data, and all piece of video of each frame of video are distributed to each non-occupied terminal;
Step s4: comprise sub-step s41, s42 and s43:
Sub-step s41: the bandwidth of transmission network is inadequate between P2P network monitoring P2P network and video receiver, the non-occupied terminal in P2P network is transferred to Cloud Server by piece of video,
Sub-step s42: Cloud Server receiver, video sheet,
Sub-step s43: when Cloud Server is received video receiver request, video information is sent to video receiver;
Sub-step s6: video receiver receiver, video information.
Further,
Described video cloud computing transmission method also comprises step s5: between P2P network monitoring P2P network and video receiver, the bandwidth of transmission network is sufficient, and P2P network sends to video receiver by piece of video.
Further,
In step s5: between P2P network monitoring P2P network and video receiver, the bandwidth of transmission network is sufficient, and P2P network carries out lossy compression method coding by piece of video, and the piece of video that compressed encoding is crossed sends to video receiver;
In step s6: the piece of video that video receiver is crossed the compressed encoding receiving combines each frame of video after decoding, each frame of video of recombinant obtains video data.
Further,
In sub-step s42: combine each piece of video after Cloud Server is received piece of video and obtain frame of video;
In sub-step s43: when Cloud Server is received video receiver request, frame of video is sent to video receiver;
In step s6: combine each frame of video after video receiver receiver, video frame, obtain video data.
Further,
In sub-step s41: between P2P network monitoring P2P network and video receiver, the bandwidth of transmission network is inadequate, the non-occupied terminal in P2P network carries out lossless compression-encoding by piece of video, and the piece of video that compressed encoding is crossed is transferred to Cloud Server;
In sub-step s42: Cloud Server will receive that piece of video that compressed encoding is crossed combines each piece of video and obtains frame of video after decoding;
In sub-step s43: when Cloud Server is received video receiver request, frame of video is sent to video receiver;
In step s6: combine each frame of video after video receiver receiver, video frame, obtain video data.
Further,
In sub-step s42, Cloud Server carries out lossy compression method coding by frame of video;
In sub-step s43, when Cloud Server is received video receiver request, the frame of video that compressed encoding is crossed sends to video receiver;
In step s6: the frame of video that video receiver is crossed the compressed encoding receiving combines each frame of video after decoding, obtain video data.
Further,
In step s1: in P2P network, a terminal is as burst terminal;
In step s2: P2P network is divided into N terminal group, and each terminal group reports to burst terminal by the real-time computing of this group;
In step s3: burst terminal is divided into N piece of video according to the computing capability of each terminal group by each frame of video, and each piece of video is sent to each non-occupied terminal in counterpart terminal group;
In sub-step s41: between P2P network monitoring P2P network and video receiver, the bandwidth of transmission network is inadequate, in each terminal group, each non-occupied terminal carries out lossless compression-encoding to the piece of video receiving, in this group, complete at first the piece of video that the non-occupied terminal of compressed encoding crosses compressed encoding and be transferred to Cloud Server, in this group, other non-occupied terminals are abandoned compressed encoding.
Further,
In step s2: have a host node terminal in each terminal group, all the other are from nodal terminal, the real-time computing of host node terminal statistics place terminal group, and report to burst terminal;
In step s3: burst terminal sends to each piece of video counterpart terminal group's host node terminal, host node is transferred to each free time of this group from nodal terminal by the piece of video receiving;
In sub-step s41: when P2P network monitoring current network bandwidth inadequate, in each terminal group, each free time is carried out lossless compression-encoding from nodal terminal to the piece of video receiving, in this group, complete at first the piece of video that free time of compressed encoding crosses compressed encoding from nodal terminal and be transferred to Cloud Server, in this group, other free time are abandoned compressed encoding from nodal terminal.
Further,
In step s3: for each frame of video, the piece of video size that burst terminal is given i terminal group is: K*C
i/
, wherein, the number of the minimum code unit that K comprises for each frame of video, C
ibe the real-time computing of i terminal group, 1≤i≤N.
It is further again,
In step s3: based on international code standard H.263, H.264 or HEVC that frame of video is entered to the beneficial effect that the present invention has is as follows.
The present invention has following beneficial effect.
Video information is from video sending end is transferred to P2P network, P2P network according to existing video encoding standard to frame of video burst, piece of video is transferred to the terminal in idle condition in current network, transmission network is carried out to bandwidth monitor simultaneously, if current network bandwidth is general, P2P network carries out lossless compression-encoding to current video information, video information transmission after compressed encoding is arrived to multimedia Cloud Server, Cloud Server combines each piece of video and obtains raw video signal after decoding, carry out again lossy compression method coding, when receiving video receiver request, send to video receiver, if current network bandwidth is sufficient especially, P2P network carries out directly sending to video receiver after lossy compression method coding to video information, has solved single terminal video is carried out to the problem that coding rate is slow, video sending end is slow to the transmission of multimedia Cloud Server, amount of calculation is large.
Video sending end is transferred to the some terminals in P2P network after capturing video information, this terminal is to frame of video burst, and these piece of video are sent to terminal idle in same network and carry out Video coding, this process is distributed approach, and the method has adopted the principle of P2P network internal collaborative work.The proposition of this distributed treatment and transmission method can reduce the amount of calculation of some terminals greatly, and a plurality of terminal collaborative work, soon the ripe compressed encoding completing video.Whole process has effectively been utilized the characteristic of transmission bandwidth abundance in the interior terminal computing capability of P2P network and network.
Accompanying drawing explanation
Fig. 1 is the configuration diagram of the network that is applied to of video cloud computing transmission method of the present invention;
Fig. 2 is the schematic flow sheet of embodiment of the present invention transmission method.
Embodiment
Below in conjunction with the drawings and specific embodiments, the invention will be further described.
Video cloud computing transmission method of the present invention is a kind of multimedia cloud computing transmission method based on multistep coding, in its cloud communication network that is applied to by P2P network, video sending end, video receiver be connected, as shown in Figure 1, wherein:
(1) video sending end, as equipment such as the computer with capturing video informational function, cell phone and monitors, it can capturing video information, and video source data is transferred in P2P network;
(2) P2P network receives the video source data that video sending end transmits, each frame of video is carried out to burst, the video information transmission of minute good sheet is arrived to the terminal in idle condition in current network, video receiver transmission network is carried out to bandwidth monitor: if current network bandwidth is inadequate simultaneously, P2P network carries out lossless compression-encoding to current video information, video information transmission after compressed encoding is arrived to multimedia Cloud Server, Cloud Server combines each piece of video and obtains frame of video after decoding, carry out again lossy compression method coding, when receiving video receiver request, video information is sent to video receiver, if current network bandwidth is sufficient, P2P network carries out directly sending to video receiver after lossy compression method coding to video information,
(3) video receiver, receives the compressed encode video information that P2P network or Cloud Server transmit, and plays after these video informations are integrated into complete video data.
In a lot of application (as video conference and video monitoring), often can there is a plurality of video sending end and video receiver.
As shown in Figure 2, the video cloud computing transmission method of the embodiment of the present invention, specifically comprises the steps:
The video source data that step s1:P2P network receiver, video transmitting terminal sends;
Terminal in idle condition in step s2:P2P network judgement current network;
Step s3:P2P network is divided into some piece of video by each frame of video in video source data, and all piece of video of each frame of video are distributed to each non-occupied terminal;
Step s4: comprise sub-step s41, s42 and s43:
Sub-step s41: the bandwidth of transmission network is inadequate between P2P network monitoring P2P network and video receiver, the non-occupied terminal in P2P network is transferred to Cloud Server by piece of video,
Sub-step s42: Cloud Server receiver, video sheet,
Sub-step s43: when Cloud Server is received video receiver request, video information is sent to video receiver;
Step s5: the bandwidth of transmission network is sufficient between P2P network monitoring P2P network and video receiver, and P2P network sends to video receiver by piece of video;
Sub-step s6: video receiver receives the video information of Cloud Server or the transmission of P2P network.
So-called video information, the general designation to the information comprising in (compressed) piece of video, (compressed) frame of video, video data.
The pressure when video receiver sends video information, bandwidth being produced in order to alleviate P2P network,
In step s5: between P2P network monitoring P2P network and video receiver, the bandwidth of transmission network is sufficient, and P2P network carries out lossy compression method coding by piece of video, and the piece of video that compressed encoding is crossed sends to video receiver;
In step s6: the piece of video that video receiver is crossed the compressed encoding receiving combines each frame of video after decoding, each frame of video of recombinant obtains video data.
In sub-step s41: between P2P network monitoring P2P network and video receiver, the bandwidth of transmission network is inadequate, non-occupied terminal in P2P network can directly be transferred to Cloud Server by piece of video, certainly, in order to accelerate transmission speed, non-occupied terminal also can carry out lossless compression-encoding to piece of video, and the piece of video that compressed encoding is crossed is transferred to Cloud Server;
In sub-step s42: after Cloud Server is received piece of video, combine each piece of video and obtain frame of video, or, will receive that piece of video that compressed encoding is crossed combines each piece of video and obtains frame of video after decoding; Cloud Server also can carry out frame of video lossy compression method coding, the pressure while transmitting to video receiver to alleviate, the network bandwidth being produced one time;
In sub-step s43: when Cloud Server is received video receiver request, the frame of video that frame of video or compressed coding are crossed sends to video receiver;
In step s6: combine each frame of video after video receiver receiver, video frame or the frame of video first compressed encoding crossed each frame of video of recombinant of decoding, obtain video data.
In step s1: in setting P2P network, a terminal is as burst terminal;
In step s2: P2P network is divided into N terminal group, and each terminal group reports to burst terminal by the real-time computing of this group;
In step s3: burst terminal is divided into N piece of video according to the computing capability of each terminal group by each frame of video, and each piece of video is sent to each non-occupied terminal in counterpart terminal group, for example: based on H.263, H.264 or HEVC international code standard frame of video is carried out to burst, coding unit minimum in these coding standards is macro block, for each frame of video, the piece of video size that burst terminal is given i terminal group is: K*C
i/
, wherein, the number of the minimum code unit that K comprises for each frame of video, C
ibe the real-time computing of i terminal group, 1≤i≤N;
In sub-step s41: between P2P network monitoring P2P network and video receiver, the bandwidth of transmission network is inadequate, in each terminal group, each non-occupied terminal carries out lossless compression-encoding to the piece of video receiving, in this group, complete at first the piece of video that the non-occupied terminal of compressed encoding crosses compressed encoding and be transferred to Cloud Server, in this group, other non-occupied terminals are abandoned compressed encoding.
When keeping video signal quality, the every two field picture in video is carried out to burst.The object of burst is in order to meet the diffusion of parallel computation, the restriction of network transmission package size and restriction error code, thereby makes coded slice keep each other independent, and can accelerate the speed of Video coding.
Preferably,
In step s2: have a host node terminal in each terminal group, all the other are from nodal terminal, the real-time computing of host node terminal statistics place terminal group, and report to burst terminal;
In step s3: burst terminal sends to each piece of video counterpart terminal group's host node terminal, host node by the piece of video receiving be transferred to this group each in idle condition from nodal terminal;
In sub-step s41: when P2P network monitoring current network bandwidth inadequate, in each terminal group, each free time is carried out lossless compression-encoding from nodal terminal to the piece of video receiving, in this group, complete at first the piece of video that free time of compressed encoding crosses compressed encoding from nodal terminal and be transferred to Cloud Server, in this group, other free time are abandoned compressed encoding from nodal terminal.
In video slicing, the existing method of P2P network using is carried out Real-Time Monitoring to current network condition (being mainly broadband size, delay and idle condition).Suppose to monitor some terminal in idle condition, to these non-occupied terminals, send piece of video.Non-occupied terminal in P2P network receives after piece of video, when guaranteeing video quality, video information once be can't harm or approach harmless compressed encoding.At the present embodiment, the video compressing and encoding method adopting can based on international code standard as H.263, H.264, HEVC etc.After P2P lossless video encoding finishes, piece of video after coding is sent to multimedia Cloud Server, Cloud Server combines each piece of video and obtains original video data after decoding, then carries out lossy compression method coding, and when receiving the request of video receiver, P2P network sends it to video receiver.If but situation from P2P network to video receiver network bandwidth abundance, P2P network will carry out directly sending to video receiver after lossy compression method coding to video information.Compare lossless compression-encoding, the data volume of the video information after lossy compression method coding reduces greatly.Video receiver receives the compressed encoded video information from multimedia Cloud Server and the transmission of the P2P network terminal, and after these information being combined according to order, obtains complete video data, can play.
Be in conjunction with concrete preferred implementation further description made for the present invention as said above, can not assert that specific embodiment of the invention is confined to these explanations.For general technical staff of the technical field of the invention, do not departing under the prerequisite of design of the present invention and intension, can also make some simple deduction or replace, all should be considered as belonging to protection scope of the present invention.