CN100536576C - A video error tolerance control system and method - Google Patents
A video error tolerance control system and method Download PDFInfo
- Publication number
- CN100536576C CN100536576C CN 200710123626 CN200710123626A CN100536576C CN 100536576 C CN100536576 C CN 100536576C CN 200710123626 CN200710123626 CN 200710123626 CN 200710123626 A CN200710123626 A CN 200710123626A CN 100536576 C CN100536576 C CN 100536576C
- Authority
- CN
- China
- Prior art keywords
- subsequence
- frame
- subsequences
- decoding
- code stream
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Landscapes
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
The utility model discloses a video fault tolerant control system, comprising a splitting element and a coding element and a transmitting element which are arranged on a sender, and a decoding element and a recovery element at a receiving end; wherein the splitting element is used to split a complete image frame of a video sequence into at least two subsequences; the coding element is used to code each of the subsequences independently into a code stream; the transmitting element is used to transmit the code stream of the subsequences to the receiving end respectively; the decoding element is used to decode the code stream of the subsequences; the recovery element recovers the original image frame according to the original split spatial relationship when all the subsequences are successfully decoded or the recovery element recovers the original image frame according to spatial interpolation calculation when parts of the subsequences are successfully decoded. The utility model also provides a relative method. The utility model has the advantages that the fault tolerant ability and the packet-loss resisting ability of video transmission as well as video playing fluency can be remarkably increased.
Description
Technical field
The present invention relates to field of video communication, more particularly, relate to a kind of video error tolerance control system and method.
Background technology
Along with the development of network application, occasions such as instant messaging, chatroom have been widely used in via the video communication of network.In video communication, usually the picture frame in the video sequence is encoded to the I frame and the P frame transmits, wherein the I frame is an intracoded frame, and it does not rely on other frame and independent decoding, and encoding code stream is bigger; The P frame is an inter-frame encoding frame, and it depends on the I frame or the P frame ability decodable code of its front, because the P frame is with reference to the former frame image, so code stream is less.In order to adapt to Network Transmission, the code stream of each frame need be divided into several less packets according to situations such as the network bandwidths and send.
Yet, in the actual transmissions process (for example IP network, wireless network etc.), because the packet loss phenomenon may appear in network problem.Corresponding I frame, as long as the packet of itself all receives, the receiving terminal recovery of just can decoding; And the P two field picture, then except that the packet of itself, all the P frames behind the nearest I frame of its front and this I frame all will be received the recovery of just can decoding.I among Fig. 1 for example
0To I
1Between comprise 5 P frames, if lose in the 3rd P transmission, even if then receiving terminal receives the 4th, the 5th P frame and can not decode.
Extensive along with wireless network and multimedia technology application, the demand of transmission of video is growing on unreliable channel, and the wrong control problem in video coding and the transmission has caused extensive concern.Number of patent application discloses a kind of video error tolerance controlling schemes for the Chinese patent of " 200510097644.8 ", and it is inserted into the centre of sequence with the I frame, behind the P frame of I frame front to reference to this I frame, thereby realize fault-tolerant.Yet this scheme but causes the problem that encoder complexity increases, the decoding time-delay increases, and the fault-tolerant effect of this scheme neither be very desirable.
Summary of the invention
The technical problem to be solved in the present invention is that the problem at causing perceptible video fluency to reduce because of data-bag lost in the video communication provides a kind of video error tolerance control system and method.
The technical scheme that the present invention solves the problems of the technologies described above is, a kind of video error tolerance control system is provided, and comprises split cells, coding unit and the transmission unit that is positioned at transmitting terminal, the decoding unit that is positioned at receiving terminal and recovery unit, wherein:
Described split cells is used for the complete graph picture frame of video sequence is split as at least two subsequences equably;
Described coding unit, being used for each described subsequence absolute coding is that code stream and the I frame that makes each subsequence are staggered;
Described transmission unit is used for the encoding code stream of each subsequence is sent to receiving terminal respectively;
Described decoding unit is used to each subsequence encoding code stream of decoding and receiving;
Described recovery unit, the spatial relationship according to original fractionation when all subsequences are successfully decoded is recovered original image frame, or carries out space interpolation according to the successful subsequence of decoding and calculate the recovery original image frame when the success of parton sequential decoding.
In a kind of video error tolerance control system of the present invention, described split cells with the complete graph picture frame with interlacing, every row or interlacing be split as at least two subsequences every the row mode.
In a kind of video error tolerance control system of the present invention, described coding unit makes the I frame of interval each subsequence of phase XOR of I interframe of each subsequence staggered in order when each subsequence is encoded.
In a kind of video error tolerance control system of the present invention, described transmission unit alternately sends the encoding code stream of each subsequence in chronological order.
In a kind of video error tolerance control system of the present invention, described transmitting terminal also comprises regulon, is used for carrying out feedback regulation, space fractionation adjusting and/or the staggered adjusting of I frame according to network condition.
The present invention also provides a kind of video error tolerance control method, may further comprise the steps:
(a) at transmitting terminal the complete graph picture frame in the video sequence is split as at least two subsequences equably;
(b) be that code stream and the I frame that makes each subsequence are staggered with each subsequence absolute coding, and the encoding code stream of each subsequence is sent to receiving terminal respectively;
(c) receiving terminal spatial relationship according to original fractionation when all subsequences are successfully decoded is recovered original image frame, or carries out space interpolation according to the successful subsequence of decoding and calculate the recovery original image frame when the success of parton sequential decoding.
In a kind of video error tolerance control method of the present invention, in the described step (a), described complete graph picture frame with interlacing, every row or interlacing be split as at least two subsequences every the row mode.
In a kind of video error tolerance control method of the present invention, described step (b) comprising:
(b1) each subsequence is encoded to code stream respectively, the I frame of interval each subsequence of phase XOR of I interframe is staggered in order in described encoding code stream;
(b2) each subsequence encoding code stream is encapsulated as packet and sends to receiving terminal.
In a kind of video error tolerance control method of the present invention, described step (b2) further comprises:
(b21) packet with each subsequence alternately sends to receiving terminal according to time sequencing.
In a kind of video error tolerance control method of the present invention, described step (c) comprising:
(c1) receiving terminal receives from being bit stream data with data packet recovery behind the packet of transmitting terminal, and the above-mentioned bit stream data of decoding;
(c2) code stream that judges whether all subsequences success of all decoding, the success if all subsequences are all decoded is then carried out (c3); Otherwise carry out (c4);
(c3), recover the raw video image frame according to original fractionation spatial relationship;
(c4) carry out space interpolation according to the successful subsequence of decoding and calculate the recovery original image frame.
In a kind of video error tolerance control method of the present invention, also comprise: transmitting terminal carries out feedback regulation, space fractionation adjusting and/or the staggered adjusting of I frame according to network condition.
A kind of video error tolerance control method of the present invention by at transmitting terminal the single-frame images of video sequence being carried out disassembled coding, is carried out space interpolation at receiving terminal and is recovered original image, has realized the high fluency video communication under the Network Packet Loss situation.
Description of drawings
The invention will be further described below in conjunction with drawings and Examples, in the accompanying drawing:
Fig. 1 is the schematic diagram of the packet in the existing video communication;
Fig. 2 is the schematic diagram of a kind of video error tolerance control system embodiment of the present invention;
Fig. 3 is the schematic diagram of the split cells broken away view picture frame among Fig. 2;
Fig. 4 is the schematic diagram that the recovery unit among Fig. 2 recovers picture frame;
Fig. 5 is the schematic diagram of the coding unit coding subsequence among Fig. 2;
Fig. 6 is encode the in another way schematic diagram of subsequence of the coding unit among Fig. 2;
Fig. 7 is the schematic flow sheet of a kind of video error tolerance control method of the present invention embodiment;
Fig. 8 is a coding and send the flow chart of subsequence step embodiment among Fig. 7;
Fig. 9 is decoding and recover the flow chart of picture frame step embodiment among Fig. 7.
Embodiment
Reduce according to the discernable video fluency that packet loss causes at factor in the video transmission process, the invention provides a kind of fault-tolerant control system and method that improves the video fluency.The present invention splits into two or more subsequences at the transmitting terminal of video communication with the single-frame images of video sequence, and each subsequence carried out absolute coding, at the receiving terminal of video communication the code stream of each subsequence of receiving is decoded, and when only receiving the parton sequence code stream decodable code of image, carry out space interpolation according to this decoding subsequence and recover original image.
As shown in Figure 2, be the structural representation of an embodiment of a kind of video error tolerance control system of the present invention.This system comprises split cells 11, coding unit 12, transmission unit 13, decoding unit 21 and recovery unit 22, and wherein split cells 11, coding unit 12 and transmission unit 13 are positioned at transmitting terminal 10, and decoding unit 21 and recovery unit 22 are positioned at receiving terminal 20.
It is code stream that coding unit 12 is used for split cells 11 is split each the subsequence absolute coding that obtains.In order to improve fault-tolerance, coding unit 12 is when specific implementation, and the I frame of each subsequence is staggered as far as possible.For example coding unit 12 can realize that the I frame of subsequence is staggered by the mode of Fig. 5 and Fig. 6.In mode shown in Figure 5, the I frame period of each subsequence is identical, and follow-up subsequence inserts with respect to the I frame time-delay of the subsequence of front, thereby the I frame that guarantees each subsequence is staggered in order.In mode shown in Figure 6, the I frame period of each subsequence is different mutually, for example can use a relatively prime integer P frame to carry out the interval, thereby makes the I frame of each subsequence unordered staggered.
Each subsequence encoding code stream that decoding unit 21 is used to decode and receives.This decoding unit 21 can use existing decoding chip to realize.
In addition, because network condition changes at any time in different communication processs or same process, can adjust the transmission strategy of transmitting terminal 10 according to the other side's feedback information.In said system, transmitting terminal 10 also can comprise a regulon, else sends strategy thereby select different tolerant levels for use according to different network conditions.This regulon can be used for carrying out conventional feedback regulation, and this regulon also provides the space to split adjusting and/or the staggered adjusting of I frame in addition.The space of this regulon split and the I frame staggered regulate strategy can but be not limited to following form: at the low network of packet loss, the space is split as two subsequences, and the I frame period can be big slightly, and the I frame is staggered can be orderly; And when packet loss is high especially, can be split as more subsequence in the space, and the I frame period is littler, and the I frame is unordered staggered etc.
As shown in Figure 7, be the schematic diagram of an embodiment of a kind of video error tolerance control method of the present invention.This method is used to realize the video communication between transmitting terminal and the receiving terminal, specifically may further comprise the steps:
Step S71: the complete graph picture frame in the video sequence is split as at least two subsequences equably at transmitting terminal.In this step, can with the complete graph picture frame with interlacing, every row or interlacing be split as two or more subsequences every the row mode.
Carrying out picture frame when splitting, the mode of its fractionation can be: be split as every row that two subsequences, interlacing are split as two subsequences, interlacing splits into four subsequences every row.Certainly, concrete fractionation mode can have multiple, is not limited to aforesaid way, and the principle of fractionation is as far as possible symmetrically and evenly, thereby helps recovering original image according to the parton sequence.
Step S72: it is code stream that each subsequence is carried out absolute coding, and the encoding code stream of each subsequence is sent to receiving terminal respectively.
Step S73: receiving terminal spatial relationship according to original fractionation when all subsequences are successfully decoded is recovered original image frame, or carries out space interpolation according to the successful subsequence of decoding and calculate the recovery original image frame when the success of parton sequential decoding.
For example be split as in the picture frame of two subsequences when interlacing, only decode successfully one of them, then adopt comprehensively to interpolation method, successful subsequence reverts to original image frame with decoding.
As shown in Figure 8, be coding and send the flow chart of subsequence step (step S72) embodiment among Fig. 7.This step specifically comprises:
Step S81: each subsequence is encoded to code stream respectively, in the encoding code stream of each subsequence, the P frame is inserted into I interframe, thereby make the I frame staggered as far as possible.Staggered by the I frame, can significantly improve fault-tolerance.The I frame that for example can realize subsequence by the mode of Fig. 5 and Fig. 6 is staggered.In mode shown in Figure 5, the I frame period of each subsequence is identical, and follow-up subsequence inserts with respect to the I frame time-delay of the subsequence of front, thereby the I frame that guarantees each subsequence is staggered in order.In mode shown in Figure 6, the I frame period of each subsequence is different mutually, for example can use a relatively prime integer P frame to carry out the interval, thereby makes the I frame of each subsequence unordered staggered.
Step S82: each subsequence encoding code stream is encapsulated as packet, for example can be according to the subpackage of network MTU.
Step S83: the packet bag of each subsequence is alternately sent to receiving terminal according to time sequencing, for example send out 1 packet of first subsequence earlier, send out 1 packet of second subsequence again; Perhaps in time-delay and buffering tolerance band, alternately send a plurality of packets, for example send 3 packets of first subsequence earlier, send 3 packets of second subsequence again.Like this, by sending the packet of each subsequence in proper order, can guarantee the continuity of video communication.
As shown in Figure 9, be decoding and recover the flow chart of picture frame step (step S73) embodiment among Fig. 7.This step specifically comprises:
Step S91: receiving terminal receives from being bit stream data with data packet recovery behind the packet of transmitting terminal, and the above-mentioned bit stream data of decoding.
Step S92: the code stream that judges whether all subsequences success of all decoding.Success, then execution in step S93 if all subsequences are all decoded; Otherwise execution in step S94.
Step S93: according to original fractionation spatial relationship, press luv space and split contrary operation, recover the raw video image frame.
Step S94: carry out space interpolation according to the successful subsequence of decoding and calculate the recovery original image frame.For example among Fig. 3, when original image success first subsequence (being the white subsequence among Fig. 3) image of only decoding, the failure of second subsequence (being the oblique line subsequence among Fig. 3) picture decoding, press luv space and split contrary operation, the odd column of original series image is filled (white ribbon among Fig. 4) with each pixel of the first subsequence image of decoding, and even column pixel (the oblique line band among Fig. 4) can obtain according to its neighbour's white ribbon picture element interpolation, so just be similar to and recovered the original series image, as shown in Figure 4.
In addition, in order to adapt to different network conditions, said method also can be included in transmitting terminal and carry out feedback regulation, space fractionation adjusting and the staggered adjusting of I frame etc.
Use system and method for the present invention, can significantly improve the fault-tolerant anti-packet loss ability of video transmission, improve the fluency of video playback, improve user experience.
The above; only for the preferable embodiment of the present invention, but protection scope of the present invention is not limited thereto, and anyly is familiar with those skilled in the art in the technical scope that the present invention discloses; the variation that can expect easily or replacement all should be encompassed within protection scope of the present invention.Therefore, protection scope of the present invention should be as the criterion with the protection range of claim.
Claims (11)
1, a kind of video error tolerance control system is characterized in that, comprises split cells, coding unit and the transmission unit that is positioned at transmitting terminal, the decoding unit that is positioned at receiving terminal and recovery unit, wherein:
Described split cells is used for the complete graph picture frame of video sequence is split as at least two subsequences equably;
Described coding unit, being used for each described subsequence absolute coding is that code stream and the I frame that makes each subsequence are staggered;
Described transmission unit is used for the encoding code stream of each subsequence is sent to receiving terminal respectively;
Described decoding unit is used to each subsequence encoding code stream of decoding and receiving;
Described recovery unit, the spatial relationship according to original fractionation when all subsequences are successfully decoded is recovered original image frame, or carries out space interpolation according to the successful subsequence of decoding and calculate the recovery original image frame when the success of parton sequential decoding.
2, a kind of video error tolerance control system according to claim 1 is characterized in that, described split cells with the complete graph picture frame with interlacing, every row or interlacing be split as at least two subsequences every the row mode.
3, a kind of video error tolerance control system according to claim 1 is characterized in that, described coding unit makes the I frame of interval each subsequence of phase XOR of I interframe of each subsequence staggered in order when each subsequence is encoded.
4, a kind of video error tolerance control system according to claim 1 is characterized in that, described transmission unit alternately sends the encoding code stream of each subsequence in chronological order.
5, a kind of video error tolerance control system according to claim 1 is characterized in that, described transmitting terminal also comprises regulon, is used for carrying out feedback regulation, space fractionation adjusting and/or the staggered adjusting of I frame according to network condition.
6, a kind of video error tolerance control method is characterized in that, may further comprise the steps:
(a) at transmitting terminal the complete graph picture frame in the video sequence is split as at least two subsequences equably;
(b) be that code stream and the I frame that makes each subsequence are staggered with each subsequence absolute coding, and the encoding code stream of each subsequence is sent to receiving terminal respectively;
(c) receiving terminal spatial relationship according to original fractionation when all subsequences are successfully decoded is recovered original image frame, or carries out space interpolation according to the successful subsequence of decoding and calculate the recovery original image frame when the success of parton sequential decoding.
7, a kind of video error tolerance control method according to claim 6 is characterized in that, in the described step (a), described complete graph picture frame with interlacing, every row or interlacing be split as at least two subsequences every the row mode.
8, a kind of video error tolerance control method according to claim 6 is characterized in that, described step (b) comprising:
(b1) each subsequence is encoded to code stream respectively, the I frame of interval each subsequence of phase XOR of I interframe is staggered in order in described encoding code stream;
(b2) each subsequence encoding code stream is encapsulated as packet and sends to receiving terminal.
9, a kind of video error tolerance control method according to claim 8 is characterized in that, described step (b2) further comprises:
(b21) packet with each subsequence alternately sends to receiving terminal according to time sequencing.
10, a kind of video error tolerance control method according to claim 6 is characterized in that, described step (c) comprising:
(c1) receiving terminal receives from being bit stream data with data packet recovery behind the packet of transmitting terminal, and the above-mentioned bit stream data of decoding;
(c2) code stream that judges whether all subsequences success of all decoding, the success if all subsequences are all decoded is then carried out (c3); Otherwise carry out (c4);
(c3), recover the raw video image frame according to original fractionation spatial relationship;
(c4) carry out space interpolation according to the successful subsequence of decoding and calculate the recovery original image frame.
11, a kind of video error tolerance control method according to claim 6 is characterized in that, also comprises: transmitting terminal carries out feedback regulation, space fractionation adjusting and/or the staggered adjusting of I frame according to network condition.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN 200710123626 CN100536576C (en) | 2007-09-25 | 2007-09-25 | A video error tolerance control system and method |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN 200710123626 CN100536576C (en) | 2007-09-25 | 2007-09-25 | A video error tolerance control system and method |
Publications (2)
Publication Number | Publication Date |
---|---|
CN101127918A CN101127918A (en) | 2008-02-20 |
CN100536576C true CN100536576C (en) | 2009-09-02 |
Family
ID=39095814
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN 200710123626 Active CN100536576C (en) | 2007-09-25 | 2007-09-25 | A video error tolerance control system and method |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN100536576C (en) |
Families Citing this family (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102611894B (en) * | 2012-03-02 | 2015-01-07 | 华为技术有限公司 | Method, device and system for detecting video transmission packet loss |
CN106713913B (en) * | 2015-12-09 | 2020-01-10 | 腾讯科技(深圳)有限公司 | Video image frame sending method and device and video image frame receiving method and device |
CN107302523B (en) * | 2017-05-26 | 2019-08-27 | 中国科学院西安光学精密机械研究所 | Method for solving mosaic caused by transmission stream packet loss |
CN109963185B (en) * | 2017-12-26 | 2022-09-02 | 杭州海康威视数字技术股份有限公司 | Video data sending method, video display method, device, system and equipment |
CN109451312A (en) * | 2018-11-05 | 2019-03-08 | 深圳威尔视觉传媒有限公司 | Facilitate the decoded method for processing video frequency of video, device, equipment and storage medium |
CN111064962B (en) * | 2019-12-31 | 2022-02-15 | 广州市奥威亚电子科技有限公司 | Video transmission system and method |
CN111770347A (en) * | 2020-07-17 | 2020-10-13 | 广州市奥威亚电子科技有限公司 | Video transmission method and system |
CN111770333B (en) * | 2020-07-17 | 2022-05-24 | 广州市奥威亚电子科技有限公司 | Image merging method and system |
CN112333469B (en) * | 2020-10-27 | 2022-07-08 | 杭州叙简科技股份有限公司 | System based on mobile network and wifi video transmission enhancement method |
CN118555607A (en) * | 2021-01-04 | 2024-08-27 | 腾讯科技(深圳)有限公司 | Data transmission method, data transmission device, computer readable medium and electronic equipment |
CN113839998B (en) * | 2021-09-18 | 2024-04-12 | 北京百度网讯科技有限公司 | Image data transmission method, apparatus, device, storage medium, and program product |
-
2007
- 2007-09-25 CN CN 200710123626 patent/CN100536576C/en active Active
Also Published As
Publication number | Publication date |
---|---|
CN101127918A (en) | 2008-02-20 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN100536576C (en) | A video error tolerance control system and method | |
CN103959799A (en) | Apparatus and method of transmiting/receiving broadcast data | |
CN102017617B (en) | Fast channel zapping and high quality streaming protection over a broadcast channel | |
US6973132B2 (en) | Transmission header compressor not compressing transmission headers attached to intra-frame coded moving-picture data | |
EP2013987B1 (en) | Seamless handover of multicast sessions in internet protocol based wireless networks using staggercasting | |
CN102210144B (en) | Method and apparatus for fast channel change | |
JP2001189713A (en) | Data transmitter and data transmission method | |
US8832519B2 (en) | Method and apparatus for FEC encoding and decoding | |
WO2002067588A3 (en) | Video communication system employing multiple state encoding and path diversity | |
KR20090096300A (en) | System and method for wireless communication for audiovisual data having data size adaptation | |
CN1277517A (en) | Radio communication system using for video group transmission | |
US20070288980A1 (en) | System and method for digital communication having a frame format and parsing scheme with parallel convolutional encoders | |
CN1064506C (en) | Method and apparatus for recovering an image in a video telephone system | |
CN101207813A (en) | Method and system for encoding and decoding video sequence | |
EP2373037B1 (en) | Video transmission device, video reception device, and video communication system | |
CN1754385B (en) | Image data distribution device, method, image data receiving method | |
CN103024400A (en) | Video compression fault-tolerant transmission method and system based on network | |
EP1592252A1 (en) | Video data distribution control method, device, system, and program | |
CN111064962B (en) | Video transmission system and method | |
JP6535718B2 (en) | Method and apparatus for providing streaming service | |
US20150006991A1 (en) | Graceful degradation-forward error correction method and apparatus for performing same | |
Setton et al. | Adaptive multiple description video streaming over multiple channels with active probing | |
CN106162257A (en) | A kind of adaptive network transmission optimization method of real-time video | |
CN101854224A (en) | Error correcting coding method, device and system, and forwarding control method and device | |
CN103916714A (en) | Packet-loss resistance preprocessing and recovery method for wireless network video stream |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
C14 | Grant of patent or utility model | ||
GR01 | Patent grant |