CN101155311B - Video code stream error detecting and processing method in video communication - Google Patents
Video code stream error detecting and processing method in video communication Download PDFInfo
- Publication number
- CN101155311B CN101155311B CN 200610062855 CN200610062855A CN101155311B CN 101155311 B CN101155311 B CN 101155311B CN 200610062855 CN200610062855 CN 200610062855 CN 200610062855 A CN200610062855 A CN 200610062855A CN 101155311 B CN101155311 B CN 101155311B
- Authority
- CN
- China
- Prior art keywords
- video
- image
- error
- information
- data identification
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Landscapes
- Mobile Radio Communication Systems (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
- Detection And Prevention Of Errors In Transmission (AREA)
Abstract
A method for detecting and processing error of video code flow in video communication, to establish index between transmission data identifier and corresponding encoding image information for encoding code flow; to detect the integrality of transmission data identifier on network transmission node, if detecting losing data, then to transmit the corresponding error data identifier to video encoding end through feedback channel; the video encoding end searches the corresponding image encoding information according to the transmission data identifier received from the feedback channel; the encoding end implements encoding with error or transmits the data again based on the corresponding image encoding information. The present invention can find error within a small feedback time delay, and implement error recover processing to the error video code flow, so as to recover the damaged image quality of the video encoding end with maximal speed, also the present invention has very strong anti-jamming and recover capability to video transmission error code as well as package-losing.
Description
Technical field
The invention belongs to image information transmission and process field, be specifically related to the video code flow wrong detection.
Background technology
Along with the development of wired broadband network and wireless network and the driving of user's request, multimedia technology has obtained increasing concern with relevant application, is considered to one of mainstream applications of following express network.Multimedia application, especially Video Applications, with respect to conventional use such as WWW, the E-mail etc. of Internet, it requires tighter to real-time, bigger to the demand of bandwidth.Owing to adopted the coding techniques of high compression rate in the Video Applications mostly; Its requirement to transmission error code is particularly harsh; But wired or wireless network does not provide the QoS (Quality ofServerices) of transmission to guarantee, therefore improve Video Applications is the research focus of field of multimedia communication to the anti-interference and recovery capability of transmission error code always.
It is exactly the situation adjustment video coding strategy according to network channel that the anti-mistake of a kind of effective video is handled.When network condition was relatively poor, for example channel bit error rate or packet loss were bigger, can increase the redundant data in the cataloged procedure, perhaps taked the better but lower video coding strategy of code efficiency of fault freedom; When network condition was better, for example channel bit error rate or packet loss were lower, can reduce the redundant data amount in the cataloged procedure, perhaps taked higher but the video coding strategy that fault freedom is relatively poor of code efficiency.
A key character of the anti-mistake method of this video is the feedback information that need obtain network condition or decoding end decoded picture state, then according to feedback information adjustment coding strategy.But in actual communication systems, there is time delay to coding side from the feedback decoding state information of decoder.If time delay is bigger, when coding side received error feedback information, error image caused tangible visual experience to descend in the decoder end diffusion long period to the user.And in this case, obvious decline can take place in the fault-tolerant processing ability of coding side.
Be illustrated in figure 1 as typical wireless video communication system; Be through wireless connections transmission data between terminal and the BTS/BSC/RNC; Connection between the BTS/BSC/RNC then is through wired connection, comprises core net or flexible exchanging network, and the apparatus for network node such as WMG on the core net.Because existing cable network or wireless network all can't guarantee service quality, when carrying out transfer of data, data can be lost, and therefore can't guarantee that receiving terminal correctly receives the data of transmitting terminal.The reason that causes receiving terminal can't receive correct data has two aspects, and the one, physical channel makes a mistake, and data are impaired in transmission course.In general wireless network environment issues the biological probability of managing channel error much larger than cable network environment, and in the typical radio video communication system as shown in Figure 1, A and B two places are positions that loss of data takes place the most easily.The 2nd, the loss of data that channel congestion causes, when mass data will send to far-end through network at short notice, limited bandwidth caused data correctly to send.
In traditional video error detection and error recovery method, only, receiving terminal could find mistake after receiving video codeword data stream, then error message is sent to transmitting terminal through feedback channel, take corresponding fault-tolerant processing measure at transmitting terminal.It is bigger that the shortcoming of this wrong detection and processing method is that the performance of fault-tolerant processing measure receives the influence of network-feedback time delay, when feedback delay hour, fault-tolerance processing method is simple, and can very fast error message being recovered at receiving terminal; When feedback delay was big, fault-tolerance processing method was complicated, and needed could recovering error message of long period at receiving terminal.
As shown in Figure 2, in traditional video code flow wrong detection and processing method, image encoding is carried out at terminal 1, elapsed time T
1Arrive BTS/BSC/RNC1, in core net/NGN, transmit elapsed time T then
2Arrive BTS/BSC/RNC2, last elapsed time T
3The encoded video code stream is sent to terminal 2.Therefore video code flow from the terminal 1 send to terminal 2 time be T=T
1+ T
2+ T
3When loss of data takes place in video codeword data stream in transport process; For example generation channel error or channel congestion cause video code flow to make mistakes in the transport process at terminal 1 to BTS/BSC/RNC1; On the apparatus for network node of centre, not carrying out data integrity detects; Have only to terminal 2 just detect the video code flow mistake when carrying out video decode, passed through T=T this moment
1+ T
2+ T
3Time.Terminal 2 is sent to terminal 1 again through identical channel transmission through feedback channel with error message with detected mistake then.For convenience's sake, suppose that the path of feedback channel is identical with the channel path and the condition of sending data with condition, so feedback error information experiences T=T again
1+ T
2+ T
3Time.
In this case, from the video codeword data stream 1 pair of error message in terminal time that needs that responds of making a mistake be 2 * (T
1+ T
2+ T
3).Terminal 2 receives through the video code flow after the fault-tolerant processing, and error image is recovered to handle, and final is 3 * (T constantly
1+ T
2+ T
3).
Summary of the invention
Technical problem to be solved by this invention is to be directed against in the video communication process because loss of data that channel error and channel congestion cause or the impaired decoded image quality decline problem that causes; Video code flow error-detecting method in a kind of video communication process is provided; Can fast detecting loss of data in the transmission course, thereby can manage in short feedback delay, to carry out mistake recovery.
Video code flow wrong detection and processing method in a kind of video communication of the present invention may further comprise the steps:
The first step is set up the index that sends between Data Identification number and the corresponding codes image information to the code stream of encoding;
In second step, the integrality of on transport network node, detect sending Data Identification number finds to have loss of data, and the misdata identification number of correspondence is delivered to the video coding end through feedback channel;
In the 3rd step, the video coding end retrieves corresponding image coding information according to the transmission Data Identification that receives from feedback channel number;
In the 4th step, coding side takes fault-tolerant encoding perhaps error data to be retransmitted according to the image coding information of the correspondence that retrieves.
Transmission Data Identification in the above-mentioned first step number can be the sequence number that coding back image data information is sent, and in Real-time Transport Protocol, sending Data Identification number is RTP bag sequence number; In ICP/IP protocol, sending Data Identification number is IP bag sequence number; In agreement H.324M, sending Data Identification number is the Frame sequence number.Coded image information is coded image frame information and/or coding region positional information; Encoded image frame possibly be the sequence number of a frame or multiple image; The coding region position is image block position number or image pixel position number.
The integrality that Data Identification number is sent in said detection is whether detect Data Identification number continuous.
Transport network node in said second step is base station transceiver/base station controller/radio network controller, WMG or server.
The present invention detects the perhaps information of monitoring reception video packets of data on different network nodes, judge whether to take place error in data, and handle accordingly the misdata package informatin is fed back to transmitting terminal.This error-detecting method can be found mistake in less feedback delay; And the video code flow of makeing mistakes is carried out mistake recover to handle; Thereby the damaged image quality with the fastest speed recovery video decode end has very strong antijamming capability and recovery capability to video transmission error code and video transmission packet loss.
Description of drawings
Fig. 1 is typical wireless video communication system figure;
Fig. 2 is wrong detection of the prior art and processing method figure;
Fig. 3 is one embodiment of the present invention sketch map;
Fig. 4 is the another embodiment of the invention sketch map.
Embodiment
The present invention proposes a kind of quick wrong detection and processing method based on data directory.
Like Fig. 3 and Fig. 4,1 when encoding at the terminal, sets up data and send the index between Bale No. and the coded image information.When carrying out two field picture coding, subregion on the image or Zone Full are encoded into a packet, then this packet are sent to receiving terminal.There is corresponding relation in this packet with the frame number of image and the corresponding coding region in the image.When setting up data and send between Bale No. and the coded image information index, sending Bale No. can be RTP Bale No., data frame number, and perhaps other can calculate the coded message of RTP Bale No. and data frame number.For ease, this specification back is that example representes to send Data Identification number with RTP bag sequence number, but is not limited to RTP bag sequence number.Coded image information comprises image frame number and corresponding macro block position information, and perhaps other can calculate the coded message of image frame number or macro block position.For ease, this specification back is all with coded image frame number and macro block position presentation code image information, but is not limited to coded image frame number and macro block position.
In the process that data transmit, carry out the detection of RTP bag sequence number, judge whether to take place loss of data.If loss of data takes place, the packet numbers that will lose or data frame number are sent to coding side through feedback channel.The position of detecting packet numbers or data frame number can be BTS/BSC/RNC1, BTS/BSC/RNC2, WMG, server or other apparatus for network node.Whether correct method is to judge whether RTP bag sequence number is continuous to a kind of common detection RTP bag sequence number, if the corresponding RTP packet loss of the discontinuous sequence number of discontinuous expression.Whether correct method is varied to detect RTP bag sequence number, is that to number in order be to describe with the RTP bag only at this, but does not limit to and this method.
Fault-tolerant encoding is carried out according to the image frame number and the macro block position of obliterated data in terminal 1, perhaps error data is retransmitted, thereby can recover the mistake of decoding end.
Facing Fig. 3 and two kinds of execution modes shown in Figure 4 down describes.
Like Fig. 3:
1, the 1 pair of image in terminal is encoded, and sets up the index between RTP bag sequence number and coded image frame number and the macro block position.At this moment, 1 what send is correct video code flow from the terminal.Suppose that be 0 constantly this moment.
2, when the generation channel error between terminal 1 and the BTS/BSC/RNC1 or channel congestion cause loss of data, through T
1After time, can detect the incorrect of RTP bag sequence number in the BTS/BSC/RNC1 position.Be T constantly this moment
1
3, the erroneous video code stream continues to send to terminal 2.The video code flow of the 2 pairs of receptions in terminal is decoded, and mistake appears in decoded picture.Be T constantly this moment
1+ T
2+ T
3
4, if the path of hypothesis feedback channel is identical with the channel path and the condition of transmission data with condition, incorrect RTP bag sequence number is sent to terminal 1 through feedback channel to be needed through T
1Time.Terminal 1 is according to finding corresponding codes image frame number and macro block position information in the index between RTP bag sequence number and coded image frame number and the macro block position.Carry out fault-tolerant encoding according to the corresponding codes image information then.Fault-tolerant coding method includes but not limited to technology such as reference frame selection, error tracking or frame inner updating.Be 2 * T constantly this moment
1
5, terminal 1 sends to terminal 2 with the video code flow behind the fault-tolerant encoding, and the decoder at terminal 2 carries out video decode, and error image is resumed.Be 2 * T constantly this moment
1+ T
1+ T
2+ T
3
Like Fig. 4:
1, the 1 pair of image in terminal is encoded, and sets up the index between RTP bag sequence number and coded image frame number and the macro block position.At this moment, 1 what send is correct video code flow from the terminal.Suppose that be 0 constantly this moment.
2, when the generation channel error between terminal 1 and the BTS/BSC/RNC1 or channel congestion cause loss of data, through T
1After time, can detect the incorrect of RTP bag sequence number in the BTS/BSC/RNC1 position.Be T constantly this moment
1
3, the erroneous video code stream does not send to terminal 2.Can't decode by the receiver, video code stream in terminal 2, the video decode picture is freezed.Be T constantly this moment
1+ T
2+ T
3
4, if the path of hypothesis feedback channel is identical with the channel path and the condition of transmission data with condition, incorrect RTP bag sequence number is sent to terminal 1 through feedback channel to be needed through T
1Time.Terminal 1 is according to finding corresponding codes image frame number and macro block position information in the index between RTP bag sequence number and coded image frame number and the macro block position.Carry out fault-tolerant encoding or data retransmission according to the corresponding codes image information then.Fault-tolerant coding method includes but not limited to technology such as reference frame selection, error tracking or frame inner updating.Be 2 * T constantly this moment
1
5, fault-tolerant encoding will be passed through or the video code flow that retransmits sends to terminal 2 in terminal 1, and the decoder at terminal 2 carries out video decode, and freeze frame is resumed.Be 2 * T constantly this moment
1+ T
1+ T
2+ T
3
In enforcement of the present invention; The indexing means that set up to send between Data Identification number and the coded image information is varied; A kind of simple transmission Data Identification number with the coded image information index establishing method does; One in the index comprises the RTP Bale No., follows original position by picture frame sequence number and macro block.If in the RTP bag a plurality of picture frames are arranged, then comprise the sequence number of a plurality of picture frames and the original position of macro block.
Claims (5)
1. video code flow wrong detection and the processing method in the video communication may further comprise the steps:
The first step is set up the index that sends between Data Identification number and the corresponding codes image information to the code stream of encoding;
In second step, the integrality of on transport network node, detect sending Data Identification number finds to have loss of data, and the misdata identification number of correspondence is delivered to the video coding end through feedback channel;
In the 3rd step, the video coding end retrieves corresponding image coding information according to the transmission Data Identification that receives from feedback channel number;
In the 4th step, coding side takes fault-tolerant encoding perhaps error data to be retransmitted according to the image coding information of the correspondence that retrieves.
2. video code flow wrong detection and the processing method in the described video communication of claim 1 is characterized in that, the transmission Data Identification in the said first step number is the sequence number that coding back image data information is sent; Coded image information is coded image frame information and/or coding region positional information.
3. video code flow wrong detection and the processing method in the described video communication of claim 2 is characterized in that,
In Real-time Transport Protocol, sending Data Identification number is RTP bag sequence number; In ICP/IP protocol, sending Data Identification number is IP bag sequence number; In agreement H.324M, sending Data Identification number is the Frame sequence number;
Encoded image frame is the sequence number of a frame or multiple image; The coding region position is image block position number or image pixel position number.
4. video code flow wrong detection and the processing method in the described video communication of claim 3 is characterized in that, the integrality that Data Identification number is sent in said detection is whether detect Data Identification number continuous.
5. video code flow wrong detection and the processing method in the described video communication of the arbitrary claim of claim 1 to 4; It is characterized in that the transport network node in said second step is base station transceiver, base station controller, radio network controller, WMG or server.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 200610062855 CN101155311B (en) | 2006-09-27 | 2006-09-27 | Video code stream error detecting and processing method in video communication |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 200610062855 CN101155311B (en) | 2006-09-27 | 2006-09-27 | Video code stream error detecting and processing method in video communication |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN101155311A CN101155311A (en) | 2008-04-02 |
| CN101155311B true CN101155311B (en) | 2012-09-05 |
Family
ID=39256697
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN 200610062855 Active CN101155311B (en) | 2006-09-27 | 2006-09-27 | Video code stream error detecting and processing method in video communication |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101155311B (en) |
Families Citing this family (26)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101478685B (en) * | 2009-01-16 | 2012-05-23 | 中兴通讯股份有限公司 | Anti-interference network video transmission method and apparatus |
| CN101945427B (en) * | 2009-07-03 | 2012-11-14 | 深圳市融创天下科技股份有限公司 | Efficient streaming media transmission method |
| CN102036061B (en) | 2009-09-30 | 2012-11-21 | 华为技术有限公司 | Video data transmission and sending processing method, device and network system |
| CN102316360B (en) * | 2010-07-09 | 2015-11-25 | 华为终端有限公司 | Video refreshing method, Apparatus and system |
| ES2553734T3 (en) * | 2010-09-16 | 2015-12-11 | Deutsche Telekom Ag | Method and system for measuring the quality of audio and video bit stream transmissions on a transmission chain |
| CN102457714A (en) * | 2010-11-01 | 2012-05-16 | 中国移动通信集团上海有限公司 | Method, system and device for transmission of audio-video data acquired by video camera |
| CN102595251B (en) * | 2011-01-11 | 2016-07-27 | 中兴通讯股份有限公司 | Streaming media packet loss retransmission realizes method and system |
| GB2487200A (en) | 2011-01-12 | 2012-07-18 | Canon Kk | Video encoding and decoding with improved error resilience |
| GB201103174D0 (en) * | 2011-02-24 | 2011-04-06 | Skype Ltd | Transmitting a video signal |
| GB2491589B (en) | 2011-06-06 | 2015-12-16 | Canon Kk | Method and device for encoding a sequence of images and method and device for decoding a sequence of image |
| CN103166995B (en) * | 2011-12-14 | 2016-08-10 | 华为技术有限公司 | A kind of video transmission method and device |
| CN103024400B (en) * | 2011-12-19 | 2015-04-29 | 北京捷成世纪科技股份有限公司 | Video compression fault-tolerant transmission method and system based on network |
| CN102611894B (en) * | 2012-03-02 | 2015-01-07 | 华为技术有限公司 | Method, device and system for detecting video transmission packet loss |
| CN103378955A (en) * | 2012-04-26 | 2013-10-30 | 华为技术有限公司 | Data retransmission method, data retransmission system, data retransmission device and data acquisition device |
| CN109983775A (en) | 2016-12-30 | 2019-07-05 | 深圳市大疆创新科技有限公司 | The system and method sent for the data based on feedback |
| WO2018120218A1 (en) * | 2016-12-30 | 2018-07-05 | 深圳市大疆创新科技有限公司 | Image processing method and device |
| WO2018120198A1 (en) * | 2016-12-30 | 2018-07-05 | 深圳市大疆创新科技有限公司 | Image processing method and device, unmanned aerial vehicle and receiving end |
| CN108401263B (en) * | 2017-02-07 | 2021-09-17 | 大唐移动通信设备有限公司 | Voice quality assessment method and device |
| US11284062B2 (en) * | 2017-09-05 | 2022-03-22 | Texas Instruments Incorporated | Automotive display validation |
| CN109462857A (en) * | 2017-09-06 | 2019-03-12 | 中兴通讯股份有限公司 | Loss treating method, device, wireless net member and computer readable storage medium |
| CN111601178B (en) * | 2020-05-26 | 2022-09-23 | 维沃移动通信有限公司 | Video data processing method and device and electronic equipment |
| CN111885404A (en) * | 2020-07-16 | 2020-11-03 | RealMe重庆移动通信有限公司 | Data transmission method, device and storage medium |
| CN112532349B (en) * | 2020-11-24 | 2022-02-18 | 广州技象科技有限公司 | Data processing method and device based on decoding abnormity |
| CN112511277B (en) * | 2020-11-24 | 2021-08-06 | 广州技象科技有限公司 | Data processing method and device |
| CN114520788B (en) * | 2022-04-20 | 2022-07-15 | 创思(广州)电子科技有限公司 | Self-checking type information transmission control method with storage nodes |
| CN117041466A (en) * | 2023-07-18 | 2023-11-10 | 基石酷联微电子技术（北京）有限公司 | Bidirectional transmission circuit |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1127578A (en) * | 1993-07-19 | 1996-07-24 | 英国电讯有限公司 | Detecting errors in video images |
| EP1081963B1 (en) * | 1999-08-31 | 2005-12-07 | Lucent Technologies Inc. | Video signal error detection systems |
| CN1816159A (en) * | 2005-02-02 | 2006-08-09 | 三星电子株式会社 | Error concealment for video signals |
-
2006
- 2006-09-27 CN CN 200610062855 patent/CN101155311B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1127578A (en) * | 1993-07-19 | 1996-07-24 | 英国电讯有限公司 | Detecting errors in video images |
| EP1081963B1 (en) * | 1999-08-31 | 2005-12-07 | Lucent Technologies Inc. | Video signal error detection systems |
| CN1816159A (en) * | 2005-02-02 | 2006-08-09 | 三星电子株式会社 | Error concealment for video signals |
Non-Patent Citations (4)
| Title |
|---|
| 李艺霞.低速率视频传输的抗误码技术.无线通信技术 1.2006,(1),54-58. |
| 李艺霞.低速率视频传输的抗误码技术.无线通信技术 1.2006,(1),54-58. * |
| 王华等.无线传感器网络中数据可靠传输的节能路由算法.计算机应用26 1.2006,26(1),25-27. |
| 王华等.无线传感器网络中数据可靠传输的节能路由算法.计算机应用26 1.2006,26(1),25-27. * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN101155311A (en) | 2008-04-02 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101155311B (en) | Video code stream error detecting and processing method in video communication | |
| CN100539544C (en) | Medium streaming distribution system | |
| US7636298B2 (en) | Apparatus and method for packet error correction | |
| US8499212B2 (en) | Method and apparatus for adaptive forward error correction with merged automatic repeat request for reliable multicast in wireless local area networks | |
| JP5425397B2 (en) | Apparatus and method for adaptive forward error correction | |
| CN101193312B (en) | Self-adapted error recovery device, video communication system and method based on feedback | |
| EP2529528B1 (en) | A method and apparatus for parsing a network abstraction-layer for reliable data communication | |
| US20120272124A1 (en) | Method and System for Recovering Lost Media Data Packets | |
| KR101286912B1 (en) | Variable size packets fec encoding and fec decoding method based on 3 dimension buffer | |
| JP2004537919A (en) | Forward error correction system and method for packet-based communication systems | |
| US20100214970A1 (en) | Method and system for transmitting data packets from a source to multiple receivers via a network | |
| JP2005198191A (en) | Transmission apparatus, transmission control program, and transmission method | |
| CN103580773A (en) | Method and device for transmitting data frame | |
| JP2001045098A (en) | Data communication system, data communication unit, data communication method and storage medium | |
| EP2245783A1 (en) | Controlling point-to-multipoint transmissions of content data over a radio interface | |
| US8467302B2 (en) | Wireless data transmission method, transmitting system, and receiving system | |
| CN102239658A (en) | Error control on-demand | |
| KR100240645B1 (en) | Packet error controller of multicast communication and method thereof | |
| CN102752184A (en) | Data communication system for real-time multicast service and method thereof | |
| CN102065372B (en) | Method for transmitting data in broadcast mode and related device | |
| Kim et al. | UDP-based extremely low latency streaming | |
| US7239610B2 (en) | Methods and devices for partial upper layer frame loss detection based retransmission | |
| CN101179353A (en) | Method and system of monitoring multimedia service performance | |
| CN110572721A (en) | Video transmission method and device | |
| Lifen et al. | The performance study of transmitting MPEG4 over SCTP |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant |