WO2005094084A1 - Multiple description coding video transmission using de-interlacing mechanisms - Google Patents
Multiple description coding video transmission using de-interlacing mechanisms Download PDFInfo
- Publication number
- WO2005094084A1 WO2005094084A1 PCT/IB2005/051004 IB2005051004W WO2005094084A1 WO 2005094084 A1 WO2005094084 A1 WO 2005094084A1 IB 2005051004 W IB2005051004 W IB 2005051004W WO 2005094084 A1 WO2005094084 A1 WO 2005094084A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- video
- streams
- signals
- interlacing
- signal
- Prior art date
Links
- 230000005540 biological transmission Effects 0.000 title claims abstract description 20
- 230000007246 mechanism Effects 0.000 title 1
- 238000000034 method Methods 0.000 claims abstract description 30
- 230000000750 progressive effect Effects 0.000 claims description 16
- 230000002123 temporal effect Effects 0.000 claims description 13
- 238000010586 diagram Methods 0.000 description 5
- 238000004891 communication Methods 0.000 description 3
- 230000002596 correlated effect Effects 0.000 description 2
- 230000003044 adaptive effect Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000003780 insertion Methods 0.000 description 1
- 230000037431 insertion Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012805 post-processing Methods 0.000 description 1
- 230000002441 reversible effect Effects 0.000 description 1
- 238000005070 sampling Methods 0.000 description 1
- 238000000926 separation method Methods 0.000 description 1
- 239000013598 vector Substances 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/30—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability
- H04N19/39—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability involving multiple description coding [MDC], i.e. with separate layers being structured as independently decodable descriptions of input picture data
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
- H04N19/174—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a slice, e.g. a line of blocks or a group of blocks
Definitions
- the present invention relates generally to the transmission of video sequences (20) over a network. More particularly, the present invention relates to methods of transmitting and receiving robust video over error prone channels of a network. As communication over wireless systems and the Internet has become more predominant, ways to reliably send and receive video streams over such networks have been developed. Multiple description coding (MDC) is one technique that has been shown to be effective for such communications. MDC involves the separation of video streams into multiple correlated coded representations, or descriptions, of the video signal, and transmission of the representations on separate channels for error resilience.
- MDC Multiple description coding
- One way of splitting the video streams is by separating the stream into odd and even frames and then coding the streams independently. When one of the streams is received, it can be decoded at half the frame rate. Due to the correlated nature of the video streams, intermediate frames that may become lost during transmission may be recovered using motion compensated error concealment techniques. Examples of techniques using motion compensated error concealment are Multiple State Encoding, Video Redundancy Coding (VRC) and Multiple Description Motion Compensation (MDMC).
- VRC Video Redundancy Coding
- MDMC Multiple Description Motion Compensation
- a Multiple State Encoding system includes an encoder that receives a video stream and encodes the video into independently decodable packet streams by employing multiple state encoding with multiple states, and a receiver that receives and combines the multiple streams into a single stream and decodes the received stream to reconstruct the original video stream.
- Fig. 1 a simplified block diagram of an existing VRC encoder is shown.
- the video signal consisting of a series of frames 10
- the odd 10a and even 10b frames are separated and encoded using two standardized coders 12, and then the descriptions are transmitted over the network.
- the frame 10 can be reconstructed using a standardized decoder by interpolation from neighboring frames of the other data stream or description.
- the reconstruction is performed using purely temporal information, as no spatial information is available.
- the temporal distance between the frames is relatively large, which will decrease the coding efficiency.
- Implementing the MDMC technique will provide a system with better coding efficiency.
- non-standardized coders/decoders are employed. Using MDMC two descriptions can be generated, where each includes coded information for alternating frames. Temporal predictors are used that allow the encoder to use both past even and odd frames while encoding.
- an improved method for transmitting and receiving video signals is provided.
- a progressive video sequence (20) is interlaced and the interlaced sequence is split into multiple streams.
- the multiple streams are encoded using encoders and then the streams are transmitted over independent channels of the network.
- the sequence is split into two streams of signals.
- the two streams are received and separately decoded. If there were no transmission errors, the decoded streams are regrouped into the original progressive video sequence (20). If however, there were transmission errors, de-interlacing algorithms are used to reconstruct the corrupted stream of signals.
- Fig. 1 is a simplified block diagram of a prior art VRC encoder
- Fig. 2 is a simplified diagram illustrating the how progressive video signals are currently transmitted over networks
- Figs. 3A and 3B are simplified block diagrams illustrating a transmitter and receiver for communicating progressive video signals over networks in accordance with principles of the present invention
- Fig. 4 shows a representation of interlaced video signals in accordance with principles of the present invention
- Fig. 5 shows the reconstruction of a lost or corrupted video image in accordance with principles of the present invention.
- FIG. 2 shows a simplified block diagram representation of a video sequence 20, consisting of progressive pictures A, B, C, being encoded with a standardized video encoder 22, such as an MPEG-2 or MPEG-4 encoder, for transmission over a network.
- a standardized video encoder 22 such as an MPEG-2 or MPEG-4 encoder
- FIGs. 3A, 3B and 4 a device and method of transmitting the same video sequence 20 according to principles of the present invention will now be described.
- Each of the progressive pictures A, B and C of the video sequence 20 consists of odd and even fields (e.g. Ao, Ae, Bo, Be, Co, Ce).
- the video signal 20 is interlaced with an interlacer 302.
- Interlacing involves vertically subsampling the pictures with a factor of two, by separating the odd scanning lines and the even scanning lines separately. This results in pictures containing only the odd scanning lines, hereinafter referred to the odd fields, and picture containing only the even scanning lines, hereinafter referred to the even fields, as shown in Fig. 4.
- the interlaced signal 30 is then separated into a video stream of odd fields 32 and even fields 34.
- the video streams of odd and even fields are separately encoded with standardized MPEG-2/4 encoders 304, 306, creating two descriptions each having their own prediction vectors and residues after the encoding.
- the encoded descriptions are then transmitted over independent channels 308, 310 to a receiver 320.
- both streams of encoded signals can be decoded using standardized MPEG-2/4 decoders 322, 324. If the streams are received and decoded with no transmission errors, the decoded streams are regrouped to form the original progressive video sequence 20. However, if during transmission one of the streams got corrupted, or a field in the stream was lost, the present invention provides for a way to estimate the corrupt or missing information from the information that is correctly received.
- a deinterlacer 326 employing standard de-interlacing techniques, can be used to estimate the corrupt or missing information.
- de- interlacing can be viewed as the reverse process of interlacing.
- De-interlacing doubles the vertical resolution with respect to the interlaced video, and is also aimed at removing subsampling artifacts caused by the interlaced sampling of the video.
- G. de Haan and E.B. Bellers "De-interlacing: an overview," Proceedings of the IEEE, 86(9): 1839-1857, September 1998; and E.B. Bellers and G.
- FIG. 5 shows an example of how de- interlacing can be used in accordance with the present invention to reconstruct a non-received field of a picture.
- the odd field of picture B, Bo was lost during the transmission.
- a de- interlacer is capable of reconstructing the lost Bo field based on information in the well received Be field and the regrouped A picture.
- the de-interlacer capable of performing this reconstruction is a vertical temporal median filter that inherently switches between field insertion and line repetition.
- the interpolated samples are formed as the median value of the vertical neighbors and the temporal neighbor in the previous field.
- the missing field is interpolated from both spatial and temporal information.
- the above described preferred embodiment separates the video sequence into two streams of odd and even fields and generates two descriptions which are transmitted over two independent channels
- the video sequence can be split into a plurality of multiple streams, and the sequence can be split using other parameters.
- the present invention provides advantages over the existing video transmission methods using multiple description coding. As described above, the method in accordance with the present invention uses de-interlacing techniques to reconstruct the progressive video in the event that an encoded field was corrupted during transmission.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
- Television Systems (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
Description
Claims
Priority Applications (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US10/594,022 US20100033622A1 (en) | 2004-03-24 | 2005-03-23 | Multiple description coding video transmission using de-interlacing mechanisms |
JP2007504553A JP2007531377A (en) | 2004-03-24 | 2005-03-23 | Multiple description coded video transmission using progressive scan conversion mechanism |
EP05718550A EP1730963A1 (en) | 2004-03-24 | 2005-03-23 | Multiple description coding video transmission using de-interlacing mechanisms |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US55635204P | 2004-03-24 | 2004-03-24 | |
US60/556,352 | 2004-03-24 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2005094084A1 true WO2005094084A1 (en) | 2005-10-06 |
Family
ID=34961992
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/IB2005/051004 WO2005094084A1 (en) | 2004-03-24 | 2005-03-23 | Multiple description coding video transmission using de-interlacing mechanisms |
Country Status (5)
Country | Link |
---|---|
US (1) | US20100033622A1 (en) |
EP (1) | EP1730963A1 (en) |
JP (1) | JP2007531377A (en) |
CN (1) | CN1934870A (en) |
WO (1) | WO2005094084A1 (en) |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
FR2958822A1 (en) * | 2010-04-09 | 2011-10-14 | Canon Kk | Method for transmitting video data towards e.g. screen of high definition home theater type system, involves transmitting group of elements based on predetermined alternate of elementary groups |
CN103609088A (en) * | 2011-06-16 | 2014-02-26 | 高通股份有限公司 | Sharing multi description coded content utilizing proximate helpers |
CN104243993A (en) * | 2013-06-24 | 2014-12-24 | 索尼公司 | Image processing device and image processing method, program, and imaging apparatus |
Families Citing this family (18)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8897322B1 (en) * | 2007-09-20 | 2014-11-25 | Sprint Communications Company L.P. | Enhancing video quality for broadcast video services |
CN101420607B (en) * | 2007-10-26 | 2010-11-10 | 华为技术有限公司 | Method and apparatus for multi-description encoding and decoding based on frame |
JP5161589B2 (en) * | 2008-01-07 | 2013-03-13 | パナソニック株式会社 | Image reproducing apparatus, image reproducing method, program, and integrated circuit |
US9462020B2 (en) * | 2008-01-16 | 2016-10-04 | Qualcomm Incorporated | Intelligent client: multiple channel switching over a digital broadcast network |
US8254469B2 (en) * | 2008-05-07 | 2012-08-28 | Kiu Sha Management Liability Company | Error concealment for frame loss in multiple description coding |
JP2012501611A (en) * | 2008-09-01 | 2012-01-19 | ミツビシ エレクトリック ビジュアル ソリューションズ アメリカ, インコーポレイテッド | Image improvement system |
US8643698B2 (en) * | 2009-08-27 | 2014-02-04 | Broadcom Corporation | Method and system for transmitting a 1080P60 video in 1080i format to a legacy 1080i capable video receiver without resolution loss |
US9203427B2 (en) * | 2011-02-10 | 2015-12-01 | Alcatel Lucent | System and method for mitigating the cliff effect for content delivery over a heterogeneous network |
US9049464B2 (en) * | 2011-06-07 | 2015-06-02 | Qualcomm Incorporated | Multiple description coding with plural combined diversity |
WO2013103490A1 (en) | 2012-01-04 | 2013-07-11 | Dolby Laboratories Licensing Corporation | Dual-layer backwards-compatible progressive video delivery |
US9179196B2 (en) | 2012-02-22 | 2015-11-03 | Adobe Systems Incorporated | Interleaved video streams |
JP5979949B2 (en) | 2012-04-11 | 2016-08-31 | キヤノン株式会社 | Image data transmitting apparatus and image data receiving apparatus |
JP5979948B2 (en) * | 2012-04-11 | 2016-08-31 | キヤノン株式会社 | Image data transmitting apparatus and image data receiving apparatus |
WO2013158293A1 (en) | 2012-04-19 | 2013-10-24 | Vid Scale, Inc. | System and method for error-resilient video coding |
US9854017B2 (en) * | 2013-03-15 | 2017-12-26 | Qualcomm Incorporated | Resilience in the presence of missing media segments in dynamic adaptive streaming over HTTP |
US11223667B2 (en) * | 2019-04-30 | 2022-01-11 | Phantom Auto Inc. | Low latency wireless communication system for teleoperated vehicle environments |
WO2020247557A1 (en) | 2019-06-04 | 2020-12-10 | Phantom Auto Inc. | Platform for redundant wireless communications optimization |
CN112954249A (en) * | 2021-03-04 | 2021-06-11 | 联想(北京)有限公司 | Data processing method, device, equipment, medium and product |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2000027129A1 (en) * | 1998-11-02 | 2000-05-11 | Nokia Mobile Phones Limited | Error concealment in a video signal |
EP1006732A2 (en) * | 1998-12-04 | 2000-06-07 | Mitsubishi Denki Kabushiki Kaisha | Motion compensated interpolation for digital video signal processing |
US20020116715A1 (en) * | 2001-02-16 | 2002-08-22 | Apostolopoulos John G. | Video communication method and system employing multiple state encoding and path diversity |
Family Cites Families (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP3293561B2 (en) * | 1998-07-29 | 2002-06-17 | 日本電気株式会社 | Image display device and image display method |
WO2000072585A1 (en) * | 1999-05-25 | 2000-11-30 | Koninklijke Philips Electronics N.V. | Conversion of interlaced image signals into progressive scanned image signals |
-
2005
- 2005-03-23 JP JP2007504553A patent/JP2007531377A/en active Pending
- 2005-03-23 EP EP05718550A patent/EP1730963A1/en not_active Withdrawn
- 2005-03-23 WO PCT/IB2005/051004 patent/WO2005094084A1/en active Application Filing
- 2005-03-23 CN CN200580009598.XA patent/CN1934870A/en active Pending
- 2005-03-23 US US10/594,022 patent/US20100033622A1/en not_active Abandoned
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2000027129A1 (en) * | 1998-11-02 | 2000-05-11 | Nokia Mobile Phones Limited | Error concealment in a video signal |
EP1006732A2 (en) * | 1998-12-04 | 2000-06-07 | Mitsubishi Denki Kabushiki Kaisha | Motion compensated interpolation for digital video signal processing |
US20020116715A1 (en) * | 2001-02-16 | 2002-08-22 | Apostolopoulos John G. | Video communication method and system employing multiple state encoding and path diversity |
Non-Patent Citations (2)
Title |
---|
CHANG-SU KIM ET AL: "Multiple description motion coding algorithm for robust video transmission", CIRCUITS AND SYSTEMS, 2000. PROCEEDINGS. ISCAS 2000 GENEVA. THE 2000 IEEE INTERNATIONAL SYMPOSIUM ON MAY 28-31, 2000, PISCATAWAY, NJ, USA,IEEE, vol. 4, 28 May 2000 (2000-05-28), pages 717 - 720, XP010503701, ISBN: 0-7803-5482-6 * |
MAJUMDAR A ET AL INSTITUTE OF ELECTRICAL AND ELECTRONICS ENGINEERS: "Robust distributed video compression based on multilevel coset codes", CONFERENCE RECORD OF THE 37TH. ASILOMAR CONFERENCE ON SIGNALS, SYSTEMS, & COMPUTERS. PACIFIC GROOVE, CA, NOV. 9 - 12, 2003, ASILOMAR CONFERENCE ON SIGNALS, SYSTEMS AND COMPUTERS, NEW YORK, NY : IEEE, US, vol. VOL. 1 OF 2. CONF. 37, 9 November 2003 (2003-11-09), pages 845 - 849, XP010701850, ISBN: 0-7803-8104-1 * |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
FR2958822A1 (en) * | 2010-04-09 | 2011-10-14 | Canon Kk | Method for transmitting video data towards e.g. screen of high definition home theater type system, involves transmitting group of elements based on predetermined alternate of elementary groups |
US9300979B2 (en) | 2010-04-09 | 2016-03-29 | Canon Kabushiki Kaisha | Methods for transmitting and receiving data contents, corresponding source and destination nodes and storage means |
CN103609088A (en) * | 2011-06-16 | 2014-02-26 | 高通股份有限公司 | Sharing multi description coded content utilizing proximate helpers |
CN104243993A (en) * | 2013-06-24 | 2014-12-24 | 索尼公司 | Image processing device and image processing method, program, and imaging apparatus |
Also Published As
Publication number | Publication date |
---|---|
US20100033622A1 (en) | 2010-02-11 |
EP1730963A1 (en) | 2006-12-13 |
CN1934870A (en) | 2007-03-21 |
JP2007531377A (en) | 2007-11-01 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US20100033622A1 (en) | Multiple description coding video transmission using de-interlacing mechanisms | |
EP1127467B1 (en) | Error concealment in a video signal | |
US6611530B1 (en) | Video communication using multiple streams | |
US7020203B1 (en) | Dynamic intra-coded macroblock refresh interval for video error concealment | |
Apostolopoulos | Error-resilient video compression through the use of multiple states | |
JP4440392B2 (en) | Compressed video data decoding method and apparatus | |
Apostolopoulos | Error-resilient video compression via multiple state streams | |
US20060188025A1 (en) | Error concealment | |
US20050123056A1 (en) | Encoding and decoding of redundant pictures | |
JP2005538601A (en) | Content adaptive multiple description motion compensation for improved efficiency and error recovery | |
WO2000054511A2 (en) | Error resilient still image packetization method and packet structure | |
EP1638337A1 (en) | Method and system for multiple description coding and computer program product therefor | |
US20060062298A1 (en) | Method for encoding and decoding video signals | |
EP1488645B1 (en) | Video coding and transmission | |
US6983016B2 (en) | Method for detecting errors in video information | |
US20060078053A1 (en) | Method for encoding and decoding video signals | |
Ekmekci et al. | Unbalanced quantized multiple description video transmission using path diversity | |
Yang et al. | Adaptive error concealment for temporal–spatial multiple description video coding | |
WO2002019708A1 (en) | Dual priority video transmission for mobile applications | |
Khire et al. | Multiple representation coding for error-resilient video delivery | |
Rhaiem et al. | New robust decoding scheme-aware channel condition for video streaming transmission | |
JPH11252567A (en) | Coder for image signal, its method, decoder for image signal and its method | |
Li et al. | A Robust Video Coding Scheme for Mobile Wireless Communications. | |
Li et al. | Robust Transmission of Video Stream over Fading Channels | |
Shahriari et al. | Adaptive video concealment using neural networks for H. 264 based video coding |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AK | Designated states |
Kind code of ref document: A1 Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BW BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE EG ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NA NI NO NZ OM PG PH PL PT RO RU SC SD SE SG SK SL SM SY TJ TM TN TR TT TZ UA UG US UZ VC VN YU ZA ZM ZW |
|
AL | Designated countries for regional patents |
Kind code of ref document: A1 Designated state(s): GM KE LS MW MZ NA SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LT LU MC NL PL PT RO SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application | ||
WWE | Wipo information: entry into national phase |
Ref document number: 2005718550 Country of ref document: EP |
|
WWE | Wipo information: entry into national phase |
Ref document number: 200580009598.X Country of ref document: CN Ref document number: 2007504553 Country of ref document: JP |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
WWW | Wipo information: withdrawn in national office |
Country of ref document: DE |
|
WWP | Wipo information: published in national office |
Ref document number: 2005718550 Country of ref document: EP |
|
WWE | Wipo information: entry into national phase |
Ref document number: 10594022 Country of ref document: US |