WO2007003340A3 - Video encoder and video decoder - Google Patents

Video encoder and video decoder Download PDF

Info

Publication number
WO2007003340A3
WO2007003340A3 PCT/EP2006/006317 EP2006006317W WO2007003340A3 WO 2007003340 A3 WO2007003340 A3 WO 2007003340A3 EP 2006006317 W EP2006006317 W EP 2006006317W WO 2007003340 A3 WO2007003340 A3 WO 2007003340A3
Authority
WO
WIPO (PCT)
Prior art keywords
video
frames
motion information
decoder
high resolution
Prior art date
Application number
PCT/EP2006/006317
Other languages
French (fr)
Other versions
WO2007003340A2 (en
Inventor
Ivan Dimkovic
Richard Lesser
Original Assignee
Nero Ag
Ivan Dimkovic
Richard Lesser
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nero Ag, Ivan Dimkovic, Richard Lesser filed Critical Nero Ag
Publication of WO2007003340A2 publication Critical patent/WO2007003340A2/en
Publication of WO2007003340A3 publication Critical patent/WO2007003340A3/en

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51—Motion estimation or motion compensation
    • H04N19/577—Motion compensation with bidirectional frame interpolation, i.e. using B-pictures
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/189—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the adaptation method, adaptation tool or adaptation type used for the adaptive coding
    • H04N19/196—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the adaptation method, adaptation tool or adaptation type used for the adaptive coding being specially adapted for the computation of encoding parameters, e.g. by averaging previously computed encoding parameters
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/46—Embedding additional information in the video signal during the compression process
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/46—Embedding additional information in the video signal during the compression process
    • H04N19/463—Embedding additional information in the video signal during the compression process by compressing encoding parameters before transmission
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51—Motion estimation or motion compensation
    • H04N19/513—Processing of motion vectors
    • H04N19/517—Processing of motion vectors by encoding
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/587—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal sub-sampling or interpolation, e.g. decimation or subsequent interpolation of pictures in a video sequence

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computing Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
  • Television Systems (AREA)

Abstract

A video encoder includes a frame rate downsampler for downsampling a high resolution sequence of frames and a video encoding module for encoding the low resolution sequence of frames. On the decoder-side this low resolution sequence of frames is used together with high resolution motion information for performing a motion information assisted frame interpolation. The high resolution motion information is derived on the encoder-side directly from the high resolution sequence before downsampling or is derived by analyzing the low resolution sequence of frames on the decoder-side by a subsequent scaling/interpolation of the low resolution motion information.
PCT/EP2006/006317 2005-07-01 2006-06-29 Video encoder and video decoder WO2007003340A2 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US69619005P 2005-07-01 2005-07-01
US60/696,190 2005-07-01

Publications (2)

Publication Number Publication Date
WO2007003340A2 WO2007003340A2 (en) 2007-01-11
WO2007003340A3 true WO2007003340A3 (en) 2007-07-19

Family

ID=36922243

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/EP2006/006317 WO2007003340A2 (en) 2005-07-01 2006-06-29 Video encoder and video decoder

Country Status (1)

Country Link
WO (1) WO2007003340A2 (en)

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104067317A (en) 2011-09-08 2014-09-24 宝福特控股私人有限公司 System and method for visualizing synthetic objects withinreal-world video clip
US8982137B2 (en) * 2012-12-18 2015-03-17 Google Technology Holdings LLC Methods and systems for overriding graphics commands
US9137320B2 (en) 2012-12-18 2015-09-15 Google Technology Holdings LLC Methods and systems for overriding graphics commands
US9214005B2 (en) * 2012-12-18 2015-12-15 Google Technology Holdings LLC Methods and systems for overriding graphics commands
US9131202B1 (en) 2014-05-30 2015-09-08 Paofit Holdings Pte. Ltd. Systems and methods for motion-vector-aided video interpolation using real-time smooth video playback speed variation
US9704298B2 (en) 2015-06-23 2017-07-11 Paofit Holdings Pte Ltd. Systems and methods for generating 360 degree mixed reality environments
TWI746994B (en) 2018-06-19 2021-11-21 大陸商北京字節跳動網絡技術有限公司 Different precisions for different reference list
TWI815967B (en) 2018-09-19 2023-09-21 大陸商北京字節跳動網絡技術有限公司 Mode dependent adaptive motion vector resolution for affine mode coding
JP7235877B2 (en) 2019-01-31 2023-03-08 北京字節跳動網絡技術有限公司 Context for Encoding Affine Mode Adaptive Motion Vector Resolution

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH02296479A (en) * 1989-05-11 1990-12-07 Matsushita Electric Ind Co Ltd Transmitter for moving picture signal
US5113255A (en) * 1989-05-11 1992-05-12 Matsushita Electric Industrial Co., Ltd. Moving image signal encoding apparatus and decoding apparatus

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH02296479A (en) * 1989-05-11 1990-12-07 Matsushita Electric Ind Co Ltd Transmitter for moving picture signal
US5113255A (en) * 1989-05-11 1992-05-12 Matsushita Electric Industrial Co., Ltd. Moving image signal encoding apparatus and decoding apparatus

Non-Patent Citations (12)

* Cited by examiner, † Cited by third party
Title
ARRAGON J P ET AL: "Motion compensated interpolation techniques for HD-MAC", BROADCASTING CONVENTION, 1988. IBC 1988., INTERNATIONAL BRIGHTON, UK, LONDON, UK,IEE, UK, 1988, pages 70 - 73, XP006518358, ISBN: 0-85296-368-8 *
DA SILVA CRUZ L A ET AL: "Adaptive motion vector vector quantization for video coding", IMAGE PROCESSING, 2000. PROCEEDINGS. 2000 INTERNATIONAL CONFERENCE ON SEPTEMBER 10-13, 2000, PISCATAWAY, NJ, USA,IEEE, vol. 2, 10 September 2000 (2000-09-10), pages 867 - 870, XP010530122, ISBN: 0-7803-6297-7 *
DANE G ET AL: "Encoder-Assisted Adaptive Video Frame Interpolation", ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2005. PROCEEDINGS. (ICASSP '05). IEEE INTERNATIONAL CONFERENCE ON PHILADELPHIA, PENNSYLVANIA, USA MARCH 18-23, 2005, PISCATAWAY, NJ, USA,IEEE, 18 March 2005 (2005-03-18), pages 349 - 352, XP010790648, ISBN: 0-7803-8874-7 *
DONG-WOOK KIM ET AL: "A NEW VIDEO INTERPOLATION TECHNIQUE BASED ON MOTION-ADAPTIVE SUBSAMPLING", IEEE TRANSACTIONS ON CONSUMER ELECTRONICS, IEEE SERVICE CENTER, NEW YORK, NY, US, vol. 45, no. 3, August 1999 (1999-08-01), pages 782 - 787, XP011083800, ISSN: 0098-3063 *
LIU S ET AL: "MCI-embedded motion-compensated prediction for quality enhancement of frame interpolation", PROCEEDINGS OF THE SPIE, SPIE, BELLINGHAM, VA, US, vol. 4209, 6 November 2000 (2000-11-06), pages 251 - 261, XP002351712, ISSN: 0277-786X *
PAN F ET AL: "Content adaptive frame skipping for low bit rate video coding", INFORMATION, COMMUNICATIONS AND SIGNAL PROCESSING, 2003 AND FOURTH PACIFIC RIM CONFERENCE ON MULTIMEDIA. PROCEEDINGS OF THE 2003 JOINT CONFERENCE OF THE FOURTH INTERNATIONAL CONFERENCE ON SINGAPORE 15-18 DEC. 2003, PISCATAWAY, NJ, USA,IEEE, vol. 1, 15 December 2003 (2003-12-15), pages 230 - 234, XP010702581, ISBN: 0-7803-8185-8 *
PATENT ABSTRACTS OF JAPAN vol. 015, no. 078 (E - 1037) 22 February 1991 (1991-02-22) *
SOO-CHUL HAN ET AL: "Efficient encoding of dense motion fields for motion-compensated video compression", IMAGE PROCESSING, 1999. ICIP 99. PROCEEDINGS. 1999 INTERNATIONAL CONFERENCE ON KOBE, JAPAN 24-28 OCT. 1999, PISCATAWAY, NJ, USA,IEEE, US, vol. 1, 24 October 1999 (1999-10-24), pages 84 - 88, XP010369214, ISBN: 0-7803-5467-2 *
SU J K ET AL: "Motion-compensated interpolation of untransmitted frames in compressed video", SIGNALS, SYSTEMS AND COMPUTERS, 1996. CONFERENCE RECORD OF THE THIRTIETH ASILOMAR CONFERENCE ON PACIFIC GROVE, CA, USA 3-6 NOV. 1996, LOS ALAMITOS, CA, USA,IEEE COMPUT. SOC, US, vol. 1, 3 November 1996 (1996-11-03), pages 100 - 104, XP010231401, ISBN: 0-8186-7646-9 *
THOMA R ET AL: "MOTION COMPENSATING INTERPOLATION CONSIDERING COVERED AND UNCOVERED BACKGROUND", SIGNAL PROCESSING. IMAGE COMMUNICATION, ELSEVIER SCIENCE PUBLISHERS, AMSTERDAM, NL, vol. 1, no. 2, 1 October 1989 (1989-10-01), pages 191 - 212, XP000234868, ISSN: 0923-5965 *
TIEN-YING KUO ET AL: "Motion-compensated frame interpolation scheme for H.263 codec", CIRCUITS AND SYSTEMS, 1999. ISCAS '99. PROCEEDINGS OF THE 1999 IEEE INTERNATIONAL SYMPOSIUM ON ORLANDO, FL, USA 30 MAY-2 JUNE 1999, PISCATAWAY, NJ, USA,IEEE, US, vol. 4, 30 May 1999 (1999-05-30), pages 491 - 494, XP010341210, ISBN: 0-7803-5471-0 *
YEN-KUANG CHEN ET AL: "Frame-rate up-conversion using transmitted true motion vectors", MULTIMEDIA SIGNAL PROCESSING, 1998 IEEE SECOND WORKSHOP ON REDONDO BEACH, CA, USA 7-9 DEC. 1998, PISCATAWAY, NJ, USA,IEEE, US, 7 December 1998 (1998-12-07), pages 622 - 627, XP010318331, ISBN: 0-7803-4919-9 *

Also Published As

Publication number Publication date
WO2007003340A2 (en) 2007-01-11

Similar Documents

Publication Publication Date Title
WO2007003340A3 (en) Video encoder and video decoder
EP1788817A4 (en) Decoder, encoder, decoding method and encoding method
WO2006007527A3 (en) Method and apparatus for using frame rate up conversion techniques in scalable video coding
MY141817A (en) Reduced resolution update mode for advanced video coding
WO2005099275A3 (en) Complexity scalable video decoding
WO2009126915A8 (en) Rate-distortion defined interpolation for video coding based on fixed filter or adaptive filter
WO2007038728A3 (en) Encoder assisted frame rate up conversion using various motion models
WO2006104556A3 (en) Split screen multimedia video conferencing
WO2008022181A3 (en) Updating of decoder states after packet loss concealment
WO2008005574A3 (en) Method and apparatus for decoupling frame number and/or picture order count (poc) for multi-view video encoding and decoding
WO2010003563A8 (en) Audio encoder and decoder for encoding and decoding audio samples
TW200723887A (en) Method and apparatus for weighted prediction for scalable video coding
WO2007002437A3 (en) Method and apparatus for video encoding and decoding using adaptive interpolation
ATE414381T1 (en) VIDEO CODING AND DECODING, MOTION COMPENSATED VIDEO ENCODER AND ASSOCIATED DECODER
WO2007018709A3 (en) Method and apparatus for the concealment of missing video frames
AU2003276300A1 (en) Picture buffering for prediction references and display
WO2007145381A3 (en) Motion picture encoding device, motion picture encoding method, motion picture decoding device, motion picture decoding method, motion picture recording device, program and data structure
WO2006122314A3 (en) Temporal error concealment for bi-directionally predicted frames
WO2008103766A3 (en) Computational complexity and precision control in transform-based digital media codec
WO2007007263A3 (en) Audio encoding and decoding
WO2009051692A3 (en) Methods and apparatus for inter-layer residue prediction for scalable video
WO2008081810A1 (en) Video encoding method, decoding method, device thereof, program thereof, and storage medium containing the program
WO2008085533A3 (en) Block information adjustment techniques to reduce artifacts in interpolated video frames
WO2002085028A3 (en) Interpolation for motion compensation
WO2011128272A3 (en) Hybrid video decoder, hybrid video encoder, data stream

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application
NENP Non-entry into the national phase

Ref country code: DE

WWW Wipo information: withdrawn in national office

Country of ref document: DE

122 Ep: pct application non-entry in european phase

Ref document number: 06762275

Country of ref document: EP

Kind code of ref document: A2