WO2012001520A3 - Pixel interpolation method and system - Google Patents

Pixel interpolation method and system Download PDF

Info

Publication number
WO2012001520A3
WO2012001520A3 PCT/IB2011/001857 IB2011001857W WO2012001520A3 WO 2012001520 A3 WO2012001520 A3 WO 2012001520A3 IB 2011001857 W IB2011001857 W IB 2011001857W WO 2012001520 A3 WO2012001520 A3 WO 2012001520A3
Authority
WO
WIPO (PCT)
Prior art keywords
pixel
predicted
computing
combination
neighborhood
Prior art date
Application number
PCT/IB2011/001857
Other languages
French (fr)
Other versions
WO2012001520A2 (en
Inventor
Ronggang Wang
Yongbing Zhang
Dong YUAN
Original Assignee
France Telecom
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by France Telecom filed Critical France Telecom
Publication of WO2012001520A2 publication Critical patent/WO2012001520A2/en
Publication of WO2012001520A3 publication Critical patent/WO2012001520A3/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformations in the plane of the image
    • G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
    • G06T3/4007—Scaling of whole images or parts thereof, e.g. expanding or contracting based on interpolation, e.g. bilinear interpolation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/103—Selection of coding mode or of prediction mode
    • H04N19/105—Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/182—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a pixel
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/189—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the adaptation method, adaptation tool or adaptation type used for the adaptive coding
    • H04N19/192—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the adaptation method, adaptation tool or adaptation type used for the adaptive coding the adaptation method, adaptation tool or adaptation type being iterative or recursive
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51—Motion estimation or motion compensation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51—Motion estimation or motion compensation
    • H04N19/577—Motion compensation with bidirectional frame interpolation, i.e. using B-pictures
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/587—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal sub-sampling or interpolation, e.g. decimation or subsequent interpolation of pictures in a video sequence
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/60—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
    • H04N19/61—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding in combination with predictive coding
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/80—Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation
    • H04N19/82—Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation involving filtering within a prediction loop
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/01—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level
    • H04N7/0127—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level by changing the field or frame frequency of the incoming video signal, e.g. frame rate converter
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/01—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level
    • H04N7/0127—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level by changing the field or frame frequency of the incoming video signal, e.g. frame rate converter
    • H04N7/0132—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level by changing the field or frame frequency of the incoming video signal, e.g. frame rate converter the field or frame frequency of the incoming video signal being multiplied by a positive integer, e.g. for flicker reduction

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
  • Television Systems (AREA)

Abstract

A method of computing a frame to be predicted from a first and a second reference frames, said method comprising for each pixel to be predicted in the frame to be predicted the acts of defining a first and a second pixel corresponding, respectively in said first and second reference frames, to the pixel to be predicted along the motion vector of said pixel to be predicted; computing a first predicted pixel as a combination of pixels in a neighborhood of said first pixel using first combination coefficients, said first combination coefficients allowing computing said second pixel as a combination of pixels of said neighborhood of said first pixel, wherein said first combination coefficients are calculated using a similarity function representing a grey level difference between a pixel of said neighborhood of said first pixel and the pixel to be predicted; and computing said pixel to be predicted from said first predicted pixel.
PCT/IB2011/001857 2010-06-30 2011-06-29 Pixel interpolation method and system WO2012001520A2 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CNPCT/CN2010/074839 2010-06-30
PCT/CN2010/074839 WO2012000191A1 (en) 2010-06-30 2010-06-30 Pixel interpolation method and system

Publications (2)

Publication Number Publication Date
WO2012001520A2 WO2012001520A2 (en) 2012-01-05
WO2012001520A3 true WO2012001520A3 (en) 2012-03-01

Family

ID=44906214

Family Applications (2)

Application Number Title Priority Date Filing Date
PCT/CN2010/074839 WO2012000191A1 (en) 2010-06-30 2010-06-30 Pixel interpolation method and system
PCT/IB2011/001857 WO2012001520A2 (en) 2010-06-30 2011-06-29 Pixel interpolation method and system

Family Applications Before (1)

Application Number Title Priority Date Filing Date
PCT/CN2010/074839 WO2012000191A1 (en) 2010-06-30 2010-06-30 Pixel interpolation method and system

Country Status (1)

Country Link
WO (2) WO2012000191A1 (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109934262B (en) * 2019-01-31 2023-08-22 平安科技（深圳）有限公司 Picture variability judging method, device, computer equipment and storage medium
CN111161338B (en) * 2019-12-26 2022-05-17 浙江大学 Point cloud density improving method for depth prediction based on two-dimensional image gray scale

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1978737A2 (en) * 2007-03-27 2008-10-08 Kabushiki Kaisha Toshiba Frame interpolation apparatus and method
WO2010032229A1 (en) * 2008-09-22 2010-03-25 France Telecom Frame rate up conversion method and system
WO2010049917A2 (en) * 2008-10-31 2010-05-06 France Telecom Image prediction method and system

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1272967C (en) * 2002-01-18 2006-08-30 株式会社东芝 Video coding method and apparatus and decoding method and apparatus
WO2006108654A2 (en) * 2005-04-13 2006-10-19 Universität Hannover Method and apparatus for enhanced video coding
JP2006324888A (en) * 2005-05-18 2006-11-30 Fujitsu Ltd Dynamic-image coding equipment

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1978737A2 (en) * 2007-03-27 2008-10-08 Kabushiki Kaisha Toshiba Frame interpolation apparatus and method
WO2010032229A1 (en) * 2008-09-22 2010-03-25 France Telecom Frame rate up conversion method and system
WO2010049917A2 (en) * 2008-10-31 2010-05-06 France Telecom Image prediction method and system

Non-Patent Citations (6)

* Cited by examiner, † Cited by third party
Title
KOKARAM A C ET AL: "DETECTION OF MISSING DATA IN IMAGE SEQUENCES", IEEE TRANSACTIONS ON IMAGE PROCESSING, IEEE SERVICE CENTER, PISCATAWAY, NJ, US, vol. 4, no. 11, 1 November 1995 (1995-11-01), pages 1496 - 1508, XP000537923, ISSN: 1057-7149, DOI: 10.1109/83.469931 *
KOKARAM A C ET AL: "INTERPOLATION OF MISSING DATA IN IMAGE SEQUENCES", IEEE TRANSACTIONS ON IMAGE PROCESSING, IEEE SERVICE CENTER, PISCATAWAY, NJ, US, vol. 4, no. 11, 1 November 1995 (1995-11-01), pages 1509 - 1519, XP000537924, ISSN: 1057-7149, DOI: 10.1109/83.469932 *
XIANMING LIU ET AL: "Joint learning for side information and correlation model based on linear regression model in distributed video coding", IMAGE PROCESSING (ICIP), 2009 16TH IEEE INTERNATIONAL CONFERENCE ON, IEEE, PISCATAWAY, NJ, USA, 7 November 2009 (2009-11-07), pages 2937 - 2940, XP031628218, ISBN: 978-1-4244-5653-6, DOI: 10.1109/ICIP.2009.5413499 *
XIN LI: "Video Processing Via Implicit and Mixture Motion Models", IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, IEEE SERVICE CENTER, PISCATAWAY, NJ, US, vol. 17, no. 8, 1 August 2007 (2007-08-01), pages 953 - 963, XP011190411, ISSN: 1051-8215, DOI: 10.1109/TCSVT.2007.896656 *
YONGBING ZHANG ET AL: "A Motion-Aligned Auto-Regressive Model for Frame Rate Up Conversion", IEEE TRANSACTIONS ON IMAGE PROCESSING, IEEE SERVICE CENTER, PISCATAWAY, NJ, US, vol. 19, no. 5, 1 May 2010 (2010-05-01), pages 1248 - 1258, XP002586010, ISSN: 1057-7149, DOI: 10.1109/TIP.2009.2039055 *
YONGBING ZHANG ET AL: "A Spatio-Temporal Auto Regressive Model for Frame Rate Upconversion", IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, IEEE SERVICE CENTER, PISCATAWAY, NJ, US, vol. 19, no. 9, 1 September 2009 (2009-09-01), pages 1289 - 1301, XP011268769, ISSN: 1051-8215, DOI: 10.1109/TCSVT.2009.2022798 *

Also Published As

Publication number Publication date
WO2012000191A1 (en) 2012-01-05
WO2012001520A2 (en) 2012-01-05

Similar Documents

Publication Publication Date Title
NZ612089A (en) Deblocking filtering
WO2009034488A3 (en) Method an apparatus for line based vertical motion estimation and compensation
IN2014MN00856A (en)
WO2012142505A3 (en) Pixel value compaction for graphics processing
WO2013002579A3 (en) Method for image interpolation using asymmetric interpolation filter and apparatus therefor
EP2664149A4 (en) Deblocking filtering
WO2013002586A3 (en) Method and apparatus for image encoding and decoding using intra prediction
WO2011155697A3 (en) Method and device for converting three-dimensional image using depth map information
WO2011053655A3 (en) Global motion parameter estimation using block-based motion vectors
WO2013155267A3 (en) Motion vector rounding
WO2011103210A3 (en) Smoothing overlapped regions resulting from geometric motion partitioning
MY166573A (en) Multi-metric filtering
CA2843772C (en) Apparatus and method for digital microscopy imaging
WO2012044105A3 (en) Method and device for interpolating images by using a smoothing interpolation filter
WO2011126278A3 (en) Method and apparatus for encoding and decoding video
WO2013003143A3 (en) Motion prediction in scalable video coding
WO2007127446A3 (en) Burn-in control
WO2009116745A3 (en) Method and apparatus for encoding and decoding image
WO2014014603A3 (en) Crosstalk reduction with location-based adjustment in multiview video processing
EP2534842B8 (en) Motion vector prediction method
WO2008156010A1 (en) Image processing device, image processing method, and program
WO2013086530A3 (en) Method and apparatus for processing partial video frame data
MX2012003206A (en) Video display device.
WO2013009099A3 (en) Device and method for blur processing
WO2014096961A3 (en) Systems and methods for adaptive scaling of digital images

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 11773823

Country of ref document: EP

Kind code of ref document: A2

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 11773823

Country of ref document: EP

Kind code of ref document: A2