WO2008018015A1 - Dispositif d'élévation d'une fréquence image - Google Patents

Dispositif d'élévation d'une fréquence image Download PDF

Info

Publication number
WO2008018015A1
WO2008018015A1 PCT/IB2007/053102 IB2007053102W WO2008018015A1 WO 2008018015 A1 WO2008018015 A1 WO 2008018015A1 IB 2007053102 W IB2007053102 W IB 2007053102W WO 2008018015 A1 WO2008018015 A1 WO 2008018015A1
Authority
WO
WIPO (PCT)
Prior art keywords
film
rate
motion
images
image
Prior art date
Application number
PCT/IB2007/053102
Other languages
English (en)
Inventor
Franciscus H. Van Heesch
Michiel A. Klompenhouwer
Maurice P. H. Penners
Wim Michiels
Erwin B. Bellers
Johan G. W. M. Janssen
Original Assignee
Koninklijke Philips Electronics N.V.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Koninklijke Philips Electronics N.V. filed Critical Koninklijke Philips Electronics N.V.
Publication of WO2008018015A1 publication Critical patent/WO2008018015A1/fr

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/01—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level
    • H04N7/0112—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level one of the standards corresponding to a cinematograph film standard

Definitions

  • the invention relates to image rate increasing.
  • High-end LCD-TV systems typically discriminate film content from video content and process both input types differently.
  • film preferably, film judder reduction is applied in order to improve the motion portrayal by means of motion compensated frame rate conversion.
  • LCDs typically suffer from motion blur
  • the motion portrayal of both video and film can be further improved by applying motion blur reduction.
  • additional frame rate conversion often this is too computational intensive and more cost effective techniques are used, such as black frame insertion, grey frame insertion and dynamic frame insertion.
  • DFI has been disclosed by JP-A-2002351382. See also Han-Feng Chen, et.
  • Dynamic Frame Insertion is a motion blur reduction technique that doubles the frame rate, alternating a peaked and blurred version of each input picture that are obtained by spatial filtering. This effectively reduces the hold time of spatial details by a factor of two, while large areas have a hold time of the input frame rate preventing large area flicker.
  • an object of the invention to provide an improved image rate increasing.
  • the invention is defined by the independent claims.
  • Advantageous embodiments are defined in the dependent claims.
  • a more cost effective implementation is obtained.
  • video and film content require a different kind of processing.
  • motion judder is removed prior to motion blur reduction, while in case of video applying motion blur reduction suffices.
  • FIG. 1 shows a basic implementation of the present invention
  • Fig. 2 shows a schematic implementation of a general embodiment
  • Fig. 3 shows a third embodiment of the present invention
  • Fig. 4 shows a fourth embodiment of the present invention
  • Fig. 5 shows a fifth embodiment of the present invention.
  • motion portrayal enhancement for an LCD-TV system should at least contain film detection, motion judder cancellation, and motion blur reduction, as illustrated in Fig. 1. This leaves the system architect with the options to decide on the output frame rate for both film and video and to decide on the motion blur reduction method to use for an optimal cost/quality tradeoff.
  • Incoming images I are applied to a film detector FD to determine whether the images originated from film.
  • film detector FD There are several known techniques for film detection; a suitable technique has been described in US 5365280.
  • Images F that have been determined to originate from film are first applied to a motion judder cancellation circuit MJC, and thereafter to a motion blur reduction circuit MBR, while images V that have not been determined to originate from film are directly applied to the motion blur reduction circuit MBR, which furnishes output images O.
  • motion compensated frame rate up- conversion to the maximum obtainable refresh rate is optimal for both film and video. For modern displays and content this typically entails frame rate up-conversion of HD input material that has an intrinsic frame rate of 25 Hz or 50 Hz (24 Hz or 60 Hz in the US) to a display frame rate of 100 ( 120) Hz .
  • Motion portrayal improvement of TV-signals on LCD displays requires motion judder removal and motion blur reduction. Both require a frame rate increase, but where there are multiple options for motion blur reduction, motion judder reduction can only be reduced using motion compensated interpolation.
  • System design considerations determine the optimal method for motion blur reduction and the extent to which motion judder is reduced. To produce an optimal picture quality at any time a video processing system should, therefore, be capable of dynamically switching between different up-conversion methods depending on the input format.
  • Fig. 2 shows a schematic implementation of a general embodiment.
  • a motion judder detector e.g. a detector FD for detecting whether the source material was film
  • the input pictures F are temporally up-converted to a frame-rate higher than the judder limit, using motion-compensated frame rate conversion ME+MC, followed by a further frame rate doubling by means of DFI.
  • the image rate is not adjusted, as both the input images and the output image are at a rate matching that of the TV system, i.e.
  • the motion-compensated frames are spatially low- pass filtered (LPF) to serve as a second input to the DFI processing block.
  • LPF spatially low- pass filtered
  • DFI Dynamic Frame Insertion
  • DFI processing alternately outputs sharpened and low-pass filtered (LPF) images, the average of the sharpened and low-pass filtered images corresponding to the input images.
  • the low-pass filtering LPF and motion-compensated frame rate conversion MC order can be swapped, as illustrated in Fig. 3.
  • This embodiment has the advantage that the low-pass filtering LPF is applied on the input frame rate, which is beneficial in terms of computational costs and/or complexity on certain system architectures.
  • two motion-compensation blocks are present, viz. MC A for the film-originated images F that have not been low-pass filtered and MC B for the film-originated images F that have been low-pass filtered.
  • Both motion- compensated blocks MC A and MC B receive their motion vectors from a motion vector estimation block ME.
  • the embodiment of Fig. 3 corresponds to the embodiment of Fig. 2.
  • Fig. 4 shows a more detailed embodiment of a video system that discriminates between video (judder free) input material V and film (judder impaired) input material F.
  • Film detector FD determines if the input material I is video or film.
  • the input picture rate is 24 Hz (or 25 Hz in Europe).
  • the frame rate is doubled to 48 Hz (or 50 Hz in Europe) by means of motion compensated frame rate conversion, using a motion estimator ME to determine the motion in the video sequence and a conversion unit MC to interpolate the moving objects along the motion vector, e.g. by using the techniques described in G. de Haan, "Video Processing for Multimedia Systems", University Press, Eindhoven, The Netherlands, ISBN-90-014015-8, 2000.
  • a frame memory FM is used for the motion-compensated processing ME / MC.
  • the motion- compensation algorithm goes back to the original images at 24 Hz (which may involve combining 2 interlaced TV images into 1 de-interlaced 24 Hz image) and produces 48 Hz images by motion-compensated image rate doubling in a known manner.
  • DFI Dynamic Frame Insertion
  • LPF 2D low-pass filtering
  • the low-pass filtered picture is motion compensated (MC LPF) and the input picture is motion compensated (MC IN). Both outputs are used for the Dynamic Frame Insertion processing block DFI to generate a motion compensated peaked and blurred frame. Together with the output frames of the DFI processing block that operates on the previous picture that has been stored in a frame memory the output picture rate is upconverted with a factor of 4.
  • the input frames preferably are encoded in the linear light RGB domain, but an alternative embodiment applies this processing scheme in the YUV domain, by either processing on the Y-component only or applying similar processing to Y and UV components separately.
  • Figs. 4 and 5 show that motion estimation and motion compensation is performed using a current frame and a stored frame.
  • Other upconversion techniques that use a different number of frames are also possible.
  • the low-pass filtering that serves as an input to the DFI algorithm in a video system can be applied to either the interlaced or de- interlaced input picture.
  • Improved versions of the DFI algorithm make it motion vector dependent.
  • the DFI block could have its own motion estimation or, more advantageously, use the motion estimation block ME already present in the circuit.
  • one aspect of the invention covers a video processing system for both video and film that combines motion judder reduction with motion blur reduction.
  • the invention can be applied in video processing pipelines for TV systems, e.g. backend-scaler ICs on the small-signal board of an LCD-TV or TCON ICs on the LCD panel itself.
  • the same circuitry may be used for the actual image rate increase (motion blur reduction) both when the incoming images have been determined to originate from film and when the incoming images have been determined to not originate from film. While several embodiments show a distinction between the motion estimation / compensation, and the DFI, an integrated approach is possible in which in a single step both motion compensation and DFI are carried out. While several embodiments include a film detector, no such film detector is necessary if the incoming image signal includes a control signal indicating whether the incoming images originate from film.
  • any reference signs placed between parentheses shall not be construed as limiting the claim.
  • the word “comprising” does not exclude the presence of elements or steps other than those listed in a claim.
  • the word "a” or “an” preceding an element does not exclude the presence of a plurality of such elements.
  • the invention may be implemented by means of hardware comprising several distinct elements, and/or by means of a suitably programmed processor. In the device claim enumerating several means, several of these means may be embodied by one and the same item of hardware. The mere fact that certain measures are recited in mutually different dependent claims does not indicate that a combination of these measures cannot be used to advantage.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Television Systems (AREA)
  • Liquid Crystal Display Device Control (AREA)

Abstract

L'invention concerne un dispositif d'élévation d'une fréquence image conçu pour élever la fréquence image si les images d'entrée proviennent d'un film, ledit dispositif comprenant un premier circuit (MC, DFI) d'élévation de la fréquence image servant à générer des images de sortie de film à une fréquence de sortie de film à partir d'images d'entrée (F) provenant d'un film, et un deuxième circuit (DFI) d'élévation de la fréquence image servant à générer des images de sortie vidéo à une fréquence de sortie vidéo à partir d'images d'entrée (V) ne provenant pas d'un film. Si une fréquence de film d'origine (par ex. 24 Hz) à laquelle le film a été reçu ne correspond pas à la moitié de la fréquence image d'entrée (par ex. 60 Hz) à laquelle les images d'entrée sont reçues, la fréquence image de sortie (par ex. 96 Hz) est alors différente de la fréquence vidéo de sortie (par ex. 120 Hz).
PCT/IB2007/053102 2006-08-09 2007-08-07 Dispositif d'élévation d'une fréquence image WO2008018015A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US82186306P 2006-08-09 2006-08-09
US60/821,863 2006-08-09

Publications (1)

Publication Number Publication Date
WO2008018015A1 true WO2008018015A1 (fr) 2008-02-14

Family

ID=38771888

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/IB2007/053102 WO2008018015A1 (fr) 2006-08-09 2007-08-07 Dispositif d'élévation d'une fréquence image

Country Status (1)

Country Link
WO (1) WO2008018015A1 (fr)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2009147614A1 (fr) * 2008-06-02 2009-12-10 Nxp B.V. Masquage d’artefacts pour conversion ascendante temporelle
RU2461979C2 (ru) * 2008-02-21 2012-09-20 Шарп Кабусики Кайся Устройство видеоотображения

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1999034597A1 (fr) * 1997-12-31 1999-07-08 Sarnoff Corporation CONVERSION DE FREQUENCE DE TRAME ET DE FORMAT POUR AFFICHAGE D'UNE SOURCE VIDEO DE 24 Hz
JP2002351382A (ja) * 2001-03-22 2002-12-06 Victor Co Of Japan Ltd ディスプレイ装置
EP1482732A2 (fr) * 2003-05-27 2004-12-01 Genesis Microchip, Inc. Méthode et système de modification de la fréquence d'image d'un dispositif d'affichage vidéo

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1999034597A1 (fr) * 1997-12-31 1999-07-08 Sarnoff Corporation CONVERSION DE FREQUENCE DE TRAME ET DE FORMAT POUR AFFICHAGE D'UNE SOURCE VIDEO DE 24 Hz
JP2002351382A (ja) * 2001-03-22 2002-12-06 Victor Co Of Japan Ltd ディスプレイ装置
EP1482732A2 (fr) * 2003-05-27 2004-12-01 Genesis Microchip, Inc. Méthode et système de modification de la fréquence d'image d'un dispositif d'affichage vidéo

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
CHEN HA-FEG ET AL: "Smooth frame insertion method for motion-blur reduction in LCDs", EURODISPLAY, XX, XX, 2005, pages 359 - 361, XP009087929 *

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
RU2461979C2 (ru) * 2008-02-21 2012-09-20 Шарп Кабусики Кайся Устройство видеоотображения
US8941778B2 (en) 2008-02-21 2015-01-27 Sharp Kabushiki Kaisha Video display apparatus
WO2009147614A1 (fr) * 2008-06-02 2009-12-10 Nxp B.V. Masquage d’artefacts pour conversion ascendante temporelle

Similar Documents

Publication Publication Date Title
EP0740467B1 (fr) Conversion du mode ciné au balayage progressif
De Haan IC for motion-compensated de-interlacing, noise reduction, and picture-rate conversion
US7705914B2 (en) Pull-down signal detection apparatus, pull-down signal detection method and progressive-scan conversion apparatus
US8396129B2 (en) Apparatus and method for single-pass, gradient-based motion compensated image rate conversion
US8508659B2 (en) System and method for frame rate conversion using multi-resolution temporal interpolation
EP1551181A2 (fr) Contrôleur adaptatif d'affichage
US7667772B2 (en) Video processing apparatus and method
US20080055477A1 (en) Method and System for Motion Compensated Noise Reduction
KR20090113751A (ko) 화상 표시 장치
NL1027270C2 (nl) Deïnterlinieringsinrichting met een ruisverminderings/verwijderingsinrichting.
KR20060047630A (ko) 움직임 보상된 출력 이미지 데이터를 생성하는 방법 및움직임 보상기
US6947094B2 (en) Image signal processing apparatus and method
KR20060130147A (ko) 이미지 움직임 보상 장치 및 그 방법
JP2007274411A (ja) プルダウン信号検出装置およびプルダウン信号検出方法並びに順次走査変換装置および順次走査変換方法
US8248527B2 (en) Method and system for video overlay on film detection on progressive video input
EP1985110A1 (fr) Dispositif de traitement vidéo et procédé de traitement de données vidéo
WO2007149424A2 (fr) procédé et système pour une insertion de trame dans un système d'affichage numérique
US7868948B2 (en) Mage signal processing apparatus, image signal processing method and program for converting an interlaced signal into a progressive signal
US7430014B2 (en) De-interlacing device capable of de-interlacing video fields adaptively according to motion ratio and associated method
US8929447B2 (en) Image deblurring method using motion compensation
WO2008018015A1 (fr) Dispositif d'élévation d'une fréquence image
KR100467625B1 (ko) 프레임 레이트 변환을 이용하는 영상 처리 장치 및 방법
JP2008009182A (ja) 液晶表示装置
JP2005026885A (ja) テレビジョン受信装置及びその制御方法
JP2006030352A (ja) 液晶表示装置

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 07805328

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

NENP Non-entry into the national phase

Ref country code: RU

122 Ep: pct application non-entry in european phase

Ref document number: 07805328

Country of ref document: EP

Kind code of ref document: A1