EP2087736A2 - Video pre-processing device and method, motion estimation device and method - Google Patents
Video pre-processing device and method, motion estimation device and methodInfo
- Publication number
- EP2087736A2 EP2087736A2 EP07847362A EP07847362A EP2087736A2 EP 2087736 A2 EP2087736 A2 EP 2087736A2 EP 07847362 A EP07847362 A EP 07847362A EP 07847362 A EP07847362 A EP 07847362A EP 2087736 A2 EP2087736 A2 EP 2087736A2
- Authority
- EP
- European Patent Office
- Prior art keywords
- component
- video
- colour
- colour component
- pixel
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/90—Dynamic range modification of images or parts thereof
- G06T5/94—Dynamic range modification of images or parts thereof based on local image properties, e.g. for local contrast enhancement
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/77—Circuits for processing the brightness signal and the chrominance signal relative to each other, e.g. adjusting the phase of the brightness signal relative to the colour signal, correcting differential gain or differential phase
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/117—Filters, e.g. for pre-processing or post-processing
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/186—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a colour or a chrominance component
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
- H04N19/51—Motion estimation or motion compensation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/60—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
- H04N19/61—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding in combination with predictive coding
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/80—Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/85—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10016—Video; Image sequence
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10024—Color image
Definitions
- the invention relates to a video pre-processing device and method.
- the invention may, in particular, be applied to video pre-processing prior to motion estimation and, more particularly, to recursive-pixel-based motion estimation.
- Motion estimation by the recursive-pixel method is based on the DFD
- the invention provides a method of image processing that advantageously allows the contours of an image to be accentuated.
- Such an accentuation can be useful in order to improve the motion estimation of a video sequence without affecting the core of the estimator.
- the motion estimation is more effective in images whose contours are accentuated because a motion estimator needs the contours of an image to lock onto and to define the various movements.
- the invention is not limited to motion estimation but may be used for other image processing applications for which such an accentuation of the contours is advantageous.
- the invention provides a device for video preprocessing of at least one of the colour components of the video comprising, for each pixel,
- the device comprises linear rescaling means carrying out, upstream of the low-pass filtering means, a linear rescaling in such a manner as to spread the spectrum of at least one colour component between a minimum value and a predetermined maximum value.
- the pre-processing is carried out by choosing from amongst
- the green component of the video preferably a combination of the red component and of the blue component.
- the invention also relates to a motion estimation device for a video signal comprising, for each pixel : - means for linear rescaling in such a manner as to spread the spectrum of at least one colour component between a minimum value and a predetermined maximum value,
- the invention also relates to a method for the video pre-processing of at least one of the colour components of the video comprising for each pixel,
- the various embodiments of the invention may be produced by software, hardware or by combination of these various techniques.
- the invention can be supplied as a computer program product, or a software application, which can comprise a device or medium readable by a computer having instructions stored for executing the method according to the invention.
- the invention may be effected by hardware means containing logic wired so as to carry out the various means of the invention or else by a combination of software and hardware means.
- the video image at the input of the device is decomposed for each pixel according to its red, green and blue colour components. Each pixel is therefore represented by its three components.
- Each component, red, green, blue, is respectively filtered by a module 1 , 4, 7.
- linear rescaling modules 1 , 4 and 7 are optional for the implementation of the invention. However, they do considerably improve the results obtained.
- the purpose of the modules 1 , 4 and 7 is to spread the grey levels so as to distribute the values of each component over a wider interval [L, I M ], where l m and I M represent the minimum and maximum values permitted at the output, hence between 0 and 255 for pixels coded over 8 bits.
- the pixel output from the module 1 has a value Ir' in the range between l m and I M such that: , b]
- the minimum l m and maximum I M output values are respectively 0 and 255, the values of the colour components being coded over 8 bits.
- the values 20 and 235 are respectively chosen for a and b according to the preferred embodiment.
- the values 10 and 245 are respectively taken for a and b.
- the pixel output from the module 4 has a value Iv' in the range between l m and I M such that:
- the pixel output from the module 4 has a value Ib' in the range between l m and I M such that:
- the b, a, l m and I M can be different for the different color components.
- the modules 1 , 4 and 7 are respectively connected to modules 2, 5 and 8. These modules 2, 5 and 8 carry out a low-pass filtering on the signals Ir', Ib' and Iv' received from the modules 1 , 4 and 7.
- the low-pass filtering allows the image to be smoothed after its linear rescaling but also the noise to be reduced.
- the following low-pass filter is used:
- Ir" ( p ,j) ⁇ ⁇ m Jr' (P 1+nj+ J y -l -l In other embodiments, other values may be used.
- the modules 3, 6 and 9 apply a filter to the signals Ir", Iv" and Ib" received from the modules 2, 5 and 8, respectively.
- the signals Ir'", Iv'" and Ib'" obtained are combined for each pixel so as to obtain a luminance value which will subsequently be used, for example, by a motion estimator of the recursive pixel type.
- the luminance Y is calculated by a module 10 according to the following formula:
- the device is not applicable to the three colour components. More generally, the luminance is thus obtained according to the following equation:
- each module is replicated for each component. It is clear that, for those skilled in the art, the processing of the various components can be performed by the same module in a sequential fashion. It goes without saying that the invention is not limited to the exemplary embodiments described hereinabove. In particular, those skilled in the art may bring any variant into the embodiments presented and combine them so as to benefit from their various advantages.
- the invention may notably be applied to applications relating to video coding other than motion estimation.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Image Processing (AREA)
- Color Television Systems (AREA)
- Processing Of Color Television Signals (AREA)
- Image Analysis (AREA)
Abstract
Description
Claims
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| FR0655128 | 2006-11-27 | ||
| PCT/EP2007/062834 WO2008065089A2 (en) | 2006-11-27 | 2007-11-26 | Video pre-processing device and method, motion estimation device and method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| EP2087736A2 true EP2087736A2 (en) | 2009-08-12 |
Family
ID=38222397
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| EP07847362A Withdrawn EP2087736A2 (en) | 2006-11-27 | 2007-11-26 | Video pre-processing device and method, motion estimation device and method |
Country Status (3)
| Country | Link |
|---|---|
| EP (1) | EP2087736A2 (en) |
| KR (1) | KR101377780B1 (en) |
| WO (1) | WO2008065089A2 (en) |
Family Cites Families (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5933540A (en) * | 1995-05-11 | 1999-08-03 | General Electric Company | Filter system and method for efficiently suppressing noise and improving edge definition in a digitized image |
| US20040032906A1 (en) * | 2002-08-19 | 2004-02-19 | Lillig Thomas M. | Foreground segmentation for digital video |
| JP4411879B2 (en) * | 2003-07-01 | 2010-02-10 | 株式会社ニコン | Signal processing apparatus, signal processing program, and electronic camera |
| EP1522963A1 (en) * | 2003-10-07 | 2005-04-13 | Deutsche Thomson-Brandt Gmbh | Method for processing video pictures for false contours and dithering noise compensation |
| KR100624421B1 (en) * | 2004-05-04 | 2006-09-19 | 삼성전자주식회사 | Digital video signal filtering device and method |
| WO2005124664A2 (en) * | 2004-06-14 | 2005-12-29 | Precoad, Inc. | Image clean-up and pre-coding |
-
2007
- 2007-11-26 KR KR1020097010723A patent/KR101377780B1/en not_active Expired - Fee Related
- 2007-11-26 EP EP07847362A patent/EP2087736A2/en not_active Withdrawn
- 2007-11-26 WO PCT/EP2007/062834 patent/WO2008065089A2/en not_active Ceased
Non-Patent Citations (1)
| Title |
|---|
| None * |
Also Published As
| Publication number | Publication date |
|---|---|
| KR20090086560A (en) | 2009-08-13 |
| WO2008065089A2 (en) | 2008-06-05 |
| WO2008065089A3 (en) | 2008-09-04 |
| KR101377780B1 (en) | 2014-03-26 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| TWI407800B (en) | Improved processing of mosaic images | |
| RU2413384C2 (en) | Device of image processing and method of image processing | |
| JP2022504475A5 (en) | ||
| EP1473670A2 (en) | Colour edge enhancement method | |
| TR201802291T4 (en) | Multiple regression estimators with multiple color channels. | |
| WO2015198954A1 (en) | Method and decoder for predicting and filtering color components in pictures | |
| US7474785B2 (en) | Video auto enhancing algorithm | |
| CN113824943A (en) | Low-light video processing method, device and storage medium | |
| US11677938B2 (en) | Method to reduce contour artifacts on recursive temporal filters | |
| CN109118437B (en) | A method and storage medium capable of processing muddy water images in real time | |
| US9858889B2 (en) | Color compensation circuit, display apparatus, and color compensation method | |
| CN107358578B (en) | Yin-yang face treatment method and device | |
| US8385671B1 (en) | Digital camera and method | |
| CN111815659A (en) | Image processing method, image processing device, electronic equipment and computer readable storage medium | |
| CN101778297B (en) | Interference elimination method of image sequence | |
| WO2008065089A2 (en) | Video pre-processing device and method, motion estimation device and method | |
| US10264212B1 (en) | Low-complexity deinterlacing with motion detection and overlay compensation | |
| EP1927251A2 (en) | Apparatus for filtering an image obtained by block based image decompression | |
| CN111800583A (en) | High dynamic range image partition processing method and device and computer readable storage medium | |
| CN1751523A (en) | Processing signals for a color sequential display | |
| EP1782383A1 (en) | Video processor comprising a sharpness enhancer | |
| US20100002773A1 (en) | Motion-Compensated Temporal Recursive Filter | |
| WO2006020532A2 (en) | Fast area-selected filtering for pixel-noise and analog artifacts reduction | |
| Mittal et al. | An efficient video enhancement method using LA* B* analysis | |
| WO2010028682A1 (en) | Image sharpening |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
| 17P | Request for examination filed |
Effective date: 20090526 |
|
| AK | Designated contracting states |
Kind code of ref document: A2 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC MT NL PL PT RO SE SI SK TR |
|
| RAP1 | Party data changed (applicant data changed or rights of an application transferred) |
Owner name: THOMSON LICENSING |
|
| DAX | Request for extension of the european patent (deleted) | ||
| 17Q | First examination report despatched |
Effective date: 20110725 |
|
| RIC1 | Information provided on ipc code assigned before grant |
Ipc: G06T 5/00 20060101AFI20180808BHEP Ipc: H04N 19/80 20140101ALI20180808BHEP Ipc: H04N 19/51 20140101ALI20180808BHEP |
|
| GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
| INTG | Intention to grant announced |
Effective date: 20180920 |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN |
|
| 18D | Application deemed to be withdrawn |
Effective date: 20190131 |