WO2001024151A1 - Method for processing video pictures for display on a display device - Google Patents
Method for processing video pictures for display on a display device Download PDFInfo
- Publication number
- WO2001024151A1 WO2001024151A1 PCT/EP2000/009311 EP0009311W WO0124151A1 WO 2001024151 A1 WO2001024151 A1 WO 2001024151A1 EP 0009311 W EP0009311 W EP 0009311W WO 0124151 A1 WO0124151 A1 WO 0124151A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- pixel
- correction
- motion vector
- sub
- compensation
- Prior art date
Links
Classifications
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
- G09G3/20—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
- G09G3/2007—Display of intermediate tones
- G09G3/2018—Display of intermediate tones by time modulation using two or more time intervals
- G09G3/2022—Display of intermediate tones by time modulation using two or more time intervals using sub-frames
- G09G3/2033—Display of intermediate tones by time modulation using two or more time intervals using sub-frames with splitting one or more sub-frames corresponding to the most significant bits into two or more sub-frames
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2320/00—Control of display operating conditions
- G09G2320/02—Improving the quality of display appearance
- G09G2320/0261—Improving the quality of display appearance in the context of movement of objects on the screen or movement of the observer relative to the screen
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2320/00—Control of display operating conditions
- G09G2320/02—Improving the quality of display appearance
- G09G2320/0266—Reduction of sub-frame artefacts
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2320/00—Control of display operating conditions
- G09G2320/10—Special adaptations of display systems for operation with variable images
- G09G2320/106—Determination of movement vectors or equivalent parameters within the image
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
- G09G3/20—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
- G09G3/22—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters using controlled light sources
- G09G3/28—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters using controlled light sources using luminous gas-discharge panels, e.g. plasma panels
- G09G3/288—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters using controlled light sources using luminous gas-discharge panels, e.g. plasma panels using AC panels
Definitions
- the invention relates to a method for processing video pictures for display on a display device.
- the invention is closely related to a kind of video processing for improving the picture quality of pictures which are displayed on matrix displays like plasma display panels (PDP) or other display devices where the pixel values control the generation of a corresponding number of small lighting pulses for luminance degration on the display.
- PDP plasma display panels
- the Plasma technology now makes it possible to achieve flat color panel of large size (greater than possible with CRTs) with very limited depth and without any viewing angle constraints .
- the subject artefact, with which the invention deals is called "'dynamic false contour effect" since it corresponds to disturbances of gray levels and colors in the form of an apparition of colored edges in the picture when an observation point on the PDP screen moves.
- the effect is most visible when the image has a smooth gradation like skin.
- Fig. 1 shows the simulation of such a false contour effect en a natural scene with skin areas.
- two dark lines which e. g. are caused by this false contour effect. Also in the face of the woman such dark lines occur on the right side.
- a Plasma Display Panel utilizes a matrix array of discharge cells which could only be “ON” or “OFF”. Also unlike a CRT or LCD in which gray levels are expressed by analog control of the light emission, a PDP controls the gray level by modulating the number of light pulses per frame. This time-modulation will be integrated by the eye over a period corresponding to the eye time response.
- a dynamic false contour effect reduction can be done by making specific corrections on a movement trajectory defined by the motion vectors.
- the characteristics of the human visual system are used to implement a post processing on the vectors coming from the motion estimator. That makes possible to define a compensation trajectory re- specting the human eye in order to improve the global quality of the compensation.
- One aspect of the invention is that the estimated motion vectors are converted into a more symmetrical form which al- lows to distribute corrections along the vector more symmetrically around the vectors. This respects better the behavior of the human visual system.
- An advantageous algorithm for this conversion is claimed in claim 2.
- the motion vector components estimated for a pixel are rounded down to integer values irrespective of the rational component value of each vector component before symmetrization. This has the advantage that over- compensation is reliably avoided. In contrast, this means that under-compensation is taken instead. Over-compensation has the disadvantage that the false contour changes its ap- pearance. E.g. a different color can occur due to over- compensation. This is very disturbing for the viewer.
- a third aspect of the invention concerns a specific rounding process for calculating the positions of corrections on signal level as claimed in claim 6.
- the pixel coordinates for a correction value are rounded down if the rational component of the pixel coordinate is in a lower range
- the pixel coordinate is rounded up and rounded down if the rational component is in a medium range thus determining two correction positions
- the pixel coordinates for a correction value are rounded up if the rational component of the pixel coordinate is in an upper range .
- Fig. 1 shows a video picture in which the false contour effect is simulated
- Fig. 2 shows an illustration for explaining the sub-field organization of a PDP
- Fig. 3 shows an illustration for explaining the false contour effect
- Fig. 4 illustrates the appearance of a dark edge when a display of two frames is being made in the manner shown in Fig. 3;
- Fig. 5 shows a possible trajectory for distributing false contour corrections along a motion vector of a critical observation point on a plasma screen;
- Fig. 6 shows a model how the human brain analysis visual information
- Fig. 7 shows a 3D-illustration of a gabor wavelet used in the model of Fig.6;
- Fig. 8 shows a 2D-illustration of a gabor wavelet projected on a plasma screen
- Fig. 9 shows a first illustration of distributing correc- tions along a motion vector which will lead to a non-optimal false contour correction
- Fig. 10 shows a sub-field organisation with 12 sub-fields
- Fig. 11 shows the centers of gravity for the sub-fields of the sub-field organisation shown in Fig.10;
- Fig. 12 shows a second illustration of distributing corrections along a motion vector respecting the sym- metry of the gabor function
- Fig. 13 shows a third illustration of distributing corrections along a motion vector not respecting the symmetry of the gabor function
- Fig. 14 shows an illustration of a special rounding process for distributing corrections on signal amplitude level instead of sub-field level
- Fig. 15 shows an illustration of distributing corrections on signal amplitude level along a motion vector applying a first specific rounding scheme
- Fig. 16 shows an illustration of distributing corrections on signal amplitude level along a motion vector applying a second specific rounding scheme.
- a Plasma Display Panel utilizes a matrix array of discharge cell which can only be “ON” or “OFF”.
- the PDP controls the gray level by modulating the number of light pulses per frame. This time modulation will be integrated by the eye over a period corresponding to the human eye time-response.
- each level will be represented by a combination of the 8 following bits :
- the frame period will be divided in 8 lighting periods (called sub- fields), each one corresponding to a bit.
- the number of light pulses for the bit "2" is the double as for the bit "1" and so on.
- Fig. 2 represents this decomposition.
- the addressing and erasing periods of every sub-field are not shown.
- the plasma driving principle however requires also these periods. It is well known to the skilled man, that during each sub-field a plasma cell needs to be addressed, first in an addressing or scanning period, afterwards the sustain period follows where the light pulses are generated and finally in an erase period the charge in the plasma cells is quenched.
- This PWM-type light generation introduces new categories of image-quality degradation corresponding to disturbances of gray levels or colors.
- the name for this effect is dynamic false contour effect since the fact that it corresponds to the apparition of colored edges in the picture when an observation point on the PDP screen moves.
- Such failures on a picture leads to an impression of strong contours appearing on homogeneous area like skin.
- the degradation is enhanced when the image has a smooth gradation and also when the light-emission period exceeds several milliseconds.
- the same problems occur on static images when observers are moving their heads and that leads to the conclusion that such a failure depends on the human visual perception.
- Fig. 3 represents in light gray the lighting sub-fields corresponding to the level 127 and in dark gray, these corresponding to the level 128.
- the diagonal parallel lines originating from the eye indi- cate the behavior of the eye integration during a movement.
- the two outer diagonal eye-integration-lines show the borders of the region with faulty perceived luminance. Between them, the eye will perceive a lack of luminance which leads to the appearing of a dark edge as indicated in the eye stimuli integration curve at the bottom of Fig. 3. This is also illustrated in Fig. 4 for the same moving transition.
- the false contour effect is produced on the eye retina when the eye follows a moving object since the eye does not integrate the right information at the right time.
- motion estimation dynamic methods
- the more serious ones are based on motion estimation (dynamic methods) which aim to detect the movement of each pixel in a frame in order to anticipate the eye movement and to reduce the failure appearing on the retina through different corrections.
- the goal of each dynamic algorithm is to define for each pixel observed by the eye, the way the eye is following its movement during a frame in order to generate a correction on this trajectory.
- Such algorithms are described e.g. in EP-A-0 980 059 and EP-A-0 978 816 which are European patent applications of the applicant.
- the vector represents the real motion of a pixel, that means the real trajectory the eye will follow when it locks this pixel.
- the dashed line represents a possible trajectory in the matrix array. Yet, there are different jectory in the matrix array. Yet, there are different trajectories possible and it is necessary to define a trajectory as near as possible from the eye integration trajectory. According to the invention this is done according to the human visual system which will be described more in detail hereinafter.
- the complete human visual system can be seen as a picture encoder to reduce the information received by the retina to the essential information which could be rapidly interpreted by the brain.
- the pupil can be seen as a low-pass filter which reduces the amount of high spacial frequencies. It is not required here, to make a complete exposition of the human visual system but to extract some important characteristics from the HVS to explain the ideas included in this invention disclosure.
- Fig. 6 One key point of the human visual system is the fact that the cortex areas will analyse the incoming picture with a discrete filter bank as illustrated in Fig. 6.
- entation of arcta v * a and b are parameters .
- the value f 0 represents the excitation intensity in the brain corresponding to the perception strength.
- Fig. 7 the characteristic of such a gabor function is illustrated.
- a 3D plot of the gabor function is given, in the right part of Fig. 7 the characteristic of the gabor function is illustrated with a colored 2D plot of the same function.
- the middle area (directly arround the vector) represents the more sensitive one for the eye integration. Consequently, each kind of dynamic false contour compensation should be spread over this area which is important for the definition of the compensation trajectory.
- the different motion vectors could have any kind of values and so any kind of direction.
- the aim of each compensation is to reduce, in the right direction taking into account the right amplitude of the movement, the false contour effect.
- FIG. 9 Before going further, an example of an improperly compensation is illustrated in Fig. 9.
- the number 0 to 9 corresponds in each case to one of the ten elements of the compensation. It is evident from Fig. 9 with the 2D-plot of the gabor function included, that this compensation does not respect the symmetry of the human eye integration function and thus leads to a non-optimal false contour correction.
- the human cerebral cortex decomposes each movement and stimuli in preferential directions.
- those directions can be defined as discrete ones.
- one principle of the new algorithm is to convert the motion vectors to a discrete number of directions (convert all vectors to specific ones which leads to a more symmetrical compensation) .
- the vector components are rounded to integers and conse- quently, the direction given by each vector is based on the ratio between the two integer vector components. In order to create a discrete space of directions, a good possibility is to define which integer ratios are allowed for motion vectors. For that purpose, the second stage of the processing will correspond to a modification of the vector components as described below:
- the vector V(l; ) will be converted to the vector '(6;3) and the vector (2;9) will be converted to K'(2;8) .
- These two vectors are elements of a discrete space of vec ⁇ tors and their form leads to a better symmetry of the com- pensation.
- V" (6;3) .
- the main idea of the sub-field shifting algorithm is to anticipate the movement in order to position the different bit planes of the moving area on the eye integration trajectory. That means the different bit-planes are shifted depending on the eye movement to make sure that the eye receives the right information at the right time. For that purpose centers of gravity have been defined for the sub-fields:
- G() represents the center of gravity location in the frame
- n the current sub-field
- Dur ( ) the duration of the sub-field. This duration includes the addressing time as but not the erasing time:
- Dur(n) Tadd + Tn in which Tadd represents the duration of the addressing pe ⁇ riod and Tn the duration of the sustain period of the sub- field itself.
- the erasing period is subjectively smaller and is in this embodiment neglected but can alternatively also be taken into account in another embodiment.
- Fig. 12 the resulting compensation is illustrated.
- the sub-field entries for the sixth and seventh sub-field are shifted one pixel to the right.
- the sub-field entry for the 12 th sub-field is shifted five pixels to the right and three pixels upwards. All the remaining shifts can easily be seen from Fig. 12.
- V' (7;3j is depicted and the compensation results for this vector can be directly compared.
- FIG. 12 A comparison of Fig. 12 with Fig. 13 shows that the compensation result shown in Fig. 13 second one does not respect the symmetry of the human visual system. There are five corrections on pixel positions below the motion vector against only one correction on pixel positions above the motion vector. In that case, simulations showed some artefact produced by the compensation itself even in areas where no false contour is visible. In addition, when the vector space is discrete, the compensation stays more stable between two serious vector changes .
- roundt means rounding up of the value in brackets and round means the mathematical operation of rounding down the value in brackets.
- 1% is the programmable border for the rounding down region and S% is the corresponding border for the rounding up region.
- the border 1% and S% could have different values depending on the compensation algorithm used.
- the region inbetween the borders 1% and S is a region where rounding down and rounding up of the correction position components is being done thus leading to two correction positions in case there is only one component treated in this way and leading to four correction positions in case there are components treated in this way.
- the numbers used in Fig. 15 denote the correction positions in the pixel matrix.
- the correction values for these positions need to be calculated.
- a constant value can be used which adds or subtracts some luminance to the pixels of each correction position depending on the moving transition.
- Higher sophisticated correction value distribution algorithms can also be used e.g. a correction based on an algorithm which makes the correction values increase and decrease with the correction number. Examples of these algorithms are described in the articles:
- the next case considered is the case with and the same motion vector and number of corrections.
- Fig. 16 shows how the compensation will look like.
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Computer Hardware Design (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Control Of Indicators Other Than Cathode Ray Tubes (AREA)
- Control Of Gas Discharge Display Tubes (AREA)
Abstract
Description
Claims
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
AU75222/00A AU7522200A (en) | 1999-09-27 | 2000-09-23 | Method for processing video pictures for display on a display device |
EP00964228A EP1234298A1 (en) | 1999-09-27 | 2000-09-23 | Method for processing video pictures for display on a display device |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP99118990 | 1999-09-27 | ||
EP99118990.3 | 1999-09-27 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2001024151A1 true WO2001024151A1 (en) | 2001-04-05 |
Family
ID=8239063
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/EP2000/009311 WO2001024151A1 (en) | 1999-09-27 | 2000-09-23 | Method for processing video pictures for display on a display device |
Country Status (3)
Country | Link |
---|---|
EP (1) | EP1234298A1 (en) |
AU (1) | AU7522200A (en) |
WO (1) | WO2001024151A1 (en) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2003055221A2 (en) * | 2001-12-20 | 2003-07-03 | Koninklijke Philips Electronics N.V. | Adjustment of motion vectors in digital image processing systems |
WO2005073945A1 (en) * | 2004-01-27 | 2005-08-11 | Koninklijke Philips Electronics, N.V. | Image motion compensation arrangement and method therefor |
Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5109425A (en) * | 1988-09-30 | 1992-04-28 | The United States Of America As Represented By The United States National Aeronautics And Space Administration | Method and apparatus for predicting the direction of movement in machine vision |
EP0893916A2 (en) * | 1997-07-24 | 1999-01-27 | Matsushita Electric Industrial Co., Ltd. | Image display apparatus and image evaluation apparatus |
-
2000
- 2000-09-23 AU AU75222/00A patent/AU7522200A/en not_active Abandoned
- 2000-09-23 EP EP00964228A patent/EP1234298A1/en not_active Withdrawn
- 2000-09-23 WO PCT/EP2000/009311 patent/WO2001024151A1/en not_active Application Discontinuation
Patent Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5109425A (en) * | 1988-09-30 | 1992-04-28 | The United States Of America As Represented By The United States National Aeronautics And Space Administration | Method and apparatus for predicting the direction of movement in machine vision |
EP0893916A2 (en) * | 1997-07-24 | 1999-01-27 | Matsushita Electric Industrial Co., Ltd. | Image display apparatus and image evaluation apparatus |
Non-Patent Citations (1)
Title |
---|
ZHU Y -W ET AL: "15.3: A MOTION-DEPENDENT EQUALIZING-PULSE TECHNIQUE FOR REDUCTING GRAY-SCALE DISTURBANCES ON PDPS", SID INTERNATIONAL SYMPOSIUM DIGEST OF TECHNICAL PAPERS,US,SANTA ANA, SID, vol. 28, 13 May 1997 (1997-05-13), pages 221 - 224, XP000722692, ISSN: 0097-966X * |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2003055221A2 (en) * | 2001-12-20 | 2003-07-03 | Koninklijke Philips Electronics N.V. | Adjustment of motion vectors in digital image processing systems |
WO2003055221A3 (en) * | 2001-12-20 | 2004-06-17 | Koninkl Philips Electronics Nv | Adjustment of motion vectors in digital image processing systems |
WO2005073945A1 (en) * | 2004-01-27 | 2005-08-11 | Koninklijke Philips Electronics, N.V. | Image motion compensation arrangement and method therefor |
Also Published As
Publication number | Publication date |
---|---|
AU7522200A (en) | 2001-04-30 |
EP1234298A1 (en) | 2002-08-28 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US6473464B1 (en) | Method and apparatus for processing video pictures, especially for false contour effect compensation | |
US6476875B2 (en) | Method and apparatus for processing video pictures, especially for false contour effect compensation | |
EP1532607B1 (en) | Method and apparatus for processing video pictures improving dynamic false contour effect compensation | |
JP4928662B2 (en) | Method and apparatus for processing video images for display on a display device | |
US6961379B2 (en) | Method for processing video pictures and apparatus for processing video pictures | |
US7023450B1 (en) | Data processing method and apparatus for a display device | |
US7142253B2 (en) | Method and apparatus for processing video pictures for improving picture quality for subsequent display | |
EP1162571B1 (en) | Method and apparatus for processing video pictures for false contour effect compensation | |
WO2001024151A1 (en) | Method for processing video pictures for display on a display device | |
US6930694B2 (en) | Adapted pre-filtering for bit-line repeat algorithm | |
EP0980059B1 (en) | Method and apparatus for processing video pictures, especially for false contour effect compensation | |
EP0987675A1 (en) | Method and apparatus for processing video pictures, especially for false contour effect compensation |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AK | Designated states |
Kind code of ref document: A1 Designated state(s): AE AG AL AU BA BB BG BR CA CN CR CU CZ DM DZ EE GD GE HR HU ID IL IN IS JP KP KR LC LK LR LV MA MG MK MN MX NO NZ PL RO SG SI SK TR TT UA US UZ VN YU ZA |
|
AL | Designated countries for regional patents |
Kind code of ref document: A1 Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE BF BJ CF CG CI CM GA GN GW ML MR NE SN TD TG |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application | ||
DFPE | Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101) | ||
WWE | Wipo information: entry into national phase |
Ref document number: 2000964228 Country of ref document: EP |
|
WWE | Wipo information: entry into national phase |
Ref document number: 10089021 Country of ref document: US |
|
WWP | Wipo information: published in national office |
Ref document number: 2000964228 Country of ref document: EP |
|
NENP | Non-entry into the national phase |
Ref country code: JP |
|
WWW | Wipo information: withdrawn in national office |
Ref document number: 2000964228 Country of ref document: EP |