EP1391867B1 - Plasma display panel (PDP) - improvement of dithering noise while displaying less video levels than required - Google Patents
Plasma display panel (PDP) - improvement of dithering noise while displaying less video levels than required Download PDFInfo
- Publication number
- EP1391867B1 EP1391867B1 EP03292006A EP03292006A EP1391867B1 EP 1391867 B1 EP1391867 B1 EP 1391867B1 EP 03292006 A EP03292006 A EP 03292006A EP 03292006 A EP03292006 A EP 03292006A EP 1391867 B1 EP1391867 B1 EP 1391867B1
- Authority
- EP
- European Patent Office
- Prior art keywords
- sub
- field
- video
- dithering
- picture data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Lifetime
Links
- 238000000034 method Methods 0.000 claims description 20
- 230000009466 transformation Effects 0.000 claims description 14
- 230000001131 transforming effect Effects 0.000 claims description 12
- 238000012545 processing Methods 0.000 claims description 8
- 230000006835 compression Effects 0.000 claims description 3
- 238000007906 compression Methods 0.000 claims description 3
- 238000012886 linear function Methods 0.000 claims 6
- 230000006870 function Effects 0.000 description 24
- 210000004027 cell Anatomy 0.000 description 11
- 230000000694 effects Effects 0.000 description 9
- 230000004044 response Effects 0.000 description 7
- 230000004243 retinal function Effects 0.000 description 6
- 230000035945 sensitivity Effects 0.000 description 6
- 238000012937 correction Methods 0.000 description 5
- 210000004180 plasmocyte Anatomy 0.000 description 5
- 210000001525 retina Anatomy 0.000 description 5
- 230000002207 retinal effect Effects 0.000 description 5
- 230000007704 transition Effects 0.000 description 5
- 230000008520 organization Effects 0.000 description 4
- 230000009467 reduction Effects 0.000 description 4
- 230000000007 visual effect Effects 0.000 description 4
- 230000006978 adaptation Effects 0.000 description 2
- 230000008901 benefit Effects 0.000 description 2
- 230000008859 change Effects 0.000 description 2
- 230000006378 damage Effects 0.000 description 2
- 238000001914 filtration Methods 0.000 description 2
- 230000010354 integration Effects 0.000 description 2
- 239000011159 matrix material Substances 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 210000002569 neuron Anatomy 0.000 description 2
- 238000010561 standard procedure Methods 0.000 description 2
- 230000002123 temporal effect Effects 0.000 description 2
- 101100129500 Caenorhabditis elegans max-2 gene Proteins 0.000 description 1
- 238000009825 accumulation Methods 0.000 description 1
- 230000003213 activating effect Effects 0.000 description 1
- 238000013459 approach Methods 0.000 description 1
- 210000004556 brain Anatomy 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000009792 diffusion process Methods 0.000 description 1
- 230000009977 dual effect Effects 0.000 description 1
- 230000005284 excitation Effects 0.000 description 1
- 230000005764 inhibitory process Effects 0.000 description 1
- 238000007620 mathematical function Methods 0.000 description 1
- 230000003472 neutralizing effect Effects 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 230000008447 perception Effects 0.000 description 1
- 230000001766 physiological effect Effects 0.000 description 1
- 230000037452 priming Effects 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 238000012887 quadratic function Methods 0.000 description 1
- 230000001629 suppression Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
- G09G3/20—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
- G09G3/2007—Display of intermediate tones
- G09G3/2044—Display of intermediate tones using dithering
- G09G3/2051—Display of intermediate tones using dithering with use of a spatial dither pattern
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
- G09G3/20—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
- G09G3/2007—Display of intermediate tones
- G09G3/2018—Display of intermediate tones by time modulation using two or more time intervals
- G09G3/2022—Display of intermediate tones by time modulation using two or more time intervals using sub-frames
- G09G3/2029—Display of intermediate tones by time modulation using two or more time intervals using sub-frames the sub-frames having non-binary weights
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2320/00—Control of display operating conditions
- G09G2320/02—Improving the quality of display appearance
- G09G2320/0242—Compensation of deficiencies in the appearance of colours
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2320/00—Control of display operating conditions
- G09G2320/02—Improving the quality of display appearance
- G09G2320/0261—Improving the quality of display appearance in the context of movement of objects on the screen or movement of the observer relative to the screen
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2320/00—Control of display operating conditions
- G09G2320/02—Improving the quality of display appearance
- G09G2320/0271—Adjustment of the gradation levels within the range of the gradation scale, e.g. by redistribution or clipping
- G09G2320/0276—Adjustment of the gradation levels within the range of the gradation scale, e.g. by redistribution or clipping for the purpose of adaptation to the characteristics of a display device, i.e. gamma correction
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
- G09G3/20—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
- G09G3/22—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters using controlled light sources
- G09G3/28—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters using controlled light sources using luminous gas-discharge panels, e.g. plasma panels
- G09G3/288—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters using controlled light sources using luminous gas-discharge panels, e.g. plasma panels using AC panels
Definitions
- the present invention relates to a device and method for processing video picture data for display on a display device having a plurality of luminous elements corresponding to pixels of a video picture, wherein the brightness of each pixel is controlled by sub-field code words corresponding to a number of impulses for switching on and off the luminous elements, by dithering said video picture data and sub-field coding the dithered video picture data for displaying.
- the Plasma technology makes it possible to achieve flat color panel of large size (out of the CRT limitations) and with very limited depth without any viewing angle constraints.
- a lot of work has been made to improve its picture quality. Consequently, a new technology like the Plasma one has to provide a picture quality as good or even better than standard TV technology.
- at least 8-bit video data is needed. In fact, more than 8 bits should be preferably be used to have a correct rendition of the low video levels because of the gammatization process that aims at reproducing the non-linear CRT behavior on a linear panel like plasma.
- a Plasma Display Panel utilizes a matrix array of discharge cells that could only be “ON” or “OFF”. Also unlike a CRT or LCD in which gray levels are expressed by analog control of the light emission, a PDP controls the gray level by modulating the number of small light pulses per frame. This time-modulation will be integrated by the observer's eye over a period corresponding to the eye time response.
- Dithering per se is a well-known technique used to reduce the effects of quantisation noise due to a reduced number of displayed resolution bits. With dithering, some artificial levels are added inbetween the existing video levels corresponding to the reduced number of displayed resolution bits. This improves the gray scale portrayal, but on the other hand adds high frequency, low amplitude dithering noise which is perceptible to the human viewer only at a small viewing distance.
- each sub-field corresponds to a bit
- 8 sub-fields are required for an acceptable gray scale rendition.
- the addressing speed is not fast enough to render 8 sub-fields in a given timeframe (20 ms in 50Hz video sources (PAL, SECAM), 16.6 ms in 60Hz video sources (NTSC), 13.3 ms in 75Hz video sources,).
- the plasma cell has only two different states: a plasma cell can only be ON or OFF.
- video levels are rendered by using a temporal modulation.
- the most efficient addressing scheme should be to address N times if the number of video levels to be created is equal to N.
- the first one is to use a minimum of 8 SF (in case of an 8-bit video level representation) and the combination of these 8 SF is able to generate the 256 levels.
- Such a mode is illustrated in Fig. 1 .
- Each sub-field is divided into three parts: an addressing part, a sustain part and an erase part.
- the addressing period is used to address line per line the plasma cells by applying a writing voltage to those cells that shall be activated for light generation and is typical for PDPs.
- the sustain period is used as a period for lighting of written plasma cells by applying sustain pulses with a typical sustain voltage to all cells.
- the erase period is used for erasing the cell charges, thereby neutralizing the cells.
- Fig. 2 presents the standard method used to generate all 256 video levels based on the 8 bit code from Fig. 1 .
- the eye of the observer will integrate, over the duration of the image period, the various combinations of luminous emissions and by this recreate the various shades in the gray levels.
- the integration axis will be perpendicular to the panel in the time direction. The observer will integrate information coming from the same pixel and will not detect any disturbances.
- a spatio-temporal uncorrelation of the 16 available basic levels is used.
- This example based on 16 sub-fields will be used in the following in order to simplify the exposition.
- Fig. 5 presents the case of a transition 127/128 rendered via this mode in case of movement. It shows that moving transitions between similar levels are no more a source of false contouring but lead to smooth transitions.
- Fig. 4 illustrates the incremental addressing mode without addressing period. A global addressing operation is performed at the beginning of a frame period, called global priming. This is followed by a selective erase operation in which the charge of only those cells is quenched that shall not produce light. All the other cells remain charged for the following sustain period. The selective erase operation is part of each sub-field. At the end of the frame period a global erase operation neutralizes all cells.
- Fig. 6 illustrates a possibility to implement the incremental coding scheme with 4 bit dithering.
- a further important aspect is the implementation of a gamma correction.
- the CRT displays do not have a linear response to the beam intensity but rather a quadratic response. For that reason, the pictures sent to the display are pre-corrected in the studio or mostly already in the video camera itself so that the picture seen by the human eye respects the filmed picture.
- Fig. 7 illustrates this principle.
- the pre-correction made at the source level will degrade the observed picture which becomes unnatural as illustrated on Fig. 8 .
- an artificial gamma operation made in a specific video-processing unit of the plasma display device will invert the pre-correction made at the source level. Normally the gamma correction is made in the plasma display unit directly before the encoding to sub-field level. This gamma operation leads to a destruction of low video levels if the output video data is limited to 8 bit resolution as illustrated on Fig. 9 .
- Fig. 10 represents this encoding method. It shows that an optimized computation of the weights for an incremental code enables to take into account the gamma progression without the implementation of a specific gamma operation at video level. Obviously, in the present example, only the use of 4-bit dithering enables the generation of the 256 different perceived video levels.
- each of the 16 sub-fields will be used to render a group of 16 video levels.
- Half of the pixels in a homogenous block will not be activated for light generation and half will be activated for light generation only with sub-field SF 1 having the weight "2". From frame to frame the dithering pattern is toggled as shown in Fig. 12.
- Fig. 12 represents a possible dithering used to render the video level 12 taking into account the gamma of 1.82 used to compute the weights.
- Fig. 12 and Fig. 13 have shown that the same kind of dithering (4-bit) has been used both for the low-level and the high level video range.
- Each of the 16 possible video levels are equally distributed among the 256 video levels and the same kind of dithering is applied in-between to render the other levels.
- this does not fit with the human perception of luminance. Indeed the eye is much more sensitive to noise in the low level than in the luminous areas.
- this object is solved by a method for processing video picture data for display on a display device having a plurality of luminous elements corresponding to pixels of a video picture, wherein the brightness of each pixel is controlled by sub-field code words corresponding to a number of impulses for switching on and off the luminous elements, by dithering said video picture data and sub-field coding said dithered video picture data for displaying, as well as transforming said video picture data according to a retinal function before dithering.
- a Device for processing video picture data for display on a display device having a plurality of luminous elements corresponding to pixels of a video picture comprising brightness controlling means with which the brightness of each pixel is controlled by at least one sub-field code word with which the luminous element/s are activated or inactivated for light output in small pulses corresponding to sub-fields in a video frame, including dithering means for dithering said video picture data and sub-field coding means for sub-field coding said dithered video picture data for displaying, characterized by transforming means for transforming said video picture data according to a retinal function before dithering.
- the advantage of the present invention is the reduction of the dithering visibility by a change of the sub-field organization together with a transformation of the video input values through an appropriate transformation curve based on the human visual system luminance sensitivity (Weber-Fechner law).
- the analysis of the retina shows one of the fundamental functions of the visual system cells: the notion of receptor fields. These represent small retina areas related to a neuron and determining its response to luminous stimuli. Such receptor fields can be divided into regions enabling the excitation or inhibition of the neuron and often called “ON" and "OFF” regions. Fig. 14 illustrates such a receptor field. These receptor fields transmit to the brain, not the absolute luminance value located at each photo-receiver, but the relative value measured between two adjacent points on the retina. This means that the eye is not sensitive to the absolute luminance but only to the local contrasts. This phenomenon is illustrated in Fig. 15 : in the middle of each area, the gray disk has the same level, but human eyes perceive it differently.
- I eye a 1 + a 2 ⁇ log 10 ( I plasma ).
- I eye I max 2 ⁇ log 10 ⁇ 1 + 100 ⁇ I screen I max
- I screen represents the luminance of the screen
- I max the maximal screen luminance
- I eye the luminance observed by the eye.
- the inventive concept described in this document will take care of the human luminance sensitivity.
- the goal of the invention will be to apply less dithering to the low-levels while using more dithering for the high levels.
- this is done without using various dithering schemes by using a model of the human eye combined with an adaptation of the sub-field weighting.
- the first stage defined in the inventive concept is based on a filtering of the input picture based on the human visual sensitivity function.
- a function will be used derived from those described above. Obviously, there are many other HVS functions existing and the invention shall not be limited to this particular function.
- the used transformation function presented in Fig. 16 can be applied via a LUT (Look-Up Table) or directly via a function in the plasma specific IC.
- the LUT is the simplest way and requires limited resources in an IC.
- the next stage of the concept is the adapted modification of the picture coding with the sub-fields. Obviously, a complex transformation of the input picture corresponding to a retinal behavior has been applied and now, the inverse transformation should be applied in the sub-field weighting to present the correct picture to the eye (not twice the same retinal behavior).
- V n 255 ⁇ n ⁇ 16 255 ⁇ with V n representing the progression of the weights, n the various steps of this progression (constant), 255 representing the maximum luminance, 16 the number of levels rendered with the dithering (4-bit) and ⁇ the gamma of 1.82.
- this function shall be used further on but the sixteen steps n are no more in constant progression but they will have to follow the inverse retinal progression.
- the new weights include not only the gamma function but also the inverse of retinal function, which has been applied to the input video values.
- the new sub-field progression is shown on Fig. 17 .
- a HVS function is first applied to the input video level before the implementation of the dithering.
- the dithering is performed on the HVS adapted input picture.
- the inverse HVS function has been implemented integrated in the sub-field weighting to provide a correct picture to the eye including the required gamma function. Nevertheless, since the dithering function has been implemented between the HVS function and its inverse function, the dithering level will follow the HVS behavior as desired. Therefore, the dithering noise will have the same amplitude on the eye for all rendered levels and that makes it less disturbing.
- Fig. 19 depicts the result of the implementation of the HVS concept.
- the low video levels an expansion has been made ahead of the dithering step.
- the low video levels are distributed over an enlarged video level range. This has the effect of a reduction of the dithering level.
- a compression has been made ahead of the dithering step.
- the high video levels are concentrated in a reduced video level range. In that case the dithering level has been increased.
- Fig. 20 shows the difference between the prior art and the new HVS concept in the rendition of low video levels.
- the values in brackets represent the value to be displayed after gammatization.
- more sub-fields are available for low-level reproduction and therefore the dithering is less visible.
- the level 4 (0.5 after gammatization) is rendered with combination of 1 and 0 in case of HVS implementation. In that case, the dithering pattern is less visible than in the prior art solution with a combination of 0 and 2!
- Fig. 21 now shows the difference between the prior art and the new HVS concept in rendition of high video levels.
- the level 216 (187.5 after gammatization) is rendered with combination of 175 and 200 in case of prior art solution while a combination of 165 and 206 is used in HVS concept. Nevertheless, since the eye is less sensitive to high level differences, the picture is not really degraded in the high level range.
- the HVS concept therefore makes a compromise between more sub-fields for low-levels and less sub-fields for high levels in order to globally reduce the dithering visibility.
- Fig. 22 describes a possible circuit implementation of the current invention.
- RGB input pictures are forwarded to the degamma function block 10: this can be realized with a look-up table (LUT) or by software with a mathematical function.
- the outputs of this block are forwarded to the HVS filtering block 11 that implements the retinal behavior via a complex mathematical formula or simply with a LUT.
- This function can be activated or deactivated by a HVS control signal generated by the Plasma Control block 16. Then the dithering will be added in dithering block 12 and this can be configured via the DITH signal from the Plasma Control Block 16.
- the same block will configure the sub-field encoding block 13 to take into account or not the HVS inverse weighting.
- the sub-field code words are read out of the sub-field encoding block 13 and all the code words for one line are collected in order to create a single very long code word which can be used for the line-wise PDP addressing. This is carried out in the serial to parallel conversion unit 14.
- the plasma control block 16 generates all scan and sustain pulses for PDP control. It receives horizontal and vertical synchronising signals for reference timing.
- the inventive method described in this document will enable a reduction of the dithering visibility by a common change of the sub-field organization together with a modification of the video through an appropriate transformation curve based on the human visual system luminance sensitivity (Weber-Fechner law).
- dithering was made pixel-based.
- a colour PDP for each pixel three plasma cells RGB are existing.
- the invention is not restricted to pixel-based dithering.
- Cell-based dithering as explained in WO-A-01/71702 can also be used in connection with the present invention.
- the invention can be used in particular in PDPs.
- Plasma displays are currently used in consumer electronics, e.g. for TV sets, and also as a monitor for computers.
- use of the invention is also appropriate for matrix displays where the light emission is also controlled with small pulse in sub-fields, i.e. where the PWM principle is used for controlling light emission.
- the PWM principle is used for controlling light emission.
- DMDs digital micro mirror devices
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Computer Hardware Design (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Control Of Indicators Other Than Cathode Ray Tubes (AREA)
Description
- The present invention relates to a device and method for processing video picture data for display on a display device having a plurality of luminous elements corresponding to pixels of a video picture, wherein the brightness of each pixel is controlled by sub-field code words corresponding to a number of impulses for switching on and off the luminous elements, by dithering said video picture data and sub-field coding the dithered video picture data for displaying.
- The Plasma technology makes it possible to achieve flat color panel of large size (out of the CRT limitations) and with very limited depth without any viewing angle constraints. Referring to the last generation of European TV, a lot of work has been made to improve its picture quality. Consequently, a new technology like the Plasma one has to provide a picture quality as good or even better than standard TV technology. In order to display a video picture with a quality similar to the CRT, at least 8-bit video data is needed. In fact, more than 8 bits should be preferably be used to have a correct rendition of the low video levels because of the gammatization process that aims at reproducing the non-linear CRT behavior on a linear panel like plasma.
- A Plasma Display Panel (PDP) utilizes a matrix array of discharge cells that could only be "ON" or "OFF". Also unlike a CRT or LCD in which gray levels are expressed by analog control of the light emission, a PDP controls the gray level by modulating the number of small light pulses per frame. This time-modulation will be integrated by the observer's eye over a period corresponding to the eye time response.
- Today, a lot of methods exist for reproducing various video levels using the modulation of the light pulses per frame (PWM - Pulse Width Modulation). In some cases it is not possible to reproduce enough video levels due to timing issues, use of a specific solution against false contour effect, etc. In these cases, some dithering technique should be used to artificially render all required levels. The visibility of the dithering noise will be directly linked to the way the basic levels have been chosen.
- Dithering per se is a well-known technique used to reduce the effects of quantisation noise due to a reduced number of displayed resolution bits. With dithering, some artificial levels are added inbetween the existing video levels corresponding to the reduced number of displayed resolution bits. This improves the gray scale portrayal, but on the other hand adds high frequency, low amplitude dithering noise which is perceptible to the human viewer only at a small viewing distance.
- An optimization of the dithering concept is able to strongly reduce its visibility as disclosed in the
WO-A-01/71702 - From
WO-A-02 45062 - From Weitbruch S. et al: "Bildqualitatsverbesserung durch Codierungsoptimierung für Plasma-TV", Fernseh und Kinotechnik, VDE Verlag GmbH, Berlin, vol. 54, no. 8/9, August 2000, pages 520-522, 524, 526, XP001078093 ISSN: 0015-0142 a discussion of the Weber-Fechner-law for plasma TV design is known which is the base for a new type of sub-field coding called slope increasing code.
- Various reasons can lead to a lack of video levels in the gray level rendition on a plasma screen (or similar display based on PWM system-like (Pulse Width Modulation) light generation.
- Some of the main reasons for a lack of level rendition are listed below:
- In case of simple binary coding (each sub-field corresponds to a bit) 8 sub-fields are required for an acceptable gray scale rendition. Nevertheless, for some single scan panels, the addressing speed is not fast enough to render 8 sub-fields in a given timeframe (20 ms in 50Hz video sources (PAL, SECAM), 16.6 ms in 60Hz video sources (NTSC), 13.3 ms in 75Hz video sources,...).
- For good response fidelity, specific sub-field organizations with a specific sub-field weight sequence are needed. For instance, a sub-field sequence growing slower than the Fibonacci sequence (1-1-2-3-5-8-13-21-34-55-89-144-233...) increases the response fidelity of the panel. In that case at least 12 sub-fields are required to achieve more than 255 different levels corresponding to 8-bit video. Even in case of a dual-scan panel, the addressing time is mainly too slow to have both a good coding and enough sustain time to provide a good contrast and a good peak-white enhancement.
- In order to completely suppress the PWM related artifacts known under the name "false contour effect", a new coding concept has been developed called "incremental code". Such a coding system does no more allow to have any sub-field switched OFF between two sub-fields switched ON. In that case, the number of video levels which can be rendered is equal to the number of sub-fields. Since it is not possible to dispose of 255 different sub-fields on a plasma display (around 122 ms needed for addressing only), it won't be possible via such a method to dispose of enough video levels.
- In order to simplify the exposition, the last case will be used as an example for the further explanation. Obviously, the invention described in this document is however not limited to this concept.
- The plasma cell has only two different states: a plasma cell can only be ON or OFF. Thus video levels are rendered by using a temporal modulation. The most efficient addressing scheme should be to address N times if the number of video levels to be created is equal to N. In case of an 8 bit video value, each cell should be addressable 256 times in a video frame! This however, is not technically possible since each addressing operation requires a lot of time (around 2µs per line, i. e. 480µs for the addressing of all lines in dual scan mode and 256*480µs = 122 ms for the maximum value of 256 operations, which is much more than the 20 ms available time in case of the 50Hz display mode).
- Then, there are two possibilities to render the information. The first one is to use a minimum of 8 SF (in case of an 8-bit video level representation) and the combination of these 8 SF is able to generate the 256 levels. Such a mode is illustrated in
Fig. 1 . - Each sub-field is divided into three parts: an addressing part, a sustain part and an erase part. The addressing period is used to address line per line the plasma cells by applying a writing voltage to those cells that shall be activated for light generation and is typical for PDPs. The sustain period is used as a period for lighting of written plasma cells by applying sustain pulses with a typical sustain voltage to all cells. Finally, the erase period is used for erasing the cell charges, thereby neutralizing the cells.
-
Fig. 2 presents the standard method used to generate all 256 video levels based on the 8 bit code fromFig. 1 . - According to
Fig. 3 the eye of the observer will integrate, over the duration of the image period, the various combinations of luminous emissions and by this recreate the various shades in the gray levels. In case of no motion (left side ofFig. 3 ), the integration axis will be perpendicular to the panel in the time direction. The observer will integrate information coming from the same pixel and will not detect any disturbances. - If the object is moving (right side of
Fig. 3 ), the observer will follow this object from frame t to t+1. On a CRT, because the emission time is very short the eye will follow correctly the object even with a large movement. On a PDP, the emission time extends over the whole image period. With an object movement of 3 pixels per frame, the eye will integrate sub-fields coming from 3 different pixels. Unfortunately, if among these 3 pixels there is a transition, this integration can lead to the false contour as shown at the bottom ofFig.3 on the right. - The second encoding possibility already mentioned before is to render only a limited number of levels but to choose these levels in order to never introduce any temporal disturbance. This code will be called "incremental code" because for any level B>A one will have codeB = codeA + C where C is a positive value. This coding obviously limits the number of video levels which can be generated to the number of addressing periods. However, with such a code there will never be one sub-field OFF between two consecutive sub-fields ON. Some optimized dithering or error diffusion techniques can help to compensate this lack of accuracy.
- The main advantage of such a coding method is the suppression of any false contour effect since there are no more any discontinuities between two similar levels (e.g. 127/128) as it was the case with standard 8 bit coding. For that reason this mode is sometimes called NFC mode for No False Contour. On the other hand, such a mode requires dithering to dispose of enough video levels, which can introduce some disturbing noise.
-
Fig. 4 illustrates the generation of 256 levels with an incremental code based on 16 sub-fields and 4 bit dithering (16x24=256) . For this a spatio-temporal uncorrelation of the 16 available basic levels is used. This example based on 16 sub-fields will be used in the following in order to simplify the exposition. -
Fig. 5 presents the case of a transition 127/128 rendered via this mode in case of movement. It shows that moving transitions between similar levels are no more a source of false contouring but lead to smooth transitions.Fig. 4 illustrates the incremental addressing mode without addressing period. A global addressing operation is performed at the beginning of a frame period, called global priming. This is followed by a selective erase operation in which the charge of only those cells is quenched that shall not produce light. All the other cells remain charged for the following sustain period. The selective erase operation is part of each sub-field. At the end of the frame period a global erase operation neutralizes all cells.Fig. 6 illustrates a possibility to implement the incremental coding scheme with 4 bit dithering. - A further important aspect is the implementation of a gamma correction. The CRT displays do not have a linear response to the beam intensity but rather a quadratic response. For that reason, the pictures sent to the display are pre-corrected in the studio or mostly already in the video camera itself so that the picture seen by the human eye respects the filmed picture.
Fig. 7 illustrates this principle. - In the case of Plasma displays which have a linear response characteristic, the pre-correction made at the source level will degrade the observed picture which becomes unnatural as illustrated on
Fig. 8 . In order to suppress this problem, an artificial gamma operation made in a specific video-processing unit of the plasma display device will invert the pre-correction made at the source level. Normally the gamma correction is made in the plasma display unit directly before the encoding to sub-field level. This gamma operation leads to a destruction of low video levels if the output video data is limited to 8 bit resolution as illustrated onFig. 9 . - In the case of the incremental code, there is an opportunity to avoid such an effect. In fact, it is possible to implement the gamma function in the sub-field weights. It shall be assumed to dispose of 16 sub-fields following a gamma function (γ = 1.82) from 0 to 255 with a dithering step of 16 (4 bit). In that case, for each of the 16 possible video values Vn, the value displayed should respect the following progression:
-
- The accumulation of these weights follows a quadratic function (gamma=1.82) from 0 (no SF ON) up to 255 (all SF ON).
Fig. 10 represents this encoding method. It shows that an optimized computation of the weights for an incremental code enables to take into account the gamma progression without the implementation of a specific gamma operation at video level. Obviously, in the present example, only the use of 4-bit dithering enables the generation of the 256 different perceived video levels. - If nothing specific is implemented, each of the 16 sub-fields will be used to render a group of 16 video levels.
Fig. 11 illustrates this principle. It represents how the various video levels will be rendered in the example of an incremental code. All levels between 0 and 15 will be rendered while applying a dithering based on the sub-field SF0 (0) and SF1 (2). All the levels between 224 and 240 will be rendered while applying a dithering based on thesub-field - In this presentation the black level is defined as SF0 (weight=0). Of course, there is no extra sub-field SF0 in the sub-field organization. The black level is simply be generated by not activating or deactivating all other sub-fields SF1 to SF16. An example: The
input video level 12 should have theamplitude 1 after gammatization (255·(12/255)1.82 = 1) and this could be rendered with the dithering shown inFig. 12 . Half of the pixels in a homogenous block will not be activated for light generation and half will be activated for light generation only with sub-field SF1 having the weight "2". From frame to frame the dithering pattern is toggled as shown inFig. 12. Fig. 12 represents a possible dithering used to render thevideo level 12 taking into account the gamma of 1.82 used to compute the weights. - On the other hand, if no specific adaptation is applied, exactly the same dithering will be used in order to render the video level 231 (213.5 after gamma) as shown in
Fig. 13 . It represents a possible dithering used to render the video level 231 taking into account the gamma of 1.82 used to compute the weights (255·(231/255)1.82 =213.5). -
Fig. 12 andFig. 13 have shown that the same kind of dithering (4-bit) has been used both for the low-level and the high level video range. Each of the 16 possible video levels are equally distributed among the 256 video levels and the same kind of dithering is applied in-between to render the other levels. On the other hand, this does not fit with the human perception of luminance. Indeed the eye is much more sensitive to noise in the low level than in the luminous areas. - In view of that it is an object of the present invention to provide a display device and a method which enables a reduction of the dithering visibility.
- According to the present invention this object is solved by a method for processing video picture data for display on a display device having a plurality of luminous elements corresponding to pixels of a video picture, wherein the brightness of each pixel is controlled by sub-field code words corresponding to a number of impulses for switching on and off the luminous elements, by dithering said video picture data and sub-field coding said dithered video picture data for displaying, as well as transforming said video picture data according to a retinal function before dithering.
- Furthermore, the above-mentioned object is solved by a Device for processing video picture data for display on a display device having a plurality of luminous elements corresponding to pixels of a video picture, comprising brightness controlling means with which the brightness of each pixel is controlled by at least one sub-field code word with which the luminous element/s are activated or inactivated for light output in small pulses corresponding to sub-fields in a video frame, including dithering means for dithering said video picture data and sub-field coding means for sub-field coding said dithered video picture data for displaying, characterized by transforming means for transforming said video picture data according to a retinal function before dithering.
- Further advantageous embodiments are apparent from the dependent claims.
- The advantage of the present invention is the reduction of the dithering visibility by a change of the sub-field organization together with a transformation of the video input values through an appropriate transformation curve based on the human visual system luminance sensitivity (Weber-Fechner law).
- Exemplary embodiments of the invention are illustrated in the drawings and are explained in more detail in the following description. The drawings are showing in:
-
Fig. 1 the principle of 8-sub-field standard encoding; -
Fig. 2 the encoding of 256 video levels using standard approach; -
Fig. 3 the false contour effect in case of standard coding; -
Fig. 4 the generation of 256 video levels with incremental coding; -
Fig. 5 a moving transition in case of incremental code; -
Fig. 6 principal processing steps for an implementation of the incremental coding; -
Fig. 7 the principle of gamma pre-correction for standard CRT displays; -
Fig. 8 the effect of displaying standard pre-corrected pictures on a PDP; -
Fig. 9 the low video level destruction by application of a gamma function to the input video levels; -
Fig. 10 a gamma progression integrated in the incremental coding; -
Fig. 11 a sub-field organization to be used for incremental coding; -
Fig. 12 a rendition ofvideo level 12 with dithering; -
Fig. 13 a rendition of video level 231 with dithering; -
Fig. 14 a receptor field of a retina; -
Fig. 15 an illustration for demonstrating the contrast sensitivity of human eyes; -
Fig. 16 an example of a HVS transformation curve; -
Fig. 17 an HVS adapted incremental coding scheme with integrated gamma progression; -
Fig. 18 principal processing steps for an implementation of the HVS adapted incremental coding scheme; -
Fig. 19 the HVS coding concept and its effect on input video levels; -
Fig. 20 a comparison of standard rendition and HVS rendition for some low video levels; -
Fig. 21 a comparison of standard rendition and HVS rendition for some high video levels; and -
Fig. 22 a circuit implementation of HVS coding. - The present invention will be explained in further detail along with the following preferred embodiments.
- For a better understanding of the present invention some physiological effects of the human visible sense are presented below.
- The analysis of the retina shows one of the fundamental functions of the visual system cells: the notion of receptor fields. These represent small retina areas related to a neuron and determining its response to luminous stimuli. Such receptor fields can be divided into regions enabling the excitation or inhibition of the neuron and often called "ON" and "OFF" regions.
Fig. 14 illustrates such a receptor field. These receptor fields transmit to the brain, not the absolute luminance value located at each photo-receiver, but the relative value measured between two adjacent points on the retina. This means that the eye is not sensitive to the absolute luminance but only to the local contrasts. This phenomenon is illustrated inFig. 15 : in the middle of each area, the gray disk has the same level, but human eyes perceive it differently. - This phenomenon is called "Weber-Fechner" law and represents retina sensitivity as a logarithmic behavior under the form Ieye = a 1 + a 2 · log10(Iplasma ). One formula commonly used is defined by Anil K. Jain in "Fundamental of digital image" (Prentice Hall 1989) under the form
- This curve shows that the human eye is much more sensitive to the low video levels than to the highest ones. Therefore, it is not reasonable to apply exactly the same kind of dithering for all video levels. If such a concept is used, the eye will be disturbed by the dithering applied to the lowest video levels while it does not care of all levels rendered in the luminous parts of the screen.
- The inventive concept described in this document will take care of the human luminance sensitivity. In that case, the goal of the invention will be to apply less dithering to the low-levels while using more dithering for the high levels. In addition to that, this is done without using various dithering schemes by using a model of the human eye combined with an adaptation of the sub-field weighting.
- The first stage defined in the inventive concept is based on a filtering of the input picture based on the human visual sensitivity function. In order to simplify the present exposition, a function will be used derived from those described above. Obviously, there are many other HVS functions existing and the invention shall not be limited to this particular function.
-
- The used transformation function presented in
Fig. 16 can be applied via a LUT (Look-Up Table) or directly via a function in the plasma specific IC. The LUT is the simplest way and requires limited resources in an IC. - The next stage of the concept is the adapted modification of the picture coding with the sub-fields. Obviously, a complex transformation of the input picture corresponding to a retinal behavior has been applied and now, the inverse transformation should be applied in the sub-field weighting to present the correct picture to the eye (not twice the same retinal behavior).
- As already said, the example of the incremental coding is again used to simplify the present exposition but any other coding concept can also be used for the invention.
- In order to apply an inverse transformation in the weight, this inverse transformation should be computed. Defining the retinal transformation as
- Now, in order to compute the new sub-field weights for the incremental code, the inverse retinal function will be used. In the previous computation of the weights, the following formula has been used:
-
-
- Now, the new weights include not only the gamma function but also the inverse of retinal function, which has been applied to the input video values. The new sub-field progression is shown on
Fig. 17 . - Based on this principle it is possible to use exactly the same implementation principle as described before and represented newly on
Fig. 18 . A HVS function is first applied to the input video level before the implementation of the dithering. The dithering is performed on the HVS adapted input picture. The inverse HVS function has been implemented integrated in the sub-field weighting to provide a correct picture to the eye including the required gamma function. Nevertheless, since the dithering function has been implemented between the HVS function and its inverse function, the dithering level will follow the HVS behavior as desired. Therefore, the dithering noise will have the same amplitude on the eye for all rendered levels and that makes it less disturbing. - A further illustration of the whole concept is presented on
Fig. 19. Fig. 19 depicts the result of the implementation of the HVS concept. In the low video levels an expansion has been made ahead of the dithering step. The low video levels are distributed over an enlarged video level range. This has the effect of a reduction of the dithering level. On the other hand, in the high video levels, a compression has been made ahead of the dithering step. The high video levels are concentrated in a reduced video level range. In that case the dithering level has been increased. - This can be better explained along with
Fig. 20 and Fig. 21 which compare the rendition of various levels using the standard method (prior art) and the new HVS concept. -
Fig. 20 shows the difference between the prior art and the new HVS concept in the rendition of low video levels. On theFig. 20 and 21 , the values in brackets represent the value to be displayed after gammatization. In the HVS implementation, more sub-fields are available for low-level reproduction and therefore the dithering is less visible. For instance, the level 4 (0.5 after gammatization) is rendered with combination of 1 and 0 in case of HVS implementation. In that case, the dithering pattern is less visible than in the prior art solution with a combination of 0 and 2! -
Fig. 21 now shows the difference between the prior art and the new HVS concept in rendition of high video levels. In the HVS implementation, there are fewer sub-fields available than in prior art since more sub-fields have been spent for low-levels. For instance the level 216 (187.5 after gammatization) is rendered with combination of 175 and 200 in case of prior art solution while a combination of 165 and 206 is used in HVS concept. Nevertheless, since the eye is less sensitive to high level differences, the picture is not really degraded in the high level range. - In other words the HVS concept therefore makes a compromise between more sub-fields for low-levels and less sub-fields for high levels in order to globally reduce the dithering visibility.
-
Fig. 22 describes a possible circuit implementation of the current invention. RGB input pictures are forwarded to the degamma function block 10: this can be realized with a look-up table (LUT) or by software with a mathematical function. The outputs of this block are forwarded to theHVS filtering block 11 that implements the retinal behavior via a complex mathematical formula or simply with a LUT. This function can be activated or deactivated by a HVS control signal generated by thePlasma Control block 16. Then the dithering will be added in ditheringblock 12 and this can be configured via the DITH signal from thePlasma Control Block 16. - The same block will configure the
sub-field encoding block 13 to take into account or not the HVS inverse weighting. - For plasma display panel addressing, the sub-field code words are read out of the
sub-field encoding block 13 and all the code words for one line are collected in order to create a single very long code word which can be used for the line-wise PDP addressing. This is carried out in the serial toparallel conversion unit 14. Theplasma control block 16 generates all scan and sustain pulses for PDP control. It receives horizontal and vertical synchronising signals for reference timing. - The inventive method described in this document will enable a reduction of the dithering visibility by a common change of the sub-field organization together with a modification of the video through an appropriate transformation curve based on the human visual system luminance sensitivity (Weber-Fechner law).
- In the preferred embodiments disclosed above, dithering was made pixel-based. In a colour PDP for each pixel three plasma cells RGB are existing. The invention is not restricted to pixel-based dithering. Cell-based dithering as explained in
WO-A-01/71702 - The invention can be used in particular in PDPs. Plasma displays are currently used in consumer electronics, e.g. for TV sets, and also as a monitor for computers. However, use of the invention is also appropriate for matrix displays where the light emission is also controlled with small pulse in sub-fields, i.e. where the PWM principle is used for controlling light emission. In particular it is applicable to DMDs (digital micro mirror devices).
Claims (10)
- Method for processing video picture data for display on a display device (16) having a plurality of luminous elements corresponding to pixels of a video picture, wherein the brightness of each pixel is controlled by at least one sub-field code word with which the luminous element/s are activated or inactivated for light output in small pulses corresponding to sub-fields in a video frame, each sub-field having assigned a sub-field weight, the sub-field weight determining the length in time a pixel is activated during this sub-field, the method comprising the steps of dithering said video picture data and sub-field coding said dithered video picture data for brightness control, characterized by the further steps of transforming said video picture data according to a non-linear function representing the Weber-Fechner-law before said dithering step and sub-field coding said dithered video picture data for brightness control, wherein in the step of sub-field coding a specific code is used in which by corresponding bit entries it is avoided that in a frame period a sub-field is inactivated between two activated sub-fields and wherein the sub-field weights are adapted to grow according to the inverse of the non-linear function representing the Weber-Fechner-law, thereby integrating the inverse transformation of the dithered video picture data in the step of sub-field coding.
- Method according to claim 1, wherein said transforming includes an expansion of low video levels of brightness and a compression of high video levels of brightness.
- Method according to claim 1 or 2, wherein said function for transforming input values to output values is y = a·log10 (b+c·x), where a, b, and c are real numbers.
- Method according to one of the claims 1 to 3, wherein said transformation function is applied via a look-up table.
- Method according to one of the claims 1 to 4, wherein the dithering step has the characteristic that using one sub-field more video levels are rendered in the high video level range than in the low video level range.
- Device for processing video picture data for display on a display device (16) having a plurality of luminous elements corresponding to pixels of a video picture, comprising brightness controlling means with which the brightness of each pixel is controlled by at least one sub-field code word with which the luminous element/s are activated or inactivated for light output in small pulses corresponding to sub-fields in a video frame, each sub-field having assigned a sub-field weight, the sub-field weight determining the length in time a pixel is activated during this sub-field, including dithering means (12) for dithering said video picture data, characterized by transforming means (11) for transforming said video picture data according to a non-linear function representing the Weber-Fechner-law before dithering and sub-field coding means (14) for sub-field coding said dithered video picture data for displaying using a specific code in which by corresponding bit entries it is avoided that in a frame period a sub-field is inactivated between two activated sub-fields, and wherein the sub-field weights are adapted to grow according to the inverse of the non-linear function representing the Weber-Fechner-law, thereby integrating the inverse transformation of the dithered video picture data in the step of sub-field coding.
- Device according to claim 6, wherein said transforming means (11) cause expansion of a low input video level range and compression of a high input video level range.
- Device according to claim 6 or 7, wherein said non-linear function for transforming input values is y = a·log10 (b+c·x), where a, b, and c are real numbers.
- Device according to one of the claims 6 to 8, wherein said non-linear function is applicable via a look-up table by said transforming means (10).
- device according to one of the claims 6 to 9, wherein the transforming means (10) cause that the dithering means (12) render more video levels using one sub-field in the high video level range than in the low video level range.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP03292006A EP1391867B1 (en) | 2002-08-23 | 2003-08-11 | Plasma display panel (PDP) - improvement of dithering noise while displaying less video levels than required |
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP02090298 | 2002-08-23 | ||
EP02090298A EP1391865A1 (en) | 2002-08-23 | 2002-08-23 | Plasma display panel (PDP) - Reduction of dithering noise while displaying less video levels than required |
EP03292006A EP1391867B1 (en) | 2002-08-23 | 2003-08-11 | Plasma display panel (PDP) - improvement of dithering noise while displaying less video levels than required |
Publications (2)
Publication Number | Publication Date |
---|---|
EP1391867A1 EP1391867A1 (en) | 2004-02-25 |
EP1391867B1 true EP1391867B1 (en) | 2008-10-15 |
Family
ID=31189528
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP03292006A Expired - Lifetime EP1391867B1 (en) | 2002-08-23 | 2003-08-11 | Plasma display panel (PDP) - improvement of dithering noise while displaying less video levels than required |
Country Status (1)
Country | Link |
---|---|
EP (1) | EP1391867B1 (en) |
Families Citing this family (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2006053171A1 (en) * | 2004-11-10 | 2006-05-18 | Thomson Licensing | System and method for dark noise reduction in pulse width modulated (pwm) displays |
US9280943B2 (en) | 2009-02-13 | 2016-03-08 | Barco, N.V. | Devices and methods for reducing artefacts in display devices by the use of overdrive |
Family Cites Families (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP1136974A1 (en) * | 2000-03-22 | 2001-09-26 | Deutsche Thomson-Brandt Gmbh | Method for processing video data for a display device |
EP1326223A1 (en) * | 2000-11-30 | 2003-07-09 | THOMSON multimedia S.A. | Method and apparatus for controlling a display device |
-
2003
- 2003-08-11 EP EP03292006A patent/EP1391867B1/en not_active Expired - Lifetime
Also Published As
Publication number | Publication date |
---|---|
EP1391867A1 (en) | 2004-02-25 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US6894664B2 (en) | Method and apparatus for processing video pictures | |
US6756995B2 (en) | Method and apparatus for processing video picture data for display on a display device | |
EP1269457B1 (en) | Method for processing video data for a display device | |
EP1326223A1 (en) | Method and apparatus for controlling a display device | |
US7522130B2 (en) | Plasma display panel (PDP)—improvement of dithering noise while displaying less video levels than required | |
US7609235B2 (en) | Multiscan display on a plasma display panel | |
EP1262947B1 (en) | Method and apparatus for processing video picture data for a display device | |
KR20050033810A (en) | Method for processing video pictures for false contours and dithering noise compensation | |
EP1391867B1 (en) | Plasma display panel (PDP) - improvement of dithering noise while displaying less video levels than required | |
US8576263B2 (en) | Method and apparatus for processing video pictures | |
KR100416143B1 (en) | Gray Scale Display Method for Plasma Display Panel and Apparatus thereof | |
EP1936590B1 (en) | Method and apparatus for processing video pictures | |
EP1260957B1 (en) | Pre-filtering for a Plasma Display Panel Signal | |
EP1359564B1 (en) | Multiscan display on a plasma display panel | |
KR20040011358A (en) | Method and apparatus for grayscale enhancement of a display device | |
EP1995712A1 (en) | Method for applying dithering to video data and display device implementing said method |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LI LU MC NL PT RO SE SI SK TR |
|
AX | Request for extension of the european patent |
Extension state: AL LT LV MK |
|
17P | Request for examination filed |
Effective date: 20040318 |
|
17Q | First examination report despatched |
Effective date: 20040419 |
|
AKX | Designation fees paid |
Designated state(s): DE FR GB |
|
RAP1 | Party data changed (applicant data changed or rights of an application transferred) |
Owner name: THOMSON LICENSING |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): DE FR GB |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: 746 Effective date: 20081015 |
|
REF | Corresponds to: |
Ref document number: 60324070 Country of ref document: DE Date of ref document: 20081127 Kind code of ref document: P |
|
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
26N | No opposition filed |
Effective date: 20090716 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 14 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R082 Ref document number: 60324070 Country of ref document: DE Representative=s name: DEHNS, DE Ref country code: DE Ref legal event code: R082 Ref document number: 60324070 Country of ref document: DE Representative=s name: HOFSTETTER, SCHURACK & PARTNER PATENT- UND REC, DE |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 15 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 16 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R082 Ref document number: 60324070 Country of ref document: DE Representative=s name: DEHNS, DE Ref country code: DE Ref legal event code: R081 Ref document number: 60324070 Country of ref document: DE Owner name: INTERDIGITAL CE PATENT HOLDINGS SAS, FR Free format text: FORMER OWNER: THOMSON LICENSING, BOULOGNE BILLANCOURT, FR |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: 732E Free format text: REGISTERED BETWEEN 20190912 AND 20190918 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: FR Payment date: 20190827 Year of fee payment: 17 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: GB Payment date: 20190829 Year of fee payment: 17 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: DE Payment date: 20191031 Year of fee payment: 17 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R119 Ref document number: 60324070 Country of ref document: DE |
|
GBPC | Gb: european patent ceased through non-payment of renewal fee |
Effective date: 20200811 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: FR Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20200831 Ref country code: DE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20210302 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: GB Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20200811 |