EP1412934B1 - Method and device for noise reduction in a pulse-width controlled image display device - Google Patents

Method and device for noise reduction in a pulse-width controlled image display device Download PDF

Info

Publication number
EP1412934B1
EP1412934B1 EP02754952A EP02754952A EP1412934B1 EP 1412934 B1 EP1412934 B1 EP 1412934B1 EP 02754952 A EP02754952 A EP 02754952A EP 02754952 A EP02754952 A EP 02754952A EP 1412934 B1 EP1412934 B1 EP 1412934B1
Authority
EP
European Patent Office
Prior art keywords
brightness
pixels
threshold value
successive pixels
data stream
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Lifetime
Application number
EP02754952A
Other languages
German (de)
French (fr)
Other versions
EP1412934A2 (en
Inventor
Udo Fischbeck
Johannes Spindler
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Grundig Multimedia BV
Original Assignee
Grundig Multimedia BV
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Grundig Multimedia BV filed Critical Grundig Multimedia BV
Publication of EP1412934A2 publication Critical patent/EP1412934A2/en
Application granted granted Critical
Publication of EP1412934B1 publication Critical patent/EP1412934B1/en
Anticipated expiration legal-status Critical
Expired - Lifetime legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
    • G09G3/20—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
    • G09G3/22—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters using controlled light sources
    • G09G3/28—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters using controlled light sources using luminous gas-discharge panels, e.g. plasma panels
    • G09G3/288—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters using controlled light sources using luminous gas-discharge panels, e.g. plasma panels using AC panels
    • G09G3/296—Driving circuits for producing the waveforms applied to the driving electrodes
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/14—Picture signal circuitry for video frequency region
    • H04N5/21—Circuitry for suppressing or minimising disturbance, e.g. moiré or halo
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
    • G09G3/20—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
    • G09G3/2007—Display of intermediate tones
    • G09G3/2018—Display of intermediate tones by time modulation using two or more time intervals
    • G09G3/2022—Display of intermediate tones by time modulation using two or more time intervals using sub-frames
    • G09G3/2037—Display of intermediate tones by time modulation using two or more time intervals using sub-frames with specific control of sub-frames corresponding to the least significant bits
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2360/00—Aspects of the architecture of display systems
    • G09G2360/16—Calculation or use of calculated indices related to luminance levels in display data
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
    • G09G3/20—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
    • G09G3/22—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters using controlled light sources
    • G09G3/28—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters using controlled light sources using luminous gas-discharge panels, e.g. plasma panels
    • G09G3/288—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters using controlled light sources using luminous gas-discharge panels, e.g. plasma panels using AC panels

Definitions

  • the time interval available for displaying a television picture is decomposed into part-time intervals of different duration or different weighting, during which a predetermined activation sequence is selected as a function of the brightness value of a respective picture element. This corresponds to a single or multiple illumination of the respective pixel during the time interval available for image display, wherein each illumination is assigned a predetermined period of time.

Abstract

The invention relates to a method and a device for noise reduction in a pulse-width controlled image display device. A monitoring of whether the brightness of several sequential image points is brighter than a given brightness threshold value occurs. If not the case, the delayed but otherwise unchanged input signal is supplied to the display. If, on the other hand, the brightness of several sequential image points is less than the given threshold brightness value, a mean value generation for the brightness values of several sequential image points occurs and said mean value is supplied to the display.

Description

Die Erfindung betrifft ein Verfahren und eine Vorrichtung zur Rauschreduktion bei einer pulsbreitengesteuerten Bildanzeigevorrichtung.The invention relates to a method and a device for noise reduction in a pulse width-controlled image display device.

Ein derartiges Verfahren und eine derartige Vorrichtung kommen beispielsweise bei Plasmadisplays zum Einsatz, welche in Zukunft die bei höherwertigen Fernsehgeräten derzeit noch verwendeten Farbbildröhren ergänzen oder ersetzen werden. Im Zusammenhang mit Farbbildröhren ist der Benutzer hochwertiger Fernsehgeräte seit dem Ende der 80er Jahre aufgrund der 100-Hz-Technologie an eine flackerfreie Darstellung gewöhnt.Such a method and apparatus are used, for example, in plasma displays, which in the future will supplement or replace the color picture tubes currently used in higher-quality television sets. In the context of color picture tubes, the user of high quality televisions has been accustomed to a flicker free display since the late 1980's due to the 100Hz technology.

Aus der Zeitschrift Radio Fernsehen Elektronik RFE, Heft 2, 1997, Seiten 18-20 , ist ein Plasmadisplay bekannt, das aus zwei Glasplatten mit matrixartig angeordneten Elektroden besteht, zwischen denen sich ein Edelgasgemisch befindet. Die Bildinformation wird bei Plasmadisplays nicht zeilenweise dargestellt wie bei Kathodenstahlröhren, sondern vollbildweise. Da bei einem Plasmadisplay die einzelnen Bildpunkte nicht zu beliebigen Zeiten einzeln ein- und ausgeschaltet werden können, muss die Aktivierung der Bildpunkte für das gesamte Display in einem Aktivierungsdurchgang erfolgen.From the magazine Radio Television Electronics RFE, Issue 2, 1997, pages 18-20 , a plasma display is known, which consists of two glass plates with matrix-like electrodes, between which there is a noble gas mixture. The image information is not displayed line by line in plasma displays as in cathode-ray tubes, but in full screen. Since the individual pixels can not be switched on and off individually at arbitrary times in the case of a plasma display, the activation of the pixels for the entire display must take place in one activation pass.

Die Ansteuerung eines Plasmadisplays erfolgt in mehreren Phasen: einer Adressierungs- oder Initialisierungsphase, einer Halte- oder Aktivierungsphase und einer Löschphase. -The activation of a plasma display takes place in several phases: an addressing or initialization phase, a holding or activation phase and a deletion phase. -

In der Adressierungs- oder Initialisierungsphase werden alle Zellen des Plasmadisplays vorgeladen, welche in der darauf folgenden Halte- oder Aktivierungsphase aktiviert werden sollen. Im letzten Schritt, der Löschphase, werden die vorgeladenen Zellen wieder entladen, die Bildinformation wird gelöscht.In the addressing or initialization phase, all cells of the plasma display are preloaded, which are to be activated in the subsequent holding or activation phase. In the last step, the deletion phase, If the preloaded cells are discharged again, the image information is deleted.

Das zur Darstellung eines Fernsehbildes zur Verfügung stehende Zeitintervall wird in Teilzeitintervalle unterschiedlicher Dauer bzw. unterschiedlicher Gewichtung zerlegt, während derer in Abhängigkeit vom Helligkeitswert eines jeweiligen Bildpunktes eine vorgegebene Aktivierungssequenz gewählt wird. Dies entspricht einem ein- oder mehrmaligen Aufleuchten des jeweiligen Bildpunktes während des zur Bilddarstellung zur Verfügung stehenden Zeitintervalles, wobei jedem Aufleuchten eine vorgegebene Zeitdauer zugeordnet ist.The time interval available for displaying a television picture is decomposed into part-time intervals of different duration or different weighting, during which a predetermined activation sequence is selected as a function of the brightness value of a respective picture element. This corresponds to a single or multiple illumination of the respective pixel during the time interval available for image display, wherein each illumination is assigned a predetermined period of time.

Derartige bekannte Plasmadisplays werden beispielsweise von den Firmen Fujitsu und NEC am Markt vertrieben.Such known plasma displays are sold for example by the companies Fujitsu and NEC on the market.

Aus der DE 198 33 597 A1 sind ein Verfahren und eine Vorrichtung zur Flimmerreduzierung bei pulsbreitengesteuerten Bildanzeigevorrichtungen bekannt, insbesondere bei einem Farbplasmadisplay. Ein derartiges Farbplasmadisplay dient beispielsweise der Darstellung von Fernsehbildern. Das Farbplasmadisplay wird mittels eines Pulsbreitenmodulators angesteuert, wobei zur Ansteuerung die Dauer eines Fernsehbildes in eine Reihe von Teilbildern bzw. Teilzeitintervallen zerlegt wird, die nacheinander dargestellt werden. Zur Flackerreduzierung, insbesondere einer 50-Hz-Flackerreduzierung, wird die Reihenfolge der Teilzeitintervalle und/oder der Aktivierungssequenzen der Teilzeitintervalle derart vorgegeben, dass das Flackern der darzustellenden Bilder minimal ist.From the DE 198 33 597 A1 For example, a method and apparatus for flicker reduction in pulse width controlled image display devices are known, especially in a color plasma display. Such a color plasma display serves, for example, to display television pictures. The color plasma display is controlled by means of a pulse width modulator, wherein for driving the duration of a television picture is decomposed into a series of sub-pictures or part-time intervals, which are displayed one after the other. For flicker reduction, in particular a 50 Hz flicker reduction, the order of the part-time intervals and / or the activation sequences of the part-time intervals is specified such that the flickering of the images to be displayed is minimal.

Weiterhin ist aus der DE 198 37 307 A1 eine bewegungsdetektorabhängige Veränderung der Reihenfolge der Teilzeitintervalle bekannt. Beim Vorliegen von Bewegungen wird die Reihenfolge der Teilzeitintervalle derart gewählt, dass Bewegungsartefakte vermieden werden. Ansonsten erfolgt die Wahl der Reihenfolge der Teilzeitintervalle derart, dass 50Hz-Flackerstörungen reduziert werden.Furthermore, from the DE 198 37 307 A1 a motion detector dependent change in the order of the part-time intervals known. In the presence of motions, the order of the part-time intervals is chosen such that motion artifacts are avoided. Otherwise, the choice of Order of part-time intervals such that 50Hz flicker errors are reduced.

Weiterhin ist es im Zusammenhang mit Plasmadisplays bereits bekannt, die Helligkeit eines darzustellenden Bildes zu erfassen, aus dem erfassten Helligkeitswert für jedes der Teilzeitintervalle des darzustellenden Bildes eine maximal zulässige Leuchtdauer abzuleiten und bei einer Veränderung des erfassten Helligkeitswertes die maximal zulässige Leuchtdauer für jedes der Teilzeitintervalle zu verändern. Diese Veränderung erfolgt derart, dass bei erfasstem dunklen Bildinhalt bzw. geringem Helligkeitswert die maximal zulässige Leuchtdauer in jedem der Teilzeitintervalle um dieselbe Zeitdauer erhöht wird. Ergibt hingegen die Helligkeitserfassung des darzustellenden Bildes, dass ein insgesamt heller Bildinhalt vorliegt, dann wird die maximal zulässige Leuchtdauer für jedes der Teilzeitintervalle um eine Zeitdauer verringert, die für alle Teilzeitintervalle gleich ist.Furthermore, in the context of plasma displays, it is already known to detect the brightness of an image to be displayed, derive a maximum permissible illumination duration from the detected brightness value for each of the part time intervals of the image to be displayed and, for a change in the detected brightness value, the maximum permissible illumination duration for each of the part time intervals change. This change takes place in such a way that when the dark picture content or the low brightness value is detected, the maximum permissible lighting duration in each of the part-time intervals is increased by the same time duration. If, on the other hand, the brightness detection of the image to be displayed shows that the image content is altogether brighter, then the maximum permissible illumination duration for each of the part-time intervals is reduced by a time duration which is the same for all part-time intervals.

Ein Nachteil dieser Vorgehensweise besteht darin, dass der Kontrast des darzustellenden Bildes reduziert ist, da bei erfasster großer Helligkeit des darzustellenden Bildes die Zeitdauer für die Darstellung heller Bildbestandteile reduziert ist und bei erfasster geringer Helligkeit eines darzustellenden Bildes dunkelgraue Bildbestandteile hellgrau dargestellt werden, da diese durch die beschriebene Beaufschlagung mit einem konstanten Offset nach oben gezogen werden, d. h. länger leuchten.A disadvantage of this procedure is that the contrast of the image to be displayed is reduced, since with detected high brightness of the image to be displayed, the time for the representation of light image components is reduced and dark gray image components are displayed light gray when detected low brightness of an image to be displayed the loading described is pulled upwards with a constant offset, d. H. shine longer.

Ferner ist aus der deutschen Patentanmeldung 100 09 858 ein Verfahren zur Verbesserung des Kontrasts einer pulsbreitengesteuerten Bildanzeigevorrichtung bekannt. Bei diesem Verfahren wird eine Veränderung der maximal zulässigen Leuchtdauer für die Teilzeitintervalle derart vorgenommen, dass die maximal zulässige Leuchtdauer für Teilzeitintervalle mit geringerer Wertigkeit kleineren Änderungen unterworfen wird als die maximal zulässige Leuchtdauer für Teilzeitintervalle mit höherer Wertigkeit.Furthermore, from the German patent application 100 09 858 A method for improving the contrast of a pulse width-controlled image display device is known. In this method, a change in the maximum allowable lighting time for the part-time intervals is made such that the maximum allowable lighting time for part-time intervals with lower significance is subjected to smaller changes than the maximum allowable lighting time for part-time intervals with higher significance.

Ausgehend von diesem Stand der Technik liegt der Erfindung die Aufgabe zugrunde, ein neues Verfahren und eine neue Vorrichtung anzugeben, bei welchen das Rauschen reduziert ist.Based on this prior art, the invention has for its object to provide a new method and a new device in which the noise is reduced.

Diese Aufgabe wird durch ein Verfahren mit den im Anspruch 1 angegebenen Merkmalen bzw. durch eine Vorrichtung mit den im Anspruch 4 angegebenen Merkmalen gelöst.This object is achieved by a method having the features specified in claim 1 or by a device having the features specified in claim 4.

Vorteilhafte Ausgestaltungen und Weiterbildungen der Erfindung ergeben sich aus den abhängigen Ansprüchen.Advantageous embodiments and modifications of the invention will become apparent from the dependent claims.

Die Vorteile der Erfindung bestehen insbesondere darin, dass in dunklen Bereichen eines angezeigten Bildes das Rauschen reduziert ist. Damit wird dem Umstand Rechnung getragen, dass bei pulsbreitengesteuerten Bildanzeigevorrichtungen, insbesondere Plasmadisplays, in dunklen Bildbereichen auftretendes Rauschen besonders störend ist. Dies ist darauf zurückzuführen, dass dunklen Bildbereichen kurze Teilzeitintervalle zugeordnet sind. Ist beispielsweise anhand von Rauschen nicht nur das dem LSB eines Mehrbit-Wortes zugeordnete Teilzeitintervall aktiviert, sondern auch das benachbarte Teilzeitintervall LSB+1, dann bedeutet dies bereits eine Verdoppelung der Helligkeit, welche vom menschlichen Auge registriert und als störend empfunden wird.The advantages of the invention are, in particular, that the noise is reduced in dark areas of a displayed image. This takes into account the fact that in the case of pulse-width-controlled image display devices, in particular plasma displays, noise occurring in dark image areas is particularly disturbing. This is due to the fact that dark image areas are assigned short part-time intervals. If, for example, based on noise, not only the part-time interval assigned to the LSB of a multi-bit word is activated, but also the adjacent part-time interval LSB + 1, this already means a doubling of the brightness which is registered by the human eye and is perceived as disturbing.

Dies gilt insbesondere dann, wenn zu einer künstlichen Erhöhung der Anzahl der Graustufen im Sinne eines "Dithering-Vorganges" sowohl das LSB als auch das LSB+1 jeweils auf vier benachbarte Pixel des anzuzeigenden Bildes aufgeteilt werden. In diesem Fall erzeugt vorliegendes Rauschen zusätzliche räumliche Effekte im genannten Viererblock, die für das menschliche Auge störend in Erscheinung treten.This applies in particular when, for an artificial increase in the number of gray levels in the sense of a "dithering process", both the LSB and the LSB + 1 are each divided into four adjacent pixels of the image to be displayed. In this case, present noise creates additional spatial effects in the block of four that are disturbing to the human eye.

Durch das beanspruchte Ersetzen von Bildpunkten mit niedrigen Helligkeitswerten durch gemittelte Helligkeitswerte wird das in dunklen Bildbereichen auftretende Rauschen reduziert. In hellen Bildbereichen erfolgtThe claimed replacement of pixels with low brightness values with averaged brightness values reduces the noise occurring in dark image areas. In bright picture areas takes place

Weiterhin ist aus Patent Abstract of Japan vol. 1998, no. 09, 31. Juli 1998 (1998-07-31 ) -& JP 10 091120 A (Fujitsu General LTD(,10. April 1998 (1998-04-10) eine Anordnung bekannt, die mit Hilfe eines Fehlerdiffusionsschaltkreis bei Plasmadisplays eine Verbesserung der Bilddarstellung in den dunklen Bildbereichen erreicht. keine Veränderung des Bildsignals, da Rauschen in hellen Bildbereichen weniger störend in Erscheinung tritt.Furthermore, it is off Patent Abstract of Japan vol. 1998, no. 09, 31 July 1998 (1998-07-31 ) - & JP 10 091120 A (Fujitsu General LTD (April 10, 1998 (1998-04-10) discloses an arrangement that achieves an improvement in image display in the dark image areas by means of an error diffusion circuit in plasma displays. no change in the image signal, since noise in the light image areas is less disturbing.

Das beanspruchte Verfahren ist sowohl im Sinne einer eindimensionalen Filterung als auch einer zweidimensionalen als auch einer dreidimensionalen Filterung verwendbar. Bei einer zweidimensionalen Filterung sind lediglich zusätzliche Zeilenspeicher und bei einer dreidimensionalen Filterung Bildspeichermittel zusätzlich vorzusehen.The claimed method can be used both in terms of one-dimensional filtering and of two-dimensional and three-dimensional filtering. In the case of two-dimensional filtering, only additional line memories are to be provided and, in the case of a three-dimensional filtering, image memory means must additionally be provided.

Gegebenenfalls kann die durchgeführte Filterung sich auch auf Bildpunkte erstrecken, die im Übergangsbereich zwischen gefilterten und nicht gefilterten Daten liegen. Dadurch werden auch die Übergänge weicher gestaltet.Optionally, the filtering performed may also extend to pixels located in the transition region between filtered and unfiltered data. This also makes the transitions softer.

Weiterhin kann die Anzahl der aufeinanderfolgenden Bildpunkte, die im ersten Schritt überprüft werden, unterschiedlich groß gewählt werden. Dies gilt auch für die Anzahl der Bildpunkte, die zur Mittelwertbildung herangezogen werden. In diesen Fällen muss natürlich auch die Verzögerungszeit des im Weg des nichtgefilterten Signals liegenden Verzögerungsgliedes entsprechend angepasst werden.Furthermore, the number of successive pixels that are checked in the first step can be selected to be different. This also applies to the number of pixels used for averaging. In these cases, of course, the delay time of the lying in the path of the unfiltered signal delay element must be adjusted accordingly.

Weitere vorteilhafte Eigenschaften der Erfindung ergeben sich aus der Erläuterung eines Ausführungsbeispiels anhand der Figuren. Es zeigt:

  • Figur 1 eine Skizze zur Erläuterung der Ansteuerung einer pulsbreitengesteuerten Bildanzeigevorrichtung,
  • Figur 2 ein Blockdiagramm zur Erläuterung eines Ausführungsbeispiels für die Erfindung, und
  • Figur 3 ein Zeitdiagramm zur Veranschaulichung der Funktionsweise der Erfindung.
Further advantageous features of the invention will become apparent from the explanation of an embodiment with reference to FIGS. It shows:
  • FIG. 1 a sketch to explain the control of a pulse width-controlled image display device,
  • FIG. 2 a block diagram for explaining an embodiment of the invention, and
  • FIG. 3 a timing diagram for illustrating the operation of the invention.

Die Figur 1 zeigt eine Skizze zur Erläuterung der Ansteuerung einer pulsbreitengesteuerten Bildanzeigevorrichtung, beispielsweise eine Plasmadisplays. Das zur Darstellung eines Fernsehbildes zur Verfügung stehende Zeitintervall von 20 Millisekunden wird in Teilzeitintervalle SF1, SF2, ..., SF6 zerlegt. Jedes dieser Teilzeitintervalle weist eine unterschiedliche Dauer bzw. Gewichtung G auf, die in der Figur 1 jeweils oberhalb der die Teilzeitintervalle repräsentierenden Kästchen angegeben ist. Während dieser Teilzeitintervalle wird in Abhängigkeit vom Helligkeitswert eines jeweiligen Bildpunktes eine vorgegebene Aktivierungssequenz gewählt. Dies entspricht einem ein- oder mehrmaligen Aufleuchten des jeweiligen Bildpunktes während des zur Bilddarstellung zur Verfügung stehenden Zeitintervalles, wobei jedem Aufleuchten eine vorgegebene Zeitdauer zugeordnet ist.The FIG. 1 shows a sketch for explaining the control of a pulse width-controlled image display device, such as a plasma display. The time interval of 20 milliseconds available for displaying a television picture is decomposed into part-time intervals SF1, SF2,..., SF6. Each of these part-time intervals has a different duration or weighting G, which in the FIG. 1 respectively above the boxes representing the part-time intervals. During these part-time intervals, a predetermined activation sequence is selected as a function of the brightness value of a respective pixel. This corresponds to a single or multiple illumination of the respective pixel during the time interval available for image display, wherein each illumination is assigned a predetermined period of time.

Bei dunklen Bildpunkten erfolgt beispielsweise nur ein Aufleuchten während des Teilzeitintervalles SF1, welches dem LSB eines Videosignals entspricht. Erfolgt aufgrund von Rauschen auch ein Aufleuchten während des Teilzeitintervalles SF2, welches im Vergleich zu SF1 die annähernd doppelte zeitliche Länge bzw. Gewichtung aufweist, dann bedeutet dies bereits eine nahezu Verdoppelung der Helligkeit, welche vom menschlichen Auge als störend empfunden wird.In the case of dark pixels, for example, only a lighting up takes place during the part-time interval SF1, which corresponds to the LSB of a video signal. If, due to noise, lighting also occurs during the part-time interval SF2, which has approximately twice the time length or weighting in comparison with SF1, then this already means a nearly doubling of the brightness, which is perceived as disturbing by the human eye.

Um derartige durch Rauschen verursachten Störungen zu vermeiden, die vor allem in dunklen Bildbereichen auftreten, erfolgt eine Signalverarbeitung, wie sie in der Figur 2 anhand eines Ausführungsbeispiels für die Erfindung beschrieben ist.To avoid such interference caused by noise, which occur especially in dark image areas, there is a signal processing, as described in the FIG. 2 is described with reference to an embodiment of the invention.

Die Figur 2 zeigt ein Blockdiagramm zur Erläuterung eines Ausführungsbeispiels für die Erfindung. Dem Eingang E wird ein Videoeingangssignal in Form eines Signaldatenstromes zugeführt, welcher den Helligkeitssignalen aufeinanderfolgender Bildpunkte des auf dem Plasmadisplays anzuzeigenden Bildes entspricht. Dieses Videoeingangssignal wird auf drei Signalwege aufgeteilt.The FIG. 2 shows a block diagram for explaining an embodiment of the invention. The input E is supplied with a video input signal in the form of a signal data stream, which corresponds to the brightness signals of successive pixels of the image to be displayed on the plasma display. This video input signal is split into three signal paths.

Im oberen Signalweg gelangt es an eine Prüfeinheit 1, in welcher überprüft wird, ob die Helligkeit dreier aufeinanderfolgender Bildpunkte jeweils kleiner ist als ein vorgegebener Helligkeitsschwellenwert. Ist dies nicht der Fall, dann generiert die Prüfeinheit 1 ein Steuersignal für einen Schalter 4, durch welches der Schalter 4 in seine obere Schaltstellung gebracht wird. Ist die Helligkeit dreier aufeinanderfolgender Bildpunkte hingegen jeweils kleiner als der vorgegebene Helligkeitsschwellenwert, dann erzeugt die Prüfeinheit 1 ein Steuersignal für den Schalter 4, durch welches der Schalter 4 in seine untere Schaltstellung gebracht wird.In the upper signal path, it passes to a test unit 1, in which it is checked whether the brightness of three successive pixels is in each case smaller than a predefined brightness threshold value. If this is not the case, then the test unit 1 generates a control signal for a switch 4, by which the switch 4 is brought into its upper switching position. On the other hand, if the brightness of three successive pixels is in each case smaller than the predetermined brightness threshold value, then the test unit 1 generates a control signal for the switch 4, by means of which the switch 4 is brought into its lower switching position.

Im mittleren Signalweg ist ein Verzögerungsglied 2 vorgesehen, in welchem der Eingangsdatenstrom um die Dauer zweier Bildpunkte verzögert wird. Das Ausgangssignal des Verzögerungsgliedes 2 wird dem oberen Eingang des Schalters 4 zugeführt.In the middle signal path, a delay element 2 is provided, in which the input data stream is delayed by the duration of two pixels. The output signal of the delay element 2 is supplied to the upper input of the switch 4.

Im unteren Signalweg wird das Eingangssignal über ein Filter 3 geleitet, in welchem eine lineare oder gewichtete Mittelwertbildung dreier aufeinanderfolgender Bildpunkte erfolgt. Das Ausgangssignal des Filters 3 wird dem unteren Eingang des Schalters 4 zugeführt.In the lower signal path, the input signal is passed through a filter 3, in which a linear or weighted averaging of three consecutive pixels takes place. The output signal of the filter 3 is supplied to the lower input of the switch 4.

Der Ausgang des Schalters 4 ist mit einem Plasmadisplay 5 verbunden, auf welchem die Signaldarstellung erfolgt.The output of the switch 4 is connected to a plasma display 5, on which the signal is displayed.

Bei der gezeigten Schaltung wird dann, wenn die Helligkeit dreier aufeinanderfolgender Bildpunkte jeweils unter dem Helligkeitsschwellenwert liegt, der untere Signalweg durchgeschaltet, so dass ein gemitteltes Signal dem Display 5 zugeführt wird, und dann, wenn die Helligkeit dreier aufeinanderfolgender Bildpunkte nicht jeweils unter dem Helligkeitsschwellenwert liegt, der mittlere Signalweg durchgeschaltet, so dass das verzögerte, ansonsten aber unveränderte Eingangssignal an das Display 5 weitergeleitet wird.In the circuit shown, when the brightness of three consecutive pixels is each below the brightness threshold, the lower signal path is turned on so that an averaged signal is supplied to the display 5 and when the brightness of three consecutive pixels is not below the brightness threshold , the middle signal path through, so that the delayed, but otherwise unchanged input signal is forwarded to the display 5.

Die vorstehend beschriebene Prüfung und die in Abhängigkeit vom Prüfungsergebnis durchgeführte Signalverarbeitung wird Bildpunkt für Bildpunkt wiederholt.The test described above and the signal processing performed as a function of the test result is repeated pixel by pixel.

Die Figur 3 zeigt ein Zeitdiagramm, in welchem die Funktionsweise der Erfindung veranschaulicht ist. In der Figur 3a ist der am Eingang E vorliegende Signaldatenstrom gezeigt, in welchem die Helligkeitswerte der aufeinanderfolgenden Bildpunkte in hexadezimaler Form angegeben sind. Dieser Signaldatenstrom ist zur Veranschaulichung in drei Bereiche B1, B2, B3 unterteilt, wobei die Helligkeitswerte der Bildpunkte in den Bereichen B1 und B3 größer sind als der vorgegebene Helligkeitsschwellenwert, der beim vorliegenden Ausführungsbeispiel bei "30" in hexadezimaler Darstellung liegt, und wobei die Helligkeitswerte der Bildpunkte im Bereich B2 kleiner sind als der genannte Helligkeitsschwellenwert.The FIG. 3 shows a timing diagram in which the operation of the invention is illustrated. In the FIG. 3a the signal data stream present at the input E is shown, in which the brightness values of the successive pixels are indicated in hexadecimal form. This signal data stream is subdivided into three areas B1, B2, B3 for illustration, wherein the brightness values of the pixels in the areas B1 and B3 are greater than the predetermined brightness threshold, which in the present exemplary embodiment is "hexadecimal" in "30", and the brightness values of the pixels in the area B2 are smaller than the specified brightness threshold value.

In der Figur 3b ist der am Ausgang des Verzögerungsgliedes 2 vorliegende Signaldatenstrom gezeigt, der gegenüber dem Eingangssignaldatenstrom um die Dauer zweier Bildpunkte verzögert ist.In the FIG. 3b the present at the output of the delay element 2 signal data stream is shown, which is delayed from the input signal data stream by the duration of two pixels.

Die Figur 3c zeigt den verzögerten gefilterten Datenstrom, wie er am Ausgang des Filters 3 vorliegt, und die Figur 3d den am Ausgang des Schalters 4 vorliegenden Datenstrom. Aus letzterem ist ersichtlich, dass die Helligkeitswerte in den Bereichen B1 und B3, abgesehen von der Verzögerung um die Dauer zweier Bildpunkte, mit den entsprechenden Helligkeitswerten des Eingangsdatenstroms übereinstimmen. Die Helligkeitswerte im Bereich B2 sind hingegen gemäß der vorliegenden Erfindung durch Mittelwerte ersetzt, die jeweils aus den Helligkeitswerten dreier aufeinanderfolgender Bildpunkte ermittelt wurden.The Figure 3c shows the delayed filtered data stream, as it exists at the output of the filter 3, and the 3d figure the present at the output of the switch 4 data stream. From the latter, it can be seen that the brightness values in the regions B1 and B3, apart from the delay by the duration of two pixels, coincide with the corresponding brightness values of the input data stream. The brightness values in the area B2, in contrast, according to the present invention, are replaced by mean values which were respectively determined from the brightness values of three successive pixels.

Durch diese Mittelwertbildung, die nur in dunklen Bildbereichen vorgenommen wird, wird das Rauschen in diesen dunklen Bildbereichen verringert.This averaging, which is done only in dark areas of the image, reduces the noise in these dark areas of the image.

Claims (4)

  1. Method for noise reduction in a pulse-width-controlled image display device, wherein the time interval available for representing the image is divided into successive weighted partial time intervals and activation sequences assigned to the partial time intervals are generated by conversion from the brightness values which form a signal data stream, are associated with the pixels of the image to be represented and are present in the form of multibit words,
    characterized in that
    a) in a first step a check is made to determine whether the brightness of a plurality of successive pixels is greater than a predetermined brightness threshold value,
    b) in a second step,
    - when the brightness of a plurality of successive pixels is in each case less than the predetermined brightness threshold value, the brightness values of this plurality of successive pixels are averaged and this average value is inserted into the signal data stream, and
    - when the brightness of a plurality of successive pixels is not in each case less than the predetermined brightness threshold value, the associated multibit word is supplied in unchanged form for conversion into activation sequences, and
    c) the first and second steps are carried out for each of the successive pixels.
  2. Method according to Claim 1,
    characterized in that
    in the second step, when the brightness of a plurality of successive pixels is less than the predetermined brightness threshold value, a weighted averaging of the brightness values of a plurality of successive pixels is performed.
  3. Method according to Claim 1 or 2,
    characterized in that
    the number of pixels to be checked in the first step is at least three.
  4. Device for carrying out the method according to Claim 1, comprising:
    - an input terminal (E) for receiving the signal data stream corresponding to the brightness signals,
    - a test unit (1) for checking whether the brightness of a plurality of successive pixels is less than the predetermined brightness threshold value,
    - a changeover switch (4) controlled by the test unit, which switch, on the output side, when the brightness of a plurality of successive pixels is not less than the predetermined brightness threshold value, provides the time-delayed signal data stream in unchanged form and, when the brightness of a plurality of successive pixels is less than the predetermined brightness threshold value, provides a signal data stream obtained by averaging.
EP02754952A 2001-08-04 2002-07-30 Method and device for noise reduction in a pulse-width controlled image display device Expired - Lifetime EP1412934B1 (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
DE10138353A DE10138353A1 (en) 2001-08-04 2001-08-04 Noise reduction in pulse width controlled plasma television display with averaged or delayed signal fed to display according to brightness of consecutive pixels
DE10138353 2001-08-04
PCT/EP2002/008440 WO2003015065A2 (en) 2001-08-04 2002-07-30 Method and device for noise reduction in a pulse-width controlled image display device

Publications (2)

Publication Number Publication Date
EP1412934A2 EP1412934A2 (en) 2004-04-28
EP1412934B1 true EP1412934B1 (en) 2010-11-17

Family

ID=7694418

Family Applications (1)

Application Number Title Priority Date Filing Date
EP02754952A Expired - Lifetime EP1412934B1 (en) 2001-08-04 2002-07-30 Method and device for noise reduction in a pulse-width controlled image display device

Country Status (9)

Country Link
US (1) US7224375B2 (en)
EP (1) EP1412934B1 (en)
JP (1) JP2004538522A (en)
KR (1) KR20040018274A (en)
CN (1) CN1539130A (en)
AT (1) ATE488834T1 (en)
DE (2) DE10138353A1 (en)
ES (1) ES2356716T3 (en)
WO (1) WO2003015065A2 (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1810500A1 (en) * 2004-11-10 2007-07-25 THOMSON Licensing System and method for dark noise reduction in pulse width modulated (pwm) displays
KR20210156057A (en) 2020-06-17 2021-12-24 삼성전자주식회사 Touch screen controller and touch screen driving circuit and touch screen system comprising thereof

Family Cites Families (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4573075A (en) * 1983-06-24 1986-02-25 Rca Corporation Digital signal coring apparatus with controllable coring threshold level
US4682230A (en) * 1986-03-21 1987-07-21 Rca Corporation Adaptive median filter system
JPH0435472A (en) * 1990-05-30 1992-02-06 Nec Home Electron Ltd Video display device
JPH04117874A (en) * 1990-09-07 1992-04-17 Mitsubishi Electric Corp Video signal processing unit
JP2740377B2 (en) * 1991-08-28 1998-04-15 三洋電機株式会社 Contour correction circuit
DE69321308T2 (en) * 1992-07-31 1999-03-25 Canon Kk Display control unit
JP3427271B2 (en) * 1992-10-30 2003-07-14 三菱電機株式会社 Video signal processing circuit
KR970009469B1 (en) 1993-06-05 1997-06-13 삼성전자 주식회사 Interlace/sequential scan conversion apparatus and method for facilitating double smoothing function
US6025818A (en) 1994-12-27 2000-02-15 Pioneer Electronic Corporation Method for correcting pixel data in a self-luminous display panel driving system
JP3647138B2 (en) * 1995-04-21 2005-05-11 キヤノン株式会社 Display device
JP3322809B2 (en) * 1995-10-24 2002-09-09 富士通株式会社 Display driving method and apparatus
JP3484895B2 (en) 1996-09-12 2004-01-06 株式会社富士通ゼネラル Error diffusion circuit of display device
WO1999067943A1 (en) * 1998-06-23 1999-12-29 Sharp Kabushiki Kaisha Image processor, image processing method, and medium on which image processing program is recorded
JP2001036770A (en) * 1999-07-15 2001-02-09 Nec Corp Device and method for noise reduction control

Also Published As

Publication number Publication date
ES2356716T3 (en) 2011-04-12
EP1412934A2 (en) 2004-04-28
KR20040018274A (en) 2004-03-02
WO2003015065A2 (en) 2003-02-20
ATE488834T1 (en) 2010-12-15
US7224375B2 (en) 2007-05-29
JP2004538522A (en) 2004-12-24
CN1539130A (en) 2004-10-20
DE50214774D1 (en) 2010-12-30
DE10138353A1 (en) 2002-02-28
US20040160459A1 (en) 2004-08-19
WO2003015065A3 (en) 2003-10-23

Similar Documents

Publication Publication Date Title
DE69937211T2 (en) Pixel Motion Distortion Reduction for a Pulse Number Compensation Digital Display
DE69627782T2 (en) Control method for spatial light modulator
EP0445336A1 (en) Method and device for reducing the edge flicker of a television picture
DE69434133T2 (en) Matrix-type video recorder with speed-dependent filter for increasing the high spatial frequencies and method for its operation
EP3253045B1 (en) Method for detecting and correcting image errors and image processing unit and computer programme for same
DE69838372T2 (en) Method and apparatus for scanning a plasma display panel
DE19958662B4 (en) Intensity control with a single button for use in digital test and measurement equipment
EP1368801B1 (en) Method and device for improving the grey scale resolution of a pulse width modulated image display device
EP1412934B1 (en) Method and device for noise reduction in a pulse-width controlled image display device
DE2840005C2 (en)
DE10051074C1 (en) Noise reduction method for pulse width controlled image display device provides selective modification of multi-bit word corresponding to each image point dependent on brightness comparison
DE10009858B4 (en) Method and device for improving the contrast of a pulse width-controlled image display device
DE60010063T2 (en) Method and device for video image processing to compensate for the false contour effect
DE19837307A1 (en) Pulse width modulated image display such as a plasma screen that is controlled using a number of sequential time intervals within the display period
EP1099211B1 (en) Subframe-controlled image display device
EP1241880B1 (en) Method for displaying of PAL colour television signals by means of an image display device using pulse width modulation
DE10320299B4 (en) Method and device for improving the gray value representation of a pulse-width-controlled image display device
DE10127132A1 (en) Process for the display of gamma pre distorted RGB signals for a plasma screen display
DE202016008887U1 (en) Image processing unit and computer program for the detection and correction of image errors
DE10227433B4 (en) Device for changing the contrast of a pulse-width-controlled image display device
EP1329871B1 (en) Method and apparatus for the improvement of image quality in darker areas of a digital display
DE19954029C1 (en) Display image enhancement device uses 2 alternate image enhancement modes selected in dependence on image content
DE3803835A1 (en) TRANSCODER
EP1475769A2 (en) Method and device for improving the grey scale resolution of a pulse width modulated image display device
DE3007083A1 (en) Video telephone subscriber relative position presentation - using continuous call back to match subscriber's position so that movement from camera produces weaker signals

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20031118

AK Designated contracting states

Kind code of ref document: A2

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR IE IT LI LU MC NL PT SE SK TR

RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: GRUNDIG MULTIMEDIA B.V.

17Q First examination report despatched

Effective date: 20070430

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

RIC1 Information provided on ipc code assigned before grant

Ipc: G09G 3/28 20060101AFI20100528BHEP

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: GRUNDIG MULTIMEDIA B.V.

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR IE IT LI LU MC NL PT SE SK TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

Free format text: NOT ENGLISH

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REF Corresponds to:

Ref document number: 50214774

Country of ref document: DE

Date of ref document: 20101230

Kind code of ref document: P

REG Reference to a national code

Ref country code: NL

Ref legal event code: VDEP

Effective date: 20101117

REG Reference to a national code

Ref country code: ES

Ref legal event code: FG2A

Ref document number: 2356716

Country of ref document: ES

Kind code of ref document: T3

Effective date: 20110412

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20101117

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20101117

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20101117

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20110217

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20110317

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20101117

REG Reference to a national code

Ref country code: IE

Ref legal event code: FD4D

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20110218

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20101117

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20101117

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20101117

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20101117

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20101117

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

26N No opposition filed

Effective date: 20110818

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 50214774

Country of ref document: DE

Effective date: 20110818

BERE Be: lapsed

Owner name: GRUNDIG MULTIMEDIA B.V.

Effective date: 20110731

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20110731

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20110731

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20110731

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20110731

REG Reference to a national code

Ref country code: AT

Ref legal event code: MM01

Ref document number: 488834

Country of ref document: AT

Kind code of ref document: T

Effective date: 20110730

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AT

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20110730

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20110730

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 15

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 16

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 17

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: TR

Payment date: 20210610

Year of fee payment: 20

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20210723

Year of fee payment: 20

Ref country code: IT

Payment date: 20210730

Year of fee payment: 20

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: ES

Payment date: 20210802

Year of fee payment: 20

Ref country code: GB

Payment date: 20210722

Year of fee payment: 20

Ref country code: DE

Payment date: 20210723

Year of fee payment: 20

REG Reference to a national code

Ref country code: DE

Ref legal event code: R071

Ref document number: 50214774

Country of ref document: DE

REG Reference to a national code

Ref country code: ES

Ref legal event code: FD2A

Effective date: 20220805

REG Reference to a national code

Ref country code: GB

Ref legal event code: PE20

Expiry date: 20220729

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GB

Free format text: LAPSE BECAUSE OF EXPIRATION OF PROTECTION

Effective date: 20220729

Ref country code: ES

Free format text: LAPSE BECAUSE OF EXPIRATION OF PROTECTION

Effective date: 20220731