EP2085154B1 - Verfahren, Beleuchtungseinheit und Vorrichtung zum spektralbasierten Sortieren - Google Patents

Verfahren, Beleuchtungseinheit und Vorrichtung zum spektralbasierten Sortieren Download PDF

Info

Publication number
EP2085154B1
EP2085154B1 EP20090450021 EP09450021A EP2085154B1 EP 2085154 B1 EP2085154 B1 EP 2085154B1 EP 20090450021 EP20090450021 EP 20090450021 EP 09450021 A EP09450021 A EP 09450021A EP 2085154 B1 EP2085154 B1 EP 2085154B1
Authority
EP
European Patent Office
Prior art keywords
illumination
sensor
illumination unit
wavelengths
range
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
EP20090450021
Other languages
German (de)
English (en)
French (fr)
Other versions
EP2085154A2 (de
EP2085154A3 (de
Inventor
Axel Kulcke
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Individual
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Publication of EP2085154A2 publication Critical patent/EP2085154A2/de
Publication of EP2085154A3 publication Critical patent/EP2085154A3/de
Application granted granted Critical
Publication of EP2085154B1 publication Critical patent/EP2085154B1/de
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B07—SEPARATING SOLIDS FROM SOLIDS; SORTING
    • B07C—POSTAL SORTING; SORTING INDIVIDUAL ARTICLES, OR BULK MATERIAL FIT TO BE SORTED PIECE-MEAL, e.g. BY PICKING
    • B07C5/00—Sorting according to a characteristic or feature of the articles or material being sorted, e.g. by control effected by devices which detect or measure such characteristic or feature; Sorting by manually actuated devices, e.g. switches
    • B07C5/34—Sorting according to other particular properties
    • B07C5/3416—Sorting according to other particular properties according to radiation transmissivity, e.g. for light, x-rays, particle radiation
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B07—SEPARATING SOLIDS FROM SOLIDS; SORTING
    • B07C—POSTAL SORTING; SORTING INDIVIDUAL ARTICLES, OR BULK MATERIAL FIT TO BE SORTED PIECE-MEAL, e.g. BY PICKING
    • B07C5/00—Sorting according to a characteristic or feature of the articles or material being sorted, e.g. by control effected by devices which detect or measure such characteristic or feature; Sorting by manually actuated devices, e.g. switches
    • B07C5/34—Sorting according to other particular properties
    • B07C5/342—Sorting according to other particular properties according to optical properties, e.g. colour
    • B07C5/3425—Sorting according to other particular properties according to optical properties, e.g. colour of granular material, e.g. ore particles, grain

Definitions

  • the invention relates to a method according to the preamble of claim 1.
  • the processing and sorting of bulk solids with color cameras is a common method.
  • a common embodiment is in AT410847 described.
  • EP 0734789A3 describes this technology.
  • Different camera technologies are used, in particular sequential RGB (red-green-blue) color filter line scan cameras, trilinear RGB color filter line scan cameras or even 3 chip cameras.
  • the local and temporal resolution of the systems today is at least 1000 local points and 1 kHz line rate per sensor system.
  • the EP 0 727 260 A discloses a method for sorting grains using two light sources.
  • the WO 2007/110672 A1 relates to a study of glass, wherein a bright field recording and a dark field recording are made using light sources with different wavelengths for the two recordings.
  • the object of the invention is therefore to provide a method of the type mentioned above, with which the mentioned disadvantages can be avoided, with which a reliable sorting with a low rejection can be ensured by a sorting and which can be carried out easily and inexpensively.
  • the invention further relates to a lighting unit with which the method according to the invention can be carried out particularly simply and to an apparatus for carrying out the method.
  • Fig. 1 schematically a device for the spectral-based sorting of transparent and semi-transparent bulk materials 9 is shown with one with a lighting unit 2 and a sensor 1, wherein the sensor 1 is designed to receive transmission signals.
  • the illumination unit 2 is designed for illumination with predeterminable wavelengths ⁇ , wherein illumination with these wavelengths ⁇ is temporally or locally discretely feasible.
  • the sensor 1 may be a monochrome sensor, which may be designed in particular as a camera. In particular surface cameras or line scan cameras appear advantageous.
  • the spatial and temporal resolution of the sensor 1 can be at least 1000 local points and at least 1 kHz line rate, with ever higher line rates are possible.
  • the line rate may be in the range of 4 to 20 kHz.
  • An evaluation device is connected on the input side to the sensor 1 and on the output side to a sorting device, wherein the sorting device - viewed in the direction of the material flow - is subsequently arranged on the sensor 1.
  • the bulk materials 9 are moved through in a material flow between the illumination unit 2 and the sensor 1, with the illumination unit 2, the illumination with predetermined wavelengths ⁇ temporally or locally discretely performed, recorded with the sensor 1 transmission signals , the transmission signals evaluated and sorted the bulk materials 9 according to the evaluation.
  • An advantageous embodiment of the method relates to the sorting of waste glass.
  • At least one wavelength ⁇ of the illumination in the UV range, at least one wavelength 1 in the VIS range and at least one wavelength ⁇ in the NIR range is specified.
  • foreign substances can be reliably separated out in the case of the bulk goods 9.
  • One possible application may be the sorting of plastics. The advantages listed below - with the exception of a complete color sorting - can be achieved in an analogous manner.
  • RGB cameras have no distinction between yellow and brown objects, since their spectral resolution in the spectral range is limited to two side channels, namely green and red.
  • wavelengths ⁇ are specified in the VIS range, whereby the determination of the colors is further improved can be and especially for common colors a particularly good visibility can be ensured.
  • Transmission curves ⁇ are shown with respect to the wavelength ⁇ .
  • additional wavelengths ⁇ can enable a distinction between yellow and deciduous sherds.
  • Fig. 2 the transmission curves ⁇ of two different materials are shown as continuous curves over the wavelength ⁇ . Furthermore, six vertical bars are shown, which represent possible predefinable wavelengths ⁇ . Due to the values at these predetermined wavelengths ⁇ , the two illustrated materials can be distinguished easily and reliably.
  • a UV wavelength ⁇ of 370 nm, visible wavelengths ⁇ of 460 nm, 530 nm and 630 nm and an NIR wavelength ⁇ of 940 nm are used.
  • the wavelengths ⁇ are selected from the sensitivity range of camera sensors based on CMOS or CCD, whereby they are typically limited to the range from 300 nm to 1200 nm, in particular from 350 nm to 1050 nm.
  • the spectral ranges assigned to the predeterminable wavelengths ⁇ can be spatially or temporally separated.
  • High-power LEDs that is to say LEDs greater than or approximately equal to 1 mm 2 , which are available in the spectral range from 300 nm to 1200 nm in a central wavelength graduation of approximately 20 nm, can preferably be used as the luminous means 3.
  • sensor 1 offers surface-scan camera sensors.
  • line sensor only the temporal separation appears appropriate, the monochrome lines are recorded sequentially and the monochrome signals can be superimposed line by line by interpolation.
  • CMOS-based sensors 1 are advantageous, since the read-out areas are adjustable here and the entire sensor does not have to be read out. With today's technology, for example, a CMOS sensor with 2200x 3000 pixels can be used.
  • the spectral illumination areas in the sorting system can be separated in the direction of material travel and the reception areas on the sensor 1 can be limited to these. Subsequently, a time overlay of the partial images can be made.
  • the more advantageous embodiment appears to be the temporal separation of the signals.
  • LED lighting can be flashed very fast, with individual flashes of light only taking a few microseconds.
  • sub-images of the traversing objects at different wavelengths ⁇ can be sequentially recorded at the same location. Since the exact times of the flashes of light are known, these spectral fields can be composed in time.
  • a lighting unit 2 For the construction of an advantageous embodiment of a lighting unit 2, the use of UV (370 nm or 405 nm), red (typically 630 nm), green (typically 530 nm) and blue (typically 460 nm) and NIR (typically 840 or 940 nm) LED Dies (typical AlGaInP and InGaN technology) proposed without color conversion layer.
  • An advantageous arrangement is in FIG. 4 shown.
  • the five LEDs are preferably integrated very closely together in an LED module 31.
  • chip on board technology can be applied to standard, metal core or ceramic circuit boards to further increase luminance.
  • the LED lighting units can be used single-row or multi-row lighting amplification.
  • the shards have sharp break edges in all orientations and often have no plane-parallel surfaces in the object, but lenticular ones. Furthermore, the pigments are incorporated in the volume and the surfaces are often filled with labels or soiling.
  • the lighting is designed as partial dark field lighting.
  • a partial dark field illumination is an illumination that includes both dark field illumination and bright field illumination.
  • the described arrangement which has a high proportion of indirect lighting (dark field), by the front terminating diffuser 5 but also a smaller proportion of bright field illumination.
  • the dark field illumination is realized in that the illumination units 2 are outside the viewing window 11 of the sensor 1 and the sensor 1 looks directly at a dark strip 4 in the illumination unit 2.
  • the light of the LEDs is homogenized by means of specular or diffusely highly reflecting walls 6, for example anodized aluminum sheets, and conducted to the exit plane of the lighting unit 2.
  • the diffuser 5 is mounted, which generates the bright field component of the lighting unit 2. This diffuser 5 is necessary in practice, since the area in which the objects move is very dirty and therefore an additional variable diffuse proportion is to be expected from the soils in each type of lighting.
  • the sensor 1 Due to the scattering on the diffuser 5, the sensor 1 receives a constant amount of light. Thus, the sensor 1 can also be adjusted for a long time to the light and the color.
  • the diffuser 5 can be covered with a cover 7, which is transparent over the entire spectral range, for protecting the lighting unit 2.
  • a passive cooling 9 can be realized via heat-conducting mounting materials.
  • the viewing window 11 of the sensor 1 can be aligned with a viewing area 4 of the lighting unit 2, wherein all the lighting elements 3 of the lighting unit 2 are arranged outside the viewing area 4 and wherein the bright field component of the partial dark field illumination is effected by a passive light-diffusing element 5 on the side facing the sensor 1 side of the illumination unit 2.
  • a particularly advantageous embodiment of the lighting unit 2 comprises a plurality of lighting elements 3, the viewing area 4 for interacting with the viewing window 11 of the sensor 1, wherein all lighting elements 3 are arranged outside the field of view 4, and the passive light-diffusing element 5 for forming the bright field component of Operadunkelfeldbeleuchtung.
  • the sensor 1 does not see the lighting elements 3 directly in the beam path, but a direct illumination arises only through the passive diffuser 5.
  • the light-diffusing element 5 may be formed of glass or plastic.
  • the light-diffusing element 5 is preferably surface-or volume-frosted and has only low absorption losses.
  • the space between the light-emitting elements 3 and the light-diffusing element 5 may be bounded by lateral boundaries 6, wherein the lateral boundaries 6 are formed mirror-like or diffuse highly reflective, whereby a good homogenization of the dark field illumination can be achieved. Furthermore, it can be ensured that a high proportion of the light energy reaches the sensor 1, whereby the required power of the lighting unit 2 kept as low as possible and a high efficiency can be achieved.
  • LEDs can be used, whereby a high luminance can be provided.
  • An LED based lighting system will be installed in AT004889U1 described.
  • An embodiment for increasing the light intensity is in the DE202004019684U1 described.
  • Systems with LEDs can work with standard LEDs, with the standard being the 0.3 mm die technology, beam-focusing optics and, above all, the white light generation with blue LED die and combined yellow fluorescent dye (white light LEDs).
  • the luminance can be increased by using high power LEDs (1mm LED die or larger). Due to the color conversion, this type of lighting requires General but active cooling, which is accomplished for example with water cooling.
  • monochrome light flashes are generated with the illumination unit 2, wherein sequentially light flashes are generated in all predeterminable wavelengths ⁇ .
  • a predetermined sequence of the predefinable wavelengths can be repeated in an endless loop during the implementation of the method.
  • Labels are thus illuminated indirectly. Fracture edges and lenticular shapes have a significantly increased signal intensity due to the indirect "partial dark field illumination". Therefore, paper is different from non-transparent materials (ceramics and stones). Thin porcelain, which may be somewhat white in volume and semitransparent, falls into its own color intensity range. In connection with an object evaluation, a distinction can be made in this way. Straight labels on colored glass are recognizable by the combination of white paper with the volume color pigments. Thick, dark shards of color result in very intense color signals due to the high proportion of dark field illumination.
EP20090450021 2008-01-31 2009-01-28 Verfahren, Beleuchtungseinheit und Vorrichtung zum spektralbasierten Sortieren Active EP2085154B1 (de)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
AT1482008 2008-01-31

Publications (3)

Publication Number Publication Date
EP2085154A2 EP2085154A2 (de) 2009-08-05
EP2085154A3 EP2085154A3 (de) 2009-09-09
EP2085154B1 true EP2085154B1 (de) 2012-06-06

Family

ID=40568435

Family Applications (1)

Application Number Title Priority Date Filing Date
EP20090450021 Active EP2085154B1 (de) 2008-01-31 2009-01-28 Verfahren, Beleuchtungseinheit und Vorrichtung zum spektralbasierten Sortieren

Country Status (4)

Country Link
EP (1) EP2085154B1 (es)
AT (1) AT10869U1 (es)
ES (1) ES2390845T3 (es)
HK (1) HK1137383A1 (es)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3263233A1 (en) 2016-06-28 2018-01-03 Buhler Sortex Ltd. Illumination devices
DE102017119137A1 (de) * 2017-08-22 2019-02-28 Sesotec Gmbh Verfahren zur Detektion und Aussonderung von Sonderglas aus Recyclingglas

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH07155702A (ja) * 1993-12-01 1995-06-20 Satake Eng Co Ltd 穀粒色彩選別装置
DE19511901A1 (de) 1995-03-31 1996-10-02 Commodas Gmbh Vorrichtung und Verfahren zum Sortieren von Schüttgut
US6144004A (en) * 1998-10-30 2000-11-07 Magnetic Separation Systems, Inc. Optical glass sorting machine and method
AT4889U1 (de) 2000-11-07 2001-12-27 Binder Co Ag Diodenlichtquelle für eine zeilenkamera
AT410847B (de) 2001-02-20 2003-08-25 Binder Co Ag Vorrichtung zum erfassen und erkennen von objekten
DE202004019684U1 (de) 2004-12-17 2006-02-09 Commodas Daten- Und Systemtechnik Nach Mass Gmbh Vorrichtung zur Licht-Analyse von Partikeln
AT503036B1 (de) 2005-05-25 2007-07-15 Binder Co Ag Etikettenentferner
GB0606217D0 (en) * 2006-03-29 2006-05-10 Pilkington Plc Glazing inspection

Also Published As

Publication number Publication date
EP2085154A2 (de) 2009-08-05
ES2390845T3 (es) 2012-11-19
HK1137383A1 (en) 2010-07-30
AT10869U1 (de) 2009-11-15
EP2085154A3 (de) 2009-09-09

Similar Documents

Publication Publication Date Title
EP2290355B1 (de) Vorrichtung und Verfahren zum Inspizieren etikettierter Gefäße
DE69817580T2 (de) Vorrichtung zur optischen prüfung von verpackungsfolien
AT505671B1 (de) Verfahren zum optischen detektieren von bewegten objekten
EP2089168B1 (de) Vorrichtung und verfarhen zur optischen sortierung von schüttgut
EP3107664B1 (de) Aussortieren von mineralienhaltigen objekten oder kunststoff-objekten
DE602006000559T2 (de) Optisches Verfahren und optische Vorrichtung zur Erkennung von Defekten der Oberfläche und der Struktur eines heißen, sich kontinuierlich bewegenden Produkts
EP2879919B1 (de) Detektion von regentropfen auf einer scheibe mittels einer kamera und beleuchtung
EP1288651B1 (de) Verfahren und Vorrichtung zur Ermittlung von optischen Fehlern
EP3208572B1 (de) Inspektions- und/oder bahnbeobachtungsvorrichtung, verwendung einer anordnung als hintergrundblende oder durchlichtsender in der inspektions- und/oder der bahnbeobachtungsvorrichtung und verfahren zum betreiben der inspektions- und/oder bahnbeobachtungsvorrichtung
DE102014220598A1 (de) Inspektionsvorrichtung und Verfahren zur Durchlichtinspektion von Behältern
DE102017008406A1 (de) Inspektionsvorrichtung mit Farbbeleuchtung
DE102010055523A1 (de) Vorrichtung in der Spinnereivorbereitung zum Erkennen von Fremdteilen aus Kunststoff, wie Prolypropylenbändchen, -gewebe und -folien u. dgl.
DE19955292A1 (de) Vorrichtung an einer Faserverarbeitungseinrichtung, z. B. Spinnereivorbereitungsmaschine oder -anlage, zum Erkennen und Verarbeiten von Verunreinigungen
EP1205745B1 (de) Diodenlichtquelle für eine Zeilenkamera
EP2085154B1 (de) Verfahren, Beleuchtungseinheit und Vorrichtung zum spektralbasierten Sortieren
AT508060B1 (de) Verfahren, beleuchtungseinrichtung und system zum optischen detektieren von bewegten objekten
EP2253948A1 (de) Vorrichtung zum optischen Untersuchen eines Gegenstandes
DE102017103660B4 (de) Verfahren zum betrieb einer lichtquelle für eine kamera, lichtquelle, kamera
WO2006069645A1 (de) Vorrichtung zur umgebungslicht-unabhängigen kontinuierlichen beobachtung von objekten
EP2083261A2 (de) Vorrichtung zum Erfassen und Erkennen von Objekten
WO2009018849A1 (de) Anordnung zur bildaufnahme von elementen
WO2010133393A2 (de) Optisches aufzeichnungsgerät zur aufzeichnung eines bildes
DE10046354C1 (de) Scanner und Verfahren zur Defekterkennung bei der elektronischen Bildverarbeitung
DE102004039334A1 (de) Vorrichtung zur Verbesserung der Sicht in Fahrzeugen und Fahrzeug
DE102006057182A1 (de) Multisensorieller Zeilenbildsensor

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

AK Designated contracting states

Kind code of ref document: A2

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO SE SI SK TR

AX Request for extension of the european patent

Extension state: AL BA RS

PUAL Search report despatched

Free format text: ORIGINAL CODE: 0009013

AK Designated contracting states

Kind code of ref document: A3

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO SE SI SK TR

AX Request for extension of the european patent

Extension state: AL BA RS

17P Request for examination filed

Effective date: 20100309

AKX Designation fees paid

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO SE SI SK TR

REG Reference to a national code

Ref country code: HK

Ref legal event code: DE

Ref document number: 1137383

Country of ref document: HK

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO SE SI SK TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

Free format text: NOT ENGLISH

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 560745

Country of ref document: AT

Kind code of ref document: T

Effective date: 20120615

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

Free format text: LANGUAGE OF EP DOCUMENT: GERMAN

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 502009003741

Country of ref document: DE

Effective date: 20120802

REG Reference to a national code

Ref country code: NL

Ref legal event code: VDEP

Effective date: 20120606

REG Reference to a national code

Ref country code: HK

Ref legal event code: GR

Ref document number: 1137383

Country of ref document: HK

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120606

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120606

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120606

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120606

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120906

REG Reference to a national code

Ref country code: ES

Ref legal event code: FG2A

Ref document number: 2390845

Country of ref document: ES

Kind code of ref document: T3

Effective date: 20121119

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

Effective date: 20120606

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120606

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120907

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120606

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120606

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120606

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120606

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120606

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120606

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120606

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20121006

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20121008

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120606

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120606

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120606

26N No opposition filed

Effective date: 20130307

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 502009003741

Country of ref document: DE

Effective date: 20130307

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120906

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20130131

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

REG Reference to a national code

Ref country code: IE

Ref legal event code: MM4A

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20130131

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20130131

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20130128

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120606

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120606

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20090128

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20130128

Ref country code: MK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120606

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 8

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 9

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 10

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20230123

Year of fee payment: 15

Ref country code: ES

Payment date: 20230216

Year of fee payment: 15

Ref country code: AT

Payment date: 20221128

Year of fee payment: 15

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20230124

Year of fee payment: 15

Ref country code: DE

Payment date: 20230119

Year of fee payment: 15

Ref country code: BE

Payment date: 20230123

Year of fee payment: 15

P01 Opt-out of the competence of the unified patent court (upc) registered

Effective date: 20230521

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: ES

Payment date: 20240216

Year of fee payment: 16