EP2565851A2 - Dispositif de recyclage de bouteilles consignées et procédé de classification de bouteilles consignées à l'aide de champs lumineux - Google Patents
Dispositif de recyclage de bouteilles consignées et procédé de classification de bouteilles consignées à l'aide de champs lumineux Download PDFInfo
- Publication number
- EP2565851A2 EP2565851A2 EP12182005A EP12182005A EP2565851A2 EP 2565851 A2 EP2565851 A2 EP 2565851A2 EP 12182005 A EP12182005 A EP 12182005A EP 12182005 A EP12182005 A EP 12182005A EP 2565851 A2 EP2565851 A2 EP 2565851A2
- Authority
- EP
- European Patent Office
- Prior art keywords
- empties
- light field
- control unit
- image
- unit
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 19
- 238000001514 detection method Methods 0.000 claims abstract description 16
- 238000005259 measurement Methods 0.000 claims description 11
- 238000005286 illumination Methods 0.000 claims description 9
- 235000013361 beverage Nutrition 0.000 claims description 5
- 238000003384 imaging method Methods 0.000 claims 1
- 239000011521 glass Substances 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 238000010276 construction Methods 0.000 description 2
- 230000001419 dependent effect Effects 0.000 description 2
- 238000011161 development Methods 0.000 description 1
- 230000018109 developmental process Effects 0.000 description 1
- 239000000203 mixture Substances 0.000 description 1
- 238000001454 recorded image Methods 0.000 description 1
- 230000003595 spectral effect Effects 0.000 description 1
- 230000002123 temporal effect Effects 0.000 description 1
- 238000004148 unit process Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G07—CHECKING-DEVICES
- G07F—COIN-FREED OR LIKE APPARATUS
- G07F7/00—Mechanisms actuated by objects other than coins to free or to actuate vending, hiring, coin or paper currency dispensing or refunding apparatus
- G07F7/06—Mechanisms actuated by objects other than coins to free or to actuate vending, hiring, coin or paper currency dispensing or refunding apparatus by returnable containers, i.e. reverse vending systems in which a user is rewarded for returning a container that serves as a token of value, e.g. bottles
- G07F7/0609—Mechanisms actuated by objects other than coins to free or to actuate vending, hiring, coin or paper currency dispensing or refunding apparatus by returnable containers, i.e. reverse vending systems in which a user is rewarded for returning a container that serves as a token of value, e.g. bottles by fluid containers, e.g. bottles, cups, gas containers
Definitions
- the invention relates to a device for the return of empties, in which the empties is entered into a detection area of an input tray.
- the entered empties are classified using optical methods.
- the invention relates to a method for classifying empties, in which the empties input in the input tray is classified by means of optical methods.
- the device is in particular a reverse vending machine which is used in retail outlets so that the customers can return their empties and receive the deposit raised on the empties.
- the empties are in particular containers that consist of a crate with several compartments and possibly recorded in the compartments bottles.
- the bottles accommodated in the compartments are in particular glass faults, ie returnable bottles.
- a stereo camera which comprises two cameras, with each of which an image is captured with a picture of the entered empties.
- a control unit With the help of a control unit, a three-dimensional measurement of the empties, in particular the height, width and length of the crate, the Position and / or size of the compartments of the crate and the dimensions of the arranged in the compartments bottles are determined.
- the empties are classified. In particular, it is determined here whether the empties are empties subject to a deposit and how high the deposit for the corresponding empties is. Accordingly, this pledge is credited to the customer and issued after completion of the input all empties via a receipt with the value of the credit to him.
- a problem with the use of stereo cameras to determine the dimension and thus to classify the empties is that with the help of the stereo camera often only a very inaccurate determination of the dimensions of the boxes and bottles is possible.
- edges that lie outside the focus plane of the stereo camera can only be imaged relatively blurred in the images captured by the stereo camera, so that it is difficult to determine the dimensions of these blurred body edges.
- the device comprises an image acquisition unit, with the aid of which at least one light field of the coverage area, and thus of any empties entered, is recorded.
- the control unit classifies the empties with the help of this light field.
- a light field is understood to mean a function which describes the amount of light that falls in every direction at each point of the three-dimensional space.
- the light intensity but also the direction in which the light is incident on the corresponding point of the image acquisition unit is preferably detected in the light field in each individual pixel.
- the use of a light field for classifying the empties has the advantage that the three-dimensional measurement of empties containers with the help of only one detection unit and only one light field is possible because this contains a light field more for the classification of boxes and bottles relevant information than the images of a stereo camera.
- the light field is in particular seven-dimensional, d. H.
- the light field includes the three-dimensional geometry, the two-dimensional reflections, the wavelength and the time, so that also for the classification of the empties more information is available.
- a light field it is basically possible to perform a so-called re-focusing, ie that the focus on different image planes of the light field can be subsequently changed without further pictures of the empties must be recorded.
- all necessary for the measurement of the empties edges can be focused, so that an accurate measurement of this Edges is possible.
- the light field allows a large number of different viewing angles to be detected within the emptying area given by the recording of the light field, so that the problem of detection and measurement of edge parallel to epipolar lines is bypassed or does not occur.
- the device has in particular a lighting unit for illuminating the detection area, wherein the lighting unit and the image detection unit are preferably arranged such that a dark field illumination of the empties takes place.
- a dark field illumination the empties are illuminated in such a way that only indirect light reflected by empties enters the objective of the image acquisition unit.
- This dark field illumination ensures that the mouth of bottles of empties is illuminated at a shallow angle, and thus the reflection of the mouth in the light field can be classified in a simple manner.
- the image acquisition unit comprises a plenoptic camera, so that only one camera is necessary for the acquisition of the light field.
- the plenoptic camera makes it possible to easily and inexpensively record the light field of the detection area in a short time.
- a plenoptic camera is understood in particular to mean a camera which detects a 4D light field.
- a stereo camera captures only a 2D image.
- the light field measurement is made possible by a grid of several microlenses in front of the image sensor.
- the special ability of a plenoptic camera is that the maximum depth of field is very high, no focussing process has to be awaited and the focal plane of a recorded image can be subsequently adjusted. From the image data, the depth information can be determined, so that a plenoptic camera is also suitable as a 3D camera.
- the plenoptic camera comprises a lens grid comprising a large number of lenses, which is arranged in front of the image sensor. Through this lens grid, each pixel is refracted again and expanded into a cone, which hits the sensor surface in a circle. The point at which the light beam strikes the sensor surface reveals which direction the light beam originally came from. A vertically incident light beam ends up, for example, in the center of the circle, an obliquely arriving further on the edge.
- the sharpness can be subsequently re-determined, in particular calculated, and, as in the case of a "correct" lens, the focus can be changed.
- a database is stored in the control unit in which different empties classes are assigned characteristic features, wherein the control unit determines at least one characteristic feature in the light field and classifies the empties as a function of this determined characteristic feature.
- the features are, in particular, dimensions of the empties, wherein at least one image processing algorithm is stored in the control unit, which the control unit processes to determine at least one dimension of the empties from the light field.
- the empties are in particular and empties containers, which consist of a crate and possibly recorded therein surfaces.
- the dimensions of the crate, the number and / or position of the compartments of the box, the height of the bottles and / or at least the radius of the bottles are determined as characteristic features.
- the control unit carries out in particular a three-dimensional measurement of the empties with the aid of the light field. This ensures that an accurate, reliable classification of the empties is possible and thus a false classification and thus the payment of a false deposit amount are avoided.
- the image capture unit takes only one light field from each empties entered, so that the Classification of the empties with a small effort is possible. Due to the large number of information contained in the only one light field, it is not necessary to detect multiple light fields.
- the control unit classifies the empties in particular as a function of the information contained in the light field about the three-dimensional geometry of the empties, the information contained in the light field about the occurring two-dimensional reflections, the information contained in the light field about the wavelengths, d. H. the spectral composition of the light, and / or the information contained in the light field over time, d. H. about the temporal change of the incident light.
- a particularly accurate classification of empties is possible.
- the classification is understood in particular to mean that the entered empties are divided into the different empties classes via the control unit.
- the empties classes can be designed such that each empties class corresponds to a preset deposit amount.
- the empties classes can be preset in such a way, since a separate empties class is preset for each type of crate used and / or for each type of bottle used.
- the empties entered are classified insofar as they are a returnable or non-refundable empties or foreign bodies. The subject to empties is from the device in particular withdrawn, whereas the non-refundable empties and / or the foreign body are returned to the operator of the device.
- the device comprises, in particular, a receipt printer, by means of which, after the empties have been entered and their classification assigned to the operator, a receipt can be issued with the deposit amount due to him.
- Another aspect of the invention relates to a method for classifying empties, in which the empties are entered into an input tray and at least one light field of the empties is determined. The empties are classified depending on the light field. The light field is also recorded in this case, preferably via a plenoptic camera.
- the classified empties is illuminated in particular with the aid of a dark field illumination, so that the edges of bottles, in particular their mouths, can be reliably detected and thus the dimension of the bottle can be easily determined.
- the method specified by the independent method claim may be further developed by means of the features described in the claims dependent on the independent apparatus claim or their corresponding method features.
- FIGS. 1 to 3 in each case a schematic representation of a device 10, 12, 14 for the return of empties 16 is shown, wherein FIG. 1 a top view of a first embodiment, FIG. 2 a side view of a second embodiment and FIG. 3 a side view of a third embodiment shows.
- the embodiments differ only in the arrangement of a plenoptic camera 18 for receiving light fields, which is why the general structure is described below for all three embodiments together.
- the device 10, 12, 14, which is also referred to as reverse vending machine, has input tray 20, in which the empties 16 by an operator of the device 10, 12, 14 can be entered.
- the empties 16 are, in particular, empties containers which consist of a crate 22 and a plurality of bottles 24 received in compartments of this crate 22. In the in the FIGS. 1 to 3 shown embodiment, six bottles 24 are arranged in the beverage box 22. Alternatively, empties 16 and empty crates 22, ie beverage crates 22, in which no bottles 24 are included, are entered. It is also possible that the empties 16 beverage boxes 22 with more than six bottles 24 or less than six bottles 24 can be entered.
- the bottles 24 are, in particular, glass bottles, that is to say reusable counterfeits. Alternatively, it can also be disposable PET bottles or plastic returnable bottles 24.
- the device 10, 12, 14 comprises a lighting unit 26, wherein the lighting unit 26 and the plenoptic camera 18 are arranged such that a dark field illumination of the empties 16 takes place.
- a dark field illumination is understood in particular that no direct lighting follows, but that only stray light from the empties 16 enters the lens of the plenoptic camera 18, which has the advantage that reflections 28 are better detectable at the bottle mouths 30 of the bottle 24.
- a light field of a detection area of the plenoptic camera 18, in which the empties 16 are arranged, and thus also of the empties 16 itself is recorded.
- the general structure of the plenoptic camera 18 will be described below in connection with FIG. 4 described in more detail.
- any other image capture unit capable of receiving light fields may also be used.
- the device 10, 12, 14 has a control unit 40 which processes at least one image processing algorithm stored in it in order to determine dimensions of the empties 16 from the recorded light field of the empties 16 and to classify the empties 16 as a function of these determined dimensions.
- a control unit 40 which processes at least one image processing algorithm stored in it in order to determine dimensions of the empties 16 from the recorded light field of the empties 16 and to classify the empties 16 as a function of these determined dimensions.
- the edges of the crate 22 the number and / or position of the compartments of the crate 22 and / or the dimensions of the bottles 24 determined by means of the light field or from the light field.
- the control unit 40 determines whether the entered object 16 is actually empties 16 and whether this empties 16 is subject to a deposit. In particular, the control unit 40 determines what type of empties 16 it is and how high the deposit amount provided for this empties 16 is.
- a light field is understood to mean a function that describes the amount of light that is incident at every point of the three-dimensional space in all directions.
- a four-dimensional light field using the plenoptic camera 18 not only the gray value of each pixel but also the direction of the incident light beam is determined.
- the empties 16 can be viewed in a predetermined by the pleniform camera 18 areas from different angles with the help of only one recorded light field. This has the consequence that a precise measurement of the empties 16 is possible.
- edges that run parallel to the epipolar lines can also be accurate be measured, as appropriate viewing angles can be taken.
- the plenoptic camera 18 has the advantage that only a single camera is necessary, with the help of which only exactly one light field of each empties 16 must be recorded. Thus, a simple inexpensive construction is achieved and a calibration effort, as is necessary in a stereo camera, is avoided.
- the plenoptic camera 18 takes the light field of the empties 16 directly, whereas in the third embodiment according to FIG. 3 a mirror 50 is provided which mirrors empties 16 and on which the plenoptic camera 18 is directed. As a result, a particularly compact construction is achieved.
- FIG. 4 a schematic representation of a plenoptic camera 18 and a bottle 24 is shown.
- the plenoptic camera 18 includes a main lens 42, by means of which a virtual image 44 of the bottle 24 is generated.
- a lens array 48 is arranged from microlenses, one of which with the Reference numeral 50 is designated. These microlenses 50 "view" the virtual image 44 and image it on the image capture sensor 46. Due to the microlenses 50 of the lens array 48, each pixel of the virtual image 44 is refracted again and expanded into a cone which strikes the image acquisition sensor 46 in a circle. The position in which the light beam is incident within the corresponding cone of the respective microlens 50 on the image detection sensor 46, the direction of the incident light beam can be determined.
- plenoptic camera 18 instead of a 4D light field, it is also possible to determine a 7D light field which contains further information about the recorded empties 16.
- the seven dimensions are in particular the three-dimensional geometry, the two-dimensional reflections, the wavelength and the time.
- FIGS. 5 and 6 a light field of a crate 22 is shown, wherein in both figures, the same light field is shown.
- the focal plane which is also referred to as sharpness level, in the region of the front side of the crate 22, at FIG. 6 in contrast, set in the area of the rear side of the crate 22, so in FIG. 5 the front and in FIG. 6 the rear side is sharp and the corresponding edges are determined and measured reliably and precisely by the processing of the corresponding image processing algorithms can be.
- a corresponding change of the focal plane is also referred to as re-focusing.
- the sharp edges are each represented by a single line, the blurred edges by double lines.
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Investigating Or Analysing Materials By Optical Means (AREA)
- Length Measuring Devices By Optical Means (AREA)
- Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
DE201110053179 DE102011053179A1 (de) | 2011-09-01 | 2011-09-01 | Vorrichtung zur Rücknahme von Leergut und Verfahren zum Klassifizieren von Leergut mit Hilfe von Lichtfeldern |
Publications (3)
Publication Number | Publication Date |
---|---|
EP2565851A2 true EP2565851A2 (fr) | 2013-03-06 |
EP2565851A3 EP2565851A3 (fr) | 2013-03-27 |
EP2565851B1 EP2565851B1 (fr) | 2015-07-01 |
Family
ID=46969998
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP12182005.4A Active EP2565851B1 (fr) | 2011-09-01 | 2012-08-28 | Dispositif de recyclage de bouteilles consignées et procédé de classification de bouteilles consignées à l'aide de champs lumineux |
Country Status (4)
Country | Link |
---|---|
EP (1) | EP2565851B1 (fr) |
DE (1) | DE102011053179A1 (fr) |
DK (1) | DK2565851T3 (fr) |
ES (1) | ES2546990T3 (fr) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP3040708A4 (fr) * | 2013-08-30 | 2016-08-31 | Fujifilm Corp | Dispositif et procédé de mesure de caractéristiques optiques |
EP3866128A1 (fr) * | 2020-02-14 | 2021-08-18 | Sielaff Gmbh & Co. Kg Automatenbau | Système de détection et procédé de détection des objets pour ou dans un distributeur automatique d'acceptation |
Family Cites Families (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
FI73329B (fi) * | 1984-08-29 | 1987-05-29 | Halton Oy | Anordning foer identifiering och registrering av flaskor och/eller flaskkorgar. |
GB2288016B (en) * | 1994-03-31 | 1998-05-13 | Tomra Systems As | Device for generating,detecting and recognizing a contour image of a liquid container |
DE19906773A1 (de) * | 1999-02-17 | 2000-08-24 | Prokent Ag | Einrichtung zur dreidimensionalen Vermessung in Leergutlogistiksystemen |
DE20006318U1 (de) * | 2000-04-06 | 2000-10-26 | Stiefel Gmbh | Vorrichtung zur zumindest teilweisen Erfassung der Umrißkonktur eines Gegenstands |
DE10359781B4 (de) * | 2003-12-19 | 2006-01-05 | Krones Ag | Vorrichtung zur Inspektion von Leergut-Gebinden |
HUE044105T2 (hu) * | 2005-01-25 | 2019-09-30 | Tomra Systems Asa | Eszköz göngyöleg visszavételére szolgáló automatához (RVM), visszaváltható göngyölegek vagy tárgyak befogadására, tárolására és kezelésére |
DE102005007492A1 (de) * | 2005-02-17 | 2006-08-31 | Hecht, Siegmar, Dr.-Ing. | Anordnung zur dreidimensionalen Vermessung von Leergut in Leergutautomaten |
DE102008025658A1 (de) * | 2008-05-28 | 2009-12-03 | Wincor Nixdorf International Gmbh | Optische Erfassung und Klassifizierung von gegenständlichen Leergut-Objekten in einem Leergut-Rückgabesystem |
DE102008026180A1 (de) * | 2008-05-30 | 2009-12-03 | Wincor Nixdorf International Gmbh | Logoerkennung von Leergutgebinden |
US7949252B1 (en) * | 2008-12-11 | 2011-05-24 | Adobe Systems Incorporated | Plenoptic camera with large depth of field |
DE102009000834A1 (de) * | 2009-02-13 | 2010-09-16 | Sielaff Gmbh & Co. Kg Automatenbau | Bilderfassungsvorrichtung und Verwendung derselben |
-
2011
- 2011-09-01 DE DE201110053179 patent/DE102011053179A1/de not_active Withdrawn
-
2012
- 2012-08-28 ES ES12182005.4T patent/ES2546990T3/es active Active
- 2012-08-28 DK DK12182005.4T patent/DK2565851T3/en active
- 2012-08-28 EP EP12182005.4A patent/EP2565851B1/fr active Active
Non-Patent Citations (1)
Title |
---|
None |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP3040708A4 (fr) * | 2013-08-30 | 2016-08-31 | Fujifilm Corp | Dispositif et procédé de mesure de caractéristiques optiques |
EP3866128A1 (fr) * | 2020-02-14 | 2021-08-18 | Sielaff Gmbh & Co. Kg Automatenbau | Système de détection et procédé de détection des objets pour ou dans un distributeur automatique d'acceptation |
Also Published As
Publication number | Publication date |
---|---|
DK2565851T3 (en) | 2015-09-21 |
EP2565851A3 (fr) | 2013-03-27 |
EP2565851B1 (fr) | 2015-07-01 |
DE102011053179A1 (de) | 2013-03-07 |
ES2546990T3 (es) | 2015-09-30 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP3491331B1 (fr) | Procédé et dispositif pour l'examen optique de corps transparents | |
DE102018105301B4 (de) | Kamera und Verfahren zur Erfassung von Bilddaten | |
EP1645839B1 (fr) | Dispositif et procédé pour surveiller des objets en motion | |
EP3489735B1 (fr) | Procédé et système de microscopie à feuille de lumière | |
DE3926349C2 (fr) | ||
DE102006053788A1 (de) | Verfahren zur Erkennung von Verschmutzungen im Bereich von Farbübergängen auf Wertdokumenten und Mittel zur Durchführung des Verfahrens | |
EP3353537B1 (fr) | Procédé et dispositif d'examen pour l'examen optique par transparence de récipients non étiquetés | |
DE202006020599U1 (de) | Optische Erfassung von bewegten Objekten und Vorrichtung | |
DE102016011497A1 (de) | Optische Untersuchungseinrichtung und optisches Untersuchungsverfahren mit sichtbarem und infrarotem Licht für Halbleiterbauteile | |
EP2795589A1 (fr) | Procédé et dispositif de contrôle d'un élément de sécurité d'un document de valeur | |
EP0708325A1 (fr) | Méthode et dispositif d'inspection d'objets notamment de bouteilles | |
EP2565851B1 (fr) | Dispositif de recyclage de bouteilles consignées et procédé de classification de bouteilles consignées à l'aide de champs lumineux | |
EP3281184B1 (fr) | Procédé et dispositif de détermination de l'état de remplissage de tubes de pièces de monnaie | |
WO2015052010A1 (fr) | Dispositif et procédé de mesurage de vitres, en particulier de pare-brises de véhicules | |
WO2015052011A1 (fr) | Dispositif et procédé pour mesurer des vitres, en particulier des pare-brises de véhicules | |
WO2020207795A1 (fr) | Microscope à feuille de lumière et procédé de détermination de l'indice de réfraction d'objets dans la chambre à échantillons | |
EP3267367B1 (fr) | Dispositif de disque de comptage | |
EP1805478A1 (fr) | Dispositif de mesure tridimensionnelle d'objets | |
EP3055840A1 (fr) | Système et procédé de traitement de documents de valeur | |
DE102010055427A1 (de) | Verfahren und Vorrichtung zur Untersuchung des optischen Zustandes von Wertdokumenten | |
EP3866128A1 (fr) | Système de détection et procédé de détection des objets pour ou dans un distributeur automatique d'acceptation | |
DE102005051028A1 (de) | Einrichtung zur dreidimensionalen Vermessung von Objekten | |
DE102011102777B4 (de) | Verfahren zur Aufnahme von Bildern von Gegenständen | |
DE102010036762B4 (de) | Verfahren und Vorrichtung zur Formerkennung von Leergutgebinden in Leergutrücknahmeautomaten mittels eines Lichtschnitt Triangulationsverfahren | |
DE20317095U1 (de) | Vorrichtung zur Erkennung von Oberflächenfehlern |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAL | Search report despatched |
Free format text: ORIGINAL CODE: 0009013 |
|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
AK | Designated contracting states |
Kind code of ref document: A2 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
AX | Request for extension of the european patent |
Extension state: BA ME |
|
AK | Designated contracting states |
Kind code of ref document: A3 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
AX | Request for extension of the european patent |
Extension state: BA ME |
|
RIC1 | Information provided on ipc code assigned before grant |
Ipc: G07F 7/06 20060101AFI20130215BHEP |
|
17P | Request for examination filed |
Effective date: 20130802 |
|
RBV | Designated contracting states (corrected) |
Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
17Q | First examination report despatched |
Effective date: 20130918 |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
INTG | Intention to grant announced |
Effective date: 20150227 |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D Free format text: NOT ENGLISH |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: REF Ref document number: 734366 Country of ref document: AT Kind code of ref document: T Effective date: 20150715 Ref country code: CH Ref legal event code: EP |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D Free format text: LANGUAGE OF EP DOCUMENT: GERMAN |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 502012003588 Country of ref document: DE |
|
REG | Reference to a national code |
Ref country code: DK Ref legal event code: T3 Effective date: 20150915 |
|
REG | Reference to a national code |
Ref country code: ES Ref legal event code: FG2A Ref document number: 2546990 Country of ref document: ES Kind code of ref document: T3 Effective date: 20150930 |
|
REG | Reference to a national code |
Ref country code: SE Ref legal event code: TRGR |
|
REG | Reference to a national code |
Ref country code: NL Ref legal event code: FP |
|
REG | Reference to a national code |
Ref country code: NO Ref legal event code: T2 Effective date: 20150701 |
|
REG | Reference to a national code |
Ref country code: LT Ref legal event code: MG4D |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20151002 Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150701 Ref country code: LV Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150701 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: HR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150701 Ref country code: RS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150701 Ref country code: PL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150701 Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20151102 Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20151101 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MC Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150701 |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: PL |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 502012003588 Country of ref document: DE |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CH Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20150831 Ref country code: EE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150701 Ref country code: IT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150701 Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150701 Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150701 Ref country code: LI Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20150831 |
|
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: RO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150701 |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: MM4A |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: ST Effective date: 20160429 |
|
26N | No opposition filed |
Effective date: 20160404 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20150828 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: FR Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20150901 Ref country code: SI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150701 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150701 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SM Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150701 Ref country code: BG Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150701 Ref country code: HU Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO Effective date: 20120828 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CY Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150701 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: BE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20150831 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: TR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150701 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LU Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20150828 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150701 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: AL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150701 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: NL Payment date: 20190726 Year of fee payment: 8 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: DK Payment date: 20190726 Year of fee payment: 8 Ref country code: ES Payment date: 20190902 Year of fee payment: 8 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: AT Payment date: 20190724 Year of fee payment: 8 |
|
REG | Reference to a national code |
Ref country code: DK Ref legal event code: EBP Effective date: 20200831 |
|
REG | Reference to a national code |
Ref country code: NL Ref legal event code: MM Effective date: 20200901 |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: MM01 Ref document number: 734366 Country of ref document: AT Kind code of ref document: T Effective date: 20200828 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: AT Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20200828 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: DK Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20200831 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: NL Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20200901 |
|
REG | Reference to a national code |
Ref country code: ES Ref legal event code: FD2A Effective date: 20220110 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: ES Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20200829 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: SE Payment date: 20220824 Year of fee payment: 11 Ref country code: NO Payment date: 20220822 Year of fee payment: 11 Ref country code: GB Payment date: 20220824 Year of fee payment: 11 Ref country code: FI Payment date: 20220818 Year of fee payment: 11 Ref country code: DE Payment date: 20220624 Year of fee payment: 11 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R119 Ref document number: 502012003588 Country of ref document: DE |
|
GBPC | Gb: european patent ceased through non-payment of renewal fee |
Effective date: 20230828 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: FI Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20230828 |