EP2816536A1 - Automate de reprise pour bouteilles consignées - Google Patents

Automate de reprise pour bouteilles consignées Download PDF

Info

Publication number
EP2816536A1
EP2816536A1 EP13172507.9A EP13172507A EP2816536A1 EP 2816536 A1 EP2816536 A1 EP 2816536A1 EP 13172507 A EP13172507 A EP 13172507A EP 2816536 A1 EP2816536 A1 EP 2816536A1
Authority
EP
European Patent Office
Prior art keywords
recognition unit
gesture recognition
user
detection area
vending machine
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
EP13172507.9A
Other languages
German (de)
English (en)
Other versions
EP2816536B1 (fr
Inventor
Roy Gergs
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Wincor Nixdorf International GmbH
Original Assignee
Wincor Nixdorf International GmbH
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Wincor Nixdorf International GmbH filed Critical Wincor Nixdorf International GmbH
Priority to EP13172507.9A priority Critical patent/EP2816536B1/fr
Priority to DK13172507.9T priority patent/DK2816536T3/en
Publication of EP2816536A1 publication Critical patent/EP2816536A1/fr
Application granted granted Critical
Publication of EP2816536B1 publication Critical patent/EP2816536B1/fr
Not-in-force legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G07—CHECKING-DEVICES
    • G07F—COIN-FREED OR LIKE APPARATUS
    • G07F7/00—Mechanisms actuated by objects other than coins to free or to actuate vending, hiring, coin or paper currency dispensing or refunding apparatus
    • G07F7/06—Mechanisms actuated by objects other than coins to free or to actuate vending, hiring, coin or paper currency dispensing or refunding apparatus by returnable containers, i.e. reverse vending systems in which a user is rewarded for returning a container that serves as a token of value, e.g. bottles
    • G07F7/0609—Mechanisms actuated by objects other than coins to free or to actuate vending, hiring, coin or paper currency dispensing or refunding apparatus by returnable containers, i.e. reverse vending systems in which a user is rewarded for returning a container that serves as a token of value, e.g. bottles by fluid containers, e.g. bottles, cups, gas containers

Definitions

  • the invention relates to a reverse vending machine according to the preamble of claim 1.
  • Such a reverse vending machine comprises a processing device for accepting or issuing an empties object or for issuing a receipt.
  • returnable bottles or deposit funds can be returned with a user inserts a deposit bottle or empties box in a configured receiving device of the reverse vending machine or pushes and in return receives the deposit value of the returned empties amount paid or a receipt (Pledge) on the deposit value for payment to a cashier receives.
  • a deposit bottle or empties box in a configured receiving device of the reverse vending machine or pushes and in return receives the deposit value of the returned empties amount paid or a receipt (Pledge) on the deposit value for payment to a cashier receives.
  • an acceptance device is activated when a user inserts or inserts an emptied object into the acceptance device.
  • a conveyor of the acceptance device is set in motion, which is the emptied object a detection unit and then forwarded for storage or compaction (for disposable plastic bottles).
  • compaction for disposable plastic bottles.
  • a user After a return of empties objects, a user must also use a suitable input device, such as a button to pay the deposit or to receive a receipt. This requires, on the one hand, the provision of such an input device at the reverse vending machine and, on the other hand, an additional operating step for the user when returning empties objects.
  • a suitable input device such as a button to pay the deposit or to receive a receipt.
  • a switch-on device for turning on a detection unit is provided.
  • the switch-on device can be formed, for example, by a light barrier, a light scanner or a sensor which detects an approach of a reusable container to be returned and as a result switches on a detection unit.
  • Object of the present invention is to provide a reverse vending machine and a method for operating a reverse vending machines available that allow the simplest possible, comfortable for a user operation for returning an emptied object.
  • a gesture recognition unit is additionally provided, which is designed to recognize an operating gesture of a user located in a detection area of the gesture recognition unit and to convert it into a control command for controlling the processing facility.
  • the present invention is based on the idea to use a gesture recognition unit for controlling a reverse vending machine.
  • the gesture recognition unit is designed to recognize at least one operating gesture of a user.
  • the operating gesture may be in a movement of the user (For example, the movement of an arm to approach an empties object to an acceptance device), in a viewing direction of the user, a facial expression of the user, a posture of the user or the like, possibly in combination with an audible utterance of the user exist.
  • the gesture recognition unit detects such a gesture and evaluates it to generate a control command in response to an operator gesture, which is then used to control the processing unit, for example, an acceptance device for accepting an empties object or an output device for issuing money or for issuing a document , Depending on the control command then, for example, an acceptance device can be activated or stopped again, it can be the output of a pledge equivalent money or a receipt, or it can be issued to a user, for example, to correctly enter an empties object or for further operation ,
  • the gesture recognition unit is in this case designed to recognize an operator gesture within a detection range of the gesture recognition unit. If a user is at least partially within the detection area, an operating gesture of the user can be evaluated and converted into a suitable control command.
  • the detection area is in this case advantageously preceded by a housing of the reverse vending machine and detects an area in which a user usually resides in order to supply an emptied object to an acceptance device of the reverse vending machine or to perform another operating action on the reverse vending machine.
  • a spatial area with a radius of up to four meters, preferably up to two meters in front of the reverse vending machine are detected, wherein the gesture recognition unit detects a room and thus recognizes operating gestures of a user in a three-dimensional manner.
  • the sensor device is generally designed to detect an operating gesture in a three-dimensional space.
  • the sensor device can in this case, for example, as in the US 2008/0240502 A1 , the US 7,433,024 B2 , the US 2009/0185274 A1 , the US 2010/0020078 A1 whose content is to be fully included in the present case.
  • the projection device of the sensor device can be designed, for example, to generate an infrared projection image.
  • the projection device serves to project a projection image into the detection space in the manner of a predetermined pattern in order to capture reflections of the projected projection image by means of the recording device and to generate a depth image on the basis of the projected projection image acquired in this way, the precise information about the distance of an object to the sensor device contains.
  • the depth image is hereby generated by evaluating distortions of the projected projection image due to reflections on an object located in the detection area.
  • the projection device in this case projects a predetermined pattern into the space of the detection area, for example a dot or bar pattern, which is reflected on objects within the detection area.
  • the projected projection image is picked up by the pickup device, and depth information is calculated from the deviation between the reflected and the known predetermined patterns of the projected image projected by the projection device.
  • the projection device and likewise the recording device operate in the infrared wavelength range, the calculation of the depth information is insensitive to daylight.
  • the recording device may, for example, have a frame rate of 30 fps for recording moving pictures and a resolution in the full HD range (1920 ⁇ 1080 pixels) or lower (for example 1280 ⁇ 1024 pixels).
  • the camera is preferably designed as a color camera (RGB camera).
  • the camera thus serves to record a color image, wherein the camera, for example, a frame rate of 30 fps and a resolution in the Full HD range (1920 x 1080 pixels) or even lower (for example, 1280 x 1,024 pixels) may have.
  • the sensor device comprises at least two spaced-apart microphones for the spatial detection of an acoustic signal.
  • two or more microphones can thus be spatially recorded an acoustic signal, so that a spatial localization of the acoustic source can be made.
  • the sensor device with its individual sensors can be fixedly arranged on a housing of the reverse vending machine. It is also conceivable that the sensor device can be adjusted by motor relative to the housing, for example, by being able to be inclined about a horizontal pivot axis by a predetermined angular range. This allows the adjustment of the detection range, for example, depending on the presence and the behavior of a user, for example, depending on the height of a user or its approach to the reverse vending machine, the adjustment can be done automatically as a result of detected by the sensor sensor sensor signals.
  • the gesture recognition unit can be designed, for example, to recognize within the detection area a user gesture, for example the approach of an empties object to an acceptance device or the termination of a throw-in process or the like, in order to control the empties return device as a function of a recognized operating gesture.
  • a user gesture for example the approach of an empties object to an acceptance device or the termination of a throw-in process or the like
  • the gesture recognition unit can thus be recognized, for example, whether it is an emptied object in an approximated or thrown empties object that can be accepted and processed at the reverse vending machine.
  • an emptied object can then be rejected or accepted early.
  • the provision of a separate detection unit on an acceptance device of the reverse vending machine can thus be dispensed with.
  • the object is further achieved by a method for operating a reverse vending machine.
  • the reverse vending machine has a processing device for receiving or outputting an empties object or for outputting a receipt. It is provided that a gesture recognition unit detects an operating gesture of a user located in a detection area of the gesture recognition unit and converts it into a control command for controlling the processing device.
  • Fig. 1 shows in a schematic view of a reverse vending machine 1, for returning an empties object F in the form of a reusable or disposable bottle (see Fig. 3 ) is configured by a user N or to return an empties box.
  • the reverse vending machine 1 has an acceptance device 10 in the form of an acceptance shaft for insertion or insertion of an emptied object F in the form of a bottle and an acceptance device 11 for setting an empties box.
  • an acceptance device 10 in the form of an acceptance shaft for insertion or insertion of an emptied object F in the form of a bottle and an acceptance device 11 for setting an empties box.
  • a detection unit for detecting the empties object F is fed and then be transported by means of a suitable conveyor to a deposit or a Kompakt michsaku (in disposable plastic bottles).
  • the reverse vending machine 1 is used in a conventional manner for the acceptance of empties objects and pays a user N in return via an output device 12 a deposit in cash or a receipt (pledge), by means of which the user N at a checkout pay off the deposit can let.
  • the in Fig. 1 illustrated reverse vending machine 1 has a gesture recognition unit 2 for detecting a user gesture N in a detection area E (see Fig. 3 ) on.
  • the gesture recognition unit 2 is configured to recognize an operation gesture such as a movement of the user N, a posture of the user N, a line of sight of the user N or the like, and to convert them into a control command based on which the acceptance devices 10, 11 or the output device 12 (the processing facilities of the reverse vending machine 1 realize) can be controlled.
  • gesture recognition units are known today, for example, from mobile phones or video game consoles.
  • the gesture recognition unit 2 of the reverse vending machine 1 can recognize that a user N directs his gaze to a specific receiving device 10, 11, turns to an acceptance device 10, 11 or approaches an emptied object F to an acceptance device 10, 11.
  • the gesture recognition unit 2 may generate a control command that activates one or more acceptance devices 10, 11 or the output device 12 and thus prepares for the acceptance of an empties object F or causes the issuance of a deposit or a deposit slip.
  • the operation of the reverse vending machine 1 by a user N becomes simple and intuitive.
  • the user N does not have to press any keys or operate any other input devices.
  • the reverse vending machine 1 is automatically controlled without requiring any special, conscious interaction of the user F with other input devices.
  • FIG Fig. 2 An embodiment of a gesture recognition unit 2 is shown schematically in FIG Fig. 2 shown.
  • the gesture recognition unit 2 has, for example, two microphones 20, 21, which are arranged at a distance from one another and serve to receive a three-dimensional sound field.
  • the gesture recognition unit 2 further has a projection device 22 for projecting an infrared projection image into the detection area E.
  • Such an infrared projection image P as shown schematically in FIG Fig. 4 may, for example, take the form of a predetermined pattern, for example a dot or dash pattern. Reflections of the projection image P at a user N or another object in the detection area E, which is upstream of the reverse vending machine 1 (see Fig. 3 ), are recorded by means of a recording device 23, which is designed in the manner of an infrared camera, for example, with a frame rate of, for example, 30 fps (fps: frames per second).
  • depth information can be calculated in the manner of a depth image, so that in a spatially highly resolved manner pinpoint the distance of a user N and determine its body regions and limbs from the gesture recognition unit 2.
  • the gesture recognition unit 2 further has a camera 24 in the form of a color camera (RGB camera) for recording color images with a frame rate of, for example, 30 fps.
  • the camera 24 is thus designed to record images in the visible light range, so that 24 color and brightness information can be obtained and evaluated via the camera.
  • the microphones 20, 21, the projection device 22, the recording device 23 and the camera 24 together realize a sensor device of the gesture recognition unit 2 for detecting sensor signals.
  • the sensor signals that is to say the signals of the microphones 20, 21, the recording device 23 and the camera 24, are supplied to a control device 27, for example in the form of a chip, and are evaluated by the control device 27 for generating one or more suitable control commands.
  • the control device 27 can then, for example the acceptance devices 10, 11 or the output device 12 are driven to perform a predetermined action.
  • the control device 27 may be connected to a memory 28.
  • predetermined operating gesture patterns may be stored on the memory 28 in the manner of a database, so that a detection can be carried out in dependence on a comparison of a recorded operating gesture with a previously stored operating gesture pattern, by means of which a control command can then be generated.
  • the controller 27 also acts together with arranged on a housing 13 of the reverse vending machine 1 speakers 25, 26 and a screen 29.
  • the speakers 25, 26, for example, an acoustic output to guide a user N to operate the empties return vending machine 1, warnings generate or other acoustic feedback, such as a warning sound or the like, output.
  • About the screen 29 operating instructions can be issued in a comparable manner, or it can be played advertising or the like.
  • the sensor device 20-24 of the gesture recognition unit 2 is used to perform a gesture recognition within a detection range E, which is a housing 13 of the reverse vending machine 1 upstream.
  • a gesture recognition can be performed here, for example, within a range with a radius of up to four meters, for example up to two meters to the gesture recognition unit 2, so that only gestures of a user N, which is close to a reverse vending machine 1, detected and recognized.
  • the detection area E extends spatially in three dimensions and may, for example, have the shape of a detection funnel.
  • the sensor device 20-24 can be arranged with its individual sensors (microphones 20, 21, projection device 22, receiving device 23, camera 24) or adjustable in total on the housing 13 of the reverse vending machine 1.
  • the adjustability may be such that the sensor device 20-24 as a whole or individual ones of the sensors 20-24 are separated from one another about a horizontal pivot axis S (see FIG Fig. 3 ) can be pivoted, so that the detection range E in height, for example, depending on the height of a user N can be automatically adjusted.
  • gesture recognition unit basically completely different operating gestures of a user can be recognized and evaluated, so that operation of a reverse vending machine can proceed completely without (conscious) user interaction.
  • a reverse vending machine can be activated as a whole as soon as a user enters a detection area.
  • An acceptance device can be activated when the user carries out a movement of an empties object in the direction of the acceptance device. And if the user then directs his gaze, for example, towards an issuing device, an issue of the deposit or a pledge slip can be made without the user having to operate an input device of any kind, such as a button or a button.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Control Of Vending Devices And Auxiliary Devices For Vending Devices (AREA)
  • User Interface Of Digital Computer (AREA)
EP13172507.9A 2013-06-18 2013-06-18 Automate de reprise pour bouteilles consignées Not-in-force EP2816536B1 (fr)

Priority Applications (2)

Application Number Priority Date Filing Date Title
EP13172507.9A EP2816536B1 (fr) 2013-06-18 2013-06-18 Automate de reprise pour bouteilles consignées
DK13172507.9T DK2816536T3 (en) 2013-06-18 2013-06-18 Returnable Packaging Machine

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
EP13172507.9A EP2816536B1 (fr) 2013-06-18 2013-06-18 Automate de reprise pour bouteilles consignées

Publications (2)

Publication Number Publication Date
EP2816536A1 true EP2816536A1 (fr) 2014-12-24
EP2816536B1 EP2816536B1 (fr) 2016-05-18

Family

ID=48625948

Family Applications (1)

Application Number Title Priority Date Filing Date
EP13172507.9A Not-in-force EP2816536B1 (fr) 2013-06-18 2013-06-18 Automate de reprise pour bouteilles consignées

Country Status (2)

Country Link
EP (1) EP2816536B1 (fr)
DK (1) DK2816536T3 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102015110758A1 (de) * 2015-07-03 2017-01-05 Mathias Jatzlauk Visualisierungssystem mit Gestensteuerung

Citations (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE29812678U1 (de) 1998-07-16 1998-10-29 Kiesel, Alfred, 47259 Duisburg Rücknahmestation für Mehrwegbehälter
US20070086764A1 (en) * 2005-10-17 2007-04-19 Konicek Jeffrey C User-friendlier interfaces for a camera
US20080240502A1 (en) 2007-04-02 2008-10-02 Barak Freedman Depth mapping using projected patterns
US7433024B2 (en) 2006-02-27 2008-10-07 Prime Sense Ltd. Range mapping using speckle decorrelation
WO2009021227A2 (fr) * 2007-08-09 2009-02-12 Recyclebank, Llc Système de collecte sélective par apport volontaire et procédé associé
US20090185274A1 (en) 2008-01-21 2009-07-23 Prime Sense Ltd. Optical designs for zero order reduction
US20100020078A1 (en) 2007-01-21 2010-01-28 Prime Sense Ltd Depth mapping using multi-beam illumination
US20100103131A1 (en) * 2008-10-23 2010-04-29 Utique Inc. Interactive and 3-D multi-senor touch selection interface for an automated retail store, vending machine, digital sign, or retail display
DE102010040177A1 (de) * 2010-09-02 2012-03-08 Sielaff Gmbh & Co. Kg Automatenbau Verkaufs- oder Rücknahmeautomat sowie Verfahren
WO2012072835A1 (fr) * 2010-12-03 2012-06-07 Lopez De Aragon Lopez Diego Machine pour l'achat automatique de produits, en particulier de métaux précieux
FR2970797A1 (fr) * 2011-01-25 2012-07-27 Intui Sense Dispositif a commandes tactile et gestuelle et procede d'interpretation de la gestuelle associe
DE102011109392A1 (de) * 2011-08-04 2013-02-07 Findbox Gmbh Warenautomat
CN102981615A (zh) * 2012-11-05 2013-03-20 瑞声声学科技(深圳)有限公司 手势识别装置及识别方法

Patent Citations (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE29812678U1 (de) 1998-07-16 1998-10-29 Kiesel, Alfred, 47259 Duisburg Rücknahmestation für Mehrwegbehälter
US20070086764A1 (en) * 2005-10-17 2007-04-19 Konicek Jeffrey C User-friendlier interfaces for a camera
US7433024B2 (en) 2006-02-27 2008-10-07 Prime Sense Ltd. Range mapping using speckle decorrelation
US20100020078A1 (en) 2007-01-21 2010-01-28 Prime Sense Ltd Depth mapping using multi-beam illumination
US20080240502A1 (en) 2007-04-02 2008-10-02 Barak Freedman Depth mapping using projected patterns
WO2009021227A2 (fr) * 2007-08-09 2009-02-12 Recyclebank, Llc Système de collecte sélective par apport volontaire et procédé associé
US20090185274A1 (en) 2008-01-21 2009-07-23 Prime Sense Ltd. Optical designs for zero order reduction
US20100103131A1 (en) * 2008-10-23 2010-04-29 Utique Inc. Interactive and 3-D multi-senor touch selection interface for an automated retail store, vending machine, digital sign, or retail display
DE102010040177A1 (de) * 2010-09-02 2012-03-08 Sielaff Gmbh & Co. Kg Automatenbau Verkaufs- oder Rücknahmeautomat sowie Verfahren
WO2012072835A1 (fr) * 2010-12-03 2012-06-07 Lopez De Aragon Lopez Diego Machine pour l'achat automatique de produits, en particulier de métaux précieux
FR2970797A1 (fr) * 2011-01-25 2012-07-27 Intui Sense Dispositif a commandes tactile et gestuelle et procede d'interpretation de la gestuelle associe
DE102011109392A1 (de) * 2011-08-04 2013-02-07 Findbox Gmbh Warenautomat
CN102981615A (zh) * 2012-11-05 2013-03-20 瑞声声学科技(深圳)有限公司 手势识别装置及识别方法

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
ANTHONY WING KOSNER: "Hug Me: Coca-Cola Introduces Gesture Based Marketing in Singapore - Forbes", 4 November 2012 (2012-11-04), XP055085515, Retrieved from the Internet <URL:http://www.forbes.com/sites/anthonykosner/2012/04/11/hug-me-coca-cola-introduces-gesture-based-marketing-in-singapore/> [retrieved on 20131028] *
MARIO MORALES ET AL: "VENDOR PROFILE Omek Interactive: Gesture Recognition and Machine Vision Technology for Intelligent Systems", 31 August 2012 (2012-08-31), XP055085512, Retrieved from the Internet <URL:http://www.smarttechnologyworld.com/pdf/omek.pdf> [retrieved on 20131028] *

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102015110758A1 (de) * 2015-07-03 2017-01-05 Mathias Jatzlauk Visualisierungssystem mit Gestensteuerung

Also Published As

Publication number Publication date
EP2816536B1 (fr) 2016-05-18
DK2816536T3 (en) 2016-08-29

Similar Documents

Publication Publication Date Title
EP3478535B1 (fr) Procédé permettant de faire fonctionner un véhicule automobile
EP1532805B1 (fr) Appareil de prise de vue et utilisation de cet appareil de prise de vue
EP2070008A1 (fr) Dispositif de reconnaissance automatique
WO2009071121A2 (fr) Système d&#39;interaction pour interaction entre un écran et un objet indicateur
DE19649455A1 (de) Bankautomat
CN108154707A (zh) 一种停车场数据处理终端设备和停车场管理系统
DE112018006071T5 (de) Formidentifizierungsvorrichtung und zustellbox
WO2016030105A1 (fr) Dispositif d&#39;acquisition des caractéristiques biométriques d&#39;un visage d&#39;une personne
EP3494551A1 (fr) Distributeur de cartes avec interface utilisateur de sécurité
CN109523682A (zh) 一种投票系统
EP2816536B1 (fr) Automate de reprise pour bouteilles consignées
DE202007009120U1 (de) Warenauswahleinheit
WO1999041713A1 (fr) Procede de surveillance du processus d&#39;exploitation d&#39;appareils et dispositif de libre-service dont la surveillance est assuree a l&#39;aide dudit procede
DE102016014420B3 (de) Ladenlokal mit Einrichtungen zur Verhütung von Rückgabebetrug sowie Verfahren zur Verhütung von Rückgabebetrug in Ladenlokalen
EP3025215B1 (fr) Procédé et dispositif de traitement de documents de valeur
EP3719764B1 (fr) Dispositif automatique de vente de marchandises et procédé
DE4235039C2 (de) Verfahren und Vorrichtung zum Bestimmen der Entfernung zwischen einem Monitor eines münzbetätigten Unterhaltungsautomaten und einer seiner Bedieneinrichtungen
DE202007009844U1 (de) Kartenleser
WO2021023814A1 (fr) Appareil pour le retour automatisé d&#39;une marchandise et procédé pour faire fonctionner l&#39;appareil
EP3839859A1 (fr) Terminal d&#39;enregistrement libre-service, procédé et dispositif de commande
WO2020035097A1 (fr) Procédé de détection et ensuite de génération de données pour un utilisateur d&#39;un terminal en libre-service
EP0488952A2 (fr) Méthode et dispositif pour deconsigner des articles, par exemple des boîtes de boissons vides
DE102014208327A1 (de) Verfahren und System zur Steuerung eines Medienausgabegeräts
DE19905999A1 (de) Vorrichtung zum Kontrollieren des Korbes und anderer Ablagen von Einkaufswagen auf Warenentleerung
DE102010051081B4 (de) System und Verfahren zum Übertragen von Informationen an ein Depositgerät

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20140526

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

17Q First examination report despatched

Effective date: 20150327

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

INTG Intention to grant announced

Effective date: 20160201

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

Free format text: NOT ENGLISH

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 4

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

Free format text: LANGUAGE OF EP DOCUMENT: GERMAN

Ref country code: AT

Ref legal event code: REF

Ref document number: 801066

Country of ref document: AT

Kind code of ref document: T

Effective date: 20160615

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 502013003015

Country of ref document: DE

REG Reference to a national code

Ref country code: NL

Ref legal event code: FP

REG Reference to a national code

Ref country code: DK

Ref legal event code: T3

Effective date: 20160822

REG Reference to a national code

Ref country code: SE

Ref legal event code: TRGR

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

REG Reference to a national code

Ref country code: NO

Ref legal event code: T2

Effective date: 20160518

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160518

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160518

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160919

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160518

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160518

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160518

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160819

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160518

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160518

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20160630

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160518

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160518

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160518

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160518

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 502013003015

Country of ref document: DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160518

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160518

REG Reference to a national code

Ref country code: IE

Ref legal event code: MM4A

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160518

26N No opposition filed

Effective date: 20170221

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20160630

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20160630

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 5

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160518

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20160618

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20130618

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 6

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160518

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160518

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160518

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20160618

Ref country code: MK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160518

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160518

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160518

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160518

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: NL

Payment date: 20190527

Year of fee payment: 7

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DK

Payment date: 20190524

Year of fee payment: 7

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20190522

Year of fee payment: 7

REG Reference to a national code

Ref country code: DK

Ref legal event code: EBP

Effective date: 20200630

REG Reference to a national code

Ref country code: NL

Ref legal event code: MM

Effective date: 20200701

REG Reference to a national code

Ref country code: AT

Ref legal event code: MM01

Ref document number: 801066

Country of ref document: AT

Kind code of ref document: T

Effective date: 20200618

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NL

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20200701

Ref country code: FR

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20200630

REG Reference to a national code

Ref country code: DE

Ref legal event code: R082

Ref document number: 502013003015

Country of ref document: DE

Representative=s name: VIERING, JENTSCHURA & PARTNER MBB PATENT- UND , DE

Ref country code: DE

Ref legal event code: R082

Ref document number: 502013003015

Country of ref document: DE

Representative=s name: KILBURN & STRODE LLP, NL

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AT

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20200618

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: DK

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20200630

REG Reference to a national code

Ref country code: DE

Ref legal event code: R082

Ref document number: 502013003015

Country of ref document: DE

Representative=s name: VIERING, JENTSCHURA & PARTNER MBB PATENT- UND , DE

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: SE

Payment date: 20220623

Year of fee payment: 10

Ref country code: NO

Payment date: 20220621

Year of fee payment: 10

Ref country code: GB

Payment date: 20220623

Year of fee payment: 10

Ref country code: DE

Payment date: 20220530

Year of fee payment: 10

REG Reference to a national code

Ref country code: DE

Ref legal event code: R119

Ref document number: 502013003015

Country of ref document: DE

REG Reference to a national code

Ref country code: NO

Ref legal event code: MMEP

REG Reference to a national code

Ref country code: SE

Ref legal event code: EUG

GBPC Gb: european patent ceased through non-payment of renewal fee

Effective date: 20230618

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: DE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20240103

Ref country code: GB

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230618

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230619

Ref country code: NO

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230630