EP3608593A1 - Système de cuisson - Google Patents

Système de cuisson Download PDF

Info

Publication number
EP3608593A1
EP3608593A1 EP18188387.7A EP18188387A EP3608593A1 EP 3608593 A1 EP3608593 A1 EP 3608593A1 EP 18188387 A EP18188387 A EP 18188387A EP 3608593 A1 EP3608593 A1 EP 3608593A1
Authority
EP
European Patent Office
Prior art keywords
oven
food
cooking
external computing
computing means
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
EP18188387.7A
Other languages
German (de)
English (en)
Other versions
EP3608593B1 (fr
Inventor
Volkmar Bunzel
Thomas Schulz
Thorben SCHIFFLER
Michele Toppano
Christoph Luckhardt
Klaus Wälzlein
Constantin KRAUSSE
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Electrolux Appliances AB
Original Assignee
Electrolux Appliances AB
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Electrolux Appliances AB filed Critical Electrolux Appliances AB
Priority to EP18188387.7A priority Critical patent/EP3608593B1/fr
Priority to PCT/EP2019/070338 priority patent/WO2020030462A1/fr
Publication of EP3608593A1 publication Critical patent/EP3608593A1/fr
Application granted granted Critical
Publication of EP3608593B1 publication Critical patent/EP3608593B1/fr
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F24—HEATING; RANGES; VENTILATING
    • F24C—DOMESTIC STOVES OR RANGES ; DETAILS OF DOMESTIC STOVES OR RANGES, OF GENERAL APPLICATION
    • F24C7/00—Stoves or ranges heated by electric energy
    • F24C7/08—Arrangement or mounting of control or safety devices
    • F24C7/082—Arrangement or mounting of control or safety devices on ranges, e.g. control panels, illumination
    • F24C7/085—Arrangement or mounting of control or safety devices on ranges, e.g. control panels, illumination on baking ovens
    • H—ELECTRICITY
    • H05—ELECTRIC TECHNIQUES NOT OTHERWISE PROVIDED FOR
    • H05B—ELECTRIC HEATING; ELECTRIC LIGHT SOURCES NOT OTHERWISE PROVIDED FOR; CIRCUIT ARRANGEMENTS FOR ELECTRIC LIGHT SOURCES, IN GENERAL
    • H05B6/00—Heating by electric, magnetic or electromagnetic fields
    • H05B6/64—Heating using microwaves
    • H05B6/6447—Method of operation or details of the microwave heating apparatus related to the use of detectors or sensors

Definitions

  • the present invention relates to a cooking system and to a method for operating a food processing oven.
  • DE 10 2012 204229 A1 there is disclosed a device having a cooking chamber in which there is arranged a camera for recording an image of the food in the cooking chamber.
  • a recognition unit is provided to recognize the food in the cooking chamber in dependence of the captured image, and a selection unit selects a cooking program from predetermined cooking programs in dependence of the captured image.
  • the system known from DE 10 2012 204 229 A1 is disadvantageous in that the food recognition requires sophisticated evaluation means, which requires a considerable amount of computation and data storage, which usually is not available in a household appliance. Thus, unless the household appliance is equipped with a fast processing device, which results in high costs of the household appliance, the quality and speed of the food recognition will not be satisfactory.
  • the oven is configured to automatically provide for a picture recognition which is triggered by the closing of the oven door, wherein in contrast to known systems the picture recognition is configured as rather basic picture recognition which merely aims at recognizing whether the oven cavity is empty or might contain a food item.
  • Such basic picture recognition does not require sophisticated computation and hence can be implemented with comparable simple components both in terms of hardware and software. Such basic picture recognition thus can be implemented in a fast and effective manner at moderate costs.
  • the further detailed picture recognition which then is performed to identify the kind of food to be processed, which may include an evaluation of various parameters of the food being processed, such as size, shape, surface structure, color, etc., which parameters also may change during the cooking process, such as the degree of browning of the food, such detailed picture recognition is not performed at the oven but in an external computing means, for example a cloud-based server system.
  • an external computing means for example a cloud-based server system.
  • the external computing means is for example a central server
  • such server not only can be provided with much higher computation capacity but further can be configured to have access to a large database of pictures of food of various kinds and at various stages of processing.
  • the external computing means is configured as an adaptive self-learning system, such as a neural network system
  • configuring the external computing means as a server system allows the system to be trained by a plurality of users, which further increases the accuracy of the system.
  • the external computing means selects cooking parameters based on the determined food parameters and transmits the selected cooking parameters to the oven.
  • the external computing means such as a cloud based server system, thus can be provided with a database that contains cooking parameters that are specifically adapted for the particular oven, and which cooking parameters are designed to reflect the type and state of the particular food being processed, as well as personal preferences of a user, such as a degree of browning or the like.
  • the communication means of the oven is adapted to communicate with a multi-purpose communication device, such as a mobile phone, a tablet, a laptop computer, or a personal computer, which provides for communication with the external computing means.
  • the multi-purpose communication device can be employed as interfacing device so as to display settings and options to the user, and provide input to the oven and to the external computing means.
  • the interfacing particularly can be implemented as an application that is executed on the multi-purpose communication device, so as to provide for a convenient means for the user to be presented with operation options, selected operating parameters and any further appropriate information as regards operation of the device.
  • Providing for an application that is run on a multi-purpose communication device provides a comfortable means for controlling the cooking process, which application further can easily be updated via the internet so as to further improve the software.
  • the external computing means can be configured to transmit food data and/or cooking parameters to the user for confirmation by the user before proceeding to the step of selecting cooking parameters based on the determined food parameters and/or the step of transmitting the selected cooking parameters to the oven.
  • the user may be presented with the determined food data, such as the type of food as determined in the food recognition process, cooking parameters that have been determined based on the determined type of food, which cooking parameters may comprise operating parameters of the oven, such as heating modes, temperature levels, durations, steam addition, and the like, or preparation parameters for the determined type of food such as a degree of cooking, such as rare or well-done, a degree of browning, a predetermined change in size, etc.
  • the oven comprises an interface which is configured for communication with the external computing means and/or the multi-purpose communication device.
  • Such oven interface can be configured, for example, to start a cooking process upon transmittal of selected cooking parameters to the oven, to assist in a configuration process, to initiate program routines, such as service operations, etc.
  • the external computing means is a cloud-based system, i.e. a remote server system that is accessible via the internet and which is configured to communicate with a plurality of users.
  • a cloud-based system basically is not restricted to any constraints in terms of computing capacity and data volume and hence allows implementing a much more accurate and fast picture recognition as a stand-alone device that is provided at the oven as such.
  • the user thus is presented with an intermediate result of the overall evaluation process, such as the type of food to be processed, or suggested operating parameters, before these operating parameters are transmitted to the oven.
  • the method of the present invention further may comprise a step of transmitting to the user a selection of cooking options and/or optional cooking parameters which is performed after the step of performing a food recognition routine on the picture data to determine food data, so as to first ask the user for confirmation and/or selection of further optional parameters before proceeding with selecting cooking parameters and transmitting the selected cooking parameters to the oven.
  • the method after the step of transmitting the selected cooking parameters to the oven, may comprise a step of displaying the selected cooking parameters, wherein the method only proceeds to the step of operating the oven based on the transmitted cooking parameters upon confirmation by the user.
  • confirmation by the user can be effected, for example, by providing a "Start" button either at the oven or at the multi-purpose communication device.
  • FIG. 1 illustrates a schematic perspective view of a domestic cooking oven 10 which comprises a housing 12, an oven cavity 14 inside the housing 12, an oven door 16 for closing a front side of the oven cavity 14, and a front panel 22 which is arranged above the oven door 16.
  • control and display elements for operation of the oven, such as a touchpad panel 24 and a control button 26.
  • the oven door 16 comprises a door window 18 arranged in a central portion of the oven door 16.
  • a door handle 20 is attached at an outer side of the oven door 16 above the door window 18.
  • a camera 28 having a camera lens at the rear side of the handle, which camera lens is arranged to have a viewing angle which covers basically the entire oven cavity 14. While a camera or another optical sensor for monitoring the interior of the oven cavity 14 alternatively could be located within the oven cavity, providing the camera within the handle is advantageous because in this manner the camera is not exposed to the harsh environment of the oven atmosphere which may involve high temperatures and high humidity, but which also contains oven fumes and food particles or droplets.
  • FIG 2 illustrates a schematic process diagram for operation of the oven 10 shown in Figure 1 , which process diagram is illustrated in Figure 3 as a flow diagram
  • the method starts with the user 30 opening the oven door 16 so as to put a food item into the oven cavity 14 (step 1).
  • the closing of the door is sensed by a door sensor (step 2), such as a switch which is provided in the door frame so as to be contacted by the door when the door is closed, or which is associated to the hinge to detect from the positioning of the hinge when the door is in the fully closed position.
  • the camera 28 in the door handle 20 Upon sensing a closing of the door, the camera 28 in the door handle 20 is activated to obtain picture data from within the oven cavity 14 (step 3). The obtained picture data then is evaluated in a processing unit of the oven 10 so as to determine by some basic picture recognition routine that the oven cavity 14 no longer is empty (step 4).
  • such basic picture recognition routine may comprise comparing a prestored picture of the empty oven cavity with the picture data obtained after closing the door, wherein it is determined that the oven cavity may contain a food item if the compared picture data does not correspond to each other.
  • the software for conducting the basic picture evaluation routine can be stored in the memory of the oven controller or in an additional memory that is provided for such purpose.
  • step 5 in which the obtained picture data is transmitted to an external computing means 32, which in Figure 2 is illustrated as a cloud-based server system which is accessible via internet.
  • the obtained picture data is transmitted together with data for identifying the type of oven, such as a type name or model number.
  • the necessary data for identifying the type of oven also can be stored at the cloud-based server system, such as by a registration process which the users performs once upon installing the oven. In such latter case the server can retrieve the required data based on the identification of the user, which identification anyway has to be provided so that the server can respond to the user.
  • step 4 If it be determined during step 4 that the oven cavity 14 still is empty, then the program returns to step 1, i.e. waits for a detection of the closing of the door.
  • the external computing means 32 processes the picture data obtained from the oven in a picture recognition routine so as to determine food data including the type of food and various characteristics such as the size, volume, color, surface texture, etc. of the food (step 6). Based on the determined food characteristics and optionally based on settings or options selected by the user, the external computing means selects from a database operating parameters that specifically are designed for processing the particular food item in the particular oven (step 7) .
  • the operating parameters that have been determined by the external computing means then are transmitted to the user, which in the process scheme illustrated in Figure 2 is done with the aid of a mobile communication device 34, which in Figure 2 is illustrated as a tablet computer.
  • the data is displayed on the tablet computer wherein optionally also a notification can be output, such as an acoustic tone, so as to alert the user that data has been transmitted (step 8).
  • step 9 The user now can check the displayed data so as to confirm that the food type and the suggested settings are correct, or to change settings or select additional options (step 9).
  • the thus confirmed or adapted selections then are transmitted to the external computing means (step 10), which transmits corresponding operating parameters to the oven (step 11).
  • the oven then can be operated in accordance with the transmitted operating parameters (step 13), either directly upon receipt of the operating parameters, or upon the user providing again for some confirmation that the operation of the oven 10 is to be started, such as by pressing the control button 26 which in this case acts as start button for the device (step 12).
  • the oven directly communicates with the external computing means, i.e. the cloud-based server system
  • the communication usually will be effected via a network interface, such as a home communication system with which the oven communicates, such as via a LAN or WLAN connection.
  • the communication between the oven and the external computing means is effected via a multipurpose communication device, in Figure 2 the tablet computer, which thus is operated not only as a user interface bus also as a communication interface for the oven.
  • the determination of the operating parameters for conducting a cooking process in conformity with the recognized food and optional user preferences is done in the external computing means, this also could be done at least in part by the multipurpose communication deice, i.e. the tablet computer illustrated in Figure 2 , which communicates with the external computing means.
  • the display and selection of further options such as the suggesting of different recipes for the detected food or the display of further options for the cooking process, such as the degree of cooking, timer functions, warming functions to be conducted following a cooking process, could be done via an application that is run on the tablet computer, and which uses data that is stored on the tablet computer or which is obtained from the internet, such as from the external computing means.
  • the food data, oven parameters, and optional settings is displayed at the tablet computer
  • data also can be displayed directly at the touchpad panel 24 of the oven, which also can be used for displaying the recognized food type, recipes, suggested or selected oven parameters, and for making user selections, such as by displaying a list of options from which the user may chose.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Electromagnetism (AREA)
  • Chemical & Material Sciences (AREA)
  • Combustion & Propulsion (AREA)
  • Mechanical Engineering (AREA)
  • General Engineering & Computer Science (AREA)
  • Electric Ovens (AREA)
EP18188387.7A 2018-08-10 2018-08-10 Système de cuisson comprenant un four et un moyen de calcul externe, et procédé de fonctionnement d'un tel système Active EP3608593B1 (fr)

Priority Applications (2)

Application Number Priority Date Filing Date Title
EP18188387.7A EP3608593B1 (fr) 2018-08-10 2018-08-10 Système de cuisson comprenant un four et un moyen de calcul externe, et procédé de fonctionnement d'un tel système
PCT/EP2019/070338 WO2020030462A1 (fr) 2018-08-10 2019-07-29 Système de cuisson

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
EP18188387.7A EP3608593B1 (fr) 2018-08-10 2018-08-10 Système de cuisson comprenant un four et un moyen de calcul externe, et procédé de fonctionnement d'un tel système

Publications (2)

Publication Number Publication Date
EP3608593A1 true EP3608593A1 (fr) 2020-02-12
EP3608593B1 EP3608593B1 (fr) 2022-03-16

Family

ID=63244410

Family Applications (1)

Application Number Title Priority Date Filing Date
EP18188387.7A Active EP3608593B1 (fr) 2018-08-10 2018-08-10 Système de cuisson comprenant un four et un moyen de calcul externe, et procédé de fonctionnement d'un tel système

Country Status (2)

Country Link
EP (1) EP3608593B1 (fr)
WO (1) WO2020030462A1 (fr)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2021180477A1 (fr) * 2020-03-12 2021-09-16 BSH Hausgeräte GmbH Réglage d'un degré de brunissage cible sur un appareil de cuisson ménager
EP3904769A1 (fr) * 2020-04-30 2021-11-03 Miele & Cie. KG Appareil de cuisson avec détection électronique des erreurs de l'opérateur
EP4009252A1 (fr) * 2020-12-07 2022-06-08 Electrolux Appliances Aktiebolag Procédé de traitement d'aliments dans un appareil, système de traitement d'aliments et application logicielle
WO2023011841A1 (fr) 2021-08-04 2023-02-09 BSH Hausgeräte GmbH Procédé de surveillance de produit en cours de cuisson et appareil de cuisson ménager
WO2024053908A1 (fr) * 2022-09-07 2024-03-14 삼성전자주식회사 Appareil de cuisson et son procédé de commande

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3865025A3 (fr) 2017-08-09 2021-11-10 SharkNinja Operating LLC Dispositif de cuisson et ses composants
CN212788226U (zh) 2019-02-25 2021-03-26 沙克忍者运营有限责任公司 烹饪系统
US20190254476A1 (en) 2019-02-25 2019-08-22 Sharkninja Operating Llc Cooking device and components thereof
US11678765B2 (en) 2020-03-30 2023-06-20 Sharkninja Operating Llc Cooking device and components thereof
CN113729513A (zh) * 2021-09-27 2021-12-03 广东美的厨房电器制造有限公司 烹饪器具及其控制方法和控制装置、可读存储介质

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102012204229A1 (de) 2012-03-16 2013-09-19 BSH Bosch und Siemens Hausgeräte GmbH Vorrichtung für ein Gargerät und Gargerät
WO2016034295A1 (fr) * 2014-09-03 2016-03-10 Electrolux Appliances Aktiebolag Appareil électroménager, en particulier four de cuisson, doté d'une caméra
WO2016179424A1 (fr) * 2015-05-05 2016-11-10 June Life, Inc. Système de préparation d'aliments connecté et son procédé d'utilisation
US20170223774A1 (en) * 2015-09-10 2017-08-03 Brava Home, Inc. Variable peak wavelength cooking instrument with support tray
WO2018114170A1 (fr) * 2016-12-21 2018-06-28 Electrolux Appliances Aktiebolag Entité de préparation d'aliments

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CA3076234A1 (fr) * 2017-09-18 2019-03-21 InterProducTec Consulting GmbH & Co. KG Systeme de surveillance et systeme de preparation d'aliments

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102012204229A1 (de) 2012-03-16 2013-09-19 BSH Bosch und Siemens Hausgeräte GmbH Vorrichtung für ein Gargerät und Gargerät
WO2016034295A1 (fr) * 2014-09-03 2016-03-10 Electrolux Appliances Aktiebolag Appareil électroménager, en particulier four de cuisson, doté d'une caméra
WO2016179424A1 (fr) * 2015-05-05 2016-11-10 June Life, Inc. Système de préparation d'aliments connecté et son procédé d'utilisation
US20170223774A1 (en) * 2015-09-10 2017-08-03 Brava Home, Inc. Variable peak wavelength cooking instrument with support tray
WO2018114170A1 (fr) * 2016-12-21 2018-06-28 Electrolux Appliances Aktiebolag Entité de préparation d'aliments

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2021180477A1 (fr) * 2020-03-12 2021-09-16 BSH Hausgeräte GmbH Réglage d'un degré de brunissage cible sur un appareil de cuisson ménager
CN115190956A (zh) * 2020-03-12 2022-10-14 Bsh家用电器有限公司 在家用烹饪器具上设定目标褐变程度
EP3904769A1 (fr) * 2020-04-30 2021-11-03 Miele & Cie. KG Appareil de cuisson avec détection électronique des erreurs de l'opérateur
EP4009252A1 (fr) * 2020-12-07 2022-06-08 Electrolux Appliances Aktiebolag Procédé de traitement d'aliments dans un appareil, système de traitement d'aliments et application logicielle
WO2022122375A1 (fr) * 2020-12-07 2022-06-16 Electrolux Appliances Aktiebolag Procédé de traitement d'aliments dans un appareil, système de traitement d'aliments et application logicielle
WO2023011841A1 (fr) 2021-08-04 2023-02-09 BSH Hausgeräte GmbH Procédé de surveillance de produit en cours de cuisson et appareil de cuisson ménager
DE102021208447A1 (de) 2021-08-04 2023-02-09 BSH Hausgeräte GmbH Verfahren zum Überwachen von Gargut und Haushaltsgargerät
WO2024053908A1 (fr) * 2022-09-07 2024-03-14 삼성전자주식회사 Appareil de cuisson et son procédé de commande

Also Published As

Publication number Publication date
EP3608593B1 (fr) 2022-03-16
WO2020030462A1 (fr) 2020-02-13

Similar Documents

Publication Publication Date Title
EP3608593B1 (fr) Système de cuisson comprenant un four et un moyen de calcul externe, et procédé de fonctionnement d'un tel système
TWI667003B (zh) 電動家用器具及操作此家用器具之方法
CN107468048B (zh) 烹饪器具及其控制方法
JP6265868B2 (ja) 加熱調理器、加熱調理システム、及び、加熱調理器の制御方法
EP3540315B1 (fr) Appareil de cuisson comportant un dispositif d'imagerie
US20210401223A1 (en) Cooking device having camera
US20150305567A1 (en) Food processor
EP3660659A1 (fr) Dispositif et système de cuisson
US20100192784A1 (en) Cooking appliance, controlling system for cooking appliance and controlling method for cooking appliance
KR20180083167A (ko) 조리 기기 및 그를 포함하는 조리 시스템
CN211582580U (zh) 一种烹饪系统
US20220163261A1 (en) Appliances and Methods for Adaptive Zonal Cooking
US20190327796A1 (en) Oven appliance and a method for operating an oven appliance for customized cooking outcome
CN114305138A (zh) 一种智能烤箱及其控制方法
CN209733642U (zh) 一种智能烹饪设备
CN116601438A (zh) 用于操作烹饪器具的方法以及烹饪器具
JP2019148387A (ja) 加熱調理機および加熱調理システム
CN212912895U (zh) 烤箱
US12066193B2 (en) Method for preparing a cooking product, cooking device, and cooking device system
EP3809925A1 (fr) Appareil de cuisson destiné à la cuisson de grains entiers tels que du riz à grains entiers
JP7446833B2 (ja) 加熱調理器システム
KR20230011181A (ko) 조리 기기 및 그의 제어 방법
CN113712439A (zh) 烹饪装置及其控制方法、控制装置和可读存储介质
WO2023087810A1 (fr) Dispositif de cuisson intelligent, dispositif intelligent de conservation de la fraîcheur et procédé de commande
JP2003322343A (ja) 宅内ネットワークシステム

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION HAS BEEN PUBLISHED

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20200812

RBV Designated contracting states (corrected)

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

INTG Intention to grant announced

Effective date: 20211018

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

Ref country code: DE

Ref legal event code: R096

Ref document number: 602018032230

Country of ref document: DE

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 1476146

Country of ref document: AT

Kind code of ref document: T

Effective date: 20220415

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG9D

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20220316

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220316

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220316

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220616

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220316

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220316

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220616

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 1476146

Country of ref document: AT

Kind code of ref document: T

Effective date: 20220316

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220316

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220617

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220316

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220316

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220316

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220316

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220316

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220718

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220316

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220316

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220316

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220316

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220316

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220716

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220316

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602018032230

Country of ref document: DE

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220316

26N No opposition filed

Effective date: 20221219

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220316

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220316

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

GBPC Gb: european patent ceased through non-payment of renewal fee

Effective date: 20220810

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20220810

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20220831

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20220831

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20220831

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20220810

P01 Opt-out of the competence of the unified patent court (upc) registered

Effective date: 20230625

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20220831

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GB

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20220810

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: IT

Payment date: 20230822

Year of fee payment: 6

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20180810

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220316

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220316

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220316

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220316

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20240828

Year of fee payment: 7

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20240826

Year of fee payment: 7