EP4098154B1 - Miroir sanitaire avec dispositif de surveillance - Google Patents

Miroir sanitaire avec dispositif de surveillance Download PDF

Info

Publication number
EP4098154B1
EP4098154B1 EP21177054.0A EP21177054A EP4098154B1 EP 4098154 B1 EP4098154 B1 EP 4098154B1 EP 21177054 A EP21177054 A EP 21177054A EP 4098154 B1 EP4098154 B1 EP 4098154B1
Authority
EP
European Patent Office
Prior art keywords
mirror
unit
body characteristics
mirror device
sanitary
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
EP21177054.0A
Other languages
German (de)
English (en)
Other versions
EP4098154C0 (fr
EP4098154A1 (fr
Inventor
Volker Frisch
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Chipglobe GmbH
Original Assignee
Chipglobe GmbH
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Chipglobe GmbH filed Critical Chipglobe GmbH
Priority to EP21177054.0A priority Critical patent/EP4098154B1/fr
Publication of EP4098154A1 publication Critical patent/EP4098154A1/fr
Application granted granted Critical
Publication of EP4098154C0 publication Critical patent/EP4098154C0/fr
Publication of EP4098154B1 publication Critical patent/EP4098154B1/fr
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • A—HUMAN NECESSITIES
    • A47—FURNITURE; DOMESTIC ARTICLES OR APPLIANCES; COFFEE MILLS; SPICE MILLS; SUCTION CLEANERS IN GENERAL
    • A47G—HOUSEHOLD OR TABLE EQUIPMENT
    • A47G1/00—Mirrors; Picture frames or the like, e.g. provided with heating, lighting or ventilating means
    • A47G1/02—Mirrors used as equipment

Definitions

  • the present invention relates to sanitary mirror devices capable of monitoring body characteristics.
  • mirrors are common which help individuals to check their outer appearance before leaving the bathroom or the sanitary facility.
  • As such mirrors are often installed above a faucet, it belongs to a morning routine of most people to stand in front of the mirror brushing their teeth, washing their face, applying cosmetics, styling hair, and the like.
  • a body scale to measure the body weight, using other separate devices measuring the heart rate and/or blood pressure and/or to make measurements of other body characteristics such as respiratory rate or body temperature.
  • body characteristics such as blood pressure and heart rate, are of permanent continuous interest and are usually measured in the mornings shortly after getting up from the night rest.
  • the morning routine usually takes a significant part of the day.
  • the additional actions of measuring body characteristics prolong the morning routine.
  • these additional actions require getting up earlier.
  • Document WO 2018/060232 A1 discloses an apparatus for supporting at least one user in performing a personal care activity, such as a smart mirror, the apparatus comprising a control unit configured to determine a personal care activity performed by the at least one user; identify one or more regions of interest in the image of the at least one user based on the determined personal care activity; acquire information associated with the determined personal care activity, and modify the image of the at least one user at the identified one or more regions of interest based on the acquired information to support the at least one user in performing the personal care activity.
  • This document discloses a sanitary mirror device according to the preamble of claim 1.
  • Document WO 2018/045649 A1 discloses a smart mirror including a mirror surface, a display module, a voice module, a communication module, a control processing module and a power supply module.
  • the mirror surface includes a light reflection layer and a transparent material layer.
  • the display module is arranged in the transparent material layer.
  • the voice module, the communication module, the control processing module and the power module are arranged on at least one end of the mirror or the back of the mirror.
  • the communication module is used to establish a communication connection with an external device.
  • the control processing module is configured to receive and process instructions to control the display module, the voice module and the communication module.
  • Document CN 111 977 985 A discloses a smart mirror including a display device and a mirror surface with a translucent coating.
  • the mirror surface is located on the surface of the display device.
  • a part of the mirror surface is transparent, and the other part has a translucent coating.
  • Document CN 108 920 509 A discloses an intelligent vanity mirror, comprising a vanity mirror body, a wireless communication module, a controller module, a detection module, a voice module, an input display module, a power supply module and a storage module.
  • the wireless communication module, detection module, voice module, input display module, power supply module and storage module are all electrically connected with the controller module.
  • the wireless communication module, the controller module, the power supply module and the storage module are all arranged in the vanity mirror body.
  • the detection module is arranged outside the vanity mirror body, and is used for analyzing skin color and detecting human makeup.
  • the input and display module is arranged outside the vanity mirror body and is used for inputting and displaying personal information.
  • Document US 2008/126129 A1 discloses a method for determining the conditions of a skin of an individual and providing recommendations on the factors to be used on at least one skin aesthetic procedure, the method comprising obtaining information from the individual regarding the skin aesthetic procedure the individual desires to have performed, determining at least one skin condition of the individual prior to the administration of the skin aesthetic procedure, selecting the most efficacious factors for the desired skin aesthetic procedure based on the skin condition, and providing recommendations to the individual for the skin care treatments procedure based on the selected factors to enhance efficiency of the skin aesthetic procedure.
  • a sanitary mirror device comprising:
  • the radar sensor unit has a radar sensor and an analyzing unit to process radar signals, wherein the radar unit is configured to provide radar signals and comprise at least one antenna, wherein the antenna is provided as one of a part of a frame circumventing the mirror plane, an area of a metal layer forming the mirror plane which is galvanically isolated or any other configuration where the radar radiation is not blocked or distorted by a metal layer of or in the mirror element.
  • the sanitary mirror device further includes a sensor unit configured to obtain a body characteristic of an individual which is presently located (standing, sitting) in front of the mirror element.
  • a sensor unit configured to obtain a body characteristic of an individual which is presently located (standing, sitting) in front of the mirror element.
  • the display unit may be integrated with the mirror element so that a display area of the display unit is embedded or directly abuts to the mirror plane.
  • the display area may be formed as a semi-transparent layer embedded in or neighboring the mirror plane, so that when the display unit is deactivated the display area is fully reflective, particularly as reflective as the mirror plane itself.
  • the sanitary mirror device includes a sensor unit that allows contactless measuring of body characteristics using electromagnetic radiation such as radar, visible light, or infrared light based measurements.
  • the body characteristics comprise a heart rate, a respiratory rate, and/or blood pressure.
  • the sensor unit includes a radar sensor unit that has a radar sensor and an analyzing unit to apply measurements on the individual being in front of the sanitary mirror device.
  • the radar sensor unit is configured to detect micromotion in the body of the individual, the resulting radar signals can be analyzed in the analyzing unit, particularly using machine learning methods, to obtain a heart rate and/or a respiratory rate and/or a blood pressure information.
  • Detecting heart rate and respiratory rate using Doppler radar measurements is well known in the art, e.g. from documents R. Fletcher et al., "Low-Cost Differential Front-End for Doppler Radar Vital Sign monitoring,” IEEE MTT-S International Microwave Symposium Digest, pp.1325-1328, 2009 and Young Woo Choi et al, "Micro-Doppler simulator of bulk and micro motions for vehicle drivers", IEEE, 2016 International Conference on Information and Communication Technology Convergence (ICTC) 19-21 Oct. 2016 .
  • ICTC Information and Communication Technology Convergence
  • blood pressure can also be measured using Doppler radar technology as known from document Tomoyuki Ohata et al.,. “Non-Contact Blood Pressure Measurement Scheme Using Doppler Radar”, Annu Int Conf IEEE Eng Med Biol Soc, 2019 Jul.
  • the Doppler radar micro motion measurement can be applied in a single antenna and dual antenna technology and is sensitive to the motion of body parts such as lungs and heart to detect respiratory and heart beat motions. From these motions respiratory rate, blood pressure, and heart rate can be derived using appropriate well-known signal processing technology.
  • the sensor unit may comprise a camera configured to detect a skin color of the individual in front of the mirror device as a body characteristics.
  • the sensor unit comprises an infrared camera or an infrared temperature sensor which is configured to detect a body temperature as a body characteristics.
  • control unit may be configured to generate or to retrieve information from an internal storage unit and/or a remote storage unit associated with the obtained body characteristics data and to display the retrieved information on the display area of the display unit.
  • control unit may be configured to track the body characteristics data over time associated with an identification of the individual the body characteristics data belong to, wherein the identification is manually input or automatically made by means of a camera image of the individual taken at the time of detecting body characteristics data and by applying well-known face recognition techniques.
  • FIG. 1 schematically shows the sanitary mirror device 1 according to the present invention.
  • the sanitary mirror device 1 includes a mirror element 2 with a mirror plane for providing a mirror image of objects and individuals being present in front of the mirror element 2.
  • the mirror element 2 is usually attached to a wall (e.g. in parallel to the wall), particularly in a bathroom or in a sanitary facility.
  • the mirror device 1 is provided with a display unit 3 having a display area.
  • the display unit 3 may be formed as an LCD-display with backlight or as a Micro LED display.
  • Display unit 3 can be provided neighboring the mirror element 2, such as below the mirror plane of the mirror element 2.
  • the display area of display unit 3 is arranged behind a semi-transparent reflective layer.
  • the semi-transparent layer is at least provided at the portion of the mirror plane.
  • the display area is black and does not emit any light. Due to the semi-transparent layer, the mirror plane is continuously reflective even in the portion of the mirror plane behind which the display area is located. Therefore, the display area acts like the rest of the mirror plane. Furthermore, when display unit 3 is activated it allows displaying information to a user in front of the mirror element 2.
  • the mirror element 2 is formed by a glass screen which is coated with a metal layer on its backside wherein in the portion of the mirror plane where the display unit is arranged the metal layer is thinned to make the metal layer semi-transparent so that an image presented by the display unit 3 shines through the semi-transparent metal layer.
  • the sanitary mirror device 1 includes a sensor unit 4 with one or more sensors to obtain sensor information.
  • the sensor unit 4 is configured to obtain body characteristics of an individual being present in front of the mirror element 2 and to display the body characteristics or information related thereto to immediately inform the individual while the individual is using the mirror device e.g. to check their outer appearance.
  • the sensor unit 4 comprises a radar sensor unit 41.
  • the radar sensor unit 41 has a radar unit 41a and an analyzing unit 41b which are configured to performs a Doppler radar measurement to obtain a micro-motion radar signal of the individual's body.
  • the micro-motion radar signal can be analyzed in the analyzing unit 41b to obtain a heart rate and/or a blood pressure and/or a respiratory rate and the like.
  • the radar unit 41a can be of a single antenna or dual antenna type.
  • a dual antenna type radar unit 41 has a transmitting antenna 41c and a receiving antenna 41d which allows the radar unit to obtain a Doppler radar signal which can be analyzed in the analyzing unit 41b.
  • the transmitting and receiving antenna 41c, 41d may be arranged at an edge of the mirror element 2, particularly in or on a frame part 6 at least partly surrounding the mirror element 2.
  • mirror element 2 may be provided with openings 41f in the metal layer in which at least one of the transmitting and receiving antennas may be arranged.
  • the transmitting and receiving antennas in the opening 41f may be formed as an antenna layer made of an optically reflective and electrically conductive metal which is galvanically isolated from the rest of the metal layer of the mirror element 2. This allows forming antenna elements for the radar sensor unit 41 which may be separated from the rest of the metal layer by a gap 41g that is preferably smaller than 5 mm.
  • the radar sensor unit 41 can be further provided with and be connected with a multiple antenna arrangement where one or more additional antennas 41j are placed at multiple locations (such as left and right of the mirror device 1) to acquire a more detailed signal for the radar sensor unit 41 to process.
  • the sensor unit 4 may further be provided with an infrared camera 42 or an infrared temperature sensor which is directed to a position in front of the mirror element 2 which allows obtaining a body temperature as a body characteristics of an individual.
  • the sensor unit 4 may further be provided with a room temperature sensor 43 to detect an ambient temperature.
  • a control unit 5 is provided which is in communication with the sensor unit 4 and with the display unit 3.
  • the control unit 5 may include a data processing unit and be in control of the displaying of the measured body characteristics on the display area of display unit 3 and further additional information such as an ambient temperature.
  • warnings e.g. if a critical condition is detected. For instance, it can be checked if a critical condition has occurred if any of the heart rate, blood pressure and respiratory rate is too high or too low. In case of a critical condition a warning signal can be displayed and/or advice can be given to the individual.
  • control unit 5 may be in connection with a storage unit 7 to collect and timely track the measured body characteristics each time a measurement has been carried out to obtain a timeline of the body characteristics e.g. for medical analysis and/or supervision.
  • the storage unit 7 may be integrated with the mirror device 1 or can be cloud-based when the control unit 5 is equipped with an optional data communication unit 51 to transmit body characteristics over a network, such as the Internet, to the cloud-based storage unit.
  • the control unit 5 may have communication means to e.g. communicate with a Home IoT unit. If the user configures his or her Home IoT system to be connected to the smart mirror device 1, he or she will be able to get the information from the control unit 5 to this Home IoT network.
  • a mobile device can be used to retrieve the data and see the graphs of blood pressure, temperature reading etc. over a predetermined time frame such as a week, a month etc. This functionality is configurable so that user can enable or disable the communication of data from control unit 5 to external devices. This data can also be directly retrieved from the control unit 5 by the mobile device.
  • the timeline of the body characteristics can be stored associated to a user which can be identified by manual input. Therefore, an input device (not shown) can be separately provided or can be implemented as a touch sensor surface on the display area of the display unit 3.
  • the touch sensor may be configured in conjunction with the control unit 5 to make selections from menus or choices displayed on the display area so that an identification of the individual presently using the mirror device can be manually input by the user.
  • the sensor unit 4 may further be provided with and or coupled to a camera 44 which is directed to a position in front of the sanitary mirror device 1 in which the individual using the mirror device is usually positioned.
  • An image taken by the camera 44 may be used to automatically identify the individual in front of the mirror device 1 applying well known face recognition techniques in the control unit 5 or the cloud. So, the body characteristics can be stored in conjunction with the identification of the specific individual the currently obtained body characteristics belong to. Thereby, different data sets of timelines of body characteristics can be kept in association with a specific individual if the mirror device is used by a plurality of individuals.
  • the camera 44 can be used as an additional sensor for detecting the skin color of the individual, particularly at a predetermined body position, so that the skin color can be tracked over time as a body characteristics.
  • the control unit 5 making use of specific databases stored in the storage unit or a cloud storage can make use of an expert system for patterns which may indicate illness symptoms of the individual by analyzing the timelines of the body characteristics stored.

Landscapes

  • Mirrors, Picture Frames, Photograph Stands, And Related Fastening Devices (AREA)
  • Measuring And Recording Apparatus For Diagnosis (AREA)

Claims (9)

  1. Un dispositif de miroir sanitaire (1), comprenant :
    - un élément de miroir (2) avec un plan de miroir réfléchissant ;
    - une unité de capteurs (4) comprenant un ou plusieurs capteurs (41, 42, 43, 44) configurés pour détecter des données de caractéristiques corporelles sans contact, les données de caractéristiques corporelles correspondant ou se rapportant à au moins une caractéristique corporelle d'un individu se trouvant devant le dispositif de miroir (1) ;
    - une unité d'affichage (3) ;
    - une unité de commande (5) configurée pour recevoir les données de caractéristiques corporelles et pour ordonner à l'unité d'affichage (3) d'afficher des informations correspondant et/ou se rapportant aux données de caractéristiques corporelles,
    caractérisé en ce que
    l'unité de détection (3) comprenant une unité de détection radar (41) configurée pour effectuer une mesure radar Doppler afin de détecter les données de caractéristiques corporelles, et que
    l'unité de capteur radar (41) comporte une unité radar (41a) et une unité d'analyse (41b) pour traiter les signaux radar, l'unité radar (41a) étant configurée pour fournir des signaux radar et comprenant au moins une antenne (41c, 41d), l'au moins une antenne (41c, 41d) étant fournie sous la forme d'une partie d'un cadre contournant le plan du miroir ou d'une zone d'une couche métallique formant le plan du miroir qui est isolée de manière galvanique du reste du plan du miroir.
  2. Le dispositif de miroir sanitaire (1) selon la revendication 1, dans lequel l'unité d'affichage (3) est intégrée à l'élément de miroir (2) de sorte qu'une zone d'affichage de l'unité d'affichage (3) est encastrée ou directement adossée au plan du miroir.
  3. Le dispositif de miroir sanitaire (1) selon la revendication 2, dans lequel la zone d'affichage est formée comme une couche semi-transparente dans ou à proximité du plan du miroir, de sorte que lorsque l'unité d'affichage (3) est désactivée, la zone d'affichage est réfléchissante, en particulier aussi réfléchissante que le plan du miroir.
  4. Le dispositif de miroir sanitaire (1) selon la revendication 1, dans lequel les caractéristiques corporelles comprennent la fréquence cardiaque, la fréquence respiratoire et/ou la pression artérielle.
  5. Le dispositif de miroir sanitaire (1) selon la revendication 1, dans lequel une antenne supplémentaire (41j) est prévue à l'extérieur de l'agencement de l'élément de miroir (2), de l'unité de commande (5) et de l'unité d'affichage (3).
  6. Le dispositif de miroir sanitaire (1) selon l'une des revendications 1 à 5, dans lequel l'unité de capteur (4) comprend une caméra (44) configurée pour détecter la couleur de la peau de l'individu devant le dispositif de miroir en tant que caractéristique corporelle.
  7. Le dispositif de miroir sanitaire (1) selon l'une des revendications 1 à 6, dans lequel l'unité de capteur (4) comprend une caméra infrarouge (42) ou un capteur de température infrarouge (43) configuré pour détecter la température du corps en tant que caractéristique du corps.
  8. Le dispositif de miroir sanitaire (1) selon l'une des revendications 1 à 7, dans lequel l'unité de commande (5) est configurée pour générer ou récupérer des informations à partir d'une unité de stockage interne et/ou d'une unité de stockage à distance associée aux données de caractéristiques corporelles et pour afficher les informations récupérées sur la zone d'affichage de l'unité d'affichage (3).
  9. Le dispositif de miroir sanitaire (1) selon l'une des revendications 1 à 8, dans lequel l'unité de commande (5) est configurée pour suivre les données de caractéristiques corporelles dans le temps associées à une identification de l'individu auquel les données de caractéristiques corporelles appartiennent, l'identification étant saisie manuellement ou réalisée automatiquement au moyen d'une image de l'individu prise par une caméra au moment de la détection des données de caractéristiques corporelles et en appliquant des techniques de reconnaissance faciale.
EP21177054.0A 2021-06-01 2021-06-01 Miroir sanitaire avec dispositif de surveillance Active EP4098154B1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
EP21177054.0A EP4098154B1 (fr) 2021-06-01 2021-06-01 Miroir sanitaire avec dispositif de surveillance

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
EP21177054.0A EP4098154B1 (fr) 2021-06-01 2021-06-01 Miroir sanitaire avec dispositif de surveillance

Publications (3)

Publication Number Publication Date
EP4098154A1 EP4098154A1 (fr) 2022-12-07
EP4098154C0 EP4098154C0 (fr) 2023-08-16
EP4098154B1 true EP4098154B1 (fr) 2023-08-16

Family

ID=76553466

Family Applications (1)

Application Number Title Priority Date Filing Date
EP21177054.0A Active EP4098154B1 (fr) 2021-06-01 2021-06-01 Miroir sanitaire avec dispositif de surveillance

Country Status (1)

Country Link
EP (1) EP4098154B1 (fr)

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3578100A1 (fr) * 2018-06-05 2019-12-11 Koninklijke Philips N.V. Procédé et appareil servant à estimer une tendance dans un substitut de pression sanguine

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE3176658D1 (en) * 1981-12-10 1988-03-31 Revlon Process for making metallic leafing pigments
CN106343833B (zh) * 2016-09-08 2018-01-30 深圳市元征科技股份有限公司 一种智能镜子
EP3518710B1 (fr) * 2016-09-27 2022-12-28 Koninklijke Philips N.V. Appareil et procédé de support d'au moins un utilisateur dans l'exécution d'une activité de soins personnels
CN108920509A (zh) * 2018-05-30 2018-11-30 深圳市赛亿科技开发有限公司 一种智能化妆镜
CN111977985A (zh) * 2019-05-24 2020-11-24 科勒(中国)投资有限公司 镜面制作方法、智能镜子及镜柜

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3578100A1 (fr) * 2018-06-05 2019-12-11 Koninklijke Philips N.V. Procédé et appareil servant à estimer une tendance dans un substitut de pression sanguine

Also Published As

Publication number Publication date
EP4098154C0 (fr) 2023-08-16
EP4098154A1 (fr) 2022-12-07

Similar Documents

Publication Publication Date Title
US9060683B2 (en) Mobile wireless appliance
US8500636B2 (en) Health monitoring appliance
US8328718B2 (en) Health monitoring appliance
US20150269825A1 (en) Patient monitoring appliance
US20150099941A1 (en) Health monitoring appliance
US20120035433A1 (en) Examination and imaging of brain cognitive functions
US20070273504A1 (en) Mesh network monitoring appliance
US20240265730A1 (en) Body temperature monitoring device and wearable accessary having thermal sensor
US20040082862A1 (en) Examination and imaging of brain cognitive functions
CN106659397A (zh) 非接触式测温系统和方法
CA3130109A1 (fr) Detection et identification d'utilisateur dans un reglage de salle de bains
EP3906852A1 (fr) Procédé et système de reconnaissance biométrique, en particulier d'utilisateurs d'installations sanitaires
CN108567433A (zh) 一种多功能全光纤非侵入式的状态监测薄垫
CN110870761B (zh) 一种基于视触觉混合感知的皮肤检测系统
CN109419498A (zh) 一种多功能人体感知系统
EP3906844A1 (fr) Procédé et système d'évaluation biomédicale dans les installations sanitaires
EP4098154B1 (fr) Miroir sanitaire avec dispositif de surveillance
CN108720813A (zh) 一种用于乳腺癌监测的柔性传感器
RU2696042C2 (ru) Способ и система для регистрации движения глаз
HALABY et al. Novel approach of a smart medical mirror system for medical applications
US20210353155A1 (en) Body temperature detection safety kiosk
CN208808459U (zh) 一种皮肤生理指标测量装置
Pan et al. Infrared image processing for a physiological information telemetry system
EP3906849B1 (fr) Procédé et système de reconnaissance biométrique continue et/ou d'évaluation biomédicale dans des installations sanitaires
CN103431844A (zh) 人体生物遥感诊断技术

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20220304

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

INTG Intention to grant announced

Effective date: 20230316

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

RBV Designated contracting states (corrected)

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

Ref country code: DE

Ref legal event code: R096

Ref document number: 602021004270

Country of ref document: DE

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

U01 Request for unitary effect filed

Effective date: 20230823

U07 Unitary effect registered

Designated state(s): AT BE BG DE DK EE FI FR IT LT LU LV MT NL PT SE SI

Effective date: 20230927

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20231117

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20231216

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230816

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20231116

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20231216

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230816

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20231117

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230816

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230816

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230816

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230816

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230816

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230816

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230816

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602021004270

Country of ref document: DE

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

26N No opposition filed

Effective date: 20240517

U20 Renewal fee paid [unitary effect]

Year of fee payment: 4

Effective date: 20240621