EP3583540A1 - System and method for detecting the fatigue of a vehicle driver - Google Patents
System and method for detecting the fatigue of a vehicle driverInfo
- Publication number
- EP3583540A1 EP3583540A1 EP17800733.2A EP17800733A EP3583540A1 EP 3583540 A1 EP3583540 A1 EP 3583540A1 EP 17800733 A EP17800733 A EP 17800733A EP 3583540 A1 EP3583540 A1 EP 3583540A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- vehicle
- pupil diameter
- driver
- fatigue
- detected
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/59—Context or environment of the image inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
- G06V20/597—Recognising the driver's state or behaviour, e.g. attention or drowsiness
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
- B60W40/08—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/18—Eye characteristics, e.g. of the iris
- G06V40/19—Sensors therefor
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
- B60W40/08—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
- B60W2040/0818—Inactivity or incapacity of driver
Definitions
- the present invention relates to a system and method for detecting the fatigue of a driver of a vehicle.
- a system for accurately detecting the fatigue of a driver of a vehicle comprising:
- At least one camera for detecting the pupil diameter of the leader of
- At least one sensor for detecting a timely luminance in the vehicle
- the vehicle may be, for example, a motor vehicle, a rail vehicle, an aircraft, a watercraft, etc.
- at least one camera can be arranged, which is designed to recognize the pupil diameter of the driver of the vehicle (also referred to below as the driver).
- the vehicle may include at least one sensor for detecting a timely luminance in the vehicle. The luminance of a surface determines with which surface brightness the eye of the driver perceives the surface and thus has a direct relation to the optical
- the vehicle also includes a computing module configured to detect the fatigue of the driver of the vehicle by calculation. The calculation is based on the pupil diameter detected by the at least one camera and the detected, up-to-date luminance in the vehicle.
- the at least one camera preferably comprises a high-resolution interior camera and / or a high-resolution infrared camera.
- the at least one camera may include a high-resolution interior camera.
- the at least one camera may comprise a high-resolution infrared camera.
- the pupil diameter can still be determined very precisely even in very poor lighting conditions in the vehicle.
- the high-resolution interior camera and the high-resolution infrared camera can be implemented in a camera module. In another example, these may be implemented in different camera modules.
- the at least one camera can be any and / or suitable numerical combination
- Indoor cameras and / or infrared cameras include.
- the at least one sensor for detecting the up-to-date luminance in the vehicle comprises a sensor for the automatic driving light control, AFL sensor.
- the luminance x [cd / m 2 ] is the quotient of light intensity I [cd] and the visible illuminated area [m 2 ].
- the light intensity I [cd] is the product on the illuminance E [Ix] and the squared distance r [m] between the illuminated surface and the eye.
- the conversion can be done for example by the computing module or any other suitable module with appropriate computing capacity in the vehicle.
- such an AFL sensor already installed in the vehicle in addition to the automatic driving light control of the vehicle can be used for detecting the current luminance x, so that there is no need for an additional sensor for detecting the current luminance in the vehicle.
- the detection of the fatigue of the driver of the vehicle by the computing module comprises:
- Pupil diameter; and / or a sensor for high beam regulation can be corrected.
- the calculation of the pupil diameter D x in [mm] with respect to the detected, current luminance x can be calculated, for example, by the following formula: ⁇ _ ⁇ Q 0.8558-0.000401 + 8.4) 3
- the detected pupil diameter D xy indicates the pupil diameter of the driver with respect to the current luminance x and the fatigue of the driver y and can be represented as follows:
- the calculation of the fatigue of the driver of the vehicle by the computing unit may include appropriate correction factors.
- a correction factor with respect to the speed of reduction of the pupil diameter of the driver can be introduced or used, for example, by a temporal derivative of the pupil diameter of the driver. For example, if the pupil diameter of the driver decreases very rapidly, then the cause is a sudden incidence of light, and the detection of the
- the pupil diameter of the driver slowly over time (see Figure 3 and Figure 4), then the detection of fatigue by the computing module.
- the correction factor can result, for example, from the following formula:
- ⁇ is the constriction of the pupil diameter due to the incidence of light
- the computing module may also be previously for the driver
- the up-to-date luminance x can be corrected or regulated by the automatic high beam light sensor.
- the sensor for automatic high beam light control for example, at night driving an oncoming vehicle with the light on. From this, a correction factor for influencing the pupil diameter of the driver by the light of oncoming vehicles can be taken into account.
- the correction factor may include suspending the driver's fatigue calculation by the computing module when the oncoming vehicle is oncoming light detected by the automatic high beam light sensor.
- the computing module may take into account other correction factors in the calculation of the driver's fatigue, e.g. Day and / or seasons and / or current weather conditions in connection with the vehicle orientation.
- Vehicle orientation can be determined, for example, by a navigation system in the vehicle, with data relating to the daily and / or seasons and current
- Weather conditions can be obtained from a storage unit in the vehicle and / or one or more (backend) servers.
- the system further comprises:
- the control unit is set up to initiate at least a corresponding countermeasure when the driver of the vehicle detects tiredness.
- the countermeasure may be an optical (eg via a
- Output unit in the vehicle and / or acoustic (for example via a speaker in the vehicle) and / or to reduce the interior temperature, for example by a
- the underlying object is achieved by a method for accurately detecting the fatigue of a driver of a vehicle, comprising:
- the at least one camera preferably comprises a high-resolution interior camera and / or a high-resolution infrared camera.
- the at least one sensor for detecting the up-to-date luminance in the vehicle comprises a sensor for the automatic driving light control, AFL sensor.
- the detection of the fatigue of the driver of the vehicle by the computing module comprises:
- the method preferably includes initiating, by means of at least one control unit, a countermeasure when fatigue is detected.
- Fig. 1 shows an exemplary system for the exact detection of fatigue of a
- Fig. 2 shows an exemplary method for the exact detection of fatigue
- Fig. 3 shows a decrease in the pupil diameter of subjects at
- FIG. 4 shows an exemplary decrease of the pupil diameter of subjects during monotonous driving and constant light conditions with time as well as the positive influence of an external stimulus on the fatigue of the person
- FIG. 1 shows an exemplary system 100 for the exact detection of the tiredness of a driver 120 of a vehicle 110 (hereinafter also referred to as driver 120).
- the vehicle 110 may be, for example, a motor vehicle, a rail vehicle, an aircraft, a watercraft, etc.
- the system 100 includes at least one camera 1 12 for detecting the pupil diameter of the driver 120.
- the at least one camera 1 12 can include a high-resolution indoor camera.
- the pupil diameter of the driver 120 can be determined very accurately by means of a high-resolution interior camera.
- the at least one camera 12 may comprise a high-resolution infrared camera.
- the pupil diameter of the driver 120 can still be determined very accurately even in very poor light conditions (eg darkness, tunnels, etc.) in the vehicle 110.
- the high-resolution interior camera and the high-resolution infrared camera can be implemented in a camera module. In another example, these may be implemented in different camera modules.
- the at least one camera 12 may comprise any desired and / or suitable numerical combination of interior cameras and / or infrared cameras.
- the system 100 also includes at least one sensor 1 16 A for detecting a
- the luminance (of a surface in the vehicle 1 10) determines the surface brightness with which the eye of the driver 120 perceives the surface and thus has a direct relation to the visual sensory perception.
- the at least one sensor 1 16 A for detecting the timely luminance in the vehicle 1 10 may include a sensor for the automatic driving light control, AFL sensor 1 16 A.
- the sensor for the automatic driving light control (AFL sensor) 1 16 A for example, a timely luminance x detect.
- AFL sensor 1 16 A is configured to detect illuminance on the vehicle surroundings (ie, which luminous flux in lumens, Im, falls on a unit area surrounding the vehicle in m 2 , also Lux,
- the luminance x [cd / m 2 ] is the quotient of light intensity I [cd] and the visible illuminated area [m 2 ].
- the light intensity I [cd] is the product on the illuminance E [Ix] and the squared distance r [m] between the illuminated surface and the eye.
- the conversion can for example be done by the computing module 1 14, see below, or any other suitable module (not shown) with corresponding computing capacity in the vehicle 1 10.
- such an AFL sensor 1 16 A already installed in the vehicle 1 10 can be used for detecting the current luminance x, so that there is no additional sensor for detecting the timely luminance in the vehicle 1 10 needs.
- the system 100 may further comprise at least one calculation module 1 14 for detecting the fatigue of the driver of the vehicle 120 by calculation, wherein the calculation based on the detected pupil diameter and the detected, timely luminance in the vehicle 1 10.
- the computing module 1 14 may perform the calculation based on the detected by the at least one camera 1 12 pupil diameter of the driver 120 and the detected by the at least one sensor 1 16 A, timely luminance in the vehicle 1 10. In particular, the computing module 1 14, the calculation of the
- the pupil diameter D xy detected by the at least one camera 12 indicates the pupil diameter of the driver 120 with reference to the current luminance x and the fatigue of the driver y and can be represented as follows:
- a comparison of the pupil diameter detected by the at least one camera 12 with the pupil diameter calculated by the computing module 1 14 can be compared
- the calculation of the fatigue of the driver 120 of the vehicle 1 10 by the computing unit 1 14 may include appropriate correction factors. For example, a
- Correction factor with respect to the speed of reduction of the pupil diameter of the driver 120 may be introduced or used, for example, by taking a time derivative of the pupil diameter of the driver 120. For example, if the pupil diameter of the driver 120 decreases very rapidly, then the cause is a sudden one
- the fatigue detection is performed by the computing module 1 14.
- the correction factor can result, for example, from the following formula:
- the computing module 1 14 can also be used for data previously stored for the driver 120 (for example in a memory unit 1 18 in the vehicle 1 10)
- the up-to-the-minute luminance x can be corrected or regulated by the automatic highbeam control sensor 1 16 B
- the sensor for automatic high beam regulation 1 16 B for example, a night driving
- the correction factor may be detected by the sensor for automatic high beam regulation 1 16 B,
- Oncoming vehicle with the light on the suspension of the calculation of the fatigue of the driver 120 by the computing module 1 14 include.
- Calculation module 1 14 take into account further correction factors in the calculation of the driver's fatigue 120, e.g. Daily and / or seasons and / or current
- the vehicle orientation can be determined, for example, by a navigation system in the vehicle, wherein data relating to the times of day and / or seasons and current weather conditions can be obtained from a memory unit 118 in the vehicle 110 and / or from one or more (backend) servers 130 ,
- the system 100 may further comprise at least one control unit 118, wherein the
- Control unit 1 18 is set to initiate at least recognized a corresponding countermeasure if fatigue of the driver 120 or driver 120 of the vehicle 1 10 detected.
- the countermeasure may be an optical (e.g.
- Vehicle 1 10 act, as exemplified below with reference to Figures 3 and 4 explained.
- FIG. 2 shows an exemplary method 200 for the exact detection of the fatigue of a driver 120 of a vehicle 110 (hereinafter also referred to as driver 120), wherein the
- Method steps can be performed by a system 100 as described with reference to Figure 1, and the method steps can be carried out as described with reference to Figure 1.
- the method comprises:
- Detecting 210 by at least one camera 1 12, the pupil diameter of the guide 120 of the vehicle 1 10, wherein the at least one camera 1 12 may include a high-resolution interior camera and / or a high-resolution infrared camera.
- Detect 230 by calculation in a computing module 1 14, if there is fatigue of the driver 120 of the vehicle 1 10, wherein the calculation based on the at least one camera 1 12 detected pupil diameter and the detected, timely luminance in the vehicle 1 10.
- Detecting 230 the fatigue of the driver 120 of the vehicle 1 10 (or driver 120) by the computing module 14 may include:
- the method may also include initiating 240, by at least one control unit 118, a countermeasure of fatigue 236 detected by the computing module 1 14, as described with reference to FIGS. 3 and 4, for example.
- FIG. 3 shows a decrease in the average pupil diameter in millimeters (mm) 310 of subjects during monotonous travel over time in minutes (min) 320, whereby the subjects were confronted with external stimuli at specific times, in particular in minutes 5, 10 and 27 ,
- mm millimeters
- min minutes
- FIGS. 3 and 4 show a decrease in the average pupil diameter in millimeters (mm) 310 of subjects during monotonous travel over time in minutes (min) 320, whereby the subjects were confronted with external stimuli at specific times, in particular in minutes 5, 10 and 27 .
- Pupil diameters in minutes 5, 10 and 27 were created in particular by verbal questioning of the subjects during the test drives in the simulator. In particular, this involves the evaluation or results of a driving simulator study. It thus turns out that a cognitive effort, such as the answer to questions, a widening of the pupil diameter and thus an increased alertness or an increased
- Attention level includes.
- FIG. 4 shows an exemplary decrease in the diameter of the pupil in mm 410 of subjects during monotonous driving with time in min 420.
- the positive influence of an external stimulus on the fatigue of the subjects is shown as of minute 20 as the result of another driving simulator study.
- the pupil diameter is very well suited as indicator for the tiredness or vigilance of drivers, as long as the lighting conditions are constant.
- the system 100 and method 200 described with reference to FIGS. 1 and 2 now permit accurate detection of the fatigue of drivers 120 by taking into account non-constant lighting conditions related to the pupil diameter.
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Multimedia (AREA)
- Transportation (AREA)
- Mechanical Engineering (AREA)
- Mathematical Physics (AREA)
- Automation & Control Theory (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Ophthalmology & Optometry (AREA)
- Human Computer Interaction (AREA)
- Traffic Control Systems (AREA)
- Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
- Eye Examination Apparatus (AREA)
Abstract
Description
Claims
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
DE102017202659.6A DE102017202659A1 (en) | 2017-02-20 | 2017-02-20 | System and method for detecting the fatigue of a driver |
PCT/EP2017/078018 WO2018149519A1 (en) | 2017-02-20 | 2017-11-02 | System and method for detecting the fatigue of a vehicle driver |
Publications (1)
Publication Number | Publication Date |
---|---|
EP3583540A1 true EP3583540A1 (en) | 2019-12-25 |
Family
ID=60387991
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP17800733.2A Pending EP3583540A1 (en) | 2017-02-20 | 2017-11-02 | System and method for detecting the fatigue of a vehicle driver |
Country Status (5)
Country | Link |
---|---|
US (1) | US10832068B2 (en) |
EP (1) | EP3583540A1 (en) |
CN (1) | CN110313007B (en) |
DE (1) | DE102017202659A1 (en) |
WO (1) | WO2018149519A1 (en) |
Families Citing this family (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DE102021111465A1 (en) | 2021-05-04 | 2022-11-10 | Bayerische Motoren Werke Aktiengesellschaft | DETERMINING A PERSON'S FATIGUE BASED ON AN ANALYSIS OF AN EYE BLINK |
CN113925512B (en) * | 2021-10-14 | 2023-10-20 | 东风汽车集团股份有限公司 | Fatigue detection method and device based on visual field focus |
Family Cites Families (18)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DE19803158C1 (en) | 1998-01-28 | 1999-05-06 | Daimler Chrysler Ag | Arrangement for determining the state of vigilance, esp. for machinery operator or vehicle driver |
US6926429B2 (en) * | 2002-01-30 | 2005-08-09 | Delphi Technologies, Inc. | Eye tracking/HUD system |
AUPS254302A0 (en) | 2002-05-24 | 2002-06-13 | Resmed Limited | A sleepiness test |
US7280678B2 (en) * | 2003-02-28 | 2007-10-09 | Avago Technologies General Ip Pte Ltd | Apparatus and method for detecting pupils |
US7963652B2 (en) * | 2003-11-14 | 2011-06-21 | Queen's University At Kingston | Method and apparatus for calibration-free eye tracking |
DE10359125A1 (en) | 2003-12-17 | 2005-07-14 | Volkswagen Ag | Motor vehicle driver`s reflex action recognizing method, involves measuring brightness of ambient light and reflex time taken by pupil of driver against light, and generating threshold value for automatic tiredness estimate of driver |
DE102004005163B3 (en) | 2004-02-02 | 2005-06-02 | Braun, Uwe Peter, Dipl.-Ing. | Alertness detection device for vehicle driver using intermittent illumination of eye and evaluation of pupil reaction |
RU2395228C2 (en) | 2004-04-01 | 2010-07-27 | Уилльям С. ТОРЧ | Biosensors, communicators and controllers for eye movement monitoring and methods of their application |
US7438418B2 (en) * | 2005-02-23 | 2008-10-21 | Eyetracking, Inc. | Mental alertness and mental proficiency level determination |
US7747068B1 (en) * | 2006-01-20 | 2010-06-29 | Andrew Paul Smyth | Systems and methods for tracking the eye |
WO2008024639A2 (en) * | 2006-08-11 | 2008-02-28 | Donnelly Corporation | Automatic headlamp control system |
KR101576319B1 (en) | 2008-09-18 | 2015-12-09 | 학교법인 츄부대학 | Sleepiness signal detector |
CN102439627B (en) | 2010-02-26 | 2014-10-08 | 松下电器(美国)知识产权公司 | Pupil detection device and pupil detection method |
US9468372B2 (en) | 2013-02-28 | 2016-10-18 | Johnson & Johnson Vision Care, Inc. | Electronic ophthalmic lens with rear-facing pupil diameter sensor |
US9751534B2 (en) * | 2013-03-15 | 2017-09-05 | Honda Motor Co., Ltd. | System and method for responding to driver state |
DE102013212877A1 (en) | 2013-07-02 | 2015-01-08 | Volkswagen Aktiengesellschaft | Method and device for determining the condition of a motor vehicle driver |
US9867563B2 (en) | 2014-01-10 | 2018-01-16 | Carleton Life Support Systems Inc. | Reduced cognitive function detection and alleviation system for a pilot |
US10845620B2 (en) * | 2014-12-08 | 2020-11-24 | Aleksandr Shtukater | Smart contact lens |
-
2017
- 2017-02-20 DE DE102017202659.6A patent/DE102017202659A1/en active Pending
- 2017-11-02 EP EP17800733.2A patent/EP3583540A1/en active Pending
- 2017-11-02 WO PCT/EP2017/078018 patent/WO2018149519A1/en active Application Filing
- 2017-11-02 CN CN201780086832.1A patent/CN110313007B/en active Active
-
2019
- 2019-08-19 US US16/543,856 patent/US10832068B2/en active Active
Also Published As
Publication number | Publication date |
---|---|
DE102017202659A1 (en) | 2018-08-23 |
CN110313007A (en) | 2019-10-08 |
CN110313007B (en) | 2023-08-04 |
WO2018149519A1 (en) | 2018-08-23 |
US10832068B2 (en) | 2020-11-10 |
US20190370582A1 (en) | 2019-12-05 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
DE102011109564B4 (en) | Method and device for monitoring at least one vehicle occupant and method for operating at least one assistance device | |
DE102004022581B4 (en) | Driver assistance system | |
DE102011016772B4 (en) | 12.04.2021Method and device for monitoring at least one vehicle occupant and method for operating at least one assistance device | |
DE102018207069B4 (en) | Method and control unit for operating an autonomous vehicle | |
DE102015216143A1 (en) | A system and method for generating an environmental condition in or about a vehicle in response to a detected mood | |
DE102019003429A1 (en) | Method for the prediction and reduction of kinetosis-related disorders | |
DE112014000591T5 (en) | Attention-level detection device and attention-level detection method | |
DE102019208663B4 (en) | Method for supporting a driver with regard to objects and motor vehicle relevant to a traffic situation | |
DE102011110486A1 (en) | Method and device for monitoring at least one vehicle occupant and method for operating at least one assistance device | |
DE102019109505A1 (en) | DATA PROCESSING DEVICE, MONITORING SYSTEM, WECKSYSTEM, DATA PROCESSING METHOD AND DATA PROCESSING PROGRAM | |
DE102014201036A1 (en) | Image-based classification of driver status and / or driver behavior | |
DE112017007267T5 (en) | Concentration determining apparatus, concentration degree determination method, and concentration degree determination program | |
DE102012105285A1 (en) | Method for assisting rider of motor car, involves defining a warning strategy based on the derived rider intention of current rider, and adjusting motor car rider assistance system if necessary | |
DE102014216208A1 (en) | Method and device for determining a reaction time of a vehicle driver | |
DE102011085825A1 (en) | Method and device for warning the driver of a motor vehicle in case of lack of attention | |
DE102018213230A1 (en) | Method and control device for warning a driver of a motor vehicle and motor vehicle with such a control device | |
WO2004103761A1 (en) | Device for the individual adjustment of the movement dynamics of a motor vehicle | |
DE102019201407A1 (en) | Method and device for controlling a driver's attention | |
EP3583540A1 (en) | System and method for detecting the fatigue of a vehicle driver | |
DE102017103391A1 (en) | Method for improving the user-friendliness of a vehicle | |
DE102019004692B3 (en) | Device and method for determining image data of the eyes, eye positions and / or a line of sight of a vehicle user in a vehicle | |
DE102020110417A1 (en) | Method and system for assisting a driver | |
DE102018217183B4 (en) | Learning a light distribution for a headlight | |
DE112022001065T5 (en) | INFORMATION PROCESSING DEVICE, INFORMATION PROCESSING METHOD AND INFORMATION PROCESSING PROGRAM | |
DE102014019246B4 (en) | Driver assistance device for a motor vehicle and a method for operating such |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: UNKNOWN |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE |
|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
|
17P | Request for examination filed |
Effective date: 20190730 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
AX | Request for extension of the european patent |
Extension state: BA ME |
|
DAV | Request for validation of the european patent (deleted) | ||
DAX | Request for extension of the european patent (deleted) | ||
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: EXAMINATION IS IN PROGRESS |
|
17Q | First examination report despatched |
Effective date: 20210728 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: EXAMINATION IS IN PROGRESS |
|
P01 | Opt-out of the competence of the unified patent court (upc) registered |
Effective date: 20230502 |