EP3493178B1 - Verfahren und vorrichtung zur erkennung der aufmerksamkeit eines fahrers - Google Patents
Verfahren und vorrichtung zur erkennung der aufmerksamkeit eines fahrers Download PDFInfo
- Publication number
- EP3493178B1 EP3493178B1 EP17204922.3A EP17204922A EP3493178B1 EP 3493178 B1 EP3493178 B1 EP 3493178B1 EP 17204922 A EP17204922 A EP 17204922A EP 3493178 B1 EP3493178 B1 EP 3493178B1
- Authority
- EP
- European Patent Office
- Prior art keywords
- vehicle
- warning
- driver
- partly
- signal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000001514 detection method Methods 0.000 title claims description 8
- 238000000034 method Methods 0.000 claims description 24
- 230000007613 environmental effect Effects 0.000 claims description 4
- 230000005236 sound signal Effects 0.000 claims description 3
- 210000003128 head Anatomy 0.000 description 3
- 238000012544 monitoring process Methods 0.000 description 3
- 206010041349 Somnolence Diseases 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000001815 facial effect Effects 0.000 description 1
- 230000000977 initiatory effect Effects 0.000 description 1
- 230000000414 obstructive effect Effects 0.000 description 1
- 230000000704 physical effect Effects 0.000 description 1
- 238000005070 sampling Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/16—Anti-collision systems
- G08G1/167—Driving aids for lane monitoring, lane changing, e.g. blind spot detection
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
- B60W40/08—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
- B60W40/02—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to ambient conditions
- B60W40/04—Traffic conditions
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
- B60W50/08—Interaction between the driver and the control system
- B60W50/14—Means for informing the driver, warning the driver or prompting a driver intervention
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/56—Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
- G06V20/58—Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/56—Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
- G06V20/588—Recognition of the road, e.g. of lane markings; Recognition of the vehicle driving pattern in relation to the road
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/59—Context or environment of the image inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
- G06V20/597—Recognising the driver's state or behaviour, e.g. attention or drowsiness
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W2520/00—Input parameters relating to overall vehicle dynamics
- B60W2520/14—Yaw
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W2540/00—Input parameters relating to occupants
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W2540/00—Input parameters relating to occupants
- B60W2540/18—Steering angle
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W2540/00—Input parameters relating to occupants
- B60W2540/225—Direction of gaze
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W2540/00—Input parameters relating to occupants
- B60W2540/229—Attention level, e.g. attentive to driving, reading or sleeping
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W2552/00—Input parameters relating to infrastructure
- B60W2552/53—Road markings, e.g. lane marker or crosswalk
Definitions
- the present disclosure relates to a vehicle safety system comprising at least one image sensor device, a control unit arrangement and at least one warning device.
- the image sensor device is arranged to detect eye configurations of a vehicle driver.
- said external rear-view mirror is equipped with a warning light source that is adapted to emit a light when a vehicle is determined to be present in the blind spot field.
- a determining is for example enabled by means of a vehicle environment detecting system such as a vehicle radar system comprised in the ego vehicle. This means that when a driver of the ego vehicle is about to change lanes and looks in the suitable external rear-view mirror and there is a vehicle in the blind spot field and thus is difficult to see, the driver is warned by the emitted light from the warning light source.
- GB 2500690 discloses a driver monitoring system, where, if a vehicle is detected in a blind spot by a blind spot monitoring system, an output alert can be modified depending on whether the driver is determined as looking at the blind spot.
- the vehicle safety system further is adapted to determine the following cases:
- the vehicle safety system is adapted to issue the second warning signal.
- a number of advantages are obtained by means of the present disclosure. Mainly, a much less complicated device and method for detection of vehicle driver attentiveness by determining where a driver is looking is provided, without the need for calculating such things as gaze angles, head angles and models for facial features.
- Figure 1 schematically shows a top view of an ego vehicle 1 arranged to run in a first lane 2a on a road 2, where the ego vehicle 1 comprises a vehicle radar system 3.
- the vehicle radar system 3 comprises a radar sensor arrangement 4 that is arranged to distinguish and/or resolve targets from the surroundings by transmitting signal 6 and receiving corresponding reflected signals 7 and using a Doppler effect in a previously well-known manner.
- the signals 6, 7 are according to some aspects constituted by sweep signals in the form of FMCW (Frequency Modulated Continuous Wave) chirp signals 6 of a previously known kind.
- FMCW Frequency Modulated Continuous Wave
- the vehicle radar system 3 further comprises a radar control unit 5 that is connected to the radar sensor arrangement 4 and is arranged to provide azimuth angles, distance and radial velocity of possible target object detections by simultaneously sampling and analyzing phase and amplitude of the received signals in a previously well-known manner.
- a radar control unit 5 that is connected to the radar sensor arrangement 4 and is arranged to provide azimuth angles, distance and radial velocity of possible target object detections by simultaneously sampling and analyzing phase and amplitude of the received signals in a previously well-known manner.
- the ego vehicle comprises a left-hand external rear-view mirror 8, a right-hand external rear-view mirror 9 and an internal rear-view mirror 10.
- Each external rear-view mirror 8, 9 is equipped with a corresponding warning light source 11, 12 that is adapted to emit a warning light when a target vehicle 13 travelling in an adjacent second lane 2b, constituting a target lane 2b, is determined to at least partly be present in a left-hand blind spot field 14 or right-hand blind spot field 15, where a blind spot field 14, 15 is outside a coverage 34, 35 of the external rear-view mirrors 8, 9 and a coverage 36 of the internal rear-view mirror 10.
- Such a determining is generally enabled by means of a vehicle environment detecting system, according to some aspects by means of the vehicle radar system 3 comprised in the ego vehicle 1.
- the vehicle radar system 3 comprised in the ego vehicle 1.
- the radar system is adapted to determine if there is a target vehicle 13 in a blind spot field 14, 15.
- a target vehicle 13 is determined to be in the left-hand blind spot field 14, and thus difficult to see.
- a safety control unit 22 is then informed of this fact by radar control unit 5, where the safety control unit 22 then is adapted to warn the driver by initiating light emission from a left-hand warning light source 11 at the left-hand external rear-view mirror 8. It is, however, necessary that the driver looks at the left-hand external rear-view mirror 8 when being about to change lanes in order to discover the emitted light from the left-hand warning light source 11.
- a problem regarding deteriorated attentiveness is that, generally, persons do not detect their own lack of attentiveness when it appears. It is thus difficult for a person to be aware of lack of attentiveness, and to take action for counteraction. Deteriorated attentiveness may be due to different factors such as distracting objects or gadgets as well as drowsiness.
- FIG. 2 An example is shown in Figure 2 that schematically shows a cut-open part of the ego vehicle 1, where the ego vehicle 1 comprises a near infrared (NIR) internal digital camera device 17 positioned on a dashboard 31 with two NIR light sources F such as flashes, where the internal digital camera device 17 is comprised in a driver monitoring system (DMS).
- NIR near infrared
- DMS driver monitoring system
- the internal digital camera device 17 is arranged for capturing images of the eyes 21 of a person 19 driving the vehicle 1, a driver 19, and transferring these images to an image control unit 20.
- the image control unit 20 is adapted to process the acquired images and determine the position of the driver's eyes 21, and to determine where the gaze 23 of the eyes 21 falls.
- the image control unit 20 is adapted to determine if the gaze 23 of the eyes 21 falls within a warning light window 24, 25, where each warning light window 24, 25 encompasses a warning light source 11, 12, when the warning light source 11, 12 has been initiated to emit a warning light that generally is constituted by a first warning signal.
- a left-hand warning light window 24 is indicated for the left-hand warning light source 11
- a right-hand warning light window 25 is indicated for a right-hand warning light source 12 at the right-hand external rear-view mirror 9.
- the safety control unit 22 is adapted to acquire information regarding:
- a target vehicle 13 there is a target vehicle 13 within a blind spot field 14, and if it also is determined that the driver 19 is about to change to a lane where the target vehicle 13 travels, and if it also is determined that the gaze 23 of the eyes 21 falls outside the left-hand warning light window 24, a second warning signal is issued to the driver.
- the second warning signal is according to some aspects constituted by a sound signal, a tactile signal such as an induced vibration at a steering wheel 26, a dashboard warning light signal 27, or any combination of these.
- the safety control unit 22 in order to acquire information regarding if the driver 19 is about to change lanes, is adapted to:
- the ego vehicle 1 comprises at least one of an external front-facing camera arrangement 29, and a yaw angle sensor arrangement 30, where the safety control unit 22 is adapted to acquire data regarding a signal indicator lever setting, and applicable sensor data.
- the safety control unit 22 is adapted to acquire data regarding a signal indicator lever setting, and applicable sensor data.
- sensor devices 42 that provide sensor data to the safety control unit 22.
- Such sensor devices for example comprise the yaw angle sensor arrangement 30, a sensor for the signal indicator lever setting, the external front-facing camera arrangement 29.
- the present disclosure relates to a method for detecting attentiveness of a vehicle driver 19 with respect to at least one warning device 11, 12 that is initiated to emit a first warning signal, where the method comprises:
- the present disclosure is not limited to the examples above, but may vary freely within the scope of the appended claims.
- the internal digital camera device 17 should be placed as close as possible to the line of sight of the driver 19 when the driver 19 is looking forward. However, the placement is more important in the horizontal direction than the vertical direction.
- Examples for camera positions are at the steering wheel 26, at a steering column 32, at the dashboard 31 or in the inner roof lining 33 as indicated in Figure 1 .
- Other examples are airbag covers, sun visors, the internal rear-view mirror 10, and/or in the vehicle A-pillars.
- the internal digital camera device 17 If the internal digital camera device 17 is positioned straight in front of the driver 19, it is less complicated to determine if the driver 19 is looking inside the predetermined field of view due to more available data. However, for practical reasons this may not be possible due to space limitations, design reasons and view obstructive reasons.
- control units 5, 20, 22 are according to some aspects comprised by one common or several separate units, and may also be comprised in another unit.
- the control units generally form a control unit arrangement 5, 20, 22.
- the drivers gaze 23 falls is determined by using stored models of eye configuration samples that are indicative of eyes that look inside a predetermined field of view such as warning light window 24, 25. It is possible that stored models of eye configuration samples that are indicative of eyes that look outside a predetermined field of view, or both, are used instead.
- the vehicle driver 19 is determined to be looking outside a warning light window 24, 25 when the gaze 23 falls outside that warning light window 24, 25 to a predetermined extent.
- the present disclosure relates to a vehicle safety system 37 comprising at least one internal digital camera device 17, a control unit arrangement 5, 20, 22 and at least one warning light source 11, 12 or other type of warning device.
- the vehicle safety system 37 comprises at least one environmental detection device 3 such as the radar system 3, a Lidar arrangement, an external camera device or similar, where the environmental detection device is adapted to detect if a target vehicle 13 at least partly is present within a blind spot field 14, 15 that is outside a coverage 34, 35, 36 of available rear-view mirrors 8, 9, 10 for the driver 19.
- the vehicle safety system 37 also comprises sensor devices 42 that are adapted to provide sensor data to the control unit arrangement 5, 20, 22.
- the coverages 34, 35, 36 mentioned above are related to the coverages 34, 35, 36 that are available for the driver 19. These coverages 34, 35, 36 of course change due to positioning of the rear-view mirrors 8, 9, 10, the physical properties of the driver 19 such as height as well as the driver's present head position.
- the blind spot fields 14, 15 are according to some aspects predetermined from a model that covers most of all normal cases. According to other aspects, the blind spot fields 14, 15 are determined adaptively by means of determined eye positions of the driver 19 relative the rear-view mirrors 8, 9, 10.
- the present disclosure is directed towards detecting whether a driver is noticing an activated warning light source 11, 12 associated with an external rear-view mirror 9, 10. Generally, the present disclosure is directed towards detecting whether the driver 19 is noticing a first warning signal emitted from a warning device 11, 12. Generally, each warning light window 24, 25 is constituted by a corresponding warning area 24, 25.
- the parts of the vehicle safety system 37 normally comprise many more components that those mentioned, and it is to be understood that the present description is directed towards an understanding of the present disclosure. Components not shown or described are considered to be obvious for the skilled person, having well-known functionalities.
- the present disclosure relates to a vehicle safety system 37 comprising at least one image sensor device 17, a control unit arrangement 5, 20, 22 and at least one warning device 11, 12, where said image sensor device 17 is arranged to detect eye configurations of a vehicle driver 19.
- the control unit arrangement 5, 20, 22 is arranged to determine if the vehicle driver 19 at least partly is looking outside a warning area 24, 25 that at least partly encompasses said warning device 11, 12, and in that case to issue a second warning signal.
- the vehicle safety system 37 further comprises at least one environmental detection device 3 that is adapted to determine whether a target vehicle 13 at least partly is within a blind spot field 14, 15 that is outside a coverage 34, 35, 36 of available rear-view mirrors 8, 9, 10 for the vehicle driver 19.
- the vehicle safety system 37 further is adapted to determine the following cases:
- the present disclosure relates to a method for detecting attentiveness of a vehicle driver 19 with respect to at least one warning device 11, 12 that is initiated to emit a first warning signal, where the method comprises:
- the method further comprises determining whether a target vehicle 13 at least partly is within a blind spot field 14, 15 that is outside a coverage 34, 35, 36 of available rear-view mirrors 8, 9, 10 for the vehicle driver 19.
- the method further comprises determining the following cases:
- the method further comprises determining if the vehicle driver 19 is about to change lanes by:
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Automation & Control Theory (AREA)
- General Physics & Mathematics (AREA)
- Transportation (AREA)
- Mechanical Engineering (AREA)
- Multimedia (AREA)
- Theoretical Computer Science (AREA)
- Mathematical Physics (AREA)
- Human Computer Interaction (AREA)
- Traffic Control Systems (AREA)
Claims (6)
- Fahrzeugsicherheitssystem (37), umfassend mindestens eine Bildsensorvorrichtung (17), eine Steuereinheitsanordnung (5, 20, 22), mindestens eine Umgebungserfassungsvorrichtung (3), die angepasst ist, um zu bestimmen, ob ein Zielfahrzeug (13) mindestens teilweise innerhalb eines toten Winkelfeldes (14, 15) liegt, das sich außerhalb einer Abdeckung (34, 35, 36) von verfügbaren Rückspiegeln (8, 9, 10) für den Fahrzeugführer (19) befindet, und mindestens eine Warnvorrichtung (11, 12), die angepasst ist, um ein erstes Warnsignal in Form einer Warnleuchte abzugeben, wenn ein Zielfahrzeug (13), das sich in einer benachbarten zweiten Fahrspur (2b) bewegt, die eine Zielfahrspur (2b) bildet, bestimmt ist, um in einem linken toten Winkelfeld (14) oder einem rechten toten Winkelfeld (15) mindestens teilweise vorhanden zu sein, wobei die Bildsensorvorrichtung (17) angeordnet ist, um Augenkonfigurationen eines Fahrzeugführers (19) zu erfassen und um diese Bilder an eine Bildsteuereinheit (20) zu übertragen, wobei die Bildsteuereinheit (20) angepasst ist, um die erlangten Bilder zu verarbeiten und die Position der Augen (21) eines Fahrers zu bestimmen und um zu bestimmen, wohin der Blick (23) der Augen (21) fällt, dadurch gekennzeichnet, dass, wenn die Warnvorrichtung (11, 12) veranlasst wird, das erste Warnsignal in Form einer Warnleuchte abzugeben, die Bildsteuereinheit (20) angeordnet ist, um zu bestimmen, ob der Fahrzeugführer (19) mindestens teilweise außerhalb eines Warnbereichs (24, 25) schaut, der die Warnvorrichtung (11, 12) umschließt, und wobei in diesem Fall die Steuereinheitsanordnung (5, 20, 22) angeordnet ist, um ein zweites Warnsignal auszugeben, wobei das zweite Warnsignal durch ein Tonsignal, ein taktiles Signal oder eine beliebige Kombination dieser gebildet wird.
- Fahrzeugsicherheitssystem (37) nach Anspruch 1, wobei das Fahrzeugsicherheitssystem (37) ferner angepasst ist, um die folgenden Fälle zu bestimmen:- ob der Fahrzeugführer (19) im Begriff ist, die Fahrspuren zu wechseln,- ob sich ein Zielfahrzeug (13) mindestens teilweise innerhalb eines toten Winkelfeldes (14, 15) befindet, das dem möglichen Fahrspurwechsel entspricht, und- ob der Fahrzeugführer (19) mindestens teilweise außerhalb eines Warnbereichs (24, 25) schaut, der eine Warnvorrichtung (11, 12) umschließt, die mit dem möglichen Fahrspurwechsel verknüpft ist,und wobei, wenn alle diese Fälle erfüllt sind, das
Fahrzeugsicherheitssystem angepasst wird, um das zweite Warnsignal auszugeben. - Fahrzeugsicherheitssystem nach Anspruch 2, wobei das Fahrzeugsicherheitssystem (37) angepasst ist, um zu bestimmen, ob der Fahrzeugführer (19) im Begriff ist, die Fahrspuren zu wechseln, indem es angepasst ist zum:- Bestimmen einer Einstellung eines Signalblinkerhebels (28),- Bestimmen einer Änderung eines Lenkwinkels mittels einer Gierwinkelsensoranordnung (30) und/oder- Bestimmen einer Fahrzeugbewegung in Bezug auf Straßenmarkierungen mittels einer externen nach vorne gerichteten Kameraanordnung (29).
- Verfahren zum Erfassen einer Aufmerksamkeit eines Fahrzeugführers (19) in Bezug auf mindestens eine Warnvorrichtung (11, 12), die veranlasst wird, ein erstes Warnsignal in Form einer Warnleuchte abzugeben, wobei das Verfahren umfasst:Bestimmen, ob sich ein Zielfahrzeug (13) mindestens teilweise innerhalb eines toten Winkelfeldes (14, 15) befindet, das sich außerhalb einer Abdeckung (34, 35, 36) von verfügbaren Rückspiegeln (8, 9, 10) für den Fahrzeugführer (19) befindet;Abgeben des ersten Warnsignals in Form einer Warnleuchte, wenn für ein Zielfahrzeug (13), das sich in einer benachbarten zweiten Fahrspur (2b) bewegt, die eine Zielfahrspur (2b) bildet, bestimmt wird, mindestens teilweise in einem linken toten Winkelfeld (14) oder einem rechten toten Winkelfeld vorhanden zu sein;(38) Erfassen von Augenkonfigurationen des Fahrzeugführers (19) und ein Bestimmen der Position der Augen (21) eines Fahrers und wohin der Blick (23) der Augen (21) fällt;dadurch gekennzeichnet, dass,(43) wenn die Warnvorrichtung (11, 12) veranlasst wird, das erste Warnsignal abzugeben, das Verfahren ferner umfasst:(39) Bestimmen, ob der Fahrzeugführer (19) mindestens teilweise außerhalb eines Warnbereichs (24, 25) schaut, der die Warnvorrichtung (11, 12) umschließt, und wenn dies der Fall ist:(40) Ausgeben eines zweiten Warnsignals, wobei das zweite Warnsignal durch ein Tonsignal, ein taktiles Signal oder eine beliebige Kombination dieser gebildet wird.
- Verfahren nach Anspruch 4, wobei das Verfahren ferner das Bestimmen der folgenden Fälle umfasst:- ob der Fahrzeugführer (19) im Begriff ist, die Fahrspuren zu wechseln,- ob sich ein Zielfahrzeug (13) mindestens teilweise innerhalb eines toten Winkelfeldes (14, 15) befindet, das dem möglichen Fahrspurwechsel entspricht, und- ob der Fahrzeugführer (19) mindestens teilweise außerhalb eines Warnbereichs (24, 25) schaut, der eine Warnvorrichtung (11, 12) umschließt, die mit dem möglichen Fahrspurwechsel verknüpft ist,und wobei, wenn alle diese Fälle erfüllt sind, das Verfahren ferner ein Ausgeben des zweiten Warnsignals umfasst.
- Verfahren nach Anspruch 5, wobei das Verfahren ferner das Bestimmen umfasst, ob der Fahrzeugführer (19) im Begriff ist, die Fahrspuren zu wechseln durch:- Bestimmen einer Einstellung des Signalblinkerhebels (28),- Bestimmen einer Änderung des Lenkwinkels durch Verwenden einer Gierwinkelsensoranordnung (30) und/oder- Bestimmen der Fahrzeugbewegung in Bezug auf Straßenmarkierungen durch Verwenden einer externen nach vorne gerichteten Kameraanordnung (29).
Priority Applications (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP17204922.3A EP3493178B1 (de) | 2017-12-01 | 2017-12-01 | Verfahren und vorrichtung zur erkennung der aufmerksamkeit eines fahrers |
CN201880074127.4A CN111357038A (zh) | 2017-12-01 | 2018-11-16 | 驾驶员注意力检测方法及装置 |
PCT/EP2018/081534 WO2019105762A1 (en) | 2017-12-01 | 2018-11-16 | Driver attentiveness detection method and device |
US16/768,843 US20210237743A1 (en) | 2017-12-01 | 2018-11-16 | Driver attentiveness detection method and device |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP17204922.3A EP3493178B1 (de) | 2017-12-01 | 2017-12-01 | Verfahren und vorrichtung zur erkennung der aufmerksamkeit eines fahrers |
Publications (2)
Publication Number | Publication Date |
---|---|
EP3493178A1 EP3493178A1 (de) | 2019-06-05 |
EP3493178B1 true EP3493178B1 (de) | 2024-03-06 |
Family
ID=60569724
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP17204922.3A Active EP3493178B1 (de) | 2017-12-01 | 2017-12-01 | Verfahren und vorrichtung zur erkennung der aufmerksamkeit eines fahrers |
Country Status (4)
Country | Link |
---|---|
US (1) | US20210237743A1 (de) |
EP (1) | EP3493178B1 (de) |
CN (1) | CN111357038A (de) |
WO (1) | WO2019105762A1 (de) |
Families Citing this family (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN110781718B (zh) * | 2019-08-28 | 2023-10-10 | 浙江零跑科技股份有限公司 | 一种驾驶室红外视觉系统及驾驶员注意力分析方法 |
JP2021196941A (ja) * | 2020-06-16 | 2021-12-27 | トヨタ自動車株式会社 | ドライバ監視システム |
JP2022152869A (ja) * | 2021-03-29 | 2022-10-12 | 本田技研工業株式会社 | 車両制御装置、車両制御方法、及びプログラム |
TWI773375B (zh) * | 2021-06-11 | 2022-08-01 | 英業達股份有限公司 | 偵測系統 |
Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
SE520360C2 (sv) * | 1999-12-15 | 2003-07-01 | Goeran Sjoenell | Varningsanordning vid fordon |
US20170247031A1 (en) * | 2009-12-18 | 2017-08-31 | Honda Motor Co., Ltd. | Predictive human-machine interface using eye gaze technology, blind spot indicators and driver experience |
Family Cites Families (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
ES2391556T3 (es) * | 2002-05-03 | 2012-11-27 | Donnelly Corporation | Sistema de detección de objetos para vehículo |
US6859144B2 (en) * | 2003-02-05 | 2005-02-22 | Delphi Technologies, Inc. | Vehicle situation alert system with eye gaze controlled alert signal generation |
US7859432B2 (en) * | 2007-05-23 | 2010-12-28 | Che Il Electric Wireing Devices Co., Ltd. | Collision avoidance system based on detection of obstacles in blind spots of vehicle |
KR101351656B1 (ko) * | 2012-03-30 | 2014-01-16 | 대성전기공업 주식회사 | 차량용 글랜스 라이트 장치 |
US20100209881A1 (en) * | 2009-02-18 | 2010-08-19 | Gm Global Technology Operations, Inc. | Driving skill recognition based on behavioral diagnosis |
GB2500690B (en) * | 2012-03-30 | 2015-07-29 | Jaguar Land Rover Ltd | Driver assistance system |
DE102012022819A1 (de) * | 2012-11-17 | 2014-05-22 | GM Global Technology Operations LLC (n. d. Ges. d. Staates Delaware) | Verfahren und Vorrichtungen zur Ausgabe von Informationen in einem Kraftfahrzeug |
CN106952502A (zh) * | 2017-05-11 | 2017-07-14 | 迈锐数据(北京)有限公司 | 一种弯道车辆预警设备及系统 |
-
2017
- 2017-12-01 EP EP17204922.3A patent/EP3493178B1/de active Active
-
2018
- 2018-11-16 CN CN201880074127.4A patent/CN111357038A/zh active Pending
- 2018-11-16 WO PCT/EP2018/081534 patent/WO2019105762A1/en active Application Filing
- 2018-11-16 US US16/768,843 patent/US20210237743A1/en not_active Abandoned
Patent Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
SE520360C2 (sv) * | 1999-12-15 | 2003-07-01 | Goeran Sjoenell | Varningsanordning vid fordon |
US20170247031A1 (en) * | 2009-12-18 | 2017-08-31 | Honda Motor Co., Ltd. | Predictive human-machine interface using eye gaze technology, blind spot indicators and driver experience |
Also Published As
Publication number | Publication date |
---|---|
WO2019105762A1 (en) | 2019-06-06 |
CN111357038A (zh) | 2020-06-30 |
EP3493178A1 (de) | 2019-06-05 |
US20210237743A1 (en) | 2021-08-05 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP3493178B1 (de) | Verfahren und vorrichtung zur erkennung der aufmerksamkeit eines fahrers | |
JP4019736B2 (ja) | 車両用障害物検出装置 | |
US9586525B2 (en) | Camera-assisted blind spot detection | |
CN103158621B (zh) | 使车辆驾驶员可见的观察到位于盲点内物体的系统和方法 | |
US9251709B2 (en) | Lateral vehicle contact warning system | |
JP4415856B2 (ja) | 周囲感知システムによって路上車両の前方周囲を検出するための方法 | |
KR20170000363A (ko) | 차량, 특히 상용 차량을 위한 디스플레이 시스템 | |
US9415736B2 (en) | Method, computer program product and system for utilizing vehicle safety equipment | |
US8370055B2 (en) | Driver assistance system | |
EP3414131B1 (de) | System zur verringerung des toten winkels für ein fahrzeug | |
EP3190021A1 (de) | System und verfahren zur kollisionswarnung | |
EP3139340B1 (de) | System und verfahren zur verbesserung der sichtbarkeit | |
EP3089136A1 (de) | Vorrichtung und verfahren zur detektion eines objekts in einem überwachungsbereich eines fahrzeugs | |
EP2487666B1 (de) | Verfahren und Fahrerassistenzsystem zum Anzeigen von Bildern in einem Kraftfahrzeug | |
CN110622504A (zh) | 借助安装在车辆内的传感器空间分辨地探测车辆外部物体的方法和设备 | |
US20230415734A1 (en) | Vehicular driving assist system using radar sensors and cameras | |
KR102100978B1 (ko) | 리어 뷰를 위한 제어 유닛 및 방법 | |
EP3774500B1 (de) | Verfahren zur hinderniserkennung | |
US10131353B2 (en) | Vehicle and method for controlling the same | |
KR20210101877A (ko) | 차량의 후측방 경고 장치 및 방법 | |
US20220126819A1 (en) | Vehicle control apparatus and control method therefor | |
US10759342B2 (en) | Apparatus and method for controlling collision alert | |
EP4105676A1 (de) | Fahrerassistenzsystem und verfahren zum betreiben eines fahrerassistenzsystems | |
KR20230136830A (ko) | 운전자 보조 시스템 및 운전자 보조 방법 | |
KR102497460B1 (ko) | 근접 거리 경보 시스템 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE APPLICATION HAS BEEN PUBLISHED |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
AX | Request for extension of the european patent |
Extension state: BA ME |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
|
17P | Request for examination filed |
Effective date: 20191204 |
|
RBV | Designated contracting states (corrected) |
Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: EXAMINATION IS IN PROGRESS |
|
17Q | First examination report despatched |
Effective date: 20210225 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: EXAMINATION IS IN PROGRESS |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: GRANT OF PATENT IS INTENDED |
|
RIC1 | Information provided on ipc code assigned before grant |
Ipc: B60W 50/14 20120101ALI20230929BHEP Ipc: G06V 20/59 20220101ALI20230929BHEP Ipc: G06V 20/58 20220101ALI20230929BHEP Ipc: G08G 1/16 20060101AFI20230929BHEP |
|
INTG | Intention to grant announced |
Effective date: 20231108 |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE PATENT HAS BEEN GRANTED |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: EP |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 602017079722 Country of ref document: DE |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D |
|
RAP4 | Party data changed (patent owner data changed or rights of a patent transferred) |
Owner name: MAGNA ELECTRONICS SWEDEN AB |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: PK Free format text: DIE PUBLIKATION VOM 27.03.2024 WURDE AM 24.04.2024 IRRTUEMLICHERWEISE ERNEUT PUBLIZIERT. LA PUBLICATION DU 27.03.2024 A ETE REPUBLIEE PAR ERREUR LE 24.04.2024. LA PUBBLICAZIONE DEL 27.03.2024 E STATA ERRONEAMENTE RIPUBBLICATA IL 24.04.2024. |
|
REG | Reference to a national code |
Ref country code: SE Ref legal event code: TRGR |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R081 Ref document number: 602017079722 Country of ref document: DE Owner name: MAGNA ELECTRONICS SWEDEN AB, SE Free format text: FORMER OWNER: VEONEER SWEDEN AB, VARGARDA, SE |
|
REG | Reference to a national code |
Ref country code: LT Ref legal event code: MG9D |