WO2019171452A1 - Dispositif d'aide à la conduite, procédé d'aide à la conduite, et système d'aide à la conduite pourvu d'un dispositif d'aide à la conduite - Google Patents

Dispositif d'aide à la conduite, procédé d'aide à la conduite, et système d'aide à la conduite pourvu d'un dispositif d'aide à la conduite Download PDF

Info

Publication number
WO2019171452A1
WO2019171452A1 PCT/JP2018/008482 JP2018008482W WO2019171452A1 WO 2019171452 A1 WO2019171452 A1 WO 2019171452A1 JP 2018008482 W JP2018008482 W JP 2018008482W WO 2019171452 A1 WO2019171452 A1 WO 2019171452A1
Authority
WO
WIPO (PCT)
Prior art keywords
conversation
driver
concentration
warning
driving support
Prior art date
Application number
PCT/JP2018/008482
Other languages
English (en)
Japanese (ja)
Inventor
政生 村上
Original Assignee
三菱電機株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 三菱電機株式会社 filed Critical 三菱電機株式会社
Priority to JP2020504513A priority Critical patent/JP7098265B2/ja
Priority to PCT/JP2018/008482 priority patent/WO2019171452A1/fr
Priority to DE112018007226.6T priority patent/DE112018007226T5/de
Publication of WO2019171452A1 publication Critical patent/WO2019171452A1/fr

Links

Images

Classifications

    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
    • B60W40/08—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W50/08—Interaction between the driver and the control system
    • B60W50/14—Means for informing the driver, warning the driver or prompting a driver intervention
    • G—PHYSICS
    • G08—SIGNALLING
    • G08G—TRAFFIC CONTROL SYSTEMS
    • G08G1/00—Traffic control systems for road vehicles
    • G08G1/16—Anti-collision systems
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
    • B60W40/08—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
    • B60W2040/0818—Inactivity or incapacity of driver
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2420/00—Indexing codes relating to the type of sensors based on the principle of their operation
    • B60W2420/40—Photo, light or radio wave sensitive means, e.g. infrared sensors
    • B60W2420/403—Image sensing, e.g. optical camera

Definitions

  • the present invention relates to a driving support device, a driving support method, and a driving support system including the driving support device.
  • the present invention has been made to solve the above-described problems, and an object of the present invention is to provide a driving support device capable of giving an appropriate warning according to the degree of concentration on the conversation of the driver.
  • the driving support device is provided inside the host vehicle, and an utterance interval calculation unit that calculates the utterance interval of the driver based on images captured by the imaging device that images the face of the driver at a predetermined interval; Based on the utterance interval, a conversation concentration level determination unit that determines the concentration level of the driver in the conversation and a warning indicating that the host vehicle has approached the alerting point are changed according to the concentration level in the conversation.
  • a warning controller Is provided.
  • the driving support device can provide an appropriate warning according to the driver's degree of concentration in the conversation.
  • FIG. 2 is a block diagram illustrating a configuration example of a driving support system using the driving support device according to the first embodiment.
  • 2A and 2B are diagrams showing a hardware configuration example of the driving support apparatus according to Embodiment 1 of the present invention.
  • 4 is a flowchart illustrating an operation of warning control processing of the driving support device according to the first embodiment.
  • FIG. 1 is a block diagram illustrating a configuration example of a driving support system including the driving support apparatus according to the first embodiment.
  • the driving support system includes an imaging device 10 that captures the driver's face, and points that require attention to the driver (for example, traffic congestion points, accident-prone points, lane reduction points).
  • DataBase DataBase
  • the imaging device 10 is provided in front of the host vehicle (for example, a dashboard or an instrument panel) and captures images of the driver's face (face images) at predetermined intervals.
  • Examples of the imaging device 10 include a charge-coupled device (CCD) and an infrared camera.
  • the attention point DB 20 is configured by a rewritable nonvolatile storage device (for example, a hard disk drive or a flash memory).
  • a location that needs to be alerted to the driver such as a location where traffic is congested, a location where accidents occur frequently, a location where lanes decrease, a location where the road surface is frozen, etc. Attention point) is memorized.
  • the host vehicle position acquisition unit 30 acquires position information of the host vehicle from, for example, a GPS (Global Positioning System) (not shown) provided in the host vehicle.
  • the warning device 50 is connected to the alerting point DB 20 and the host vehicle position acquisition unit 30, and when it is determined that the host vehicle has approached a predetermined distance from the alerting point, the alerting point to the driver Present a warning message or icon indicating that you are approaching.
  • the driving support device 40 includes an utterance interval detection unit 41 that detects an utterance interval of the driver, a conversation concentration degree determination unit 42 that determines the degree of concentration of the driver in the conversation based on the utterance interval, and the driver's conversation. And a warning control unit 43 that controls the warning device 50 so as to change a warning indicating to the driver that the host vehicle has approached the alerting point according to the degree of concentration.
  • the speech interval calculation unit 41 acquires images of the driver's face captured by the imaging device 10 at predetermined intervals, and detects the opening / closing operation of the driver's mouth based on the image. Further, when it is detected that the opening / closing operation of the driver's mouth is stopped, the speech interval detecting unit 41 counts the time (utterance interval) T until the next opening / closing operation of the driver's mouth. Then, the utterance interval detection unit 41 outputs the counted utterance interval T to the conversation concentration degree determination unit 42.
  • the conversation concentration degree determination unit 42 is a predetermined number of times that the utterance interval T is shorter than the normal utterance interval Tj of the driver (T ⁇ Tj). It is determined whether (n times) or more are continuous. When it is determined that the state in which the utterance interval T is shorter than the normal utterance interval Tj of the driver (T ⁇ Tj) is continued n times or more, the driver concentrates on the conversation based on the utterance interval T. The degree (concentration of conversation) is calculated. Then, the conversation concentration level determination unit 42 outputs the conversation concentration level to the warning control unit 43.
  • the normal speech interval described above is, for example, the average value of the speech interval of the driver up to now or the average value of the speech interval at a predetermined time after the driver turns on the ignition switch of the own vehicle. .
  • the method of determining the conversation concentration level is such that when the driver's speech interval T is shorter than the driver's normal speech interval Tj (T ⁇ Tj) continuously n times or more, the driver's speech interval T is normal. A difference ⁇ Tn from the speech interval Tj is calculated. Furthermore, two predetermined threshold values T1 and T2 (T1 ⁇ T2) are compared with the difference ⁇ Tn to determine the driver's conversation concentration level in three stages. That is, in the case of ⁇ Tn ⁇ T1, it is determined that the driver's conversation concentration level is level 1 (mild careless state).
  • T1 ⁇ ⁇ Tn ⁇ T2 it is determined that the driver's conversation concentration level is level 2 (moderate careless state).
  • T2 ⁇ Tn it is determined that the driver's conversation concentration level is level 3 (severe careless state).
  • the method of dividing the conversation concentration level into three levels has been described. However, this is an example, and the level of conversation concentration can be divided into arbitrary levels depending on how the threshold is set.
  • the warning control unit 43 When the conversation concentration level is output from the conversation concentration level determination unit 42, the warning control unit 43 notifies the warning volume and warning indicating that the host vehicle is approaching the alerting point according to the conversation concentration level.
  • the warning device 50 is controlled to change at least one of the timing, the number of warnings, and the warning frequency. In other words, the higher the concentration of the conversation, the less likely the driver will notice the warning, so the higher the concentration of the driver's conversation, the higher the volume of the warning, the earlier the timing of alerting, the more the number of warnings, Alternatively, the warning is easily given to the driver by increasing the frequency of the warning.
  • the driving support device 40 further includes a vehicle speed acquisition unit (not shown) that acquires the vehicle speed of the host vehicle, and the warning control 43 controls the warning device 50 only when the vehicle speed is equal to or higher than a predetermined threshold. You may do it.
  • a vehicle speed acquisition unit (not shown) that acquires the vehicle speed of the host vehicle
  • the warning control 43 controls the warning device 50 only when the vehicle speed is equal to or higher than a predetermined threshold. You may do it.
  • 2A and 2B are diagrams illustrating a hardware configuration example of the driving support device 40.
  • the functions of the speech interval calculation unit 41, the conversation concentration determination unit 42, and the warning control unit 43 in the driving support device 40 are realized by a processing circuit. That is, the driving support device 40 includes a processing circuit for realizing the above functions.
  • the processing circuit may be a processing circuit 100a, which is dedicated hardware as shown in FIG. 2A, or a processor 100b that executes a program stored in the memory 100c as shown in FIG. 2B. Good.
  • the processing circuit 100a is, for example, a single circuit, a composite circuit, or a programmed circuit.
  • a processor, a processor programmed in parallel, an ASIC (Application Specific Integrated Circuit), an FPGA (Field-programmable Gate Array), or a combination thereof is applicable.
  • the functions of each part of the speech interval calculation unit 41, the conversation concentration determination unit 42, and the warning control unit 43 may be realized by a processing circuit, or the functions of each part may be realized by a single processing circuit.
  • the speech interval calculation unit 41, the conversation concentration determination unit 42, and the warning control unit 43 are the processor 100b
  • the function of each unit is realized by software, firmware, or a combination of software and firmware.
  • the Software or firmware is described as a program and stored in the memory 100c.
  • the processor 100b reads out and executes the program stored in the memory 100c, thereby realizing the functions of the utterance interval calculation unit 41, the conversation concentration degree determination unit 42, and the warning control unit 43. That is, the utterance interval calculation unit 41, the conversation concentration determination unit 42, and the warning control unit 43 execute a program in which each step shown in FIG. 3 to be described later is executed when executed by the processor 100b.
  • a memory 100c for storing is provided. These programs can be said to cause the computer to execute the procedures or methods of the speech interval calculation unit 41, the conversation concentration degree determination unit 42, and the warning control unit 43.
  • the processor 100b is, for example, a CPU (Central Processing Unit), a processing device, an arithmetic device, a processor, a microprocessor, a microcomputer, or a DSP (Digital Signal Processor).
  • the memory 100c may be, for example, a nonvolatile or volatile semiconductor memory such as a RAM (Random Access Memory), a ROM (Read Only Memory), a flash memory, an EPROM (Erasable Programmable ROM), or an EEPROM (Electrically EPROM). Further, it may be a magnetic disk such as a hard disk or a flexible disk, or an optical disk such as a mini disk, CD (Compact Disc), or DVD (Digital Versatile Disc).
  • a part may be implement
  • the processing circuit 100a in the driving support device 40 can realize the functions described above by hardware, software, firmware, or a combination thereof.
  • FIG. 3 is a flowchart showing an operation of warning control according to the first embodiment.
  • the speech interval calculation unit 41 acquires a driver's face image (face image) captured by the imaging device 10 at a predetermined interval (step ST1), and calculates the driver's speech interval T from the acquired face image (step ST1).
  • Step ST2 The conversation concentration determination unit 42 determines whether or not the state (T ⁇ Tj) in which the utterance interval T calculated in step ST2 is shorter than the normal utterance interval Tj continues for a predetermined number of times (n times) (step ST3)
  • n times a predetermined number of times
  • step ST4 when the state where the speech interval T is shorter than the normal speech interval Tj (T ⁇ Tj) continues n times or more (step ST3; YES), the driver's degree of concentration in the conversation (conversation concentration) based on the speech interval T Degree) (step ST4).
  • the warning control unit 43 controls the warning device 50 so as to give a warning according to the conversation concentration determined in step ST4 (step ST5). Then, the process returns to step ST1.
  • the driver's speech interval T is calculated based on images captured by the imaging device 10 that captures the driver's face provided inside the host vehicle at predetermined intervals.
  • the speech interval calculation unit 41 that performs the conversation
  • the conversation concentration level determination unit 42 that determines the driver's concentration level in the conversation based on the driver's speech interval T
  • a warning control unit 43 that changes a warning indicating that the vehicle has approached the vehicle, so that it is possible to give a warning according to the driver's degree of concentration in the conversation and the degree of concentration in the driver's conversation Appropriate warning can be made according to the situation. Thereby, it is possible to suppress the driver from missing the warning.

Landscapes

  • Engineering & Computer Science (AREA)
  • Automation & Control Theory (AREA)
  • Transportation (AREA)
  • Mechanical Engineering (AREA)
  • Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • General Physics & Mathematics (AREA)
  • Mathematical Physics (AREA)
  • Traffic Control Systems (AREA)

Abstract

Dans un exemple de l'état de la technique, une conduite distraite est déterminée sur la base de la durée de la conversation du conducteur, et en conséquence, il est seulement possible d'émettre un avertissement de la même manière indépendamment du fait que le degré de concentration du conducteur sur la conversation est faible ou élevé. La présente invention permet d'émettre un avertissement approprié en fonction du degré de concentration du conducteur sur la conversation.
PCT/JP2018/008482 2018-03-06 2018-03-06 Dispositif d'aide à la conduite, procédé d'aide à la conduite, et système d'aide à la conduite pourvu d'un dispositif d'aide à la conduite WO2019171452A1 (fr)

Priority Applications (3)

Application Number Priority Date Filing Date Title
JP2020504513A JP7098265B2 (ja) 2018-03-06 2018-03-06 運転支援装置
PCT/JP2018/008482 WO2019171452A1 (fr) 2018-03-06 2018-03-06 Dispositif d'aide à la conduite, procédé d'aide à la conduite, et système d'aide à la conduite pourvu d'un dispositif d'aide à la conduite
DE112018007226.6T DE112018007226T5 (de) 2018-03-06 2018-03-06 Fahrassistenzvorrichtung, Fahrassistenzverfahren und die Fahrassistenzvorrichtung aufweisendes Fahrassistenzsystem

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/JP2018/008482 WO2019171452A1 (fr) 2018-03-06 2018-03-06 Dispositif d'aide à la conduite, procédé d'aide à la conduite, et système d'aide à la conduite pourvu d'un dispositif d'aide à la conduite

Publications (1)

Publication Number Publication Date
WO2019171452A1 true WO2019171452A1 (fr) 2019-09-12

Family

ID=67846536

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2018/008482 WO2019171452A1 (fr) 2018-03-06 2018-03-06 Dispositif d'aide à la conduite, procédé d'aide à la conduite, et système d'aide à la conduite pourvu d'un dispositif d'aide à la conduite

Country Status (3)

Country Link
JP (1) JP7098265B2 (fr)
DE (1) DE112018007226T5 (fr)
WO (1) WO2019171452A1 (fr)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102023103475A1 (de) 2023-02-14 2024-08-14 Bayerische Motoren Werke Aktiengesellschaft Verfahren, Verarbeitungseinrichtung und Computerprogramm zum Steuern einer Fahrzeugfunktion

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH08192655A (ja) * 1995-01-17 1996-07-30 Toyota Motor Corp 漫然運転防止装置
JPH11276461A (ja) * 1998-03-27 1999-10-12 Suzuki Motor Corp 注意力測定装置及びこれを用いた情報提示装置
WO2005114576A1 (fr) * 2004-05-21 2005-12-01 Asahi Kasei Kabushiki Kaisha Dispositif d'évaluation du contenu d'opération
WO2011004035A1 (fr) * 2009-07-08 2011-01-13 Rafael Sancho Leon Emballage pour produits laitiers et analogues
WO2015151243A1 (fr) * 2014-04-02 2015-10-08 日産自動車株式会社 Dispositif d'affichage d'informations de véhicule

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2010241371A (ja) * 2009-04-09 2010-10-28 Toyota Motor Corp 運転状態検出装置
JP2011075397A (ja) * 2009-09-30 2011-04-14 Sanyo Electric Co Ltd ナビゲーション装置
JP5853897B2 (ja) * 2012-08-03 2016-02-09 株式会社デンソー 操作制御装置、及び、操作制御プログラム

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH08192655A (ja) * 1995-01-17 1996-07-30 Toyota Motor Corp 漫然運転防止装置
JPH11276461A (ja) * 1998-03-27 1999-10-12 Suzuki Motor Corp 注意力測定装置及びこれを用いた情報提示装置
WO2005114576A1 (fr) * 2004-05-21 2005-12-01 Asahi Kasei Kabushiki Kaisha Dispositif d'évaluation du contenu d'opération
WO2011004035A1 (fr) * 2009-07-08 2011-01-13 Rafael Sancho Leon Emballage pour produits laitiers et analogues
WO2015151243A1 (fr) * 2014-04-02 2015-10-08 日産自動車株式会社 Dispositif d'affichage d'informations de véhicule

Also Published As

Publication number Publication date
JP7098265B2 (ja) 2022-07-11
DE112018007226T5 (de) 2020-12-17
JPWO2019171452A1 (ja) 2020-10-22

Similar Documents

Publication Publication Date Title
US11027746B2 (en) Drive mode switching control device, method and program
CN110356418B (zh) 用于提供车辆控制权转移的通知的装置和方法
WO2019239463A1 (fr) Dispositif de commande de déplacement de véhicule et procédé de commande de déplacement de véhicule
JP4604691B2 (ja) 車両用警報装置、車両周囲状況の警報方法
US20190351901A1 (en) Travel path recognition apparatus and travel path recognition method
JP5938518B2 (ja) 衝突安全制御装置
JP5609293B2 (ja) 車線逸脱警報装置及び警報方法
WO2019171452A1 (fr) Dispositif d'aide à la conduite, procédé d'aide à la conduite, et système d'aide à la conduite pourvu d'un dispositif d'aide à la conduite
JP2005182753A (ja) 車両運転支援装置
JP2017107299A (ja) ふらつき判定装置及びふらつき判定方法
JP2017174345A (ja) 混雑度算出装置、混雑度算出方法並びに混雑度算出用プログラム及び記録媒体
JP2004310260A (ja) 一時停止警報装置
JP6583166B2 (ja) 運転支援装置
US20190147271A1 (en) Driver determination apparatus and driver state determination apparatus including driver determination apparatus, method for driver determination and driver state determination, and recording medium
JP4063144B2 (ja) 車両用後側方監視装置
JP6602226B2 (ja) 追従走行支援装置および追従走行支援方法
JP2022021517A (ja) 危険運転判定装置及び危険運転判定方法
JP4497011B2 (ja) 一時停止警報装置及び一時停止警報方法
US10417505B2 (en) Vehicle detection warning device and vehicle detection warning method
KR20210057897A (ko) 자율주행차량의 안전주행 제어 장치 및 그 방법
JP2011043943A (ja) 撮像システム
JP2021111223A (ja) 渋滞検出装置
CN110662682A (zh) 移动体控制装置、移动体控制方法以及移动体控制程序
JP2022043784A (ja) 映像記録装置および映像記録方法
JP2021163150A (ja) 逆走防止装置および逆走防止方法

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18909049

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2020504513

Country of ref document: JP

Kind code of ref document: A

122 Ep: pct application non-entry in european phase

Ref document number: 18909049

Country of ref document: EP

Kind code of ref document: A1