JP2018151765A5 - - Google Patents

Download PDF

Info

Publication number
JP2018151765A5
JP2018151765A5 JP2017046345A JP2017046345A JP2018151765A5 JP 2018151765 A5 JP2018151765 A5 JP 2018151765A5 JP 2017046345 A JP2017046345 A JP 2017046345A JP 2017046345 A JP2017046345 A JP 2017046345A JP 2018151765 A5 JP2018151765 A5 JP 2018151765A5
Authority
JP
Japan
Prior art keywords
information
driver
sight
line
dwell time
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
JP2017046345A
Other languages
Japanese (ja)
Other versions
JP2018151765A (en
JP6468306B2 (en
Filing date
Publication date
Application filed filed Critical
Priority to JP2017046345A priority Critical patent/JP6468306B2/en
Priority claimed from JP2017046345A external-priority patent/JP6468306B2/en
Priority to PCT/JP2017/036703 priority patent/WO2018163490A1/en
Publication of JP2018151765A publication Critical patent/JP2018151765A/en
Publication of JP2018151765A5 publication Critical patent/JP2018151765A5/ja
Application granted granted Critical
Publication of JP6468306B2 publication Critical patent/JP6468306B2/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Claims (4)

運転者監視センサと車外監視センサと警告出力装置とを備えた車両の運転者による視認を支援する視認支援装置であって、
前記運転者監視センサの運転者監視情報に基づいて、前記運転者に関する状態情報を取得する運転者状態情報取得部と、
前記車外監視センサの車外監視情報に基づいて、前記車両の周辺に存在する対象を検知する対象検知部と、
前記対象が、予め分類された複数のグループのいずれに属するかを特定し、前記状態情報と前記対象が属するグループのグループ情報とに基づいて、前記運転者の目視が適切であったか否かを判定する目視判定部と、
前記目視判定部により前記運転者の目視が不適切であると判定された場合に、前記警告出力装置に警告を発生させるための警告情報を出力する警告情報出力部とを備え
前記状態情報は、前記運転者の視線の方向を表す視線方向情報と、前記運転者の視線の滞留時間を表す視線滞留時間情報とを含み、前記グループ情報は、グループ毎に予め個別に設定された前記運転者の視線の累積滞留時間の閾値を表す閾値情報を含み、前記目視判定部は、前記対象の位置を表す位置情報と前記視線方向情報と前記視線滞留時間情報とに基づいて、前記対象に向けられた前記運転者の視線の累積滞留時間を表す視線累積滞留時間情報を算出し、算出した前記視線累積滞留時間情報を前記閾値情報と比較し、前記視線累積滞留時間情報が前記閾値情報以上である場合、前記運転者の目視が適切であると判定する、視認支援装置。
A visual assistance device for assisting visual recognition by a driver of a vehicle provided with a driver monitoring sensor, an outside monitoring sensor, and a warning output device,
Based on driver monitoring information of the driver monitoring sensor, a driver state information acquisition unit that acquires state information about the driver;
A target detection unit for detecting a target existing around the vehicle based on the vehicle monitoring information of the vehicle monitoring sensor;
It is determined whether the target belongs to a plurality of groups classified in advance, and it is determined whether or not the driver's visual observation is appropriate based on the state information and the group information of the group to which the target belongs. A visual judgment unit to perform,
A warning information output unit that outputs warning information for generating a warning in the warning output device when the visual determination unit determines that the driver's visual inspection is inappropriate ;
The state information includes line-of-sight direction information indicating the direction of the driver's line of sight and line-of-sight dwell time information indicating the dwell time of the driver's line of sight, and the group information is individually set for each group in advance. Threshold value information representing a threshold value of the accumulated dwell time of the driver's line of sight, the visual determination unit based on the position information representing the position of the target, the line-of-sight direction information, and the line-of-sight dwell time information, The line-of-sight accumulated dwell time information representing the accumulated dwell time of the driver's line of sight directed toward the subject is calculated, the calculated line-of-sight accumulated dwell time information is compared with the threshold information, and the line-of-sight accumulated dwell time information is the threshold value The visual assistance device that determines that the visual observation of the driver is appropriate when the information is more than information .
前記複数のグループは、少なくとも、動きが予測不能な対象を含む第1のグループと、動きが予測可能な対象を含む第2のグループと、動きが実質的にない対象を含む第3のグループとを含み、前記第1のグループの前記閾値情報は前記第2のグループの前記閾値情報よりも大きく、前記第2のグループの前記閾値情報は前記第3のグループの前記閾値情報よりも大きい、請求項に記載の視認支援装置。 The plurality of groups include at least a first group including a target whose motion is unpredictable, a second group including a target whose motion can be predicted, and a third group including a target substantially free of motion. The threshold information of the first group is greater than the threshold information of the second group, and the threshold information of the second group is greater than the threshold information of the third group. Item 20. The visual assistance device according to Item 1 . 運転者監視センサと車外監視センサと警告出力装置とを備えた車両の運転者による視認を支援する視認支援方法であって、
前記運転者監視センサの運転者監視情報に基づいて、前記運転者に関する状態情報を取得する運転者状態取得ステップと、
前記車外監視センサの車外監視情報に基づいて、前記車両の周辺に存在する対象を検知する対象検知ステップと、
前記対象検知ステップにより検知された前記対象が、予め分類された複数のグループのいずれに属するかを特定し、前記状態情報と前記対象が属するグループのグループ情報とに基づいて、前記運転者の目視が適切であったか否かを判定する目視判定ステップと、
前記目視判定ステップにより前記運転者の目視が不適切であると判定された場合に、前記警告出力装置に警告を発生させるための警告情報を出力する警告情報出力ステップとを有し
前記状態情報は、前記運転者の視線の方向を表す視線方向情報と、前記運転者の視線の滞留時間を表す視線滞留時間情報とを含み、前記グループ情報は、グループ毎に予め個別に設定された前記運転者の視線の累積滞留時間の閾値を表す閾値情報を含み、前記目視判定ステップは、前記対象の位置を表す位置情報と前記視線方向情報と前記視線滞留時間情報とに基づいて、前記対象に向けられた前記運転者の視線の累積滞留時間を表す視線累積滞留時間情報を算出し、算出した前記視線累積滞留時間情報を前記閾値情報と比較し、前記視線累積滞留時間情報が前記閾値情報以上である場合、前記運転者の目視が適切であると判定する、視認支援方法。
A visual assistance method for assisting visual recognition by a driver of a vehicle including a driver monitoring sensor, an outside monitoring sensor, and a warning output device,
Based on driver monitoring information of the driver monitoring sensor, a driver state acquisition step of acquiring state information about the driver;
An object detection step for detecting an object present in the vicinity of the vehicle based on the vehicle monitoring information of the vehicle monitoring sensor;
The target detected by the target detection step is identified as belonging to a plurality of groups classified in advance, and based on the state information and the group information of the group to which the target belongs, the driver's visual inspection is performed. A visual determination step for determining whether or not was appropriate;
A warning information output step for outputting warning information for generating a warning in the warning output device when it is determined by the visual determination step that the driver's visual inspection is inappropriate ;
The state information includes line-of-sight direction information indicating the direction of the driver's line of sight and line-of-sight dwell time information indicating the dwell time of the driver's line of sight, and the group information is individually set for each group in advance. Threshold value information representing a threshold of the accumulated dwell time of the driver's line of sight, and the visual determination step is based on the position information representing the position of the target, the line-of-sight direction information, and the line-of-sight dwell time information. The line-of-sight accumulated dwell time information representing the accumulated dwell time of the driver's line of sight directed toward the subject is calculated, the calculated line-of-sight accumulated dwell time information is compared with the threshold information, and the line-of-sight accumulated dwell time information is the threshold value A visual assistance method for determining that the visual observation of the driver is appropriate when the information is more than information .
請求項1または請求項2に記載の視認支援装置が備える各部の機能または請求項3に記載の視認支援方法の各ステップの処理をコンピュータに実行させるプログラム。 The program which makes a computer perform the process of each step of the visual assistance method of Claim 3 or the function of each part with which the visual recognition assistance apparatus of Claim 1 or Claim 2 is provided.
JP2017046345A 2017-03-10 2017-03-10 Visual assistance device, method and program Expired - Fee Related JP6468306B2 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
JP2017046345A JP6468306B2 (en) 2017-03-10 2017-03-10 Visual assistance device, method and program
PCT/JP2017/036703 WO2018163490A1 (en) 2017-03-10 2017-10-10 Visual recognition support device, method, and program

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2017046345A JP6468306B2 (en) 2017-03-10 2017-03-10 Visual assistance device, method and program

Publications (3)

Publication Number Publication Date
JP2018151765A JP2018151765A (en) 2018-09-27
JP2018151765A5 true JP2018151765A5 (en) 2019-01-10
JP6468306B2 JP6468306B2 (en) 2019-02-13

Family

ID=63447413

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2017046345A Expired - Fee Related JP6468306B2 (en) 2017-03-10 2017-03-10 Visual assistance device, method and program

Country Status (2)

Country Link
JP (1) JP6468306B2 (en)
WO (1) WO2018163490A1 (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113841190A (en) 2019-05-15 2021-12-24 日产自动车株式会社 Driving assistance method and driving assistance system
CN110246305A (en) * 2019-08-01 2019-09-17 肇庆学院 A kind of fatigue driving detection early warning system and method based on machine vision
JP7229283B2 (en) * 2021-02-04 2023-02-27 本田技研工業株式会社 vehicle seat belt device

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2007072632A (en) * 2005-09-05 2007-03-22 Toyota Motor Corp On-vehicle warning apparatus
JP2008254710A (en) * 2007-04-09 2008-10-23 Fujitsu Ten Ltd Obstacle detector
JP5547160B2 (en) * 2011-10-27 2014-07-09 本田技研工業株式会社 Vehicle periphery monitoring device
JP2016066231A (en) * 2014-09-24 2016-04-28 パイオニア株式会社 Collision prevention device, collision prevention method, collision prevention program, and recording medium

Similar Documents

Publication Publication Date Title
WO2017175025A3 (en) Detecting visual information corresponding to an animal
RU2015120679A (en) SYSTEM FOR TRACKING OBJECTS AROUND THE VEHICLE
MY186583A (en) Collision avoidance assistance device for a vehicle
EP2838050A3 (en) Image processing unit, object detection method, object detection program, and vehicle control system
EP3016025A3 (en) Image processing device, image processing method, POI information creation system, warning system, and guidance system
EP2772810A3 (en) Recognition-based industrial automation control with person and object discrimination
BR112018008270A8 (en) PARKING SPACE LINE DETECTION DEVICE AND METHOD
EP2949534A3 (en) Driver assistance apparatus capable of diagnosing vehicle parts and vehicle including the same
EP2772336A3 (en) Recognition-based industrial automation control with position and derivative decision reference
WO2016176301A3 (en) System for integrating multiple sensor data to predict a fall risk
EP2851841A3 (en) System and method of alerting a driver that visual perception of pedestrian may be difficult
WO2015041872A8 (en) Method and apparatus for selectively providing information on objects in a captured image
WO2012168055A3 (en) Method and device for detecting objects in the area surrounding a vehicle
EP3506169A3 (en) Driver assistance system and method for object detection and notification
JP2010056692A5 (en)
EP2905724A3 (en) Object detection system and method
MY158602A (en) Three-dimensional object detection device, and three-dimensional object detection method
EP2372309A3 (en) Vehicle position detection system
ATE537662T1 (en) SYSTEM, PROGRAM AND METHOD FOR VEHICLE PERIPHERAL MONITORING
JP2018143338A5 (en)
EP3270364A3 (en) Detection method and apparatus of a status of a parking lot and electronic equipment
MY179728A (en) Three-dimensional object detection device
JP2016045903A5 (en)
JP2018151765A5 (en)
MX2017013477A (en) Lidar and vision vehicle sensing.