JP2018151765A5 - - Google Patents
Download PDFInfo
- Publication number
- JP2018151765A5 JP2018151765A5 JP2017046345A JP2017046345A JP2018151765A5 JP 2018151765 A5 JP2018151765 A5 JP 2018151765A5 JP 2017046345 A JP2017046345 A JP 2017046345A JP 2017046345 A JP2017046345 A JP 2017046345A JP 2018151765 A5 JP2018151765 A5 JP 2018151765A5
- Authority
- JP
- Japan
- Prior art keywords
- information
- driver
- sight
- line
- dwell time
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 230000000007 visual effect Effects 0.000 claims 18
- 238000001514 detection method Methods 0.000 claims 3
- 238000011179 visual inspection Methods 0.000 claims 3
- 238000000034 method Methods 0.000 claims 1
Claims (4)
前記運転者監視センサの運転者監視情報に基づいて、前記運転者に関する状態情報を取得する運転者状態情報取得部と、
前記車外監視センサの車外監視情報に基づいて、前記車両の周辺に存在する対象を検知する対象検知部と、
前記対象が、予め分類された複数のグループのいずれに属するかを特定し、前記状態情報と前記対象が属するグループのグループ情報とに基づいて、前記運転者の目視が適切であったか否かを判定する目視判定部と、
前記目視判定部により前記運転者の目視が不適切であると判定された場合に、前記警告出力装置に警告を発生させるための警告情報を出力する警告情報出力部とを備え、
前記状態情報は、前記運転者の視線の方向を表す視線方向情報と、前記運転者の視線の滞留時間を表す視線滞留時間情報とを含み、前記グループ情報は、グループ毎に予め個別に設定された前記運転者の視線の累積滞留時間の閾値を表す閾値情報を含み、前記目視判定部は、前記対象の位置を表す位置情報と前記視線方向情報と前記視線滞留時間情報とに基づいて、前記対象に向けられた前記運転者の視線の累積滞留時間を表す視線累積滞留時間情報を算出し、算出した前記視線累積滞留時間情報を前記閾値情報と比較し、前記視線累積滞留時間情報が前記閾値情報以上である場合、前記運転者の目視が適切であると判定する、視認支援装置。 A visual assistance device for assisting visual recognition by a driver of a vehicle provided with a driver monitoring sensor, an outside monitoring sensor, and a warning output device,
Based on driver monitoring information of the driver monitoring sensor, a driver state information acquisition unit that acquires state information about the driver;
A target detection unit for detecting a target existing around the vehicle based on the vehicle monitoring information of the vehicle monitoring sensor;
It is determined whether the target belongs to a plurality of groups classified in advance, and it is determined whether or not the driver's visual observation is appropriate based on the state information and the group information of the group to which the target belongs. A visual judgment unit to perform,
A warning information output unit that outputs warning information for generating a warning in the warning output device when the visual determination unit determines that the driver's visual inspection is inappropriate ;
The state information includes line-of-sight direction information indicating the direction of the driver's line of sight and line-of-sight dwell time information indicating the dwell time of the driver's line of sight, and the group information is individually set for each group in advance. Threshold value information representing a threshold value of the accumulated dwell time of the driver's line of sight, the visual determination unit based on the position information representing the position of the target, the line-of-sight direction information, and the line-of-sight dwell time information, The line-of-sight accumulated dwell time information representing the accumulated dwell time of the driver's line of sight directed toward the subject is calculated, the calculated line-of-sight accumulated dwell time information is compared with the threshold information, and the line-of-sight accumulated dwell time information is the threshold value The visual assistance device that determines that the visual observation of the driver is appropriate when the information is more than information .
前記運転者監視センサの運転者監視情報に基づいて、前記運転者に関する状態情報を取得する運転者状態取得ステップと、
前記車外監視センサの車外監視情報に基づいて、前記車両の周辺に存在する対象を検知する対象検知ステップと、
前記対象検知ステップにより検知された前記対象が、予め分類された複数のグループのいずれに属するかを特定し、前記状態情報と前記対象が属するグループのグループ情報とに基づいて、前記運転者の目視が適切であったか否かを判定する目視判定ステップと、
前記目視判定ステップにより前記運転者の目視が不適切であると判定された場合に、前記警告出力装置に警告を発生させるための警告情報を出力する警告情報出力ステップとを有し、
前記状態情報は、前記運転者の視線の方向を表す視線方向情報と、前記運転者の視線の滞留時間を表す視線滞留時間情報とを含み、前記グループ情報は、グループ毎に予め個別に設定された前記運転者の視線の累積滞留時間の閾値を表す閾値情報を含み、前記目視判定ステップは、前記対象の位置を表す位置情報と前記視線方向情報と前記視線滞留時間情報とに基づいて、前記対象に向けられた前記運転者の視線の累積滞留時間を表す視線累積滞留時間情報を算出し、算出した前記視線累積滞留時間情報を前記閾値情報と比較し、前記視線累積滞留時間情報が前記閾値情報以上である場合、前記運転者の目視が適切であると判定する、視認支援方法。 A visual assistance method for assisting visual recognition by a driver of a vehicle including a driver monitoring sensor, an outside monitoring sensor, and a warning output device,
Based on driver monitoring information of the driver monitoring sensor, a driver state acquisition step of acquiring state information about the driver;
An object detection step for detecting an object present in the vicinity of the vehicle based on the vehicle monitoring information of the vehicle monitoring sensor;
The target detected by the target detection step is identified as belonging to a plurality of groups classified in advance, and based on the state information and the group information of the group to which the target belongs, the driver's visual inspection is performed. A visual determination step for determining whether or not was appropriate;
A warning information output step for outputting warning information for generating a warning in the warning output device when it is determined by the visual determination step that the driver's visual inspection is inappropriate ;
The state information includes line-of-sight direction information indicating the direction of the driver's line of sight and line-of-sight dwell time information indicating the dwell time of the driver's line of sight, and the group information is individually set for each group in advance. Threshold value information representing a threshold of the accumulated dwell time of the driver's line of sight, and the visual determination step is based on the position information representing the position of the target, the line-of-sight direction information, and the line-of-sight dwell time information. The line-of-sight accumulated dwell time information representing the accumulated dwell time of the driver's line of sight directed toward the subject is calculated, the calculated line-of-sight accumulated dwell time information is compared with the threshold information, and the line-of-sight accumulated dwell time information is the threshold value A visual assistance method for determining that the visual observation of the driver is appropriate when the information is more than information .
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2017046345A JP6468306B2 (en) | 2017-03-10 | 2017-03-10 | Visual assistance device, method and program |
PCT/JP2017/036703 WO2018163490A1 (en) | 2017-03-10 | 2017-10-10 | Visual recognition support device, method, and program |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2017046345A JP6468306B2 (en) | 2017-03-10 | 2017-03-10 | Visual assistance device, method and program |
Publications (3)
Publication Number | Publication Date |
---|---|
JP2018151765A JP2018151765A (en) | 2018-09-27 |
JP2018151765A5 true JP2018151765A5 (en) | 2019-01-10 |
JP6468306B2 JP6468306B2 (en) | 2019-02-13 |
Family
ID=63447413
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
JP2017046345A Expired - Fee Related JP6468306B2 (en) | 2017-03-10 | 2017-03-10 | Visual assistance device, method and program |
Country Status (2)
Country | Link |
---|---|
JP (1) | JP6468306B2 (en) |
WO (1) | WO2018163490A1 (en) |
Families Citing this family (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN113841190A (en) | 2019-05-15 | 2021-12-24 | 日产自动车株式会社 | Driving assistance method and driving assistance system |
CN110246305A (en) * | 2019-08-01 | 2019-09-17 | 肇庆学院 | A kind of fatigue driving detection early warning system and method based on machine vision |
JP7229283B2 (en) * | 2021-02-04 | 2023-02-27 | 本田技研工業株式会社 | vehicle seat belt device |
Family Cites Families (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2007072632A (en) * | 2005-09-05 | 2007-03-22 | Toyota Motor Corp | On-vehicle warning apparatus |
JP2008254710A (en) * | 2007-04-09 | 2008-10-23 | Fujitsu Ten Ltd | Obstacle detector |
JP5547160B2 (en) * | 2011-10-27 | 2014-07-09 | 本田技研工業株式会社 | Vehicle periphery monitoring device |
JP2016066231A (en) * | 2014-09-24 | 2016-04-28 | パイオニア株式会社 | Collision prevention device, collision prevention method, collision prevention program, and recording medium |
-
2017
- 2017-03-10 JP JP2017046345A patent/JP6468306B2/en not_active Expired - Fee Related
- 2017-10-10 WO PCT/JP2017/036703 patent/WO2018163490A1/en active Application Filing
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2017175025A3 (en) | Detecting visual information corresponding to an animal | |
RU2015120679A (en) | SYSTEM FOR TRACKING OBJECTS AROUND THE VEHICLE | |
MY186583A (en) | Collision avoidance assistance device for a vehicle | |
EP2838050A3 (en) | Image processing unit, object detection method, object detection program, and vehicle control system | |
EP3016025A3 (en) | Image processing device, image processing method, POI information creation system, warning system, and guidance system | |
EP2772810A3 (en) | Recognition-based industrial automation control with person and object discrimination | |
BR112018008270A8 (en) | PARKING SPACE LINE DETECTION DEVICE AND METHOD | |
EP2949534A3 (en) | Driver assistance apparatus capable of diagnosing vehicle parts and vehicle including the same | |
EP2772336A3 (en) | Recognition-based industrial automation control with position and derivative decision reference | |
WO2016176301A3 (en) | System for integrating multiple sensor data to predict a fall risk | |
EP2851841A3 (en) | System and method of alerting a driver that visual perception of pedestrian may be difficult | |
WO2015041872A8 (en) | Method and apparatus for selectively providing information on objects in a captured image | |
WO2012168055A3 (en) | Method and device for detecting objects in the area surrounding a vehicle | |
EP3506169A3 (en) | Driver assistance system and method for object detection and notification | |
JP2010056692A5 (en) | ||
EP2905724A3 (en) | Object detection system and method | |
MY158602A (en) | Three-dimensional object detection device, and three-dimensional object detection method | |
EP2372309A3 (en) | Vehicle position detection system | |
ATE537662T1 (en) | SYSTEM, PROGRAM AND METHOD FOR VEHICLE PERIPHERAL MONITORING | |
JP2018143338A5 (en) | ||
EP3270364A3 (en) | Detection method and apparatus of a status of a parking lot and electronic equipment | |
MY179728A (en) | Three-dimensional object detection device | |
JP2016045903A5 (en) | ||
JP2018151765A5 (en) | ||
MX2017013477A (en) | Lidar and vision vehicle sensing. |