JP7222216B2 - 運転支援装置 - Google Patents
運転支援装置 Download PDFInfo
- Publication number
- JP7222216B2 JP7222216B2 JP2018203218A JP2018203218A JP7222216B2 JP 7222216 B2 JP7222216 B2 JP 7222216B2 JP 2018203218 A JP2018203218 A JP 2018203218A JP 2018203218 A JP2018203218 A JP 2018203218A JP 7222216 B2 JP7222216 B2 JP 7222216B2
- Authority
- JP
- Japan
- Prior art keywords
- driver
- line
- saliency map
- vehicle
- sight
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000001514 detection method Methods 0.000 claims description 59
- 238000003384 imaging method Methods 0.000 claims description 28
- 238000012545 processing Methods 0.000 description 14
- 238000010586 diagram Methods 0.000 description 12
- 238000013528 artificial neural network Methods 0.000 description 8
- 238000012790 confirmation Methods 0.000 description 7
- 238000002485 combustion reaction Methods 0.000 description 3
- 230000000694 effects Effects 0.000 description 3
- 238000000034 method Methods 0.000 description 3
- 230000006399 behavior Effects 0.000 description 2
- 238000004364 calculation method Methods 0.000 description 2
- 238000013461 design Methods 0.000 description 2
- 238000006073 displacement reaction Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 230000001133 acceleration Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000015572 biosynthetic process Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 239000000446 fuel Substances 0.000 description 1
- 230000009191 jumping Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 230000002265 prevention Effects 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 239000013589 supplement Substances 0.000 description 1
- 238000003786 synthesis reaction Methods 0.000 description 1
- 230000002194 synthesizing effect Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/013—Eye tracking input arrangements
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
- B60K35/20—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
- B60K35/28—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor characterised by the type of the output information, e.g. video entertainment or vehicle dynamics information; characterised by the purpose of the output information, e.g. for attracting the attention of the driver
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
- B60K35/20—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
- B60K35/28—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor characterised by the type of the output information, e.g. video entertainment or vehicle dynamics information; characterised by the purpose of the output information, e.g. for attracting the attention of the driver
- B60K35/285—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor characterised by the type of the output information, e.g. video entertainment or vehicle dynamics information; characterised by the purpose of the output information, e.g. for attracting the attention of the driver for improving awareness by directing driver's gaze direction or eye points
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
- B60K35/65—Instruments specially adapted for specific vehicle types or users, e.g. for left- or right-hand drive
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60Q—ARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
- B60Q9/00—Arrangement or adaptation of signal devices not provided for in one of main groups B60Q1/00 - B60Q7/00, e.g. haptic signalling
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/40—Extraction of image or video features
- G06V10/46—Descriptors for shape, contour or point-related descriptors, e.g. scale invariant feature transform [SIFT] or bags of words [BoW]; Salient regional features
- G06V10/462—Salient features, e.g. scale invariant feature transforms [SIFT]
- G06V10/464—Salient features, e.g. scale invariant feature transforms [SIFT] using a plurality of salient features, e.g. bag-of-words [BoW] representations
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/56—Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/59—Context or environment of the image inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
- G06V20/597—Recognising the driver's state or behaviour, e.g. attention or drowsiness
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/18—Eye characteristics, e.g. of the iris
- G06V40/193—Preprocessing; Feature extraction
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
- B60K2360/149—Instrument input by detecting viewing direction not otherwise provided for
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
- B60K2360/16—Type of output information
- B60K2360/178—Warnings
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
- B60K2360/20—Optical features of instruments
- B60K2360/21—Optical features of instruments using cameras
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
- B60K2360/741—Instruments adapted for user detection
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
- B60K35/10—Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
- B60K35/20—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
- B60K35/21—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor using visual output, e.g. blinking lights or matrix displays
- B60K35/22—Display screens
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
- B60K35/20—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
- B60K35/26—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor using acoustic output
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
- B60K35/60—Instruments characterised by their location or relative disposition in or on vehicles
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R11/00—Arrangements for holding or mounting articles, not otherwise provided for
- B60R11/04—Mounting of cameras operative during drive; Arrangement of controls thereof relative to the vehicle
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R11/00—Arrangements for holding or mounting articles, not otherwise provided for
- B60R2011/0001—Arrangements for holding or mounting articles, not otherwise provided for characterised by position
- B60R2011/0003—Arrangements for holding or mounting articles, not otherwise provided for characterised by position inside the vehicle
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Human Computer Interaction (AREA)
- Mechanical Engineering (AREA)
- General Engineering & Computer Science (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Combustion & Propulsion (AREA)
- Transportation (AREA)
- Chemical & Material Sciences (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Ophthalmology & Optometry (AREA)
- Traffic Control Systems (AREA)
- Image Analysis (AREA)
- Closed-Circuit Television Systems (AREA)
Description
図1は、第1の実施形態にかかる運転支援装置を搭載する車両の車室の一部が透視された状態の一例が示された斜視図である。図2は、第1の実施形態にかかる車両が有する撮像装置の配置の一例を示す図である。図1に示されるように、車両1は、車体2と、操舵部4と、モニタ装置11と、を備える。
本実施形態は、運転者の運転熟練度を含むドライバー情報を取得し、撮像画像およびドライバー情報に基づいて、運転者の運転熟練度毎のパーソナルサリエンシーマップを生成し、検出した運転者の視線分布と、運転熟練度毎のパーソナルサリエンシーマップとを比較して、運転者の運転熟練度を判別する例である。以下の説明では、第1の実施形態と異なる構成について説明する。
本実施形態は、第1運転熟練度のパーソナルサリエンシーマップと運転者の視線分布とに差がある場合と、第1運転熟練度より高い第2運転熟練度のパーソナルサリエンシーマップと運転者の視線分布とに差がある場合とで、危険通知の通知頻度を変更する例である。以下の説明では、第2の実施形態と同様の構成については説明を省略する。
本実施形態は、撮像画像に基づいてボトムアップサリエンシーマップを生成し、パーソナルサリエンシーマップからボトムアップサリエンシーマップを除いたトップダウンサリエンシーマップを生成し、検出した視線分布がボトムアップサリエンシーマップと異なる場合と、検出した視線分布がトップダウンサリエンシーマップと異なる場合とで、危険通知の通知頻度を変更する例である。以下の説明では、上述の実施形態と同様の構成については説明を省略する。
Claims (4)
- 車両の運転者の視線分布を検出する視線検出部と、
撮像部によって車両の周辺を撮像して得られる撮像画像を取得する画像取得部と、
前記車両の運転者を識別可能とするドライバー情報を取得するドライバー情報取得部と、
前記撮像画像および前記ドライバー情報に基づいて、前記撮像画像のサリエンシーマップでありかつ前記運転者毎に異なるパーソナルサリエンシーマップを生成する生成部と、
前記視線検出部により検出した前記視線分布と、生成した前記パーソナルサリエンシーマップとを比較して、前記運転者が前記車両の周辺の視認すべき対象に視線を向けているか否かを判断する判断部と、
前記運転者が前記車両の周辺の視認すべき対象に視線を向けていないと判断された場合、前記車両の危険通知を通知する通知部と、
を備え、
前記ドライバー情報取得部は、さらに、前記運転者の運転熟練度を含む前記ドライバー情報を取得し、
前記生成部は、さらに、前記撮像画像および前記ドライバー情報に基づいて、前記運転者の運転熟練度毎の前記パーソナルサリエンシーマップを生成し、
前記判断部は、さらに、前記視線検出部により検出した前記視線分布と、生成した前記パーソナルサリエンシーマップとを比較して、前記運転者の運転熟練度を判別する、
運転支援装置。 - 前記通知部は、前記運転者の運転熟練度の判別結果に応じて、前記危険通知の通知頻度を変更する請求項1に記載の運転支援装置。
- 前記通知部は、第1運転熟練度の前記パーソナルサリエンシーマップと前記視線検出部により検出した前記視線分布との差が予め設定された閾値以上である場合と、前記第1運転熟練度より高い第2運転熟練度の前記パーソナルサリエンシーマップと前記視線検出部により検出した前記視線分布との差が予め設定された閾値以上である場合とで、前記危険通知の通知頻度を変更する請求項1または2に記載の運転支援装置。
- 前記生成部は、さらに、前記撮像画像に基づいてボトムアップサリエンシーマップを生成し、前記パーソナルサリエンシーマップから前記ボトムアップサリエンシーマップを除いたトップダウンサリエンシーマップを生成し、前記視線検出部により検出した前記視線分布と前記ボトムアップサリエンシーマップとの差が予め設定された閾値以上である場合と、当該視線分布と前記トップダウンサリエンシーマップとの差が予め設定された閾値以上である場合とで、前記危険通知の通知頻度を変更する請求項1から3のいずれか一に記載の運転支援装置。
Priority Applications (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2018203218A JP7222216B2 (ja) | 2018-10-29 | 2018-10-29 | 運転支援装置 |
DE102019128840.1A DE102019128840A1 (de) | 2018-10-29 | 2019-10-25 | Fahrassistenzgerät |
US16/663,638 US11440473B2 (en) | 2018-10-29 | 2019-10-25 | Driving assistance apparatus |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2018203218A JP7222216B2 (ja) | 2018-10-29 | 2018-10-29 | 運転支援装置 |
Publications (2)
Publication Number | Publication Date |
---|---|
JP2020071537A JP2020071537A (ja) | 2020-05-07 |
JP7222216B2 true JP7222216B2 (ja) | 2023-02-15 |
Family
ID=70325029
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
JP2018203218A Active JP7222216B2 (ja) | 2018-10-29 | 2018-10-29 | 運転支援装置 |
Country Status (3)
Country | Link |
---|---|
US (1) | US11440473B2 (ja) |
JP (1) | JP7222216B2 (ja) |
DE (1) | DE102019128840A1 (ja) |
Families Citing this family (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP7263734B2 (ja) * | 2018-10-29 | 2023-04-25 | 株式会社アイシン | 視認対象判定装置 |
JP7273544B2 (ja) * | 2019-03-07 | 2023-05-15 | 株式会社Subaru | 車両の情報提供装置、車両の情報提供方法及びプログラム |
JP7183943B2 (ja) * | 2019-05-09 | 2022-12-06 | トヨタ自動車株式会社 | ステアリングモジュール |
JP7331729B2 (ja) * | 2020-02-19 | 2023-08-23 | マツダ株式会社 | 運転者状態推定装置 |
JP7331728B2 (ja) * | 2020-02-19 | 2023-08-23 | マツダ株式会社 | 運転者状態推定装置 |
US11854242B2 (en) * | 2020-09-23 | 2023-12-26 | Apple Inc. | Systems and methods for providing personalized saliency models |
US11999356B2 (en) | 2020-11-13 | 2024-06-04 | Toyota Research Institute, Inc. | Cognitive heat map: a model for driver situational awareness |
CN112849148B (zh) * | 2021-01-11 | 2023-03-14 | 重庆长安汽车股份有限公司 | 一种自动驾驶功能控制方法、自动驾驶系统、汽车、控制器及计算机可读存储介质 |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2005267108A (ja) | 2004-03-17 | 2005-09-29 | Denso Corp | 運転支援装置 |
JP2007017340A (ja) | 2005-07-08 | 2007-01-25 | Aisin Aw Co Ltd | ナビゲーション装置及びナビゲーション方法 |
JP2007133692A (ja) | 2005-11-10 | 2007-05-31 | Toyota Motor Corp | 運転行動評価装置 |
JP2018097398A (ja) | 2016-12-07 | 2018-06-21 | トヨタ自動車株式会社 | 視線推定システム |
Family Cites Families (47)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8189825B2 (en) * | 1994-05-09 | 2012-05-29 | Breed David S | Sound management techniques for vehicles |
US7835834B2 (en) * | 2005-05-16 | 2010-11-16 | Delphi Technologies, Inc. | Method of mitigating driver distraction |
KR100708165B1 (ko) | 2005-07-20 | 2007-04-17 | 삼성전자주식회사 | 어레이 잉크젯 헤드 및 이를 적용한 잉크젯 화상형성장치 |
US7668400B2 (en) * | 2006-07-31 | 2010-02-23 | Hewlett-Packard Development Company, L.P. | Image layout constraint generation |
US7747107B2 (en) * | 2007-03-06 | 2010-06-29 | Mitsubishi Electric Research Laboratories, Inc. | Method for retargeting images |
GB2451483B (en) * | 2007-07-31 | 2012-05-30 | Hewlett Packard Development Co | Image processing method, system and computer readable medium |
JP2009093341A (ja) | 2007-10-05 | 2009-04-30 | Toyota Central R&D Labs Inc | 認知再現装置及びプログラム並びに交通流シミュレーション装置及びプログラム |
US8808195B2 (en) * | 2009-01-15 | 2014-08-19 | Po-He Tseng | Eye-tracking method and system for screening human diseases |
US8774498B2 (en) * | 2009-01-28 | 2014-07-08 | Xerox Corporation | Modeling images as sets of weighted features |
US8175376B2 (en) * | 2009-03-09 | 2012-05-08 | Xerox Corporation | Framework for image thumbnailing based on visual similarity |
US8629784B2 (en) * | 2009-04-02 | 2014-01-14 | GM Global Technology Operations LLC | Peripheral salient feature enhancement on full-windshield head-up display |
US8384534B2 (en) * | 2010-01-14 | 2013-02-26 | Toyota Motor Engineering & Manufacturing North America, Inc. | Combining driver and environment sensing for vehicular safety systems |
US8649606B2 (en) * | 2010-02-10 | 2014-02-11 | California Institute Of Technology | Methods and systems for generating saliency models through linear and/or nonlinear integration |
US8471691B2 (en) * | 2010-06-15 | 2013-06-25 | GM Global Technology Operations LLC | Portable vision system |
US8675966B2 (en) * | 2011-09-29 | 2014-03-18 | Hewlett-Packard Development Company, L.P. | System and method for saliency map generation |
WO2014042571A1 (en) * | 2012-09-17 | 2014-03-20 | Volvo Truck Corporation | Method and system for providing a tutorial message to a driver of a vehicle |
US8847771B2 (en) * | 2013-01-25 | 2014-09-30 | Toyota Motor Engineering & Manufacturing North America, Inc. | Method and apparatus for early detection of dynamic attentive states for providing an inattentive warning |
US9324161B2 (en) * | 2013-03-13 | 2016-04-26 | Disney Enterprises, Inc. | Content-aware image compression method |
US10213162B2 (en) * | 2013-04-06 | 2019-02-26 | Honda Motor Co., Ltd. | System and method for capturing and decontaminating photoplethysmopgraphy (PPG) signals in a vehicle |
US9467750B2 (en) * | 2013-05-31 | 2016-10-11 | Adobe Systems Incorporated | Placing unobtrusive overlays in video content |
WO2015045063A1 (ja) * | 2013-09-26 | 2015-04-02 | 富士通株式会社 | 駆動制御装置、電子機器、及び駆動制御方法 |
US10165176B2 (en) * | 2013-10-31 | 2018-12-25 | The University Of North Carolina At Chapel Hill | Methods, systems, and computer readable media for leveraging user gaze in user monitoring subregion selection systems |
GB2525656B (en) * | 2014-05-01 | 2018-01-31 | Jaguar Land Rover Ltd | Control apparatus and related methods for addressing driver distraction |
US9283847B2 (en) * | 2014-05-05 | 2016-03-15 | State Farm Mutual Automobile Insurance Company | System and method to monitor and alert vehicle operator of impairment |
US20150339589A1 (en) * | 2014-05-21 | 2015-11-26 | Brain Corporation | Apparatus and methods for training robots utilizing gaze-based saliency maps |
CN106663208B (zh) * | 2014-08-28 | 2019-04-23 | 高通股份有限公司 | 时间显著图 |
US10503999B2 (en) * | 2015-03-24 | 2019-12-10 | Hrl Laboratories, Llc | System for detecting salient objects in images |
US9937791B2 (en) * | 2015-04-29 | 2018-04-10 | Ashton Cameron Cofer | Systems and methods for detecting and alerting a drowsy driver |
CN106296638A (zh) * | 2015-06-04 | 2017-01-04 | 欧姆龙株式会社 | 显著性信息取得装置以及显著性信息取得方法 |
WO2016207875A1 (en) * | 2015-06-22 | 2016-12-29 | Photomyne Ltd. | System and method for detecting objects in an image |
US10489691B2 (en) * | 2016-01-15 | 2019-11-26 | Ford Global Technologies, Llc | Fixation generation for machine learning |
US10055652B2 (en) * | 2016-03-21 | 2018-08-21 | Ford Global Technologies, Llc | Pedestrian detection and motion prediction with rear-facing camera |
EP3438948B1 (en) * | 2016-05-11 | 2023-08-30 | Sony Group Corporation | Image processing apparatus, image processing method, and mobile body |
JP6531719B2 (ja) * | 2016-05-23 | 2019-06-19 | 株式会社デンソー | ドライバ状態検知装置、ドライバ状態検知方法 |
CN109906165A (zh) * | 2016-08-10 | 2019-06-18 | 兹沃公司 | 使用推断的注意力模型经由收集和存储的元数据提供信息的方法和设备 |
US10255521B2 (en) * | 2016-12-12 | 2019-04-09 | Jack Cooper Logistics, LLC | System, method, and apparatus for detection of damages on surfaces |
US10379612B1 (en) * | 2016-12-16 | 2019-08-13 | Apple Inc. | Electronic device with gaze tracking system |
US20180229372A1 (en) * | 2017-02-10 | 2018-08-16 | JIBO, Inc. | Maintaining attention and conveying believability via expression and goal-directed behavior with a social robot |
JP7009882B2 (ja) * | 2017-09-26 | 2022-01-26 | 富士通株式会社 | 表示プログラム、表示方法、及び表示装置 |
JP6950432B2 (ja) * | 2017-10-05 | 2021-10-13 | トヨタ自動車株式会社 | 運転支援装置、情報処理装置、運転支援システム、運転支援方法 |
US10440276B2 (en) * | 2017-11-02 | 2019-10-08 | Adobe Inc. | Generating image previews based on capture information |
CN107943029A (zh) * | 2017-11-15 | 2018-04-20 | 苏州佳世达电通有限公司 | 运输方法及运输系统 |
US10475145B1 (en) * | 2017-12-21 | 2019-11-12 | Shutterstock, Inc. | Smart watermarking |
US10793186B2 (en) * | 2018-01-11 | 2020-10-06 | International Business Machines Corporation | Steering assistance based on driver analytics and behavior |
US11126257B2 (en) * | 2018-04-17 | 2021-09-21 | Toyota Research Institute, Inc. | System and method for detecting human gaze and gesture in unconstrained environments |
US20200064912A1 (en) * | 2018-08-22 | 2020-02-27 | Ford Global Technologies, Llc | Eye gaze tracking of a vehicle passenger |
US10902279B2 (en) * | 2018-09-25 | 2021-01-26 | Honda Motor Co., Ltd. | Training saliency |
-
2018
- 2018-10-29 JP JP2018203218A patent/JP7222216B2/ja active Active
-
2019
- 2019-10-25 US US16/663,638 patent/US11440473B2/en active Active
- 2019-10-25 DE DE102019128840.1A patent/DE102019128840A1/de active Pending
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2005267108A (ja) | 2004-03-17 | 2005-09-29 | Denso Corp | 運転支援装置 |
JP2007017340A (ja) | 2005-07-08 | 2007-01-25 | Aisin Aw Co Ltd | ナビゲーション装置及びナビゲーション方法 |
JP2007133692A (ja) | 2005-11-10 | 2007-05-31 | Toyota Motor Corp | 運転行動評価装置 |
JP2018097398A (ja) | 2016-12-07 | 2018-06-21 | トヨタ自動車株式会社 | 視線推定システム |
Also Published As
Publication number | Publication date |
---|---|
US20200130578A1 (en) | 2020-04-30 |
DE102019128840A1 (de) | 2020-04-30 |
US11440473B2 (en) | 2022-09-13 |
JP2020071537A (ja) | 2020-05-07 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP7222216B2 (ja) | 運転支援装置 | |
JP6806156B2 (ja) | 周辺監視装置 | |
US20200086793A1 (en) | Periphery monitoring device | |
US10131277B2 (en) | Surroundings monitoring apparatus | |
US9886859B2 (en) | Parking assistance device | |
US11648932B2 (en) | Periphery monitoring device | |
US11787335B2 (en) | Periphery monitoring device | |
JP2016097896A (ja) | 画像表示制御装置 | |
US10807643B2 (en) | Peripheral monitoring device | |
US11620834B2 (en) | Periphery monitoring device | |
US20190244324A1 (en) | Display control apparatus | |
US11393223B2 (en) | Periphery monitoring device | |
US10991086B2 (en) | Adhered substance detection apparatus | |
US20200084395A1 (en) | Periphery monitoring device | |
JP7263734B2 (ja) | 視認対象判定装置 | |
WO2022168540A1 (ja) | 表示制御装置及び表示制御プログラム | |
US11301701B2 (en) | Specific area detection device | |
JP6965563B2 (ja) | 周辺監視装置 | |
JP7276255B2 (ja) | 画像処理装置、プログラム、及び画像処理システム | |
KR102296213B1 (ko) | 영상 기록 장치 및 그 동작 방법 | |
JP7380073B2 (ja) | 駐車支援装置 | |
JP2022009331A (ja) | 周辺監視装置 | |
JP2024056653A (ja) | オブジェクト検出システム | |
JP2022121370A (ja) | 表示制御装置及び表示制御プログラム | |
JP2020071773A (ja) | 視線検出装置 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
A621 | Written request for application examination |
Free format text: JAPANESE INTERMEDIATE CODE: A621 Effective date: 20210909 |
|
A977 | Report on retrieval |
Free format text: JAPANESE INTERMEDIATE CODE: A971007 Effective date: 20220720 |
|
A131 | Notification of reasons for refusal |
Free format text: JAPANESE INTERMEDIATE CODE: A131 Effective date: 20220802 |
|
A521 | Request for written amendment filed |
Free format text: JAPANESE INTERMEDIATE CODE: A523 Effective date: 20220929 |
|
A131 | Notification of reasons for refusal |
Free format text: JAPANESE INTERMEDIATE CODE: A131 Effective date: 20221018 |
|
A521 | Request for written amendment filed |
Free format text: JAPANESE INTERMEDIATE CODE: A523 Effective date: 20221215 |
|
TRDD | Decision of grant or rejection written | ||
A01 | Written decision to grant a patent or to grant a registration (utility model) |
Free format text: JAPANESE INTERMEDIATE CODE: A01 Effective date: 20230104 |
|
A61 | First payment of annual fees (during grant procedure) |
Free format text: JAPANESE INTERMEDIATE CODE: A61 Effective date: 20230117 |
|
R150 | Certificate of patent or registration of utility model |
Ref document number: 7222216 Country of ref document: JP Free format text: JAPANESE INTERMEDIATE CODE: R150 |