JP7063005B2 - 運転支援方法、車両、及び運転支援システム - Google Patents
運転支援方法、車両、及び運転支援システム Download PDFInfo
- Publication number
- JP7063005B2 JP7063005B2 JP2018033596A JP2018033596A JP7063005B2 JP 7063005 B2 JP7063005 B2 JP 7063005B2 JP 2018033596 A JP2018033596 A JP 2018033596A JP 2018033596 A JP2018033596 A JP 2018033596A JP 7063005 B2 JP7063005 B2 JP 7063005B2
- Authority
- JP
- Japan
- Prior art keywords
- driving support
- vehicle
- sound source
- voice
- display
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims description 47
- 230000008569 process Effects 0.000 claims description 24
- 238000012545 processing Methods 0.000 claims description 9
- 238000004891 communication Methods 0.000 description 11
- 230000015654 memory Effects 0.000 description 10
- 238000001514 detection method Methods 0.000 description 7
- 230000006870 function Effects 0.000 description 7
- 238000012986 modification Methods 0.000 description 6
- 230000004048 modification Effects 0.000 description 6
- 238000003384 imaging method Methods 0.000 description 5
- 230000001149 cognitive effect Effects 0.000 description 4
- 230000002093 peripheral effect Effects 0.000 description 4
- 238000013459 approach Methods 0.000 description 2
- 230000006399 behavior Effects 0.000 description 2
- 230000008859 change Effects 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 238000005401 electroluminescence Methods 0.000 description 2
- 238000009434 installation Methods 0.000 description 2
- 230000004807 localization Effects 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 238000000926 separation method Methods 0.000 description 2
- 230000001755 vocal effect Effects 0.000 description 2
- 238000013528 artificial neural network Methods 0.000 description 1
- 238000007796 conventional method Methods 0.000 description 1
- 238000012258 culturing Methods 0.000 description 1
- 239000000284 extract Substances 0.000 description 1
- 230000014509 gene expression Effects 0.000 description 1
- 230000010365 information processing Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 230000002123 temporal effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/20—Image preprocessing
- G06V10/22—Image preprocessing by selection of a specific region containing or referencing a pattern; Locating or processing of specific regions to guide the detection or recognition
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
- B60K35/10—Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
- B60K35/20—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
- B60K35/21—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor using visual output, e.g. blinking lights or matrix displays
- B60K35/22—Display screens
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
- B60K35/20—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
- B60K35/21—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor using visual output, e.g. blinking lights or matrix displays
- B60K35/23—Head-up displays [HUD]
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
- B60K35/20—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
- B60K35/26—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor using acoustic output
- B60K35/265—Voice
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
- B60K35/20—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
- B60K35/28—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor characterised by the type of the output information, e.g. video entertainment or vehicle dynamics information; characterised by the purpose of the output information, e.g. for attracting the attention of the driver
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
- B60W50/08—Interaction between the driver and the control system
- B60W50/14—Means for informing the driver, warning the driver or prompting a driver intervention
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S5/00—Position-fixing by co-ordinating two or more direction or position line determinations; Position-fixing by co-ordinating two or more distance determinations
- G01S5/01—Determining conditions which influence positioning, e.g. radio environment, state of motion or energy consumption
- G01S5/018—Involving non-radio wave signals or measurements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/16—Sound input; Sound output
- G06F3/167—Audio in a user interface, e.g. using voice commands for navigating, audio feedback
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/56—Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
- G06V20/58—Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/59—Context or environment of the image inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
- G06V20/597—Recognising the driver's state or behaviour, e.g. attention or drowsiness
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/08—Speech classification or search
- G10L15/18—Speech classification or search using natural language modelling
- G10L15/1815—Semantic context, e.g. disambiguation of the recognition hypotheses based on word meaning
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
- B60K2360/148—Instrument input by voice
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
- B60K2360/16—Type of output information
- B60K2360/178—Warnings
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
- B60W50/08—Interaction between the driver and the control system
- B60W50/14—Means for informing the driver, warning the driver or prompting a driver intervention
- B60W2050/146—Display means
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S5/00—Position-fixing by co-ordinating two or more direction or position line determinations; Position-fixing by co-ordinating two or more distance determinations
- G01S5/18—Position-fixing by co-ordinating two or more direction or position line determinations; Position-fixing by co-ordinating two or more distance determinations using ultrasonic, sonic, or infrasonic waves
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/26—Speech to text systems
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/08—Speech classification or search
- G10L2015/088—Word spotting
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L25/00—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
- G10L25/48—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Transportation (AREA)
- Mechanical Engineering (AREA)
- Theoretical Computer Science (AREA)
- Multimedia (AREA)
- Chemical & Material Sciences (AREA)
- Combustion & Propulsion (AREA)
- Human Computer Interaction (AREA)
- Automation & Control Theory (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Radar, Positioning & Navigation (AREA)
- Remote Sensing (AREA)
- General Engineering & Computer Science (AREA)
- General Health & Medical Sciences (AREA)
- Computational Linguistics (AREA)
- Acoustics & Sound (AREA)
- Artificial Intelligence (AREA)
- User Interface Of Digital Computer (AREA)
- Fittings On The Vehicle Exterior For Carrying Loads, And Devices For Holding Or Mounting Articles (AREA)
- Traffic Control Systems (AREA)
- Navigation (AREA)
Description
車両の運転支援方法であって、
前記車両の外部に位置する音源の音声を取得するステップと、
音声認識処理によって認識される前記音声の発話内容に応じた運転支援情報を、前記音声に基づいて特定される前記車両に対する前記音源の相対位置を示唆する表示態様で、表示部に表示させる表示ステップと、を含む。
音声取得部及び制御部を備える車両であって、
前記音声取得部は、前記車両の外部に位置する音源の音声を取得し、
前記制御部は、音声認識処理によって認識される前記音声の発話内容に応じた運転支援情報を、前記音声に基づいて特定される前記車両に対する前記音源の相対位置を示唆する表示態様で、表示部に表示させる。
車両と、前記車両と通信可能なサーバと、を備える運転支援システムであって、
前記車両は、前記車両の外部に位置する音源の音声を取得し、
前記車両又は前記サーバは、前記音声に基づいて前記車両に対する前記音源の相対位置を特定し、
前記車両又は前記サーバは、音声認識処理によって前記音声の発話内容を認識し、
前記車両は、前記発話内容に応じた運転支援情報を、前記音源の前記相対位置を示唆する表示態様で、表示部に表示させる。
図1を参照して、本発明の一実施形態に係る運転支援システム1の概要について説明する。運転支援システム1は、車両10と、サーバ20と、を備える。車両10は、例えば自動車を含むが、任意の他の車両を含んでもよい。サーバ20は、1つ又は互いに通信可能な複数のサーバ装置を含む。本実施形態では、説明の簡便のため、サーバ20が1つのサーバ装置であるものとして説明する。車両10及びサーバ20は、ネットワーク30を介して通信可能に接続される。ネットワーク30は、例えばインターネットを含むが、任意の他のネットワークを含んでもよい。
図1に示すように、車両10は、音声取得部11と、撮像部12と、表示部13と、通信部14と、記憶部15と、制御部16と、を備える。音声取得部11、撮像部12、表示部13、通信部14、記憶部15、及び制御部16は、例えばCAN(Controller Area Network)等の車載ネットワーク又は専用線を介して、互いに通信可能である。
図1に示すように、サーバ20は、サーバ通信部21と、サーバ記憶部22と、サーバ制御部23と、を備える。
図9を参照して、運転支援システム1の上述した動作のフローについて説明する。当該動作は、例えば車両10のイグニッションがオンである間、繰り返し実行されてもよい。
10 車両
11 音声取得部
110 マイク
12 撮像部
13 表示部
130 ウィンドシールド
131 表示パネル
14 通信部
15 記憶部
16 制御部
20 サーバ
21 サーバ通信部
22 サーバ記憶部
23 サーバ制御部
30 ネットワーク
40、40a、40b 音源
50、50a、50b 運転支援情報
51、51a、51b 運転支援情報
510、510a、510b 枠
511、511a、511b 第1表示要素
52、52a、52b 運転支援情報
520、520a、520b 枠
521、521a、521b 第1表示要素
53、53a、53b 運転支援情報
530、530a、530b 枠
531、531a、531b 第2表示要素
54、54a 運転支援情報
540、540a 枠
541、541a 第2表示要素
55、55a、55b 運転支援情報
Claims (9)
- 車両の運転支援方法であって、
前記車両の外部に位置する音源の音声を取得するステップと、
音声認識処理によって認識される前記音声の発話内容に応じた運転支援情報を、前記音声に基づいて特定される前記車両に対する前記音源の相対位置を示唆する表示態様で、表示部に表示させる表示ステップと、
を含み、
前記表示部は、ヘッドアップディスプレイであり、
前記表示ステップにおいて、前記運転支援情報の少なくとも一部を前記音源に重畳して表示させる、運転支援方法。 - 請求項1に記載の運転支援方法であって、
前記表示部に表示された前記運転支援情報は、前記運転支援情報と前記音源との対応関係を示す第1表示要素を含む、運転支援方法。 - 請求項1又は2に記載の運転支援方法であって、
前記表示部に表示された前記運転支援情報は、前記車両から前記音源の方向を示す第2表示要素を含む、運転支援方法。 - 請求項1から3のいずれか一項に記載の運転支援方法であって、
前記音声又は前記発話内容の長さと、前記発話内容に含まれる文言と、前記発話内容の文脈と、前記音声の音圧と、前記音源を撮像した1以上の撮像画像を用いる画像認識処理の実行結果と、のうち少なくとも1つに基づいて、前記表示ステップを実行するか否かが決定される、運転支援方法。 - 請求項1から4のいずれか一項に記載の運転支援方法であって、
前記音声認識処理の実行結果の確度を示唆する情報を前記表示部に表示させるステップを更に含む、運転支援方法。 - 請求項1から5のいずれか一項に記載の運転支援方法であって、
前記運転支援情報は、前記発話内容を示す文字列及び画像の少なくとも一方を含む、運転支援方法。 - 請求項1から5のいずれか一項に記載の運転支援方法であって、
前記運転支援情報は、前記発話内容を示す第1の文字列が短文化された第2の文字列を含む、運転支援方法。 - 音声取得部及び制御部を備える車両であって、
前記音声取得部は、前記車両の外部に位置する音源の音声を取得し、
前記制御部は、音声認識処理によって認識される前記音声の発話内容に応じた運転支援情報を、前記音声に基づいて特定される前記車両に対する前記音源の相対位置を示唆する表示態様で、表示部に表示させ、
前記表示部は、ヘッドアップディスプレイであり、
前記制御部は、前記運転支援情報の少なくとも一部を前記音源に重畳して表示させる、
車両。 - 車両と、前記車両と通信可能なサーバと、を備える運転支援システムであって、
前記車両は、前記車両の外部に位置する音源の音声を取得し、
前記車両又は前記サーバは、前記音声に基づいて前記車両に対する前記音源の相対位置を特定し、
前記車両又は前記サーバは、音声認識処理によって前記音声の発話内容を認識し、
前記車両は、前記発話内容に応じた運転支援情報を、前記音源の前記相対位置を示唆する表示態様で、表示部に表示させ、
前記表示部は、ヘッドアップディスプレイであり、
前記車両は、前記運転支援情報の少なくとも一部を前記音源に重畳して表示させる、
運転支援システム。
Priority Applications (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2018033596A JP7063005B2 (ja) | 2018-02-27 | 2018-02-27 | 運転支援方法、車両、及び運転支援システム |
US16/272,244 US10759447B2 (en) | 2018-02-27 | 2019-02-11 | Driving support method, vehicle, and driving support system |
CN201910133249.2A CN110194181B (zh) | 2018-02-27 | 2019-02-22 | 驾驶支持方法、车辆和驾驶支持系统 |
US16/941,601 US11097745B2 (en) | 2018-02-27 | 2020-07-29 | Driving support method, vehicle, and driving support system |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2018033596A JP7063005B2 (ja) | 2018-02-27 | 2018-02-27 | 運転支援方法、車両、及び運転支援システム |
Publications (2)
Publication Number | Publication Date |
---|---|
JP2019149023A JP2019149023A (ja) | 2019-09-05 |
JP7063005B2 true JP7063005B2 (ja) | 2022-05-09 |
Family
ID=67684296
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
JP2018033596A Active JP7063005B2 (ja) | 2018-02-27 | 2018-02-27 | 運転支援方法、車両、及び運転支援システム |
Country Status (3)
Country | Link |
---|---|
US (2) | US10759447B2 (ja) |
JP (1) | JP7063005B2 (ja) |
CN (1) | CN110194181B (ja) |
Families Citing this family (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN111194440A (zh) * | 2017-08-07 | 2020-05-22 | 北美日产公司 | 自主车辆通知系统和方法 |
JPWO2021210088A1 (ja) * | 2020-04-15 | 2021-10-21 | ||
US20210232836A1 (en) * | 2021-03-25 | 2021-07-29 | Intel Corporation | Vehicle data relation device and methods therefor |
CN114987518A (zh) * | 2021-07-23 | 2022-09-02 | 上海博汽智能科技有限公司 | 一种车载人机交互方法及系统 |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2006092482A (ja) | 2004-09-27 | 2006-04-06 | Yamaha Corp | 音声認識通報装置 |
JP2008009568A (ja) | 2006-06-27 | 2008-01-17 | Toyota Motor Corp | 説明表示装置 |
JP2009192489A (ja) | 2008-02-18 | 2009-08-27 | Toyota Motor Corp | 情報提供装置、情報表示方法、ナビゲーション装置 |
JP2015001776A (ja) | 2013-06-13 | 2015-01-05 | 三菱電機株式会社 | 運転支援装置 |
US20170309175A1 (en) | 2016-04-21 | 2017-10-26 | Hyundai Motor Company | Method for providing sound detection information, apparatus detecting sound around vehicle, and vehicle including the same |
Family Cites Families (21)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH082339A (ja) | 1994-06-16 | 1996-01-09 | Mitsubishi Automob Eng Co Ltd | 車外音導入装置 |
JPH1031882A (ja) | 1996-07-16 | 1998-02-03 | Niles Parts Co Ltd | 車両用音声記憶装置 |
JP2003004521A (ja) | 2001-06-27 | 2003-01-08 | Kenwood Corp | 車外音の識別装置 |
DE10131720B4 (de) | 2001-06-30 | 2017-02-23 | Robert Bosch Gmbh | Head-Up Display System und Verfahren |
ATE509332T1 (de) * | 2005-03-14 | 2011-05-15 | Harman Becker Automotive Sys | Automatische erkennung von fahrzeugbetrieb- geräuschsignalen |
JP2007034348A (ja) | 2005-07-22 | 2007-02-08 | Hitachi Ltd | 音声感知システム |
ATE424329T1 (de) * | 2006-10-02 | 2009-03-15 | Harman Becker Automotive Sys | Sprachsteuerung von fahrzeugelementen von ausserhalb einer fahrzeugkabine |
US8319620B2 (en) * | 2008-06-19 | 2012-11-27 | Personics Holdings Inc. | Ambient situation awareness system and method for vehicles |
JP5397735B2 (ja) | 2008-09-12 | 2014-01-22 | 株式会社デンソー | 車両用緊急車両接近検出システム |
DE102010001684A1 (de) * | 2010-02-09 | 2011-08-11 | Robert Bosch GmbH, 70469 | Verfahren zum Betreiben eines Head-Up-Display-Systems, Head-Up-Display-System |
JP2011232292A (ja) | 2010-04-30 | 2011-11-17 | Toyota Motor Corp | 車外音検出装置 |
WO2012097150A1 (en) * | 2011-01-12 | 2012-07-19 | Personics Holdings, Inc. | Automotive sound recognition system for enhanced situation awareness |
EP2709891B1 (en) * | 2011-05-20 | 2016-10-26 | Valeo Schalter und Sensoren GmbH | Method for supporting a driver using a portable device in a vehicle |
JP5622819B2 (ja) | 2012-09-28 | 2014-11-12 | 富士重工業株式会社 | 視線誘導システム |
JP2015005935A (ja) | 2013-06-21 | 2015-01-08 | 株式会社Jvcケンウッド | 警報音認知機能を備えた音響機器 |
US9262924B2 (en) * | 2014-07-09 | 2016-02-16 | Toyota Motor Engineering & Manufacturing North America, Inc. | Adapting a warning output based on a driver's view |
JP6361565B2 (ja) | 2015-04-23 | 2018-07-25 | 株式会社デンソー | 車載機器の動作制御装置 |
US9844981B2 (en) * | 2015-06-02 | 2017-12-19 | Karma Automotive Llc | Systems and methods for use in a vehicle for detecting external events |
KR101977090B1 (ko) * | 2015-07-22 | 2019-05-10 | 엘지전자 주식회사 | 차량 제어 장치 및 이를 구비한 차량의 제어방법 |
KR20170099188A (ko) * | 2016-02-23 | 2017-08-31 | 엘지전자 주식회사 | 차량 운전 보조장치 및 이를 포함하는 차량 |
US10088846B2 (en) * | 2016-03-03 | 2018-10-02 | GM Global Technology Operations LLC | System and method for intended passenger detection |
-
2018
- 2018-02-27 JP JP2018033596A patent/JP7063005B2/ja active Active
-
2019
- 2019-02-11 US US16/272,244 patent/US10759447B2/en active Active
- 2019-02-22 CN CN201910133249.2A patent/CN110194181B/zh active Active
-
2020
- 2020-07-29 US US16/941,601 patent/US11097745B2/en active Active
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2006092482A (ja) | 2004-09-27 | 2006-04-06 | Yamaha Corp | 音声認識通報装置 |
JP2008009568A (ja) | 2006-06-27 | 2008-01-17 | Toyota Motor Corp | 説明表示装置 |
JP2009192489A (ja) | 2008-02-18 | 2009-08-27 | Toyota Motor Corp | 情報提供装置、情報表示方法、ナビゲーション装置 |
JP2015001776A (ja) | 2013-06-13 | 2015-01-05 | 三菱電機株式会社 | 運転支援装置 |
US20170309175A1 (en) | 2016-04-21 | 2017-10-26 | Hyundai Motor Company | Method for providing sound detection information, apparatus detecting sound around vehicle, and vehicle including the same |
Also Published As
Publication number | Publication date |
---|---|
US11097745B2 (en) | 2021-08-24 |
JP2019149023A (ja) | 2019-09-05 |
US10759447B2 (en) | 2020-09-01 |
US20190263426A1 (en) | 2019-08-29 |
CN110194181B (zh) | 2022-07-05 |
CN110194181A (zh) | 2019-09-03 |
US20200353946A1 (en) | 2020-11-12 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP7063005B2 (ja) | 運転支援方法、車両、及び運転支援システム | |
US10908677B2 (en) | Vehicle system for providing driver feedback in response to an occupant's emotion | |
US10994612B2 (en) | Agent system, agent control method, and storage medium | |
JP6284331B2 (ja) | 会話支援装置、会話支援方法及び会話支援プログラム | |
US11176948B2 (en) | Agent device, agent presentation method, and storage medium | |
JP2005343431A (ja) | 車両用情報処理システム | |
US11450316B2 (en) | Agent device, agent presenting method, and storage medium | |
CN110968048B (zh) | 智能体装置、智能体控制方法以及存储介质 | |
US20080086260A1 (en) | Apparatus and method for recognizing voice in vehicles | |
EP3495942B1 (en) | Head-mounted display and control method thereof | |
JP2015114726A (ja) | 情報伝達装置及びその制御方法、情報装置、コンピュータプログラム | |
JP2020060861A (ja) | エージェントシステム、エージェント方法、およびプログラム | |
US20200317055A1 (en) | Agent device, agent device control method, and storage medium | |
US11974103B2 (en) | In-car headphone acoustical augmented reality system | |
JP2016199124A (ja) | 音場制御装置及び適用方法 | |
KR102371513B1 (ko) | 대화 시스템 및 대화 처리 방법 | |
CN111731320A (zh) | 智能体系统、智能体服务器及其控制方法、存储介质 | |
JP2019200125A (ja) | 経路案内制御装置および経路案内制御方法 | |
US11518399B2 (en) | Agent device, agent system, method for controlling agent device, and storage medium | |
CN112581977A (zh) | 实现声音检测及其响应的计算机装置和方法 | |
JP2019102062A (ja) | ヘッドマウントディスプレイ及びその制御方法 | |
JP2020060623A (ja) | エージェントシステム、エージェント方法、およびプログラム | |
JP7192561B2 (ja) | 音声出力装置および音声出力方法 | |
JP2023098263A (ja) | 車両用記録制御装置および記録方法 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
A621 | Written request for application examination |
Free format text: JAPANESE INTERMEDIATE CODE: A621 Effective date: 20200924 |
|
A977 | Report on retrieval |
Free format text: JAPANESE INTERMEDIATE CODE: A971007 Effective date: 20210831 |
|
A131 | Notification of reasons for refusal |
Free format text: JAPANESE INTERMEDIATE CODE: A131 Effective date: 20210907 |
|
A521 | Request for written amendment filed |
Free format text: JAPANESE INTERMEDIATE CODE: A523 Effective date: 20211013 |
|
TRDD | Decision of grant or rejection written | ||
A01 | Written decision to grant a patent or to grant a registration (utility model) |
Free format text: JAPANESE INTERMEDIATE CODE: A01 Effective date: 20220322 |
|
A61 | First payment of annual fees (during grant procedure) |
Free format text: JAPANESE INTERMEDIATE CODE: A61 Effective date: 20220404 |
|
R151 | Written notification of patent or utility model registration |
Ref document number: 7063005 Country of ref document: JP Free format text: JAPANESE INTERMEDIATE CODE: R151 |