JP2020102027A - 制御装置、車両、画像表示システム、及び画像表示方法 - Google Patents
制御装置、車両、画像表示システム、及び画像表示方法 Download PDFInfo
- Publication number
- JP2020102027A JP2020102027A JP2018240111A JP2018240111A JP2020102027A JP 2020102027 A JP2020102027 A JP 2020102027A JP 2018240111 A JP2018240111 A JP 2018240111A JP 2018240111 A JP2018240111 A JP 2018240111A JP 2020102027 A JP2020102027 A JP 2020102027A
- Authority
- JP
- Japan
- Prior art keywords
- vehicle
- driver
- image
- unit
- control device
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims description 18
- 238000004891 communication Methods 0.000 claims description 34
- 230000006870 function Effects 0.000 description 18
- 238000003860 storage Methods 0.000 description 18
- 238000012545 processing Methods 0.000 description 16
- 230000015654 memory Effects 0.000 description 15
- 238000003384 imaging method Methods 0.000 description 5
- 238000010586 diagram Methods 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 239000004065 semiconductor Substances 0.000 description 3
- 101001093748 Homo sapiens Phosphatidylinositol N-acetylglucosaminyltransferase subunit P Proteins 0.000 description 2
- 206010049976 Impatience Diseases 0.000 description 2
- 210000001508 eye Anatomy 0.000 description 2
- 210000003128 head Anatomy 0.000 description 2
- 230000010365 information processing Effects 0.000 description 2
- 230000036772 blood pressure Effects 0.000 description 1
- 230000036760 body temperature Effects 0.000 description 1
- 210000005252 bulbus oculi Anatomy 0.000 description 1
- 238000012790 confirmation Methods 0.000 description 1
- 238000007796 conventional method Methods 0.000 description 1
- 238000005520 cutting process Methods 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 238000009826 distribution Methods 0.000 description 1
- 238000005401 electroluminescence Methods 0.000 description 1
- 230000004424 eye movement Effects 0.000 description 1
- 239000011521 glass Substances 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 230000007774 longterm Effects 0.000 description 1
- 239000000203 mixture Substances 0.000 description 1
- 238000003825 pressing Methods 0.000 description 1
- 230000035485 pulse pressure Effects 0.000 description 1
- 230000000153 supplemental effect Effects 0.000 description 1
- 230000035900 sweating Effects 0.000 description 1
- 238000009423 ventilation Methods 0.000 description 1
Images
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
- B60W40/08—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
- H04N7/181—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
- B60W50/08—Interaction between the driver and the control system
- B60W50/14—Means for informing the driver, warning the driver or prompting a driver intervention
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
- G01C21/26—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network
- G01C21/265—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network constructional aspects of navigation devices, e.g. housings, mountings, displays
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/40—Scenes; Scene-specific elements in video content
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/56—Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/59—Context or environment of the image inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
- G06V20/597—Recognising the driver's state or behaviour, e.g. attention or drowsiness
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/18—Eye characteristics, e.g. of the iris
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/44—Receiver circuitry for the reception of television signals according to analogue transmission standards
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
- H04N7/183—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a single remote source
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W2554/00—Input parameters relating to objects
- B60W2554/40—Dynamic objects, e.g. animals, windblown objects
- B60W2554/404—Characteristics
- B60W2554/4047—Attentiveness, e.g. distracted by mobile phone
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/40—Scenes; Scene-specific elements in video content
- G06V20/44—Event detection
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/15—Biometric patterns based on physiological signals, e.g. heartbeat, blood flow
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Radar, Positioning & Navigation (AREA)
- Remote Sensing (AREA)
- Automation & Control Theory (AREA)
- Signal Processing (AREA)
- Human Computer Interaction (AREA)
- Mechanical Engineering (AREA)
- Transportation (AREA)
- Mathematical Physics (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Ophthalmology & Optometry (AREA)
- Traffic Control Systems (AREA)
- Closed-Circuit Television Systems (AREA)
Abstract
Description
車両の運転手が運転中に前記車両の外に存在する対象を見逃したことをイベントとして検出し、検出したイベントで見逃された対象を含む画像である対象画像の、前記運転手に向けての出力を制御する制御部を備える。
制御装置が、車両の運転手が運転中に前記車両の外に存在する対象を見逃したことをイベントとして検出し、
前記車両の撮影部が、前記制御装置により検出されたイベントで見逃された対象を含む画像である対象画像を撮影し、
前記車両の出力部と、端末機器とのいずれかが、前記撮影部により撮影された対象画像を前記運転手に向けて表示する。
11 制御部
12 記憶部
13 通信部
14 測位部
15 撮影部
16 入力部
17 出力部
20 端末機器
21 制御部
22 記憶部
23 通信部
24 撮影部
25 入力部
26 出力部
30 画像表示システム
31 制御装置
32 ネットワーク
41 対象画像
Claims (11)
- 車両の運転手が運転中に前記車両の外に存在する対象を見逃したことをイベントとして検出し、検出したイベントで見逃された対象を含む画像である対象画像の、前記運転手に向けての出力を制御する制御部を備える制御装置。
- 前記制御部は、前記車両に備えられた、表示機能を有する出力部を制御して前記対象画像を前記運転手に向けて表示させる請求項1に記載の制御装置。
- 通信機能を有する通信部をさらに備え、
前記制御部は、前記通信部を制御して前記対象画像を前記運転手の端末機器へ送信させる請求項1に記載の制御装置。 - 前記対象画像は、前記車両から撮影された画像である請求項1から請求項3のいずれか1項に記載の制御装置。
- 前記対象画像は、前記制御部により前記イベントが検出される前に前記車両から撮影された画像である請求項4に記載の制御装置。
- 前記制御部は、前記車両で撮影された前記運転手を含む画像にて前記イベントを検出する請求項1から請求項5のいずれか1項に記載の制御装置。
- 前記制御部は、前記車両で行われた前記運転手の入力操作に基づいて前記イベントを検出する請求項1から請求項5のいずれか1項に記載の制御装置。
- 前記対象画像を撮影する撮影部と、
請求項1から請求項7のいずれか1項に記載の制御装置と
を備える車両。 - 前記対象画像を前記運転手に向けて表示する出力部をさらに備える請求項8に記載の車両。
- 請求項1から請求項7のいずれか1項に記載の制御装置と、
前記対象画像を前記制御装置から受信し、前記対象画像を前記運転手に向けて表示する端末機器と
を備える画像表示システム。 - 制御装置が、車両の運転手が運転中に前記車両の外に存在する対象を見逃したことをイベントとして検出し、
前記車両の撮影部が、前記制御装置により検出されたイベントで見逃された対象を含む画像である対象画像を撮影し、
前記車両の出力部と、端末機器とのいずれかが、前記撮影部により撮影された対象画像を前記運転手に向けて表示する画像表示方法。
Priority Applications (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2018240111A JP7176398B2 (ja) | 2018-12-21 | 2018-12-21 | 制御装置、車両、画像表示システム、及び画像表示方法 |
US16/600,687 US11468692B2 (en) | 2018-12-21 | 2019-10-14 | Control device, vehicle, image display system, and image display method |
CN201911319897.3A CN111355925B (zh) | 2018-12-21 | 2019-12-19 | 控制装置、车辆、图像显示系统和图像显示方法 |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2018240111A JP7176398B2 (ja) | 2018-12-21 | 2018-12-21 | 制御装置、車両、画像表示システム、及び画像表示方法 |
Publications (2)
Publication Number | Publication Date |
---|---|
JP2020102027A true JP2020102027A (ja) | 2020-07-02 |
JP7176398B2 JP7176398B2 (ja) | 2022-11-22 |
Family
ID=71097577
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
JP2018240111A Active JP7176398B2 (ja) | 2018-12-21 | 2018-12-21 | 制御装置、車両、画像表示システム、及び画像表示方法 |
Country Status (3)
Country | Link |
---|---|
US (1) | US11468692B2 (ja) |
JP (1) | JP7176398B2 (ja) |
CN (1) | CN111355925B (ja) |
Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2006172215A (ja) * | 2004-12-16 | 2006-06-29 | Fuji Photo Film Co Ltd | 運転支援システム |
WO2015071924A1 (ja) * | 2013-11-12 | 2015-05-21 | 三菱電機株式会社 | 運転支援画像生成装置、運転支援画像表示装置、運転支援画像表示システム、及び運転支援画像生成プログラム |
Family Cites Families (29)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5583495A (en) * | 1992-09-02 | 1996-12-10 | Ben Lulu; Dani | Vehicle alarm system |
JP3386034B2 (ja) | 2000-05-10 | 2003-03-10 | 株式会社デンソー | ナビゲーション装置及び記録媒体 |
AU2003219926A1 (en) | 2002-02-26 | 2003-09-09 | Canesta, Inc. | Method and apparatus for recognizing objects |
DE60330980D1 (de) * | 2002-10-15 | 2010-03-04 | Volvo Technology Corp | Verfahren für die auswertung der kopf- und augenaktivität einer person |
US7986339B2 (en) | 2003-06-12 | 2011-07-26 | Redflex Traffic Systems Pty Ltd | Automated traffic violation monitoring and reporting system with combined video and still-image data |
JP2007225282A (ja) | 2004-03-31 | 2007-09-06 | Pioneer Electronic Corp | 情報提示装置、情報提示プログラム及び情報提示方法等 |
EP1961622B1 (en) | 2005-12-12 | 2018-06-13 | Panasonic Intellectual Property Corporation of America | Safety-travel assistance device |
JP2007318431A (ja) | 2006-05-25 | 2007-12-06 | Fujifilm Corp | 表示制御システムおよび表示制御方法 |
JP4767797B2 (ja) | 2006-09-05 | 2011-09-07 | 株式会社デンソーアイティーラボラトリ | 車両用ナビゲーション装置、方法およびプログラム |
US20100019932A1 (en) | 2008-07-24 | 2010-01-28 | Tele Atlas North America, Inc. | Driver Initiated Vehicle-to-Vehicle Anonymous Warning Device |
US8121618B2 (en) | 2009-10-28 | 2012-02-21 | Digimarc Corporation | Intuitive computing methods and systems |
US20120197522A1 (en) * | 2009-12-25 | 2012-08-02 | Hideki Fukuhara | Navigation device |
JP5910450B2 (ja) | 2012-10-03 | 2016-04-27 | 株式会社デンソー | 車両用ナビゲーションシステム |
US8876535B2 (en) * | 2013-03-15 | 2014-11-04 | State Farm Mutual Automobile Insurance Company | Real-time driver observation and scoring for driver's education |
TW201528112A (zh) * | 2013-12-27 | 2015-07-16 | Sony Corp | 控制裝置、控制方法及電腦程式 |
US9472023B2 (en) | 2014-10-06 | 2016-10-18 | Toyota Jidosha Kabushiki Kaisha | Safety system for augmenting roadway objects on a heads-up display |
US9586591B1 (en) * | 2015-05-04 | 2017-03-07 | State Farm Mutual Automobile Insurance Company | Real-time driver observation and progress monitoring |
KR101843773B1 (ko) | 2015-06-30 | 2018-05-14 | 엘지전자 주식회사 | 차량 운전 보조 장치, 차량용 디스플레이 장치 및 차량 |
JP2017111469A (ja) * | 2015-12-14 | 2017-06-22 | 富士通株式会社 | 道路標識視認判定システム、道路標識視認判定方法、及びプログラム |
JP6563798B2 (ja) | 2015-12-17 | 2019-08-21 | 大学共同利用機関法人自然科学研究機構 | 視覚認知支援システムおよび視認対象物の検出システム |
TWI575223B (zh) | 2016-01-07 | 2017-03-21 | 神達電腦股份有限公司 | 導航方法及導航裝置 |
CN105844257B (zh) * | 2016-04-11 | 2019-03-01 | 吉林大学 | 基于机器视觉雾天行车错失道路标志牌的预警系统及方法 |
JP6699831B2 (ja) * | 2016-04-28 | 2020-05-27 | トヨタ自動車株式会社 | 運転意識推定装置 |
US10789840B2 (en) | 2016-05-09 | 2020-09-29 | Coban Technologies, Inc. | Systems, apparatuses and methods for detecting driving behavior and triggering actions based on detected driving behavior |
CN106143307B (zh) * | 2016-07-11 | 2019-07-19 | 京东方科技集团股份有限公司 | 一种驾驶辅助系统及车辆 |
JP2018101337A (ja) | 2016-12-21 | 2018-06-28 | パナソニックIpマネジメント株式会社 | ドライブレコーダ |
CN107341468B (zh) * | 2017-06-30 | 2021-05-04 | 北京七鑫易维信息技术有限公司 | 驾驶员状态识别方法、装置、存储介质及处理器 |
US10471955B2 (en) | 2017-07-18 | 2019-11-12 | lvl5, Inc. | Stop sign and traffic light alert |
WO2020015403A1 (zh) * | 2018-07-16 | 2020-01-23 | Oppo广东移动通信有限公司 | 图像处理方法、装置、计算机可读存储介质和电子设备 |
-
2018
- 2018-12-21 JP JP2018240111A patent/JP7176398B2/ja active Active
-
2019
- 2019-10-14 US US16/600,687 patent/US11468692B2/en active Active
- 2019-12-19 CN CN201911319897.3A patent/CN111355925B/zh active Active
Patent Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2006172215A (ja) * | 2004-12-16 | 2006-06-29 | Fuji Photo Film Co Ltd | 運転支援システム |
WO2015071924A1 (ja) * | 2013-11-12 | 2015-05-21 | 三菱電機株式会社 | 運転支援画像生成装置、運転支援画像表示装置、運転支援画像表示システム、及び運転支援画像生成プログラム |
Also Published As
Publication number | Publication date |
---|---|
CN111355925B (zh) | 2021-09-14 |
US20200202150A1 (en) | 2020-06-25 |
JP7176398B2 (ja) | 2022-11-22 |
US11468692B2 (en) | 2022-10-11 |
CN111355925A (zh) | 2020-06-30 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US20190092345A1 (en) | Driving method, vehicle-mounted driving control terminal, remote driving terminal, and storage medium | |
US10281721B2 (en) | System and method for augmented reality head up display for vehicles | |
US9771083B2 (en) | Cognitive displays | |
US11351918B2 (en) | Driver-assistance device, driver-assistance system, method of assisting driver, and computer readable recording medium | |
US9613459B2 (en) | System and method for in-vehicle interaction | |
US11900672B2 (en) | Integrated internal and external camera system in vehicles | |
US10723266B2 (en) | On-vehicle display controller, on-vehicle display system, on-vehicle display control method, and non-transitory storage medium | |
US11057575B2 (en) | In-vehicle device, program, and vehicle for creating composite images | |
JP2013255168A (ja) | 撮像装置、および撮像方法 | |
CN105564343B (zh) | 用于连接移动照相机装置的装置和方法 | |
US11616905B2 (en) | Recording reproduction apparatus, recording reproduction method, and program | |
US20190135197A1 (en) | Image generation device, image generation method, recording medium, and image display system | |
JP6891926B2 (ja) | 車両システム、車両システムで実行される方法、および運転者支援システム | |
JP7176398B2 (ja) | 制御装置、車両、画像表示システム、及び画像表示方法 | |
EP3827297A1 (en) | Apparatus and method for use with vehicle | |
US20200204955A1 (en) | Map generation device, map generation system, map generation method, and map generation program | |
EP3209017A1 (en) | Vehicle image display system | |
US11072348B2 (en) | Driving assist device, vehicle, information providing device, driving assist system, and driving assist method | |
US20150130938A1 (en) | Vehicle Operational Display | |
CN117922433A (zh) | 影像监测方法、装置、电子设备、车辆及存储介质 | |
EP3785994A1 (en) | A system and method for highlighting of an object to a vehicle occupant | |
CN117360391A (zh) | 基于ar的数字后视镜系统、车辆及显示方法 | |
CN117755206A (zh) | 车辆视野调节方法、装置、计算机设备和存储介质 | |
JP2021124972A (ja) | 情報処理システム、および情報処理プログラム | |
JP2023006970A (ja) | 運転支援制御装置、及び運転支援制御方法 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
A621 | Written request for application examination |
Free format text: JAPANESE INTERMEDIATE CODE: A621 Effective date: 20210325 |
|
A131 | Notification of reasons for refusal |
Free format text: JAPANESE INTERMEDIATE CODE: A131 Effective date: 20220329 |
|
A521 | Request for written amendment filed |
Free format text: JAPANESE INTERMEDIATE CODE: A523 Effective date: 20220520 |
|
A131 | Notification of reasons for refusal |
Free format text: JAPANESE INTERMEDIATE CODE: A131 Effective date: 20220920 |
|
A521 | Request for written amendment filed |
Free format text: JAPANESE INTERMEDIATE CODE: A523 Effective date: 20220926 |
|
TRDD | Decision of grant or rejection written | ||
A01 | Written decision to grant a patent or to grant a registration (utility model) |
Free format text: JAPANESE INTERMEDIATE CODE: A01 Effective date: 20221011 |
|
A61 | First payment of annual fees (during grant procedure) |
Free format text: JAPANESE INTERMEDIATE CODE: A61 Effective date: 20221024 |
|
R151 | Written notification of patent or utility model registration |
Ref document number: 7176398 Country of ref document: JP Free format text: JAPANESE INTERMEDIATE CODE: R151 |