JP7039879B2 - 表示制御装置 - Google Patents
表示制御装置 Download PDFInfo
- Publication number
- JP7039879B2 JP7039879B2 JP2017150671A JP2017150671A JP7039879B2 JP 7039879 B2 JP7039879 B2 JP 7039879B2 JP 2017150671 A JP2017150671 A JP 2017150671A JP 2017150671 A JP2017150671 A JP 2017150671A JP 7039879 B2 JP7039879 B2 JP 7039879B2
- Authority
- JP
- Japan
- Prior art keywords
- image
- unit
- height
- vehicle
- virtual projection
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000003384 imaging method Methods 0.000 claims description 47
- 238000012937 correction Methods 0.000 claims description 29
- 239000011165 3D composite Substances 0.000 claims description 11
- 230000002093 peripheral effect Effects 0.000 description 27
- 238000012545 processing Methods 0.000 description 16
- 240000004050 Pentaglottis sempervirens Species 0.000 description 10
- 235000004522 Pentaglottis sempervirens Nutrition 0.000 description 10
- 230000002194 synthesizing effect Effects 0.000 description 10
- 230000000630 rising effect Effects 0.000 description 8
- 238000010586 diagram Methods 0.000 description 7
- 230000008859 change Effects 0.000 description 6
- 238000001514 detection method Methods 0.000 description 5
- 238000000034 method Methods 0.000 description 5
- 230000001133 acceleration Effects 0.000 description 4
- 230000000694 effects Effects 0.000 description 4
- 239000000203 mixture Substances 0.000 description 4
- 230000008569 process Effects 0.000 description 4
- 101100064079 Mus musculus Pdss1 gene Proteins 0.000 description 3
- 238000002485 combustion reaction Methods 0.000 description 3
- 239000002131 composite material Substances 0.000 description 3
- 238000009434 installation Methods 0.000 description 3
- 230000006870 function Effects 0.000 description 2
- 238000004519 manufacturing process Methods 0.000 description 2
- 238000005259 measurement Methods 0.000 description 2
- 238000002156 mixing Methods 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 1
- 230000015572 biosynthetic process Effects 0.000 description 1
- 230000002542 deteriorative effect Effects 0.000 description 1
- 239000000446 fuel Substances 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000008439 repair process Effects 0.000 description 1
- 239000011435 rock Substances 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 239000013589 supplement Substances 0.000 description 1
- 238000003786 synthesis reaction Methods 0.000 description 1
- 238000002834 transmittance Methods 0.000 description 1
Images
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R1/00—Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
- B60R1/20—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
- B60R1/31—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles providing stereoscopic vision
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformations in the plane of the image
- G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
- G06T3/4038—Image mosaicing, e.g. composing plane images from plane sub-images
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R1/00—Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
- B60R1/20—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
- B60R1/22—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle
- B60R1/23—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle with a predetermined field of view
- B60R1/24—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle with a predetermined field of view in front of the vehicle
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R1/00—Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
- B60R1/20—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
- B60R1/22—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle
- B60R1/23—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle with a predetermined field of view
- B60R1/27—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle with a predetermined field of view providing all-round vision, e.g. using omnidirectional cameras
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R1/00—Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
- B60R1/20—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
- B60R1/22—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle
- B60R1/28—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle with an adjustable field of view
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T1/00—General purpose image data processing
- G06T1/0007—Image acquisition
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T15/00—3D [Three Dimensional] image rendering
- G06T15/10—Geometric effects
- G06T15/20—Perspective computation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/56—Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
- G06V20/58—Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
- H04N7/188—Capturing isolated or intermittent images triggered by the occurrence of a predetermined event, e.g. an object reaching a predetermined position
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
- B60R2300/10—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of camera system used
- B60R2300/105—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of camera system used using multiple cameras
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
- B60R2300/60—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by monitoring and displaying vehicle exterior scenes from a transformed perspective
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
- B60R2300/80—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement
- B60R2300/802—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement for monitoring and displaying vehicle exterior blind spot views
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30248—Vehicle exterior or interior
- G06T2207/30252—Vehicle exterior; Vicinity of vehicle
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2215/00—Indexing scheme for image rendering
- G06T2215/16—Using real world measurements to influence rendering
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Mechanical Engineering (AREA)
- Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Geometry (AREA)
- Computer Graphics (AREA)
- Software Systems (AREA)
- Signal Processing (AREA)
- Computing Systems (AREA)
- Closed-Circuit Television Systems (AREA)
- Image Processing (AREA)
Description
Y1=Y0×(第1高さH1)/(第2高さH2)・・・・(式1)
Claims (3)
- 車両の第一の高さ位置に設けられて前記車両の周囲のうち第一の方向の状況を撮像する第1撮像部から得られる第1画像と、前記第一の高さ位置とは異なる第二の高さ位置に設けられて前記第一の方向とは異なる第二の方向の状況を撮像する第2撮像部から得られる第2画像と、を取得する画像取得部と、
前記第1画像および前記第2画像を投影可能で、前記車両の接地面から高さ方向に立ち上がる側面を少なくとも備える三次元の仮想投影面を取得する投影面取得部と、
前記第1撮像部の位置から前記仮想投影面を臨んだ場合に前記仮想投影面に投影する前記第1画像の高さ方向の投影位置と、前記第2撮像部の位置から前記仮想投影面を臨んだ場合に前記仮想投影面に投影する前記第2画像の高さ方向の投影位置とのうち少なくとも一方を前記第一の高さ位置と前記第二の高さ位置との差に基づき、前記第1画像の内容と前記第2画像の内容とが整合するように補正する補正部と、
補正によって高さ方向の整合が取れた前記第1画像と前記第2画像を含む三次元合成画像を生成する画像合成部と、
を備える表示制御装置。 - 前記補正部は、前記第一の高さ位置と前記第二の高さ位置との高さ比に基づき、前記投影位置を補正する請求項1に記載の表示制御装置。
- さらに、前記車両の周囲に存在する物体の位置を検出可能な位置検出部を備え、
前記投影面取得部は、前記物体の位置に対応する位置に前記側面を備える前記仮想投影面を取得する請求項1または請求項2に記載の表示制御装置。
Priority Applications (5)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2017150671A JP7039879B2 (ja) | 2017-08-03 | 2017-08-03 | 表示制御装置 |
US16/632,930 US11383642B2 (en) | 2017-08-03 | 2018-02-21 | Display control apparatus |
EP18842006.1A EP3664014B1 (en) | 2017-08-03 | 2018-02-21 | Display control device |
PCT/JP2018/006260 WO2019026320A1 (ja) | 2017-08-03 | 2018-02-21 | 表示制御装置 |
CN201880048325.3A CN110945558B (zh) | 2017-08-03 | 2018-02-21 | 显示控制装置 |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2017150671A JP7039879B2 (ja) | 2017-08-03 | 2017-08-03 | 表示制御装置 |
Publications (2)
Publication Number | Publication Date |
---|---|
JP2019028920A JP2019028920A (ja) | 2019-02-21 |
JP7039879B2 true JP7039879B2 (ja) | 2022-03-23 |
Family
ID=65233362
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
JP2017150671A Active JP7039879B2 (ja) | 2017-08-03 | 2017-08-03 | 表示制御装置 |
Country Status (5)
Country | Link |
---|---|
US (1) | US11383642B2 (ja) |
EP (1) | EP3664014B1 (ja) |
JP (1) | JP7039879B2 (ja) |
CN (1) | CN110945558B (ja) |
WO (1) | WO2019026320A1 (ja) |
Families Citing this family (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2018131165A1 (ja) * | 2017-01-16 | 2018-07-19 | 富士通株式会社 | 情報処理プログラム、情報処理方法および情報処理装置 |
WO2019038901A1 (ja) * | 2017-08-25 | 2019-02-28 | 株式会社ソシオネクスト | 補正装置、補正プログラム及び記録媒体 |
JP6909151B2 (ja) * | 2017-12-28 | 2021-07-28 | アルパイン株式会社 | 車載システム |
DE102018214875A1 (de) * | 2018-08-31 | 2020-03-05 | Audi Ag | Verfahren und Anordnung zum Erzeugen einer Umgebungsrepräsentation eines Fahrzeugs und Fahrzeug mit einer solchen Anordnung |
WO2020068960A1 (en) * | 2018-09-26 | 2020-04-02 | Coherent Logix, Inc. | Any world view generation |
JP7000383B2 (ja) * | 2019-07-04 | 2022-01-19 | 株式会社デンソー | 画像処理装置および画像処理方法 |
US11948315B2 (en) * | 2020-12-31 | 2024-04-02 | Nvidia Corporation | Image composition in multiview automotive and robotics systems |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP5648746B2 (ja) | 2011-07-12 | 2015-01-07 | 日産自動車株式会社 | 車両用監視装置、車両用監視システム、端末装置及び車両の監視方法 |
WO2015194501A1 (ja) | 2014-06-20 | 2015-12-23 | クラリオン株式会社 | 映像合成システムとそのための映像合成装置及び映像合成方法 |
JP2016225865A (ja) | 2015-06-01 | 2016-12-28 | 東芝アルパイン・オートモティブテクノロジー株式会社 | 俯瞰画像生成装置 |
WO2017056989A1 (ja) | 2015-09-30 | 2017-04-06 | アイシン精機株式会社 | 車両用画像処理装置 |
Family Cites Families (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2000064175A1 (fr) * | 1999-04-16 | 2000-10-26 | Matsushita Electric Industrial Co., Ltd. | Dispositif de traitement d'images et systeme de surveillance |
US7741961B1 (en) * | 2006-09-29 | 2010-06-22 | Canesta, Inc. | Enhanced obstacle detection and tracking for three-dimensional imaging systems used in motor vehicles |
JP2008309519A (ja) * | 2007-06-12 | 2008-12-25 | Panasonic Corp | 画像処理を用いた物体検出装置 |
JP5057936B2 (ja) * | 2007-11-09 | 2012-10-24 | アルパイン株式会社 | 鳥瞰画像生成装置および方法 |
WO2010051979A1 (de) * | 2008-11-05 | 2010-05-14 | Johnson Controls Gmbh | Fahrzeuganzeigesystem bzw. projektionsdisplay für ein kraftfahrzeug und verfahren zur kalibrierung |
JP5483120B2 (ja) * | 2011-07-26 | 2014-05-07 | アイシン精機株式会社 | 車両周辺監視システム |
-
2017
- 2017-08-03 JP JP2017150671A patent/JP7039879B2/ja active Active
-
2018
- 2018-02-21 US US16/632,930 patent/US11383642B2/en active Active
- 2018-02-21 EP EP18842006.1A patent/EP3664014B1/en active Active
- 2018-02-21 WO PCT/JP2018/006260 patent/WO2019026320A1/ja unknown
- 2018-02-21 CN CN201880048325.3A patent/CN110945558B/zh active Active
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP5648746B2 (ja) | 2011-07-12 | 2015-01-07 | 日産自動車株式会社 | 車両用監視装置、車両用監視システム、端末装置及び車両の監視方法 |
WO2015194501A1 (ja) | 2014-06-20 | 2015-12-23 | クラリオン株式会社 | 映像合成システムとそのための映像合成装置及び映像合成方法 |
JP2016225865A (ja) | 2015-06-01 | 2016-12-28 | 東芝アルパイン・オートモティブテクノロジー株式会社 | 俯瞰画像生成装置 |
WO2017056989A1 (ja) | 2015-09-30 | 2017-04-06 | アイシン精機株式会社 | 車両用画像処理装置 |
Also Published As
Publication number | Publication date |
---|---|
EP3664014B1 (en) | 2022-08-10 |
US20200238907A1 (en) | 2020-07-30 |
CN110945558B (zh) | 2023-06-06 |
EP3664014A1 (en) | 2020-06-10 |
JP2019028920A (ja) | 2019-02-21 |
EP3664014A4 (en) | 2020-07-08 |
US11383642B2 (en) | 2022-07-12 |
WO2019026320A1 (ja) | 2019-02-07 |
CN110945558A (zh) | 2020-03-31 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP7039879B2 (ja) | 表示制御装置 | |
JP6115104B2 (ja) | 車両の制御装置、及び制御方法 | |
EP3687165B1 (en) | Display control device | |
US11440475B2 (en) | Periphery display control device | |
EP3002727B1 (en) | Periphery monitoring apparatus and periphery monitoring system | |
JP7091624B2 (ja) | 画像処理装置 | |
CN110997409B (zh) | 周边监控装置 | |
CN110877573A (zh) | 车辆周边显示装置 | |
JP6554866B2 (ja) | 画像表示制御装置 | |
JP6876236B2 (ja) | 表示制御装置 | |
JP7013751B2 (ja) | 画像処理装置 | |
JP7009785B2 (ja) | 周辺監視装置 | |
JP2022023870A (ja) | 表示制御装置 | |
JP7314518B2 (ja) | 周辺監視装置 | |
JP6965563B2 (ja) | 周辺監視装置 | |
JP2022009331A (ja) | 周辺監視装置 | |
JP2021064149A (ja) | 画像処理装置 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
A621 | Written request for application examination |
Free format text: JAPANESE INTERMEDIATE CODE: A621 Effective date: 20200714 |
|
A131 | Notification of reasons for refusal |
Free format text: JAPANESE INTERMEDIATE CODE: A131 Effective date: 20210824 |
|
A521 | Request for written amendment filed |
Free format text: JAPANESE INTERMEDIATE CODE: A523 Effective date: 20211014 |
|
TRDD | Decision of grant or rejection written | ||
A01 | Written decision to grant a patent or to grant a registration (utility model) |
Free format text: JAPANESE INTERMEDIATE CODE: A01 Effective date: 20220208 |
|
A61 | First payment of annual fees (during grant procedure) |
Free format text: JAPANESE INTERMEDIATE CODE: A61 Effective date: 20220221 |
|
R150 | Certificate of patent or registration of utility model |
Ref document number: 7039879 Country of ref document: JP Free format text: JAPANESE INTERMEDIATE CODE: R150 |