JP6730613B2 - 俯瞰映像生成装置、俯瞰映像生成システム、俯瞰映像生成方法およびプログラム - Google Patents

俯瞰映像生成装置、俯瞰映像生成システム、俯瞰映像生成方法およびプログラム Download PDF

Info

Publication number
JP6730613B2
JP6730613B2 JP2017036658A JP2017036658A JP6730613B2 JP 6730613 B2 JP6730613 B2 JP 6730613B2 JP 2017036658 A JP2017036658 A JP 2017036658A JP 2017036658 A JP2017036658 A JP 2017036658A JP 6730613 B2 JP6730613 B2 JP 6730613B2
Authority
JP
Japan
Prior art keywords
bird
obstacle
eye view
view image
vehicle
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2017036658A
Other languages
English (en)
Japanese (ja)
Other versions
JP2018142884A5 (enExample
JP2018142884A (ja
Inventor
友喜 桜木
友喜 桜木
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
JVCKenwood Corp
Original Assignee
JVCKenwood Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by JVCKenwood Corp filed Critical JVCKenwood Corp
Priority to JP2017036658A priority Critical patent/JP6730613B2/ja
Priority to EP17898618.8A priority patent/EP3547677B1/en
Priority to PCT/JP2017/039368 priority patent/WO2018159016A1/ja
Publication of JP2018142884A publication Critical patent/JP2018142884A/ja
Priority to US16/424,704 priority patent/US10715734B2/en
Publication of JP2018142884A5 publication Critical patent/JP2018142884A5/ja
Priority to US16/889,977 priority patent/US11032479B2/en
Application granted granted Critical
Publication of JP6730613B2 publication Critical patent/JP6730613B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/63—Control of cameras or camera modules by using electronic viewfinders
    • H04N23/633—Control of cameras or camera modules by using electronic viewfinders for displaying additional information relating to control or operation of the camera
    • H04N23/634—Warning indications
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformations in the plane of the image
    • G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
    • G06T3/4038—Image mosaicing, e.g. composing plane images from plane sub-images
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R1/00—Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/20—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/22—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle
    • B60R1/23—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle with a predetermined field of view
    • B60R1/27—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle with a predetermined field of view providing all-round vision, e.g. using omnidirectional cameras
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R1/00—Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/20—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/22—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle
    • B60R1/28—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle with an adjustable field of view
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R21/00—Arrangements or fittings on vehicles for protecting or preventing injuries to occupants or pedestrians in case of accidents or other traffic risks
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T1/00—General purpose image data processing
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/50—Constructional details
    • H04N23/54—Mounting of pick-up tubes, electronic image sensors, deviation or focusing coils
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/698—Control of cameras or camera modules for achieving an enlarged field of view, e.g. panoramic image capture
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/90—Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H04N7/181—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/30—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing
    • B60R2300/301—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing combining image information with other obstacle sensor information, e.g. using RADAR/LIDAR/SONAR sensors for estimating risk of collision
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/30—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing
    • B60R2300/303—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing using joined images, e.g. multiple camera images
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/60—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by monitoring and displaying vehicle exterior scenes from a transformed perspective
    • B60R2300/607—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by monitoring and displaying vehicle exterior scenes from a transformed perspective from a bird's eye viewpoint
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30248—Vehicle exterior or interior
    • G06T2207/30252—Vehicle exterior; Vicinity of vehicle

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Mechanical Engineering (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Closed-Circuit Television Systems (AREA)
  • Image Processing (AREA)
  • Image Analysis (AREA)
JP2017036658A 2017-02-28 2017-02-28 俯瞰映像生成装置、俯瞰映像生成システム、俯瞰映像生成方法およびプログラム Active JP6730613B2 (ja)

Priority Applications (5)

Application Number Priority Date Filing Date Title
JP2017036658A JP6730613B2 (ja) 2017-02-28 2017-02-28 俯瞰映像生成装置、俯瞰映像生成システム、俯瞰映像生成方法およびプログラム
EP17898618.8A EP3547677B1 (en) 2017-02-28 2017-10-31 Bird's eye view image generation device, bird's eye view image generation system, bird's eye view image generation method and program
PCT/JP2017/039368 WO2018159016A1 (ja) 2017-02-28 2017-10-31 俯瞰映像生成装置、俯瞰映像生成システム、俯瞰映像生成方法およびプログラム
US16/424,704 US10715734B2 (en) 2017-02-28 2019-05-29 Bird's-eye view video generation device, bird's-eye view video generation method, and non-transitory storage medium
US16/889,977 US11032479B2 (en) 2017-02-28 2020-06-02 Bird's-eye view video generation device, bird's-eye view video generation method, and non-transitory storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2017036658A JP6730613B2 (ja) 2017-02-28 2017-02-28 俯瞰映像生成装置、俯瞰映像生成システム、俯瞰映像生成方法およびプログラム

Publications (3)

Publication Number Publication Date
JP2018142884A JP2018142884A (ja) 2018-09-13
JP2018142884A5 JP2018142884A5 (enExample) 2019-12-19
JP6730613B2 true JP6730613B2 (ja) 2020-07-29

Family

ID=63370661

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2017036658A Active JP6730613B2 (ja) 2017-02-28 2017-02-28 俯瞰映像生成装置、俯瞰映像生成システム、俯瞰映像生成方法およびプログラム

Country Status (4)

Country Link
US (2) US10715734B2 (enExample)
EP (1) EP3547677B1 (enExample)
JP (1) JP6730613B2 (enExample)
WO (1) WO2018159016A1 (enExample)

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP6998360B2 (ja) * 2019-12-13 2022-01-18 本田技研工業株式会社 車両用表示装置及び駐車支援システム
CN111368641A (zh) * 2020-02-11 2020-07-03 北京百度网讯科技有限公司 障碍物筛选方法、装置、电子设备及存储介质
CN113411488A (zh) * 2020-03-17 2021-09-17 长沙智能驾驶研究院有限公司 全景图像生成方法、装置、存储介质及计算机设备
EP4320013A1 (en) * 2021-04-07 2024-02-14 Stoneridge, Inc. Vehicle display including an offset camera view
JP2023063070A (ja) * 2021-10-22 2023-05-09 トヨタ自動車株式会社 車両用走行支援装置
JP7366982B2 (ja) * 2021-11-24 2023-10-23 本田技研工業株式会社 制御装置、制御方法、及び制御プログラム
JP2024044213A (ja) * 2022-09-20 2024-04-02 トヨタ自動車株式会社 車両用表示制御装置
US20250080687A1 (en) * 2023-08-31 2025-03-06 Texas Instruments Incorporated Surround view using rear view camera
CN117074049B (zh) * 2023-10-19 2024-01-02 中汽传媒(天津)有限公司 一种基于虚实结合的智能驾驶车路云测试系统

Family Cites Families (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5850352A (en) * 1995-03-31 1998-12-15 The Regents Of The University Of California Immersive video, including video hypermosaicing to generate from multiple video views of a scene a three-dimensional video mosaic from which diverse virtual video scene images are synthesized, including panoramic, scene interactive and stereoscopic images
US20050031169A1 (en) * 2003-08-09 2005-02-10 Alan Shulman Birds eye view virtual imaging for real time composited wide field of view
JP4883977B2 (ja) * 2005-10-05 2012-02-22 アルパイン株式会社 車両用画像表示装置
JP5112998B2 (ja) * 2008-09-16 2013-01-09 本田技研工業株式会社 車両周囲監視装置
JP5182042B2 (ja) * 2008-11-28 2013-04-10 富士通株式会社 画像処理装置、画像処理方法及びコンピュータプログラム
CN102577372B (zh) 2009-09-24 2015-06-10 松下电器产业株式会社 驾驶辅助显示装置
JP5195776B2 (ja) * 2010-01-25 2013-05-15 株式会社デンソー 車両周辺監視装置
JP5853457B2 (ja) * 2011-07-20 2016-02-09 アイシン精機株式会社 車両周辺監視システム
JP5961472B2 (ja) * 2012-07-27 2016-08-02 日立建機株式会社 作業機械の周囲監視装置
US9728228B2 (en) * 2012-08-10 2017-08-08 Smartdrive Systems, Inc. Vehicle event playback apparatus and methods
JP6262068B2 (ja) * 2014-04-25 2018-01-17 日立建機株式会社 車体近傍障害物報知システム
EP3160138B1 (en) 2014-06-20 2021-03-17 Clarion Co., Ltd. Image synthesis system, image synthesis device therefor, and image synthesis method
JP6575445B2 (ja) * 2015-09-30 2019-09-18 アイシン精機株式会社 車両用画像処理装置
US10523865B2 (en) * 2016-01-06 2019-12-31 Texas Instruments Incorporated Three dimensional rendering for surround view using predetermined viewpoint lookup tables

Also Published As

Publication number Publication date
US11032479B2 (en) 2021-06-08
US20200296298A1 (en) 2020-09-17
EP3547677B1 (en) 2020-07-29
WO2018159016A1 (ja) 2018-09-07
EP3547677A4 (en) 2019-10-23
JP2018142884A (ja) 2018-09-13
EP3547677A1 (en) 2019-10-02
US20190281229A1 (en) 2019-09-12
US10715734B2 (en) 2020-07-14

Similar Documents

Publication Publication Date Title
JP6730613B2 (ja) 俯瞰映像生成装置、俯瞰映像生成システム、俯瞰映像生成方法およびプログラム
CN107097721B (zh) 驾驶辅助装置
JP5810773B2 (ja) 二輪車の後方映像表示装置
US11528413B2 (en) Image processing apparatus and image processing method to generate and display an image based on a vehicle movement
CN103987582B (zh) 驾驶辅助装置
US20190199940A1 (en) Image display apparatus
CN108886602B (zh) 信息处理装置
US10855934B2 (en) Generating bird's-eye view images
JP6730614B2 (ja) 車両用表示制御装置、車両用表示システム、車両用表示制御方法およびプログラム
JP2012214083A (ja) 画像生成装置、画像表示システム及び画像生成方法
WO2017110144A1 (ja) 俯瞰映像生成装置、俯瞰映像生成システム、俯瞰映像生成方法およびプログラム
JP2020068515A (ja) 画像処理装置
US20150098624A1 (en) Parking support apparatus
JP6398675B2 (ja) 画像生成装置
JP2020170341A (ja) 表示制御装置、表示制御方法及びプログラム
JP6760129B2 (ja) 俯瞰映像生成装置、俯瞰映像生成システム、俯瞰映像生成方法およびプログラム
JP6724821B2 (ja) 俯瞰映像生成装置、俯瞰映像生成システム、俯瞰映像生成方法およびプログラム
JP5943207B2 (ja) 車両の駐車操作支援用映像表示装置
JP2007251880A (ja) 車両用画像表示装置および画像合成方法
JP2005324593A (ja) トップビュー画像生成装置及びトップビュー画像表示方法
JP2020182217A (ja) 俯瞰映像生成装置、俯瞰映像生成方法およびプログラム
JP2020088801A (ja) 運転支援装置
JP6644264B2 (ja) 俯瞰映像生成装置、俯瞰映像生成システム、俯瞰映像生成方法およびプログラム
WO2013038509A1 (ja) 車両周辺監視装置および車両周辺監視システム

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20191031

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20191031

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20200602

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20200615

R150 Certificate of patent or registration of utility model

Ref document number: 6730613

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150