CN105814886B - 图像处理设备、图像处理方法和程序 - Google Patents

图像处理设备、图像处理方法和程序 Download PDF

Info

Publication number
CN105814886B
CN105814886B CN201480067077.9A CN201480067077A CN105814886B CN 105814886 B CN105814886 B CN 105814886B CN 201480067077 A CN201480067077 A CN 201480067077A CN 105814886 B CN105814886 B CN 105814886B
Authority
CN
China
Prior art keywords
image
area
image data
vehicle
composite
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN201480067077.9A
Other languages
English (en)
Chinese (zh)
Other versions
CN105814886A (zh
Inventor
大场英史
真渊健
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sony Corp
Original Assignee
Sony Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sony Corp filed Critical Sony Corp
Publication of CN105814886A publication Critical patent/CN105814886A/zh
Application granted granted Critical
Publication of CN105814886B publication Critical patent/CN105814886B/zh
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformations in the plane of the image
    • G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
    • G06T3/4038—Image mosaicing, e.g. composing plane images from plane sub-images
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R1/00—Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/02—Rear-view mirror arrangements
    • B60R1/06—Rear-view mirror arrangements mounted on vehicle exterior
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H04N7/181—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R1/00—Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/20—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/22—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle
    • B60R1/23—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle with a predetermined field of view
    • B60R1/27—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle with a predetermined field of view providing all-round vision, e.g. using omnidirectional cameras
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T1/00—General purpose image data processing
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G06T19/20—Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformations in the plane of the image
    • G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
    • G—PHYSICS
    • G08—SIGNALLING
    • G08G—TRAFFIC CONTROL SYSTEMS
    • G08G1/00—Traffic control systems for road vehicles
    • G08G1/16—Anti-collision systems
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/10—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of camera system used
    • B60R2300/107—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of camera system used using stereoscopic cameras
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/30—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing
    • B60R2300/303—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing using joined images, e.g. multiple camera images
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/60—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by monitoring and displaying vehicle exterior scenes from a transformed perspective
    • B60R2300/607—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by monitoring and displaying vehicle exterior scenes from a transformed perspective from a bird's eye viewpoint
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10016—Video; Image sequence
    • G06T2207/10021—Stereoscopic video; Stereoscopic image sequence
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20212—Image combination
    • G06T2207/20221—Image fusion; Image merging
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30248—Vehicle exterior or interior
    • G06T2207/30252—Vehicle exterior; Vicinity of vehicle

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Mechanical Engineering (AREA)
  • Computer Graphics (AREA)
  • Computer Hardware Design (AREA)
  • General Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Architecture (AREA)
  • Signal Processing (AREA)
  • Image Processing (AREA)
  • Closed-Circuit Television Systems (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
CN201480067077.9A 2013-12-16 2014-11-27 图像处理设备、图像处理方法和程序 Expired - Fee Related CN105814886B (zh)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
JP2013259593A JP6232994B2 (ja) 2013-12-16 2013-12-16 画像処理装置、および画像処理方法、並びにプログラム
JP2013-259593 2013-12-16
PCT/JP2014/005932 WO2015092981A1 (en) 2013-12-16 2014-11-27 Image processing apparatus, image processing method, and program

Publications (2)

Publication Number Publication Date
CN105814886A CN105814886A (zh) 2016-07-27
CN105814886B true CN105814886B (zh) 2020-09-15

Family

ID=52101553

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201480067077.9A Expired - Fee Related CN105814886B (zh) 2013-12-16 2014-11-27 图像处理设备、图像处理方法和程序

Country Status (7)

Country Link
US (1) US10140775B2 (enExample)
EP (1) EP3039644B1 (enExample)
JP (1) JP6232994B2 (enExample)
CN (1) CN105814886B (enExample)
BR (1) BR112016013307A2 (enExample)
RU (1) RU2679987C2 (enExample)
WO (1) WO2015092981A1 (enExample)

Families Citing this family (30)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2015129280A1 (ja) * 2014-02-26 2015-09-03 京セラ株式会社 画像処理装置および画像処理方法
US10891736B1 (en) * 2015-06-23 2021-01-12 Amazon Technologies, Inc. Associating an agent with an event using motion analysis
JP6413974B2 (ja) * 2015-08-05 2018-10-31 株式会社デンソー キャリブレーション装置、キャリブレーション方法、及びプログラム
US10157452B1 (en) * 2015-09-28 2018-12-18 Amazon Technologies, Inc. Image processing system for image rectification
JP6493143B2 (ja) * 2015-10-15 2019-04-03 株式会社デンソー 表示制御装置及び表示制御プログラム
JP6512449B2 (ja) * 2016-01-20 2019-05-15 パナソニックＩｐマネジメント株式会社 表示装置
KR102371588B1 (ko) * 2016-05-02 2022-03-07 현대자동차주식회사 영상기반 장애물 인식 시스템 및 방법
US10636110B2 (en) * 2016-06-28 2020-04-28 Intel Corporation Architecture for interleaved rasterization and pixel shading for virtual reality and multi-view systems
KR101844885B1 (ko) * 2016-07-11 2018-05-18 엘지전자 주식회사 차량 운전 보조장치 및 이를 포함하는 차량
WO2018037789A1 (ja) 2016-08-22 2018-03-01 ソニー株式会社 画像処理装置、および画像処理方法、並びにプログラム
JP2018085008A (ja) 2016-11-25 2018-05-31 株式会社ジャパンディスプレイ 画像処理装置および画像処理装置の画像処理方法
KR102433824B1 (ko) * 2017-01-12 2022-08-17 현대모비스 주식회사 Avm 자동 공차 보정 시스템 및 그 방법
KR102466305B1 (ko) * 2017-01-12 2022-11-10 현대모비스 주식회사 Avm 자동 공차 보정 시스템 및 그 방법
DE102017214545A1 (de) * 2017-08-21 2019-02-21 Bayerische Motoren Werke Aktiengesellschaft Verfahren und Vorrichtung zur Ermittlung einer Wahrscheinlichkeit, mit der sich ein Objekt in einem Sichtfeld eines Fahrers eines Fahrzeugs befindet
US11004226B2 (en) * 2017-09-07 2021-05-11 Sony Corporation Image processing device, image processing method, and image display system for grasping a distance from an obstacle with a smaller visual line shift
JP6897442B2 (ja) * 2017-09-12 2021-06-30 株式会社Ｊｖｃケンウッド 車両用装置、キャリブレーション結果判定システム、および、キャリブレーション結果判定方法、ならびに、プログラム
JP7013751B2 (ja) * 2017-09-15 2022-02-01 株式会社アイシン 画像処理装置
DE102017216822A1 (de) * 2017-09-22 2019-03-28 Continental Automotive Gmbh Vorrichtung und Verfahren zum Anpassen einer Bildverarbeitung basierend auf einer Form einer Anzeigeneinrichtung für ein Kraftfahrzeug
JP6472864B1 (ja) * 2017-11-29 2019-02-20 株式会社近江デジタルファブリケーションズ 画像配信システム、及び配信画像生成方法
WO2019209067A1 (ko) * 2018-04-26 2019-10-31 주식회사 텐앤투 광각 영상 제공 시스템
CN108995592B (zh) * 2018-08-02 2021-06-15 张士文 汽车影像系统
US11024012B2 (en) * 2018-08-02 2021-06-01 Apple Inc. Directional scaling systems and methods
WO2020100835A1 (ja) * 2018-11-15 2020-05-22 パナソニックＩｐマネジメント株式会社 カメラシステム及び車両
EP3896962A4 (en) * 2018-12-11 2022-01-26 Sony Group Corporation Image processing device, image processing method, and image processing system
DE102019205440A1 (de) * 2019-04-16 2020-10-22 Zf Friedrichshafen Ag Lern-Verfahren zur winkelunabhängigen Objekterkennung für bewegliche und orts-feste Systeme
JP7225079B2 (ja) 2019-11-29 2023-02-20 日立Astemo株式会社 障害物認識装置
CN112565730B (zh) * 2020-12-03 2023-07-25 阿波罗智联(北京)科技有限公司 路侧感知方法、装置、电子设备、存储介质及路侧设备
KR102788777B1 (ko) * 2021-11-29 2025-04-01 주식회사 와이즈오토모티브 어라운드 뷰 영상을 생성하는 영상 생성 장치를 평가하기 위한 장치 및 방법
KR102795515B1 (ko) * 2021-12-17 2025-04-15 주식회사 와이즈오토모티브 어라운드 뷰 영상을 생성하는 영상 생성 장치를 평가하기 위한 장치 및 방법
US12394210B2 (en) 2022-12-09 2025-08-19 Lite-On Technology Corporation Processing method for vehicle surround view, vehicle surround view system and in-vehicle processing device

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2001083921A (ja) * 1999-09-16 2001-03-30 Dainippon Printing Co Ltd モニタのコントラスト調整方法
CN103338325A (zh) * 2013-06-14 2013-10-02 杭州普维光电技术有限公司 基于全景摄像机的车底盘图像采集方法

Family Cites Families (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2003030833A (ja) 2001-07-13 2003-01-31 Matsushita Electric Ind Co Ltd 光記録媒体、光記録媒体の記録方法及び光記録媒体の記録装置
DE60207655T2 (de) 2001-09-07 2006-06-08 Matsushita Electric Industrial Co., Ltd., Kadoma Vorrichtung zum Anzeigen der Umgebung eines Fahrzeuges und System zur Bildbereitstellung
JP4744823B2 (ja) * 2004-08-05 2011-08-10 株式会社東芝 周辺監視装置および俯瞰画像表示方法
EP1807732B1 (en) * 2004-10-25 2008-10-01 Koninklijke Philips Electronics N.V. Display device
JP4639753B2 (ja) * 2004-10-25 2011-02-23 日産自動車株式会社 運転支援装置
US7512262B2 (en) * 2005-02-25 2009-03-31 Microsoft Corporation Stereo-based image processing
JP4934308B2 (ja) * 2005-10-17 2012-05-16 三洋電機株式会社 運転支援システム
JP4861034B2 (ja) * 2006-03-29 2012-01-25 クラリオン株式会社 車載カメラのキャリブレーションシステム
WO2007129582A1 (ja) * 2006-05-09 2007-11-15 Nissan Motor Co., Ltd. 車両周辺画像提供装置及び車両周辺画像提供方法
JP2009077022A (ja) * 2007-09-19 2009-04-09 Sanyo Electric Co Ltd 運転支援システム及び車両
JP5068779B2 (ja) * 2009-02-27 2012-11-07 現代自動車株式会社 車両周囲俯瞰画像表示装置及び方法
JP5165631B2 (ja) 2009-04-14 2013-03-21 現代自動車株式会社 車両周囲画像表示システム
JP2012147149A (ja) * 2011-01-11 2012-08-02 Aisin Seiki Co Ltd 画像生成装置
TWM407861U (en) * 2011-03-17 2011-07-21 Acard Technology Corp Panorama motor vehicle auxiliary recorder
JP5483120B2 (ja) 2011-07-26 2014-05-07 アイシン精機株式会社 車両周辺監視システム
JP5870608B2 (ja) * 2011-10-13 2016-03-01 アイシン精機株式会社 画像生成装置
WO2013074604A2 (en) * 2011-11-15 2013-05-23 Magna Electronics, Inc. Calibration system and method for vehicular surround vision system
US9139133B2 (en) * 2012-05-31 2015-09-22 GM Global Technology Operations LLC Vehicle collision warning system and method

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2001083921A (ja) * 1999-09-16 2001-03-30 Dainippon Printing Co Ltd モニタのコントラスト調整方法
CN103338325A (zh) * 2013-06-14 2013-10-02 杭州普维光电技术有限公司 基于全景摄像机的车底盘图像采集方法

Also Published As

Publication number Publication date
RU2679987C2 (ru) 2019-02-14
RU2016122956A3 (enExample) 2018-07-16
BR112016013307A2 (pt) 2022-07-19
WO2015092981A1 (en) 2015-06-25
JP6232994B2 (ja) 2017-11-22
US20160217625A1 (en) 2016-07-28
JP2015119225A (ja) 2015-06-25
RU2016122956A (ru) 2017-12-12
EP3039644A1 (en) 2016-07-06
EP3039644B1 (en) 2019-11-27
US10140775B2 (en) 2018-11-27
CN105814886A (zh) 2016-07-27

Similar Documents

Publication Publication Date Title
CN105814886B (zh) 图像处理设备、图像处理方法和程序
JP4125252B2 (ja) 画像生成装置、画像生成方法、及び画像生成プログラム
JP5342036B2 (ja) ３ｄ表面形状をキャプチャーするための方法
CN110461268B (zh) 医疗用途的放大的高分辨率成像和跟踪
US10897600B1 (en) Sensor fusion based perceptually enhanced surround view
JP5632762B2 (ja) 測位情報形成装置、検出装置、及び測位情報形成方法
JP2019519128A (ja) 両眼視野／単眼視野間の移行
US20170358056A1 (en) Image generation device, coordinate converison table creation device and creation method
JP2012186653A (ja) 画像表示装置、方法およびプログラム
JP4950137B2 (ja) 撮像装置及びプログラム
US10685474B2 (en) Method for repairing incomplete 3D depth image using 2D image information
US12080075B2 (en) Method for generating an image of vehicle surroundings, and apparatus for generating an image of vehicle surroundings
JP5861114B2 (ja) 画像処理装置、及び画像処理方法
Xiang et al. A gradient-based approach for interference cancelation in systems with multiple Kinect cameras
US11145093B2 (en) Semiconductor device, image processing system, image processing method and computer readable storage medium
CN107531182A (zh) 车辆用显示装置以及车辆用显示方法
CN107548501B (zh) 用于驾驶员辅助系统的图像合成装置
US11119313B1 (en) Imaging systems and methods for expanding field of view of captured images
JP2023111638A (ja) 情報処理装置、情報処理方法、及びプログラム
KR20110088680A (ko) 복수개의 영상을 합성한 합성 영상에 대한 보정 기능을 구비하는 영상 처리 장치
US12505564B2 (en) Method and an apparatus for selecting a pixel's mask
US20240242361A1 (en) Method and an apparatus for selecting a pixel's mask
JP6136747B2 (ja) ２次元３次元表示装置
JP2013121150A (ja) 情報処理装置及び情報処理方法
KR101336955B1 (ko) 다시점 영상 생성 방법 및 시스템

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20200915