JP6232994B2 - 画像処理装置、および画像処理方法、並びにプログラム - Google Patents

画像処理装置、および画像処理方法、並びにプログラム Download PDF

Info

Publication number
JP6232994B2
JP6232994B2 JP2013259593A JP2013259593A JP6232994B2 JP 6232994 B2 JP6232994 B2 JP 6232994B2 JP 2013259593 A JP2013259593 A JP 2013259593A JP 2013259593 A JP2013259593 A JP 2013259593A JP 6232994 B2 JP6232994 B2 JP 6232994B2
Authority
JP
Japan
Prior art keywords
image
image processing
area
strip
images
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
JP2013259593A
Other languages
English (en)
Japanese (ja)
Other versions
JP2015119225A (ja
JP2015119225A5 (enExample
Inventor
英史 大場
英史 大場
謙 馬渕
謙 馬渕
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sony Corp
Original Assignee
Sony Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority to JP2013259593A priority Critical patent/JP6232994B2/ja
Application filed by Sony Corp filed Critical Sony Corp
Priority to BR112016013307A priority patent/BR112016013307A2/pt
Priority to PCT/JP2014/005932 priority patent/WO2015092981A1/en
Priority to EP14812308.6A priority patent/EP3039644B1/en
Priority to US14/917,711 priority patent/US10140775B2/en
Priority to CN201480067077.9A priority patent/CN105814886B/zh
Priority to RU2016122956A priority patent/RU2679987C2/ru
Publication of JP2015119225A publication Critical patent/JP2015119225A/ja
Publication of JP2015119225A5 publication Critical patent/JP2015119225A5/ja
Application granted granted Critical
Publication of JP6232994B2 publication Critical patent/JP6232994B2/ja
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G06T19/20—Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R1/00—Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/02—Rear-view mirror arrangements
    • B60R1/06—Rear-view mirror arrangements mounted on vehicle exterior
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H04N7/181—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R1/00—Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/20—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/22—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle
    • B60R1/23—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle with a predetermined field of view
    • B60R1/27—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle with a predetermined field of view providing all-round vision, e.g. using omnidirectional cameras
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T1/00—General purpose image data processing
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformations in the plane of the image
    • G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformations in the plane of the image
    • G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
    • G06T3/4038—Image mosaicing, e.g. composing plane images from plane sub-images
    • G—PHYSICS
    • G08—SIGNALLING
    • G08G—TRAFFIC CONTROL SYSTEMS
    • G08G1/00—Traffic control systems for road vehicles
    • G08G1/16—Anti-collision systems
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/10—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of camera system used
    • B60R2300/107—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of camera system used using stereoscopic cameras
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/30—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing
    • B60R2300/303—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing using joined images, e.g. multiple camera images
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/60—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by monitoring and displaying vehicle exterior scenes from a transformed perspective
    • B60R2300/607—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by monitoring and displaying vehicle exterior scenes from a transformed perspective from a bird's eye viewpoint
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10016—Video; Image sequence
    • G06T2207/10021—Stereoscopic video; Stereoscopic image sequence
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20212—Image combination
    • G06T2207/20221—Image fusion; Image merging
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30248—Vehicle exterior or interior
    • G06T2207/30252—Vehicle exterior; Vicinity of vehicle

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Mechanical Engineering (AREA)
  • Computer Graphics (AREA)
  • Computer Hardware Design (AREA)
  • General Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Architecture (AREA)
  • Signal Processing (AREA)
  • Image Processing (AREA)
  • Closed-Circuit Television Systems (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
JP2013259593A 2013-12-16 2013-12-16 画像処理装置、および画像処理方法、並びにプログラム Expired - Fee Related JP6232994B2 (ja)

Priority Applications (7)

Application Number Priority Date Filing Date Title
JP2013259593A JP6232994B2 (ja) 2013-12-16 2013-12-16 画像処理装置、および画像処理方法、並びにプログラム
PCT/JP2014/005932 WO2015092981A1 (en) 2013-12-16 2014-11-27 Image processing apparatus, image processing method, and program
EP14812308.6A EP3039644B1 (en) 2013-12-16 2014-11-27 Image processing apparatus, image processing method, and program
US14/917,711 US10140775B2 (en) 2013-12-16 2014-11-27 Image processing apparatus, image processing method, and program
BR112016013307A BR112016013307A2 (pt) 2013-12-16 2014-11-27 Aparelho de processamento de imagem, e, sistemas de processamento de imagem em automóvel e de monitoramento de veículo
CN201480067077.9A CN105814886B (zh) 2013-12-16 2014-11-27 图像处理设备、图像处理方法和程序
RU2016122956A RU2679987C2 (ru) 2013-12-16 2014-11-27 Устройство обработки изображений, способ обработки изображений и программа

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2013259593A JP6232994B2 (ja) 2013-12-16 2013-12-16 画像処理装置、および画像処理方法、並びにプログラム

Publications (3)

Publication Number Publication Date
JP2015119225A JP2015119225A (ja) 2015-06-25
JP2015119225A5 JP2015119225A5 (enExample) 2016-02-12
JP6232994B2 true JP6232994B2 (ja) 2017-11-22

Family

ID=52101553

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2013259593A Expired - Fee Related JP6232994B2 (ja) 2013-12-16 2013-12-16 画像処理装置、および画像処理方法、並びにプログラム

Country Status (7)

Country Link
US (1) US10140775B2 (enExample)
EP (1) EP3039644B1 (enExample)
JP (1) JP6232994B2 (enExample)
CN (1) CN105814886B (enExample)
BR (1) BR112016013307A2 (enExample)
RU (1) RU2679987C2 (enExample)
WO (1) WO2015092981A1 (enExample)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE112020004944T5 (de) 2019-11-29 2022-08-11 Hitachi Astemo, Ltd. Hinderniserkennungsvorrichtung

Families Citing this family (29)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2015129280A1 (ja) * 2014-02-26 2015-09-03 京セラ株式会社 画像処理装置および画像処理方法
US10891736B1 (en) * 2015-06-23 2021-01-12 Amazon Technologies, Inc. Associating an agent with an event using motion analysis
JP6413974B2 (ja) * 2015-08-05 2018-10-31 株式会社デンソー キャリブレーション装置、キャリブレーション方法、及びプログラム
US10157452B1 (en) * 2015-09-28 2018-12-18 Amazon Technologies, Inc. Image processing system for image rectification
JP6493143B2 (ja) * 2015-10-15 2019-04-03 株式会社デンソー 表示制御装置及び表示制御プログラム
JP6512449B2 (ja) * 2016-01-20 2019-05-15 パナソニックＩｐマネジメント株式会社 表示装置
KR102371588B1 (ko) * 2016-05-02 2022-03-07 현대자동차주식회사 영상기반 장애물 인식 시스템 및 방법
US10636110B2 (en) * 2016-06-28 2020-04-28 Intel Corporation Architecture for interleaved rasterization and pixel shading for virtual reality and multi-view systems
KR101844885B1 (ko) * 2016-07-11 2018-05-18 엘지전자 주식회사 차량 운전 보조장치 및 이를 포함하는 차량
WO2018037789A1 (ja) 2016-08-22 2018-03-01 ソニー株式会社 画像処理装置、および画像処理方法、並びにプログラム
JP2018085008A (ja) 2016-11-25 2018-05-31 株式会社ジャパンディスプレイ 画像処理装置および画像処理装置の画像処理方法
KR102433824B1 (ko) * 2017-01-12 2022-08-17 현대모비스 주식회사 Avm 자동 공차 보정 시스템 및 그 방법
KR102466305B1 (ko) * 2017-01-12 2022-11-10 현대모비스 주식회사 Avm 자동 공차 보정 시스템 및 그 방법
DE102017214545A1 (de) * 2017-08-21 2019-02-21 Bayerische Motoren Werke Aktiengesellschaft Verfahren und Vorrichtung zur Ermittlung einer Wahrscheinlichkeit, mit der sich ein Objekt in einem Sichtfeld eines Fahrers eines Fahrzeugs befindet
US11004226B2 (en) * 2017-09-07 2021-05-11 Sony Corporation Image processing device, image processing method, and image display system for grasping a distance from an obstacle with a smaller visual line shift
JP6897442B2 (ja) * 2017-09-12 2021-06-30 株式会社Ｊｖｃケンウッド 車両用装置、キャリブレーション結果判定システム、および、キャリブレーション結果判定方法、ならびに、プログラム
JP7013751B2 (ja) * 2017-09-15 2022-02-01 株式会社アイシン 画像処理装置
DE102017216822A1 (de) * 2017-09-22 2019-03-28 Continental Automotive Gmbh Vorrichtung und Verfahren zum Anpassen einer Bildverarbeitung basierend auf einer Form einer Anzeigeneinrichtung für ein Kraftfahrzeug
JP6472864B1 (ja) * 2017-11-29 2019-02-20 株式会社近江デジタルファブリケーションズ 画像配信システム、及び配信画像生成方法
WO2019209067A1 (ko) * 2018-04-26 2019-10-31 주식회사 텐앤투 광각 영상 제공 시스템
CN108995592B (zh) * 2018-08-02 2021-06-15 张士文 汽车影像系统
US11024012B2 (en) * 2018-08-02 2021-06-01 Apple Inc. Directional scaling systems and methods
WO2020100835A1 (ja) * 2018-11-15 2020-05-22 パナソニックＩｐマネジメント株式会社 カメラシステム及び車両
EP3896962A4 (en) * 2018-12-11 2022-01-26 Sony Group Corporation Image processing device, image processing method, and image processing system
DE102019205440A1 (de) * 2019-04-16 2020-10-22 Zf Friedrichshafen Ag Lern-Verfahren zur winkelunabhängigen Objekterkennung für bewegliche und orts-feste Systeme
CN112565730B (zh) * 2020-12-03 2023-07-25 阿波罗智联(北京)科技有限公司 路侧感知方法、装置、电子设备、存储介质及路侧设备
KR102788777B1 (ko) * 2021-11-29 2025-04-01 주식회사 와이즈오토모티브 어라운드 뷰 영상을 생성하는 영상 생성 장치를 평가하기 위한 장치 및 방법
KR102795515B1 (ko) * 2021-12-17 2025-04-15 주식회사 와이즈오토모티브 어라운드 뷰 영상을 생성하는 영상 생성 장치를 평가하기 위한 장치 및 방법
US12394210B2 (en) 2022-12-09 2025-08-19 Lite-On Technology Corporation Processing method for vehicle surround view, vehicle surround view system and in-vehicle processing device

Family Cites Families (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4508319B2 (ja) * 1999-09-16 2010-07-21 大日本印刷株式会社 モニタのコントラスト調整方法
JP2003030833A (ja) 2001-07-13 2003-01-31 Matsushita Electric Ind Co Ltd 光記録媒体、光記録媒体の記録方法及び光記録媒体の記録装置
DE60207655T2 (de) 2001-09-07 2006-06-08 Matsushita Electric Industrial Co., Ltd., Kadoma Vorrichtung zum Anzeigen der Umgebung eines Fahrzeuges und System zur Bildbereitstellung
JP4744823B2 (ja) * 2004-08-05 2011-08-10 株式会社東芝 周辺監視装置および俯瞰画像表示方法
EP1807732B1 (en) * 2004-10-25 2008-10-01 Koninklijke Philips Electronics N.V. Display device
JP4639753B2 (ja) * 2004-10-25 2011-02-23 日産自動車株式会社 運転支援装置
US7512262B2 (en) * 2005-02-25 2009-03-31 Microsoft Corporation Stereo-based image processing
JP4934308B2 (ja) * 2005-10-17 2012-05-16 三洋電機株式会社 運転支援システム
JP4861034B2 (ja) * 2006-03-29 2012-01-25 クラリオン株式会社 車載カメラのキャリブレーションシステム
WO2007129582A1 (ja) * 2006-05-09 2007-11-15 Nissan Motor Co., Ltd. 車両周辺画像提供装置及び車両周辺画像提供方法
JP2009077022A (ja) * 2007-09-19 2009-04-09 Sanyo Electric Co Ltd 運転支援システム及び車両
JP5068779B2 (ja) * 2009-02-27 2012-11-07 現代自動車株式会社 車両周囲俯瞰画像表示装置及び方法
JP5165631B2 (ja) 2009-04-14 2013-03-21 現代自動車株式会社 車両周囲画像表示システム
JP2012147149A (ja) * 2011-01-11 2012-08-02 Aisin Seiki Co Ltd 画像生成装置
TWM407861U (en) * 2011-03-17 2011-07-21 Acard Technology Corp Panorama motor vehicle auxiliary recorder
JP5483120B2 (ja) 2011-07-26 2014-05-07 アイシン精機株式会社 車両周辺監視システム
JP5870608B2 (ja) * 2011-10-13 2016-03-01 アイシン精機株式会社 画像生成装置
WO2013074604A2 (en) * 2011-11-15 2013-05-23 Magna Electronics, Inc. Calibration system and method for vehicular surround vision system
US9139133B2 (en) * 2012-05-31 2015-09-22 GM Global Technology Operations LLC Vehicle collision warning system and method
CN103338325A (zh) * 2013-06-14 2013-10-02 杭州普维光电技术有限公司 基于全景摄像机的车底盘图像采集方法

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE112020004944T5 (de) 2019-11-29 2022-08-11 Hitachi Astemo, Ltd. Hinderniserkennungsvorrichtung

Also Published As

Publication number Publication date
RU2679987C2 (ru) 2019-02-14
RU2016122956A3 (enExample) 2018-07-16
BR112016013307A2 (pt) 2022-07-19
WO2015092981A1 (en) 2015-06-25
US20160217625A1 (en) 2016-07-28
JP2015119225A (ja) 2015-06-25
RU2016122956A (ru) 2017-12-12
EP3039644A1 (en) 2016-07-06
CN105814886B (zh) 2020-09-15
EP3039644B1 (en) 2019-11-27
US10140775B2 (en) 2018-11-27
CN105814886A (zh) 2016-07-27

Similar Documents

Publication Publication Date Title
JP6232994B2 (ja) 画像処理装置、および画像処理方法、並びにプログラム
JP5342036B2 (ja) ３ｄ表面形状をキャプチャーするための方法
JP3886769B2 (ja) 補正画像生成装置および補正画像生成プログラム
TWI510086B (zh) 數位重對焦方法
JP5971223B2 (ja) 合成画像生成装置
KR101077584B1 (ko) 복수개의 카메라로부터 획득한 영상을 정합하는 영상 처리 장치 및 방법
JP5222205B2 (ja) 画像処理装置、方法及びプログラム
CN102273201B (zh) 车辆用周边监视装置以及车辆用周边图像显示方法
CN109948398B (zh) 全景泊车的图像处理方法及全景泊车装置
KR101339121B1 (ko) 다중 룩업 테이블을 이용한 차량 어라운드 뷰 영상 생성장치
EP2629506A1 (en) Two-step brightness adjustment in around-view systems
JP5173552B2 (ja) 車両周辺監視装置およびこれに適用される歪み補正値の設定修正方法
JP6139141B2 (ja) 外観画像生成方法及び外観画像生成装置
JP7632687B2 (ja) 画像処理方法、画像表示方法、画像処理装置、及び画像表示装置
JP6190119B2 (ja) 画像処理装置、撮像装置、制御方法、及びプログラム
CN108431866B (zh) 显示控制装置以及显示控制方法
JP2016213759A (ja) 後方モニタ
JP2009211254A (ja) 画像処理ユニット、複眼撮像装置、画像処理方法、および画像処理プログラム
KR101293263B1 (ko) 복수개의 영상을 합성한 합성 영상에서 거리 정보를 제공하는 기능을 구비하는 영상 처리 장치 및 방법
KR20130134086A (ko) 광각 카메라를 이용한 영상 시스템 및 그 방법
JP5978866B2 (ja) 撮影装置及び撮影装置の画像処理方法
KR101613682B1 (ko) 광 필드 데이터를 이용한 영상 처리 장치 및 방법
CN107531182A (zh) 车辆用显示装置以及车辆用显示方法
JP5478366B2 (ja) 映像監視装置
KR101926498B1 (ko) 스테레오 영상 정합 장치 및 이의 정합 방법

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20151222

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20151222

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20170125

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20170214

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20170405

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20170926

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20171009

R151 Written notification of patent or utility model registration

Ref document number: 6232994

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R151

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

LAPS Cancellation because of no payment of annual fees