CN105814886B - 图像处理设备、图像处理方法和程序 - Google Patents

图像处理设备、图像处理方法和程序 Download PDF

Info

Publication number
CN105814886B
CN105814886B CN201480067077.9A CN201480067077A CN105814886B CN 105814886 B CN105814886 B CN 105814886B CN 201480067077 A CN201480067077 A CN 201480067077A CN 105814886 B CN105814886 B CN 105814886B
Authority
CN
China
Prior art keywords
image
area
image data
vehicle
composite
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN201480067077.9A
Other languages
English (en)
Chinese (zh)
Other versions
CN105814886A (zh
Inventor
大场英史
真渊健
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sony Corp
Original Assignee
Sony Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sony Corp filed Critical Sony Corp
Publication of CN105814886A publication Critical patent/CN105814886A/zh
Application granted granted Critical
Publication of CN105814886B publication Critical patent/CN105814886B/zh
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformations in the plane of the image
    • G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
    • G06T3/4038—Image mosaicing, e.g. composing plane images from plane sub-images
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R1/00—Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/02—Rear-view mirror arrangements
    • B60R1/06—Rear-view mirror arrangements mounted on vehicle exterior
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H04N7/181—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R1/00—Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/20—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/22—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle
    • B60R1/23—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle with a predetermined field of view
    • B60R1/27—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle with a predetermined field of view providing all-round vision, e.g. using omnidirectional cameras
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T1/00—General purpose image data processing
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating three-dimensional [3D] models or images for computer graphics
    • G06T19/20—Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformations in the plane of the image
    • G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
    • G—PHYSICS
    • G08—SIGNALLING
    • G08G—TRAFFIC CONTROL SYSTEMS
    • G08G1/00—Traffic control systems for road vehicles
    • G08G1/16—Anti-collision systems
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/10—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of camera system used
    • B60R2300/107—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of camera system used using stereoscopic cameras
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/30—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing
    • B60R2300/303—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing using joined images, e.g. multiple camera images
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/60—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by monitoring and displaying vehicle exterior scenes from a transformed perspective
    • B60R2300/607—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by monitoring and displaying vehicle exterior scenes from a transformed perspective from a bird's eye viewpoint
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10016—Video; Image sequence
    • G06T2207/10021—Stereoscopic video; Stereoscopic image sequence
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20212—Image combination
    • G06T2207/20221—Image fusion; Image merging
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30248—Vehicle exterior or interior
    • G06T2207/30252—Vehicle exterior; Vicinity of vehicle

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Mechanical Engineering (AREA)
  • Architecture (AREA)
  • Computer Graphics (AREA)
  • Computer Hardware Design (AREA)
  • General Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Signal Processing (AREA)
  • Image Processing (AREA)
  • Closed-Circuit Television Systems (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
CN201480067077.9A 2013-12-16 2014-11-27 图像处理设备、图像处理方法和程序 Expired - Fee Related CN105814886B (zh)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
JP2013259593A JP6232994B2 (ja) 2013-12-16 2013-12-16 画像処理装置、および画像処理方法、並びにプログラム
JP2013-259593 2013-12-16
PCT/JP2014/005932 WO2015092981A1 (en) 2013-12-16 2014-11-27 Image processing apparatus, image processing method, and program

Publications (2)

Publication Number Publication Date
CN105814886A CN105814886A (zh) 2016-07-27
CN105814886B true CN105814886B (zh) 2020-09-15

Family

ID=52101553

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201480067077.9A Expired - Fee Related CN105814886B (zh) 2013-12-16 2014-11-27 图像处理设备、图像处理方法和程序

Country Status (7)

Country Link
US (1) US10140775B2 (https=)
EP (1) EP3039644B1 (https=)
JP (1) JP6232994B2 (https=)
CN (1) CN105814886B (https=)
BR (1) BR112016013307A2 (https=)
RU (1) RU2679987C2 (https=)
WO (1) WO2015092981A1 (https=)

Families Citing this family (31)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPWO2015129280A1 (ja) * 2014-02-26 2017-03-30 京セラ株式会社 画像処理装置および画像処理方法
US10891736B1 (en) * 2015-06-23 2021-01-12 Amazon Technologies, Inc. Associating an agent with an event using motion analysis
JP6413974B2 (ja) * 2015-08-05 2018-10-31 株式会社デンソー キャリブレーション装置、キャリブレーション方法、及びプログラム
US10157452B1 (en) * 2015-09-28 2018-12-18 Amazon Technologies, Inc. Image processing system for image rectification
JP6493143B2 (ja) * 2015-10-15 2019-04-03 株式会社デンソー 表示制御装置及び表示制御プログラム
JP6512449B2 (ja) * 2016-01-20 2019-05-15 パナソニックＩｐマネジメント株式会社 表示装置
KR102371588B1 (ko) * 2016-05-02 2022-03-07 현대자동차주식회사 영상기반 장애물 인식 시스템 및 방법
US10636110B2 (en) * 2016-06-28 2020-04-28 Intel Corporation Architecture for interleaved rasterization and pixel shading for virtual reality and multi-view systems
KR101844885B1 (ko) * 2016-07-11 2018-05-18 엘지전자 주식회사 차량 운전 보조장치 및 이를 포함하는 차량
US11528413B2 (en) 2016-08-22 2022-12-13 Sony Corporation Image processing apparatus and image processing method to generate and display an image based on a vehicle movement
JP2018085008A (ja) 2016-11-25 2018-05-31 株式会社ジャパンディスプレイ 画像処理装置および画像処理装置の画像処理方法
KR102466305B1 (ko) * 2017-01-12 2022-11-10 현대모비스 주식회사 Avm 자동 공차 보정 시스템 및 그 방법
KR102433824B1 (ko) * 2017-01-12 2022-08-17 현대모비스 주식회사 Avm 자동 공차 보정 시스템 및 그 방법
DE102017214545A1 (de) * 2017-08-21 2019-02-21 Bayerische Motoren Werke Aktiengesellschaft Verfahren und Vorrichtung zur Ermittlung einer Wahrscheinlichkeit, mit der sich ein Objekt in einem Sichtfeld eines Fahrers eines Fahrzeugs befindet
JPWO2019049709A1 (ja) * 2017-09-07 2020-12-03 ソニー株式会社 画像処理装置、画像処理方法、および画像表示システム
JP6897442B2 (ja) * 2017-09-12 2021-06-30 株式会社Ｊｖｃケンウッド 車両用装置、キャリブレーション結果判定システム、および、キャリブレーション結果判定方法、ならびに、プログラム
JP7013751B2 (ja) * 2017-09-15 2022-02-01 株式会社アイシン 画像処理装置
DE102017216822A1 (de) * 2017-09-22 2019-03-28 Continental Automotive Gmbh Vorrichtung und Verfahren zum Anpassen einer Bildverarbeitung basierend auf einer Form einer Anzeigeneinrichtung für ein Kraftfahrzeug
JP6472864B1 (ja) * 2017-11-29 2019-02-20 株式会社近江デジタルファブリケーションズ 画像配信システム、及び配信画像生成方法
WO2019209067A1 (ko) * 2018-04-26 2019-10-31 주식회사 텐앤투 광각 영상 제공 시스템
US11024012B2 (en) * 2018-08-02 2021-06-01 Apple Inc. Directional scaling systems and methods
CN108995592B (zh) * 2018-08-02 2021-06-15 张士文 汽车影像系统
CN113016179A (zh) * 2018-11-15 2021-06-22 松下知识产权经营株式会社 摄像机系统和车辆
US11987182B2 (en) 2018-12-11 2024-05-21 Sony Group Corporation Image processing apparatus, image processing method, and image processing system
DE102019205440A1 (de) * 2019-04-16 2020-10-22 Zf Friedrichshafen Ag Lern-Verfahren zur winkelunabhängigen Objekterkennung für bewegliche und orts-feste Systeme
JP7225079B2 (ja) 2019-11-29 2023-02-20 日立Astemo株式会社 障害物認識装置
CN112565730B (zh) * 2020-12-03 2023-07-25 阿波罗智联(北京)科技有限公司 路侧感知方法、装置、电子设备、存储介质及路侧设备
TWI786664B (zh) 2021-06-04 2022-12-11 緯創資通股份有限公司 影像處理裝置及基於影像的試紙辨識方法
KR102788777B1 (ko) * 2021-11-29 2025-04-01 주식회사 와이즈오토모티브 어라운드 뷰 영상을 생성하는 영상 생성 장치를 평가하기 위한 장치 및 방법
KR102795515B1 (ko) * 2021-12-17 2025-04-15 주식회사 와이즈오토모티브 어라운드 뷰 영상을 생성하는 영상 생성 장치를 평가하기 위한 장치 및 방법
US12394210B2 (en) 2022-12-09 2025-08-19 Lite-On Technology Corporation Processing method for vehicle surround view, vehicle surround view system and in-vehicle processing device

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2001083921A (ja) * 1999-09-16 2001-03-30 Dainippon Printing Co Ltd モニタのコントラスト調整方法
CN103338325A (zh) * 2013-06-14 2013-10-02 杭州普维光电技术有限公司 基于全景摄像机的车底盘图像采集方法

Family Cites Families (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2003030833A (ja) 2001-07-13 2003-01-31 Matsushita Electric Ind Co Ltd 光記録媒体、光記録媒体の記録方法及び光記録媒体の記録装置
ATE311725T1 (de) 2001-09-07 2005-12-15 Matsushita Electric Industrial Co Ltd Vorrichtung zum anzeigen der umgebung eines fahrzeuges und system zur bildbereitstellung
JP4744823B2 (ja) * 2004-08-05 2011-08-10 株式会社東芝 周辺監視装置および俯瞰画像表示方法
JP4639753B2 (ja) * 2004-10-25 2011-02-23 日産自動車株式会社 運転支援装置
CN100451800C (zh) * 2004-10-25 2009-01-14 皇家飞利浦电子股份有限公司 显示装置
US7512262B2 (en) * 2005-02-25 2009-03-31 Microsoft Corporation Stereo-based image processing
JP4934308B2 (ja) 2005-10-17 2012-05-16 三洋電機株式会社 運転支援システム
JP4861034B2 (ja) * 2006-03-29 2012-01-25 クラリオン株式会社 車載カメラのキャリブレーションシステム
US8243994B2 (en) * 2006-05-09 2012-08-14 Nissan Motor Co., Ltd. Vehicle circumferential image providing device and vehicle circumferential image providing method
JP2009077022A (ja) * 2007-09-19 2009-04-09 Sanyo Electric Co Ltd 運転支援システム及び車両
JP5068779B2 (ja) * 2009-02-27 2012-11-07 現代自動車株式会社 車両周囲俯瞰画像表示装置及び方法
JP5165631B2 (ja) 2009-04-14 2013-03-21 現代自動車株式会社 車両周囲画像表示システム
JP2012147149A (ja) * 2011-01-11 2012-08-02 Aisin Seiki Co Ltd 画像生成装置
TWM407861U (en) * 2011-03-17 2011-07-21 Acard Technology Corp Panorama motor vehicle auxiliary recorder
JP5483120B2 (ja) 2011-07-26 2014-05-07 アイシン精機株式会社 車両周辺監視システム
JP5870608B2 (ja) * 2011-10-13 2016-03-01 アイシン精機株式会社 画像生成装置
US9491451B2 (en) * 2011-11-15 2016-11-08 Magna Electronics Inc. Calibration system and method for vehicular surround vision system
US9139133B2 (en) * 2012-05-31 2015-09-22 GM Global Technology Operations LLC Vehicle collision warning system and method

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2001083921A (ja) * 1999-09-16 2001-03-30 Dainippon Printing Co Ltd モニタのコントラスト調整方法
CN103338325A (zh) * 2013-06-14 2013-10-02 杭州普维光电技术有限公司 基于全景摄像机的车底盘图像采集方法

Also Published As

Publication number Publication date
JP6232994B2 (ja) 2017-11-22
BR112016013307A2 (pt) 2022-07-19
JP2015119225A (ja) 2015-06-25
US10140775B2 (en) 2018-11-27
RU2679987C2 (ru) 2019-02-14
EP3039644B1 (en) 2019-11-27
EP3039644A1 (en) 2016-07-06
RU2016122956A3 (https=) 2018-07-16
RU2016122956A (ru) 2017-12-12
CN105814886A (zh) 2016-07-27
US20160217625A1 (en) 2016-07-28
WO2015092981A1 (en) 2015-06-25

Similar Documents

Publication Publication Date Title
CN105814886B (zh) 图像处理设备、图像处理方法和程序
US10897600B1 (en) Sensor fusion based perceptually enhanced surround view
JP4125252B2 (ja) 画像生成装置、画像生成方法、及び画像生成プログラム
CN110461268B (zh) 医疗用途的放大的高分辨率成像和跟踪
JP5342036B2 (ja) ３ｄ表面形状をキャプチャーするための方法
JP5632762B2 (ja) 測位情報形成装置、検出装置、及び測位情報形成方法
JP2019519128A (ja) 両眼視野／単眼視野間の移行
JP2017220923A (ja) 画像生成装置、画像生成方法、およびプログラム
US10354358B2 (en) Image generation device, coordinate transformation table creation device and creation method
US20120229610A1 (en) Stereoscopic image display method and stereoscopic image display apparatus
JP2012186653A (ja) 画像表示装置、方法およびプログラム
JP4950137B2 (ja) 撮像装置及びプログラム
JP5861114B2 (ja) 画像処理装置、及び画像処理方法
US10685474B2 (en) Method for repairing incomplete 3D depth image using 2D image information
JP2018133746A (ja) 画像処理装置、画像処理システム、画像処理方法及びプログラム
US12080075B2 (en) Method for generating an image of vehicle surroundings, and apparatus for generating an image of vehicle surroundings
KR102917059B1 (ko) 삼각형 기반의 선택적 워핑을 통한 가상 시점 영상 합성 방법 및 장치
JP2017050857A (ja) 画像処理装置、画像処理方法およびプログラム
US11119313B1 (en) Imaging systems and methods for expanding field of view of captured images
US12505564B2 (en) Method and an apparatus for selecting a pixel's mask
Xiang et al. A gradient-based approach for interference cancelation in systems with multiple Kinect cameras
US11145093B2 (en) Semiconductor device, image processing system, image processing method and computer readable storage medium
JP2004282167A (ja) 画像処理装置及び方法並びにプログラム
CN107531182A (zh) 车辆用显示装置以及车辆用显示方法
CN107548501B (zh) 用于驾驶员辅助系统的图像合成装置

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20200915