JP2013207637A5 - - Google Patents

Download PDF

Info

Publication number
JP2013207637A5
JP2013207637A5 JP2012075962A JP2012075962A JP2013207637A5 JP 2013207637 A5 JP2013207637 A5 JP 2013207637A5 JP 2012075962 A JP2012075962 A JP 2012075962A JP 2012075962 A JP2012075962 A JP 2012075962A JP 2013207637 A5 JP2013207637 A5 JP 2013207637A5
Authority
JP
Japan
Prior art keywords
image
distance information
shape
unit
image processing
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
JP2012075962A
Other languages
Japanese (ja)
Other versions
JP5959264B2 (en
JP2013207637A (en
Filing date
Publication date
Application filed filed Critical
Priority to JP2012075962A priority Critical patent/JP5959264B2/en
Priority claimed from JP2012075962A external-priority patent/JP5959264B2/en
Publication of JP2013207637A publication Critical patent/JP2013207637A/en
Publication of JP2013207637A5 publication Critical patent/JP2013207637A5/ja
Application granted granted Critical
Publication of JP5959264B2 publication Critical patent/JP5959264B2/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Claims (12)

自車両の近辺の対象物を撮像する複数のカメラと、
前記カメラで撮像した対象物までの距離情報を生成する距離情報生成部と、
前記距離情報生成部で生成した距離情報を基に自車両から前記対象物までの距離に応じた立体面を有する空間モデルの形状を決定するモデル形状決定部と、
前記モデル形状決定部で決定された形状を有する空間モデルに対して前記複数のカメラによる撮像で得た複数の画像を投影し、さらに投影した画像をスクリーン座標系に変換することで、スクリーン座標系の画像を生成する投影変換部と、
前記投影変換部によって生成されたスクリーン座標系の画像の一部又は全部を抽出して合成画像を生成する画像合成部と、
前記画像合成部で生成された合成画像を、画像表示部に表示させる情報伝達部と
を備えることを特徴とする画像処理装置。
A plurality of cameras for imaging objects in the vicinity of the host vehicle;
A distance information generation unit that generates distance information to the object imaged by the camera;
A model shape determining unit that determines the shape of a spatial model having a three-dimensional surface according to the distance from the host vehicle to the object based on the distance information generated by the distance information generating unit;
By projecting a plurality of images obtained by imaging with the plurality of cameras onto the spatial model having the shape determined by the model shape determining unit, and further converting the projected image into a screen coordinate system, a screen coordinate system A projection conversion unit for generating an image of
An image composition unit that extracts a part or all of the image of the screen coordinate system generated by the projection conversion unit to generate a composite image;
An image processing apparatus comprising: an information transmission unit that causes the image display unit to display the composite image generated by the image synthesis unit.
前記モデル形状決定部は、前記距離情報生成部で生成した距離情報を基に、自車両の進行方向にあり、かつ自車両に最も近い対象物、又はその部分の距離情報のみを反映して前記空間モデル形状を決定することを特徴とする請求項1に記載の画像処理装置。 Based on the distance information generated by the distance information generation unit, the model shape determination unit reflects only the distance information of the object in the traveling direction of the host vehicle and closest to the host vehicle, or the portion thereof. The image processing apparatus according to claim 1, wherein the shape of the spatial model is determined. 前記モデル形状決定部は、前記自車両に最も近い対象物又はその部分として、該対象物又はその部分の自車両に最も近い端部から所定の距離範囲までの部分についての距離情報を反映して前記空間モデル形状の決定を行うことを特徴とする請求項2に記載の画像処理装置。 The model shape determining unit reflects distance information about a portion from the end closest to the host vehicle to a predetermined distance range from the target or the portion of the target closest to the host vehicle. The image processing apparatus according to claim 2, wherein the shape of the space model is determined. 前記モデル形状決定部は、前記距離情報生成部で生成した距離情報を基に、自車両の進行方向にあり、かつ自車両に最も近い対象物又はその部分、及び画像上で当該最も近い対象物又はその部分の周囲に位置する部分についての距離情報のみを反映して前記空間モデル形状を決定することを特徴とする請求項1に記載の画像処理装置。 The model shape determination unit is based on the distance information generated by the distance information generation unit, and is in the traveling direction of the host vehicle and is closest to the host vehicle or a portion thereof, and the closest target on the image The image processing apparatus according to claim 1, wherein the shape of the space model is determined by reflecting only distance information about a portion located around the portion. 前記モデル形状決定部は、前記空間モデルのうち、前記対象物又はその部分までの距離情報を反映して決定する部分以外の部分については、予め定められた形状とすることを特徴とする請求項2から4のいずれか1項に記載の画像処理装置。 The model shape determining unit is configured to assume a predetermined shape for a portion other than a portion determined by reflecting distance information to the object or the portion of the space model. the image processing apparatus according to any one of 2 to 4. 前記予め定められた形状が椀型であることを特徴とする請求項5に記載の画像処理装置。   The image processing apparatus according to claim 5, wherein the predetermined shape is a bowl shape. 前記モデル形状決定部は、前記予め定められた形状のサイズを、前記対象物又はその部分までの距離情報を反映して決定する部分とそれにつながる部分との間に段差が生じないように決定することを特徴とする請求項5又は6に記載の画像処理装置。   The model shape determining unit determines the size of the predetermined shape so that a step does not occur between a portion that reflects the object or distance information to the portion and a portion that is connected thereto. The image processing apparatus according to claim 5, wherein the image processing apparatus is an image processing apparatus. 前記画像合成部は、前記合成画像において、前記自車両に最も近い対象物又はその部分に対応する画像部分とその周囲の画像部分との境界部分をぼかすための処理を行う請求項4に記載の画像処理装置。   The said image synthetic | combination part performs the process for blurring the boundary part of the image part corresponding to the target object or its part nearest to the said own vehicle, and its surrounding image part in the said synthesized image. Image processing device. 前記複数のカメラの各々は、前記複数のカメラのうちの少なくとも他の一つのカメラと撮像範囲が部分的に重なる
ことを特徴とする請求項1から8のいずれか1項に記載の画像処理装置。
Each of the plurality of cameras, at least one other camera and the image processing apparatus according to any one of claims 1 to 8, the imaging range is characterized in that partially overlaps one of said plurality of cameras .
前記複数のカメラで撮像する画像毎の輝度レベルを整合させる輝度調整部と、
当該輝度調整部からの制御信号をもとに前記複数のカメラの各々で撮像する画像の輝度レベルを制御するカメラパラメータ設定部をさらに有する
ことを特徴とする請求項1からのいずれか1項に記載の画像処理装置。
A brightness adjustment unit for matching brightness levels for each image captured by the plurality of cameras;
Any one of claims 1 to 9, further comprising a camera parameter setting section for controlling the brightness level of the image captured by each of the plurality of cameras based on the control signal from the brightness adjusting portion An image processing apparatus according to 1.
自車両の近辺の対象物を複数のカメラで撮像するステップと、
前記カメラで撮像した対象物までの距離情報を生成する距離情報生成ステップと、
前記距離情報生成ステップで生成した距離情報を基に自車両から前記対象物までの距離に応じた立体面を有する空間モデルの形状を決定するモデル形状決定ステップと、
前記モデル形状決定ステップで決定された形状を有する空間モデルに対して前記複数のカメラによる撮像で得た複数の画像を投影し、さらに投影した画像をスクリーン座標系に変換することで、スクリーン座標系の画像を生成する投影変換ステップと、
前記投影変換ステップによって生成されたスクリーン座標系の画像の一部又は全部を抽出して合成画像を生成する画像合成ステップと、
前記画像合成ステップで生成された合成画像を、画像表示部に表示させる情報伝達ステップと
を備えることを特徴とする画像処理方法。
Imaging an object in the vicinity of the host vehicle with a plurality of cameras;
A distance information generating step for generating distance information to an object imaged by the camera;
A model shape determination step for determining a shape of a spatial model having a three-dimensional surface according to a distance from the host vehicle to the object based on the distance information generated in the distance information generation step;
By projecting a plurality of images obtained by imaging with the plurality of cameras onto the spatial model having the shape determined in the model shape determining step, and further converting the projected image into a screen coordinate system, a screen coordinate system A projection transformation step for generating an image of
An image synthesis step of extracting a part or all of the image of the screen coordinate system generated by the projection conversion step to generate a synthesized image;
An image transmission method comprising: an information transmission step of causing the image display unit to display the combined image generated in the image combining step.
請求項11の画像処理方法の各ステップをコンピュータに実行させるためのコンピュータプログラム。   A computer program for causing a computer to execute each step of the image processing method according to claim 11.
JP2012075962A 2012-03-29 2012-03-29 Image processing apparatus and method, and computer program Active JP5959264B2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2012075962A JP5959264B2 (en) 2012-03-29 2012-03-29 Image processing apparatus and method, and computer program

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2012075962A JP5959264B2 (en) 2012-03-29 2012-03-29 Image processing apparatus and method, and computer program

Publications (3)

Publication Number Publication Date
JP2013207637A JP2013207637A (en) 2013-10-07
JP2013207637A5 true JP2013207637A5 (en) 2015-03-19
JP5959264B2 JP5959264B2 (en) 2016-08-02

Family

ID=49526302

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2012075962A Active JP5959264B2 (en) 2012-03-29 2012-03-29 Image processing apparatus and method, and computer program

Country Status (1)

Country Link
JP (1) JP5959264B2 (en)

Families Citing this family (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105765966B (en) 2013-12-19 2020-07-10 英特尔公司 Bowl-shaped imaging system
US10442355B2 (en) 2014-09-17 2019-10-15 Intel Corporation Object visualization in bowl-shaped imaging systems
JP6575445B2 (en) * 2015-09-30 2019-09-18 アイシン精機株式会社 Image processing apparatus for vehicle
WO2017056989A1 (en) * 2015-09-30 2017-04-06 アイシン精機株式会社 Image processing device for vehicles
US10523865B2 (en) * 2016-01-06 2019-12-31 Texas Instruments Incorporated Three dimensional rendering for surround view using predetermined viewpoint lookup tables
JP7314518B2 (en) * 2019-02-06 2023-07-26 株式会社アイシン Perimeter monitoring device
DE102019207415A1 (en) * 2019-05-21 2020-11-26 Conti Temic Microelectronic Gmbh Method for generating an image of a vehicle environment and device for generating an image of a vehicle environment
WO2021111531A1 (en) * 2019-12-03 2021-06-10 株式会社ソシオネクスト Image processing device, image processing method, and image processing program
CN116324863A (en) * 2020-10-09 2023-06-23 株式会社索思未来 Image processing device, image processing method, and image processing program
WO2022254592A1 (en) * 2021-06-01 2022-12-08 株式会社ソシオネクスト Image-processing device, image-processing method, and image-processing program

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2007180803A (en) * 2005-12-27 2007-07-12 Aisin Aw Co Ltd Method and device for supporting driving
JP2009267923A (en) * 2008-04-28 2009-11-12 Hitachi Advanced Digital Inc Imaging system
JP5640433B2 (en) * 2010-04-07 2014-12-17 日産自動車株式会社 Image information providing apparatus and image information providing method

Similar Documents

Publication Publication Date Title
JP2013207637A5 (en)
EP3757510B1 (en) Depth map by vibrating pattern projector
JP6891954B2 (en) Object detection device, object detection method, and program
US20140218354A1 (en) View image providing device and method using omnidirectional image and 3-dimensional data
EP2869263A1 (en) Method and apparatus for generating depth map of a scene
JP2014179698A (en) Projector and control method of projector, and program of control method and recording medium with program recorded thereon
JP5299296B2 (en) Vehicle periphery image display device and vehicle periphery image display method
JP2009237878A5 (en)
GB2512242A (en) Method, device, and system for computing a spherical projection image based on two-dimensional images
JP2011128117A5 (en) Information processing apparatus, pattern data generation apparatus, information processing method, pattern data generation method, and program
JP2016085379A5 (en)
KR102049456B1 (en) Method and apparatus for formating light field image
JP2008259612A5 (en)
JP2013501264A5 (en)
JP2010022829A5 (en)
JP2018026064A5 (en)
JP2022547531A (en) Perceptually enhanced surround view based on sensor fusion
JP2016085380A (en) Controller, control method, and program
JP2015038595A5 (en) Image processing apparatus and image processing method
JP2015019133A5 (en)
JP2013093836A5 (en)
WO2017154609A1 (en) Information processing device, information processing method, and program
JP6280005B2 (en) Information processing apparatus, image projection apparatus, and information processing method
JP2017156880A5 (en) Image processing apparatus, image processing method, and image processing program
JP2016110312A (en) Image processing method, and image processor and program