JP2013030848A5

JP2013030848A5 -

Info

Publication number: JP2013030848A5
Application number: JP2011163690A
Authority: JP
Filing date: 2011-07-26
Publication date: 2014-09-04
Anticipated expiration: 2031-07-26

Description

すなわち、立体像を提示するための視差画像を生成する画像処理装置であって、
複数の視点から被写体を撮像した複数の画像を取得する取得手段と、
前記被写体が存在する空間において、前記複数の画像を撮像した撮像装置の光軸に対して垂直でないピント面の位置を設定する設定手段と、
前記立体像を観察するための左視点および右視点の、前記被写体が存在する空間における位置および方向を入力する入力手段と、
前記設定手段により設定された前記ピント面の位置と、前記入力手段により入力された前記左視点の位置および方向に基づいて、前記左視点に対応する左視点画像を生成するための第一の合成パラメータを算出し、前記設定手段により設定された前記ピント面の位置と、前記入力手段により入力された前記右視点の位置および方向とに基づいて、前記右視点に対応する右視点画像を生成するための、前記第一の合成パラメータとは異なる第二の合成パラメータを算出する算出手段と、
前記算出手段により算出された前記第一の合成パラメータに基づいて前記複数の画像を合成することで、前記ピント面に合焦した前記左視点画像を生成し、前記算出手段により算出された前記第二の合成パラメータに基づいて前記複数の画像を合成することで、前記ピント面に合焦した前記右視点画像を生成する生成手段とを有することを特徴とする。
That is, an image processing device that generates a parallax image for presenting a stereoscopic image,
Acquisition means for acquiring a plurality of images obtained by imaging a subject from a plurality of viewpoints;
Setting means for setting a position of a focus surface that is not perpendicular to the optical axis of the imaging device that captured the plurality of images in a space where the subject exists;
Input means for inputting positions and directions of a left viewpoint and a right viewpoint for observing the stereoscopic image in a space where the subject exists;
A first composition for generating a left viewpoint image corresponding to the left viewpoint based on the position of the focus plane set by the setting means and the position and direction of the left viewpoint input by the input means. A parameter is calculated, and a right viewpoint image corresponding to the right viewpoint is generated based on the position of the focus plane set by the setting unit and the position and direction of the right viewpoint input by the input unit. Calculating means for calculating a second synthesis parameter different from the first synthesis parameter;
The left viewpoint image focused on the focus plane is generated by combining the plurality of images based on the first combining parameter calculated by the calculating unit, and the first viewpoint calculated by the calculating unit is generated. And generating means for generating the right viewpoint image focused on the focus plane by combining the plurality of images based on a second combining parameter.

Claims

An image processing device that generates a parallax image for presenting a stereoscopic image,
Acquisition means for acquiring a plurality of images obtained by imaging a subject from a plurality of viewpoints;
Setting means for setting a position of a focus surface that is not perpendicular to the optical axis of the imaging device that captured the plurality of images in a space where the subject exists;
Input means for inputting positions and directions of a left viewpoint and a right viewpoint for observing the stereoscopic image in a space where the subject exists;
A first composition for generating a left viewpoint image corresponding to the left viewpoint based on the position of the focus plane set by the setting means and the position and direction of the left viewpoint input by the input means. A parameter is calculated, and a right viewpoint image corresponding to the right viewpoint is generated based on the position of the focus plane set by the setting unit and the position and direction of the right viewpoint input by the input unit. Calculating means for calculating a second synthesis parameter different from the first synthesis parameter;
The left viewpoint image focused on the focus plane is generated by combining the plurality of images based on the first combining parameter calculated by the calculating unit, and the first viewpoint calculated by the calculating unit is generated. An image processing apparatus comprising: a generating unit configured to generate the right viewpoint image focused on the focus plane by combining the plurality of images based on a second combining parameter.

The image processing apparatus according to claim 1, wherein the first synthesis parameter and the second synthesis parameter indicate shift amounts of the plurality of images when the plurality of images are combined.

The calculation means calculates the inclination of the focus surface viewed from the left viewpoint and the right viewpoint, and the distance from the left viewpoint and the right viewpoint to the focus surface, and calculates the inclination and distance of the calculated focus surface. The image processing apparatus according to claim 1, wherein the first synthesis parameter and the second synthesis parameter are calculated based on the first synthesis parameter.

The image according to any one of claims 1 to 3, wherein the setting unit sets the coordinates of a point on the focus surface and a normal vector of the focus surface as the position of the focus surface. Processing equipment.

The generation unit performs weighted addition after deforming each of the plurality of images using the first synthesis parameter and the second synthesis parameter so that the positions of the subjects coincide with each other, The image processing apparatus according to claim 1, wherein the left viewpoint image and the right viewpoint image are generated.

Before Symbol setting means, the image processing apparatus according to any one of claims 1 to 5, characterized in that setting the position of the focal plane indicated by a user instruction.

Further, the sharpness is calculated for all of the plurality of images acquired by the acquisition means, and it is determined whether or not a non-sharp image having the sharpness equal to or less than a predetermined threshold exists in the plurality of images. Determination means to perform,
Notification means for notifying that the generation of the parallax image is impossible when the determination means determines that the non-sharp image exists.
The said generation | production means produces | generates the said left viewpoint image and the said right viewpoint image, when it determines with the said non-sharp image existing in the said determination means. The image processing apparatus according to item.

The acquisition unit acquires a plurality of captured images obtained by imaging the subject with a multi-lens camera including a plurality of imaging units as the plurality of images. 8. The image processing apparatus according to any one of items 1 to 7.

An image processing method in an image processing apparatus that has an acquisition unit, a setting unit, an input unit, a calculation unit, and a generation unit and generates a parallax image for presenting a stereoscopic image,
The acquisition unit acquires a plurality of images obtained by imaging a subject from a plurality of viewpoints;
A setting step in which the setting means sets a position of a focus surface that is not perpendicular to an optical axis of an imaging apparatus that has captured the plurality of images in a space where the subject exists;
An input step in which the input means inputs a position and a direction of a left viewpoint and a right viewpoint for observing the stereoscopic image in a space where the subject exists;
The calculating means is
A first composition for generating a left viewpoint image corresponding to the left viewpoint based on the position of the focus plane set in the setting step and the position and direction of the left viewpoint input in the input step A parameter is calculated, and a right viewpoint image corresponding to the right viewpoint is generated based on the position of the focus plane set in the setting step and the position and direction of the right viewpoint input in the input step. A calculating step for calculating a second synthesis parameter different from the first synthesis parameter;
The generating means is
The left viewpoint image focused on the focus plane is generated by combining the plurality of images based on the first combining parameter calculated by the calculating step, and the first viewpoint image calculated by the calculating step is generated. Generating the right viewpoint image focused on the focus plane by combining the plurality of images based on a second combining parameter;
An image processing method comprising:

By being executed by a computer device, a program to function as each unit of the image processing apparatus according to the computer device in any one of claims 1 to 8.