JP2003187261A5

JP2003187261A5 -

Info

Publication number: JP2003187261A5
Application number: JP2001382006A
Authority: JP
Filing date: 2001-12-14
Publication date: 2005-07-28
Anticipated expiration: 2021-12-14

Claims

3D that extracts corresponding points representing the same part as a point-to-point correspondence between a plurality of images obtained by photographing the subject from a plurality of viewpoints, and generates an image viewed from an arbitrary viewpoint based on the extraction result of the corresponding points An image generation device,
Based on the corresponding point extraction result, the plurality of images are divided into partial areas, a model representing the corresponding relationship between the partial areas is obtained, and the partial area is deformed based on the model at a continuous viewpoint position. A three-dimensional image generation apparatus comprising image processing means for generating a moving image by sequentially generating the images.

3D that extracts corresponding points representing the same part as a point-to-point correspondence between a plurality of images obtained by photographing the subject from a plurality of viewpoints, and generates an image viewed from an arbitrary viewpoint based on the extraction result of the corresponding points An image generation method comprising:
Based on the corresponding point extraction result, the plurality of images are divided into partial areas, a model representing the corresponding relationship between the partial areas is obtained, and the partial area is deformed based on the model at a continuous viewpoint position. 3. A three-dimensional image generation method, wherein a moving image is generated by sequentially generating images.

3D that extracts corresponding points representing the same part as a point-to-point correspondence between a plurality of images obtained by photographing the subject from a plurality of viewpoints, and generates an image viewed from an arbitrary viewpoint based on the extraction result of the corresponding points A computer-readable storage medium storing a program for executing a three-dimensional image generation method applied to an image generation apparatus,
The three-dimensional image generation method includes a step of dividing the plurality of images into partial regions based on the extraction result of the corresponding points, a step of obtaining a model representing a correspondence relationship between the corresponding partial regions, and based on the model. And a step of generating a moving image by sequentially generating images at successive viewpoint positions by deforming the partial area.

A three-dimensional image generation apparatus having a light projecting unit that projects a light pattern on a subject and an image capturing unit that captures an image of the subject,
Parallax extracting means for extracting the parallax distribution of the subject based on the image of the subject projected with the light pattern, and an image for generating an image at the virtual viewpoint position of the subject by modifying the subject image based on the parallax distribution A three-dimensional image generation apparatus comprising: a generation unit;

The imaging means captures an image of a subject that does not project the pattern and an image of a subject that projects the light pattern, and the image generation means performs geometric transformation into an image of the subject that does not project the pattern. 5. The three-dimensional image generation apparatus according to claim 4 , wherein an image of the subject at the virtual viewpoint position is generated.

The imaging means captures an image of a subject projected with the light pattern, and the image generation means performs geometric transformation on the image of the subject projected with the pattern at the virtual viewpoint position of the subject. The three-dimensional image generation apparatus according to claim 4, wherein the image is generated.

A display unit configured to display an image generated by the image generation unit; and an input unit capable of changing the virtual viewpoint position. The image generation unit interactively responds to an input from the input unit. wherein generating the image in the virtual viewpoint position of the display means according to any of claims 4 to 6, characterized in that to display an image in the generated the virtual viewpoint position 3D image generation apparatus.

The three-dimensional image generation apparatus according to claim 4 , wherein the light projecting unit is an adapter configured to be detachable from the image pickup apparatus and project a predetermined light pattern onto the subject with strobe light.

The virtual viewpoint position is predeterminable as a plurality of sequential viewpoint position, the image in the virtual viewpoint position is any claim 4 to 6, characterized in that it is recorded as a moving image A three-dimensional image generating apparatus according to claim 1.

A three-dimensional image generation method executed by a three-dimensional image generation apparatus having a light projecting unit that projects a light pattern on a subject and an image capturing unit that captures an image of the subject,
A parallax distribution of a subject is extracted based on an image of the subject onto which the light pattern is projected, and the subject image is deformed based on the parallax distribution to generate an image at a virtual viewpoint position of the subject. 3D image generation method.

An image of a subject that does not project the pattern and an image of a subject that projects the light pattern are photographed, and a geometric transformation is performed on the image of the subject that does not project the pattern at the virtual viewpoint position of the subject. The three-dimensional image generation method according to claim 10, wherein an image is generated.

An image of a subject projected with the light pattern is captured, and an image of the subject projected with the pattern is geometrically transformed to generate an image of the subject at the virtual viewpoint position. Item 13. A three-dimensional image generation method according to Item 10 .

Interactively generating an image of the subject at the virtual viewpoint position in response to an input of the virtual viewpoint position from the outside, and displaying the generated image at the virtual viewpoint position The three-dimensional image generation method according to any one of claims 10 to 12 .

The virtual viewpoint position is predeterminable as a plurality of sequential viewpoint position, the image in the virtual viewpoint position is any claim 10 to 12, characterized in that it is recorded as a moving image A three-dimensional image generation method according to claim 1.

Readable by a computer storing a program for executing a 3D image generation method applied to a 3D image generation apparatus having a light projection means for projecting a light pattern onto a subject and an imaging means for capturing an image of the subject A storage medium,
The three-dimensional image generation method includes a step of extracting a parallax distribution of a subject based on an image of the subject onto which the light pattern is projected, and deforming the subject image based on the parallax distribution to generate a virtual viewpoint position of the subject. And a step of generating an image.

The three-dimensional image generation method includes a step of photographing an image of a subject that does not project the pattern and an image of a subject that projects the light pattern, and performs geometric transformation on the image of the subject that does not project the pattern. The storage medium according to claim 15 , further comprising a step of generating an image of the subject at the virtual viewpoint position.

The three-dimensional image generation method includes a step of photographing an image of a subject projected with the light pattern, and a geometric transformation is performed on the image of the subject projected with the pattern at the virtual viewpoint position of the subject. 16. The storage medium according to claim 15, further comprising a step of generating an image.

The three-dimensional image generation method includes the step of interactively generating an image of the subject at the virtual viewpoint position in response to an input of the virtual viewpoint position from the outside, and the generated virtual viewpoint storage medium according to any one of claims 15 to 17, characterized in that a step of displaying an image at the position.

The three-dimensional image generation method includes a step of generating an image at a plurality of continuous viewpoint positions preset as the virtual viewpoint position, and the generated image at the virtual viewpoint position as a moving image. storage medium according to any one of claims 15 to 17, characterized in that a step of recording.

A stereoscopic image processing apparatus that processes and displays an image of a subject taken from a plurality of viewpoints,
A series of left images corresponding to viewpoints on a predetermined locus from images obtained by photographing a subject from a plurality of viewpoints, and a series of right images corresponding to viewpoints moved to the right by a predetermined position in the horizontal direction from the viewpoints on the predetermined locus. And a display control means for sequentially displaying the generated series of left images and the series of right images as moving images on a display means.

21. The stereoscopic image processing apparatus according to claim 20, wherein the images of the plurality of viewpoints are images obtained by dividing a stereoscopic image captured by attaching a stereoscopic photograph adapter to the imaging apparatus into two parts on the left and right.

The display means may be a display means capable of independently observing the moving image with the left and right eyes via liquid crystal shutter glasses, or a parameter capable of observing the series of left and right images arranged in stripes without the liquid crystal shutter glasses. 21. The stereoscopic image according to claim 20 , wherein the stereoscopic image is a lux barrier type stereoscopic display means or a lenticular lens type stereoscopic display means capable of observing the series of left and right images arranged in a stripe shape without liquid crystal shutter glasses. Processing equipment.

A stereoscopic image shooting and display system comprising: an imaging device; a stereoscopic image processing device that processes and displays an image of a subject taken from a plurality of viewpoints by the imaging device; and a stereoscopic image observation device.
The imaging device is capable of shooting with a stereoscopic photograph adapter,
The stereoscopic image processing apparatus includes a series of left images corresponding to viewpoints on a predetermined locus, and viewpoints moved to the right by a predetermined position in the horizontal direction from the viewpoints on the predetermined locus from images obtained by photographing the subject from a plurality of viewpoints. Image generation means for generating a series of right images corresponding to the display, and a display control means for sequentially displaying the generated series of left images and the series of right images as moving images on a display means,
The stereoscopic image observing apparatus is liquid crystal shutter glasses capable of independently observing the moving image displayed on the display means with left and right eyes.

A stereoscopic image processing method for processing and displaying an image of a subject taken from a plurality of viewpoints,
A series of left images corresponding to viewpoints on a predetermined locus from images obtained by photographing a subject from a plurality of viewpoints, and a series of right images corresponding to viewpoints moved to the right by a predetermined position in the horizontal direction from the viewpoints on the predetermined locus. 3D image processing method, and sequentially displaying the generated series of left images and series of right images as moving images.

25. The stereoscopic image processing method according to claim 24, wherein the images of the plurality of viewpoints are images obtained by dividing a stereoscopic image captured by attaching a stereoscopic photograph adapter to an imaging device into two left and right.

The parallax allows the moving image to be displayed on display means that can be observed independently by the left and right eyes via liquid crystal shutter glasses, or the series of left and right images arranged in stripes can be observed without liquid crystal shutter glasses. displayed on the stereoscopic display means of the barrier system, or the series of left and right images which are arranged in stripes, according to claim 24, characterized in that displayed on the stereoscopic display means capable lenticular lens method observed without the liquid crystal shutter glasses 3D image processing method.

A computer-readable storage medium storing a program for executing a stereoscopic image processing method applied to a stereoscopic image processing apparatus that processes and displays images obtained by photographing a subject from a plurality of viewpoints,
The stereoscopic image processing method includes a series of left images corresponding to viewpoints on a predetermined trajectory from images obtained by photographing a subject from a plurality of viewpoints, and a viewpoint moved to the right by a predetermined position in the horizontal direction from the viewpoints on the predetermined trajectory. And a step of sequentially displaying the generated series of left images and the series of right images as moving images.

28. The storage medium according to claim 27, wherein the images of the plurality of viewpoints are images obtained by dividing a stereoscopic image captured by attaching a stereoscopic photograph adapter to an imaging apparatus into two parts on the left and right.

In the stereoscopic image processing method, the moving image is displayed on display means that can be observed independently by the left and right eyes via liquid crystal shutter glasses, or the series of left and right images arranged in stripes are displayed on a liquid crystal shutter. The step of displaying on the parallax barrier type stereoscopic display means that can be observed without glasses, or the series of left and right images arranged in stripes is displayed on the stereoscopic display means of a lenticular lens type that can be observed without liquid crystal shutter glasses. The storage medium according to claim 27, further comprising steps.