JP3064992B2 - Stereoscopic image display method and device - Google Patents

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a method of dividing a left-eye image and a right-eye image into a plurality of linear images.
The present invention relates to a stereoscopic image display method and apparatus for alternately arranging each linear image from each image, displaying the images on a display, and observing the images displayed on the display via a lenticular lens sheet having a plurality of lenticular lenses arranged.

[0002]

2. Description of the Related Art Conventionally, there is a stereoscopic image display device using a lenticular lens sheet. JP-A-8-311
Japanese Patent Publication No. 364 discloses a stereoscopic image display device in which a lenticular lens is moved in accordance with the movement of an observer, and a stereoscopic viewing area is widened. FIG. 7 shows this conventional stereoscopic image display device. The diffusion plate 601 forms an image display surface of the projection light from the projection unit 605. A pair of lenticular lenses 602 and 603 disposed on both sides of the diffusion plate 601 refract an image formed on the diffusion plate 601 so as to be incident on the left and right eyes 606 and 607. The detecting means 604 detects the observer P
Detects the viewpoint position of. The control unit 608 controls each lenticular lens 60 according to the detection value of the detection unit 604.
2, 603 is adjusted in a direction perpendicular to the surface of the diffusion plate 601 (x-axis direction) and / or in a horizontal direction parallel to the surface of the diffusion plate 601 (y-axis direction) to obtain an observation distance of the observer P;
The configuration is such that the horizontal movement of the observation position and the distance between eyes can be adjusted simultaneously or individually.

[0003] In the above arrangement, two parallax images taken from different left and right viewpoint positions are divided into linear images.
A composite linear image in which these are alternately arranged in the y-axis direction is projected onto the diffusion plate 601. Light beams from the respective linear images are made incident on the left and right eyes 606 and 607 by lenticular lenses 602 and 603. Thus, the observer P observes the original two left and right parallax images on the same screen with the left and right eyes 606 and 607, respectively, and stereoscopic vision is realized. Assuming that the viewpoint position of the observer P approaches the diffusion plate 601 in the optical axis direction (x-axis direction) in FIG. 7, the lenticular lens 603 on the emission side is moved in the x-direction so that its thickness becomes thin. Further, when the viewpoint position of the observer P moves in the horizontal direction (y-axis direction) in parallel with the diffusion plate 601, the emission side according to a change in the distance between the optical axis of the lenticular lenses 602 and 603 and the viewpoint position. Lenticular lens 603 is moved in the y-axis direction. As described above, in the conventional stereoscopic image display apparatus, the stereoscopic viewing area is expanded with respect to the movement of the observation position and the observation distance of the observer P in the left and right direction by the movement of the lenticular lenses 602 and 603 on the emission side.

[0004]

However, the conventional stereoscopic image display apparatus has the following drawbacks. That is, each parallax image is an image taken from a different direction so as to form an image only on a subject at a specific focal length among a plurality of subjects having different focal lengths included in the image, and a specific parallax image in the parallax image. Since the focal lengths of other subjects that are farther than the subject or closer subjects do not match, even when the observer P's line of sight is directed to the images of these subjects, the images remain blurred because the images remain blurred. It was impossible to express as.

[0005] It is an object of the present invention to provide a method and apparatus for displaying a stereoscopic image which enables clear stereoscopic viewing of all objects in a parallax image. An object of the present invention is to provide a stereoscopic image display method and apparatus capable of expressing a perspective by enabling stereoscopic viewing.

[0006]

The feature of the method of the present invention is that the left eye (FIG. 4) of the observer (P in FIG. 1) is used.
307) and the right eye (308 in FIG. 4) and the left eye image (204 to 206 in FIG. 3) and the right eye image (FIG. 204 to 206) are linearly divided in a predetermined direction, and a plurality of left-eye linear images and right-eye linear images are alternately arranged to form a plurality of left-eye linear images and right-eye linear images. A lenticular lens (30 in FIG. 1) continuously provided at a pitch equal to the width of the set in the predetermined direction.
2aa to 302 mn), and each of the plurality of alternately arranged linear images for the left eye and linear images for the right eye is further divided in a vertical direction with respect to a predetermined direction to obtain a plurality of dot-like pixel images. This is a stereoscopic image display method in which each of a plurality of dot-shaped pixel images is formed at an independent focal length (D1 to D3 in FIG. 2).

The feature of the apparatus of the present invention is that the observer (P in FIG. 1)
Left eye (307 in FIG. 4) position and right eye (308 in FIG. 4)
Each of the left-eye image (204 to 206 in FIG. 3) and the right-eye image (204 to 206 in FIG. 3) obtained by photographing the subject (201 to 203 in FIG. 2) from the position is linearly drawn in a predetermined direction. Display means for alternately arranging and displaying a plurality of left-eye linear images and right-eye linear images formed by dividing
And display means (100, 10 in FIG. 1).
Each of the plurality of left-eye linear images and the right-eye linear images arranged on the front surface of 1) and alternately arranged is further divided in a predetermined direction to obtain a plurality of left-eye dot pixel images (304 and 3 in FIG. 4).
06) and a dot image for the right eye (303, 30 in FIG. 4)
5) Combination of a plurality of left-eye point-shaped pixel images (304, 306 in FIG. 4) and right-eye point-shaped pixel images (303, 305 in FIG. 4) provided for each of a set of combinations. A plurality of focusing means (301aa to 301mn in FIG. 1) for forming an image at a predetermined focal length (D1 to D3 in FIG. 2);
A plurality of lenticular lenses (302aa to 302mn in FIG. 1) and a plurality of focusing units (301aa to 301mn in FIG. 1) respectively arranged on the front surface of each of the plurality of focusing units (301aa to 301mn in FIG. 1). Control means (FIG. 1) for individually controlling the focal lengths (D1 to D3 in FIG. 2)
103-106).

Since the present invention employs such a method and means, it is possible to display a stereoscopic image having a sense of perspective without the observer preparing special stereoscopic glasses.

[0009]

Next, embodiments of the present invention will be described in detail with reference to the drawings.

In FIG. 1, a flat panel display 101 is an image projector such as an LCD. The image display surface 100 is made of a diffusion plate such as a translucent plastic plate,
As an image forming surface provided on the front surface of the flat panel display 101, a projected image is displayed on this surface. The lens optical systems 102aa to 102mn are formed on the front surface of the image forming surface 100, and alternately array a plurality of left-eye and right-eye linear images formed by dividing a left-eye image and a right-eye image into a line in the screen vertical direction. The zoom lenses 301aa to 301mn each having the same width as the combination of the pair of left-eye and right-eye linear images and incorporating zoom lens driving means (not shown) formed in the vertical direction and divided into a plurality of parts. Lenticular lenses 302aa-30a formed on the front surfaces of zoom lenses 301aa-301mn, respectively.
2mn. Left eye camera 110-114
Captures a parallax image for the left eye from the same viewpoint toward a subject in the same direction at an individual focal length. Right eye camera 121
125 captures right-eye parallax images from the same viewpoint toward subjects in the same direction at different focal lengths. The left-eye camera controller 103 outputs an input image signal S110 of each image captured at a separate focal length as a left-eye parallax image.
ＳS114 are compared to select an image for each pixel and output as an input parallax image signal Sil. The right-eye camera controller 106 includes input image signals S121 to S12 of images captured at individual focal lengths as right-eye parallax images.
5 is selected by comparing each pixel unit, and the input parallax image signal S
Output as ir. The image processing device 104 synchronizes the input parallax image signals Sil and Sir from the left and right eye camera controllers 103 and 106 and synchronizes the pixel signals Sdo.
Output as t. Display controller 105
Are the display pixel signals S11 to S11 including the display information of the pixels and the information of the focal lengths D1 to D3 by the synchronized pixel signals Sdot.
Sln, Sr1 to Srn are generated, and the flat panel display 101 is driven.

In order to explain the functions of the stereoscopic display apparatus of the present embodiment, first, the functions of the left-eye cameras 110 to 114, the left-eye camera controller 103, and the right-eye camera 1 will be described.
The functions of the camera controllers 21 to 125 and the right-eye camera controller 106 will be described with reference to FIGS. FIG. 2 shows the case of the left-eye cameras 110 to 112 and the left-eye camera controller 103.

Now, cameras 110, 111, and 112 for taking images of subjects 201, 202, and 203 located at distances D1, D2, and D3 are located in the same direction from places that are close to each other and can be regarded as the same viewpoint position. It is arranged toward. The camera 110 receives an input image signal S of a video 204 (FIG. 3A) in which an image 201i of the subject 201 is clearly captured.
110 is sent to the left-eye camera controller 103, and the camera 111 sends the input image signal S111 of the video 205 (FIG. 3B) in which the image 202i of the subject 202 is clearly captured to the left-eye camera controller 103, and the camera 112
Sends an input image signal S112 of a video 206 (FIG. 3C) in which an image 203i of the subject 203 is clearly photographed to the left-eye camera controller 103. In the left-eye camera controller 103, the same subjects 201 and 2 are located in the same direction.
03 are different focal lengths D1 to D3 from the same viewpoint position.
Image signal S11 of videos 204 to 206 shot in
0 to S112 are input. The left-eye camera controller 103 outputs an input image signal S
110 to S112 are compared in units of pixel images, and a pixel image in which the images 201i to 203i are clearly shown is selected for each pixel, and the cameras 110 to 1 in which the pixel images are captured are selected.
An input parallax image signal Sil (FIG. 1) composed of each pixel image is output together with twelve focal length D1 to D3 information.

Returning to FIG. 1, right-eye cameras 121 to 125
In the same manner, the same subject 201, 202, 20
3, the right-eye cameras 121 to 125 are arranged at different viewpoint positions from the left-eye cameras 110 to 114, and the same subject 20 in the same direction as in the case of the left-eye camera
1 to 203 are different focal lengths D1 from the same viewpoint position.
The input image signals of the video images 204 to 206 captured at D3 to D3 are input to the right-eye camera controller 106. The right-eye camera controller 106 outputs these images 204-2.
The input image signal No. 06 is compared in units of pixel images, and a pixel image in which the images 201i to 203i are clearly shown is selected for each pixel, and the cameras 121 to 121 in which the pixel images are captured are selected.
It is output as an input parallax image signal Sir composed of each pixel image together with the information on the focal lengths D1 to D3 of 125.

Returning to FIG. 1, the pixel images and the information of the focal lengths D1 to D3 stored in the left-eye and right-eye camera controllers 103 and 106 respectively correspond to the input parallax image signal Si.
1 and Sir are input to the image processing device 104, and the input parallax image signals Sil and Sir are input by the image processing device 104.
Are adjusted so as to be synchronized with each other and the display controller 1 as a pixel signal Sdot with focal length D1 to D3 information.
05.

Next, a method of driving the flat panel display 101 by the display controller 105 will be described with reference to FIG.

FIG. 4 is an explanatory view showing an image display method in one pixel unit of the display. The right-eye pixels 303 and the left-eye pixels 304 are formed by being alternately arranged on the flat panel display 101, transmit through the image display surface 100, and have a zoom lens 301ab and a lenticular lens 302a.
The light passes through b and is reflected on the right eye 308 and the left eye 307, respectively.
Information on the focal lengths D1 to D3 of the left-eye pixel 304 and right-eye pixel 303 is transmitted to the zoom lens 301ab, and the zoom lens 301 of each of the pixels 303 and 304 is transmitted.
The image formation position through ab is determined by the cameras 110 to 114 and 121 to 125 and the object 20 when each pixel is originally input.
An image is formed at a distance from the left eye 307 or the right eye 308 of the observer P by a distance Dn (n = 1 or 2 or 3) from the observer P.

Next, FIG. 5 shows the subject 2 shown in FIGS.
One pixel image for the left eye 307 of 01, 202 is a distance D
1 illustrates the principle of being imaged on D2 and observed by the left eye 307 of the observer P.

FIGS. 6A and 6B show the display pixel signals S11 to S16 and Sr1 to Sr6 for the left eye 307 (FIG. 6A) and the right eye 308 (FIG. 5B). An example is shown in which images 201i and 202i of subjects 201 and 202 are formed.

In FIG. 6A, the display pixel signals S11 to S13 of the image for the left eye 307 representing the subject 201 are obtained by the left-eye camera 110 (FIG. 1) which most clearly represents the image 201i of the subject 201 for the left eye. Camera controller 103
(FIG. 1), which is selected together with the focal length D1 information of the left-eye camera 110 (FIG. 1) by the image processing device 104,
Left-eye pixel signals S11 to S13 are input to each pixel of the flat panel display 101 via the display controller 105, and left-eye pixel signals Sl11
The focal lengths of the zoom lenses 301aa to 301ac are all set by the zoom lens driving mechanism (not shown) in accordance with the focal length D1 information of each pixel included in 1 to S13.
The image 201i is formed at a distance D1 from the left eye 307 of the observer P by being controlled to a state where the focus is adjusted to 1. Similarly, the display pixel signals S14 to S16 of the left-eye video representing the subject 202 are the image 2 of the subject 202.
The left-eye camera 111 (FIG. 1) that most clearly expresses the image 02i is selected from the left-eye camera controller 103 (FIG. 1), and is selected together with the focal length D2 information of the left-eye camera 111 (FIG. 1). Image 2 shown in FIG. 6A via the controller 105
The zoom lens 301ad-301a is input to each pixel of the flat panel display 101 as the left-eye pixel signal S14-S16 of 05, and according to the focal length D2 information of each pixel included in each left-eye pixel signal S14-S16.
An image 202i is formed at a distance D2 from the left eye 307 of the observer P by controlling the focal length of f to be in focus to the focal length D2 by a zoom lens driving mechanism (not shown). In this way, the subjects 201 and 202 existing in the near and far directions are transformed into images 201i and 2 having a sense of perspective.
02i is perceived by the left eye 307.

FIG. 6B shows the display pixel signals Sr1 to Sr6 of the image for the right eye 308 representing the subject 201 in FIG.
Similarly to the image for the left eye 307 shown in (a), the image 20 of the subject 201 is located at a distance D1 from the right eye 308 of the observer P.
1i, an image 202i of the subject 202 is formed at a distance D2 from the right eye 308 of the observer P, and the distant subjects 201, 202 are perspective images 201i, 20.
Perceived by the right eye 308 as 2i.

As shown in FIGS. 6A and 6B, the plurality of subjects 201 and 202 are independently focused at different focal lengths D1 and D2, respectively.
A stereoscopic image with perspective is expressed.

FIG. 1 shows a case where images are taken with five cameras 110 to 114 and 121 to 125 as imaging devices, but the number of imaging devices can be freely set according to the required degree of expression. I don't care. A similar effect can be expected by changing the focal lengths D1 to D3 in a time-division manner and inputting an image.

In FIG. 2, the subjects 201 to 203 are 3
Although the number of cameras 110 to 112 is three, the number of subjects 201 to 203 and the number of cameras 110 to 112 do not need to match, and cost and precision of perspective expression are required. Cameras 110 to 112 according to the degree
May be determined. Here, the cameras 110-1
12 is fixed to each of the subjects 201 to 203.
Although the case where the image was shot at D3 is shown, each subject 201 to 20
Each camera 110-1 so that it can be focused even when 3 moves
12 may be provided with a zoom lens, and the focal lengths D1 to D3 may be changed in a time-division
06 may be shot by one camera.

FIG. 4 shows a lenticular lens 30.
2aa to 302mn are converted to zoom lenses 301aa to 301
Although each pixel is set between mn and the observer P, a lenticular lens sheet in which linear lenticular lenses are continuously arranged may be used as long as the same function is provided. It may be arranged at another position between the and the flat panel display.

[0025]

According to the present invention, each of the left-eye image and the right-eye image is divided into a plurality of linear images, and the linear images from each image are alternately arranged and displayed on a display. The dot image is further divided into a plurality of dot pixel images, and between each dot pixel image and the lenticular lens sheet, a zoom lens optical system is incorporated for each dot pixel image. An image is arbitrarily formed for each dot-shaped pixel image at a plurality of different places between displays or continuously different places, and the images displayed on the display are arranged with a plurality of lenticular lenses. Observation through a lenticular lens sheet enables clear stereoscopic viewing of all subjects at different viewing distances, enabling clear display of perspective stereoscopic images. There is an advantage.

[Brief description of the drawings]

FIG. 1 is a conceptual diagram of a configuration of a stereoscopic image display device of the present invention.

FIG. 2 is an explanatory diagram illustrating an image input method of the stereoscopic image display device of the present invention.

FIG. 3 shows a three-dimensional image display device of the present invention.

FIG. 4 is an explanatory diagram of a structure in a pixel unit of the stereoscopic image display device of the present invention.

FIG. 5 is an explanatory diagram of a method of expressing a perspective image of a distant subject in a unit of a pixel in the stereoscopic image display device of the present invention.

FIG. 6 is a diagram illustrating a method for expressing a left-eye image and a right-eye image according to the present invention.

FIG. 7 is a conceptual diagram illustrating a configuration of a conventional stereoscopic image display device.

[Explanation of symbols]

 P Observer 100 Image display surface 101 Flat panel display 102 aa to 102 mn Lens optical system 103 Camera controller for left eye 104 Image processing device 105 Display controller 106 Camera controller for right eye 110 to 114 Camera for left eye 121 to 125 Camera for right eye 201 to 203 Subject 201i-203i Images 204-206 Images 301aa-301mn Zoom lenses 302aa-302mn Lenticular lenses 303,305 Right eye pixels 304,306 Left eye pixels 307 Left eye 308 Right eye 601 Diffusion plate 602,603 Lenticular lens sheet 604 Detecting means 605 Projecting means 606 Left eye 607 Right eye 608 Control unit

Claims (10)

(57) [Claims] 1. A plurality of left-eye linear images formed by dividing each of a left-eye image and a right-eye image obtained by photographing a subject from a left-eye position and a right-eye position of an observer in a predetermined direction. The image and the linear image for the right eye are alternately arranged, and the lenticular lens provided continuously at a pitch equal to the width in the predetermined direction of a combination of a set of the plurality of linear images for the left eye and the linear image for the right eye. Displayed through a lenticular lens sheet continuously formed in a predetermined direction, the plurality of alternately arranged left-eye linear images and right-eye linear images are further divided in a direction perpendicular to the predetermined direction to form a plurality of linear images. A three-dimensional image display method, wherein each of the plurality of dot-shaped pixel images is formed at an independent focal length. 2. The method according to claim 1, wherein each of the plurality of dot-shaped pixel images is
A specific point-like pixel image selected from among a plurality of point-like pixel images obtained by imaging the subject at a plurality of different focal lengths from the left eye position and the right eye position of the observer, and closest to the focused state. The stereoscopic image display method according to claim 1, wherein: 3. Each of the plurality of dot-shaped pixel images is:
The stereoscopic image display method according to claim 1, wherein a distance between the left eye position and the right eye position of the observer and the subject is detected, and an image is formed at the distance. 4. Each of the plurality of linear images is photographed from a left eye position or a right eye position of the observer, and is selected from a plurality of point image pixel images obtained by photographing the subject at a plurality of different focal lengths. In addition, the specific point-like pixel image closest to the in-focus state, the distance between the left-eye position and the right-eye position of the observer and the subject is detected, and the specific image is formed at the distance. The stereoscopic image display method according to claim 1, wherein the three-dimensional image display method is generated by grouping point-like pixel images. 5. A plurality of left-eye linear images formed by dividing each of the left-eye image and the right-eye image obtained by photographing the subject from the left-eye position and the right-eye position of the observer in a predetermined direction. Display means for displaying an image and a right-eye linear image alternately and arranged, and a plurality of the left-eye linear images and the right-eye linear image which are arranged on the front of the display means and are alternately arranged. The plurality of left-eye point-shaped pixel images and the right-eye point-shaped pixel images are provided in correspondence with each set of a plurality of left-eye point-shaped pixel images and right-eye point-shaped pixel images. A plurality of focusing means for forming an image of a set of pixel images at a predetermined focal length, a plurality of lenticular lenses disposed in front of each of the plurality of focusing means, and the plurality of focusing means The focal length of each Stereoscopic image display apparatus characterized by comprising a control means for controlling. 6. The three-dimensional image display device according to claim 5, wherein the plurality of lenticular lenses are arranged on the back of the plurality of focusing units instead of on the front. 7. The three-dimensional image display device according to claim 5, wherein the plurality of lenticular lenses are lenticular lens sheets formed continuously. 8. The control unit captures the subject at a plurality of different focal lengths from the left-eye position and the right-eye position of the observer for each of the plurality of left-eye point-shaped pixel images and the right-eye point-shaped pixel image. Of the multiple point-like pixel images
8. The three-dimensional image display device according to claim 5, wherein a point-like pixel image closest to a focused state is selected and displayed on the display unit. 9. The control unit detects a distance between a left eye position and a right eye position of the observer and the subject with respect to each of the plurality of dot-shaped pixel images, and controls a focus of each of the plurality of focusing units. The stereoscopic image display device according to claim 5, wherein a distance is adjusted to each of the detected distances. 10. A plurality of point image pixel images of each of the plurality of linear images taken from the left eye position or the right eye position of the observer for each of the plurality of linear images and imaging the subject at a plurality of different focal lengths. Among the selected point-like pixel images that are closest to the in-focus state, detect the distance between the left-eye position and the right-eye position of the observer and the subject, and form an image at the distance. The three-dimensional image display device according to claim 5, wherein the point-like pixel images are grouped and generated.