JPH08328170A - Viewpoint follow-up type stereoscopic image display - Google Patents

Abstract

PURPOSE: To provide a viewpoint follow-up type stereoscopic image display which always displays a precise stereoscopic image matching with the viewpoint position, even if an observer moves. CONSTITUTION: Angle information θ and ϕ on the head part of an observer is detected by a position sensor 14 and a processor 16 so that a viewpoint position compensation quantity Δ is calculated by its angle information. A controller 18 issues a control instruction to a drive part 19 based on the compensated position information, the drive part 19 moves a projector 11 on a movement stage 12 in arrow (a) direction, and the image projected from the projector 11 by an image processing part 20 is appropriately processed. The observer can thus always sense a precise stereoscopic image matching with the viewpoint (the central part of the both eyes).

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a viewpoint-following stereoscopic image display device for displaying a stereoscopic image according to the position of the observer's viewpoint, and in particular, correction of the viewpoint position for displaying an appropriate stereoscopic image for the observer. Regarding

[0002]

2. Description of the Related Art In recent years, the demand for stereoscopic display has increased, and various stereoscopic image display devices have been studied. Recently, a projection-type stereoscopic image display device that realizes stereoscopic vision by separating and presenting images having binocular parallax separately to the left and right eyes using a lenticular screen has been receiving attention. This device has the advantage that no special glasses have to be worn.

FIG. 5 is a plan view showing a conventional projection type stereoscopic image display device using this lenticular screen.
The lenticular screen 505 is configured by arranging a large number of vertically elongated cylindrical lenses. In FIG. 5, the focal plane of each cylindrical lens is used as an image plane, and an image in which the right eye image 503 and the left eye image 502 viewed from different directions are divided into stripes and periodically arranged is projected by the projector 5
Project with 01. In FIG. 5, a large number of long and narrow stripes are arranged in the left-right direction 508 in the direction perpendicular to the paper surface. Since the eyes of the observer's right eye 506 and left eye 507 enter the lenticular screen 505 from different angles, the observer sees different images with parallax, and a stereoscopic image is sensed. Note that, for simplicity, the parallax image in FIG. 5 is the right eye image 503 and the left eye image 502.
I have a number.

In the projection type stereoscopic image display device using this lenticular screen 505, there are discrete areas where stereoscopic vision is possible, and particularly in the left-right direction 508, the area where good stereoscopic vision is possible is about the distance between the eyes. You will be limited.
In the viewpoint-following stereoscopic image display device, an appropriate stereoscopic image can be displayed for the observer by detecting the central portion of both eyes of the observer. And

Therefore, in order to expand the viewing area in the left-right direction, the viewpoint of the observer is detected, and the projected image is moved according to the detected amount so that the images corresponding to the left and right eyes of the observer are always presented. A viewpoint-following stereoscopic image display device that is controlled in accordance with the above is known. (See, for example, JP-A-1-107247). FIG. 6 is an explanatory view showing this conventional example. Here, a liquid crystal projector 602 is used as the image projection device. The liquid crystal projector 602 moves in accordance with the movement of the observer's viewpoint 601 and a moving stage 603 as a viewpoint tracking mechanism.
By moving it upwards, stereoscopic viewing is possible even if the observer moves left and right.

[0006]

In the conventional viewpoint detection method in the lenticular type viewpoint tracking type stereoscopic image display device, when a position sensor such as a three-dimensional magnetic position sensor is attached to the observer, the visual field of the observer is reduced. It is necessary to mount the position sensor on the top of the observer's head or the like so that the position sensor does not come in. At this time, if the observer moves his / her head, an accurate viewpoint position cannot be detected, and there is a problem that the observer cannot perceive a good stereoscopic image.

The problem will be described below with reference to the drawings.

FIG. 7 is a diagram regarding the degree of freedom of movement of a human head. FIG. 7A shows a motion of tilting the head to the left and right while facing the front (angle θ direction), and FIG. 7B shows a rotation motion about the neck (angle φ direction). .
Generally, the movement of the head related to the movement of the viewpoint in the left-right direction can be explained by a combination of the two.

Next, in the conventional viewpoint detection method, it will be described with reference to FIG. 8 that an error occurs in the viewpoint position detected by the position sensor when the observer's head moves as shown in FIG. The observer wears the position sensor on the top of the head so as not to enter the field of view. FIG. 8A shows the case where the head is tilted by the angle θ in the left-right direction, but an error Δ ₁ occurs between the viewpoint position detected by the position sensor and the actual viewpoint position 802. Similarly, FIG. 8B shows the case where the angle φ is rotated in the rotation direction, but an error Δ ₂ occurs between the viewpoint position detected by the position sensor and the actual viewpoint position 802. As described above, according to the conventional viewpoint detection method, since the accurate viewpoint position cannot be detected when the head of the observer moves, the observer cannot sense an appropriate stereoscopic image. In order to prevent this error from occurring in the conventional viewpoint detection method, an unreasonable posture of always erecting the head is forced.

An object of the present invention is to provide a viewpoint-following stereoscopic image display device which always displays an appropriate stereoscopic image to the observer even when the observer's head moves.

[0011]

A viewpoint-following stereoscopic image display apparatus according to the present invention comprises a tilt and direction detecting means for three-dimensionally detecting a change in the tilt and direction of the observer's head, and a change in the position of the observer. Calculation means for calculating the observer's viewpoint position based on the information and the inclination and direction change information of the observer's head, and moving the projection image on the lenticular screen so as to give the observer a stereoscopic effect according to the viewpoint position. And an image adjusting means.

[0012]

In the viewpoint position correcting method according to the present invention,
The information on the inclination and direction change of the observer's head is detected, and the error generated when the observer's head moves is calculated based on the information, and the observer's viewpoint position is corrected. As a result, it is possible to always provide the viewer with a stereoscopic image corresponding to an accurate viewpoint position.

[0013]

Embodiments of the present invention will be described below with reference to the drawings.

FIG. 1 is a block diagram showing a schematic structure of an embodiment of a viewpoint tracking type stereoscopic image display device according to the present invention. In FIG. 1, a projector 11 for projecting an image is provided behind the lenticular screen 10, and the projector 11 can be moved by a moving stage 12 in the arrow a direction. Lenticular screen 1
The image projected on 0 is displayed on the observer 13 as described above.
It is perceived as a stereoscopic image.

A position sensor 14 is attached to the head of the observer 13, and a magnetic field generator 15 is installed behind the observer 13. The magnetic field generator 15 in this embodiment is composed of three magnetic field generation coils which are orthogonal to each other, and the position sensor 14 is a three-dimensional magnetic position sensor which is composed of three magnetic sensing coils which are orthogonal to each other corresponding to the magnetic field generator 15.

The position sensor 14 detects the magnetic field generated by the magnetic field generator 15 to detect the position sensor 1
The position data indicating the change in the position of No. 4 and the change in the inclination and direction of the head of the observer 13 are output. When the position data is received from the position sensor 14, the processor 16 converts it into position information including a horizontal tilt angle θ and a rotation angle φ of the head, and outputs the position information to the calculation unit 17. The calculation unit 17 calculates the correction amount Δ using the angles θ and φ and the predetermined values L and r,
The position information is corrected by the correction amount Δ. The corrected position information is sent to the controller 18 and the controller 1
8, the viewpoint position correction control is performed. That is, the controller 18 issues a control command to the drive unit 19 based on the corrected position information, and the drive unit 19 causes the moving stage 1 to move.
The projector 11 above 2 is moved in the direction of arrow a, and the image projected from the projector 11 onto the lenticular screen 10 is moved. Further, similar image movement can be performed by the image processing unit 20. The controller 18 may change the projected image by controlling the image processing unit 20 based on the corrected information and adjusting the image data output from the image processing unit 20 to the projector 11.

Next, a method of calculating the correction amount Δ executed by the calculation unit 17 will be described.

FIG. 2 is a diagram for explaining the correction amount Δ ₁ when the observer tilts his head in the left-right direction by an angle θ. Figure 2
As shown in, when the head of the observer 13 is tilted by the angle θ with respect to the right image 201 and the left image 202 on the lenticular screen 10, the position of the position sensor 14 is changed to the viewpoint position 10.
It will move in a direction more inclined than 2. Therefore, it is necessary to correct the position shift amount from the position information of the position sensor 14. Assuming that the distance of the perpendicular line drawn from the position sensor 14 to the plane P ₁ including both eyes is L, this correction amount Δ ₁ is expressed by (Equation 1).

[0019]

## EQU1 ## Δ ₁ = L sin θ (1) FIG. 3 is a diagram for explaining the correction amount Δ ₂ when the observer rotates the head by the angle φ in the rotation direction. As shown in FIG. 3, when the head of the observer 13 rotates by an angle φ with respect to the right image 201 and the left image 202 on the lenticular screen 10, the position of the position sensor 14 rotates with respect to the viewpoint position 102. It will move in the direction. Therefore, it is necessary to correct the position shift amount from the position information of the position sensor 14. Assuming that the distance of the perpendicular line drawn from the position sensor 14 to the plane P ₂ including both eyes is r, the correction amount Δ ₂ is expressed by (Equation 2).

[0020]

[Number 2] Δ ₂ = rsinφ ₍₂₎ 4 is a diagram for explaining the delta correction amount when the observer is generally obtained by an angle φ rotated in the rotational direction while tilting angle θ of the head in the lateral direction is there. From (Equation 1), (Equation 2) and FIG. 4, this general correction amount Δ is represented by (Equation 3).

[0021]

## EQU3 ## Δ = Δ ₁ + Δ ₂ cos θ = L sin θ + r sin φ cosθ (3) The calculation unit 17 calculates the correction amount Δ and corrects the position information of the position sensor 14, whereby the controller 18 becomes
The projector 11 is moved so that the boundary between the right image 201 and the left image 202 is located at a more accurate viewpoint position 102 than in the case of only position information, or the image processing unit 20
Can be controlled so that the viewer can see the most appropriate stereoscopic image.

For example, the distance L is 1 as the average value of humans.
If the distance is 3 cm and the distance r is 7.5 cm, the observer has θ = 1.
When the head is tilted by 5 °, a viewpoint position error of about 3.4 cm occurs. According to the present embodiment, this error can be corrected and a correct stereoscopic image can be displayed to the observer. In fact, when the observer observes a stereoscopic image in a relaxed state, the hip is tilted with the waist as a fulcrum,
The effect of the viewpoint position correction according to the present invention was great. Also,
Regarding the rotation of the head, the correction angle is particularly large because the rotation angle at the time of observation often differs depending on the person and the head frequently moves in the rotation direction.

The method of detecting the position of the observer's head is not limited to the method of measuring by the three-dimensional magnetic position sensor as in this embodiment, but measurement by an acceleration sensor, ultrasonic sensor It is also possible to use measurement by, image measurement, optical measurement and the like. Further, when the image processing unit has an image processing capability capable of coping with the movement of the observer, it is possible to display the correct stereoscopic image for the observer by adjusting the image data.

In addition to the horizontal angle θ and the rotation angle φ,
It is obvious that the correction according to the information of the angle orthogonal to these, that is, the correction when the head is tilted back and forth can be easily performed from this embodiment.

If the distance L and the distance r indicating the relative positional relationship between the position of the position sensor and the viewpoint are known, the present correction method can be performed even if the position sensor is attached to any part of the observer. It is valid.

[0026]

As described above, according to the present invention, since the viewpoint position shift caused by the inclination or rotation of the observer's head can be corrected, the conventional viewpoint position correction that accompanies the movement of the entire body of the observer can be performed. In addition, the viewpoint position can be corrected more accurately, and a good stereoscopic image can be provided even for various postures that the observer shows in a relaxed state.

[Brief description of drawings]

FIG. 1 is a block diagram showing an embodiment of a viewpoint tracking type stereoscopic image display device according to the present invention.

FIG. 2 is a schematic diagram illustrating a correction amount Δ ₁ when an observer tilts his / her head in the left / right direction by an angle θ.

FIG. 3 is a schematic diagram illustrating a correction amount Δ ₂ when an observer rotates a head by an angle φ in a rotation direction.

FIG. 4 is a schematic diagram for explaining a general correction amount Δ when an observer rotates the head by an angle φ in the left-right direction while rotating the head by an angle φ.

FIG. 5 is a schematic plan view showing a configuration of a conventional projection type stereoscopic image display device using a lenticular screen.

FIG. 6 is a schematic configuration diagram for explaining a conventional viewpoint-following projection type stereoscopic image display device.

FIG. 7A is a schematic diagram for explaining the degree of freedom of tilting the head in the left-right direction while facing the front. (B) is a schematic diagram for explaining the degree of freedom of rotating the head in the rotation direction around the neck.

FIG. 8A is a schematic diagram showing an error Δ ₁ that occurs when an observer tilts his / her head in the left / right direction by an angle θ. (B) is a schematic diagram showing an error Δ ₂ that occurs when an observer rotates his / her head by an angle φ.

[Explanation of symbols]

 10 Lenticular screen 11 Projector 12 Moving stage 13 Observer 14 Position sensor 15 Magnetic field generator 16 Processor 17 Calculation unit 18 Controller 19 Drive unit 20 Image processing unit 102 Viewpoint position 111 Right eye 112 Left eye 201 Right image 202 Left image

Claims (3)

[Claims] 1. A device for displaying a stereoscopic image on an observer according to position change information of the observer with respect to a lenticular screen, wherein the inclination and direction for three-dimensionally detecting a change in the inclination and direction of the observer's head. Detecting means, computing means for calculating the observer's viewpoint position based on the observer's position change information and the head's inclination and direction change information; and giving the observer a stereoscopic effect according to the viewpoint position. A viewpoint-following stereoscopic image display device, comprising: an image adjusting means for moving the projected image on the lenticular screen. 2. The tilt and direction detecting means is provided on the head of the observer and outputs position change information of the observer and tilt and direction change information of the head. A viewpoint-following stereoscopic image display device according to item 1. 3. The calculating means calculates correction information according to the inclination and direction change information of the head and corrects the position change information of the observer according to the correction information to calculate a viewpoint position of the observer. The viewpoint-following stereoscopic image display device according to claim 1 or 2.