JPH10239634A - Stereoscopic video display device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a stereoscopic video display device which displays a natural stereoscopic video which causes less fatigue of eyes. SOLUTION: A focus measuring instrument 1 detects the visual distance from eyes to a gaze point. An image generator 2 generates display data of an image subjected to out-of-focus processing based on image data of an original image consisting of plural picture elements, distance data of each picture element, and the visual distance. A display element 3 displays an image based on display data. An eyepiece optical system 4 project the displayed image as a virtual image. A projection distance varying mechanism 5 controls the projection distance of the virtual image so that the virtual image is projected in the position of the gaze point.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a three-dimensional image display device, and is used for, for example, a head mounted display (HMD).
The present invention relates to a three-dimensional image display device that enables a three-dimensional image to be observed as a virtual image.

[0002]

2. Description of the Related Art A conventional HMD is configured to project virtual images for the right eye and the left eye at a predetermined distance and display a stereoscopic image based on binocular parallax. According to this configuration, since the focus adjustment function of the human eye is ignored, there is a problem that the eyes become tired when observing the stereoscopic video for a long time. A three-dimensional image display device aimed at solving this problem has been proposed in Japanese Patent Laid-Open No. 6-235885. This apparatus has a configuration in which an eyeball convergence position is obtained by detecting the line of sight of both eyes, and a virtual image is projected on the eyeball convergence position.

As another device for displaying a stereoscopic image, a laser scanning type (so-called direct retinal drawing type) H is used.
MD is proposed in U.S. Pat. No. 5,355,181. According to this device, stereoscopic video is displayed by performing focusing at high speed based on distance data for each pixel of an image while performing laser scanning.

[0004]

Problems to be Solved by the Invention Japanese Patent Laid-Open No. Hei 6-23588
In the device proposed in Japanese Patent Publication No. 5 (1999), an image forming position of a display image is automatically adjusted in accordance with a change in the convergence position of the left and right eyes,
The principle of matching the image formation position to the eyeball convergence position is adopted. However, since the interpupillary distance varies among individuals, it is difficult to accurately determine the eyeball convergence position of the observer. If the adjustment of the imaging position of the display video becomes inaccurate, the eyeball convergence position and the imaging position do not match, and conversely, the problem that the eyes are easily tired occurs.

By the way, when a short-distance object placed in front of a distant background is viewed on a stereoscopic image display device, it is desirable that the edge of the object having a sharp outline is clearly visible in front of the blurred background. However, U.S. Patent No. 5,355,181
According to the device proposed in the issue, the image of the blurred background enters the edge of the object in front, and appears to overlap. For this reason, there arises a problem that the stereoscopic image becomes unnatural and the sense of reality is impaired.

SUMMARY OF THE INVENTION The present invention has been made to solve the above problems, and has as its object to provide a three-dimensional image display device capable of displaying a natural three-dimensional image with less eye fatigue. Is to do.

[0007]

In order to achieve the above object, a stereoscopic image display apparatus according to a first aspect of the present invention comprises: an image data of an original image comprising a plurality of pixels; and distance data for each pixel of the original image. A display device for displaying a stereoscopic video based on display data of an image generated from the detection device, the detection device detecting a viewing distance from an observer's eye to a gazing point; Image generating means for generating display data of an image subjected to out-of-focus processing based on the distance and the image data and the distance data, and image display means for displaying an image based on the display data generated by the image generating means Image projection means for projecting an image displayed by the image display means as a virtual image, and control means for controlling a projection distance of the virtual image so that the virtual image is projected at the position of the gazing point. Characterized in that was.

In the stereoscopic image display apparatus according to a second aspect of the present invention, in the configuration of the first aspect, the image generating means may include, in the generation of the display data, a defocus amount for each pixel of the original image and the distance data. And comparing the distance data for each pixel with the distance data for peripheral pixels located in an area corresponding to the out-of-focus amount of that pixel, the distance closer to the observer than the peripheral pixels. Only for pixels having data, the display data of the peripheral pixels is processed so that the pixels are out of focus.

According to a third aspect of the present invention, there is provided a three-dimensional image display device for displaying a three-dimensional image, comprising: detecting means for detecting a viewing distance from an observer's eye to a gazing point; Image generating means for generating display data of an image subjected to out-of-focus processing according to the distance, a laser light source for emitting laser light based on the display data generated by the image generating means, and a laser light source emitted from the laser light source A condenser lens for condensing the laser light, laser scanning means for two-dimensionally scanning the laser light condensed by the condenser lens to form an intermediate image, and an intermediate image formed by the laser scanning means. An eyepiece optical system for projecting as a virtual image; and control means for controlling a distance between the laser light source and the condenser lens so that the virtual image is projected at the position of the gazing point. The features.

A three-dimensional image display device according to a fourth aspect of the present invention is a device for displaying a three-dimensional image, comprising a detecting means for detecting a refractive power of an observer's eye, and a visual distance from the observer's eye to a gazing point. Calculating means for calculating from the refractive power detected by the detecting means; image generating means for generating display data of an image subjected to defocus processing in accordance with the viewing distance calculated by the calculating means; and image generating means Image display means for displaying an image based on the display data generated in the step, image projection means for projecting the image displayed by the image display means as a virtual image, and the virtual image is projected at the position of the gazing point. And control means for controlling the projection distance of the virtual image.

[0011]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, a stereoscopic video display device embodying the present invention will be described with reference to the drawings. Note that display of an image generated from image data of an original image including a plurality of pixels and distance data for each pixel of the original image is used for displaying a stereoscopic video according to this embodiment. The image data and the distance data are normally generated by hardware and software of an existing device as described later.

<< Principle of Displaying Stereoscopic Video (FIGS. 1 to 4) >> First, the principle of displaying a stereoscopic video employed in this embodiment will be described. FIG. 1 shows the relationship between the display objects (apples and trees) viewed by the observer P and the projection distances L1 and L2. FIG. 2A shows an original image prepared for that purpose (this original image has It is assumed that there is no out-of-focus over the entire surface.). Consider a case where the observer P observes the video of the apple and the tree in the original image. When performing a stereoscopic display in which the distance from the observer P to the apple and the distance to the tree look different, in order to observe a natural three-dimensional image that is gentle to the eye E, the observer P's eye It is necessary to change the projection distance of the virtual image according to the distance at which E is focused (that is, the viewing distance of the observer P). Therefore, when the distance from the observer P to the apple is 2 m, the distance from the observer P to the tree is 50 m, and when the eye E is focused on the apple, the virtual image is set so that the projection distance (L1) becomes 2 m. Move S1 and the projection distance when the eye E is focused on the tree
The virtual image S2 is moved so that (L2) becomes 50 m.

At the same time, image processing for enhancing the stereoscopic effect is performed on the projected image. That is, the observer P is 2 m
When viewing the apple ahead, image processing is performed to show the apple clearly and blur the tree as shown in FIG. 2 (b).
As shown in (c), image processing is performed to clearly show the tree and blur the apple. As described above, when there are two or more display objects at different distances from the observer P in the original image, the perspective relation (that is, distance data) is detected for the pixels constituting each display object, and the observer P A stereoscopic image with a natural perspective is formed by out-of-focus display of a display object that is not viewed.

Further, when an apple and a tree are observed close to or overlapping with each other, the following image processing is performed. Figure 3 shows an image of an apple and a tree in close proximity,
FIG. 4 shows an image in which an apple and a tree overlap. 3 and 4, (a) is an original image, (b) is an image when the observer P is looking at an apple, and (c) is an image when the observer P is looking at a tree. It is a video.

When the observer P is looking at the apple 2 m away, as shown in a part E1 in FIGS. 3 (b) and 4 (b),
An out-of-focus image is generated such that a blurred tree edge in a distant view is observed without overlapping with a sharp apple in the near view. When the observer P is looking at a tree 50 m away, FIG.
As shown in FIG. 4 (c) and a portion E2 in FIG. 4 (c), an out-of-focus image is generated such that the edge of a blurred apple in the foreground is superimposed on a clear tree in the distant view. In this manner, when two or more display objects having different distances from the observer P are observed in close proximity or overlap, the perspective relationship (that is, distance data) is detected for the pixels constituting each display object, By performing overlapped display only when the display object to be out of focus is in the foreground, a more natural stereoscopic image with a perspective is formed.

<< Basic Configuration / Display Procedure of Embodiment (FIGS. 5 and 6) >> Next, the basic configuration of a stereoscopic video display apparatus embodying the present invention will be described for one eye side. The main components are a focus measuring device 1, an image generating device 2, a display device (a two-dimensional display device such as a liquid crystal panel), as shown in FIG.
An eyepiece optical system 4 and a variable projection distance mechanism 5.

The focus measuring device 1 detects the refractive power of the eye E of the observer P and, based on the refractive power, the viewing distance from the eye E to the point of interest (in other words, the eye E is focused. This is a detection means for calculating and outputting the position of the point of interest. From the detected viewing distance, it is possible to know how many meters the observer P is looking ahead.

The image generating device 2 generates display data C (n) of an image subjected to out-of-focus processing, which will be described later, based on the visual distance detected by the focus measuring device 1, the image data, and the distance data. It is a generating means. The display element 3
This is an image display unit that displays an image based on the display data C (n) generated by the image generation device 2.

The eyepiece optical system 4 is image projection means for projecting an image displayed on the display element 3 as a virtual image. The projection distance variable mechanism 5 is a display object (for example, an apple or a tree) in the original image.
Is a control means for controlling the projection distance L of the virtual image by auto-focus so that the virtual image is moved to the near and far positions without changing the angle of view or the position of the virtual image and the virtual image is projected at the position of the gazing point of the eye E.

The basic algorithm shown in FIG. 6 shows a display procedure performed using the above components. First, the viewing distance of the eye E is detected by the focus measuring device 1 (# 10).
From the detected viewing distance and the distance data for each pixel of the original image, the degree of out-of-focus of each pixel (amount of out-of-focus) is calculated, and based on the result, the image data of the original image is subjected to out-of-focus processing. Generate display data of (2
0). Then, the display data of the image subjected to the out-of-focus processing is displayed on the display element 3, the image is projected as a virtual image by the eyepiece optical system 4, and the virtual image is projected to the position of the gazing point by the variable projection distance mechanism 5 ( $ 30).

<< Out-of-focus processing (FIGS. 7 to 12) >> Next, out-of-focus processing performed by the image generating apparatus 2 (FIG. 5) will be described. An original image composed of N pixels is prepared, and numbers 1 to N are assigned to each pixel, and the number of an arbitrary pixel is set to n.
The original image video {(a) in FIGS. 2 to 4} includes image data A (n) composed of color information, luminance information, and the like, for each pixel n of the original image, and data from the pupil EP to the display object. And distance data B (n) representing the distance. For example, when the apple shown in FIG. 7 is displayed, color information and luminance information of the apple to be displayed are stored in the image data A (n), and distance information of 2 m is stored in the distance data B (n). {However, it is assumed that the value of B (n) increases as the distance increases (farther). }.

In the defocusing process (FIG. 8), the display data C (n) calculated from the data A (n) and B (n) and the projection distance L of the virtual image (that is, the visual distance of the eye E) is Used for image display by the display element 3. This display data C
The out-of-focus processing for calculating (n) is sequentially performed for all pixels 1 to N of the original image as described later (FIG. 9). The data A (n) and C (n) generally have three primary colors.
(R, G, B) can be represented by each luminance information.

Hereinafter, the procedure of the out-of-focus processing for the pixel n will be described with reference to the flowchart of FIG. It is assumed that information of zero luminance is input to C (n) as an initial value before the out-of-focus processing. First, after initializing the pixel number (# 10, n = 1), the blur amount rn of the image for the pixel n is calculated (# 20).

Here, a method of calculating the blur amount rn will be described with reference to FIG. Each symbol in FIG. 10 is defined as follows. I: Image plane on the retina of eye E of observer P. EP: pupil of eye E of observer P. r: radius of pupil EP of observer P. S: a virtual image plane observed through the eyepiece optical system 4. R: radius of the blurred image on the virtual image plane S. OP: An object point where the pixel n for which the blur amount rn is to be calculated is spatially arranged. H: distance from pupil EP of observer P to object point OP (from distance data B (n)). L: distance from pupil EP of observer P to virtual image plane S (from focus measuring device 1).

When the object point OP is an ideal point image, the virtual image plane S
The size of the blur of the object point OP observed in the virtual image plane S is represented by the radius of the blur image on the virtual image plane S: R = | r × (HL) / H |. When this is converted into an angle display (radian), the magnitude (radius) of the blur amount is rn = │2r (HL) / LH│ (radian). Here, as for the radius r of the pupil EP in the actual calculation, the actual pupil diameter of the observer P may be measured, or a predetermined numerical value (for example, 1 mm to 5 mm) may be used.

Returning to the flowchart of FIG. 9, a region where the blur of the pixel n overlaps with the pixels located around the pixel (hereinafter, also referred to as "peripheral pixels") is obtained (#
30). As shown in FIG. 11, when an optical system configured to observe an image on the display element 3 with the eye E placed near the focal position of the eyepiece optical system 2 (f: focal length) is displayed. The distance p on the element 3 apparently corresponds to p / f (radian). Therefore, as shown in FIG. 12, a distance from a pixel n to an arbitrary pixel located therearound is defined by a distance d between the center of the pixel n and the center of the arbitrary pixel. Surrounding pixels at positions satisfying f <rn
It is defined as a peripheral pixel located in a region where the pixel n is out of focus and the blur overlaps the above-mentioned arbitrary pixel (that is, a region corresponding to the out-of-focus amount). The numbers of the peripheral pixels corresponding to this definition are obtained, and the peripheral pixels are referred to as x (1), x (2),..., X (m) in ascending order of the numbers. FIG.
In step # 40, the initial setting of the peripheral pixel number k (k =
After performing 1), the obtained m peripheral pixels x (1) to x (x)
For (m), the following processing from x (1) to x (m) in order
(# 50 to # 100).

It is determined whether the peripheral pixel x (k) is the same as the pixel n (# 50). When the peripheral pixel x (k) is different from the pixel n, the distance data B (x (k)) of the peripheral pixel x (k) located around the pixel n and the distance data B (n) of the pixel n to be overlapped ) And (# 70). This judgment (# 70)
Then, when B (x (k)) and B (n) have substantially the same value {for example, when the difference in the distance between B (x (k)) and B (n) is 10 mm or less}, FIG. The number of digits of the distance data is limited and the comparison operation of the distance data is performed so that blurring overlaps as shown in FIG. 3 (c) and FIG. 4 (c) occur. Limitation of the number of digits of the distance data is performed, for example, by truncating digits of 10 mm or less.

If it is determined in step # 70 that the pixel n is closer to the front than the peripheral pixel x (k), {B (x (k)) ≧
B (n)}, the luminance information of the three primary colors C (x (k)) is [A
(n) luminance information / m] (# 80). As a result, the luminance of the pixel n is uniformly distributed to the m peripheral pixels x (1) to x (m). That is, here, the image data A (n)
Is divided by the number (m) of the peripheral pixels x (1) to x (m) and added together, so that the m out of focus peripheral pixels x (1) to x (m) are gathered and the original The luminance is set to be the same as the luminance of the image data A (n). By this processing, FIG.
As shown in FIG. 4 (c) and FIG. 4 (c), an image in which the apple is blurred into the edge of the tree and overlapped is observed.

On the other hand, when it is determined in step # 70 that the peripheral pixel x (k) is closer to the front than the pixel n, {B (x
(k)) <B (n)}, C (x (k)) is not changed. C
By keeping (x (k)) unchanged, FIG.
As shown in (b), a sharp apple edge is clearly observed in front of the blurred tree. As described above, only when the pixel n to be out-of-focus is located closer to the observer P than the original unfocused peripheral pixel x (k), the overlap of the blur is
{FIG. 3 (c), FIG. 4 (c)} are generated.

When it is determined in step # 50 that the neighboring pixel x (k) is the same as the pixel n, the stored luminance information of A (n) is stored in C (n) already stored without comparing the distance data. / M] (# 60). In step # 90, k =
m (# 50 to # 100)
The above processing (# 20) is performed until n = N in step # 110.
To # 120), display data C (n) is generated for all pixels from 1 to N. An image is displayed on the display element 3 based on the obtained display data C (n), and the observer P observes an out-of-focus image through the eyepiece optical system 4.

As described above, the image generating device 2 performs
Out-of-focus amount r for each pixel of {(a)} in FIGS.
n is obtained from the distance data B (n) and the viewing distance L (# 2
0), the distance data B (n) for each pixel n is compared with the distance data B (x (k)) for the surrounding pixel x (k) (#
70), the display data C (x) of the peripheral pixel x (k) only for the pixel n having the distance data B (n) closer to the observer P than the peripheral pixel x (k) so that the pixel n is out of focus.
(k)) is processed (# 80). This process (# 80)
In the example, the luminance information of the image data A (n) is distributed to a plurality of peripheral pixels x (k) determined based on the viewing distance L and the distance data B (n), and the observer P is more likely than the peripheral pixels x (k). Pixel n having distance data B (n) far from
(# 80) is not performed. By performing the out-of-focus processing on the image data A (n) and the distance data B (n) generated in advance in this way, the stereoscopic effect of the stereoscopic video can be improved.

The image data A used for the out-of-focus processing
(n) and the distance data B (n) have been conventionally used for various stereoscopic video displays. For example, a video captured by a three-dimensional scanner has distance data of each pixel constituting the image together with the image data. According to the present embodiment, natural stereoscopic video observation is possible even with such images. In a computer or a game machine that generates three-dimensional graphics, distance data of each pixel is generated in the process of generating image data, and the distance data is stored in a memory called a Z buffer. Therefore, according to the present embodiment, it is possible to observe a natural stereoscopic image by utilizing the hardware and software of the existing devices.

<< Optical Configuration of Laser Scanning HMD (FIG. 1)
3) >> FIG. 13 shows a laser scanning type H according to the present invention.
1 shows an optical configuration of an MD. The HMD includes a display unit 10 constituting image display means and control means, a half mirror 16 and a concave mirror 17 constituting image projection means (eyepiece optical system), an infrared transmission filter 18 and focus adjustment constituting detection means. A detection unit 19. Then, instead of the two-dimensional display element 3 (FIG. 5) in the above-described stereoscopic video display device, a laser scanning device 14 or the like is used as an image display means.

The display unit 10 collects laser light emitted from the laser light source 11 (including a driver) that emits laser light based on the display data generated by the image generating device 2 (FIG. 5). It comprises a light-collecting lens 12, a focusing device (for example, composed of a linear motor or the like) 13, a laser scanning device (for example, composed of a polygon mirror, a galvano mirror, etc.) 14, and a half mirror 15. Image display means for displaying an image based on the display data includes a laser light source 11, a condenser lens 12, a laser scanning device 14, and a half mirror 15. The control means for controlling the distance between the laser light source 11 and the condenser lens 12 so that a virtual image is projected at the position of the gazing point of the eye E is constituted by the condenser lens 12 and the focusing device 13. I have.

The laser light from the laser light source 11 is converged by the condenser lens 12 and passes through the half mirror 15. The condenser lens 12 is coupled to a focusing device 13 and is driven in the optical axis direction according to a control signal from the focusing device 13. The laser beam transmitted through the half mirror 15 is
Dimensionally scanned to form an intermediate image. Laser light emitted from the laser scanning device 14 is reflected by the half mirror 15 and travels to the half mirror 16. Then, the laser beam is reflected by the half mirror 16 and the concave mirror 17 and transmitted through the half mirror 16, and then guided to the position of the pupil EP of the observer P.

As described above, the eyepiece optical system including the half mirror 16 and the concave mirror 17 projects the intermediate image formed by the laser scanning device 14 as a virtual image. Concave mirror 1
The reflective surface 7 has a spherical shape with the pupil EP position as the center, and the laser scanning device 14 is disposed at a position substantially equivalent to the spherical center of the reflective surface of the concave mirror 17. A substantially spherical intermediate image is formed by the display unit 10, and the intermediate image and the reflecting surface of the concave mirror 17 are substantially concentric.

The focus adjustment detection unit 19 disposed below the half mirror 16 projects an infrared index onto the retina of the eye E, and measures the contrast to measure the contrast.
The focus adjustment is detected, and the viewing distance is obtained from the detection result. The optical path from the focus adjustment detection unit 19 to the eye E is bent by the half mirror 16, but in order to avoid laser light that directly enters the focus adjustment detection unit 19 from the display unit 10 through the half mirror 16, An infrared transmission filter 18 that transmits only infrared light is disposed between the mirror 16 and the focus adjustment detection unit 19. The infrared transmission filter 18 can reduce noise.

Focusing is performed by the focusing device 1
3 is performed by moving the condenser lens 12, but even if the virtual image position is adjusted by focusing, the apparent size of the image (image point position on the retina) determined by the scanning angle of the laser scanning device 14 changes. do not do. By moving the small condenser lens 12 in this manner, the position of the virtual image can be adjusted without changing the size of the image, so that the entire stereoscopic image display device can be made very small. The HMD has a configuration in which a laser light source 11 is provided in the display unit 10.
0, a light source unit is provided, light (R, G, B) from three laser light sources is input to the fiber, and the output end face of the fiber is arranged at the light source position in FIG. Can be achieved.

When a two-dimensional display element (such as a liquid crystal panel) such as the display element 3 (FIG. 5) is used, the display element 3 and the eyepiece optical system 4 are moved to change the projection distance L. . Due to the relatively large size of these components, it is not easy to move them with sufficient accuracy. Further, a complicated optical system is required in order to prevent image deterioration due to aberration when changing the distance between the display element 3 and the eyepiece optical system 4. As shown in FIG. 13, if a display device that performs display by laser scanning is used, relatively small components such as the laser light source 11 and the condenser lens 12 need to be moved, so that the projection distance L can be changed more easily and accurately. be able to. In addition, the eyepiece optical system 4 (FIG. 5) uses the half mirror 1
6 and the concave mirror 17, it is possible to perform projection without image deterioration despite its simple configuration.

<< Specific Configuration of Binocular HMD (FIG. 14) >> FIG. 14 shows an HM in which the HMD (FIG. 13) is configured for binocular vision.
D shows the appearance. This HMD is a display unit 1
An observation optical system including a half mirror 16, a half mirror 16 and a concave mirror 17 is provided for each of the left and right eyes, so that a stereoscopic image can be observed. The focus adjustment detection unit 19 is provided only on the right eye side.
The focusing device 13 is controlled based on the signal from the camera 9 to perform focusing on both the left and right eyes. Also,
Signal from focus adjustment detection unit 19 and image generation device 2
The out-of-focus processing described above is performed on the basis of the signal.

[0041]

As described above, according to the first to fourth aspects of the present invention, since a virtual image is projected at the position of the gazing point of the observer,
This has the effect of reducing the eye fatigue of the observer. In addition, since the image is subjected to out-of-focus processing according to the viewing distance, it is possible to observe a natural three-dimensional image with a sense of reality.

According to the second aspect, a natural perspective is obtained in which a clear foreground can be seen on the out-of-focus background, so that it is possible to observe a stereoscopic image with even more realism. This natural perspective display also has the effect of further reducing fatigue during stereoscopic video observation.

According to the third aspect of the invention, for example, the size of the condenser lens moved for focusing can be reduced, so that the entire apparatus can be made very small. In addition, since the eyepiece optical system can be constituted by a spherical mirror, a half mirror, or the like, only the projection distance can be changed without causing a displacement of the projected image on the retina in focusing. Moreover, good imaging performance can be obtained over the entire surface of the virtual image.

[Brief description of the drawings]

FIG. 1 is a schematic diagram for explaining a display principle employed in a stereoscopic video display device embodying the present invention.

FIG. 2 is a diagram showing an original image and a video to be observed in FIG. 1;

FIG. 3 is a diagram showing a state in which an out-of-focus image is generated for an original image in which a display object is in proximity.

FIG. 4 is a view showing a state of occurrence of an out-of-focus image for an original image in which display objects overlap.

FIG. 5 is a block diagram showing basic components of a stereoscopic video display device embodying the present invention.

FIG. 6 is a flowchart showing a basic algorithm of the stereoscopic video display device embodying the present invention.

FIG. 7 is a view for explaining image data and distance data of an original image.

FIG. 8 is a block diagram for explaining the process of out-of-focus processing.

FIG. 9 is a flowchart showing the procedure of out-of-focus processing applied to an image.

FIG. 10 is a diagram for explaining calculation of a blur amount.

FIG. 11 is a diagram for explaining an area where a blur of a certain pixel overlaps a neighboring pixel;

FIG. 12 is a diagram illustrating the blur of a pixel n in the vicinity of pixels x (1) to x (x)
The figure for demonstrating the area | region which overlaps with (m).

FIG. 13 is a longitudinal sectional view schematically showing an optical configuration of a laser scanning HMD embodying the present invention.

FIG. 14 is a perspective view schematically showing an external configuration of a binocular HMD embodying the present invention.

[Explanation of symbols]

 DESCRIPTION OF SYMBOLS 1 ... Focus measuring device 2 ... Image generation device 3 ... Display element 4 ... Eyepiece optical system 5 ... Projection distance variable mechanism 10 ... Display unit 11 ... Laser light source 12 ... Condensing lens 13 ... Focusing device 14 ... Laser scanning device 15 ... Half Mirror 16 Half mirror 17 Concave mirror 18 Infrared transmission filter 19 Focus detection unit

Claims (4)

[Claims] An apparatus for displaying a stereoscopic video based on display data of an image generated from image data of an original image including a plurality of pixels and distance data for each pixel of the original image. Detecting means for detecting the viewing distance from the observer's eye to the gazing point; based on the viewing distance detected by the detecting means and the image data and the distance data, display data of an image subjected to out-of-focus processing is obtained. Image generating means for generating, image displaying means for displaying an image based on the display data generated by the image generating means, image projecting means for projecting the image displayed by the image displaying means as a virtual image, Control means for controlling the projection distance of the virtual image so that the virtual image is projected at the position of the viewpoint. 2. The method according to claim 1, wherein in generating the display data, the image generating unit obtains an out-of-focus amount for each pixel of the original image from the distance data and the viewing distance, and obtains distance data for each pixel and a pixel value of the pixel. Compared with the distance data of the peripheral pixels located in the area corresponding to the out-of-focus amount, only the pixels having the distance data closer to the viewer than the peripheral pixels, the peripheral pixels so that the pixels are out of focus The stereoscopic video display device according to claim 1, wherein the display data is processed. 3. An apparatus for displaying a stereoscopic image, comprising: a detecting means for detecting a viewing distance from an observer's eye to a gazing point; and an out-of-focus processing according to the viewing distance detected by the detecting means. Generating means for generating display data of an image, a laser light source for emitting laser light based on the display data generated by the image generating means, and a condenser lens for condensing the laser light emitted from the laser light source Laser scanning means for two-dimensionally scanning the laser light condensed by the condenser lens to form an intermediate image; an eyepiece optical system for projecting the intermediate image formed by the laser scanning means as a virtual image; Control means for controlling a distance between the laser light source and the condenser lens such that the virtual image is projected at the position of the gazing point. Location. 4. An apparatus for displaying a stereoscopic image, comprising: a detecting means for detecting a refractive power of an observer's eye; and a refractive power detected by the detecting means for a visual distance from the observer's eye to a gazing point. Calculating means for calculating display data of the image subjected to the out-of-focus processing according to the viewing distance calculated by the calculating means; and display data generated by the image generating means. Image display means for displaying an image, image projection means for projecting the image displayed on the image display means as a virtual image, and control for controlling a projection distance of the virtual image so that the virtual image is projected at the position of the gazing point. Means, and a stereoscopic image display device characterized by comprising: