JP2011244349A - Display device and display method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To reduce the fatigue of the eyes of an observer.SOLUTION: This display device comprises: a display unit which displays images to allow the observer to observe a three-dimensional image; a detection unit which detects lights from the retinas of the observer's eyes to detect the focusing positions of the observer's eyes; and a blur control unit which blurs respective areas of the images to be displayed by the display unit according to the deviation of portions corresponding to the areas in the three-dimensional image from the focusing positions. The blur control unit blurs image data given to the display unit, and increases the blur with the increase of the deviation.

Description

  The present invention relates to a display device and a display method.

Patent Document 1 describes a stereoscopic display system that detects the gazing point of an observer, acquires the distance of an object displayed at the gazing point, and controls the focal length of the optical system according to the acquired distance. . In this stereoscopic display system, the distance of the focal point of the eye and the distance of the display object being watched by the observer can be matched to reduce the observer's fatigue associated with the stereoscopic view.
Patent Document 1: Japanese Patent Publication No. 6-85590 Patent Document 2: Japanese Patent Application Laid-Open No. 2007-4471

  By the way, an object at a different distance from the object displayed at the gazing point is also displayed in the display screen. Therefore, in such a stereoscopic display system, an object with a different distance from the object displayed at the gazing point must be observed at a different focal length, which causes fatigue to the observer.

  In order to solve the above-mentioned problem, in the first aspect of the present invention, a display unit that displays an image and allows an observer to observe a stereoscopic image, a detection unit that detects a focus position of the observer's eyes, A display device comprising: a blur control unit that causes each region of an image displayed by the display unit to blur according to a shift amount between a portion corresponding to the region in the stereoscopic image and the focus position; and Provide a display method.

  It should be noted that the above summary of the invention does not enumerate all the necessary features of the present invention. In addition, a sub-combination of these feature groups can also be an invention.

The structure of the display apparatus 10 which concerns on this embodiment is shown. In the display device 10 of the present embodiment, an example of the line of sight when the focus position H of the observer's eye is on the near side of the point P on the stereoscopic image 100 generated by the display unit 12 is shown. In the display device 10 of the present embodiment, the line of sight when the focus position H of the viewer's eyes is on the near side of the point P on the stereoscopic image 100 generated by the display unit 12 and on the display unit 12. An example is shown. In the display device 10 according to the present embodiment, an example of a line of sight when the focus position H of the eye of the observer matches the point P on the stereoscopic image 100 generated by the display unit 12 is shown. In the display device 10 of the present embodiment, an example of a line of sight when the focus position H of the observer's eye is on the back side of the point P of the stereoscopic image 100 generated by the display unit 12 is shown. In the state of FIG. 2, an example of the image of the part corresponding to the point P displayed by the display part 12 is shown. 3 shows an example of an image of a portion corresponding to the point P displayed by the display unit 12 in the state of FIG. In the state of FIG. 4, an example of the image of the part corresponding to the point P displayed by the display part 12 is shown. In the state of FIG. 5, an example of the image of the part corresponding to the point P displayed by the display part 12 is shown. The configuration of the first example of the detection unit 16 according to the present embodiment and an example of the optical path of the adjustment light from the detection unit 16 according to the first example toward the retina 34 of the eye 30 are shown. The structure of the 1st example of the detection part 16 which concerns on this embodiment, and an example of the optical path of the adjustment light reflected by the retina 34 of the eye 30 which goes to the detection part 16 which concerns on the 1st example from the eye 30 are shown. The relationship of the diameter d of the spot Sp at the predetermined position of the adjustment light reflected from the retina 34 of the observer's eye 30 with respect to the movement position X of the adjustment optical system 40 according to the first example is shown. The configuration of the second example of the detection unit 16 according to the present embodiment and an example of the optical path of the adjustment light from the detection unit 16 according to the second example toward the retina 34 of the eye 30 are shown. The configuration of the second example of the detection unit 16 according to the present embodiment and an example of the optical path of the adjustment light reflected by the retina 34 of the eye 30 from the eye 30 toward the detection unit 16 according to the second example are shown. In the detection unit 16 according to the second example of the present embodiment, (a) the optical conjugate position of the observer's eye 30 with the retina 34 is on the front side of the light receiving surface of the spot detection unit 52, and (b) An example of the diameter d1 of the first adjustment light spot Sp1 and the diameter d2 of the second adjustment light spot Sp2 detected by the adjustment optical system 40 in the case of being on the rear side is shown. The diameter d1 of the first adjustment light spot Sp1 reflected from the retina 34 of the observer's eye 30 with respect to the movement position X of the adjustment optical system 40 according to the second example of the present embodiment and the spot of the second adjustment light The relationship of the diameter d2 of Sp2 and the difference (d2-d1) between the diameter d1 and the diameter d2 is shown. The structure of the display apparatus 10 which concerns on the 1st modification of this embodiment is shown. The structure of the display apparatus 10 which concerns on the 2nd modification of this embodiment is shown. In the display device 10 according to the second modification of the present embodiment, an example of the focus position H of the observer's eye 30 when the observer is gazing at the point P of the stereoscopic image 100 is shown. The structure of the 1st example of the detection part 16 which concerns on the 2nd modification of this embodiment, and an example of the optical path of the adjustment light which goes to the retina 34 of the eye 30 from the detection part 16 which concerns on a 1st example are shown. The configuration of the first example of the detection unit 16 according to the second modification of the present embodiment, and the optical path of the adjustment light reflected by the retina 34 of the eye 30 from the eye 30 toward the detection unit 16 according to the first example. An example is shown. The structure of the 2nd example of the detection part 16 which concerns on the 2nd modification of this embodiment, and an example of the optical path of the adjustment light which goes to the retina 34 of the eye 30 from the detection part 16 which concerns on a 2nd example are shown. The configuration of the second example of the detection unit 16 according to the second modification of the present embodiment, and the optical path of the adjustment light reflected by the retina 34 of the eye 30 from the eye 30 toward the detection unit 16 according to the second example. An example is shown. The structure of the display apparatus 10 which concerns on the 3rd modification of this embodiment is shown. An example of the configuration of the detection unit 16 according to a third modification and an example of a line of sight when the focus position H of the observer's eye is on the near side of the point P on the stereoscopic image 100 are shown. An example of the configuration of the detection unit 16 according to the third modification, and a case where the focus position H of the observer's eyes is on the near side of the point P on the stereoscopic image 100 and is on the far side of the focus position of FIG. An example of the line of sight is shown. An example of the structure of the detection part 16 which concerns on a 3rd modification, and an example of a line of sight when the focus position H of an observer's eyes correspond to the point P on the three-dimensional image 100 are shown. An example of the configuration of the detection unit 16 according to the third modification and an example of a line of sight when the focus position H of the observer's eye is behind the point P of the stereoscopic image 100 generated by the display unit 12 are shown. . In the display apparatus 10 which concerns on the 3rd modification of this embodiment, the display position on the display surface 22 of the image corresponding to the point P of a three-dimensional image is shown. The structure of the display apparatus 10 which concerns on the 4th modification of this embodiment is shown. An example of a focus position and convergence of an observer's eye in the case of observing the three-dimensional image 100 produced | generated by the display apparatus 10 which concerns on the 4th modification of this embodiment is shown. In the fourth modification of the present embodiment, an example of the imaging direction and the focal position of the imaging unit 98-R for the right eye and the imaging unit 98-L for the left eye is shown.

  Hereinafter, the present invention will be described through embodiments of the invention, but the following embodiments do not limit the invention according to the claims. In addition, not all the combinations of features described in the embodiments are essential for the solving means of the invention.

  FIG. 1 shows a configuration of a display device 10 according to the present embodiment. The display device 10 according to the present embodiment provides an image for a right eye to an observer's right eye, an image for a left eye to an observer's left eye, and provides an image that is stereoscopically recognized by the observer. .

  The display device 10 includes a display unit 12, an output unit 14, a detection unit 16, and a blur control unit 18. The display unit 12 displays the image for the right eye and the image for the left eye to allow the observer to observe the stereoscopic image.

  For example, the display unit 12 includes a display surface 22 and a lenticular lens array 24. On the display surface 22, a right eye region for displaying a right eye image and a left eye region for displaying a left eye image are alternately arranged.

  The lenticular lens array 24 refracts the light output from the right eye region of the display surface 22 in the direction of the viewer's right eye and irradiates only the right eye to the viewer. The lenticular lens array 24 refracts the light output from the left eye region in the direction of the left eye of the observer and irradiates only the left eye to the observer. Such a display unit 12 can provide a stereoscopic image to a naked eye observer who does not wear dedicated glasses. The display unit 12 may have a parallax barrier instead of the lenticular lens array 24. The display unit 12 is not limited to the naked eye, and may be a device that displays a stereoscopic image to an observer wearing dedicated glasses.

  The output unit 14 outputs a right eye image and a left eye image. For example, the display unit 12 reproduces and outputs a right-eye image and a left-eye image from a signal read from a recording medium or a signal received from the outside.

  The detection unit 16 detects the focus position of the observer's eyes. As an example, the detection unit 16 includes a detection unit 16-R for the right eye and a detection unit 16-L for the left eye. The right-eye detection unit 16-R detects the focus position of the observer's right eye. The left-eye detection unit 16-L detects the focus position of the left eye of the observer.

  For example, the detection unit 16 applies adjustment light in an invisible wavelength region such as infrared light to the retina of the observer's eye, and detects the adjustment light reflected from the retina of the observer's eye. And the detection part 16 detects the focus position of an observer's eyes based on the detected adjustment light. As an example, the detection unit 16 applies adjustment light to the observer's eyes from the top or side of the display unit 12.

  Note that the detection unit 16 may detect the focus position of only one of the right eye and the left eye of the observer, and output only the focus position of one of the eyes as the focus position common to both eyes. Further, the display device 10 may detect the focus position of the right eye and the focus position of the left eye of the observer, respectively, and output the average focus position as a focus position common to both eyes.

  The blur control unit 18 causes each region of the image displayed by the display unit 12 to blur according to a shift amount between a portion corresponding to the region in the stereoscopic image and the focus position. In this case, as an example, when the amount of deviation is 0, the blur control unit 18 does not cause blur in the image in the area, that is, displays an image in focus in the area. And as an example, when the amount of deviation is not 0, the blur control unit 18 generates larger blur as the amount of deviation is larger.

  As an example, the blur control unit 18 calculates the amount of parallax between the image for the right eye and the image for the left eye for each region of the image displayed on the display surface 22, and corresponds to the region based on the calculated amount of parallax. The distance of the stereoscopic image is calculated. Then, the blur control unit 18 calculates a deviation amount for each region of the image displayed on the display surface 22 from the difference between the focus position detected by the detection unit 16 and the distance between the regions. Also, the blur control unit 18 receives distance information about each region of the image displayed on the display surface 22 from the output unit 14 together with the right-eye image and the left-eye image instead of calculating the parallax amount. Also good. In this case, the distance information is generated in advance, for example, when the right-eye image and the left-eye image are generated or imaged.

  Furthermore, as an example, the blur control unit 18 performs a blurring process on each area of the image displayed on the display surface 22 by a calculation by software based on the calculated shift amount. As an example, the blur control unit 18 performs a blurring process that increases the blur amount as the shift amount increases.

  Further, Patent Document 2 describes a method in which a plurality of images of regions having different exit pupils are photographed once for each pixel via a plurality of microlenses, and the overlapping positions of the plurality of images are changed and combined. Has been. According to this method, an object at a position designated from the outside can be focused, and an image blurred according to the distance from the designated position by an object other than the designated position can be displayed. The blur control unit 18 acquires images captured by the method described in Patent Document 2 as the right-eye image and the left-eye image, and focuses on the focus position of the eye detected by the detection unit 16. Output the image. Accordingly, the blur control unit 18 can cause each region of the image displayed by the display unit 12 to blur according to the amount of shift between the portion corresponding to the region in the stereoscopic image and the focus position.

  As described above, the display device 10 according to the present embodiment displays a stereoscopic image in which a blur is generated according to the amount of deviation from the focus position with respect to a portion having a distance different from the focus position of the observer's eye. be able to. Thus, according to the display device 10, for example, an image at a position different from the point of sight of the observer can be blurred to provide a three-dimensional image close to nature to the observer, thereby reducing fatigue of the observer's eyes. .

  FIG. 2 shows an example of a line of sight when the focus position H of the observer's eye is on the near side of the point P on the stereoscopic image 100 generated by the display unit 12 in the display device 10 of the present embodiment. FIG. 3 shows that the focus position H of the observer's eye is on the near side of the point P on the stereoscopic image 100 generated by the display unit 12 and on the display unit 12 in the display device 10 of the present embodiment. An example of the line of sight in the case is shown. FIG. 4 shows an example of a line of sight when the focus position H of the observer's eye matches the point P on the stereoscopic image 100 generated by the display unit 12 in the display device 10 of the present embodiment. FIG. 5 shows an example of the line of sight when the focus position H of the observer's eye is behind the point P of the stereoscopic image 100 generated by the display unit 12 in the display device 10 of the present embodiment.

  The focus position H of the observer's eye moves back and forth according to changes in the thickness of the crystalline lens. The focus position H of the observer's eye is, for example, from the viewer side (front side) as shown in FIG. 2, and from the display unit 12 as shown in FIG. Move far).

  The distance (deviation amount D) between an arbitrary point P on the stereoscopic image 100 and the focus position H of the observer's eye changes with the movement of the focus position H of the observer's eye. The shift amount D becomes 0 when the focus position H and the position of the point P coincide as shown in FIG. The deviation amount D increases as the focus position H moves away from the point P.

  FIG. 6 shows an example of an image of a portion corresponding to the point P displayed by the display unit 12 in the state of FIG. FIG. 7 shows an example of an image of a portion corresponding to the point P displayed by the display unit 12 in the state of FIG. FIG. 8 shows an example of an image of a portion corresponding to the point P displayed by the display unit 12 in the state of FIG. FIG. 9 shows an example of an image of a portion corresponding to the point P displayed by the display unit 12 in the state of FIG.

  For example, when the shift amount D is 0 as shown in FIG. 4, the display device 10 displays an image corresponding to the point P in a focused state as shown in FIG. 8, that is, without blur. On the other hand, the display device 10 displays an image corresponding to the point P in FIGS. 6, 7, and 9 when the amount of deviation is not 0 as shown in FIGS. 2, 3, and 5, for example. Are displayed in a state of defocusing, that is, in a blurred state.

  Here, the display device 10 displays a larger amount of blurring of the image corresponding to the point P as the displacement amount D is larger. For example, the shift amount D in FIG. 2 is larger than the shift amount D in FIG. Therefore, as shown in FIGS. 6 and 7, the display device 10 makes the blur amount corresponding to the shift amount D of FIG. 2 larger than the blur amount corresponding to the shift amount D of FIG.

  Further, the display device 10 blurs the image corresponding to the point P regardless of the direction of deviation between the focus position H and the point P. For example, the amount of deviation D in FIG. 3 and the amount of deviation D in FIG. Therefore, as shown in FIGS. 7 and 9, the display device 10 makes the blur amount corresponding to the shift amount D in FIG. 3 substantially the same as the blur amount corresponding to the shift amount D in FIG.

  In the initial state in which the stereoscopic image 100 is observed, the focus positions H of the right eye and the left eye almost coincide with the display surface of the display unit 12 as shown in FIG. However, in the state of FIG. 3, the image corresponding to the point P looks blurred as shown in FIG. 7, so the eyes adjust the focus to reduce the amount of blur.

  If the focus position H changes to the near side (right side in the figure), the image corresponding to the point P becomes the state shown in FIG. 6, and the amount of blur increases further. Conversely, when the focus position H changes to the back side (left side in the figure), the image corresponding to the point P becomes the state shown in FIG. 8, and the amount of blurring decreases. However, when the focus position H changes beyond the point P beyond the state shown in FIG. 8, the image corresponding to the point P changes to the state shown in FIG. 9 and the amount of blur increases again. Therefore, the eye stops performing the focus adjustment in the state of FIG. 8 in which the blur of the image corresponding to the point P is minimized.

  In this way, the display device 10 always matches the intersection (convergence position) of the line of sight of the right eye and the left eye with the focus position H at the point P and the position in the depth direction from the point P is different. Can show a blurred image according to the shift amount. Further, the above operation can be realized even with a single eye. Therefore, when there is no common image in the left and right parallax images, the display device 10 matches the focus position H with the gaze position of the stereoscopic image for the left and right eyes, and the position in the depth direction from the focus position H is the same. With respect to different three-dimensional image portions, it is possible to show an image in which a blur corresponding to the amount of deviation is generated.

  As described above, the display device 10 causes the observer to generate blur by matching the intersection (convergence position) of the line of sight of the right eye and the left eye and the amount of deviation from the focus position. A stereoscopic image close to nature can be provided to reduce eye fatigue.

  FIG. 10 shows an example of the configuration of the first example of the detection unit 16 according to the present embodiment and an optical path of adjustment light from the detection unit 16 according to the first example toward the retina 34 of the eye 30. FIG. 11 shows an example of the configuration of the first example of the detection unit 16 according to the present embodiment and the optical path of the adjustment light reflected by the retina 34 of the eye 30 from the eye 30 toward the detection unit 16 according to the first example. Indicates.

  The detection unit 16 according to this example includes an adjustment optical system 40, an adjustment lens 42, a movement control unit 44, and a calculation unit 46. The adjustment optical system 40 irradiates the retina 34 of the observer's eye 30 with adjustment light (for example, infrared light) in the invisible wavelength region output from the point light source. At the same time, the adjustment optical system 40 detects the spot diameter of the adjustment light reflected from the retina 34 of the observer's eye 30 at a predetermined position. As an example, the adjustment optical system 40 sets the diameter of the spot Sp of the adjustment light reflected from the retina 34 of the observer's eye 30 to the position of the point light source that outputs the adjustment light to the retina 34 of the observer's eye 30. Are detected at the same optical position.

  The adjustment optical system 40 includes, as an example, an adjustment light output unit 50, a spot detection unit 52, and a half mirror 54. The adjustment light output unit 50 outputs adjustment light to be given to the retina 34 of the observer's eye 30 from a point light source. The spot detector 52 detects the spot diameter of the adjustment light reflected from the retina 34 of the observer's eye 30. As an example, the spot detection unit 52 includes an image sensor and a spot diameter calculation unit that calculates a spot diameter by image processing from an image captured by the image sensor.

  The half mirror 54 gives the adjustment light output by the adjustment light output unit 50 to the retina 34 of the observer's eye 30 and also gives the adjustment light reflected from the retina 34 of the observer's eye 30 to the spot detection unit 52. . As an example, the half mirror 54 reflects (or transmits) the adjustment light output by the adjustment light output unit 50 in the direction toward the retina 34 of the eye 30 and spot-detects the light received from the direction of the retina 34 of the eye 30. It transmits (or reflects) in the direction of the part 52.

  In such an adjustment optical system 40, the light receiving position of the spot detection unit 52 is arranged such that the distance from the half mirror 54 is the same as the position of the point light source that outputs the adjustment light in the adjustment light output unit 50. Yes. As a result, the adjustment optical system 40 determines the spot diameter of the adjustment light reflected from the retina 34 of the observer's eye 30 and the position of the point light source that outputs the adjustment light to the retina 34 of the observer's eye 30 and the optics. In the same position.

  The adjustment lens 42 is provided in the optical path between the adjustment optical system 40 and the eye 30 of the observer. The adjustment lens 42 condenses adjustment light irradiated from the adjustment optical system 40 to the eye 30. For example, the adjustment lens 42 supplies adjustment light so that the focal point is positioned near the retina 34 of the eye 30.

  The movement control unit 44 moves the position of the adjustment optical system 40 back and forth along the optical path of the adjustment light so that the spot diameter detected by the adjustment optical system 40 has a predetermined size. As an example, the movement control unit 44 detects the spot diameter of the adjustment light reflected from the retina 34 at the optically same position as the position of the point light source that outputs the adjustment light to the retina 34 of the observer's eye 30. Then, the position of the adjustment optical system 40 is moved so as to minimize the detected spot diameter.

  The calculation unit 46 calculates the focus position of the observer's eye 30 based on the position of the adjustment optical system 40 with the spot diameter set to a predetermined size. For example, when the spot diameter is detected at the optically same position as the position of the point light source that outputs the adjustment light for the retina 34 of the eye 30 of the observer, the calculation unit 46 is in a state in which the detected spot diameter is minimized. Based on the position of the adjusting optical system 40, the focus position of the observer's eye 30 is calculated.

  FIG. 12 shows the relationship of the diameter d of the spot Sp at a predetermined position of the adjustment light reflected from the retina 34 of the observer's eye 30 with respect to the movement position X of the adjustment optical system 40 according to the first example. . When the diameter d of the spot Sp of the adjustment light reflected from the retina 34 of the observer's eye 30 is detected at the same optical position as the position of the point light source that outputs the adjustment light to the retina 34 of the observer's eye 30. To do.

  In this case, the position of the point light source that outputs the adjustment light in the adjustment light output unit 50 and the position of the retina 34 of the observer's eye 30 are in an optically conjugate relationship with the lens 32 and the adjustment lens 42 interposed therebetween. The diameter d of the spot Sp is minimized. On the other hand, the diameter d of the spot Sp increases as the position of the point light source that outputs the adjustment light in the adjustment light output unit 50 and the position of the retina 34 of the observer's eye 30 depart from an optically conjugate relationship. Become. Therefore, the movement control unit 44 controls the position of the adjustment optical system 40 so as to minimize the diameter d of the spot Sp, thereby adjusting the position of the point light source that outputs the adjustment light in the adjustment light output unit 50 and the observer's position. The position of the retina 34 of the eye 30 can be in an optically conjugate relationship with the lens 32 and the adjustment lens 42 interposed therebetween.

  Here, the focal length of the adjustment lens 42 is determined in advance at the time of manufacture. Accordingly, the calculation unit 46 of the adjustment optical system 40 in a state where the position of the point light source that outputs the adjustment light in the adjustment light output unit 50 and the position of the retina 34 of the observer's eye 30 are in an optically conjugate relationship. Based on the movement position, the thickness of the crystalline lens 32 of the eye 30, that is, the focus position of the eye 30, can be calculated.

  For example, the calculation unit 46 registers in advance a table indicating the focus position of the eye 30 corresponding to each of the movement positions of the adjustment optical system 40, and focuses the eye 30 based on the detected movement position of the adjustment optical system 40. Detect position. For example, the calculation unit 46 registers in advance an arithmetic expression representing the focus position of the eye 30 with respect to the movement position of the adjustment optical system 40, and detects the focus position of the eye 30 based on the arithmetic expression. In this way, the detection unit 16 according to this example can detect the focus position of the eye 30 of the observer.

  FIG. 13 shows an example of the configuration of the second example of the detection unit 16 according to the present embodiment, and an example of an optical path of adjustment light from the detection unit 16 according to the second example toward the retina 34 of the eye 30. FIG. 14 illustrates an example of the configuration of the second example of the detection unit 16 according to the present embodiment and the optical path of the adjustment light reflected from the retina 34 of the eye 30 toward the detection unit 16 according to the second example from the eye 30. Indicates. The detection unit 16 according to the second example illustrated in FIGS. 13 and 14 has substantially the same function and configuration as the detection unit 16 according to the first example illustrated in FIGS. 10 to 12. Constituent elements are denoted by the same reference numerals, and detailed description thereof is omitted except for differences.

  The adjustment light output unit 50 according to this example outputs the first adjustment light given to the retina 34 of the observer's eye 30 from the point light source, and the optical distance to the retina 34 of the observer's eye 30 is the first. The second adjustment light is output from a point light source different from the adjustment light. The adjustment light output unit 50 includes, as an example, a first point light source 60, a second point light source 62, and a parallel flat glass 64.

  The first point light source 60 outputs first adjustment light to be given to the retina 34 of the observer's eye 30. The second point light source 62 outputs second adjustment light to be given to the retina 34 of the observer's eye 30. The first point light source 60 and the second point light source 62 output light parallel to the optical axis of the half mirror 54. Moreover, the 1st point light source 60 and the 2nd point light source 62 are arrange | positioned as an example in the position where the physical distance from the half mirror 54 is the same.

  The parallel flat glass 64 is disposed between the second point light source 62 and the half mirror 54 so that the second adjustment light is incident on the incident surface at an angle of less than 90 degrees. The parallel flat glass 64 refracts and outputs the second adjustment light twice by two parallel surfaces. Therefore, the parallel flat glass 64 differs in the optical distance from the retina 34 of the observer's eye 30 to the first point light source 60 and the optical distance from the retina 34 of the observer's eye 30 to the second point light source 62. Can be a distance.

  The spot detection unit 52 has an optical distance from the retina 34 of the observer's eye 30 to the optical distance from the retina 34 of the observer's eye 30 to the first point light source 60 and from the retina 34 of the observer's eye 30. It is arranged at an intermediate position from the optical distance to the second point light source 62. Then, the spot detection unit 52 detects the spot diameter of the first adjustment light and the spot diameter of the second adjustment light reflected from the retina 34 of the eye 30 of the observer.

  The movement controller 44 moves the position of the adjustment optical system 40 along the optical path of the adjustment light so that the difference between the spot diameter of the first adjustment light and the spot diameter of the second adjustment light is a predetermined value. To move back and forth. Then, the calculation unit 46 determines the observer based on the position of the adjustment optical system 40 in a state where the difference between the spot diameter of the first adjustment light and the spot diameter of the second adjustment light is set to a predetermined value. The focus position of the eye 30 is calculated.

  For example, the optical distance from the retina 34 of the observer's eye 30 on the light receiving surface of the spot detection unit 52 is the optical distance from the retina 34 of the observer's eye 30 to the first point light source 60 and the observer's eye 30. It is assumed that it is arranged at an intermediate position from the optical distance from the retina 34 to the second point light source 62. In this case, the movement control unit 44 moves the position of the adjustment optical system 40 along the optical path of the adjustment light so that the difference between the spot diameter of the first adjustment light and the spot diameter of the second adjustment light is zero. Move back and forth. Then, the calculation unit 46 focuses the eye 30 of the observer based on the position of the adjustment optical system 40 in a state where the difference between the spot diameter of the first adjustment light and the spot diameter of the second adjustment light is zero. Calculate the position.

  FIG. 15 shows (a) the case where the optical conjugate position of the observer's eye 30 with the retina 34 is on the front side of the light receiving surface of the spot detection unit 52 in the detection unit 16 according to the second example of the present embodiment, and (B) An example of the diameter d1 of the spot Sp1 of the first adjustment light and the diameter d2 of the spot Sp2 of the second adjustment light detected by the adjustment optical system 40 in the rear side is shown. FIG. 16 shows the diameter d1 of the first adjustment light spot Sp1 reflected from the retina 34 of the eye 30 of the observer with respect to the movement position X of the adjustment optical system 40 according to the second example of the present embodiment. The relationship between the diameter d2 of the spot Sp2 of the adjustment light and the difference (d2-d1) between the diameter d1 and the diameter d2 is shown.

  Comparing the first adjustment light reflected from the retina 34 of the observer's eye 30 with the second adjustment light, the second adjustment light is more in the observer's eye 30 than the first adjustment light. The light is condensed at a position far from the retina 34. Accordingly, the movement position of the adjustment optical system 40 that minimizes the spot diameter d1 of the first adjustment light and the movement position of the adjustment optical system 40 that minimizes the spot diameter d2 of the second adjustment light. In the middle, by controlling the adjustment optical system 40, the position of the light receiving surface of the spot detection unit 52 and the position of the retina 34 of the observer's eye 30 are optically conjugated with the lens 32 and the adjustment lens 42 interposed therebetween. Relationship.

  Therefore, the calculation unit 46 moves the adjustment optical system 40 in a state where the difference between the spot diameter d1 of the first adjustment light and the spot diameter d2 of the second adjustment light is set to a predetermined value (for example, 0). Based on the above, the thickness of the crystalline lens 32 of the eye 30, that is, the focus position of the eye 30 can be calculated. Thereby, the detection unit 16 according to this example can detect the focus position of the eye 30 of the observer.

  In particular, in the detection unit 16 according to the present example, the sign of the difference between the spot diameter d1 of the first adjustment light and the spot diameter d2 of the second adjustment light indicates the target position of the movement position of the adjustment optical system 40. Flip between. Therefore, the detection unit 16 according to this example can control the movement position of the adjustment optical system 40 by servo control.

  FIG. 17 shows a configuration of the display device 10 according to a first modification of the present embodiment. Since the display device 10 according to the first modification has substantially the same function and configuration as the display device 10 according to the present embodiment shown in FIG. 1, hereinafter, the same components are denoted by the same reference numerals and are different. Detailed description is omitted except for this point.

  The display device 10 according to this modification provides a different stereoscopic image to each of a plurality of observers. As an example, the display device 10 provides each of a plurality of viewers viewing from different viewpoints with a stereoscopic image corresponding to the viewpoint. The output unit 14 according to this modification outputs a right eye image and a left eye image corresponding to each of a plurality of observers (viewpoints). The display unit 12 gives the right eye image and the left eye image corresponding to the viewpoints to the right eye and the left eye of the observers of the plurality of viewpoints.

  Furthermore, the display device 10 according to the present modification includes a plurality of detection units 16 corresponding to a plurality of observers. Each of the plurality of detection units 16 detects the focus position of the corresponding observer's eye.

  The blur control unit 18 determines each area of the image to be displayed for each of the plurality of observers according to a shift amount between a portion corresponding to the area in the stereoscopic image and the focus position of the corresponding observer's eyes. Cause blur. According to the display device 10 as described above, for each of a plurality of viewers, the intersection of the line of sight of the right eye and the left eye (the position of convergence) matches the focus position, and a portion having a distance different from the focus position of the eye On the other hand, it is possible to display a stereoscopic image in which a blur is generated according to the amount of deviation from the focus position. Therefore, according to the display device 10, it is possible to provide a natural stereoscopic image to each of a plurality of observers and reduce eye fatigue.

  FIG. 18 shows a configuration of the display device 10 according to a second modification of the present embodiment. Since the display device 10 according to the second modification has substantially the same function and configuration as the display device 10 according to the present embodiment shown in FIG. 1, hereinafter, the same components are denoted by the same reference numerals and are different. Detailed description is omitted except for this point.

  The display device 10 according to the present modification provides separate images to the observer's right eye and left eye, and provides the observer with a stereoscopically recognized image. The display device 10 according to this modification includes an output unit 14, a right-eye display surface 22-R, a left-eye display surface 22-L, a right-eye optical system 70-R, and a left-eye. Optical system 70-L, right-eye detection unit 16-R, left-eye detection unit 16-L, control unit 72, right-eye blur control unit 18-R, and left eye A blur control unit 18-L.

  The right-eye display surface 22-R displays a right-eye image to be displayed on the observer's right eye. The left-eye display surface 22-L displays a left-eye image to be displayed on the left eye of the observer. The display surface 22-R for the right eye and the display surface 22-L for the left eye are separate display panels, for example. The right-eye display surface 22-R and the left-eye display surface 22-L are different in that they are for the right eye or the left eye, but have the same functions and configurations in other points. Therefore, when the description is made without distinguishing both, the display surface 22 is simply referred to.

  The right-eye optical system 70-R generates a virtual image of the right-eye display surface 22-R and gives the virtual image to the observer's right eye. The left-eye optical system 70-L generates a virtual image of the left-eye display surface 22-L and gives it to the left eye of the observer. Note that the optical system 70-R for the right eye and the optical system 70-L for the left eye are different in that they are for the right eye or the left eye, but otherwise have the same functions and configurations. Therefore, when the description is made without distinguishing both, the optical system 70 is simply referred to.

  The optical system 70 includes a virtual image generation optical system that generates a virtual image of the display surface 22. In this example, the optical system 70 includes a lens 74 as a virtual image generating optical system. The virtual image generation optical system may be a reflection optical system.

  Furthermore, one or both of the display surface 22 and the optical system 70 can change the relative positions of each other in the optical axis direction. For example, one or both of the display surface 22 and the lens 74 of the optical system 70 can move in the optical axis direction.

  The right-eye detector 16-R detects an optical conjugate position with the retina of the observer's right eye. In this case, if the detection unit 16-R for the right eye can detect the positional relationship between the lens 74 and the display surface 22-R for the right eye, the optical conjugate position with the retina of the right eye of the observer. And the position of the right-eye display surface 22-R can be detected. In the present embodiment, the detection unit 16-R for the right eye detects light from the retina of the viewer's right eye, and based on the detected light, an optical conjugate position with the retina of the viewer's right eye And the amount of deviation from the position of the display surface 22-R for the right eye is detected.

  For example, the detection unit 16-R for the right eye supplies invisible adjustment light such as infrared light to the retina of the right eye of the observer via the right-eye optical system 70-R, and the retina of the right eye. The adjustment light reflected from the light is received through the optical system 70-R for the right eye. Then, the detection unit 16-R for the right eye detects an optical conjugate position with the retina of the right eye based on the received adjustment light.

  The left-eye detector 16-L detects an optical conjugate position with the retina of the left eye of the observer. In this case, if the detection unit 16-L for the left eye can detect the positional relationship between the lens 74 and the display surface 22-L for the left eye, the optical conjugate position with the retina of the left eye of the observer And the position of the left-eye display surface 22-L are detected. In the present embodiment, the detection unit 16-L for the left eye detects light from the retina of the viewer's left eye, and optically conjugates with the retina of the viewer's left eye based on the detected light. The position is detected, and the amount of deviation from the position of the left eye display surface 22-L is detected.

  For example, the left-eye detection unit 16-L applies invisible adjustment light such as infrared light to the left-eye retina of the observer via the left-eye optical system 70-L, and the left-eye retina. The adjustment light reflected from the light is received through the left-eye optical system 70-L. Then, the detection unit 16-L for the left eye detects an optical conjugate position with the retina of the left eye based on the received adjustment light.

  The right-eye detection unit 16-R and the left-eye detection unit 16-L are different in that they are for the right eye or the left eye, but are otherwise identical in function and configuration. Have. Therefore, when the detection unit 16-R for the right eye and the detection unit 16-L for the left eye are described without being distinguished, they are simply referred to as the detection unit 16.

  The control unit 72 controls the position of at least one of the optical system 70-R for the right eye and the display surface 22-R for the right eye based on the detection result of the detection unit 16-R for the right eye. The display surface 22-R for the eye and the retina of the right eye are kept in an optically conjugate relationship. As an example, the control unit 72 uses the lens of the right-eye optical system 70-R so that the amount of deviation between the right-eye display surface 22-R and the optical conjugate position of the right-eye retina becomes zero. 74 and the position of at least one of the right-eye display surfaces 22-R in the optical axis direction are moved.

  The control unit 72 controls the position of at least one of the left-eye optical system 70-L and the left-eye display surface 22-L based on the detection result of the left-eye detection unit 16-L. The left-eye display surface 22-L and the left-eye retina are maintained in an optically conjugate relationship. As an example, the control unit 72 uses the lens of the left-eye optical system 70-L so that the deviation amount between the left-eye display surface 22-L and the optical conjugate position of the left-eye retina becomes zero. The position in the optical axis direction of at least one of the display surface 22-L for 74 and the left eye is moved.

  The right-eye blur control unit 18-R is configured to display each region of the image displayed on the right-eye display surface 22-R, and a focus position of the portion corresponding to the region in the stereoscopic image and the right eye of the observer. Blur is generated according to the amount of deviation. In this case, the right-eye blur control unit 18-R, for example, the right-eye optical system 70 in a state where the right-eye display surface 22-R and the right-eye retina are maintained in an optically conjugate relationship. Based on the position of -R and the display surface 22-R for the right eye, each region of the image displayed on the display surface 22-R for the right eye is divided into a portion corresponding to the region in the stereoscopic image and the viewer's Blur is generated according to the amount of deviation from the focus position of the right eye.

  The blur control unit 18-L for the left eye converts each region of the image displayed on the display surface 22-L for the left eye into a portion corresponding to the region in the stereoscopic image and the focus position of the left eye of the observer. Blur is generated according to the amount of deviation. In this case, the left-eye blur control unit 18-L, for example, the left-eye optical system 70 in a state where the left-eye display surface 22-L and the left-eye retina are maintained in an optically conjugate relationship. Based on the positions of the display surface 22-L for -L and the left eye, each region of the image displayed on the display surface 22-L for the left eye is divided into a portion corresponding to the region in the stereoscopic image, and the viewer's Blur is generated according to the amount of deviation from the focus position of the left eye.

  The blur control unit 18-R for the right eye and the blur control unit 18-L for the left eye are different in that they are for the right eye or the left eye, but are otherwise identical in function and function. It has a configuration. When the blur control unit 18-R for the right eye and the blur control unit 18-L for the left eye are described without being distinguished, they are simply referred to as the blur control unit 18.

  By the detection unit 16-R for the right eye and the detection unit 16-L for the left eye, the focus position H of the right eye and the left eye coincides with the position of the virtual image on the display surface 22 formed by the lens 74. However, in the initial state of observing the stereoscopic image 100, the point P of the stereoscopic image 100 and the position of the virtual image formed by the lens 74 are out of alignment, so the image corresponding to the point P appears blurred. If it is assumed that the image is blurred as shown in FIG. 7 in the initial state, the eye performs focus adjustment so as to reduce the amount of blur.

  If the focus position H of the right eye and the left eye changes toward the eye, the position of the virtual image of the lens 74 also changes toward the eye, and accordingly the right-eye blur control unit 18-R. The left-eye blur control unit 18-L increases the blur amount of the image corresponding to the point P as in the state of FIG. Conversely, when the focus position H of the right eye and the left eye changes away from the eye, the position of the virtual image of the lens 74 also changes away from the eye, and accordingly the right eye blur control unit 18- The blur control unit 18-L for R and the left eye reduces the blur amount of the image corresponding to the point P as in the state of FIG. However, when the focus position H of the right eye and the left eye changes beyond the point P beyond the state of FIG. 8, the right eye blur control unit 18-R and the left eye blur control unit. 18-L increases the blur amount of the image corresponding to the point P as in the state of FIG. Therefore, the eye stops performing the focus adjustment in the state of FIG. 8 in which the blur of the image corresponding to the point P is minimized.

  As described above, the display device 10 always matches the recognition position by binocular parallax with the focus position H at the point P of the stereoscopic image 100 and the position of the position in the depth direction is different from the point P. It is possible to show an image in which a blur is generated according to.

  The display device 10 as described above gives an image for the right eye to the right eye of the observer and an image for the left eye to the left eye of the observer. Thereby, according to the display apparatus 10, a three-dimensional image can be provided to an observer. Furthermore, according to the display device 10, the focus position of an image whose distance between the intersection of the line of sight of the right eye and the left eye (the position of convergence) is different from the focus position of the observer's eye is the focus position. The blur can be generated according to the amount of deviation from the. Therefore, according to the display device 10, a three-dimensional image close to nature can be provided to the observer, and eye fatigue can be reduced.

  FIG. 19 shows an example of the focus position H of the eye 30 of the observer when the observer is gazing at the point P of the stereoscopic image 100 in the display device 10 according to the second modification of the present embodiment.

  It is assumed that the observer is gazing at the point P of the stereoscopic image 100 displayed on the display surface 22. In this case, the position of at least one of the lens 74 and the display surface 22 in the optical axis direction is controlled, and the optical conjugate relationship between the display surface 22 and the retina 34 of the eye 30 with the lens 32 and the lens 74 interposed therebetween. Become.

  Here, the eye 30 adjusts the thickness of the crystalline lens 32 so that the focus position H matches the point P of the stereoscopic image 100. Thereby, according to the display device 10, the position where the point P of the stereoscopic image 100 is recognized and the focus position H of the eye 30 can be matched. Furthermore, since the stereoscopic image 100 is common to the right eye and the left eye, the display device 10 according to the present modification recognizes the same point P of the stereoscopic image 100 with respect to the focus positions of the right eye and the left eye. It can also be matched to the position. Therefore, according to the display device 10 according to the present modification, it is possible to provide a viewer with a stereoscopic image that is close to nature, and to suppress fatigue during observation of the stereoscopic image.

  FIG. 20 illustrates an example of the configuration of the first example of the detection unit 16 according to the second modification example of the present embodiment, and an example of the optical path of the adjustment light from the detection unit 16 according to the first example toward the retina 34 of the eye 30. . FIG. 21 shows the configuration of the first example of the detection unit 16 according to the second modification of the present embodiment and the adjustment reflected by the retina 34 of the eye 30 from the eye 30 toward the detection unit 16 according to the first example. An example of the optical path of light is shown.

  In this example, the detection unit 16 is disposed in the optical path between the display surface 22 and the lens 74 of the optical system 70. In this example, the detection unit 16 and the display surface 22 are integrated to form an optical unit 88. Then, the optical unit 88 moves back and forth along the optical axis of the lens 74.

  The detection unit 16 includes an adjustment light output unit 50, an output lens 82, a half mirror 54, a dichroic mirror 84, a light receiving lens 86, and a spot detection unit 52.

  The adjustment light output unit 50 outputs invisible adjustment light such as infrared light. The output lens 82 condenses the adjustment light output from the adjustment light output unit 50. The output lens 82 is adjusted so that the optical distance from the lens 74 is equal to the display surface 22 on the optical path from the adjustment light output unit 50 to the retina 34 of the observer's eye 30. Collect the light.

  That is, the output lens 82 is a lens having a conjugate relationship between a position where the optical distance from the lens 74 is equal to the display surface 22 and the light emission position of the adjustment light output unit 50. Accordingly, the output lens 82 has the same optical distance from the display surface 22 to the lens 74 and the optical distance from the position of the adjustment light spot Ss collected by the output lens 82 to the lens 74. can do.

  The half mirror 54 and the dichroic mirror 84 guide the adjustment light output from the adjustment light output unit 50 into the optical path between the display surface 22 and the lens 74, and the retina of the observer's eye 30 through the lens 74. 34. Further, the half mirror 54 and the dichroic mirror 84 take out the adjustment light reflected by the retina 34 of the eye 30 of the observer from the optical path between the lens 74 and the display surface 22 and give it to the spot detection unit 52.

  For example, the half mirror 54 is disposed between the output lens 82 and the spot Ss of the adjustment light collected by the output lens 82. The half mirror 54 reflects (or transmits) the adjustment light output from the output lens 82 and supplies it to the dichroic mirror 84.

  For example, the dichroic mirror 84 is provided at an angle of 45 degrees with respect to the optical axis in the optical path between the lens 74 and the display surface 22. The dichroic mirror 84 reflects the adjustment light from the half mirror 54 and applies it to the retina 34 of the observer's eye 30 through the lens 74. Further, the dichroic mirror 84 reflects the adjustment light returned from the retina 34 of the observer's eye 30 and gives it to the half mirror 54. The half mirror 54 transmits (or reflects) the adjustment light reflected by the dichroic mirror 84 and gives it to the spot detection unit 52.

  For example, the dichroic mirror 84 reflects only infrared light and transmits light of other wavelengths. As a result, the dichroic mirror 84 gives the adjustment light of the infrared light to the retina 34 of the observer's eye 30 without affecting the display light given from the display surface 22 to the observer's eye 30. The adjustment light reflected from the retina 34 of the person's eye 30 can be taken out.

  The half mirror 54 and the dichroic mirror 84 provide the adjustment light output from the adjustment light output unit 50 to the retina 34 of the observer's eye 30 through the optical system 70 and from the retina 34 of the observer's eye 30. Any configuration may be used as long as it is a detection optical system that extracts the adjustment light reflected and output through the optical system 70.

  The light receiving lens 86 condenses the adjustment light reflected by the retina 34 of the observer's eye 30 and gives it to the spot detection unit 52. In this case, the light receiving lens 86 condenses the adjustment light reflected by the retina 34 of the observer's eye 30 after passing through a reference position where the optical distance from the lens 74 is equal to the display surface 22. For example, the light receiving lens 86 is provided between the half mirror 54 and the spot detection unit 52.

  The spot detection unit 52 detects the size of the spot Sp at the reference position where the optical distance from the lens 74 is equal to the display surface 22 in the adjustment light reflected from the retina 34 of the observer's eye 30. As an example, the spot detection unit 52 includes an image sensor disposed so that an optical distance from the lens 74 is optically conjugate with the reference position equal to the display surface 22 and the light receiving lens 86 interposed therebetween. A spot diameter calculation unit that calculates the diameter of the spot Sp from the image detected by the image sensor.

  The control unit 72 calculates the diameter d of the spot Sp based on the spot Sp of the adjustment light reflected from the retina 34 of the observer's eye 30 detected by the detection unit 16. Then, the control unit 72 moves the position of the display surface 22 in the optical axis direction (in this example, the optical unit 88 in which the display surface 22 and the detection unit 16 are integrated) so that the calculated diameter d is minimized. Let

  As a result, the control unit 72 can match the optical conjugate position with the retina 34 of the right eye of the observer on the display surface 22-R for the right eye. Further, the control unit 72 can match the optical conjugate position of the retina 34 of the left eye of the observer with the display surface 22-L for the left eye.

  FIG. 22 shows an example of the configuration of the second example of the detection unit 16 according to the second modification of the present embodiment, and an example of the optical path of the adjustment light from the detection unit 16 according to the second example toward the retina 34 of the eye 30. . FIG. 23 shows the configuration of the second example of the detection unit 16 according to the second modification of the present embodiment and the adjustment reflected by the retina 34 of the eye 30 from the eye 30 toward the detection unit 16 according to the second example. An example of the optical path of light is shown. The detection unit 16 according to the second example illustrated in FIGS. 22 and 23 has substantially the same function and configuration as the detection unit 16 according to the first example illustrated in FIGS. 20 to 21. Constituent elements are denoted by the same reference numerals, and detailed description thereof is omitted except for differences.

  The adjustment light output unit 50 according to this example outputs the first adjustment light given to the retina 34 of the observer's eye 30 from the point light source, and the optical distance to the retina 34 of the observer's eye 30 is the first. The second adjustment light is output from a point light source different from the adjustment light. The adjustment light output unit 50 according to this example has the same configuration as the adjustment light output unit 50 illustrated in FIGS. 13 and 14.

  The output lens 82 condenses the first adjustment light and the second adjustment light output from the adjustment light output unit 50. The output lens 82 is light that sandwiches a position where the optical distance from the lens 74 is equal to the display surface 22 on the optical path from the adjustment light output unit 50 to the retina 34 of the eye 30 of the observer. The first adjustment light and the second adjustment light are collected at a position that moves back and forth in the axial direction.

  For example, the output lens 82 is configured so that the spot Ss1 obtained by collecting the first adjustment light output from the adjustment light output unit 50 is closer to the observer than the position where the optical distance from the lens 74 is equal to the display surface 22. The eye 30 is formed on the front side (that is, the lens 74 side). Further, as an example, the output lens 82 has a spot Ss2 obtained by condensing the second adjustment light output from the adjustment light output unit 50 at a position where the optical distance from the lens 74 is equal to the display surface 22. It is formed on the rear side (that is, the adjustment light output unit 50 side) when viewed from the eyes 30 of the observer.

  The half mirror 54 and the dichroic mirror 84 guide the first adjustment light and the second adjustment light output from the adjustment light output unit 50 into the optical path between the display surface 22 and the lens 74, thereby causing the lens 74 to move. To the retina 34 of the eye 30 of the observer. Further, the half mirror 54 and the dichroic mirror 84 take out the first adjustment light and the second adjustment light reflected by the retina 34 of the observer's eye 30 from the optical path between the lens 74 and the display surface 22. To the spot detector 52.

  The light receiving lens 86 condenses the first adjustment light and the second adjustment light reflected by the retina 34 of the observer's eye 30 and gives them to the spot detection unit 52. In this case, the light receiving lens 86 uses the first adjustment light and the second adjustment light reflected by the retina 34 of the observer's eye 30 as reference positions where the optical distance from the lens 74 is equal to the display surface 22. Condensed after passing through.

  The spot detection unit 52 is a reference position where the optical distance from the lens 74 is equal to the display surface 22 in each of the first adjustment light and the second adjustment light reflected from the retina 34 of the eye 30 of the observer. Spot diameters of the spots Sp1 and Sp2 are detected. As an example, the spot detection unit 52 includes an image sensor disposed so that an optical distance from the lens 74 is optically conjugate with the reference position equal to the display surface 22 and the light receiving lens 86 interposed therebetween. A spot diameter calculation unit that calculates the diameters of the spots Sp1 and Sp2 from the image detected by the image sensor.

  The control unit 72 calculates the difference between the spot diameter of the first adjustment light and the spot diameter of the second adjustment light reflected by the retina 34 of the observer's eye 30 detected by the detection unit 16. . Then, the control unit 72 moves the position of the display surface 22 in the optical axis direction (in this example, the optical unit 88 in which the display surface 22 and the detection unit 16 are integrated) so that the spot diameter difference becomes zero. Let

  As a result, the control unit 72 can match the optical conjugate position with the retina 34 of the right eye of the observer on the display surface 22-R for the right eye. Further, the control unit 72 can match the optical conjugate position of the retina 34 of the left eye of the observer with the display surface 22-L for the left eye.

  FIG. 24 shows a configuration of the display device 10 according to a third modification of the present embodiment. Since the display device 10 according to the third modification has substantially the same function and configuration as the display device 10 according to the second modification shown in FIG. 18, hereinafter, the same components are denoted by the same reference numerals, Detailed description is omitted except for the differences.

  The display device 10 according to the present modification provides separate images to the observer's right eye and left eye, and provides the observer with a stereoscopically recognized image. The display device 10 includes a display unit 12, an output unit 14, an optical system 70, a detection unit 16, a control unit 72, and a blur control unit 18.

  The display unit 12 displays the image for the right eye and the image for the left eye to allow the observer to observe the stereoscopic image. The display unit 12 includes a display surface 22 and a lenticular lens array 24.

  The display surface 22 has a right-eye region for displaying a right-eye image and a left-eye region for displaying a left-eye image. As an example, the display surface 22 has right eye regions and left eye regions alternately arranged.

  The lenticular lens array 24 refracts the light output from the right eye region of the display surface 22 in the direction of the viewer's right eye and irradiates only the right eye to the viewer. The lenticular lens array 24 refracts the light output from the left eye region in the direction of the left eye of the observer and irradiates only the left eye to the observer.

  The optical system 70 generates a virtual image of the display surface 22 and gives it to the right and left eyes of the observer. In this example, the optical system 70 includes a binocular lens 90 that generates a virtual image of the display surface 22.

  Furthermore, one or both of the display surface 22 and the optical system 70 can change the relative positions of each other in the optical axis direction. For example, one or both of the display surface 22 and the binocular lens 90 of the optical system 70 can move in the optical axis direction.

  The detection unit 16 detects the amount of deviation between the optical conjugate position of at least one retina of the observer's right eye and left eye and the position of the display surface 22.

  The control unit 72 controls the position of at least one of the optical system 70 and the display surface 22 based on the detection result of the detection unit 16, and controls the display surface 22 and at least one retina of the left eye and right eye of the observer. Keep in optical conjugate relationship. As an example, the control unit 72 is optical for the right eye so that the amount of deviation between the optical conjugate position of at least one retina of the left eye and the right eye of the observer and the position of the display surface 22 becomes zero. The position of at least one of the binocular lens 90 and the display surface 22 in the system 70 is moved.

  The blur control unit 18 shifts each area of the image displayed on the display surface 22 from a portion corresponding to the area in the stereoscopic image and at least one focus position of the right eye and the left eye of the observer. In response, blur is generated. In this case, as an example, the blur control unit 18 is based on the positions of the optical system 70 and the display surface 22 in a state where the display surface 22 and at least one retina of the right eye and the left eye are maintained in an optical conjugate relationship. The position of the virtual image is calculated, and blur is generated according to the amount of deviation between the position of the virtual image and the region in the stereoscopic image.

  The display device 10 as described above gives an image for the right eye to the right eye of the observer and an image for the left eye to the left eye of the observer. Thereby, according to the display apparatus 10, a three-dimensional image can be provided to an observer. Furthermore, according to the display device 10, an image with a distance that is different from the focus position of the observer's eye and the position where the recognition position based on binocular parallax matches and is out of focus is blurred according to the amount of deviation from the focus position. Can be generated. Therefore, according to the display device 10, a three-dimensional image close to nature can be provided to the observer, and eye fatigue can be reduced.

  FIG. 25 shows an example of the configuration of the detection unit 16 according to the third modified example, and an example of a line of sight when the focus position H of the observer's eye is on the near side of the point P on the stereoscopic image 100. FIG. 26 shows an example of the configuration of the detection unit 16 according to the third modification, and the focus position H of the observer's eye is on the near side from the point P on the stereoscopic image 100, and is behind the focus position in FIG. An example of the line of sight in the case of the side is shown. FIG. 27 shows an example of the configuration of the detection unit 16 according to the third modification, and an example of the line of sight when the focus position H of the observer's eye coincides with the point P on the stereoscopic image 100. FIG. 28 shows an example of the configuration of the detection unit 16 according to the third modification, and the line of sight when the focus position H of the observer's eye is behind the point P of the stereoscopic image 100 generated by the display unit 12. An example is shown.

  The detection unit 16 according to the modification is disposed in the optical path between the display surface 22 and the binocular lens 90 of the optical system 70. The detection unit 16 includes at least one of a right-eye detector 94 -R and a left-eye detector 94 -L, and a binocular dichroic mirror 92.

  The right-eye detector 94-R applies adjustment light in an invisible wavelength region such as infrared light to the retina of the viewer's right eye, and detects the adjustment light reflected from the retina of the viewer's right eye. . Then, the right-eye detector 94-R detects the focus position of the observer's right eye based on the detected adjustment light.

  The left-eye detector 94-L applies adjustment light in an invisible wavelength region such as infrared light to the retina of the left eye of the observer, and detects the adjustment light reflected from the retina of the left eye of the observer. . Then, the left-eye detector 94-L detects the focus position of the left eye of the observer based on the detected adjustment light. The detection unit 16 may include both the right-eye detector 94-R and the left-eye detector 94-L, or may include either one.

  The binocular dichroic mirror 92 reflects only infrared light and transmits light of other wavelengths. The binocular dichroic mirror 92 is disposed in the optical path between the display surface 22 and the binocular lens 90.

  The binocular dichroic mirror 92 adjusts the adjustment light output from the right-eye detector 94 -R and the left-eye detector 94 -L in the optical path between the display surface 22 and the binocular lens 90. And applied to the retina 34 of the observer's eye 30 through the binocular lens 90. The binocular dichroic mirror 92 takes out the adjustment light reflected by the retina 34 of the observer's eye 30 from the optical path between the binocular lens 90 and the display surface 22 and detects for the right eye. To the detector 94-R and the detector 94-L for the left eye. Such a detection unit 16 can detect the amount of deviation between the optical conjugate position of at least one retina of the observer's right eye and left eye and the position of the display surface 22.

  Here, in this modified example, when the focus position H of the observer's eye coincides with the point P of the stereoscopic image 100 as shown in FIG. 27, the right eye and the left refracted by the binocular lens 90 Intersections (congestion positions) of the line of sight of the eyes coincide on the display surface 22.

  On the other hand, when the focus position H of the observer's eye is closer to the front side than the point P of the stereoscopic image 100 as shown in FIGS. 25 and 26, the right eye refracted by the binocular lens 90. And the intersection (position of convergence) of the line of sight of the left eye is on the far side from the display surface 22. In addition, when the focus position H of the observer's eye is behind the point P of the stereoscopic image 100 as shown in FIG. 28, the right eye and the left eye of the line of sight refracted by the binocular lens 90 are displayed. The intersection (congestion position) is in front of the display surface 22.

  Therefore, in the display device 10 according to the third modification, it is preferable that the control unit 72 corrects the display coordinates of the right-eye image and the left-eye image according to the focus position H of the observer's eye. That is, for each part in the stereoscopic image, the display surface 22 generates a virtual image of the display area corresponding to the part on a straight line connecting the part and the center of the eye lens corresponding to the part. It is preferable to change and display the image and the image for the left eye.

  FIG. 29 shows the display position on the display surface 22 of the image corresponding to the point P of the stereoscopic image in the display device 10 according to the third modification of the present embodiment. It is assumed that a virtual image of an arbitrary point Pp on the display surface 22 created by the binocular lens 90 is a point Pi. In this case, the point P on the stereoscopic image generated by the display surface 22 corresponding to the point Pp must be on a straight line connecting the center position Ec of the observer's eyes and the point Pi.

  The distance from the optical axis Ao of the binocular lens 90 at the center position Ec of the eye of the observer is assumed to be He. In the drawing, when the center position Ec of the observer's eye is located below the optical axis Ao, He has a negative value.

  The distance from the optical axis Ao of the point P is assumed to be Ho. The distance from the binocular lens 90 to the center position Ec of the observer's eye is Le, the distance from the binocular lens 90 to the point Pi is Li, and the distance from the binocular lens 90 to the point P is Lo. To do. Furthermore, let the focal length of the binocular lens 90 be f.

  In this case, the distance Hp from the optical axis Ao of the point Pp is represented by the following formula (1).

  Therefore, the display surface 22 displays an image corresponding to the coordinates calculated based on the following formula (1) for the point P shifted from the focus position of the observer's eye on the stereoscopic image. Thereby, in the display device 10 according to the third modification, the intersection (congestion position) of the line of sight of the right eye and the left eye can always coincide with the point P regardless of the focus position of the observer's eye.

  FIG. 30 shows a configuration of the display device 10 according to a fourth modification of the present embodiment. Since the display device 10 according to the fourth modification has substantially the same function and configuration as the display device 10 shown in FIG. 1, hereinafter, the same components are denoted by the same reference numerals, and detailed description is made except for differences. Description is omitted.

  The display device 10 according to the present modification displays the right-eye image and the left-eye image captured in real time on the display unit 12, and allows the observer to observe the stereoscopic image captured in real time. The display apparatus 10 includes an imaging unit 98-R for the right eye and an imaging unit 98-L for the left eye instead of the output unit 14. Further, the display device 10 includes a focus control unit 99-R for the right eye and a focus control unit 99-L for the left eye instead of the blur control unit 18.

  The right-eye imaging unit 98-R captures the subject 200 from a position corresponding to the right eye and generates a right-eye image. The left-eye imaging unit 98-L captures the subject 200 from a position corresponding to the left eye and generates a left-eye image.

  The display unit 12 displays the right-eye image generated by imaging by the right-eye imaging unit 98-R on the right eye of the observer in real time. Further, the display unit 12 displays the left-eye image generated by imaging by the left-eye imaging unit 98-L on the left eye in real time to the observer.

  The focus adjustment unit 99-R for the right eye uses the imaging lens of the imaging unit 98-R for the right eye according to the focus position of the observer's right eye detected by the detection unit 16-R for the right eye. Adjust the focus position. The focus adjustment unit 99-L for the left eye corresponds to the imaging lens of the imaging unit 98-L for the left eye according to the focus position of the right eye of the observer detected by the detection unit 16-L for the left eye. Adjust the focus position.

  FIG. 31 shows an example of the focus position and convergence of the eyes of the observer when observing the stereoscopic image 100 generated by the display device 10 according to the fourth modification of the present embodiment. FIG. 32 shows an example of the imaging directions and focal positions of the right-eye imaging unit 98-R and the left-eye imaging unit 98-L in the fourth modification example of the present embodiment.

In FIG. 31, in the initial state, the right eye and the left eye of the observer are trying to gaze at the point P on the stereoscopic image 100, but the focus positions are in alignment with the surface Hr1 and the surface Hl1, respectively. On the other hand, in FIG. 32, it is assumed that suitable for each surface Hr _'1 and plane Hl' ₁ is the focal point of the imaging unit 98-L of the imaging unit 98-R and the left eye for the right eye. In this way, in the initial state, the point P is not on the focus position of the eye and thus appears blurred.

  Here, the display unit 12 displays an image taken at a magnification α. In this case, the distance from the right eye (or left eye) to the focus plane of the right eye (or left eye) is D, and the imaging unit 98-R for the right eye (or imaging unit 98-L for the left eye) is used. When the distance to the focal position of the right-eye imaging unit 98-R (or the focal position of the left-eye imaging unit 98-L) is D ′, the ocular focus adjustment unit 99-R is α ×. The focal position of the imaging unit 98-R for the right eye is controlled so that the relationship D ′ = D is satisfied. Similarly, the focus adjustment unit 99-L for the left eye controls the focal position of the imaging unit 99-R for the left eye so that the relationship α × D ′ = D is established.

For example, assume that the focus position is changed from the surface Hr1 to the surface Hr2 so that the image of the point P can be seen clearly by the right eye. Then, focus adjustment unit 99-R for the right eye, in synchronization with the change of the pin and the position of the right eye, the focal position of the imaging unit 98-R for the right eye 'from ₁ [Delta] D' plane Hr = [Delta] D / alpha It is moved to the plane Hr ′ _{2 that is} shifted by a certain amount. Further, it is assumed that the focus position is changed from the plane Hl1 to the plane Hl2 so that the image of the point P can be seen clearly by the left eye. Then, the focus adjustment unit 99-L for the left eye synchronizes the focus position of the imaging unit 98-L for the left eye with respect to the plane Hl ′ ₁ by ΔD ′ = ΔD / α in synchronization with the change in the focus position of the left eye. is moved to the shifting surface Hl _'2.

  Thus, finally, the right eye and the left eye can focus on the plane including the point P on the stereoscopic image 100. This is because the point P ′ on the subject 200 is directly magnified α times and is directly viewed. Is equivalent. Further, in a portion where the distance is different from the point P in the focus direction, a blur corresponding to the difference in the distance occurs.

  As described above, the display device 10 according to the fourth modified example always matches the intersection (congestion position) of the line of sight of the right eye and the left eye with the point P without performing image blurring processing by software. It is possible to display a natural three-dimensional image enlarged by α times 200 to the observer. 30 shows a configuration including an imaging unit 98-R for the right eye and an imaging unit 98-L for the left eye instead of the output unit 14 of the display device 10 shown in FIG. Instead of the output unit 14 illustrated in FIGS. 18 and 24, a configuration may be provided that includes an imaging unit 98 -R for the right eye and an imaging unit 98 -L for the left eye.

  As mentioned above, although this invention was demonstrated using embodiment, the technical scope of this invention is not limited to the range as described in the said embodiment. It will be apparent to those skilled in the art that various modifications or improvements can be added to the above-described embodiment. It is apparent from the scope of the claims that the embodiments added with such changes or improvements can be included in the technical scope of the present invention.

  The order of execution of each process such as operations, procedures, steps, and stages in the apparatus, system, program, and method shown in the claims, the description, and the drawings is particularly “before” or “prior to”. It should be noted that the output can be realized in any order unless the output of the previous process is used in the subsequent process. Regarding the operation flow in the claims, the description, and the drawings, even if it is described using “first”, “next”, etc. for convenience, it means that it is essential to carry out in this order. It is not a thing.

DESCRIPTION OF SYMBOLS 10 Display apparatus, 12 Display part, 14 Output part, 16 Detection part, 18 Blur control part, 22 Display surface, 24 Lenticular lens array, 30 Eyes, 32 Lens, 34 Retina, 40 Adjustment optical system, 42 Adjustment lens, 44 Movement control unit, 46 calculation unit, 50 adjustment light output unit, 52 spot detection unit, 54 half mirror, 60 first point light source, 62 second point light source, 64 parallel flat glass, 70 optical system, 72 control unit, 74 lens , 82 output lens, 84 dichroic mirror, 86 light receiving lens, 88 optical unit, 90 binocular lens, 92 binocular dichroic mirror, 94 detector, 98 imaging unit, 99 focus adjustment unit, 100 stereoscopic image, 200 subject

Claims (17)

A display unit for displaying an image and allowing an observer to observe a stereoscopic image;
A detection unit for detecting a focus position of the eye of the observer;
A blur control unit that causes each region of the image displayed by the display unit to blur according to a shift amount between a portion corresponding to the region in the stereoscopic image and the focus position;
A display device comprising: The display device according to claim 1, wherein the blur control unit causes blurring to increase as the shift amount increases. The display device according to claim 1, wherein the blur control unit performs a blurring process on image data given to the display unit. The display device according to claim 1, wherein the detection unit detects light from a retina of the observer's eye to detect a focus position of the observer's eye. The display device according to claim 4, wherein the detection unit supplies adjustment light to a retina of an observer's eye and detects the adjustment light reflected from the retina of the observer's eye. The display device according to claim 5, wherein the detection unit provides adjustment light in an invisible wavelength region to a retina of the observer's eye. The detector is
The adjustment light output from the point light source is applied to the retina of the observer's eye, and the spot diameter of the adjustment light reflected from the retina of the observer's eye is determined from the retina of the eye to the point light source. An adjustment optical system that detects at the same optical distance as the target distance;
An adjustment lens provided between the adjustment optical system and the eyes of the observer;
A movement control unit that moves the position of the adjustment optical system back and forth along the adjustment light so that the spot diameter has a predetermined size;
A calculation unit that calculates a focus position of the observer's eye based on a position of the adjustment optical system in a state where the spot diameter is set to a predetermined size;
The display device according to claim 5 or 6. The adjusting optical system is
An adjustment light output unit for outputting adjustment light to be applied to the retina of the observer's eye from a point light source;
A spot detector that detects the spot diameter of the adjustment light reflected from the retina of the eye of the observer at a position of the same optical distance as the optical distance from the retina of the eye to the point light source;
A half mirror that gives the adjustment light output from the adjustment light output unit to the retina of the eye of the observer and gives the adjustment light reflected from the retina of the eye of the observer to the spot detection unit;
Have
The display device according to claim 7, wherein the movement control unit moves the position of the adjustment optical system so that the spot diameter has a predetermined size. The adjustment light output unit outputs the first adjustment light from a point light source, and the second light source from the point light source having an optical distance to the retina of the observer's eye different from that of the first adjustment light. Output adjustment light,
The spot detection unit calculates a spot diameter of the first adjustment light and a spot diameter of the second adjustment light reflected from the retina of the observer's eye from the retina of the eye. Detecting at a position of the same optical distance as the optical distance to the position between the light source and the point light source of the second adjustment light,
The movement control unit moves the position of the adjustment optical system so that a difference between a spot diameter of the first adjustment light and a spot diameter of the second adjustment light is set to a predetermined value. The display device described in 1. The display unit displays a right-eye image to be given to the observer's right eye and a left-eye image to be given to the observer's left eye, and allows the observer to observe the stereoscopic image.
The detection unit detects a focus position of at least one of the right eye and the left eye;
The blur control unit shifts each region of the right-eye image and each region of the left-eye image to a shift amount between a portion corresponding to the region in the stereoscopic image and the focus position of the corresponding eye. The display device according to claim 1, wherein blur is generated in response. The display unit includes a right-eye display surface that displays the right-eye image and a left-eye display surface that displays the left-eye image.
The display device
An optical system for the right eye that generates a virtual image of the display surface for the right eye and gives the virtual image to the right eye;
An optical system for the left eye that generates a virtual image of the display surface for the left eye and gives the virtual image to the left eye;
Controlling the position of the virtual image on the display surface for the right eye, maintaining the optical conjugate relationship between the display surface for the right eye and the retina for the right eye, and controlling the position of the virtual image on the display surface for the left eye A control unit for maintaining an optical conjugate relationship between the display surface for the left eye and the retina of the left eye;
The display device according to claim 10. The detection unit applies adjustment light to at least one of the retina of the right eye and the retina of the left eye via at least one of the optical system for the right eye and the optical system for the left eye, and is reflected from the retina. 12. The focus position of at least one of the right eye and the left eye is detected by taking in the adjustment light via at least one of the optical system for the right eye and the optical system for the left eye. Display device. The display unit has a display surface having a region for displaying the right-eye image and a region for displaying the left-eye image;
The display device
An optical system that generates a virtual image of the display surface and applies the virtual image to the right eye and the left eye;
A controller that controls the position of the virtual image on the display surface to maintain the display surface and the retina of the right eye and the left eye in an optical conjugate relationship;
The display device according to claim 10. The detection unit applies adjustment light to at least one of the retina of the right eye and the retina of the left eye via the optical system, and takes in the adjustment light reflected from the retina via the optical system. The display device according to claim 13, wherein the focus position of at least one of an eye and the left eye is detected. For each part in the stereoscopic image, the display unit generates the virtual image of the display area corresponding to the part on a straight line connecting the part and the center of the eye lens corresponding to the part. The display device according to claim 13, wherein the image and the left-eye image are changed and displayed. An imaging unit that captures an image for displaying a stereoscopic image;
A display unit that displays an image captured by the imaging unit and allows a viewer to observe a stereoscopic image;
A detection unit for detecting a focus position of the eye of the observer;
A focus adjustment unit that controls a focus position of the imaging unit according to a focus position of an observer's eye detected by the detection unit;
A display device comprising: Display the image and let the observer observe the stereoscopic image with the display unit,
Detecting the focus position of the observer's eye;
A display method in which each region of an image displayed by the display unit is blurred according to a shift amount between a portion corresponding to the region in the stereoscopic image and the focus position.