JP2014068331A - Stereoscopic display device and display method of the same - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a stereoscopic display device which informs an observer of a direction where stereoscopic display is possible and a direction where stereoscopic display can be maintained and can reduce troublesomeness of the observer with shift of a viewpoint position and to provide a display method of the stereoscopic display device.SOLUTION: A control section 20 allows display means 30 to display a direction indication image for suggesting a center direction of an observation region as an image observed by an observer in a left eye image and a right eye image when it is determined that one of a left eye and a right eye of an operator 102 reaches an end of the observation region where the left eye image or the right eye image can be observed or an outer side of the observation region in response to a viewpoint position which position detection means detects.

Description

  The present invention relates to a stereoscopic display device and a display method thereof.

  2. Description of the Related Art As a conventional stereoscopic display device, there is known a device that allows two left and right parallax images to be observed by an observer's left eye and right eye in order to enable stereoscopic viewing with the naked eye (see, for example, Patent Document 1). Such a stereoscopic display device displays a composite image in which left and right parallax images are alternately arranged for each column on a display unit such as a liquid crystal display panel, and this composite image is provided with a plurality of parallax barriers and kamaboko-shaped lenses having predetermined slits. Optical separation into left and right parallax images via an image separating means such as a lenticular lens arranged, and allowing a viewer to observe a parallax image corresponding to each eye with the left and right eyes, enabling stereoscopic viewing It is.

  In addition, the viewer's viewpoint position deviates from the normal viewing area (the area where the left and right eyes can observe the parallax images corresponding to the respective eyes) and the left and right eyes observe the parallax images corresponding to the opposite eyes or 1 As a method to solve the problem that stereoscopic vision is not possible due to crosstalk that observes both parallax images with one eye, detection means that can detect the observer's viewpoint position is provided, and according to the viewpoint position of the observer A technique for switching left and right parallax images observed in this manner is known (see, for example, Patent Document 2).

JP 2005-91447 A JP 2003-107392 A

  However, even if the method of switching the left and right parallax images according to the observer's viewpoint position as disclosed in Patent Document 2 is used, the observation in which one of the left eye or the right eye of the observer can observe the parallax image If it is located outside the area, stereoscopic display cannot be performed. At this time, it is difficult for the observer to instantly understand how the stereoscopic display can be performed by moving the viewpoint position, and there is a problem that the observer feels troublesome. In addition, since the observer can recognize that his / her viewpoint position is a position where the stereoscopic display cannot be performed only after the stereoscopic display cannot be performed, the stereoscopic display cannot be maintained and the observer feels troublesome.

  Therefore, the present invention solves the above problems, notifies the observer of the direction in which stereoscopic display is possible and the direction in which stereoscopic display can be maintained, and can reduce the troublesomeness of the observer associated with the movement of the viewpoint position. An object of the present invention is to provide a stereoscopic display device and a display method thereof.

In order to solve the above problems, the present invention provides a display means for displaying a left-eye image and a right-eye image side by side;
Display control means for causing the display means to display the left-eye image and the right-eye image;
Image separating means for separating the left-eye image and the right-eye image displayed on the display means;
A position detecting means capable of detecting an observer's viewpoint position, and a stereoscopic display device comprising:
The display control unit is configured to display an observation region in which either the left eye or the right eye of the observer can observe the left eye image or the right eye image based on the viewpoint position detected by the position detection unit. If it is determined that the image has reached the end or the outside of the observation area, the display means displays the center of the observation area as an image observed by the observer among the left-eye image or the right-eye image. A direction indication image suggesting a direction is displayed.

In order to solve the above problems, the present invention provides a display means for displaying a left-eye image and a right-eye image side by side;
Image separating means for separating the left-eye image and the right-eye image displayed on the display means;
A position detection means capable of detecting the viewpoint position of the observer, and a display method of a stereoscopic display device comprising:
Based on the viewpoint position detected by the position detecting means, either the left eye or the right eye of the observer can observe the image for the left eye or the image for the right eye, or the observation area. If it is determined that it has reached the outside of the image, a direction indication suggesting a central direction of the observation region as an image observed by the observer among the left-eye image or the right-eye image on the display means An image is displayed.

  The present invention can achieve the intended purpose, informs the observer of the direction in which stereoscopic display is possible and the direction in which stereoscopic display can be maintained, and reduces the burden on the observer associated with the movement of the viewpoint position. It becomes possible.

1 is a schematic diagram of a head-up display device according to a first embodiment of the present invention. The figure explaining the example of the three-dimensional display in the same as the above. The block diagram which shows the electric constitution of a control part same as the above. The flowchart figure which shows the control method in the same as the above. The figure explaining the viewpoint detection in the same as the above. The figure explaining an example of the image change accompanying the movement of a viewpoint position in the same as the above. The figure explaining an example of the image change accompanying the movement of a viewpoint position in the same as the above. The figure which shows an example of the direction instruction image in the same as the above. The block diagram which shows the electrical constitution of the head-up display apparatus of 2nd embodiment of this invention. The figure explaining an example of alerting | reporting operation | movement accompanying the movement of a viewpoint position in the same as the above.

Hereinafter, a first embodiment in which the present invention is applied to a head-up display (HUD) device 100 will be described with reference to the accompanying drawings.
The HUD device 100 is installed in a dashboard in a vehicle interior of a vehicle, and as shown in FIG. 1, an imaging unit (position detection unit) 10, a control unit 20, a display unit 30, and image separation are performed. Means 40 and a concave mirror 50. The display light L indicating a predetermined image output from the HUD device 100 is reflected by the windshield 101 of the vehicle and reaches the eyes of the driver (observer) 102. The driver 102 visually recognizes the virtual image V displayed in front of the windshield 101.

  The imaging unit 10 includes a known imaging device such as a CCD and peripheral circuits and lenses that control the imaging device. The imaging unit 10 is installed in front of the driver 102 and images the face of the driver 102 and outputs a captured image. .

  The control unit 20 is a so-called microcomputer. The control unit 20 is connected to the imaging unit 10 and the display unit 30, performs a viewpoint position detection process for analyzing the face image of the driver 102 output from the imaging unit 10 and calculating the viewpoint position of the driver 102. Based on the calculation result, a control signal is output to the display means 30 to perform image display control. That is, the control unit 20 functions as the position detection unit of the present invention together with the imaging unit 10 and also functions as the display control unit of the present invention. The control unit 20 cuts out a striped divided image from the image for the left eye when the object is viewed from the left eye and the image for the right eye when the object is viewed from the right eye, and alternately converts the divided images in the horizontal direction. A composite image including the left-eye image and the right-eye image is generated side by side, and this composite image is displayed on the display means 30.

  The display unit 30 includes, for example, a backlight light source 31 and a dot matrix type liquid crystal display panel 32, and emits the composite image as display light L toward the concave mirror 50. The display unit 30 may be any unit that emits the composite image as display light L, and may be a self-luminous display panel such as an organic EL panel.

  The image separating means 40 is composed of, for example, a parallax barrier (parallax barrier) provided with a plurality of stripe-shaped slit portions that transmit light, and is provided on the emission surface side of the display means 30 with a predetermined interval. The display light L passes through the slit portion of the image separation means 40, so that the composite image is divided into a left-eye image and a right-eye image, and the left-eye image light and the right-eye image light are divided by the driver 102. Can be incident separately on the left and right eyes. A lenticular lens may be used as the image separation means 40.

  The concave mirror 50 irradiates the windshield 101 with the display light L so that the display light L is focused on the left and right eyes of the driver 102. The concave mirror 50 includes a rotating shaft (not shown). The rotation axis is perpendicular to the drawing of FIG. 1, and the angle of the concave mirror 50 relative to the windshield 101 can be changed around the rotation axis. In addition, the concave mirror 50 is provided with a motor (not shown) as a driving means in order to change the angle of the concave mirror 50. By this motor, the angle of the concave mirror 50 with respect to the windshield 101 is changed, and the angle is changed. Can be maintained. As described above, the display light L can be adjusted to the driver's 102 line of sight.

The driver 102 recognizes the virtual image V as a three-dimensional image by the parallax between the two images when the light of the left-eye image is incident on the left eye and the right-eye image is incident on the right eye of the display light L. it can. FIG. 2 shows a state in which the composite image including two images for the left eye and two for the right eye (four in total) is displayed on the display unit 30 to perform stereoscopic display. E1 to E4 in FIG. 2 indicate each region (lobe) in the observation region E where the image can be observed. When a composite image in which two divided images of the left-eye image 60L and two divided images of the right-eye image 60R are alternately arranged is displayed on the display means 30 (display of the divided image of the left-eye image 60L in FIG. 2). The position is “L” and the display position of the divided image of the right-eye image 60R is “R”), and the driver 102 observes the composite image through the slit portion 41 of the image separation means 40. Thus, different images are observed for the left eye and the right eye. In FIG. 2, the right-eye image 60R can be observed in the areas E1 and E2 of the observation area E, and the left-eye image 60L can be observed in the areas E3 and E4. Therefore, when the right eye of the driver 102 is positioned between the areas E1 and E2 and the left eye is positioned between the areas E3 and E4, stereoscopic display is possible. Further, in the parallax barrier method or the lenticular method in which an image is divided and stereoscopic display is performed, the areas E1 to E4 exist repeatedly in the observation area E due to the spread of light from the display means 30. In the present embodiment, among the observation areas E, the areas E1 to E4 located in the center are main lobes that are the observation positions of the designed image (virtual image V), and the areas E1 to E4 located outside the main lobes are the side lobes. Become a robe.
In FIG. 2, the concave mirror 50 and the windshield 101 are omitted to simplify the drawing.

  FIG. 3 shows the electrical configuration of the control unit 20. As illustrated in FIG. 3, the control unit 20 includes a CPU 21, a ROM 22, a general-purpose memory 23, a video memory 24, and an external device I / F 25.

  The CPU 21 reads out and executes a predetermined program stored in advance in the ROM 22, temporarily stores the captured image from the imaging unit 10, a processed image obtained by performing image processing on the image, a calculation result such as a viewpoint position, and the like in the general-purpose memory 23. The synthesized image to be stored and displayed on the display means 30 is stored in the video memory 24.

  The ROM 22 stores a program for operating the CPU 21.

  The general-purpose memory 23 temporarily stores a captured image from the imaging unit 10, a processed image obtained by performing image processing on the captured image, a calculation result such as a viewpoint position, and the like.

  The video memory 24 stores the composite image to be displayed on the display means 30.

  The external device I / F 25 electrically connects the control unit 20 to a vehicle control system unit 103 including a computer that controls the imaging unit 10, the display unit 30, and the vehicle. The external device I / F 25 acquires a captured image from the imaging unit 10, outputs a control signal to the display unit 30, and acquires vehicle information such as a vehicle speed from the vehicle control system unit 103. CPU21 can display vehicle information on the display means 30 based on the acquired vehicle information.

Next, viewpoint detection processing and image display control in the control unit 20 will be described with reference to FIG.
First, in step S <b> 1, the CPU 21 detects the left eye and the right eye of the driver 102 from the captured image obtained by capturing the face of the driver 102 output from the imaging unit 10. Specifically, as shown in FIG. 5, for example, template matching which is a well-known image processing technique is performed on the captured image P including the face of the driver 102, and a predetermined template T is moved on the captured image P. Then, the location that matches the template T is detected as the left eye and the right eye of the driver 102 on the captured image P.

  Next, in step S2, the CPU 21 determines the left eye viewpoint position and the right eye viewpoint position in the space of the driver 102 based on the positions of the left eye and the right eye of the driver 102 on the captured image P detected in step S1. And calculate. The position information of the left eye viewpoint position and the right eye viewpoint position may be two-dimensional information or three-dimensional information. Note that the imaging unit 10 captures the face of the driver 102 even when the left eye or the right eye of the driver 102 is outside the main lobe of the observation area E, that is, inside the side lobe and outside the observation area E. It is assumed that the CPU 21 can calculate the left eye viewpoint position and the right eye viewpoint position of the driver 102.

  Next, in step S3, the CPU 21 displays the display position of the left-eye image 60L on the display means 30 and the right-eye viewpoint so as to correspond to the left-eye viewpoint position and right-eye viewpoint position of the driver 102 calculated in step S2. The display position of the image 60R is defined. Specifically, the display positions of the divided images of the left-eye image 60L and the right-eye image 60R are calculated, and the divided images of the left-eye image 60L and the right-eye image 60R are arranged in a predetermined order. The composite image arranged in (1) is generated. Further, at this time, the CPU 21 calculates the display luminance based on the left eye viewpoint position and the right eye viewpoint position of the driver 102 in the left eye image 60L and the right eye image 60R on the display means 30. At this time, the CPU 21 determines that the left eye or the right eye of the driver 102 has reached the outside or the end of the observation area E based on the left eye viewpoint position and the right eye viewpoint position of the driver 102. In this case, the left-eye image 60L or the right-eye image 60R that can be observed by the driver 102 is an image including a direction indication image that suggests the center direction of the observation region E described later.

  Next, in step S4, the CPU 21 causes the display unit 30 to display the composite image, and displays the left-eye image 60L and the right-eye image 60R with the display brightness calculated in the same step at the display position calculated in step S3. Is displayed.

  The CPU 21 executes steps S1 to S4 in an infinite loop until the power is turned off.

  Next, an example of changing the display position and the display brightness of the left-eye image 60L and the right-eye image 60R accompanying the movement of the viewpoint position of the driver 102 will be described with reference to FIG.

  FIG. 6A shows a case where the center of the viewpoint of the driver 102 (the center between the left eye and the right eye) is located at the center of the observation region E (on the boundary between the regions E2 and E3 in the main lobe). ing. At this time, the right eye of the driver 102 is located on the boundary between the areas E1 and E2 in the main lobe, and the left eye is located on the boundary between the areas E3 and E4. Therefore, the left eye image 60L and the right eye image 60R are displayed on the display unit 30 so that the right eye image 60R is observed in the regions E1 and E2 and the left eye image 60L is observed in the regions E3 and E4. A display position is determined. Further, since both the left eye and the right eye of the driver 102 are located in the main lobe, the display brightness of the left eye image 60L and the right eye image 60R on the display means 30 is kept equal.

  6B, the viewpoint of the driver 102 moves to the right (left direction in FIG. 6) as viewed from the driver 102 from FIG. 6A, and the center of the viewpoint of the driver 102 is in the main lobe. The case where it locates near the center of the area | region E2 is shown. At this time, the right eye of the driver 102 is located in the area E1 in the main lobe, and the left eye is located in the area E3. Therefore, the display position and display brightness of the left-eye image 60L and the right-eye image 60R are not changed from FIG.

  In FIG. 6C, the viewpoint of the driver 102 further moves to the right when viewed from the driver 102 from FIG. 6B, and the center of the viewpoint of the driver 102 is the boundary between the regions E1 and E2 in the main lobe. The case located above is shown. At this time, the right eye of the driver 102 is located on the boundary between the region E1 in the main lobe and the region E4 in the side lobe, and the left eye is located on the boundary between the regions E2 and E3 in the main lobe. Therefore, based on the viewpoint position of the driver 102 calculated as described above, the right-eye image 60R is observed in the regions E1 and E4, and the left-eye image 60L is observed in the regions E2 and E3. Display positions on the display means 30 for the left-eye image 60L and the right-eye image 60R are determined. Specifically, the image displayed at the position corresponding to the region E2 on the display unit 30 is for the right eye so that the images observed in the region E2 and the region E4 can be switched from the case of FIG. The divided image of the image 60R is changed to the divided image of the left-eye image 60L, and the image displayed at a position corresponding to the region E4 on the display unit 30 is changed from the divided image of the left-eye image 60L to the right-eye image. It is changed to a 60R divided image. In this case, since it is determined that the right eye of the driver 102 has reached the side lobe, the image observed by the driver 102 in the region E4, that is, the right eye displayed at a position corresponding to the region E4. The display brightness of the image 60R on the display means 30 is set higher than the display brightness when observed in the main lobe. This solves the problem that a luminance difference occurs in the image observed by the driver 102 between the main lobe and the side lobe and stereoscopic display cannot be performed (only the image of the main lobe with high luminance is recognized). Because. Note that the display brightness can be changed by partially changing the transmittance of the liquid crystal display panel 32. Thus, even when the viewpoint of the driver 102 moves in the horizontal direction, the driver 102 can observe the left-eye image 60L and the right-eye image 60R with the left eye and the right eye, respectively, and can display a three-dimensional display. Can keep. In addition, even when the viewpoint position of the driver 102 is located at the main lobe and the side lobe, the luminance difference between the observed left-eye image 60L and the right-eye image 60R is reduced, and stereoscopic display is maintained. Can do. It should be noted that the level of display brightness when observed with side lobes is determined by using a data table in which the brightness in the main lobe and the brightness in the side lobe are measured in advance and the viewpoint position and brightness adjustment value are associated with each other. The display brightness may be changed, or the brightness of the display light L reflected to the driver 102 may be determined using the captured image acquired from the imaging unit 10, and the display brightness may be adjusted as appropriate.

  In FIG. 6D, the viewpoint of the driver 102 further moves to the right when viewed from the driver 102 from FIG. 6C, and the center of the viewpoint of the driver 102 is near the center of the region E1 in the main lobe. The case where it is located is shown. At this time, the right eye of the driver 102 is located in the region E4 in the side lobe, and the left eye is located in the region E2 in the main lobe. Accordingly, the display positions of the left eye image 60L and the right eye image 60R on the display means 30 are not changed from FIG. In this case, it is determined that the right eye of the driver 102 has reached the side lobe, and the driver 102 observes the right eye image 60R only in the region E4 in the side lobe. It is considered that the luminance of the right-eye image 60R observed with the eyes is lower than that in FIG. Accordingly, the display brightness of the right eye image 60R displayed at the position corresponding to the region E4 on the display means 30 is made higher than the display brightness in FIG.

  Next, an example of a display method when the viewpoint position of the driver 102 further moves and reaches the end of the observation area E or the outside of the observation area E will be described with reference to FIG.

7A, the driver's viewpoint moves further to the right (left direction in FIG. 7) when viewed from the driver 102 from FIG. 6D, and the center of the viewpoint of the driver 102 is in the main lobe. The case where it locates near the center of the area | region E1 is shown. At this time, the right eye of the driver 102 is located in the region E3 in the side lobe, and the left eye is located in the region E1 in the main lobe. Therefore, based on the viewpoint position of the driver 102 calculated as described above, the right eye image 60R is observed in the regions E3 and E4, and the left eye image 60L is observed in the regions E1 and E2. Display positions on the display means 30 for the left-eye image 60L and the right-eye image 60R are determined. Specifically, the image displayed at the position corresponding to the region E1 on the display unit 30 is for the right eye so that the image observed in the region E1 and the region E3 can be switched from the case of FIG. The divided image of the image 60R is changed to the divided image of the left-eye image 60L, and the image displayed at a position corresponding to the region E3 on the display unit 30 is changed from the divided image of the left-eye image 60L to the right-eye image. It is changed to a 60R divided image. In this case, since it is determined that the right eye of the driver 102 has reached the side lobe, the image observed by the driver 102 in the region E3, that is, the right eye displayed at a position corresponding to the region E3. The display brightness of the image 60R on the display means 30 is set higher than the display brightness when observed in the main lobe.
Further, at this time, the right eye of the driver 102 has the end regions E21 and E31 set within a predetermined distance from the boundary between the observation region E and the outside thereof in the central direction (the direction toward the main lobe in the horizontal direction). It is located in the end region E31. In this case, the CPU 21 determines that the right eye of the driver 102 has reached the end of the observation region E, and the right eye image 60R and the left eye image 60L that can be observed by the driver 102 are displayed in the observation region E. A direction indication image suggesting the center direction is displayed on the display means 30. FIG. 8 shows an example of a direction indication image. The direction indication image 60W1 shown in FIG. 8A and the direction indication image 60W2 shown in FIG. 8B are arrow images indicating the central direction of the observation region E. A direction indicating image 60W3 shown in FIG. 8C is a triangular image showing the central direction of the observation region E. A direction indication image 60W4 shown in FIG. 8D is an image showing the central direction of the observation area E by the positional relationship of a plurality of dots (points) (in the figure, the direction in which the dots are concentrated is the observation area E). Shows the center direction). In the direction indicating image 60W4, each dot may be blinked periodically to suggest the central direction of the observation area E. By displaying the direction indication image, the driver 102 can instantly grasp that his / her viewpoint position is at the end of the observation area E and that the stereoscopic display cannot be performed if the viewpoint position is further moved. it can. Further, since the direction indication image is an image suggesting the central direction of the observation area E, the driver 102 instantaneously determines the direction in which the viewpoint should be moved in order to return to the normal display in which the direction indication image is not displayed. Can do.

7B, the driver's viewpoint moves further to the right (left direction in FIG. 7) when viewed from the driver 102 from FIG. 7A, and the center of the viewpoint of the driver 102 is in the side lobe. The case where it locates in the area | region E4 is shown. At this time, the right eye of the driver 102 is located outside the observation region E, and the left eye is located in the region E4 in the side lobe. In this case, based on the left eye viewpoint position, the left eye image 60L and the right eye are observed so that the right eye image 60R is observed in the regions E2 and E3 and the left eye image 60L is observed in the regions E1 and E4. The display position on the display means 30 with the image for use 60R is determined. Specifically, the image displayed at the position corresponding to the region E2 on the display means 30 is for the left eye so that the image observed in the region E2 and the region E4 can be switched from the case of FIG. The divided image of the image 60L is changed to the divided image of the right-eye image 60R, and the image displayed at a position corresponding to the region E4 on the display unit 30 is changed from the divided image of the right-eye image 60R to the left-eye image. It is changed to a 60L divided image. In this case, since it is determined that the left eye of the driver 102 has reached the side lobe, the image observed by the driver 102 in the region E4, that is, the left eye displayed at a position corresponding to the region E4. The display brightness of the image 60L on the display means 30 is set higher than the display brightness when observed in the main lobe. However, the right-eye image 60R is not observed by the driver 102, and only the left-eye image 60L is observed and is displayed as a flat display.
At this time, the right eye of the driver 102 is located outside the observation region E. In this case, the CPU 21 determines that the right eye of the driver 102 has reached the outside of the observation area E, and designates the direction indicating the center direction of the observation area E as the left-eye image 60L that can be observed by the driver 102. The image is displayed on the display means 30. For example, the direction indication image shown in FIG. 8 is displayed as in the case of FIG. By displaying the direction indication image, the driver 102 can instantly recognize that the stereoscopic display cannot be performed because his / her viewpoint position is outside the observation area E. In addition, since the direction indication image is an image suggesting the center direction of the observation area E, the driver 102 can instantaneously determine the direction in which the viewpoint should be moved in order to return to the viewpoint position where stereoscopic display is possible. .

The HUD device 100 according to the present embodiment has a display unit 30 that displays the left-eye image 60L and the right-eye image 60R side by side, and a display control that causes the display unit 30 to display the left-eye image 60L and the right-eye image 60R. Means (control unit 20), image separation means 40 for separating the image for left eye 60L and the image for right eye 60R displayed on the display means 30, and position detection means for detecting the viewpoint position of the driver 102 ( An imaging unit 10 and a control unit 20),
The display control means is an observation region E in which either the left eye or the right eye of the driver 102 can observe the left-eye image 60L or the right-eye image 60R based on the viewpoint position detected by the position detection means. Of the observation area E as an image observed by the driver 102 out of the left-eye image 60L or the right-eye image 60R on the display means 30. Direction indication images 60W1 to 60W4 suggesting the center direction are displayed.

  The display method of the HUD device 100 is such that either the left eye or the right eye of the driver 102 can observe the left-eye image 60L or the right-eye image 60R based on the viewpoint position detected by the position detection unit. If it is determined that the image has reached the end of the observation area E or the outside of the observation area E, the image displayed on the display means 30 is the image observed by the driver 102 among the left-eye image 60L or the right-eye image 60R. Direction indication images 60W1 to 60W4 suggesting the central direction of the observation area E are displayed.

  According to this, the driver 102 can instantly grasp the direction for maintaining the three-dimensional display or the direction in which the three-dimensional display is possible by using the direction instruction images 60W1 to 60W4, and the driver 102 accompanying the movement of the viewpoint position. Can be alleviated.

  In the HUD device 100 according to the present embodiment, the display control unit generates a left-eye image 60L and a right-eye image 60R based on the viewpoint position detected by the position detection unit, respectively. The display position of the left-eye image 60L and the display position of the right-eye image 60R on the display means 30 are changed so as to be observed with the eyes.

  Further, according to the display method of the HUD device 100, the left eye image 60L and the right eye image 60R are observed by the left eye and the right eye of the driver 102 based on the viewpoint position detected by the position detection unit, respectively. Thus, the display position of the left eye image 60L and the display position of the right eye image 60R on the display means 30 are changed.

  According to this, even when the viewpoint of the driver 102 moves in the horizontal direction, the driver 102 can observe the left-eye image 60L and the right-eye image 60R with the left eye and the right eye, respectively. The display can be kept.

  In the HUD device 100 according to the present embodiment, the display control means is configured such that either the left eye or the right eye of the driver 102 is the left eye image 60L or the right eye based on the viewpoint position detected by the position detection means. When it is determined that the image 60R has reached a lateral region (side lobe) located outside a predetermined main region (main lobe) in the observable observation region E, the left eye image 60L or the right eye The display brightness in the display means 30 of the image visually recognized by the driver 102 in the side area of the image 60R is set higher than the display brightness in the case of being observed in the main area.

  The display method of the HUD device 100 is such that either the left eye or the right eye of the driver 102 can observe the left-eye image 60L or the right-eye image 60R based on the viewpoint position detected by the position detection unit. Of the left eye image 60L or the right eye image 60R when it is determined that the side area (side lobe) located outside the predetermined main area (main lobe) is reached in the observation area E. The display brightness in the display means 30 of the image visually recognized by the driver 102 in the side area is set higher than the display brightness in the case of being observed in the main area.

  According to this, even when a parallax image (the left-eye image 60L or the right-eye image 60R) is observed between the main lobe and the side lobe, stereoscopic display is possible, and the driver 102 is less uncomfortable. It becomes possible to do.

  Next, a second embodiment of the present invention will be described. In addition, the same code | symbol is attached | subjected to the same or equivalent part as above-mentioned 1st embodiment, and the detail is abbreviate | omitted.

  FIG. 9 shows an electrical configuration of the HUD device 200 according to the second embodiment of the present invention. The HUD device 200 is different from the HUD device 100 of the first embodiment described above in that a speaker 71, a seat belt retractor 72, a steering vibration unit 73, and a seat that perform a notification operation through hearing or touch of the driver 102 are provided. The control unit 20 includes a vibration unit 74 (an example of a notification unit) and a control unit 20 (an example of a notification control unit) that controls the speaker 71, the seat belt retractor 72, the steering vibration unit 73, and the seat vibration unit 74. When it is determined that either the left eye or the right eye of the driver 102 has reached the end of the observation area E or the outside of the observation area E based on the viewpoint position of the driver 102 detected by the imaging unit 10. Are connected to at least one of the speaker 71, the seat belt retractor 72, the steering vibration unit 73, and the seat vibration unit 74. Is the point to be executed intellectual behavior.

  The control unit 20 is electrically connected to the speaker 71, the seat belt retractor 72, the steering vibration unit 73, and the seat vibration unit 74 via the external device I / F 25. The CPU 21 outputs control signals to the speaker 71, the seat belt retractor 72, the steering vibration unit 73, and the seat vibration unit 74 via the external device I / F 25, and executes a notification operation that will be described in detail later. That is, the control unit 20 functions as a notification control unit of the present invention.

  The speaker 71 is mounted on the vehicle and outputs an arbitrary sound based on a control signal from the control unit 20. The driver 102 can perceive sound through hearing. That is, the speaker 71 outputs a voice as the notification operation through the hearing of the driver 102 and functions as a notification unit of the present invention.

  The seat belt retractor 72 is a device that winds up a belt portion (webbing) of a seat belt (not shown) that restrains the driver 102, and can retract the belt portion based on a control signal from the control unit 20. A motor is provided. The driver 102 can perceive the pressure caused by the pulling of the belt portion through the sense of touch. That is, the seat belt retractor 72 performs the pull-in of the belt portion as the notification operation through the tactile sensation of the driver 102 and functions as a notification unit of the present invention.

  The steering vibration unit 73 is composed of a vibrator arranged on a steering wheel (not shown) of the vehicle, and vibrates based on a control signal from the control unit 20 to vibrate the entire steering wheel. The driver 102 can perceive the vibration of the steering wheel through the sense of touch. That is, the steering vibration unit 73 performs vibration of the steering wheel as the notification operation through the tactile sense of the driver 102, and functions as a notification unit of the present invention. In addition, when the vibration sound of the steering wheel is generated, the vibration of the steering wheel can be the notification operation through the hearing of the driver 102.

  The seat vibration unit 74 is composed of a vibrator disposed in a seat (not shown) of the driver's seat of the vehicle, vibrates based on a control signal from the control unit 20, and particularly the seat surface and / or the back surface of the seat. Is to vibrate. The driver 102 can perceive the vibration of the seat through the sense of touch. That is, the seat vibration unit 74 performs the vibration of the seat as the notification operation through the tactile sense of the driver 102, and functions as a notification unit of the present invention. In addition, when the vibration sound of the seat is generated, the vibration of the seat may be the notification operation through the hearing of the driver 102.

  Based on the left eye viewpoint position and right eye viewpoint position of the driver 102 calculated in step S2 in FIG. 3, the CPU 21 has reached the outside or end of the observation region E. The left-eye image 60L or the right-eye image 60R that can be observed by the driver 102 is an image including a direction indication image that suggests the central direction of the observation region E shown in FIG. Control signals are output to the speaker 71, the seat belt retractor 72, the steering vibration unit 73, and the seat vibration unit 74 to execute the notification operation. FIG. 10 shows an example of the notification operation. In FIG. 10, when the left eye of the driver 102 reaches the left outer side or the left end (end region E21) of the observation area E (indicated as “left side” in FIG. 10), the driver 102 When the right eye 102 reaches the right outer side or right end (end region E31) of the observation area E (indicated as “right side” in FIG. 10), the number of notification operations is made different. Thus, the driver 102 can determine the central direction of the observation area E only by the notification operation. Specifically, when the left eye of the driver 102 reaches the left outside or the left end (end region E21) of the observation area E, the notification operation is executed once, and the right eye of the driver 102 is When the observation area E reaches the right outside or right end (end area E31), the notification operation is executed twice. In addition, when outputting sound from the speaker 71, sounds such as “Please move the viewpoint to the right” and “Please move the viewpoint to the left” are directly output to suggest the center direction of the observation area E. May be. When the display means 30 blinks the direction indication image, the speaker 71, the seat belt retractor 72, the steering vibration unit 73, and the seat vibration unit 74 execute the notification operation in synchronization with the blinking of the direction indication image. Also good.

  Taking the case shown in FIG. 7A as an example, the right eye of the driver 102 is within a predetermined distance from the boundary between the observation region E and the outside thereof in the central direction (the direction toward the main lobe in the horizontal direction). It is located in the end region E31 of the set end regions E21, E31. In this case, the CPU 21 determines that the right eye of the driver 102 has reached the right end of the observation region E, and the observation region E is used as the right eye image 60R and the left eye image 60L that can be observed by the driver 102. A direction indication image suggesting the center direction of the image is displayed on the display unit 30 and the speaker 71, the seat belt retractor 72, the steering vibration unit 73, and the seat vibration unit 74 are caused to execute the notification operation. At this time, as the notification operation by the speaker 71, a warning sound is output twice. Further, as the notification operation by the seat belt retractor 72, the belt portion is retracted and released twice. Further, as the notification operation by the steering vibration unit 73, vibration of the steering wheel for a predetermined time is performed twice. In addition, as the notification operation by the seat vibration unit 74, the seat is vibrated twice for a predetermined time. Note that not all of these notification operations need be executed, and one or more of them may be performed. Even when the notification operation is performed, the driver 102 instantly hears or senses that his / her viewpoint position is at the end of the observation area E, and that the stereoscopic display cannot be performed if the viewpoint position is moved any further. Can grasp. In addition, the driver 102 can instantaneously determine the direction in which the viewpoint should be moved in order to return to a normal state where the notification operation is not performed, according to the number of the notification operations.

  In addition, taking the case shown in FIG. 7B as an example, the right eye of the driver 102 is located outside the right side of the observation region E. In this case, the CPU 21 determines that the right eye of the driver 102 has reached the right outside of the observation area E, and suggests the center direction of the observation area E as the left-eye image 60L that can be observed by the driver 102. A direction instruction image is displayed on the display unit 30 and the speaker 71, the seat belt retractor 72, the steering vibration unit 73, and the seat vibration unit 74 execute the notification operation. At this time, as the notification operation by the speaker 71, a warning sound is output twice. Further, as the notification operation by the seat belt retractor 72, the belt portion is retracted and released twice. Further, as the notification operation by the steering vibration unit 73, vibration of the steering wheel for a predetermined time is performed twice. In addition, as the notification operation by the seat vibration unit 74, the seat is vibrated twice for a predetermined time. Note that not all of these notification operations need be executed, and one or more of them may be performed. Even when the notification operation is performed, the driver 102 can instantaneously grasp through auditory or tactile sense that the stereoscopic display cannot be performed because his / her viewpoint position is outside the observation area E. Further, the driver 102 can instantaneously determine the direction in which the viewpoint should be moved in order to return to the viewpoint position where stereoscopic display is possible, based on the number of the notification operations.

The HUD device 200 according to the present embodiment further includes notification means (speaker 71, seat belt retractor 72, steering vibration unit 73, and seat) that performs a notification operation through the auditory or tactile sensation of the driver 102 in addition to the configuration of the HUD device 100 described above. A vibration unit 74) and a notification control unit (control unit 20) for controlling the notification unit,
The notification control means determines that either the left eye or the right eye of the driver 102 has reached the end of the observation area E or the outside of the observation area E based on the viewpoint position detected by the position detection means. If so, the notification means is caused to execute the notification operation.

  According to this, by the notification operation, the driver 102 has his / her viewpoint position at the end of the observation area E, and if the viewpoint position is moved further, stereoscopic display cannot be performed, or his / her viewpoint position is observed. It is possible to instantly grasp through auditory or tactile sense that stereoscopic display is no longer possible because it is outside the region E. In addition, by performing the notification operation through hearing or tactile sense of the driver 102, attention to the direction indication images 60W1 to 60W4 suggesting the center direction of the observation area E can be urged, and driving accompanying movement of the viewpoint position The troublesomeness of the person 102 can be reduced.

  Further, the notifying means suggests a central direction of the observation region based on the number of the notification operations. According to this, the driver 102 can instantaneously grasp the direction for maintaining the stereoscopic display or the direction in which the stereoscopic display can be performed only by the notification operation, and the driver 102 accompanying the movement of the viewpoint position. Can be alleviated.

Further, the display control means (control unit 20) causes the display means 30 to blink and display the direction indicating images 60W1 to 60W4,
The notification control unit causes the notification unit to execute the notification unit in synchronization with blinking of the direction indication images 60W1 to 60W4.
According to this, by performing the notification operation in synchronization with the direction indication images 60W1 to 60W4, attention to the direction indication images 60W1 to 60W4 suggesting the central direction of the observation area E can be urged, and the movement of the viewpoint position Therefore, it is possible to reduce the troublesomeness of the driver 102.

The HUD device 200 is a stereoscopic display device mounted on a vehicle,
The notification means performs at least one of voice output, steering wheel vibration, seat vibration, and retracting of the belt portion of the seat belt as the notification operation.
According to this, it is possible to easily and surely execute the notification operation through hearing or tactile sense to the driver 102 of the vehicle.

  Note that the present invention is not limited to the above-described embodiment, and various modifications (including deletion of constituent elements) can be made without departing from the scope of the invention. In the present embodiment, the left-eye image 60L and the right-eye image 60R are displayed side by side on the display unit 30 (four in total), but the left-eye image 60L and the right-eye image 60R are displayed on the display unit 30. The eye images 60R may be displayed one by one, or three or more of each may be displayed. In the present embodiment, the HUD device 100 that displays the virtual image V is taken as an example of the stereoscopic display device. However, the present invention may be applied to a stereoscopic display device that directly recognizes the screen of the display unit. Moreover, although the HUD apparatus 100 of this embodiment was for vehicles, you may apply this invention to display apparatuses other than the object for vehicles.

  The present invention is applicable to a stereoscopic display device.

100, 200 Head-up display device 102 Driver (observer)
DESCRIPTION OF SYMBOLS 10 Imaging part 20 Control part 30 Display means 40 Image separation means 50 Concave mirror 60L Image for left eye 60R Image for right eye 60W1-60W4 Direction indication image 71 Speaker (notification means)
72 Seat belt retractor (notification means)
73 Steering vibration part (notification means)
74 Seat vibration part (notification means)

Claims (10)

Display means for displaying the left eye image and the right eye image side by side;
Display control means for causing the display means to display the left-eye image and the right-eye image;
Image separating means for separating the left-eye image and the right-eye image displayed on the display means;
A position detecting means capable of detecting an observer's viewpoint position, and a stereoscopic display device comprising:
The display control unit is configured to display an observation region in which either the left eye or the right eye of the observer can observe the left eye image or the right eye image based on the viewpoint position detected by the position detection unit. If it is determined that the image has reached the end or the outside of the observation area, the display means displays the center of the observation area as an image observed by the observer among the left-eye image or the right-eye image. A stereoscopic display device that displays a direction indication image that suggests a direction. The display control means is configured so that the left-eye image and the right-eye image are observed by the observer's left eye and right eye, respectively, based on the viewpoint position detected by the position detection means. The stereoscopic display device according to claim 1, wherein a display position of the left-eye image and a display position of the right-eye image in a display unit are changed. The display control means may be configured such that either the left eye or the right eye of the observer is located in a lateral area located outside a predetermined main area in the observation area based on the viewpoint position detected by the position detection means. When it is determined that the image has reached, the display brightness of the display means of the image visually recognized by the observer in the lateral region of the left-eye image or the right-eye image is observed in the main region. The stereoscopic display device according to claim 1, wherein the display brightness is higher than the display brightness in the case of the display. Informing means for performing an informing operation through the observer's auditory or tactile sense;
Notification control means for controlling the notification means,
The notification control means determines that either the left eye or the right eye of the observer has reached the end of the observation area or the outside of the observation area based on the viewpoint position detected by the position detection means. 2. The stereoscopic display device according to claim 1, wherein the notification unit causes the notification unit to execute the notification operation. The stereoscopic display device according to claim 4, wherein the notification unit suggests a central direction of the observation region based on the number of the notification operations. The display control unit causes the display unit to blink the direction indication image,
The stereoscopic display device according to claim 4, wherein the notification control unit causes the notification unit to execute the notification unit in synchronization with blinking of the direction indication image. A stereoscopic display device mounted on a vehicle,
5. The three-dimensional image according to claim 4, wherein the notification unit executes at least one of voice output, steering wheel vibration, seat vibration, and retracting of a belt portion of the seat belt as the notification operation. Display device. Display means for displaying the left eye image and the right eye image side by side;
Image separating means for separating the left-eye image and the right-eye image displayed on the display means;
A position detection means capable of detecting the viewpoint position of the observer, and a display method of a stereoscopic display device comprising:
Based on the viewpoint position detected by the position detecting means, either the left eye or the right eye of the observer can observe the image for the left eye or the image for the right eye, or the observation area. If it is determined that it has reached the outside of the image, a direction indication suggesting a central direction of the observation region as an image observed by the observer among the left-eye image or the right-eye image on the display means A display method for a stereoscopic display device, characterized by displaying an image. The left eye in the display means so that the left eye image and the right eye image are observed with the left eye and the right eye of the observer based on the viewpoint position detected by the position detection means, respectively. The display method of the stereoscopic display device according to claim 8, wherein the display position of the image for use and the display position of the image for the right eye are changed. Based on the viewpoint position detected by the position detection means, either the left eye or the right eye of the observer is located in a side area located outside a predetermined main area in the left eye image or the observation area. When it is determined that the image has reached, the display brightness of the display means of the image visually recognized by the observer in the lateral region of the left-eye image or the right-eye image is observed in the main region. The display method of the stereoscopic display device according to claim 8 or 9, wherein the display brightness is higher than the display brightness in the case of the display.

Images