JP2013033344A - Display device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To notify a vehicle side that a warning or the like is recognized, while securing safety.SOLUTION: When a driver 60 extends a hand toward notification video 58 displayed above a steering wheel and the position of the hand (a finger) is identical to the position of the notification video 58, a notification control part 23 determines that the driver 60 has recognized the notification video 58 and performs processing such as stopping the display of the notification video 58 or the like. In short, the notification video 58 functions as a message switch. In addition, when the finger of the driver 60 makes a motion as if the driver operates the notification video 58, the motion is recognized as operation on the vehicle and the vehicle is controlled according to the operation.

Description

  The present invention relates to a display device, for example, a display device mounted on a vehicle or various operating devices.

  In general, a message such as a warning about running out of fuel or seat belt attachment / detachment is displayed on a vehicle panel such as an instrument panel on a display or the like. In general, it is unclear whether the driver or the like has confirmed the message after display. In some vehicles, by pressing a predetermined switch, it is possible to inform the vehicle that the driver has accepted the message and terminate the warning.

  However, there is a portion between the driver and the vehicle panel that becomes a barrier for switch operation, such as a steering wheel. For this reason, the switches installed on the vehicle panel often become extremely difficult to operate. In addition, when a switch is provided on the vehicle panel, it is necessary to move not only the hand but also the body when the switch is operated. However, it is preferable to avoid such movements so that the driver can concentrate on safe driving.

  In recent years, a switch is arranged on a steering wheel or the like in some vehicles in order to reduce the movement of the body or the movement of a hand during driving.

  There is a technology for outputting a virtual image of an alarm by a head-up display and further generating an alarm sound from a speaker in synchronization with the virtual image display (see Patent Document 1). The driver can be alerted. Furthermore, as a technique for prompting further attention, there is a technique for flashing a virtual image (see Patent Document 2). Furthermore, there is a technique in which the vehicle side recognizes whether or not the LED has been seen through image analysis by turning on an alarm with an LED, photographing a human face with a camera, and analyzing the image (see Patent Document 3).

JP 2010-15596A JP 2010-140253 A JP 2010-113601 A

  By the way, regarding a technique for providing a predetermined switch on a steering wheel or the like, another technique has been demanded because space is limited and many switches are already occupied by switches for audio operation, air conditioner operation, and the like. Furthermore, the techniques disclosed in Patent Documents 1 and 2 merely output a vehicle warning, and do not disclose any technique for notifying the vehicle that the driver has confirmed the warning. In the technique disclosed in Patent Document 3, it is possible to automatically determine whether a person has recognized an alarm, but the alarm output is a conventional lamp display such as an LED, and it is preferable to enhance the ability of alerting, Further, there is a problem that the driver cannot confirm whether or not the vehicle side has recognized.

  This invention is made | formed in view of such a condition, and it aims at providing the technique which solves the said subject.

The display device according to the present invention includes a video output unit that displays an image formed in space using an LRP display device, and a finger that detects whether a user instruction means is located at the image formation position of the image. A detection unit; and a determination unit that determines that the user has recognized the video when the position of the video matches the instruction unit.
The determination unit may change the display mode of the video when it is determined that the user has recognized the video.
In addition, a state detection unit that detects the state of the mounted device may be provided, and the determination unit may determine whether to perform display using the LRP display device according to the state of the device. .
Another display device of the present invention detects an image output unit that displays an image formed in space by using an LRP display device, and whether a user instruction means is located at the image formation position of the image. An instruction detection unit that changes the display state of the video according to the movement of the instruction unit, and an operation state change unit that changes the operation control of the operation target according to the movement of the instruction unit And comprising.

  ADVANTAGE OF THE INVENTION According to this invention, the technique which can grasp | ascertain an operation state reliably can be provided.

It is a figure which shows the basic principle regarding the display using the three-dimensional-video aerial projection panel based on Embodiment. It is a figure which shows typically the state which applied the stereoscopic image aerial projection panel based on embodiment to a vehicle. It is a functional block diagram which shows schematic structure of the vehicle display apparatus based on embodiment. It is a process of the flowchart which shows the message switch display process based on Example 1 of an embodiment. It is a figure which shows the example of a display of the message switch based on Example 1 of an embodiment. It is a figure which shows the example of a display of the message switch based on Example 1 of an embodiment. It is a process of the flowchart which shows the message switch display process based on Example 2 of an embodiment. It is a figure which shows the example of a display of the dial based on Example 2 of embodiment. It is a figure which shows the example of a display of the dial based on Example 2 of embodiment. It is a figure which shows the example of a display of the dial based on Example 2 of embodiment. It is a figure which shows the example of a display of the dial based on Example 2 of embodiment.

  Hereinafter, modes for carrying out the invention (hereinafter referred to as “embodiments”) will be described with reference to the drawings. The outline of the present embodiment is as follows. In the present embodiment, a display technology using a stereoscopic video aerial projection panel (LRP: Longitudinal Reflection Plate) is used. This technique is disclosed in, for example, Japanese Patent Application Laid-Open No. 2009-53262 (Basic Technology 1), Japanese Patent Application Laid-Open No. 2009-53263 (Basic Technology 2), and International Publication No. 2009/131128 (Basic Technology 3). It is unnecessary to attach any special equipment to the eyes, and the target image (subject) is imaged again in the air and displayed by a simple special reflection panel. And you can bring your hand as if you can touch the image formation position, and at that time, you can display the image that it will slip through because there is no substance in the air and space is there.

  FIG. 1 shows a basic principle regarding a display device using a stereoscopic video aerial projection panel. Details are described in the basic techniques 1 to 3 described above, and will be briefly described here. FIG. 1 is an explanatory diagram based on a sectional view, and FIG. 1 (b) is an explanatory diagram based on a perspective view. In FIG. 1A and FIG. 1B, the arrangement of the internal shielding screen is changed.

  As shown to Fig.1 (a), this display apparatus is provided with the LRP panel 54 arrange | positioned as a part of internal shielding screen. The internal shielding screen corresponds to the dashboard 68 in an application example to a vehicle described later. For example, a real image is displayed on the liquid crystal display 52 inside the screen. The actual video screen (liquid crystal display 52) is disposed to be inclined with respect to the LRP panel 54 by a predetermined angle θ. Then, the aerial image is re-imaged at a position symmetrical to the LRP panel 54 with respect to the actual image. This aerial image is used as a notification image 58 when applied to a vehicle.

  Specifically, the image (light fluxes A11 to A13) output from the first image point A1 of the actual image is reflected to the outside of the internal shielding screen at the same reflection angle as the incident angle to the LRP panel 54. For example, the incident angle θ1 and the reflection angle θ1 ′ of the light beam A11 are θ1 = θ1 ′ as illustrated. Each of the light beams A11 to A13 forms an image on the LRP panel 54 at a first re-imaging point A2 that is a position symmetrical to the first video point A1. Similarly, the light beams B11 to B13 output from the second video point B1 of the real image are imaged at the second re-imaging point B2 that is a position symmetrical to the second video point B1 with respect to the LRP panel 54. As a result, a real image (aerial image) can be formed at a symmetrical position on the opposite side of the subject with respect to the LRP panel 54. As shown in FIG. 1B, the internal shielding screen does not need to coincide with the LRP panel 54, and by using a transparent member, an aerial image can be realized as in FIG.

  FIG. 2 shows an example in which the LRP display device 50 is arranged on a part of the instrument panel of the vehicle. On the dashboard 68, the LRP panel 54 is disposed in the transparent cover portion on the driver side of the instrument panel 31. At this time, the liquid crystal display 52 is disposed inside the dashboard 68 (transparent cover). Then, an aerial image (corresponding to a notification video 58 described later) is displayed at a position symmetrical to the liquid crystal display 52 with respect to the LRP panel 54. Here, from the eye range ER of the driver 60, the aerial image (notification image 58) is just between the front window glass 90 and the steering wheel 66. This imaging position can be adjusted by the arrangement of the LRP panel 54 and the liquid crystal display 52.

  In the present embodiment, the display by the LRP display device 50 is applied to a warning lamp. When the driver 60 reaches for the notification image 58 displayed on the steering wheel 66 and the hand matches the position of the notification image 58, the vehicle determines that the driver 60 has recognized the notification image 58, and notifies Processing such as stopping the display of the video 58 is performed. That is, the notification video 58 functions as a message switch (Example 1 described later). Further, when the finger of the driver 60 moves as if operating the notification image 58, it is recognized as an operation on the vehicle, and vehicle control corresponding to the operation is performed (Example 2 described later).

  FIG. 3 is a functional block diagram showing a schematic configuration of the vehicle display device 10 according to the present embodiment. Here, it mainly shows the display system of the vehicle. The vehicle display device 10 includes a control unit 20, a display unit 30, a vehicle state sensor 36, an external sensor 37, an audio output unit 38, and a space operation detection unit 40.

  The spatial operation detection unit 40 detects the notification video 58 and the movement of the finger of the driver 60 in the vicinity thereof. The detection result is notified to the space operation control unit 24. In addition, the space operation detection part 40 is realizable by using detection apparatuses, such as a well-known human body sensor, For example, the technique of Unexamined-Japanese-Patent No. 2010-71984 and Unexamined-Japanese-Patent No. 2009-109508 can be used. With these techniques, the human body can be detected with high accuracy.

  The control unit 20 includes a vehicle control unit 21, a display control unit 22, a notification control unit 23, and a space operation control unit 24. The vehicle control unit 21 controls the vehicle in an integrated manner, and executes each function in cooperation with the display control unit 22, the notification control unit 23, and the space operation control unit 24.

  The display control unit 22 performs display control of the display unit 30 (the instrument panel 31 and the LRP display device 50) in cooperation with the vehicle control unit 21. The notification control unit 23 performs warning light display control and output control to the audio output unit 38 in accordance with the detection results of the vehicle state sensor 36 and the external sensor 37. The space operation control unit 24 determines whether or not the hand of the driver 60 has moved to the position of the notification image 58 based on the detection result of the space operation detection unit 40, and further to a more specific position of the notification image 58. Detect if it is moving. The detection result of the space operation control unit 24 is notified to the notification control unit 23 via the vehicle control unit 21. At that time, the notification control unit 23 performs display control according to the detection result.

  The vehicle state sensor 36 includes sensors that detect the state of the vehicle such as a vehicle speed sensor, a steering angle sensor, a yaw rate sensor, and a fuel amount sensor, and the detection result is notified to the vehicle control unit 21. The external sensor 37 is composed of sensors such as a camera and a radar, and detects the presence / absence, relative distance, relative speed, and the like of an object (another vehicle or person) near the vehicle. The detection result is notified to the vehicle control unit 21. The audio output unit 38 includes an amplification device and a speaker, and can output an alarm sound or the like.

  The alarm processing procedure for the driver 60 by the vehicle display device 10 having the above configuration will be described in a more specific embodiment.

<Example 1>
In the first embodiment, a fuel warning (fuel gauge) will be described with reference to the flowchart of FIG. 4 and the display examples of FIGS. The fuel gauge is arranged as one component of the instrument panel 31, and when a warning is not required, a pointer is displayed on the instrument panel 31 like a general fuel gauge.

  The vehicle control unit 21 acquires detection results of the vehicle state sensor 36, the external sensor 37, and the like, and continuously determines whether or not a matter requiring a warning has occurred by displaying a message (N in S10). ). Here, it is determined whether or not the fuel amount has become less than a predetermined value. If it is determined that a message display item has occurred (Y in S10), that is, if the fuel amount becomes less than a predetermined value, the notification control unit 23 controls the display control unit 22 and uses the LRP display device 50 to switch the message switch. The notification video 58 that functions as a message is displayed (S11). FIG. 5 shows a state in which the fuel gauge image is displayed in the upper space of the steering wheel 66 as the notification image 58.

  Subsequently, the space operation control unit 24 starts the finger position detection process of the driver 60 using the space operation detection unit 40 (S12). When the position detection process is started, the space operation control unit 24 continues the detection process until the finger of the driver 60 matches the display position (coordinates) of the notification video 58 that is a message switch (N in S13). As shown in the display example of FIG. 6, when the notification image 58 of the finger matches (Y in S13), the notification control unit 23 determines that the driver 60 has recognized the notification image 58 (S14), and performs display control. The display of the notification video 58 by the LRP display device 50 is erased by controlling the unit 22 (S15).

  In this way, the notification image 58 is displayed in the upper space of the steering wheel 66, and the display of the notification image 58 is erased by the operation of the user's finger, so that the driver 60 has recognized the alarm by himself / herself. Can be notified to the vehicle side. Further, the operation of the driver 60 allows the driver 60 to reliably store the alarm in the memory. That is, the driver 60 and the vehicle can share the information that “the driver 60 has confirmed the alarm”.

  Note that the size and color of the notification video 58 may be changed according to the importance of the alarm. For example, when the fuel amount is further reduced, the notification video 58 can be enlarged by increasing the display on the liquid crystal display 52. Further, in the case of a highly urgent alarm, by changing the display position on the liquid crystal display 52, it is possible to improve the visibility with respect to the driver 60 and to further promote attention. Further, an optical system composed of a plurality of lenses may be arranged between the liquid crystal display 52 and the LRP panel 54, and the display distance of the notification video 58 may be changed in a pseudo manner by moving these lens positions. The same effect can be obtained even if the LRP panel 54 itself is movable.

<Example 2>
In this embodiment, the present invention is adapted to the auto cruise function of the vehicle. When the driver 60 touches the speedometer configured on the touch panel vehicle panel (instrument panel 31), the speedometer video is displayed as a notification video 58 in the upper space of the steering wheel 66. Furthermore, when a movement of moving the hand 59 of the speedometer image is detected, a target speed corresponding to the changed finger position is set.

  First, when the switch operation mode is turned on, an operation to the dial (speedometer) is permitted (S20). Next, as shown in FIG. 8, when a dial display on the vehicle panel, here, contact with the speedometer is detected (S21), the notification control unit 23 controls the LRP display device 50 to correspond to the speedometer. The dial to be displayed is displayed as a virtual image in the upper space of the steering wheel 66 as shown in FIG. 9 (S22). Here, the dial pointer 59 is displayed in a zero state.

  Subsequently, the space operation control unit 24 starts the finger position detection process of the driver 60 using the space operation detection unit 40 (S23). When the position detection process starts, the space operation control unit 24 determines whether or not the finger of the driver 60 matches the coordinates on the dial pointer 59 (S24). When it matches with the pointer 59 (Y in S24), the notification control unit 23 controls the LRP display device 50 when the finger moves from the matching position, and after the finger moves as shown in FIG. The display of the pointer 59 is moved to the position (S25). Furthermore, the notification control unit 23 notifies the vehicle control unit 21 of the position of the new pointer 59, and the vehicle control unit 21 receives the notification and sets the speed corresponding to the pointer 59 as the target speed (S26).

  On the other hand, in the process of S24, when it does not coincide with the pointer 59 (N of S24), the notification control unit 23 further determines whether or not the finger of the driver 60 is the same as the dial coordinates except on the pointer 59 ( S27). If they do not match (N in S27), the finger position detection process of the driver 60 is continued (S23). As shown in FIG. 11, when the finger coincides with the coordinates of the dial except on the pointer 59 (Y in S27), the notification control unit 23 determines that the dial switch operation mode is turned off (S28), and the LRP The display of the notification video 58 by the display device 50 is stopped (S29).

  According to the present embodiment, the notification image 58 as a dial display is displayed in the space immediately above the steering wheel 66, so that the driver 60 can safely operate the notification image 58 and induce a dangerous state. Can be prevented. That is, since the driver 60 can display a display with a desired switch function in a place where the body or face is not moved greatly for the switch operation, it is possible to prevent a dangerous state from being generated by the switch operation.

  In addition, compared to the case where buttons or the like are arranged as operation means, the degree of freedom of display is increased because it is not confined to a narrow space such as the instrument panel 31. Furthermore, since the switch can be installed at the same position on the instrument panel 31, the commonality of the interface is maintained, and usability for the driver 60 can be ensured.

  Furthermore, when the dial switch operation mode is to be turned off, for example, in the case of an auto-cruise function, the notification video 58 is not displayed when it is determined to be an urban area in conjunction with navigation (not shown). This makes it possible to provide more appropriate driving assistance. Further, it is possible to perform a process such that the notification video 58 is not displayed when the steering wheel is operated by the rudder angle sensor.

  The present invention has been described based on the embodiments. This embodiment is an exemplification, and it is understood by those skilled in the art that various modifications can be made to each of those components and combinations thereof, and such modifications are also within the scope of the present invention. Although this embodiment demonstrated the aspect mounted in a vehicle, it can also apply to board machines, electronic musical instruments, etc., such as a game machine, various analysis equipment, medical equipment, an elevator. In that case, it is possible to reliably grasp the operations on the devices, and to avoid an erroneous operation on the devices due to distraction. Further, the functions of the first embodiment and the second embodiment may be mounted on the same vehicle, and those functions may be appropriately selected and executed.

DESCRIPTION OF SYMBOLS 10 Vehicle display apparatus 20 Control part 21 Vehicle control part 22 Display control part 23 Notification control part 24 Spatial operation control part 30 Display part 31 Instrument panel 36 Vehicle state sensor 37 External sensor 38 Audio | voice output part 50 LRP display apparatus 52 Liquid crystal display 54 LRP panel 58 Notification video 59 Guideline 60 Driver 68 Dashboard

Claims (4)

An image output unit that displays an image formed in space using an LRP display device;
A finger detection unit for detecting whether a user instruction means is located at the image formation position of the image;
A determination unit that determines that the user has recognized the video when the instruction means and the position of the video match;
A display device comprising:   The display device according to claim 1, wherein the determination unit changes a display mode of the video when it is determined that the user recognizes the video. It has a state detection unit that detects the state of the mounted device,
The display device according to claim 1, wherein the determination unit determines whether to perform display using the LRP display device according to a state of the device. An image output unit that displays an image formed in space using an LRP display device;
An instruction detector for detecting whether a user instruction means is located at the image formation position of the image;
A display mode changing unit that changes a display state of the video according to the movement of the instruction unit;
An operation state changing unit that changes the operation control of the operation target according to the movement of the instruction means;
A display device comprising:

Images