JP7367680B2 - display device - Google Patents

Description

The present invention relates to a display device.

As a conventional display device, Patent Document 1 discloses a navigation system mounted on a vehicle. Further, Patent Document 1 discloses that a common switch is provided for a plurality of in-vehicle devices including a navigation system, and when the line of sight of a vehicle occupant is directed toward one of the plurality of in-vehicle devices, A device is disclosed that uses a pilot lamp to notify a crew member that equipment can be operated with a switch. This device allows occupants to select the in-vehicle device they want to operate with their eyes, without using their hands, and operate it using a common switch.

Japanese Patent Application Publication No. 2011-957

In the device according to Patent Document 1, when a driver of a vehicle selects an operation target with his/her line of sight, his or her line of sight tends to deviate from the scene in front of the vehicle that should be focused on while driving.

The present invention has been made in view of the above-mentioned circumstances, and an object of the present invention is to provide a display device that allows a user to safely select an operation target even while driving.

In order to achieve the above object, a display device according to the present invention includes:
A display device mounted on a vehicle,
a plurality of display units that display images and are located at different positions;
an operation unit that allows operations on each of the plurality of display units;
a control unit that receives the operation performed on the operation unit and controls display of the plurality of display units,
The plurality of display units include a display unit that displays an image as a virtual image in front of the vehicle as seen from the driver of the vehicle,
The control unit is capable of identifying whether any of the plurality of display units is in a visible state where it is visible to the driver for a certain period of time or more,
When a display unit in the visible state is identified among the plurality of display units, displaying a cursor image on the display unit indicating that the display unit can be operated;
The plurality of display units include a first display unit that displays an image as the virtual image, and a second display unit,
When the control unit acquires warning information from the vehicle, the control unit displays a first warning image for notifying the warning information on the first display unit, and notifies the warning information on the second display unit. display a second warning image for
As an image for emphasizing the first warning image or the second warning image, an emphasized image in the same manner as the cursor image is moved from one of the first display section and the second display section to the other. to be displayed.

According to the present invention, it is possible to safely select an operation target even while driving.

FIG. 2 is a diagram for explaining how a display device according to an embodiment of the present invention is mounted on a vehicle. FIG. 3 is a diagram for explaining a display mode of a head-up display included in a display device according to an embodiment of the present invention. FIG. 1 is a block diagram mainly showing a display device according to an embodiment of the present invention. It is a flowchart of selection control processing concerning one embodiment of the present invention. (a) to (c) are diagrams for explaining display examples of cursor images. (a) and (b) are diagrams for explaining display examples of cursor images. (a) to (c) are diagrams for explaining an example of an operation when executing a warning process. (a) to (d) are diagrams for explaining an example of an operation when executing a warning process according to a modification.

A display device according to an embodiment of the present invention will be described with reference to the drawings.

As shown in FIG. 1, the display device 100 according to the present embodiment includes a first display section 11 and a second display section 12 (hereinafter collectively referred to as "a plurality of ), and not only information regarding the vehicle 1 (hereinafter also referred to as "vehicle information"), but also information other than vehicle information is integrally reported to the driver 5 (see FIG. 2). Note that the vehicle information includes not only information about the vehicle 1 itself but also information external to the vehicle 1 related to the operation of the vehicle 1.

The display device 100 includes a HUD (Head-Up Display) 21, a meter 22, and a control device 30, as shown in FIG.

The first display section 11 is realized by the HUD 21, and the second display section 12 is realized by the meter 22. As shown in FIG. 1, the first display section 11 and the second display section 12 are located at different positions from each other, and specifically, they are adjacent to each other with an interval in the vertical direction as seen from the driver 5. .

As shown in FIG. 2, the HUD 21 is provided inside the dashboard 2 and emits display light L toward the windshield 4 that has been subjected to combiner treatment. The display light L reflected by the windshield 4 heads toward the driver 5 side. By placing the viewpoint within the eye box E, the driver 5 can visually recognize the image represented by the display light L as a virtual image V in front of the windshield 4. That is, the HUD device 100 displays the virtual image V at a position in front of the windshield 4. Thereby, the driver 5 can observe the virtual image V superimposed on the scenery.

Here, the first display section 11 in this specification indicates an arbitrary portion between the eye box E and the display position of the virtual image V, as shown in FIG. Furthermore, displaying the virtual image V by the HUD 21 is also expressed as "displaying an image on the first display unit 11." The display positions of the eye box E and the virtual image V are set in advance based on the size of the display surface of the LCD 21a, which will be described later, and an optical system constituted by various mirrors in the HUD and the windshield 4 subjected to combiner processing.

As shown in FIG. 3, the HUD 21 includes an LCD (Liquid Crystal Display) 21a, a light source 21b (backlight) that illuminates the LCD 21a from behind, and a reflection section made of a plane mirror and a concave mirror (not shown). . For example, the LCD 21a is of a TFT (Thin Film Transistor) type, and the light source 21b is comprised of an LED (Light Emitting Diode).

Under the control of the control device 30, the HUD 21 generates display light L by causing the LCD 21a illuminated by the light source 21b to display an image. The generated display light L is emitted toward the windshield 4 after being reflected by the reflection section. Thereby, as described above, it becomes possible to display an image showing vehicle information on the first display section 11. Note that the content notified by the HUD 21 as an image may overlap with a part of the content notified by the meter 22.

As shown in FIG. 1, the meter 22 is located in front of the steering wheel 3 when viewed from the driver 5, and reports measured quantities related to the vehicle 1, such as vehicle speed, engine speed, total travel distance, and section travel distance. That is, the meter 22 can display an image showing a speedometer, tachometer, odometer, trip meter, etc. As shown in FIG. 3, the meter 22 includes an LCD 22a and a light source 22b (backlight) that illuminates the LCD 22a from behind. For example, the LCD 22a is of a TFT type, and the light source 22b is composed of an LED. The meter 22 displays an image showing the measured amount on the second display section 12 under the control of the control device 30. In other words, the second display section 12 is the area of the LCD 22a that can display images.

The control device 30 is composed of a microcomputer that controls the overall operation of the display device 100, and includes a control section 31, a ROM (Read Only Memory) 32, and a RAM (Random Access Memory) 33, as shown in FIG. . The control device 30 also includes a drive circuit and an input/output circuit for communicating with various systems in the vehicle 1, as components not shown. Further, the control device 30 appropriately measures time using a built-in timer.

The ROM 32 stores operating programs and various image data in advance. The RAM 33 temporarily stores various calculation results. The control unit 31 includes a CPU (Central Processing Unit) 31a that executes an operation program stored in a ROM 32, and a GDC (Graphics Display Controller) 31b that executes image processing in cooperation with the CPU. The GDC 31b includes, for example, a GPU (Graphics Processing Unit), an FPGA (Field-Programmable Gate Array), an ASIC (Application Specific Integrated Circuit), and the like. In particular, the ROM 32 stores an operating program for executing selection control processing, which will be described later. Furthermore, the configurations of the control device 30 and the control section 31 are arbitrary as long as they satisfy the functions described below.

The control unit 31 drives and controls each of the HUD 21 and the meter 22. For example, the CPU 31a drives and controls each of the light source 21b of the HUD 21 and the light source 22b of the meter 22. Further, the GDC 31b controls the driving of each of the LCD 21a of the HUD 21 and the LCD 22a of the meter 22 in cooperation with the CPU 31a.

The CPU 31a of the control unit 31 performs display control of each of the plurality of display units based on various image data stored in the ROM 32 in cooperation with the GDC 31b. The GDC 31b determines the control content of the display operation of each of the plurality of display sections based on the display control command from the CPU 31a. The GDC 31b reads from the ROM 32 image part data necessary to configure one screen to be displayed on each of the plurality of display units, and transfers it to the RAM 33. Further, the GDC 31b uses the RAM 33 to create picture data for one screen based on image part data and various image data received via communication from outside the display device 100. Then, when the GDC 31b completes one screen worth of picture data in the RAM 33, it transfers it to each of the plurality of display units in accordance with the image update timing. As a result, images corresponding to each of the plurality of display sections are displayed. Further, as will be described later, the control unit 31 receives an operation performed on the operation unit 70 and controls the display operation according to the received operation.

The CPU 31a of the control unit 31 communicates with each of the situation analysis unit 40, ECU (Electronic Control Unit) 50, line of sight detection unit 60, and operation unit 70 mounted on the vehicle 1. As the communication, for example, communication methods such as CAN (Controller Area Network), Ethernet, MOST, and LVDS (Low Voltage Differential Signaling) can be applied.

The situation analysis unit 40 outputs data indicating the situation of the vehicle 1 (hereinafter also referred to as the own vehicle 1) itself and the surrounding situation of the own vehicle 1 to the control unit 31 and the ECU 50. The situation analysis unit 40 performs communication between the vehicle 1 and a wireless network (V2N: Vehicle To Cellular Network), communication between the vehicle 1 and other vehicles (V2V: Vehicle To Vehicle), and communication between the vehicle 1 and pedestrians (V2P: It is equipped with various modules that enable communication between the vehicle 1 and roadside infrastructure (V2I: Vehicle To Pedestrian) and roadside infrastructure (V2I). In other words, the situation analysis unit 40 enables communication between the vehicle 1 and the outside of the vehicle 1 using V2X (Vehicle To Everything).

For example, (i) the situation analysis unit 40 communicates with a communication module that can directly access the WAN (Wide Area Network), an external device that can access the WAN (such as a mobile router), an access point of a public wireless LAN (Local Area Network), etc. It is equipped with a communication module for Internet communication. Further, the situation analysis unit 40 includes a GPS controller that calculates the position of the vehicle 1 based on a GPS (Global Positioning System) signal received from an artificial satellite or the like. These configurations enable V2N communication. (ii) Furthermore, the situation analysis unit 40 includes a wireless communication module that complies with a predetermined wireless communication standard, and performs V2V or V2P communication. (iii) The situation analysis unit 40 also has a communication device that wirelessly communicates with roadside infrastructure, and for example, from a base station of a driving safety support system (DSSS) to a roadside infrastructure installed as infrastructure. Obtain traffic information via a wireless device. This enables communication by V2I.

The situation analysis unit 40 also includes a stereo camera that images the outside of the vehicle 1, and object detection means consisting of a sonar, an ultrasonic sensor, and a millimeter wave radar, and detects danger around the vehicle 1 and warns of the detected danger. It is transmitted to the CPU 31a as information. For example, the control unit 31 displays, on the first display unit 11 corresponding to the HUD 21, an image for reporting warning information superimposed on an object to be warned (a vehicle in front of the vehicle 1, a pedestrian, etc.). Note that the warning information sent to the CPU 31a is based on traffic information that can be acquired through V2N or V2I communication, approaching vehicle information that can be acquired through V2V communication, pedestrian information that can be acquired through V2P communication, etc. Good too.

ECU 50 controls each part of vehicle 1 based on information from each of situation analysis section 40, line of sight detection section 60, and operation section 70. For example, the ECU 50 transmits vehicle speed information indicating the current vehicle speed of the vehicle 1 to the CPU 31a. Note that the CPU 31a may obtain vehicle speed information from a vehicle speed sensor. Further, the ECU 50 transmits measured quantities such as engine rotational speed, warning information of the vehicle 1 itself (low fuel, abnormal engine oil pressure, abnormal tire air pressure, etc.), and other vehicle information to the CPU 31a. Based on the information acquired from the ECU 50, the CPU 31a causes the meter 22 to display vehicle information such as vehicle speed, engine speed, and various warnings via the GDC 31b. Note that the CPU 31a may display at least a portion of the vehicle information on the first display unit 11 corresponding to the HUD 21.

The line of sight detection section 60 includes, for example, an imaging means (for example, a stereo camera) that images the face of the driver 5 and generates imaged data, and an image processing section that performs image processing of the imaged data, and detects the direction of the driver's 5 line of sight. Detect. For example, the line-of-sight detection unit 60 detects the line-of-sight direction of the driver 5 using a known image analysis method such as a pattern matching method, and transmits detection data indicating the detection result to the CPU 31a. The CPU 31a stores in advance in the ROM 32 the line-of-sight direction, the position of each of the plurality of display sections (the first display section 11 and the second display section 12), and the later-described content image displayed in a predetermined display section. The object that the driver 5 is currently viewing is specified by referring to the table data in which the display position of the driver 5 is associated with the display position of the object. That is, the CPU 31a specifies whether the predetermined object is in a visible state where it is visually recognized by the driver 5 or in a non-visible state where it is not visually recognized. Note that the line of sight direction may be detected based on either of the eyes of the driver 5, or may be detected as the center of gravity of both eyes, for example. The detection data is arbitrary as long as the CPU 31a can specify whether or not the driver 5 is visually recognizing a certain object. Further, the line of sight detection unit 60 may detect the direction of the driver's 5 face using a known image analysis method, and may use the detection data as detection data. In this case, the CPU 31a refers to table data stored in advance in the ROM 32 in which the face direction is associated with the position of each of the plurality of objects, and the CPU 31a visually recognizes a certain object by the driver 5 at present. All you have to do is determine whether it is there or not.

Further, the line of sight detection unit 60 may be an imaging means mounted on a wearable device worn on the head of the driver 5, an electrooculography sensor, or a motion sensor. The direction of the line of sight and the direction of the face can be detected using the image data captured by the image capturing means in the same way as described above. Further, the electro-oculogram sensor detects the direction of the driver's 5 line of sight based on the measured electro-oculogram. Further, the motion sensor includes, for example, one or a combination of an acceleration sensor, a gyro sensor, and a geomagnetic sensor, and detects the direction of the driver's 5 face.

Note that the CPU 31a may be configured to detect the direction of the driver's 5 line of sight and the orientation of the face based on signals from an imaging device or various sensors. If the CPU 31a can identify whether a certain object is in a visible state in which the driver 5 is visible or in a non-visible state in which it is not visible, the method for detecting the direction of the driver's 5 line of sight or the direction of the face can be used. And the detection configuration is arbitrary.

The operation section 70 is made up of a steering switch and a touch panel provided on the steering wheel 3, detects operations performed by the driver 5 on the operation section 70, and outputs the detection results to the ECU 50 and the control section 31. Through a selection control process to be described later, the driver 5 can select an object to be operated using a cursor image (notification image) C displayed according to the movement of the driver's line of sight, and can operate the selected object using the operating unit 70. The operation unit 70 detects operations on each of the plurality of display units. Operations on the first display section 11 corresponding to the HUD 21 include, for example, setting operations and selection operations for map information and route guidance information displayed as a virtual image V. Operations on the second display section 12 corresponding to the meter 22 include, for example, an odometer confirmation operation, a trip meter setting operation, and a display mode setting operation for the meter 22. Further, the operations on the first display section 11 and the second display section 12 may include a reproduction operation, a selection operation, etc. when displaying entertainment information, which will be described later. Note that the display content on each display section and the type of operation on each display section are not limited to these examples, but are arbitrary.

The vehicle 1 also includes an entertainment system for displaying entertainment information on the display device 100 and an audio input/output unit, as components not shown. The entertainment system includes a video/music playback section. The entertainment system may use a part of the situation analysis unit 40 described above to communicate with the outside. For example, as a video/music playback section, an entertainment system can play video and music recorded on recording media such as built-in memory, CDs (Compact Discs), and DVDs (Digital Video Disks). Such information (work title, author name, etc.) is supplied to the control unit 31 as entertainment information. Further, the video/music playback section outputs the sound played from the speaker of the audio input/output section. The audio input/output section includes a microphone, a speaker, and the like. The audio input/output unit outputs predetermined audio from the speaker in response to an audio output command from the CPU 31a. The audio input/output unit also transmits input audio data corresponding to the audio input to the microphone to the CPU 31a. For example, the CPU 31a may accept an instruction operation according to the received input audio data, and perform control such as switching the display images of each of the plurality of display sections according to the received instruction operation. In this way, the voice input section of the voice input/output section may function as the operation section 70 instead of the steering wheel switch or the like.

(Selection control processing)
Next, the selection control process executed by the control unit 31 will be described with reference to FIG. 4. The selection control process is continuously executed, for example, while the display device 100 is activated. The display device 100 is activated, for example, when the ignition of the vehicle 1 is turned on.

First, the control unit 31 controls a predetermined display unit (the first display unit 11 or the second display unit 12) for a certain period of time (for example, a period of several seconds predefined in the ROM 32) based on the detection data from the line of sight detection unit 60. As described above, it is determined whether or not the driver 5 is in a visual recognition state (step S1).

When the predetermined display section is in a visible state (step S1; Yes), the control section 31 displays a cursor image C on the predetermined display section, which indicates that the operation regarding the predetermined display section is possible (step S2). . As a result, when the second display section 12 is in the visible state, as shown in FIG. is displayed. On the other hand, when the first display section 11 is in a visible state, a cursor image C is displayed as shown in FIG. 5(a). In other words, the driver 5 can select the object he or she wants to operate by using the cursor image C displayed according to the movement of the driver's line of sight.

When the control unit 31 receives an operation from the driver 5 via the operation unit 70 while the cursor image C is displayed on the first display unit 11, the control unit 31 performs control according to the operation (for example, displaying it as a virtual image V). (setting and selection of map information and route guidance information, etc.). Further, when the control unit 31 receives an operation from the driver 5 via the operation unit 70 while the cursor image C is displayed on the second display unit 12, the control unit 31 controls the odometer or the like according to the operation. (switching the display of the trip meter, switching the display mode of the meter 22, etc.).

Here, if the cursor image C can make the driver 5 recognize that an operation related to any content displayed on the predetermined display section (first display section 11 or second display section 12) is possible, The mode is arbitrary. For example, the cursor image C may be a frame-shaped image surrounding an image indicating content (content image) displayed in a predetermined display section, or may be a frame-shaped image that surrounds an image indicating content (content image) displayed within a predetermined display section, or may be a frame-shaped image that This may be realized by changing the gradation, brightness, etc., or may be realized by changing the shape of the currently selected content image.

If the predetermined display section is not in a visible state (step S1; No), the control section 31 erases the cursor image C (step S3). As a result, if the predetermined display section (first display section 11 or second display section 12) on which the cursor image C is displayed changes from a visible state to a non-visible state, the cursor image C is deleted from the predetermined display section. be done. Further, if the driver 5 does not visually recognize either the first display section 11 or the second display section 12, the cursor image C will not be displayed on both display sections. Further, when the driver 5 moves his/her line of sight from the first display section 11 where the cursor image C is displayed to the second display section 12, the cursor image C is erased from the first display section 11 (step S3), The cursor image C will be displayed on the second display section 12 (step S2). Further, when the driver 5 moves his/her line of sight from the second display section 12 on which the cursor image C is displayed to the first display section 11, the cursor image C is erased from the second display section 12 (step S3). The cursor image C will be displayed on the first display section 11 (step S2).

Following step S2, the control unit 31 determines whether or not a plurality of content images are displayed on a predetermined display section in a visible state (step S4), and if a plurality of content images are displayed (step S4). ;Yes), the cursor image C is displayed at a position corresponding to the content image that the driver 5 is viewing (step S5). The cursor image C in this case indicates that operations regarding the content image are possible.

Here, a display example when a plurality of content images are displayed will be described. The image Im shown in FIGS. 5(b), 5(c), etc. indicates an image displayed on an arbitrary display section among the plurality of display sections. The image Im shown in FIGS. 5(b) and 5(c) includes, for example, a plurality of content images (contents A1 to A3). Content A1 is located in the center of image Im, content A2 is located on the left side of content A1 when viewed from the driver 5, and content A3 is located on the right side of content A1 when viewed from the driver 5. The types of content A1 to A3 may be any type of vehicle information or entertainment information, depending on the purpose.

FIG. 5B shows a state in which the content A2 is visually recognized by the driver 5, and that the content A2 can be operated via the operation unit 70. FIG. FIG. 5C shows a state where the content A3 is visually recognized by the driver 5, and shows that the content A3 can be operated via the operation unit 70. FIG. Note that when the cursor image C is displayed in this manner, its display position may be any position that corresponds to the content image. The corresponding position is not limited to a position superimposed on at least a portion of the content image, but may be a position away from the content image but from which it can be seen that the content image has been selected. For example, an arrow-shaped cursor image C pointing to the content image may be displayed near the content image.

Further, the plurality of content images may be displayed in response to a determination operation performed by the driver 5 on the operation unit 70. Examples of the display are shown in FIGS. 6(a) and 6(b).
For example, assume that the content A1 shown in FIG. 6(a) is a media player that is displayed based on entertainment information from the entertainment system. The driver 5 causes a cursor image C to be displayed and the media player to be in a selected state by keeping his/her line of sight on the content A1 for a certain period of time or longer, as shown in FIG. 6(a). In this state, when a predetermined determination operation is performed on the operation unit 70, items A11, A12, and A13 for operating the media player are displayed, as shown in FIG. 6(b). For example, item A11 is a library genre list, item A12 is an album list, and A13 is a play screen. Then, the driver 5 performs a selection operation using the line of sight by aligning the line of sight with any one of the items A11, A12, and A13. FIG. 6B shows a state in which item A11 as a genre list is selected by cursor image C. In this state, the driver 5 may be able to determine the genre of music to be played by performing a predetermined operation on the operation unit 70. In this way, the content images that can be selected by the driver 5 with his or her own line of sight are displayed after the driver 5 performs a predetermined operation on the operation unit 70 once or multiple times. It may also be an image (for example, items A11 to A13 described above). Note that, as shown in FIG. 6(b), after selecting an image of a lower hierarchy displayed on a predetermined display section with the cursor image C, the driver 5 averts his/her line of sight to another display section and selects the cursor image C. is erased and the user visually confirms the predetermined display section again, the control section 31 may return to display an image in a higher hierarchy (for example, content image A1), or may store the operation history in the RAM 33 or the like. , lower hierarchical images (for example, items A11 to A13) may be displayed according to the most recent operation. In this way, if the display is performed according to the previous operation, it is user-friendly.

Returning to FIG. 4, after performing steps S3 and S5, or when a plurality of content images are not displayed (step S4; No), the control unit 31 determines whether or not there is warning information (step S6). For example, when the control unit 31 obtains warning information for the vehicle 1 itself (low fuel, engine oil pressure abnormality, etc.) from the ECU 50, it determines that warning information is present. Note that the control unit 31 may determine that warning information is present when acquiring warning information indicating that a warning target object (such as a vehicle in front of the vehicle 1 or a pedestrian) is present from the situation analysis unit 40.

If there is no warning information (step S6; No), the control unit 31 returns the process to step S1, whereas if there is warning information (step S6; Yes), it executes the warning process (step S7).

Here, an example of the operation when executing the warning process will be described with reference to FIGS. 7(a) to (c).
First, as shown in FIG. 7(a), the control unit 31 notifies warning information in an arbitrary area of the image Im displayed on a predetermined display unit (first display unit 11 or second display unit 12). A warning image D is displayed. FIG. 7A shows an example in which the control unit 31 displays a warning image D in place of the content image A1 in the area where the content image A1 was displayed when there is warning information. Further, FIG. 7A shows a state in which the content image A3 is selected by the frame-shaped cursor image C.

As an example, the warning process moves the cursor image C from the state shown in FIG. 7(a) to a position corresponding to the warning image D, and transitions to the state shown in FIG. 7(b). In this case, the control unit 31 erases the cursor image C displayed according to the content image A2, and displays the cursor image C as an emphasized image at a position corresponding to the warning image D. Note that the control unit 31 may gradually move the cursor image C toward the warning image D, or may perform drawing control that represents an afterimage as the cursor image C moves. By doing so, the line of sight of the driver 5 can be guided to the warning image D, and the presence of warning information can be effectively notified.

Note that the relationship between the warning image D and the cursor image C in the "position according to the warning image D" as the position where the cursor image C is displayed is the same as the relationship between the content image and the cursor image in the "position according to the content image" described above. The relationship with C is the same. Furthermore, in the state shown in FIG. 7B, the cursor image C no longer indicates an operable target, but functions as an emphasis image for emphasizing the presence of the warning image D.

Further, as another example of the warning process, the cursor image C may be enlarged and deformed from the state shown in FIG. 7(a), and the warning image D may be surrounded as shown in FIG. 7(c). In this case as well, the control unit 31 may gradually enlarge the cursor image C toward the warning image D, or may perform drawing control that represents an afterimage as the cursor image C moves. In the state shown in FIG. 7C, the cursor image C functions as an emphasis image for emphasizing the presence of the warning image D, while indicating that the operation regarding the content image A3 is possible. That is, in the state shown in FIG. 7(c), the cursor image C no longer merely indicates an operable target.

Note that the emphasis image that emphasizes the warning image D may have the same aspect as the cursor image C. The same aspect includes not only an aspect completely the same as the cursor image C, but also an aspect in which the size is changed as shown in FIG. 7(c), an aspect in which at least part of the color or shape is changed, and the like. The form of the emphasized image is arbitrary as long as it allows the driver 5 to recognize that it was drawn using the cursor image C. Furthermore, when the warning image D is displayed in the area where the cursor image C was displayed, the cursor image C may be used as an emphasized image without being moved. At that time, the color of the cursor image C may be changed or the cursor image C may be blinked. Further, when the process transitions from step S3 to step S6 as Yes, the control unit 31 displays the cursor image C, which functions as an emphasis image, at a position corresponding to the warning image D in accordance with the display of the warning image D. good.

Following step S7, the control unit 31 determines whether a predetermined termination condition is satisfied (step S8). The termination condition is satisfied, for example, when the driver 5 performs a predetermined operation (an operation indicating that the warning information has been confirmed) on the operation unit 70, or when the warning information is no longer available. If the termination condition is not satisfied (step S8; No), the control unit 31 continues execution of the warning process (step S7), while if the termination condition is satisfied (step S8; Yes), the control unit 31 continues executing the warning process. The process ends (step S9). Specifically, the control unit 31 finishes the warning process by erasing the warning image D and stopping the movement and deformation of the cursor image C functioning as an emphasized image. After the warning process, the process returns to step S1.

(Modified example)
Note that in step S7 of the selection control process, the control unit 31 may execute a warning process according to a modified example, transition examples of which are shown in FIGS. 8(a) to 8(d). In this modification, when there is warning information as described above (step S6; Yes), the control unit 31 first displays a first warning image D1 on the first display unit 11, as shown in FIG. 8(a). is displayed, and a second warning image D2 is also displayed on the second display section 12. Note that FIG. 8A shows an example in which the first display section 11 is in a visible state where it is visible to the driver 5.

For example, the first warning image D1 and the second warning image D2 are images with different amounts of information (note that both images are shown in the same way in FIG. 8 for simplification). Specifically, to explain a case in which the warning information indicates an engine oil pressure abnormality as an example, the first warning image D1 is an image expressing content such as "There is an important warning." This image is more specific and contains more information than the first warning image D1, such as "Engine oil pressure is abnormal. Please check safety before stopping."
The control unit 31 displays such a first warning image D1 and second warning image D2, and also displays a frame-shaped cursor image C displayed at a position corresponding to the first warning image D1 on the first display unit 11. is displayed by controlling the drawing to move from the first display section 11 to the second display section 12 as shown in the order of FIGS. 8(b), (c), and (d). This guides the driver 5's line of sight from the first warning image D1 to the second warning image D2 displaying more detailed information, effectively notifying not only the existence of the warning information but also its content. be able to. The cursor image C in this case no longer indicates an operable target, but serves as an emphasis image for notifying the first warning image D1 and the second warning image D2, and particularly emphasizing the existence of the second warning image D2. Function. Note that the information amounts of the first warning image D1 and the second warning image D2 are in an inverse relationship, and the drawing is controlled so that the cursor image C is moved from the second display section 12 to the first display section 11. It may also be displayed. Further, the warning process according to the modification may be executed regardless of whether the first display section 11 or the second display section 12 is in a visible state.

Note that the present invention is not limited to the above embodiments, modifications, and drawings. It is possible to make changes (including deletion of constituent elements) as appropriate without changing the gist of the present invention.

The projection target of the display light L is not limited to the windshield 4, but may be a combiner configured with a plate-shaped half mirror, a hologram element, or the like.

Although the example in which the displays of the HUD 21 and the meter 22 are LCDs has been described above, OLEDs (Organic Light Emitting Diodes) may also be used. Further, the HUD 21 may use a reflective display device such as a DMD (Digital Micro mirror Device) or an LCOS (Liquid Crystal On Silicon).

Moreover, although the example in which two first display sections 11 and second display sections 12 are configured in the vehicle 1 has been described above, the display section includes a display section that displays an image as a virtual image V in front of the vehicle 1. There may be three or more as long as they are included. Furthermore, the first display section 11 and the second display section 12 may display an image as a virtual image V in front of the vehicle 1 using a HUD, as long as they are located apart from each other.

(1) The display device 100 installed in the vehicle 1 described above displays images and includes a plurality of display units (first display unit 11, second display unit 12) located at different positions, and a plurality of display units (first display unit 11, second display unit 12) located at different positions. It includes an operation section 70 that allows operations on each of the display sections, and a control section 31 that receives operations performed on the operation section 70 and controls the display of the plurality of display sections. The plurality of display units includes a display unit (first display unit 11) that displays an image as a virtual image V in front of the vehicle 1 as viewed from the driver 5. The control unit 31 is capable of identifying whether any of the plurality of display units is in a visible state where it has been visually recognized by the driver 5 for a certain period of time or more, and can identify the display unit in the visible state among the plurality of display units. Once specified, a cursor image C is displayed on the display section indicating that the operation related to the display section is possible.
With this configuration, the driver 5 can select an object to be operated by using the cursor image C displayed according to the movement of the driver's line of sight, and can operate the selected object using the single operating unit 70. In addition, since the display unit that can display the cursor image C includes a HUD, it is possible to prevent the driver 5 from diverting his/her line of sight from the scenery ahead that should be focused on while driving when performing a selection operation using the line of sight. . That is, according to the display device 100, it is possible to safely select an operation target even while driving.

(2) Specifically, when the control unit 31 specifies that the display unit on which the cursor image C is displayed among the plurality of display units is not in the visible state, the control unit 31 erases the cursor image C from the display unit.

(3) In addition, when specifying a display section that is in a visible state among a plurality of display sections, if the display section is displaying a plurality of content images, the control section 31 selects one of the plurality of content images. It is possible to specify which content images are in the visible state, and an image is displayed as a cursor image C at a position corresponding to the content image that has been identified as being in the visible state, indicating that operations related to the content image are possible. Display. With this configuration, content images within the display section can also be selected with the line of sight, making it user-friendly.

(4) Furthermore, when the control unit 31 acquires warning information from the vehicle 1 (specifically, the ECU 50, the situation analysis unit 40, etc.), the control unit 31 controls the control unit 31 to display the warning information on at least one of the plurality of display units. The warning image D is displayed, and as an image for emphasizing the presence of the warning image D, an emphasized image in the same manner as the cursor image C is displayed at a position corresponding to the warning image D. (5) Furthermore, when the warning image D is displayed, the control unit 31 may erase the displayed cursor image C and display the emphasized image at a position corresponding to the warning image D.
With the configuration described in (4) or (5), the line of sight of the driver 5 can be guided to the warning image D, and the presence of warning information can be effectively notified.

(6) Further, when the control unit 31 according to the modification example acquires warning information from the vehicle 1, the control unit 31 displays the first warning image D1 for notifying the warning information on the first display unit 11, and displays the second display A second warning image D2 for notifying warning information is displayed on the section 12, and an emphasized image in the same manner as the cursor image C is displayed as the first emphasized image as an image for emphasizing the first warning image D1 or the second warning image D2. The display may be displayed so as to move from one of the display section 11 and the second display section 12 to the other. With this configuration, it is possible to guide the driver's 5's line of sight from one of the first warning image D1 and the second warning image D2 to the other, and effectively notify not only the existence of warning information but also its content. .

In the above description, descriptions of known technical matters have been omitted as appropriate in order to facilitate understanding of the present invention.

100...Display device 11...First display section, 12...Second display section 21...HUD (21a...LCD, 21b...Light source)
22...meter (22a...LCD, 22b...light source)
30...Control device 31...Control unit (31a...CPU, 31b...GDC)
32...ROM, 33...RAM
40...Situation analysis section 50...ECU
60... Line of sight detection section 70... Operation section 1... Vehicle, 2... Dashboard, 3... Steering wheel, 4... Windshield 5... Driver, E... Eye box, L... Display light, V... Virtual image C... Cursor image, D...Warning image

Claims (5)

A display device mounted on a vehicle,
a plurality of display units that display images and are located at different positions;
an operation unit that allows operations on each of the plurality of display units;
a control unit that receives the operation performed on the operation unit and controls display of the plurality of display units,
The plurality of display units include a display unit that displays an image as a virtual image in front of the vehicle as seen from the driver of the vehicle,
The control unit is capable of identifying whether any of the plurality of display units is in a visible state where it is visible to the driver for a certain period of time or more,
When a display unit in the visible state is identified among the plurality of display units, displaying a cursor image on the display unit indicating that the display unit can be operated;
The plurality of display units include a first display unit that displays an image as the virtual image, and a second display unit,
When the control unit acquires warning information from the vehicle, the control unit displays a first warning image for notifying the warning information on the first display unit, and notifies the warning information on the second display unit. display a second warning image for
As an image for emphasizing the first warning image or the second warning image, an emphasized image in the same manner as the cursor image is moved from one of the first display section and the second display section to the other. to be displayed,
Display device. When the control unit specifies that the display unit on which the cursor image is displayed among the plurality of display units is not in the visible state, the control unit erases the cursor image from the display unit.
The display device according to claim 1. When identifying the display section in the visible state among the plurality of display sections, the control section may specify which display section among the plurality of content images if the display section is displaying a plurality of content images. It is possible to specify that the content image is in the visible state,
displaying, as the cursor image, an image indicating that an operation regarding the content image is possible at a position corresponding to the content image identified as being in the visible state;
The display device according to claim 1 or 2. When the warning information is acquired, the control unit displays the first warning image on the first display unit or displays the second warning image on the second display unit,
displaying the emphasized image at a position corresponding to the first warning image or the second warning image;
The display device according to any one of claims 1 to 3. When the first warning image or the second warning image is displayed, the control unit erases the displayed cursor image and moves the emphasized image to a position corresponding to the first warning image or the second warning image. to be displayed,
The display device according to claim 4.

Images