JP2020029221A - Display device - Google Patents

Abstract

To provide a display device capable of performing an appropriate display according to an operation condition.SOLUTION: A display device 100 is mounted on a vehicle that can run by automatic driving. The display device 100 includes a plurality of display units whose distances from a driver are mutually different and a control unit 31 that receives an operation to each of the plurality of display units and executes display control for the plurality of display units. The plurality of display units include a specific display unit as a second display unit 12 corresponding to an HUD 22 and a predetermined display unit located closer to the driver than to the specific display unit. The predetermined display unit is at least either a first display unit 11 of a meter 21 or a third display unit 13 of a CID 23. When a level of automatic driving is lower than level 3, the control unit 31 executes restriction processing for restricting at least either an operation executable to the predetermined display unit or a display operation of the predetermined display unit as compared with level 3.SELECTED DRAWING: Figure 3

Description

  The present invention relates to a display device.

  As a conventional display device, Patent Literature 1 discloses a display device that is mounted on a vehicle and includes a plurality of display units at different positions such as an instrument and an image display unit of a head-up display.

JP 2018-122728 A

  As described above, the display device including the plurality of display units can display various information such as important information regarding driving of the vehicle and information of lower importance. However, simply displaying information uniformly on each of the plurality of display units may hinder the concentration of driving.

  The present invention has been made in view of the above circumstances, and has as its object to provide a display device capable of performing an appropriate display according to a driving situation.

In order to achieve the above object, a display device according to the present invention includes:
A display device mounted on a vehicle capable of traveling by automatic driving,
Displaying an image, a plurality of display units at different distances from the driver of the vehicle,
A control unit that receives an operation on each of the plurality of display units and controls display of the plurality of display units,
The plurality of display units include a specific display unit and a predetermined display unit located closer to the driver than the specific display unit,
When the level of the automatic driving is less than a predetermined level, the control unit performs at least one of an operation that can be performed on the predetermined display unit and a display operation of the predetermined display unit, when the level is equal to or higher than the predetermined level. Execute the restriction process to restrict.

  According to the present invention, it is possible to perform an appropriate display according to the driving situation.

It is a figure for explaining a mode of mounting in a vehicle of a display concerning one embodiment of the present invention. It is a figure for explaining the display mode of the head up display with which the display concerning one embodiment of the present invention is provided. It is a block diagram mainly showing the display concerning one embodiment of the present invention. 5 is a flowchart of a restriction control process according to an embodiment of the present invention. (A)-(c) is a figure for demonstrating various animations.

  A display device according to an embodiment of the present invention will be described with reference to the drawings.

  As shown in FIG. 1, the display device 100 according to the present embodiment includes a first display unit 11, a second display unit 12, and a third display unit 13 provided inside and around the dashboard 2 of the vehicle 1 ( Hereinafter, the driver D is collectively provided with “plurality of display units”, and not only information about the vehicle 1 (hereinafter, also referred to as “vehicle information”) but also information other than the vehicle information in an integrated manner. 2). The vehicle information includes not only information on the vehicle 1 itself but also information on the outside of the vehicle 1 related to the operation of the vehicle 1.

  The display device 100 includes a meter 21, a head-up display (HUD) 22, a center information display (CID) 23, and a control device 30, as shown in FIG.

  The first display unit 11 is implemented by the meter 21, the second display unit 12 is implemented by the HUD 22, and the third display unit 13 is implemented by the CID 23.

  As shown in FIG. 1, the meter 21 is located in front of the steering wheel 3 when viewed from the driver D, and reports a measured amount of the vehicle 1 such as a vehicle speed, an engine speed, a total traveling distance, and a section traveling distance. That is, the meter 21 can display an image indicating a speedometer, a tachometer, an odometer, a trip meter, and the like. As shown in FIG. 3, the meter 21 includes an LCD (Liquid Crystal Display) 21a and a light source 21b (backlight) for illuminating the LCD 21a from behind. For example, the LCD 21a is of a TFT (Thin Film Transistor) type, and the light source 21b is configured by an LED (Light Emitting Diode). The meter 21 displays an image indicating the measurement amount on the first display unit 11 under the control of the control device 30. That is, the displayable area of the image on the LCD 21a is the first display unit 11.

  As shown in FIG. 2, the HUD 22 is provided inside the dashboard 2 and emits the display light L toward the combiner-treated windshield 4. The display light L reflected by the windshield 4 travels to the driver D side. By placing the viewpoint in the eye box E, the driver D can visually recognize the image represented by the display light L as the virtual image V in front of the windshield 4. That is, the HUD device 100 displays the virtual image V at a position in front of the windshield 4. Thereby, the driver D can observe the virtual image V while superimposing it on the scenery.

  Here, as shown in FIG. 2, the second display unit 12 in the present specification displays a portion between the eye box E and the display position of the virtual image V in front of the windshield 4 as viewed from the driver D. Shall be shown. The second display unit 12 may be considered as the display position of the virtual image V itself. Displaying the virtual image V by the HUD 22 is also referred to as “displaying an image on the second display unit 12”. The display positions of the eye box E and the virtual image V are set in advance based on the size of the display surface of the LCD 22a, which will be described later, and the optical system configured by various mirrors in the HUD and the combiner-processed windshield 4.

  As shown in FIG. 3, the HUD 22 includes an LCD 22a, a light source 22b (backlight) that illuminates the LCD 22a from behind, and a reflection unit including a plane mirror and a concave mirror (not shown). For example, the LCD 22a is of a TFT type, and the light source 22b is composed of an LED.

  The HUD 22 generates the display light L by the LCD 22a illuminated by the light source 22b displaying an image under the control of the control device 30. The generated display light L is emitted toward the windshield 4 after being reflected by the reflector. This makes it possible to display an image indicating vehicle information on the second display unit 12 as described above. Note that the content notified by the HUD 22 by the image may overlap with a part of the notification content by the meter 21.

  The CID 23 is located closer to the center of the vehicle 1 than the meter 21 and above the center console, as shown in FIG. 1, and displays not only vehicle information but also information other than vehicle information (for example, entertainment information). It is possible. As shown in FIG. 3, the CID 23 includes an LCD 23a and a light source 23b (backlight) that illuminates the LCD 23a from behind. For example, the LCD 23a is of a TFT type, and the light source 23b is composed of an LED. The area on the LCD 23a where an image can be displayed is the third display unit 13. Further, the CID 23 has an operation unit including a touch panel that transmits a display image on the third display unit 13.

  The CID 23 displays a predetermined image on the third display unit 13 under the control of the control device 30. Further, the CID 23 supplies a signal indicating the content of a user operation (operation by the driver D or a fellow passenger) performed on the touch panel to the control device 30.

The first to third display portions 11 to 13 are different from each other in distance from the driver D (distance in the front-rear direction for the driver D). Specifically, the third display unit 13 corresponding to the CID 23, the first display unit 11 corresponding to the meter 21, and the second display unit 12 corresponding to the HUD 22 are located in this order from the closest from the viewpoint position of the driver D. ing. That is, the third display unit 13 is located closest to the driver D, and the second display unit 12 is located farthest from the driver D.
Here, as shown in FIG. 1, a representative position at which the driver D gazes at the outside scenery when driving the vehicle 1 is defined as the point of regard F, and a radial distance around the point of regard F is defined as the shift amount G. . That is, the shift amount G represents a shift from the gazing point F, which is estimated to be watched by the driver D during driving. In such a case, when the relationship between the plurality of display units is considered by the shift amount G, the second display unit 12, the first display unit 11, and the third display unit 13 are located in ascending order of the shift amount G. In this embodiment, as will be described later, a restriction process for restricting the operation of at least a part of the plurality of display units is executed according to the automatic driving level.

  The control device 30 includes a microcomputer that controls the entire operation of the display device 100, and includes a control unit 31, a ROM (Read Only Memory) 32, and a RAM (Random Access Memory) 33, as shown in FIG. . The control device 30 includes a drive circuit and an input / output circuit for communicating with various systems in the vehicle 1 as a configuration (not shown). In addition, the control device 30 appropriately measures time using a built-in timer.

  The ROM 32 stores an operation program and various image data in advance. The RAM 33 temporarily stores various calculation results and the like. The control unit 31 includes a CPU (Central Processing Unit) 31a that executes an operation program stored in a ROM 32, and a GDC (Graphics Display Controller) 31b that executes image processing in cooperation with the CPU. The GDC 31b includes, for example, a GPU (Graphics Processing Unit), an FPGA (Field-Programmable Gate Array), an ASIC (Application Specific Integrated Circuit), and the like. In particular, the ROM 32 stores an operation program for executing a restriction control process described later. The configurations of the control device 30 and the control unit 31 are arbitrary as long as the functions described below are satisfied.

  The control unit 31 drives and controls each of the meter 21, the HUD 22, and the CID 23. For example, the CPU 31a controls each of the light source 21b of the meter 21, the light source 22b of the HUD 22, and the light source 23b of the CID 23. The GDC 31b cooperates with the CPU 31a to drive and control each of the LCD 21a of the meter 21, the LCD 22a of the HUD 22, and the LCD 23a of the CID 23.

  The CPU 31a of the control unit 31 controls the display of each of the plurality of display units based on various image data stored in the ROM 32 in cooperation with the GDC 31b. The GDC 31b determines the control content of the display operation of each of the plurality of display units based on the display control command from the CPU 31a. The GDC 31b reads, from the ROM 32, image part data necessary to compose one screen to be displayed on each of the plurality of display units, and transfers the data to the RAM 33. The GDC 31b uses the RAM 33 to create picture data for one screen based on image part data and various image data received from outside the display device 100 by communication. Then, when the picture data for one screen is completed in the RAM 33, the GDC 31b transfers the picture data to each of the plurality of display units in synchronization with the image update timing. Thereby, an image corresponding to each of the plurality of display units is displayed.

  The CPU 31a of the control unit 31 communicates with each of the situation analysis unit 40, the ECU (Electronic Control Unit) 50, the visual line detection unit 60, and the operation detection unit 70 mounted on the vehicle 1. As the communication, for example, a communication system such as CAN (Controller Area Network), Ethernet, MOST, and LVDS (Low Voltage Differential Signaling) can be applied.

  The situation analysis unit 40 outputs to the control unit 31 and the ECU 50 data indicating the situation of the vehicle 1 (hereinafter, also referred to as the own vehicle 1) itself and the surrounding conditions of the own vehicle 1. The situation analysis unit 40 performs communication between the vehicle 1 and a wireless network (V2N: Vehicle To Cellular Network), communication between the vehicle 1 and another vehicle (V2V: Vehicle To Vehicle), and communication between the vehicle 1 and a pedestrian (V2P: Vehicle To Pedestrian) and various modules that enable communication between the vehicle 1 and the roadside infrastructure (V2I: Vehicle To Roadside Infrastructure). That is, the situation analysis unit 40 enables communication by V2X (Vehicle To Everything) between the vehicle 1 and the outside of the vehicle 1.

  For example, (i) the situation analysis unit 40 communicates with a communication module that can directly access a WAN (Wide Area Network), an external device (such as a mobile router) that can access the WAN, an access point of a public wireless LAN (Local Area Network), and the like. And a communication module for performing Internet communication. The situation analysis unit 40 includes a GPS controller that calculates the position of the vehicle 1 based on a GPS (Global Positioning System) signal received from an artificial satellite or the like. With these configurations, communication by V2N is enabled. (Ii) The situation analysis unit 40 includes a wireless communication module conforming to a predetermined wireless communication standard, and performs communication using V2V or V2P. (Iii) The situation analysis unit 40 has a communication device that wirelessly communicates with the roadside infrastructure. For example, a roadside installed as an infrastructure from a base station of a driving safety support system (DSSS). Obtain traffic information via a wireless device. Thereby, communication by V2I becomes possible.

  Further, the situation analysis unit 40 transmits to the control unit 31 driving level information indicating which level of the automatic driving of the vehicle 1 is currently being performed (including the automatic driving level 0). The vehicle 1 according to this embodiment can be operated by, for example, automatic driving up to level 3 under the control of the ECU 50. Level 0 of automatic driving indicates a level at which automatic driving control is not performed, and the driver D operates all main control systems (acceleration, steering, and braking). Level 1 is so-called driving assistance, in which the system assists any one of acceleration, steering, and braking. Level 2 is a so-called partially automatic operation, in which the system assists two of acceleration, steering, and braking. Level 3 is so-called conditional automatic driving, in which the system controls acceleration, steering and braking only in a limited environment or in a traffic condition, and the driver D responds when requested by the system. Note that the level of automatic driving in this specification conforms to the definition by the Japanese government and the National Highway Traffic Safety Administration (NHTSA). The operation level information may be transmitted from the ECU 50 to the CPU 31a.

  The situation analysis unit 40 includes a stereo camera that captures an image of the outside of the vehicle 1 and an object detection unit including a sonar, an ultrasonic sensor, and a millimeter-wave radar, detects a danger around the vehicle 1, and warns of the detected danger. The information is transmitted to the CPU 31a as information. For example, the control unit 31 displays an image for notifying warning information on the second display unit 12 corresponding to the HUD 22 so as to be superimposed on a warning target object (a vehicle ahead of the vehicle 1, a pedestrian, or the like). The warning information transmitted to the CPU 31a is based on traffic information that can be obtained by V2N or V2I communication, approaching vehicle information that can be obtained by V2V communication, or pedestrian information that can be obtained by V2P communication. Is also good.

  The ECU 50 controls each unit of the vehicle 1 based on information from each of the situation analysis unit 40, the line-of-sight detection unit 60, and the operation detection unit 70. For example, the ECU 50 switches the automatic driving level of the vehicle 1 under a predetermined condition. Under the control of the ECU 50, the vehicle 1 can switch between, for example, automatic driving level 3 and at least one of automatic driving levels 0 to 2. Further, the ECU 50 transmits vehicle speed information indicating the current vehicle speed of the vehicle 1 to the CPU 31a. Note that the CPU 31a may acquire vehicle speed information from a vehicle speed sensor. In addition, the ECU 50 transmits to the CPU 31a measurement amounts such as the engine speed, warning information of the vehicle 1 itself (such as low fuel and abnormal engine oil pressure), and other vehicle information. Based on the information obtained from the ECU 50, the CPU 31a causes the meter 21 to display vehicle information such as a vehicle speed, an engine speed, and various warnings via the GDC 31b. Note that the CPU 31a may cause the second display unit 12 corresponding to the HUD 22 to display at least a part of the vehicle information.

  The line-of-sight detection unit 60 includes, for example, an imaging unit (for example, a stereo camera) that images the face of the driver D and generates image data, and an image processing unit that performs image processing on the image data. Is detected. For example, the gaze detection unit 60 detects the gaze direction of the driver D by a known image analysis method such as a pattern matching method, and transmits detection data indicating a detection result to the CPU 31a. The CPU 31a refers to table data stored in advance in the ROM 32 in which the line-of-sight direction and the positions of the plurality of display units (first to third display units 11 to 13) are associated with each other. The user D specifies which of the plurality of display units is visually recognized or not. That is, it is determined whether each of the plurality of display units is in the visual recognition state in which the driver D is visually recognized or in the non-visual state in which the driver D is not visually recognized. Note that the line of sight direction may be detected based on, for example, one of the eyes of the driver D, or may be detected as the center of gravity of both eyes. The detection data is arbitrary as long as the CPU 31a can specify which of the plurality of display units the driver D is visually checking or not. In addition, the line-of-sight detection unit 60 may detect the direction of the face of the driver D by a known image analysis method and use the detected data as detection data. In this case, the CPU 31a refers to the table data stored in the ROM 32 in advance, in which the orientation of the face is associated with the position of each of the plurality of display units (first to third display units 11 to 13). It is sufficient to specify which of the plurality of display units the driver D is currently viewing or not.

  In addition, the line-of-sight detection unit 60 may be an imaging unit mounted on a wearable device worn by the driver D on the head, an electro-oculogram sensor, or a motion sensor. The direction of the line of sight and the direction of the face can be detected in the same manner as described above, based on the image data obtained by the imaging means. Further, the electro-oculography sensor detects the gaze direction of the driver D based on the measured electro-oculography. The motion sensor includes, for example, one or a combination of an acceleration sensor, a gyro sensor, and a geomagnetic sensor, and detects the direction of the face of the driver D.

  Note that the CPU 31a may be configured to detect the gaze direction and the face direction of the driver D based on signals from the imaging unit and various sensors. If the CPU 31a can specify whether each of the plurality of display units is in the visual recognition state in which the driver D is visually recognized or in the non-visual state in which the driver D is not visually recognized, the gaze direction and the face of the driver D are determined. The detection method and the detection configuration of the direction are arbitrary.

  The operation detection unit 70 detects an operation of a user (mainly, the driver D) including an operation performed on an operation unit such as a steering switch provided on the steering wheel 3 or a touch panel of the CID 23, and detects the detection result. Output to ECU 50 and control unit 31. The operation detection unit 70 detects an operation on each of the plurality of display units. The operation on the first display unit 11 corresponding to the meter 21 includes, for example, an odometer confirmation operation, a trip meter setting operation, and a display mode setting operation of the meter 21. The operation on the second display unit 12 corresponding to the HUD 22 is, for example, a setting operation or a selection operation of map information or route guidance information displayed as the virtual image V. The operation on the third display unit 13 corresponding to the CID 23 is, for example, a reproduction operation or a selection operation when displaying entertainment information described later. Note that the display contents on each display unit and the type of operation on each display unit are not limited to these examples, and are arbitrary.

  Further, the vehicle 1 has an entertainment (entertainment) system for displaying entertainment information on the display device 100 and a voice input / output unit as a configuration (not shown). The entertainment system may use a part of the situation analysis unit 40 described above, and may further include a television (TV) tuner, a video / music playback unit, and the like. For example, the entertainment system supplies the TV information received via the TV tuner to the control unit 31 as entertainment information. In addition, the entertainment system can play video and music recorded on a recording medium such as a built-in memory, a CD (Compact Disc), and a DVD (Digital Video Disk) as a video / music playback unit, and can also play video and music. Such information (work title, author name, etc.) is supplied to the control unit 31 as entertainment information. The video / music reproducing unit outputs the reproduced audio from the speaker of the audio input / output unit. The audio input / output unit includes a microphone, a speaker, and the like. The voice input / output unit outputs a predetermined voice from a speaker in response to a voice output command from the CPU 31a. Further, the audio input / output unit transmits input audio data corresponding to the audio input to the microphone to the CPU 31a. For example, the CPU 31a receives an instruction operation according to the received input audio data, and performs control such as switching between display images on each of the plurality of display units according to the received instruction operation.

(Limit control processing)
Subsequently, the restriction control process executed by the control unit 31 will be described with reference to FIG. The restriction control process is continuously executed, for example, while the display device 100 is running. The display device 100 is activated when, for example, the ignition of the vehicle 1 is turned on.

  First, the control unit 31 determines whether or not the current automatic operation level is at least level 3 based on the operation level information from the situation analysis unit 40 (step S1).

  When the automatic operation level is equal to or higher than level 3, that is, when the automatic operation level is level 3 in this embodiment (step S1; Yes), the control unit 31 cancels the restriction processing if the restriction processing described below has been executed (step S1). Step S2). If the restriction processing has already been released, the release state is continued. In step S2, the control unit 31 controls each of the plurality of display units by "first control" in which neither an operation that can be performed on the target display unit nor a display operation on the display unit is limited. After execution of step S2, the process returns to step S1 to execute the processing.

  On the other hand, when the automatic operation level is less than level 3, that is, any one of levels 0 to 2 (step S1; No), the control unit 31 performs a restriction process for restricting an operation related to at least a part of the plurality of display units. Execute (step S3).

  Here, the restriction process includes a second control and a third control in addition to the first control. “Second control” is control that limits at least one of an operation that can be performed on a target display unit and a display operation on the display unit. “Third control” is similar to the second control, but is more restrictive than the second control. For example, the “third control” restricts all operations that can be performed on the target display unit, This is control for limiting all display operations.

  In the restricting process of step S3, for example, the control unit 31 sets the second display unit 12, which is the farthest from the driver D (the amount of deviation G from the gazing point F is the smallest), into the first control, and sets the driver D The first display unit 11 is set to the second control in which the distance from the driver D is the next (the displacement G from the gazing point F is the next smallest), and the distance from the driver D is the closest (the displacement G from the gazing point F). Is the largest). The third display unit 13 is set as the third control. In the first display unit 11 (meter 21) at the time of executing the second control, the display of some applications is restricted or the display of the application is relatively less important than before the execution of the restriction processing. And maintenance history display are not displayed), and the displayed image is simplified. Alternatively, an operation that can be performed on the first display unit 11 is restricted before execution of the restriction process (for example, an input of a trip meter setting operation and a display mode setting operation of the meter 21 is disabled). In the third display unit 13 (CID23) at the time of executing the third control, for example, the entertainment information is not displayed or the operation input from the touch panel is disabled. Note that, when the entertainment information is not displayed, the control unit 31 may cause the third display unit 13 to display a notification image such as “the CID is currently in display restriction”. As described above, in any one of the levels 0 to 2 where the driver D needs to concentrate on driving, the display and the operation that may hinder the driving of the driver D are restricted, so that the safe operation is achieved. A driving environment can be provided.

  Subsequent to step S3, based on the detection data from the line-of-sight detection unit 60, the control unit 31 allows the driver D to display the restricted display unit, for example, the third display unit 13 (CID23) for a certain period of time (for example, beforehand in the ROM 32 It is determined whether or not the user is visually recognizing (for a predetermined period such as several seconds) (step S4).

  When the driver D is viewing the third display unit 13 for a certain period of time (step S4; Yes), the control unit 31 displays a warning image such as “Please concentrate on driving” on the third display unit 13. It is displayed (step S5). The control unit 31 may emit a warning sound from the voice input / output unit in conjunction with or instead of displaying the warning image. Further, the determination target in step S4 and the display target of the warning image in step S5 may be the first display unit 11 (meter 21). When the driver D has not visually recognized the restricted display unit for a certain period of time (Step S4; No) or after the processing of Step S5, the control unit 31 returns to Step S1 and executes the processing. Therefore, in the case where the restriction processing has been executed, if the automatic operation level becomes 3 or more (Step S1; Yes), the restriction processing is canceled (Step S2). The above is the limitation control process.

(Modification 1)
Note that, when the restriction process of step S3 is called a first restriction process, a restriction according to the first modification is configured to execute a second restriction process different from the first restriction process instead of the restriction release process of step S2. Control processing may be adopted.

  In the second control process, for example, the control unit 31 sets the third display unit 13 closest to the driver D to the first control, and sets the first display unit 11 closest to the driver D to the next first display unit. 2 control, and the second display unit 12 is set to the third control. The first display unit 11 (meter 21) at the time of executing the second control may be the same as or different from the first restriction process. In the second display unit 12 (HUD 22) at the time of executing the third control, for example, the virtual image V may be hidden or the operation input to the HUD 22 may be disabled. In this way, the driver D can be guided to the display unit on which a more detailed display can be performed during automatic driving at level 3 or higher where the driver D is not obligated to look forward. Further, as the display unit is closer to the gazing point F, the content display related to the operation of the vehicle 1 is more, so that an erroneous operation on the display unit can be prevented.

(Modification 2)
Further, as the restriction of the display operation in the control processing of step 3, a restriction control processing according to a modification 2 that particularly restricts animation may be adopted.

  In the control process according to the second modification, the animation is not limited by the first control, and an animation process that combines an in-content animation and a simple effect described later is executed. On the other hand, the second control restricts the execution of the animation in the content (for example, the frame rate may be reduced as well as the non-display) in the target display unit, while enabling only the simple effect. Further, the third control is a control having a stronger restriction than the second control, and, for example, displays only a still image on a target display unit (restricts execution of all animations).

  Here, an image Im shown in FIGS. 5A to 5C is an image displayed on an arbitrary display unit (for example, the first display unit 11) among the plurality of display units. The image Im is configured to include, for example, a plurality of content images (contents C1 to C3).

  The animation in the content is a moving image that continuously reports predetermined information in an arbitrary content included in the image Im. FIG. 5C shows an example in which a map updated in real time based on the position of the own vehicle 1 and the route setting of the navigation system is displayed as an in-content animation in the content C2. Although not shown, the animation in the content may be a moving image for displaying entertainment information, a cursor movement of a list menu according to an operation of the driver D, or the like.

  Further, the simple effect is an animation for emphasizing a decoration or an object in an arbitrary content included in the image Im, such as a fade-in or a fade-out. FIG. 5A illustrates a state where the region indicating the content C2 fades in, and FIG. 5B illustrates a state where the region indicating the content C2 fades out. Note that simple effects are not limited to fade-ins and fade-outs as long as they are effects using animation.Effects that gradually change color, frame-in and frame-out, enlargement or reduction of predetermined content, and display area of predetermined content It may be a deformation or the like. The examples shown in FIGS. 5A to 5C are merely examples, and are not limited to the content C2, and the content-in-content animation and the simple effect may be executed in the content C1 and C3 located next to the content C2. . In addition, an animation in a content or a simple effect may be executed over the entire display area of the image Im.

In the restriction process according to the second modification, for example, the control unit 31 restricts the animation of the second display unit 12 that is the farthest from the driver D (the amount of deviation G from the gazing point F is the smallest). Is performed, and the first display unit 11 that is the next farthest from the driver D (the deviation G from the gazing point F is the next smallest) is the second control that executes only the simple effect. The third display unit 13 having the shortest distance from D (the displacement G from the gazing point F is the largest) is set to the third control in which no animation is executed. In this way, in any one of the levels 0 to 2 where the driver D needs to concentrate on driving, limiting the animation prevents the driver D's line of sight from shifting to a plurality of screens. And a safe driving environment can be provided. Also in the case of adopting such an animation restriction, similarly to the first modification, a second restriction process different from the first restriction process may be executed instead of the restriction release process of step S2. . Also in the second control process in this case, for example, the control unit 31 sets the third display unit 13 closest to the driver D to the first control, and sets the first display unit 13 to the next closest distance from the driver D. What is necessary is just to make the part 11 into 2nd control, and make the 2nd display part 12 into 3rd control.
In this way, the driver D can be guided to the display unit on which a more detailed display can be performed during automatic driving at level 3 or higher where the driver D is not obligated to look forward. Further, at the time of the automatic driving at the level 3 or higher, the display on the display unit close to the gazing point F is likely to be visually recognized by the driver D from the middle. Therefore, instantaneous recognizability can be improved by making a simple display using a still image on the second display unit 12 close to the gazing point F. In the second modification as well, the restriction on the operation may be executed as described above in addition to the restriction on the animation.

  Note that the present invention is not limited by the above embodiments, modifications, and drawings. Modifications (including deletion of components) can be made as appropriate without changing the gist of the present invention.

  The projection target of the display light L is not limited to the windshield 4, but may be a combiner including a plate-shaped half mirror, a hologram element, and the like.

  In the above, an example has been described in which the displays of the meter 21, the HUD 22, and the CID 23 are LCDs, but OLEDs (Organic Light Emitting Diodes) may be employed. Further, the HUD 22 may use a reflective display device such as a DMD (Digital Micro mirror Device) or an LCOS (Liquid Crystal On Silicon).

  In the above description, an example in which three display units (first to third display units 11 to 13) are configured in the vehicle 1 has been described. There may be more than one.

  The vehicle 1 is capable of controlling automatic driving at least at a predetermined level (for example, level 3) and capable of controlling a level lower than the predetermined level (for example, at least one of levels 0 to 2). Should be fine. Note that the predetermined level may be level 4.

(1) The display device 100 described above is mounted on the vehicle 1 that can travel by automatic driving. The display device 100 displays an image, receives a plurality of display units at different distances from the driver of the vehicle 1 and an operation on each of the plurality of display units, and controls display of the plurality of display units. And a control unit 31 for performing the operation.
The plurality of display units include a specific display unit (for example, the second display unit 12 corresponding to the HUD 22) and a predetermined display unit (for example, a first display unit corresponding to the meter 21) located closer to the driver D than the specific display unit. 11 and a third display unit 13) corresponding to the CID 23.
When the level of the automatic driving is lower than a predetermined level (for example, level 3), the control unit 31 performs at least one of an operation that can be performed on the predetermined display unit and a display operation of the predetermined display unit, as compared with the case that the level is equal to or higher than the predetermined level. Is executed.
According to this configuration, in a situation where the driver D needs to concentrate on driving, it is possible to restrict a display or an operation that may hinder the driving of the driver D, and thus provide a safe driving environment. And an appropriate display according to the driving situation can be performed. Note that the limitation on the display operation of the predetermined display unit may be a limitation on animation as described in the second modification.

(2) In addition, when there are a plurality of predetermined display units, and the control unit 31 performs the restriction process when the level of the automatic driving is lower than the predetermined level, the control unit 31 is located at a position closer to the driver D among the plurality of predetermined display units. (For example, when the control process is executed, the first display unit 11 corresponding to the meter 21 is set to the second control, and the third display unit 13 corresponding to the CID 23 is set to the third control. Do).
According to this configuration, it is possible to perform the display according to the importance of driving. In the restriction process, the second display unit 12 and the first display unit 11 may be set to the first control, and the third display unit 13 may be set to the second control or the third control. Further, the second display unit 12 may be set as the first control, and the first display unit 11 and the third display unit 13 may be set as the second control or the third control.

(3) In addition, the control unit 31 determines that the driver D is visually recognizing a predetermined display unit (for example, the first display unit 11 or the third display unit 13) for a certain period of time while executing the restriction process. If specified, an image indicating a warning is displayed on a predetermined display unit to be viewed.
According to this configuration, the driver can be encouraged to drive safely.

(4) Further, when the level of the automatic operation is less than the predetermined level, the control unit 31 in the first or second modification executes the first restriction process as the restriction process, while the level of the automatic operation is equal to or higher than the predetermined level. In this case, a second restriction process for restricting at least one of an operation that can be performed on the specific display unit and a display operation of the specific display unit is performed as compared with the case where the level is lower than the predetermined level.
According to this configuration, when the driver D does not have the duty to look ahead or is relatively few, it is possible to guide the line of sight of the driver D to the display unit that can perform more detailed display.

(5) When the level of the automatic driving is equal to or higher than the predetermined level, the control unit 31 in the first or second modification is farther from the driver D among the plurality of predetermined display units when executing the second restriction process. Places a strong restriction on what is in position.
According to this configuration, it is possible to perform the display according to the importance of driving. In the second restriction process, the third display unit 13 and the first display unit 11 may be set to the first control, and the second display unit 12 may be set to the second control or the third control. Further, the third display unit 13 may be set as the first control, and the first display unit 11 and the second display unit 12 may be set as the second control or the third control.

(6) Specifically, the specific display unit (the second display unit 12 corresponding to the HUD 22) displays an image as a virtual image V in front of the vehicle 1 as viewed from the driver D.
(7) The predetermined level is level 3 or level 4.

  In the above description, well-known technical items have been omitted as appropriate to facilitate understanding of the present invention.

Reference Signs List 100 display device 11 first display unit 12 second display unit 13 third display unit 21 meter (21a LCD, 21b light source)
22 HUD (22a LCD, 22b light source)
23 CID (23a LCD, 23b light source)
30 control device 31 control unit (31a CPU, 31b GDC)
32 ROM, 33 RAM
40: situation analysis unit 50: ECU
Reference numeral 60: line-of-sight detection unit 70: operation detection unit 1: vehicle, 2: dashboard, 3: steering wheel, 4: windshield D: driver, E: eye box, L: display light, V: virtual image F: fixation point , G ... shift amount

Claims (7)

A display device mounted on a vehicle capable of traveling by automatic driving,
Displaying an image, a plurality of display units at different distances from the driver of the vehicle,
A control unit that receives an operation on each of the plurality of display units and controls display of the plurality of display units,
The plurality of display units include a specific display unit and a predetermined display unit located closer to the driver than the specific display unit,
When the level of the automatic driving is less than a predetermined level, the control unit performs at least one of an operation that can be performed on the predetermined display unit and a display operation of the predetermined display unit, when the level is equal to or higher than the predetermined level. Execute the restriction process to restrict,
Display device. There are a plurality of the predetermined display units,
The control unit, when the level of the automatic driving is less than the predetermined level, applies a stronger restriction to a plurality of the predetermined display units that are closer to the driver when executing the restriction process. ,
The display device according to claim 1. The control unit, when executing the restriction process, if the driver has specified that the predetermined display unit is visually recognizable for a certain period of time, an image indicating a warning is displayed on the predetermined display unit to be visually recognized. indicate,
The display device according to claim 1. The control unit executes the first restriction process as the restriction process when the level of the automatic driving is lower than the predetermined level, but executes the first restriction process when the level of the automatic driving is higher than the predetermined level. Executing a second restriction process for restricting at least one of an operation that can be performed on the specific display unit and a display operation of the specific display unit,
The display device according to claim 1. There are a plurality of the predetermined display units,
The control unit, when the level of the automatic driving is equal to or higher than the predetermined level, when performing the second restriction process, the control unit is more resistant to a plurality of the predetermined display units that are located farther from the driver. Add restrictions,
The display device according to claim 4. The specific display unit displays an image as a virtual image in front of the vehicle as viewed from the driver,
The display device according to claim 1. The predetermined level is level 3 or level 4,
The display device according to claim 1.