JP2017178131A - Display control device and display control program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a display control device or the like which can smoothly shift an operation from an automatic drive function to a driver.SOLUTION: An HCU 20 functions as a display control device in a vehicle A having an automatic drive function which can perform a drive operation in place of a driver, and controls the display of a display region 40 which is set in front of a driver's seat 17. The HCU 20 acquires information indicating whether or not the vehicle A is controlled by the automatic drive function. Then, when the vehicle A is controlled by the automatic drive function, the HCU 20 permits the display of a content by an upper display region 41. The upper display region 41 is shifted to an upper edge rather than a lower edge of a wind shield 18 of the vehicle A.SELECTED DRAWING: Figure 1

Description

  The disclosure according to this specification relates to a display control device and a display control program for controlling display of a display area defined in front of a driver's seat in a vehicle having an automatic driving function.

  Conventionally, for example, Patent Document 1 discloses an in-vehicle information display control device that changes a display form in a display device such as a head-up display in accordance with switching between an automatic operation mode and a manual operation mode. In the automatic operation mode of the information display control device, contents such as TV information, video information recorded on an optical disc, and web information acquired via the Internet are displayed in order to eliminate the driver's boredom. In addition, in the automatic operation mode, the projection size of the head-up display is expanded to the entire windshield based on the idea that it is less necessary to pay attention to the front of the vehicle.

JP2015-217798A

  Now, in a vehicle having an automatic driving function, a driving change to a driver may be accidentally performed during the operation of the automatic driving function due to deterioration of the driving environment, abnormality of the automatic driving function, or the like. Therefore, even when the automatic driving function is in operation, it is desirable for the driver to maintain a wakefulness level that can be changed and to know the situation around the vehicle.

  Here, in the information display control device of Patent Literature 1, a reduction in the driver's arousal level can be suppressed by solving the driver's boredom by displaying the content. However, since the projection size is extended to the entire windshield, the display of the content hinders the driver from grasping the situation around the vehicle. As a result, it may be difficult to smoothly perform the driving change from the automatic driving function to the driver.

  The present disclosure has been made in view of such problems, and an object of the present disclosure is to provide a display control device and a display control program capable of causing a smooth driving change from an automatic driving function to a driver. There is to do.

  In order to achieve the above object, the disclosed first aspect is that at least a vehicle (A) having an automatic driving function capable of performing a driving operation on behalf of a driver is set at least in front of the driver seat (17). A display control device for controlling the display of one display area (40), a vehicle information acquisition unit (31) for acquiring operation information indicating whether or not the vehicle is controlled by an automatic driving function, and an automatic driving function A display control unit (35) that permits display of content in the upper display area (41) located closer to the upper edge than the lower edge of the vehicle windshield (18) when the vehicle is controlled by The display control device is provided.

  Further, the disclosed second aspect is that in the vehicle (A) having an automatic driving function capable of performing a driving operation on behalf of the driver, at least one display area (40) set in front of the driver's seat is provided. A display control program for controlling display, wherein the operation information indicating whether or not the vehicle is controlled by the automatic driving function is acquired (S102), and the vehicle is controlled by the automatic driving function. A display control program for causing at least one processor (21, 22) to execute the step (S104) of permitting display of content by the upper display area (41) located closer to the upper edge than the lower edge of the windshield of Is done.

  According to these aspects, display of content in the upper display area is permitted when the automatic driving function is operating. By eliminating the driver's boredom by displaying such content, a decrease in the driver's arousal level can be suppressed. In addition, since the upper display area is located closer to the upper edge than the lower edge of the windshield, the situation around the vehicle can be grasped through the area below the upper display area in the windshield. As described above, by maintaining the driver's arousal level without preventing the driver from grasping the situation around the vehicle, the driving change from the automatic driving function to the driver can be performed smoothly.

  Note that the reference numbers in the parentheses merely show an example of a correspondence relationship with a specific configuration in an embodiment described later, and do not limit the technical scope at all.

It is a figure which shows the layout around the driver's seat of the vehicle provided with the automatic driving function. It is a block diagram which shows the whole structure of HCU, automatic driving ECU, vehicle control ECU, etc. It is a figure which shows an example of a specific structure of HCU, automatic operation ECU, and vehicle control ECU. It is a state transition diagram which shows the whole image of several display modes, and the detail of the transition of a display mode. It is a flowchart which shows the detail of a mode switching process with FIG.6 and FIG.7. It is a flowchart which shows the detail of a mode switching process with FIG.5 and FIG.7. It is a flowchart which shows the detail of a mode switching process with FIG.5 and FIG.6.

  The function of the display control apparatus according to an embodiment of the present disclosure is realized by an HCU (HMI (Human Machine Interface) Control Unit) 20 illustrated in FIGS. 1 and 2. The HCU 20 is mounted on the vehicle A together with electronic control units such as an automatic operation ECU (Electronic Control Unit) 50 and a vehicle control ECU 80. The HCU 20, the automatic operation ECU 50, and the vehicle control ECU 80 are electrically connected to each other and can communicate with each other. The vehicle A has an automatic driving function by the operation of the automatic driving ECU 50 and the vehicle control ECU 80.

  The automatic operation ECU 50 is electrically connected to a GNSS receiver 71, a map database 72, a camera unit 73, a lidar 74, a millimeter wave radar 75, and the like. The automatic driving ECU 50 acquires information relating to the traveling environment around the host vehicle necessary for automatic driving from these configurations (71 to 75).

  A GNSS (Global Navigation Satellite System) receiver 71 measures the current position of the vehicle A based on positioning signals received from a plurality of artificial satellites. The GNSS receiver 71 sequentially outputs the current position information of the vehicle A to the automatic operation ECU 50. The map database 72 is a storage medium that stores a large number of map data. The map database 72 provides map data of the vicinity of the current position of the vehicle A and the traveling direction to the automatic driving ECU 50.

  The camera unit 73, the lidar 74, and the millimeter wave radar 75 are stationary objects such as moving objects such as pedestrians and other vehicles, falling objects on the road, traffic lights, guardrails, curbs, road signs, road markings, and marking lines. It is an autonomous sensor that detects an object. The camera unit 73, the lidar 74, and the millimeter wave radar 75 sequentially output detected object information relating to the detected moving object and stationary object to the automatic operation ECU 50.

  The automatic driving ECU 50 performs an acceleration / deceleration control and a steering control of the vehicle A in cooperation with the vehicle control ECU 80, thereby exhibiting an automatic driving function capable of performing the driving operation of the vehicle A on behalf of the driver. The automatic operation ECU 50 is mainly configured by a microcomputer having a CPU 51, a GPU 52, a RAM 53, a storage medium 54, and an input / output interface 55 (see FIG. 3). The automatic operation ECU 50 can execute the automatic operation program stored in the storage medium 54 by the CPU 51 and the GPU 52. Based on the automatic driving program, the automatic driving ECU 50 constructs the driving environment recognition unit 61, the driving plan generation unit 62, the driving change control unit 63, the ECU communication unit 64, and the HCU communication unit 65 as functional blocks related to automatic driving.

  The traveling environment recognition unit 61 recognizes the traveling environment of the vehicle A by combining the position information acquired from the GNSS receiver 71, the map data acquired from the map database 72, the detected object information acquired from each autonomous sensor, and the like. . The traveling environment recognition unit 61 generates a virtual space in which the actual traveling environment is reproduced in three dimensions by combining the integration results of the detected object information obtained from the plurality of autonomous sensors with the position information and the map data.

  The travel plan generation unit 62 generates a travel plan for causing the vehicle A to automatically travel using the automatic driving function based on the travel environment recognized by the travel environment recognition unit 61. The travel plan includes a long-term travel plan and a short-term travel plan. The long-term driving plan defines a route for directing the vehicle A to the destination set by the driver based on the map data. The short-term travel plan defines a planned travel locus for realizing travel according to the long-term travel plan based on the virtual space around the vehicle A generated by the travel environment recognition unit 61.

  The driving change control unit 63 controls the transfer of the control right related to the driving operation between the automatic driving function and the driver. The driving change control unit 63 starts the operation of the automatic driving function by acquiring input information of the starting operation of the automatic driving by the driver in the area where automatic driving is possible.

  In addition, the driving change control unit 63 refers to the long-term driving plan and systematically switches from automatic driving to manual driving before the area where automatic driving can be completed. Furthermore, when the driving environment control unit 63 accidentally or suddenly makes it difficult to recognize the driving environment by the driving environment recognition unit 61 and it is difficult to generate a short-term driving plan by the driving plan generation unit 62, the driving change control unit 63 switches from automatic driving to manual driving. Determine the switch. Further, the driving change control unit 63 determines switching from automatic driving to manual driving even when an override request operation by the driver is detected based on driving operation information acquired by the ECU communication unit 64.

  The ECU communication unit 64 performs an output process of information directed to the vehicle control ECU 80 and an acquisition process of information from the vehicle control ECU 80. Specifically, the ECU communication unit 64 generates vehicle control information having contents according to the planned travel locus formulated by the travel plan generation unit 62, and together with operation information indicating whether or not the vehicle A is controlled by the automatic driving function. And sequentially output to the vehicle control ECU 80. In addition, the ECU communication unit 64 can acquire driving operation information by the driver from the vehicle control ECU 80.

  The HCU communication unit 65 performs information output processing for the HCU 20 and information acquisition processing from the HCU 20. Specifically, the HCU communication unit 65 includes the operation information indicating whether or not the automatic driving function is operating, the relative position information of the recognition target object in the traveling direction to be recognized by the driver, and the vehicle A based on the automatic driving function. Control information (hereinafter referred to as “ADAS information”) and the like are sequentially output to the HCU 20. The recognition object is, for example, a traffic signal or a road sign.

  In addition, the HCU communication unit 65 sends request information for requesting a driving change from the automatic driving function to the driver to the HCU 20 when the driving change control unit 63 determines the driving switching from the automatic driving to the manual driving. Output toward. In addition, the HCU communication unit 65 obtains input information for an automatic driving start operation, input information for a display switching operation for switching display in a display area 40 described later, and the like from the HCU 20.

  The vehicle control ECU 80 is electrically connected to the in-vehicle actuator group 90 and the driving operation sensor group 91 mounted on the vehicle A. The in-vehicle actuator group 90 includes, for example, a throttle actuator, an injector, a brake actuator, a driving motor generator, a steering actuator, and the like. The driving operation sensor group 91 includes a steering angle sensor, a throttle position sensor, a brake pedal force sensor, and the like.

  The vehicle control ECU 80 integrally controls acceleration / deceleration and steering of the vehicle A by a control signal output toward the in-vehicle actuator group 90. In addition, the vehicle control ECU 80 outputs driving operation information by the driver detected by the driving operation sensor group 91 to the automatic driving ECU 50 and the HCU 20.

  The vehicle control ECU 80 is mainly configured by a microcomputer having a processor 81, a RAM 83, a storage medium 84, an input / output interface 85, and the like (see FIG. 3). The vehicle control ECU 80 executes the vehicle control program stored in the storage medium 84 by the processor 81, thereby constructing the actuator control unit 80a as a functional block related to vehicle control.

  The actuator control unit 80a generates a control signal output from the vehicle control ECU 80 toward the in-vehicle actuator group 90. The actuator control unit 80a acquires vehicle control information from the automatic driving ECU 50 in a state where the automatic driving function is operating, and generates a control signal based on the vehicle control information. In addition, the actuator control unit 80a generates a control signal having contents according to the driving operation information detected by the driving operation sensor group 91 and outputs the control signal to the in-vehicle actuator group 90 in a state where the automatic driving function is stopped. To do.

  The HCU 20 controls the acquisition of operation input information by the driver and the information presentation to the driver in an integrated manner. The HCU 20 is electrically connected to the notification device 10 and the detection device 13. In addition, the smartphone 110 and the external memory 120 can be connected to the HCU 20 by wire or wirelessly.

  The notification device 10 is configured to notify information to the driver. The notification device 10 includes display devices such as a transmissive display device 11 and a HUD device 12. The transmissive display device 11 and the HUD device 12 display various information on the plurality of display areas 40 set in the windshield 18 based on a control signal acquired from the HCU 20. In the windshield 18, an upper display area 41 and a lower display area 42 are set as a plurality of display areas 40.

  The transmissive display device 11 is a display device that displays various images in the upper display area 41 as real images. The transmissive display device 11 forms an upper display area 41 by being provided on the surface of the windshield 18 on the vehicle interior side. The transmissive display device 11 displays various images in color by controlling the light transmittance. When the transmissive display device 11 is turned off, the upper display area 41 becomes substantially transparent.

  The upper display area 41 is set in a horizontally long rectangular shape closer to the upper edge than the lower edge of the windshield 18. The lower edge of the upper display area 41 is defined above the vanishing point VP in the foreground as viewed from the driver performing the driving operation. More specifically, the lower edge of the upper display area 41 is set above the vanishing point VP in the foreground as viewed from the viewpoint position in the eyelips in the vehicle A taking a horizontal posture. The upper display area 41 is provided at a position higher than the viewpoint of the driver who performs the driving operation. During the automatic driving in which the driving operation is performed by the automatic driving function, various contents aiming at maintaining the driver's arousal level are displayed in the upper display area 41. The content displayed in the upper display area 41 is information not directly related to the driving operation, for example, entertainment related information such as a moving image and a social networking service (SNS).

  The HUD (Head-Up Display) device 12 is a display device that displays various images in the lower display area 42 as virtual images. The HUD device 12 is installed, for example, in an instrument panel in front of the driver's seat 17. The HUD device 12 projects image light toward the lower display area 42. The light of the image reflected to the vehicle interior side by the lower display area 42 is perceived by the driver seated in the driver's seat 17. The driver can visually recognize the virtual image of the image projected by the HUD device 12 on the foreground of the vehicle A.

  Similar to the upper display area 41, the lower display area 42 has a horizontally long rectangular shape. The lower display area 42 is located below the upper display area 41 in the windshield 18. The lower display area 42 is set closer to the lower edge than the upper edge of the windshield 18. The lower display area 42 is provided at a position lower than the viewpoint of the driver who performs the driving operation. The width and height of the lower display area 42 are smaller than the width and height of the upper display area 41. Therefore, the area of the lower display area 42 is smaller than the area of the upper display area 41. In the lower display area 42, various vehicle information relating to the vehicle A including ADAS information is displayed.

  Note that the notification device 10 may include a speaker that can reproduce sound, a tactile presentation device, and the like. Further, the notification device 10 can include not only a configuration preinstalled in the vehicle A but also a configuration temporarily mounted in the vehicle A by being brought into the vehicle interior by a passenger of the vehicle A.

  The detection device 13 is configured to detect the state of the driver and the operation by the driver. The detection device 13 includes, for example, a driver status monitor 14, a steering switch 15, a seat position sensor 16, and the like.

  A driver status monitor (DSM) 14 includes a near-infrared light source and a near-infrared camera, and a control unit for controlling them. The DSM 14 photographs a driver's face irradiated with near-infrared light from a near-infrared light source with a near-infrared camera. The DSM 14 extracts the driver's face direction, line-of-sight direction, eye opening degree, and the like from the captured image. Face orientation information, line-of-sight information, and arousal level information for the driver are sequentially output to the HCU 20.

  A plurality of steering switches 15 are arranged in the spoke portion of the steering wheel. The steering switch 15 is input with a startup operation of the automatic driving function, a display switching operation for switching the display of the upper display area 41 on and off, and the like. Input information such as a start operation and a display switching operation input to the steering switch 15 is sequentially output to the HCU 20.

  The seat position sensor 16 is a sensor that detects the state of the driver's seat. Specifically, the seat position sensor 16 detects the rear oblique angle of the backrest that is tilted rearward of the vehicle A by the driver. The seat position sensor 16 sequentially outputs the rear oblique angle of the backrest toward the HCU 20 as reclining information indicating the reclining state of the driver seat 17.

  The smartphone 110 and the external memory 120 are configured to provide the HCU 20 with content information displayed in the upper display area 41 during automatic operation. For example, the smartphone 110 provides the HCU 20 with moving image data acquired by mobile communication or the like, SNS and mail data, videophone communication data, and the like. The external memory 120 can provide moving image data stored in advance to the HCU 20.

  The HCU 20 is mainly composed of a microcomputer having a CPU 21, a GPU 22, a RAM 23, a storage medium 24, and an input / output interface 25 (see FIG. 3). The HCU 20 can execute the display control program stored in the storage medium 24 by the CPU 21 and the GPU 22. Based on the display control program, the HCU 20 constructs the vehicle information acquisition unit 31, the driver information acquisition unit 32, the content information acquisition unit 33, the oversight determination unit 34, and the display control unit 35 as functional blocks.

  The vehicle information acquisition unit 31 acquires information from the automatic driving ECU 50 through communication with the HCU communication unit 65. In the vehicle information acquisition unit 31, an operation information acquisition block 31a, a request information acquisition block 31b, an ADAS information acquisition block 31c, an object information acquisition block 31d, and the like are constructed as sub functional blocks.

  The operation information acquisition block 31a acquires operation information of the automatic driving function from the HCU communication unit 65. The request information acquisition block 31 b acquires the driving change request information output from the HCU communication unit 65 based on the determination of the driving change control unit 63. ADAS (Advanced Driver Assistance System) information acquisition block 31c acquires vehicle information related to vehicle A such as ADAS information and speed information. The object information acquisition block 31d acquires the relative position information of the recognition object.

  The driver information acquisition unit 32 acquires information related to the driver through communication with the detection device 13 and the vehicle control ECU 80. In the driver information acquisition unit 32, an operation information acquisition block 32a, a line-of-sight information acquisition block 32b, a sheet information acquisition block 32c, a delivery request detection block 32d, and the like are constructed as sub functional blocks.

  The operation information acquisition block 32a acquires input information input to the steering switch 15. For example, the input information of the starting operation of automatic driving, the input information of the display switching operation, and the like are acquired by the operation information acquisition block 32a. The line-of-sight information acquisition block 32 b acquires line-of-sight information indicating the direction of the driver's line of sight detected by the DSM 14. The seat information acquisition block 32 c acquires the reclining information detected by the seat position sensor 16.

  The delivery request detection block 32d acquires driving operation information from the vehicle control ECU 80 when the automatic driving function is operating. The specific driving operation input by the driver in the vehicle A in which the automatic driving function is activated is a driver's request operation for requesting the delivery of the driving operation to the automatic driving function. For example, the steering operation of the steering wheel and the operation of the accelerator pedal and the brake pedal may correspond to the request operation. The delivery request detection block 32d detects a requested operation for requesting the driver to override the control right based on the acquired driving operation information.

  The content information acquisition unit 33 can communicate with the smartphone 110 and the external memory 120. The content information acquisition unit 33 acquires content information from at least one of the smartphone 110 and the external memory 120. The content information acquisition unit 33 receives content information from at least one of the smartphone 110 and the external memory 120 when the automatic driving function is activated and the display of the upper display area 41 is in an on state.

  The oversight determination unit 34 compares the relative position information of the recognition object acquired in the object information acquisition block 31d with the line-of-sight information acquired in the line-of-sight information acquisition block 32b. The oversight determination unit 34 determines oversight of the recognized object by the driver based on the position information and the line-of-sight information of the recognized object. Specifically, the oversight determination unit 34 determines that the driver has overlooked the recognition object when there is no movement of the line of sight toward the recognition object. Moreover, the oversight determination part 34 determines with having recognized this recognition target object, when a driver | operator's eyes | visual_axis is turned to the recognition target object. The oversight determination of the recognition target by the oversight determination unit 34 may be continuously performed during manual driving and may be stopped during automatic driving.

  The display control unit 35 is a control signal that is output to the transmissive display device 11 and the HUD device 12 based on the information acquired by the vehicle information acquisition unit 31, the driver information acquisition unit 32, and the content information acquisition unit 33. Is generated. The display control unit 35 controls on / off of each display in the upper display area 41 and the lower display area 42 and the mode of each display.

  A plurality of display modes are set in the display control unit 35. In each display mode, ON / OFF of each display in the upper display area 41 and the lower display area 42 and information to be displayed in the upper display area 41 and the lower display area 42 are defined in advance. The display control unit 35 can switch the display mode among a plurality based on each information acquired by the vehicle information acquisition unit 31 and the driver information acquisition unit 32. In the display control unit 35, a manual operation mode, an oversight warning mode, an automatic operation mode, a first content display mode and a second content display mode, a change request mode, and the like shown in FIG. 4 are set in advance as a plurality of display modes. ing.

  The manual operation mode is a display mode that is set when the automatic operation function is not activated. When the power source of the vehicle A is turned on, the display mode is set to the manual operation mode as an initial state. In the manual operation mode, the display in the upper display area 41 is turned off in order not to prevent concentration on the operation. On the other hand, the display of the lower display area 42 is turned on. In the lower display area 42, as vehicle information, for example, various indicators such as a traveling speed of the vehicle A, a turn-by-turn image, and a caution for freezing are displayed in a virtual image.

  The oversight warning mode is one of the variations of the manual operation mode that is set when the automatic operation function is not activated. When the vehicle A is controlled by the driver, the display control unit 35 determines that an oversight determination unit 34 has overlooked a recognition target such as a traffic signal or a road sign. Switch the display mode from over to warning mode. In the oversight warning mode, the display of the upper display area 41 is turned on in addition to the lower display area 42. In the oversight warning mode, a warning message, a warning icon, or the like for alerting the driver of the recognition target object is displayed in the upper display area 41. As a result, the overlooked recognition object is notified to the driver using the display in the upper display area 41. When the driver's line of sight is directed to an overlooked recognition object or when a time-out occurs due to passing the side of the recognition object, the display control unit 35 performs normal manual operation from the oversight warning mode. Return to operation mode and display mode.

  The automatic operation mode is a display mode that is set in a state where the automatic operation function is operating based on the operation information of the automatic operation function. When the operation information indicating the operation of the automatic operation function is acquired by the operation information acquisition block 31a, the display control unit 35 switches the display mode from the manual operation mode to the automatic operation mode. The display control unit 35 may switch the display mode using the input information of the activation operation of the automatic driving function as the operation information.

  In the automatic operation mode, content display by the upper display area 41 is permitted. However, in the normal automatic operation mode, as in the normal manual operation mode, the display of the upper display area 41 remains off. On the other hand, in the lower display area 42, ADAS information acquired from the automatic driving ECU 50 is displayed as vehicle information. Specifically, each image indicating ADAS information such as a white line recognition state and a planned traveling locus is displayed in the lower display area 42.

  Each of the first content display mode and the second content display mode is one of variations of the automatic driving mode set in a state where the automatic driving function is operating. The display control unit 35 switches the display mode from the normal automatic driving mode or the second content display mode to the first content display mode when the driver performs a reclining operation of the driver's seat 17. Specifically, the display control unit 35 selects the first content when the backrest of the driver's seat 17 is tilted backward from a preset angle threshold based on the reclining information acquired by the seat information acquisition block 32c. Switch to the display mode. When the display control unit 35 determines that the reclining of the driver's seat 17 is released by the driver based on the reclining information, the display control unit 35 returns the display mode from the first content display mode to the normal automatic driving mode.

  The angle threshold used for switching to the first content display mode may be changeable by a user such as a driver. In addition, the angle threshold when switching to the first content display mode and the angle threshold when canceling the first content display mode may be the same or different.

  By switching to the first content display mode as described above, display of content in the upper display area 41 is started. On the other hand, when the display of content in the upper display area 41 is started, the display in the lower display area 42 is turned off. Thus, the display of the lower display area 42 that has become difficult for the driver to see due to the lowering of the viewpoint position accompanying the reclining is ended. When the display of the lower display area 42 is terminated, the display control unit 35 causes at least a part of the ADAS information displayed in the lower display area 42 to be displayed side by side with the content in the upper display area 41.

  When the input information of the display switching operation for turning on the display of the upper display area 41 is acquired by the operation information acquisition block 32a, the display control unit 35 performs display setting for setting the upper display area 41 to the on state. As described above, the display mode is switched from the normal automatic operation mode to the second content display mode. The display of content in the upper display area 41 is also started by switching to the second content display mode. In addition, in the second content display mode, the display of the ADAS information by the lower display area 42 is continued as in the normal automatic operation mode. Further, the display control unit 35 performs display setting for setting the upper display area 41 to the off state when the input information of the display switching operation for setting the display of the upper display area 41 to the off state is acquired by the operation information acquisition block 32a. . As a result, the display mode is returned from the second content display mode to the normal automatic operation mode.

  In the first content display mode and the second content display mode described above, the driver can enjoy moving image content such as movies and network content such as SNS displayed in the upper display area 41 and maintain the awake state. It becomes easy to do. At this time, the driver can grasp the surrounding situation through the area below the upper display area 41 in the windshield 18. Therefore, the driver can easily grasp the state around the vehicle and can easily respond to the change request from the automatic driving function, compared with the case of enjoying the content using the smartphone 110.

  In each of these automatic driving modes, if the driver's requested operation is detected by the delivery request detection block 32d, the display control unit 35 manually starts from each automatic driving mode in accordance with the override of the control right by the driver. Switch the display mode to the operation mode. As described above, the display of content in the upper display area 41 is prohibited again. As described above, when the control right is handed over to the driver according to the driver's intention, the display of the content in the upper display area 41 which is in the on state is immediately terminated.

  The change request mode is a display mode for notifying the driver of a change request from the automatic driving function. The display control unit 35 switches the display mode from each automatic driving mode to the replacement request mode when request information indicating a replacement request from the automatic driving function is acquired by the request information acquisition block 31b. In the change request mode, each display in the upper display area 41 and the lower display area 42 is turned on. Then, the display of the content in the upper display area 41 is terminated, and the driver is notified of a change request from the automatic driving function using both the upper display area 41 and the lower display area 42. In the change request mode, the driver is prompted to change quickly by using a plurality of displays.

  When the operation change from the automatic driving function to the driver is completed and the operation information indicating the manual operation is acquired in the operation information acquisition block 31a, the display control unit 35 switches from the change request mode to the manual operation mode. , Switch the display mode. As a result, the display in the upper display area 41 is turned off.

  Details of the mode switching process for switching the display mode described so far will be described with reference to FIG. 1 based on the flowcharts shown in FIGS. The mode switching process shown in each figure is started by the HCU 20 when the power source of the vehicle A is turned on and the supply of power to the in-vehicle network 1 (see FIG. 2) is started. The mode switching process is repeated until the vehicle A is turned off.

  In S101, the display mode is set to the manual operation mode as an initial state, and the process proceeds to S102. In S102, an operation information acquisition process indicating whether or not the vehicle is controlled by the automatic driving function is performed, and the process proceeds to S103. In S103, it is determined based on the operation information acquired in S102 whether or not the automatic driving function is operating. If it is determined in S103 that automatic driving is in progress, the process proceeds to S104. In S104, the display mode is set to the automatic operation mode, and the process proceeds to S113. Due to the setting in S104, the display of content in the upper display area 41 is permitted.

  If it is determined in S103 that manual operation is being performed, the process proceeds to S105. In S105, the process which acquires the relative positional information of the recognition target object of the advancing direction which a driver should recognize is implemented, and it progresses to S106. In S106, the process which acquires the gaze information which shows the direction of a driver | operator's gaze is implemented, and it progresses to S107. In S107, based on the position information of the recognition target acquired in S105 and the line-of-sight information acquired in S106, it is determined whether or not the driver has missed the recognition target. If it is determined in S107 that there is no oversight, the process returns to S101. If no driver oversight has occurred during manual operation, the normal manual operation mode is maintained by repeating S101 to S103 and S105 to S107.

  On the other hand, if it is determined in S107 that there is an oversight, the process proceeds to S108. In S108, the display mode is overlooked and the warning mode is set, and the process proceeds to S109. In S109 and S110, similarly to S102 and S103, acquisition of operation information and determination of whether or not automatic driving is in progress are performed. If it is determined in S110 that automatic operation is being performed, the process proceeds to S104, and if it is determined that manual operation is being performed, the process proceeds to S111.

  In S111, a process of acquiring line-of-sight information is performed as in S106, and the process proceeds to S112. In S112, based on the latest line-of-sight information acquired in S111 and the position information acquired in S105, it is determined whether or not the driver has visually recognized the recognition object that has been overlooked. In addition, in S112, it is determined whether the vehicle A has passed through the recognition target object and timed out. If it is determined in S112 that the driver has not visually recognized the recognition target object and has not timed out, the process returns to S108. When there is no visual recognition by the driver, S108 to S112 are repeated until time-out occurs, and the oversight warning mode is maintained. On the other hand, when the driver visually recognizes the recognition target object or times out, the process returns to S101. As a result, the display mode is returned from the oversight warning mode to the normal manual operation mode.

  In S113 after the display mode is set to the automatic driving mode, an acquisition process of driving change request information to the driver by the automatic driving function is performed, and the process proceeds to S114. In S114, based on whether or not the request information is acquired in S113, it is determined whether or not there is a replacement request. If it is determined in S114 that there is no replacement request, the process proceeds to S118. On the other hand, if it is determined in S114 that there is a replacement request, the process proceeds to S115.

  In S115, the display mode is set to the change request mode, and the process proceeds to S116. In S116, similarly to S102, an operation information acquisition process is performed, and the process proceeds to S117. In S117, based on the operation information acquired in S116, it is determined whether or not the driving change from the automatic driving function to the driver is completed. If the operation information indicates manual operation in S117, it is determined that the driving change is completed, and the process returns to S101. As described above, the display mode is switched from the change request mode to the manual operation mode. On the other hand, if the operation information indicates automatic driving in S117, it is determined that the driving shift is continuing, and the process returns to S115. The change request mode is continued until the driving change is completed by repeating S115 to S117.

  In S114, when it is determined that there is no replacement request, in S118, detection processing of the requested operation of the driver who requests the delivery of the driving operation is performed, and the process proceeds to S119. In S119, it is determined whether a requested operation is detected in S108. If it is determined in S109 that the requested operation has been detected, the process returns to S101. As described above, the display mode is switched from the automatic operation mode to the manual operation mode in accordance with the override of the driver. On the other hand, if it is determined in S119 that the requested operation has not been detected, the process proceeds to S120.

  In S120, the reclining information acquisition process is performed, and the process proceeds to S121. In S121, by comparing the reclining information acquired in S120 with the threshold angle, it is determined whether or not the backrest of the driver's seat is tilted backward from the preset angle threshold and reclining. If it is determined in S121 that the driver's seat 17 is in a reclining state, the process proceeds to S122. In S122, the display mode is set to the first content display mode, and the process returns to S113.

  If it is determined in S121 that the driver's seat 17 is not in the reclining state but in a normal state, the process proceeds to S123. In S123, the display setting reference process of the upper display area 41 based on the display switching operation is performed, and the process proceeds to S124. In S124, it is determined whether or not the setting referred to in S123 is a setting indicating that the upper display area 41 is on. If it is determined in S124 that the display setting is a setting indicating that the upper display area 41 is off, the process returns to S113. As described above, the normal automatic operation mode is continued.

  On the other hand, when it is determined in S124 that the display setting is a setting indicating that the upper display area 41 is ON, the process proceeds to S125. In S125, the display mode is set to the second content display mode, and the process returns to S113. By repeating the process between S113 and S125, the second content display mode is continued.

  According to the present embodiment described so far, display of content in the upper display area 41 is permitted in a state where the automatic driving function is operating, and driver's boredom can be eliminated by displaying the content. As a result, a decrease in the driver's arousal level can be suppressed. In addition, since the upper display area 41 is located closer to the upper edge than the lower edge of the windshield 18, the situation around the vehicle A is passed through the area below the upper display area 41 in the windshield 18. It can be grasped by the driver. As described above, according to maintaining the driver's arousal level without disturbing the driver's understanding of the surroundings of the vehicle A, the driving change from the automatic driving function to the driver can be performed smoothly. Become.

  In addition, in the present embodiment, the display in the upper display area 41 is turned off in the normal manual operation mode. Thus, if information presentation during manual operation is simplified, even if the transmissive display device 11 is provided, the driver does not easily feel the upper display area 41 during manual operation, and monitoring of the surroundings is also possible. Not disturbed. Furthermore, according to the simplification of information presentation during manual driving, it is possible to prevent overconfidence of the driving support function from the vehicle A and to encourage the driver to take proactive driving. In addition, if the display of the upper display area 41 is turned off, the power consumed by the transmissive display device 11 is reduced.

  In addition, the display of content in the upper display area 41 of the present embodiment is started when the backrest of the driver's seat 17 is reclined. If the display start of the content is associated with the reclining state of the driver's seat 17 as described above, the display of the content is automatically started when the driver is in an easy-to-see posture of the upper display area 41. As a result, the function of displaying content in the upper display area 41 during automatic driving is a user-friendly function.

  Furthermore, the upper display area 41 of the present embodiment is disposed near the upper edge of the windshield 18. Therefore, even if the driver's seat 17 is in a reclining state, the driver can visually recognize the content displayed in the upper display area 41 while keeping an easy posture. As a result, the effect of maintaining the arousal level by displaying the content is surely exhibited.

  In addition, in the present embodiment, a lower display area 42 for displaying vehicle information and the like is defined separately from the upper display area 41. Therefore, during manual driving, even if the display of the upper display area 41 is turned off, the vehicle information can be appropriately provided to the driver by the display of the lower display area 42.

  Further, in the present embodiment, when the driver's viewpoint position is lowered by the reclining of the driver's seat 17, the display of the lower display area 42 that has become difficult for the driver to visually recognize is terminated. As a result, it is possible to prevent a situation where wasteful power is consumed due to the continuation of the display in the lower display area 42 that is difficult for the driver to visually recognize.

  Furthermore, in this embodiment, even if the display of the lower display area 42 is turned off, the ADAS information is moved to the upper display area 41 and continuously displayed. According to the display of the ADAS information in the upper display area 41, part of the driver's consciousness can be directed to grasping the situation around the vehicle even during automatic driving. As a result, the driving change from the automatic driving function to the driver can be performed smoothly. Furthermore, if ADAS information is presented in a timely manner, the driver can easily feel a sense of security with respect to the automatic driving function.

  In addition, in the present embodiment, in the change request mode when there is a change request from the automatic driving function, the driver is notified of the request for driving change using the display in both the upper display area 41 and the lower display area 42. Is done. As a result, the driver can immediately notice a request for a driving change from the automatic driving function. Therefore, even if it is an accidental request for driving change, the driver can quickly respond to the transfer of the control right from the automatic driving function by noticing the notification of each display.

  In addition, according to the present embodiment, when a request operation for overriding is detected, the display of content in the upper display area 41 is promptly terminated. Therefore, the driver can grasp the situation around the vehicle without being disturbed by the display of the content. As a result, it is possible to smoothly implement the driving change according to the driver's intention.

  Here, the situation around the vehicle necessary for driving can be sufficiently grasped if a range below the vanishing point VP in the foreground is visually recognized. Therefore, in the present embodiment, the lower edge of the upper display area 41 is set above the vanishing point VP in the foreground. As a result, it is difficult for the driver to grasp the situation around the vehicle by the display of the content in the upper display area 41. Therefore, even when the content is displayed in the upper display area 41, the driver can reliably grasp information around the vehicle.

  Furthermore, in this embodiment, when the driver overlooks the recognition target object during manual driving, the overlooked recognition target object is notified to the driver by the display in the upper display area 41. As described above, the upper display area 41 can be used not only during automatic driving but also during manual driving, and can provide information useful to the driver such as alerting oversight.

  The HCU 20 corresponds to a “display control device”, and the CPU 21 and the GPU 22 correspond to a “processor”. The line-of-sight information acquisition block 32b corresponds to a “line-of-sight information acquisition unit”, the sheet information acquisition block 32c corresponds to a “sheet information acquisition unit”, and the delivery request detection block 32d corresponds to a “request detection unit”.

(Other embodiments)
Although one embodiment of the present disclosure has been described above, the present disclosure is not construed as being limited to the above-described embodiment, and can be applied to various embodiments and combinations without departing from the scope of the present disclosure. be able to.

  In the above embodiment, the upper display area and the lower display area are provided integrally with the windshield on the surface of the windshield on the vehicle interior side. However, for example, the upper display area and the lower display area may be set to a transparent plate-like member such as a combiner provided separately from the windshield on the vehicle interior side of the windshield.

  In the upper display area of the above embodiment, an image is displayed by the transmissive display device. However, the display device that forms the display in the upper display area is not limited to the transmissive display device. For example, a HUD device that displays a virtual image by projecting light of an image on the upper display region may be provided separately from the HUD device for the lower display region.

  In the lower display area of the above embodiment, an image is displayed by the HUD device. However, the display device that forms the display in the lower display area is not limited to the HUD device. For example, similarly to the upper display area, an image may be displayed in the lower display area by the transmissive display device. Furthermore, an image may be displayed in both the upper display area and the lower display area by one display device.

  In the normal automatic driving mode of the above embodiment, the display of the content in the upper display area is not started, and the display of the content is started by the input of the driver's seat reclining or display switching operation. However, content display in the upper display area may be started in conjunction with switching from the manual operation mode to the automatic operation mode. Furthermore, the display of content in the upper display area may be started using information different from the reclining and display switching operations as a trigger.

  In the above embodiment, the display of the lower display area is turned off by the reclining of the driver's seat, but the display of the lower display area may be continued even if the reclining is performed. When the lower display area is turned off, the information displayed in the lower display area may not be moved to the upper display area, and may be displayed on, for example, a combination meter and a center display.

  The shape of the upper display area set in the horizontally long rectangular shape in the above embodiment can be changed as appropriate. In addition, a non-display area that does not overlap the content display is secured below the vanishing point VP in the foreground as viewed from the viewpoint position in the eyelip in a vehicle that is in automatic driving and takes a horizontal posture. For example, the position of the upper display area may be changed as appropriate. For example, the upper display area can be set in a range above the vertical center line of the windshield defined along the vehicle width direction.

  In the above embodiment, the driver's request for switching from the automatic driving function based on the determination of the driving shift control unit has been notified to both the upper display area and the lower display area. However, the change request may be notified only by one of the upper display area and the lower display area. Further, for example, a planned change request may be notified by only one of the upper display area and the lower display area, and a sudden change request may be notified by both the upper display area and the lower display area.

  In the above embodiment, the display in the upper display area is immediately turned off by overriding the control right by the driver. However, based on the input of the request operation for overriding, for example, the display of the upper display area may be terminated after the message image indicating that the control right of the driving operation is transferred to the driver is displayed.

  The oversight warning function as in the above embodiment may be omitted. Or the necessity of implementation of an oversight warning may be selected by switching operation by a driver. Furthermore, the recognition target object to be overlooked warning is not limited to traffic signals and road signs, but may be a moving object such as a pedestrian.

  In the embodiment described above, the CPU (Central Processing Unit) and the GPU (Graphics Processing Unit) of the HCU are used as the processor that executes the display control program. However, each functional unit related to display control may be appropriately realized by various electronic control units mounted on the vehicle. For example, if the automatic operation ECU is an in-vehicle system that also functions as an HCU, the CPU 51 and the GPU 52 (see FIG. 3) of the automatic operation ECU may execute the display control program. Further, the CPU and each GPU of the automatic operation ECU and the HCU may process the display control program in cooperation. Further, the microcontroller of the combination meter may execute the display control program as a processor. Various non-transitional tangible storage media such as a flash memory and a hard disk can be used as a storage medium for storing a program executed by each processor.

A vehicle, 17 driver's seat, 18 windshield, 20 HCU (display control device), 21 CPU (processor), 22 GPU (processor), 31 vehicle information acquisition unit, 32b gaze information acquisition block (gaze information acquisition unit), 32c Sheet information acquisition block (sheet information acquisition unit), 32d delivery request detection block (request detection unit), 34 oversight determination unit, 35 display control unit, 40 display area, 41 upper display area, 42 lower display area, VP vanishing point

Claims (10)

A display control device that controls the display of at least one display area (40) set in front of the driver seat (17) in a vehicle (A) having an automatic driving function capable of performing a driving operation on behalf of the driver. There,
A vehicle information acquisition unit (31) for acquiring operation information indicating whether or not the vehicle is controlled by the automatic driving function;
When the vehicle is controlled by the automatic driving function, a display control unit that permits display of content by the upper display area (41) positioned closer to the upper edge than the lower edge of the windshield (18) of the vehicle (35) and
A display control device. A seat information acquisition unit (32c) for acquiring reclining information indicating the reclining state of the driver seat;
2. The display control unit according to claim 1, wherein, based on the reclining information, the display of the content in the upper display area is started when the backrest of the driver's seat is tilted backward from a preset angle threshold. Display controller. The display control unit
In the lower display area (42) located closer to the lower edge than the upper edge of the windshield, vehicle information relating to the vehicle is displayed,
The display control apparatus according to claim 2, wherein display of the lower display area is terminated when display of content in the upper display area is started based on the reclining information.   The said display control part displays at least one part of the said vehicle information currently displayed on the said lower display area on the said upper display area, when the display of the said lower display area is complete | finished. Display control device.   The display control device according to claim 1, wherein the display control unit displays vehicle information relating to the vehicle in a lower display area (42) located closer to the lower edge than the upper edge of the windshield. The vehicle information acquisition unit further acquires request information for driving change to the driver by the automatic driving function,
When the request information is acquired by the vehicle information acquisition unit, the display control unit notifies the driver of a request for a driving change using both the upper display area and the lower display area. The display control device according to any one of claims 3 to 5. A request detection unit (32d) for detecting the driver's request operation for requesting delivery of the driving operation to the automatic driving function,
The display control device according to any one of claims 1 to 6, wherein the display control unit terminates display of the content in the upper display area when the request operation is detected by the request detection unit.   The display control device according to any one of claims 1 to 7, wherein a lower edge of the upper display area is defined above a vanishing point (VP) in the foreground as viewed from the driver performing the driving operation. . The vehicle information acquisition unit acquires position information of a recognition target object in a traveling direction that the driver should recognize,
A line-of-sight information acquisition unit (32b) for acquiring line-of-sight information indicating the direction of the driver's line of sight;
An oversight determination unit (34) for determining oversight of the recognition object by the driver based on the positional information and the line-of-sight information of the recognition object;
When the vehicle is being controlled by the driver, the display control unit determines that the overlooked recognition object is overlooked when the oversight determination unit determines that the recognition object is overlooked. The display control apparatus as described in any one of Claims 1-8 which alert | reports using the display of a display area. In a vehicle (A) having an automatic driving function capable of performing a driving operation on behalf of a driver, a display control program for controlling display of at least one display area (40) set in front of a driver seat,
Obtaining operation information indicating whether or not the vehicle is controlled by the automatic driving function (S102);
When the vehicle is controlled by the automatic driving function, permitting the display of content by the upper display area (41) located closer to the upper edge than the lower edge of the windshield of the vehicle (S104);
Is a display control program that causes at least one processor (21, 22) to execute.

Images