JP2018103880A - Display device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a display device which allows a driver to easily grasp surrounding situation when switching from automatic driving to manual driving.SOLUTION: A control part displays an automatic driving screen which includes surrounding situation during automatic driving and displays a switching screen which includes the surrounding situation from when switching from the automatic driving to manual driving is made until predetermined time elapses or until traveling a predetermined distance is made. When the predetermined time has elapsed or the traveling the predetermined distance has been made after switching from the automatic driving to the manual driving, it displays a manual driving screen which does not include the surrounding situation.SELECTED DRAWING: Figure 4

Description

  The present invention relates to a display device, a display method, a display control program for executing the display method, and a recording medium on which the display control program is recorded.

  As a technology related to automobiles (moving bodies) that select automatic driving and manual driving, there is a known technology that presents this to the driver when there is a possibility of switching from automatic driving to manual driving. (Patent Document 1).

  During the automatic driving of the car, the driver is freed from the need to monitor the surrounding situation, and therefore does not confirm or grasp the surrounding situation. For this reason, even if the switching from automatic driving to manual driving is presented in advance, the problem is that the driver cannot check and grasp the surrounding situation in time and cannot smoothly switch to manual driving.

JP 2001-199295 A

  This invention makes it an example of a subject to cope with such a problem. That is, the present invention provides, for example, a display device, a display method, a display control program for executing the display method, and the display control program that enable the driver to easily understand the surrounding situation when switching from automatic driving to manual driving. The object is to provide a recorded recording medium.

  The display device according to claim 1, which has been made to solve the above-described problem, displays on the display unit a display unit, an acquisition unit that acquires a situation around a moving body, and the ambient situation acquired by the acquisition unit. A control unit that causes the display unit to display the ambient state until a predetermined time has elapsed or the vehicle has traveled for a predetermined period after switching from automatic operation to manual operation of the moving body. It is characterized by.

  The display method according to claim 9 is a display method for causing the display unit to display the surrounding state of the moving body acquired by the acquiring unit, and a predetermined time has elapsed after switching from automatic operation to manual operation of the moving body. Until the vehicle travels or travels a predetermined section, the surrounding state is displayed on the display unit.

  The display control program according to claim 10 is a display control program that is executed by a computer that controls the display unit, and travels for a predetermined period of time after a predetermined time elapses after the moving body is switched from automatic operation to manual operation. Until then, the computer is caused to function as a control unit that causes the display unit to display the surrounding situation acquired by the acquisition unit.

  A recording medium according to an eleventh aspect is characterized in that the display control program according to the tenth aspect is recorded.

1 is a perspective view of a display system having a display device according to an embodiment of the present invention. It is the front view which looked at the display system shown by FIG. 1 from the driver's seat. It is explanatory drawing which showed the relationship between the windshield light shown by FIG. 1, and a driver | operator. It is the block diagram which showed the functional structure of the display system shown by FIG. It is a flowchart which shows the control processing procedure of the driver display of the control part shown by FIG. It is a figure which shows the example of a display of the driver display shown in FIG. 1 at the time of automatic driving | operation. It is a figure which shows the example of a display of the driver display shown in FIG. 1 just before the end of automatic driving | operation. It is a figure which shows the example of a display of the driver display shown in FIG. 1 before progress for the predetermined time after switching to manual operation. It is a figure which shows the example of a display of the driver display shown in FIG. 1 after progress for a predetermined time after switching to manual operation.

  Hereinafter, a display device according to an embodiment of the present invention will be described. A display device according to an embodiment of the present invention includes a display unit, an acquisition unit that acquires a situation around the moving body, and a control unit that displays the surrounding situation acquired by the acquisition unit on the display unit. The unit causes the display unit to display the surrounding state until a predetermined time has elapsed after traveling from the automatic operation to the manual operation of the moving body or until traveling for a predetermined section. Thereby, since the surrounding situation is displayed for a while after switching to manual driving, it becomes easier for the driver to grasp the surrounding situation when switching from automatic driving to manual driving.

  Further, the control unit may display the manual operation screen on the display unit after a predetermined time has elapsed after traveling from the automatic operation to the manual operation or after traveling for a predetermined section. As a result, the surrounding situation is displayed without displaying the manual operation screen for a while after switching to manual driving, so it becomes easier for the driver to grasp the surrounding situation when switching from automatic driving to manual driving. .

  In addition, the control unit displays an automatic operation screen including an ambient condition during the automatic operation on the display unit, and includes the ambient condition until a predetermined time elapses after traveling from the automatic operation to the manual operation. The switching screen may be displayed on the display unit, and the manual operation screen may be displayed on the display unit after a predetermined time has elapsed or after traveling for a predetermined period. Thereby, since the surrounding situation is displayed for a while after switching to manual driving, it becomes easier for the driver to grasp the surrounding situation when switching from automatic driving to manual driving.

  Further, the manual operation screen may not include the surrounding situation.

  The acquisition unit may acquire other mobile objects or obstacles around the mobile object as the surrounding situation. This makes it easier for the driver to grasp other moving objects or obstacles around the moving object when switching from automatic driving to manual driving.

  Further, the control unit may enlarge the display of the speed information of the moving body after switching from the automatic operation to the manual operation. This makes it easier for the driver to grasp speed information during manual driving.

  Further, the control unit may display the distance and / or time from the automatic operation to the manual operation on the display unit. Thereby, it is possible to grasp how long the driver will switch to manual driving later.

  In addition, a biological detection unit that detects biological information of the driver may be further provided, and the control unit may enlarge the display of the biological information after switching from automatic driving to manual driving. This makes it easier for the driver to grasp biometric information during manual driving.

  A display method according to an embodiment of the present invention will be described. The display method of the present invention is a display method for causing the display unit to display the surrounding state of the moving object acquired by the acquiring unit, and until a predetermined time elapses after switching from automatic operation to manual operation of the moving object or a predetermined section Until it travels, the surroundings are displayed on the display. Thereby, since the surrounding situation is displayed for a while after switching to manual driving, it becomes easier for the driver to grasp the surrounding situation when switching from automatic driving to manual driving.

  The display method described above may be a program that is executed by a computer. By doing so, the surrounding situation can be displayed for a while after switching to manual driving using a computer, and it becomes easier for the driver to grasp the surrounding situation when switching from automatic driving to manual driving. .

  Further, the above-described program may be stored in a computer-readable recording medium. In this way, the program can be distributed as a single unit in addition to being incorporated in the device, and version upgrades can be easily performed.

  A display device according to an embodiment of the present invention will be described with reference to FIGS. FIG. 1 is a perspective view of a display system 100 having a display device according to the present embodiment. The display system 100 includes a plurality of display units (displays) installed around a driver's seat SH of a vehicle as an example of a moving body. FIG. 2 is a front view of the driver seat SH as viewed from the front.

  The driver's seat SH is provided with a handle H in front thereof and a driver display 101 on the back side thereof. The driver display 101 is a display that is long in the left-right direction. The driver display 101 displays a speedometer, a fuel gauge, a water temperature gauge, and the vehicle surroundings acquired by the vehicle outside information acquisition unit 2 (acquisition unit), which will be described later, by characters or images.

  A control panel 104 is provided on the right side (passenger seat side) of the driver seat SH. On the control panel 104, operation input such as setting of an air conditioner and a navigation system, selection of content such as music and video, and playback is performed.

  A center multimedia display 102 is provided above the control panel 104 (on the right side of the driver display 101). The center multimedia display 102 displays a map and guidance of the navigation system, for example, the above-described video content during automatic driving.

  The windshield light 103 can emit light in a plurality of emission colors by a light emitting element such as an LED (light emitting diode) or an organic EL (Electro Luminescence). In this embodiment, as shown in FIG. 2, the shape is elongated in the left-right direction when viewed from the driver, but is not limited thereto. However, the size (length) of the windshield light 103 is preferably larger than icons, indicators, characters, and the like displayed in the driver display 101.

  As shown in FIG. 3, the windshield light 103 is embedded in a dashboard on the back side of the driver display 101. The windshield light 103 lights up or blinks from the dashboard toward the windshield W (also referred to as a windshield), so that the lighting is reflected on the windshield W (W1 in FIG. 3). It can be visually recognized as being displayed above the display 101.

  In the present embodiment, the windshield light 103 is provided with a pair (103a, 103b) at two places on the right side and the left side as viewed from the driver's seat SH (see FIG. 2).

  Note that the windshield light 103 is not limited to be embedded in the dashboard, but may be disposed below the windshield W and at a position (such as on the dashboard) that can be directly recognized by the driver. Or you may install in the upper part of the driver display 101. FIG. In other words, it may be arranged in front of the driver seat SH. For example, it is preferable to arrange at a position where the line of sight movement from the driver display 101 or the center multimedia display 102 is small.

  Next, a functional configuration of the display system 100 having the above-described configuration will be described with reference to FIG. As shown in FIG. 4, in addition to the driver display 101, the center multimedia display 102, the windshield light 103, and the control panel 104, the display system 100 includes an outside information acquisition unit 2, an in-vehicle information acquisition unit 3, The content information acquisition unit 4 and the control unit 5 are provided.

  The vehicle exterior information acquisition unit 2 is obtained, for example, by a sensor that detects surrounding conditions such as LIDAR (Laser Imaging Detection and Ranging, Laser Illuminated Detection and Ranging) or LiDAR (Light Detection and Ranging) or a camera that captures the outside of the vehicle. Information outside the vehicle (presence and location of surrounding vehicles (other moving objects), presence and location of obstacles including pedestrians, etc.) is acquired. Specifically, the outside information acquisition unit 2 functions as an interface circuit of a sensor such as LIDAR.

  The in-vehicle information acquisition unit 3 automatically acquires information indicating that the vehicle is traveling in automatic driving, information acquired from each sensor installed in the vehicle, such as traveling speed, remaining amount of fuel, and water temperature, and automatically during automatic driving. Driving control information such as operated brakes and direction indicators, biological information of the driver D such as driver drowsiness, and the like are acquired. Specifically, the in-vehicle information acquisition unit 3 functions as an interface circuit with each sensor in the vehicle, a control device for automatic driving, and the like.

  The content information acquisition unit 4 acquires information such as video content to be displayed on the center multimedia display 102 from a storage device such as a hard disk (not shown), an optical device such as a DVD drive, a content server outside the vehicle, and the like. Specifically, the content information acquisition unit 4 functions as an interface circuit with a storage device or an external communication device.

  The control unit 5 controls display of the driver display 101, the center multimedia display 102, and the windshield light 103 based on various information acquired by the outside information acquisition unit 2, the in-vehicle information acquisition unit 3, and the content information acquisition unit 4. . Specifically, the control unit 5 functions as a control circuit such as a CPU (Central Processing Unit).

  The control unit 5 displays numerical values and images of biological information such as the traveling speed and remaining fuel amount acquired by the in-vehicle information acquisition unit 3 or the drowsiness of the driver D, the vehicle surroundings acquired by the outside information acquisition unit 2, and the like. For example, it is displayed on the driver display 101. In addition, the control unit 5 reproduces information such as video content acquired by the content information acquisition unit 4 and displays it on the center multimedia display 102.

  In addition, the control unit 5 displays part of the information acquired by the vehicle exterior information acquisition unit 2 and the vehicle interior information acquisition unit 3 during the automatic driving by turning on or blinking the windshield light 103. For example, the windshield lights 103a and 103b are lit in blue during automatic operation. In addition, for example, when switching between automatic driving and manual driving by a route or the like, the light blinks in purple from a certain time before the end of automatic driving based on the time until the switching point to manual driving. That is, it is displayed that it is within a certain time after the end of automatic driving. Note that it may be from a predetermined distance before the end of automatic driving.

  The driver display 101, the vehicle exterior information acquisition unit 2, and the control unit 5 described above constitute the display device 1 according to an embodiment of the present invention.

  Next, the control operation (display method) of the driver display 101 in the control unit 5 described above will be described with reference to FIGS. FIG. 5 is a flowchart showing a control processing procedure of the driver display 101 of the control unit 5. By configuring this flowchart as a computer program executed by the control unit 5, a display control program can be obtained. 6 to 9 are diagrams showing display examples on the driver display 101. FIG.

  The control unit 5 periodically acquires vehicle exterior information and vehicle interior information from the vehicle exterior information acquisition unit 2 and the vehicle interior information acquisition unit 3. First, in step S1, the control unit 5 determines whether or not automatic operation is being performed. If automatic operation is being performed (in the case of YES), the process proceeds to step S2, and if not in automatic operation (in the case of NO), the step is performed. Proceed to S8. Whether or not automatic driving is in progress may be determined from the information acquired by the in-vehicle information acquisition unit 3.

  In step S2, the control unit 5 determines whether or not it is just before the end of automatic driving. Whether or not it is just before the end of the automatic operation can be determined based on the distance and time from the automatic operation to the manual operation. If it is not just before the end of automatic operation (NO in step S2), the process proceeds to step S3.

  Next, in step S <b> 3, the control unit 5 displays the automatic operation screen shown in FIG. 6 on the driver display 101. The automatic operation screen has an ambient condition area A1, a speedometer area A2, a fuel gauge area A3, a water temperature gauge area A4, a countdown area A5, and a biological information area A6. The surrounding situation area A1 is displayed near the center of the driver display 101. The control unit 5 displays a lane and a host vehicle mark M1 indicating the host vehicle in the surrounding situation area A1. When the outside information acquisition unit 2 detects the surrounding vehicle or an obstacle including a pedestrian, the control unit 5 detects the surrounding vehicle mark or the obstacle at the position of the surrounding vehicle or the obstacle with respect to the own vehicle mark M1 on the surrounding situation area A1. A mark (none of which is shown) is displayed. The driver can know the position of the surrounding vehicle and the obstacle from the positional relationship between the own vehicle mark M1 and the surrounding vehicle mark and the obstacle mark (not shown).

  The speedometer area A2 is displayed on the right side of the surrounding situation area A1, and the traveling speed (speed information) acquired from the in-vehicle information acquisition unit 3 is displayed. The fuel gauge area A3 is displayed on the upper right of the speedometer area A2, and the remaining fuel amount acquired from the in-vehicle information acquisition unit 3 is displayed. The water temperature gauge area A4 is displayed at the lower right of the speedometer area A2, and the water temperature acquired from the in-vehicle information acquisition unit 3 is displayed. The countdown area A5 is displayed on the upper left side of the surrounding situation area A1, and the distance and time from the automatic operation to the manual operation are displayed.

  The biometric information area A6 displays driver biometric information such as the driver's sleepiness. In the present embodiment, a driver icon I1 and a display bar I2 are displayed in the biometric information area A6. The driver icon I1 is displayed in a color corresponding to the degree of sleepiness. In the present embodiment, the display is such that blue is the most awakened and the redness increases as sleepiness increases. The display bar I2 is elongated in the left-right direction, and shows the relationship between the display color of the driver icon I1 and the degree of sleepiness. In the present embodiment, the display bar I2 is gradation-displayed so that the left side is blue and the redness increases toward the right. The driver D can know the degree of sleepiness by the position of the display color of the driver icon I1 on the display bar I2.

  On the other hand, in step S2, if it is just before the end of automatic driving (in the case of YES), the process proceeds to step S4.

  In step S4, the control unit 5 further displays a button area A7 on the automatic operation screen as shown in FIG. The button area A7 is displayed so as to overlap the countdown area A5 and the surrounding situation area A1 on the right side of the biological information display area A6. In the button area A7, the button B provided on the handle H (see FIG. 2) is pressed to confirm whether the driver recognizes the switching to the manual driving or to switch to the manual driving. This is a display area. In the present embodiment, in the button area A7, a picture of a handle provided with a button and a letter “please press the button” are displayed. The control unit 5 displays the automatic operation screen shown in FIG. 7 until switching to manual operation.

  Thereafter, when the automatic operation is switched to the manual operation (YES in step S5), the control unit 5 displays a switching screen as shown in FIG. 8 (step S6). That is, the switching screen has an ambient condition area A1, a speedometer area A2, a fuel gauge area A3, a water temperature gauge area A4, and a biological information area A6. That is, in FIG. 6 and FIG. 7, a screen for switching is obtained by deleting the countdown area A5 and the button area A7 from the automatic operation screen. The speedometer area A2 and the biological information area A6 on the switching screen are displayed larger than the speedometer area A2 and the biological information area A6 on the automatic operation screen. When the control unit 5 switches from the automatic operation screen to the switching screen, the speedometer region A2 and the living body region A6 are gradually displayed larger.

  Thereafter, when a predetermined time has elapsed after switching to manual operation (YES in step S7), the control unit 5 displays the manual operation screen shown in FIG. 9 on the driver display 101 (step S8), and then returns to step S1.

  The manual operation screen has a speedometer area A2, a fuel gauge area A3, a water temperature gauge area A4, a biological information area A6, and a menu selection area A8, and does not include the surrounding situation area A1. On the manual operation screen, a menu selection area A8 is displayed near the center of the screen instead of the surrounding situation area A1. In the menu selection area A8, a plurality of menus (music, news, etc.) that can be selected by the operation unit 105 (see FIG. 2) arranged on the handle H are displayed. Further, the speedometer area A2 and the biological information area A6 on the manual operation screen may be the same size as the speedometer area A2 and the biological information area A6 on the switching screen, or the sizes thereof are different. Also good.

  According to the above-described embodiment, the control unit 5 displays the surrounding situation until a predetermined time has elapsed after switching from automatic driving to manual driving of the vehicle. Thereby, since the surrounding situation is displayed for a while after switching to manual driving, it becomes easy for the driver D to grasp the surrounding situation when switching from automatic driving to manual driving.

  Moreover, according to the Example mentioned above, the control part 5 is switched to the screen for manual operation, after predetermined time passes, after switching from automatic operation to manual operation. As a result, the surrounding situation is displayed without switching to the manual operation screen for a while after switching to manual driving, so when switching from automatic driving to manual driving, driver D knows the surrounding situation. It becomes easy.

  Further, according to the above-described embodiment, the control unit 5 displays the automatic operation screen including the ambient condition during the automatic operation, and includes the ambient condition until a predetermined time elapses after switching from the automatic operation to the manual operation. A switching screen is displayed, and after a predetermined time has elapsed since switching from automatic operation to manual operation, the screen is switched to a manual operation screen that does not include surrounding conditions. Thereby, since the surrounding situation is displayed for a while after switching to manual driving, it becomes easy for the driver D to grasp the surrounding situation when switching from automatic driving to manual driving.

  Moreover, according to the Example mentioned above, the vehicle exterior information acquisition part 2 is acquiring the surrounding vehicle or an obstruction as a surrounding condition. This makes it easier for the driver D to grasp the surrounding vehicle or the obstacle when switching from automatic driving to manual driving.

  Moreover, according to the Example mentioned above, the control part 5 enlarges the display of the speedometer area | region A2 after switching from automatic operation to manual operation. This makes it easier for the driver D to grasp speed information during manual driving.

  Moreover, according to the Example mentioned above, the control part 5 displays the distance and time from the switching to automatic operation to manual operation. Thereby, it is possible to grasp how long the driver D will switch to manual driving later.

  Moreover, according to the Example mentioned above, the control part 5 enlarges the display of biometric information area | region A6 after switching from automatic operation to manual operation. This makes it easier for the driver D to grasp the biological information during manual driving.

  According to the above-described embodiment, the surrounding situation is displayed until a predetermined time has elapsed after switching from automatic operation to manual operation. However, the present invention is not limited to this. You may make it display a surrounding condition until it drive | works a predetermined area after switching from automatic driving | operation to manual driving | operation.

  Further, according to the above-described embodiment, the manual operation screen does not include the surrounding situation area A1, but the present invention is not limited to this. The ambient situation area A1 may be included in the manual operation screen. When including the surrounding situation area A1 on the manual operation screen, it is preferable to make the surrounding situation area A1 smaller than the surrounding situation area A1 of the automatic driving screen or to display it in the corner of the driver display 101.

  Moreover, according to the Example mentioned above, although the vehicle exterior information acquisition part 2 acquired the surrounding vehicle and the obstruction as a surrounding condition, and displayed it on surrounding condition area | region A1, it is not restricted to this. The surrounding situation may be the surrounding situation of the vehicle, and may be information such as the situation of the road ahead (whether it is a curve or a straight line), for example.

  Moreover, according to the Example mentioned above, although the speedometer area | region A2 and biometric information area | region A6 of the screen for switching were displayed larger than the screen for automatic driving | operations, it is not restricted to this. The size of the speedometer area A2 and the biological information area A6 may be the same on the switching screen and the automatic operation screen.

  According to the above-described embodiment, the distance and time from the automatic operation to the manual operation are displayed in the countdown area A5 of the automatic operation screen. However, the present invention is not limited to this. Only one of the distance and time may be displayed in the countdown area A5.

  Moreover, according to the Example mentioned above, although the sleepiness information was displayed as the biological information of the driver | operator D, it is not restricted to this. The biological information may be information such as a heartbeat.

  The present invention is not limited to the above embodiment. That is, various modifications can be made without departing from the scope of the present invention.

1 Display device 2 Outside vehicle information acquisition unit (acquisition unit)
5 Control unit 101 Driver display (display unit)

Claims (11)

A display unit;
An acquisition unit for acquiring the situation around the moving object;
A control unit that causes the display unit to display the surrounding situation acquired by the acquisition unit,
The said control part displays the said surrounding condition on the said display part until it passes for a predetermined period or after driving | running | working a predetermined area after the switching from the automatic driving | running | working of the said mobile body to manual operation.   The said control part displays the screen for manual operation on the said display part, after the said predetermined time passes or after driving | running | working a predetermined area after switching from the said automatic driving | operation to the said manual driving | operation. Display device.   The control unit displays an automatic operation screen including the surrounding situation during automatic operation on the display unit, and until the predetermined time has elapsed after traveling from the automatic operation to the manual operation or until the vehicle travels for a predetermined period. 3. A switching screen including a surrounding situation is displayed on the display unit, and a manual operation screen is displayed on the display unit after the predetermined time has elapsed or after traveling for the predetermined section. The display device described in 1.   The display device according to claim 2, wherein the ambient situation is not included in the manual operation screen.   The display device according to claim 1, wherein the acquisition unit acquires another moving body or an obstacle around the moving body as the surrounding situation.   The display device according to claim 1, wherein the control unit enlarges the display of speed information of the moving body after switching from the automatic operation to the manual operation.   The display device according to claim 1, wherein the control unit displays a distance and / or time from the automatic operation to the manual operation on the display unit. It further comprises a living body detection unit for detecting the driver's biological information,
The display device according to claim 1, wherein the control unit enlarges the display of the biological information after switching from the automatic operation to the manual operation. A display method for displaying the surroundings of a moving object acquired by an acquisition unit on a display unit,
A display method comprising: displaying the surrounding state on the display unit until a predetermined time elapses or a predetermined section travels after switching from automatic operation to manual operation of the moving body. A display control program executed by a computer that controls the display unit,
The computer is caused to function as a control unit that causes the display unit to display the surrounding state acquired by the acquisition unit until a predetermined time has elapsed or the vehicle has traveled for a predetermined period after switching from automatic operation to manual operation of the moving body. Display control program to be executed.   A recording medium in which the display control program according to claim 10 is recorded.

Images