JP6892264B2 - Display device - Google Patents

Description

The present invention relates to a display device, a display method, a display control program for executing the display method, and a recording medium on which the display control program is recorded.

As a technology related to automobiles (moving bodies) that select between automatic driving and manual driving, there is a known technology that presents to the driver when there is a possibility of switching from automatic driving to manual driving. (Patent Document 1).

When driving an automobile automatically, the driver is freed from the need to monitor the surrounding conditions, and therefore does not check or grasp the surrounding conditions. Therefore, even if the switch from the automatic operation to the manual operation is presented in advance, the driver cannot confirm and grasp the surrounding situation in time and cannot smoothly switch to the manual operation as an example.

Japanese Unexamined Patent Publication No. 2001-1992

The present invention makes it an example of a problem to deal with such a problem. That is, the present invention provides, for example, a display device for easily grasping the surrounding situation, a display method, a display control program for executing the display method, and the display control program when switching from automatic operation to manual operation. The purpose is to provide a recording medium for recording.

The display device according to claim 1, which has been made to solve the above-mentioned problems, displays on the display unit, an acquisition unit that acquires the surrounding conditions of the moving body, and the surrounding conditions acquired by the acquisition unit. The control unit is provided with a control unit for causing the movement, and the control unit displays the surrounding situation on the display unit until a predetermined time elapses or a predetermined section travels after switching from automatic operation to manual operation of the moving body. It is characterized by.

The display method according to claim 9 is a display method for displaying the surrounding condition of the moving body acquired by the acquisition unit on the display unit, and a predetermined time has elapsed since the automatic operation of the moving body was switched to the manual operation. It is characterized in that the surrounding situation is displayed on the display unit until the vehicle travels for a predetermined section.

The display control program according to claim 10 is a display control program executed by a computer that controls a display unit, and travels for a predetermined time or a predetermined section after switching from automatic operation to manual operation of a moving body. It is characterized in that the computer functions as a control unit for displaying the surrounding situation acquired by the acquisition unit on the display unit.

The recording medium according to claim 11 is characterized in that the display control program according to claim 10 is recorded.

It is a perspective view of the display system which has the display device which concerns on one Example of this invention. It is a front view of the display system shown in FIG. 1 as seen from the driver's seat. It is explanatory drawing which showed the relationship between the windshield light shown in FIG. 1 and a driver. It is a block diagram which showed the functional structure of the display system shown in FIG. It is a flowchart which shows the control processing procedure of the driver display of the control part shown in FIG. It is a figure which shows the display example of the driver display shown in FIG. 1 at the time of automatic operation. It is a figure which shows the display example of the driver display shown in FIG. 1 just before the end of automatic operation. It is a figure which shows the display example of the driver display shown in FIG. 1 after the switch to the manual operation, and before the elapse of a predetermined time. It is a figure which shows the display example of the driver display shown in FIG. 1 after a predetermined time elapses after switching to manual operation.

Hereinafter, a display device according to an embodiment of the present invention will be described. The display device according to the embodiment of the present invention includes a display unit, an acquisition unit that acquires the surrounding conditions of the moving body, and a control unit that displays the surrounding conditions acquired by the acquisition unit on the display unit. The unit causes the display unit to display the surrounding conditions from the time when the moving body is switched from the automatic operation to the manual operation until a predetermined time elapses or the vehicle travels in a predetermined section. As a result, the surrounding condition is displayed for a while after switching to the manual operation, so that the driver can easily grasp the surrounding condition when switching from the automatic operation to the manual operation.

Further, the control unit may display the manual operation screen on the display unit after a predetermined time has elapsed after switching from the automatic operation to the manual operation or after traveling in a predetermined section. As a result, the surrounding situation is displayed without displaying the manual driving screen for a while after switching to manual driving, so that it becomes easier for the driver to grasp the surrounding situation when switching from automatic driving to manual driving. ..

In addition, the control unit displays an automatic driving screen including the surrounding conditions on the display unit during automatic driving, and includes the surrounding conditions until a predetermined time elapses or the vehicle travels in a predetermined section after switching from automatic driving to manual driving. The switching screen may be displayed on the display unit, and the manual operation screen may be displayed on the display unit after a predetermined time has elapsed or after traveling in a predetermined section. As a result, the surrounding condition is displayed for a while after switching to the manual operation, so that the driver can easily grasp the surrounding condition when switching from the automatic operation to the manual operation.

Further, the screen for manual operation may not include the surrounding conditions.

In addition, the acquisition unit may acquire other moving objects or obstacles around the moving object as surrounding conditions. This makes it easier for the driver to grasp other moving objects or obstacles around the moving object when switching from automatic operation to manual operation.

Further, the control unit may increase the display of the speed information of the moving body after switching from the automatic operation to the manual operation. This makes it easier for the driver to grasp the speed information during manual operation.

Further, the control unit may display the distance and / or time from the automatic operation to the manual operation on the display unit. This makes it possible to grasp how soon the driver will switch to manual operation.

Further, a biological detection unit for detecting the biological information of the driver may be further provided, and the control unit may increase the display of the biological information after switching from the automatic operation to the manual operation. This makes it easier for the driver to grasp the biological information during manual driving.

In addition, a display method according to an embodiment of the present invention will be described. The display method of the present invention is a display method for displaying the surrounding condition of the moving body acquired by the acquisition unit on the display unit, from the time when the automatic operation of the moving body is switched to the manual operation until a predetermined time elapses or a predetermined section. The surrounding situation is displayed on the display unit until the vehicle is driven. As a result, the surrounding condition is displayed for a while after switching to the manual operation, so that the driver can easily grasp the surrounding condition when switching from the automatic operation to the manual operation.

Further, the program may be a program in which the above-mentioned display method is executed by a computer. By doing so, the surrounding situation can be displayed for a while after switching to manual driving using a computer, and it becomes easier for the driver to grasp the surrounding situation when switching from automatic driving to manual driving. ..

Further, the above-mentioned program may be stored in a computer-readable recording medium. By doing so, the program can be distributed as a single unit in addition to being incorporated in the device, and version upgrades and the like can be easily performed.

A display device according to an embodiment of the present invention will be described with reference to FIGS. 1 to 9. FIG. 1 is a perspective view of a display system 100 having a display device according to this embodiment. The display system 100 includes a plurality of display units (displays) installed around the driver's seat SH of the vehicle as an example of the moving body. FIG. 2 is a front view of the driver's seat SH as viewed from the front.

The driver's seat SH is provided with a steering wheel H in front of the driver's seat SH, and a driver display 101 is provided behind the steering wheel H. The driver display 101 is a display that is long in the left-right direction. On the driver display 101, the surrounding conditions of the vehicle acquired by the speedometer, the fuel gauge, the water temperature gauge, and the vehicle exterior information acquisition unit 2 (acquisition unit), which will be described later, are displayed by characters, images, and the like.

A control panel 104 is provided on the right side (passenger seat side) of the driver's seat SH. The control panel 104 is used for setting the air conditioner and navigation system, selecting content such as music and video, and inputting operations such as playback.

A center multimedia display 102 is provided on the upper side of the control panel 104 (on the right side of the driver display 101). The center multimedia display 102 displays a map and guidance of a navigation system, and displays, for example, the above-mentioned video contents during automatic driving.

The windshield light 103 can emit light with a plurality of emission colors by a light emitting element such as an LED (light emitting diode) or an organic EL (Electro Luminescence). In this embodiment, as shown in FIG. 2, the shape is elongated in the left-right direction when viewed from the driver, but the shape is not limited to this. However, the size (length) of the windshield light 103 is preferably larger than the icons, indicators, characters, etc. displayed in the driver display 101.

As shown in FIG. 3, the windshield light 103 is embedded in the dashboard on the back side of the driver display 101. The windshield light 103 lights up or blinks from the dashboard toward the windshield W (also referred to as a windshield), so that the lighting or the like is reflected in the windshield W (W1 in FIG. 3). It can be visually recognized as being displayed above the display 101.

In this embodiment, the windshield lights 103 are provided in pairs (103a, 103b) at two locations on the right side and the left side when viewed from the driver's seat SH (see FIG. 2).

The windshield light 103 is not limited to being embedded in the dashboard, and may be arranged below the windshield W at a position (on the dashboard or the like) that the driver can directly see. Alternatively, it may be installed on the upper part of the driver display 101. That is, it may be arranged in front of the driver's seat SH. Further, for example, it is preferable that the driver display 101 or the center multimedia display 102 is arranged at a position where the line-of-sight movement is small.

Next, the functional configuration of the display system 100 having the above-described configuration will be described with reference to FIG. As shown in FIG. 4, in addition to the driver display 101, the center multimedia display 102, the windshield light 103, and the control panel 104 described above, the display system 100 includes the vehicle exterior information acquisition unit 2 and the vehicle interior information acquisition unit 3. , A content information acquisition unit 4 and a control unit 5.

The vehicle exterior information acquisition unit 2 was obtained by, for example, a sensor that detects the surrounding conditions such as LIDAR (Laser Imaging Detection and Ranging, Laser Illuminated Detection and Ranging) or LiDAR (Light Detection and Ranging), or a camera that photographs the outside of the vehicle. Acquires information outside the vehicle (presence / absence and position of surrounding vehicles (other moving objects), presence / absence and position of obstacles including pedestrians, etc.). Specifically, the interface circuit of a sensor such as LIDAR functions in the vehicle exterior information acquisition unit 2.

The in-vehicle information acquisition unit 3 automatically indicates, for example, information indicating that the vehicle is driving in automatic driving, information acquired from each sensor installed in the vehicle such as traveling speed, remaining amount of fuel, and water temperature, and automatically during automatic driving. It acquires driving control information such as brakes and turn signals to be operated, and biological information of driver D such as driver's drowsiness. Specifically, the in-vehicle information acquisition unit 3 functions as an interface circuit or the like with each sensor in the vehicle, an automatic driving control device, or the like.

The content information acquisition unit 4 acquires information such as video content to be displayed on the center multimedia display 102 from a storage device such as a hard disk (not shown), an optical device such as a DVD drive, a content server outside the vehicle, or the like. Specifically, the content information acquisition unit 4 functions as an interface circuit with a storage device, a communication device with the outside, and the like.

The control unit 5 controls the display of the driver display 101, the center multimedia display 102, and the windshield light 103 based on various information acquired by the vehicle exterior information acquisition unit 2, the vehicle interior information acquisition unit 3, and the content information acquisition unit 4. .. Specifically, the control unit 5 functions as a control circuit such as a CPU (Central Processing Unit).

The control unit 5 obtains numerical values and images of biological information such as the traveling speed and the remaining amount of fuel acquired by the in-vehicle information acquisition unit 3 or the drowsiness of the driver D, and the surrounding conditions of the vehicle acquired by the outside information acquisition unit 2. It is displayed on the driver display 101 by such means. Further, the control unit 5 reproduces information such as video content acquired by the content information acquisition unit 4 and displays it on the center multimedia display 102.

Further, the control unit 5 displays a part of the information acquired by the vehicle exterior information acquisition unit 2 and the vehicle interior information acquisition unit 3 during automatic driving by turning on or blinking the windshield light 103. For example, during automatic operation, both the windshield lights 103a and 103b are lit in blue. Further, for example, when switching between automatic driving and manual driving depending on the traveling route or the like, it blinks in purple from a certain time before the end of automatic driving based on the time to the switching point to manual driving. That is, it is displayed that the automatic operation is within a certain period of time. It should be noted that it may be started from a predetermined distance before the end of the automatic operation.

The driver display 101 described above, the vehicle exterior information acquisition unit 2, and the control unit 5 constitute a display device 1 according to an embodiment of the present invention.

Next, the control operation (display method) of the driver display 101 in the control unit 5 described above will be described with reference to FIGS. 5 to 9. FIG. 5 is a flowchart showing a control processing procedure of the driver display 101 of the control unit 5. By configuring this flowchart as a computer program executed by the control unit 5, it can be a display control program. 6 to 9 are views showing a display example of the driver display 101.

The control unit 5 periodically acquires the vehicle exterior information and the vehicle interior information from the vehicle exterior information acquisition unit 2 and the vehicle interior information acquisition unit 3. First, in step S1, the control unit 5 determines whether or not it is in automatic operation, proceeds to step S2 if it is in automatic operation (if YES), and if it is not in automatic operation (in the case of NO), it is a step. Proceed to S8. Whether or not the vehicle is in automatic driving may be determined from the information acquired by the in-vehicle information acquisition unit 3.

In step S2, the control unit 5 determines whether or not the automatic operation is about to end. Whether or not the automatic operation is about to end can be determined based on the distance and time from the automatic operation to the manual operation. If it is not just before the end of automatic operation (NO in step S2), the process proceeds to step S3.

Next, in step S3, the control unit 5 displays the automatic driving screen shown in FIG. 6 on the driver display 101. The screen for automatic operation has an ambient situation area A1, a speedometer area A2, a fuel gauge area A3, a water temperature gauge area A4, a countdown area A5, and a biometric information area A6. The surrounding situation area A1 is displayed near the center of the driver display 101. The control unit 5 displays the lane and the own vehicle mark M1 indicating the own vehicle in the surrounding situation area A1. When the control unit 5 detects surrounding vehicles and obstacles including pedestrians by the outside information acquisition unit 2, the surrounding vehicle mark and obstacles are located at the positions of the surrounding vehicles and obstacles with respect to the own vehicle mark M1 on the surrounding situation area A1. A mark (neither is shown) is displayed. The driver can know the position of the surrounding vehicle and the obstacle from the positional relationship between the own vehicle mark M1 and the surrounding vehicle mark and the obstacle mark (not shown).

The speedometer area A2 is displayed on the right side of the surrounding situation area A1, and the traveling speed (speed information) acquired from the in-vehicle information acquisition unit 3 is displayed. The fuel gauge area A3 is displayed on the upper right of the speedometer area A2, and the remaining amount of fuel acquired from the in-vehicle information acquisition unit 3 is displayed. The water temperature gauge area A4 is displayed at the lower right of the speedometer area A2, and the water temperature acquired from the in-vehicle information acquisition unit 3 is displayed. The countdown area A5 is displayed on the upper left side of the surrounding situation area A1, and the distance and time from automatic operation to switching to manual operation are displayed.

In the biological information area A6, the driver's biological information such as the driver's drowsiness is displayed. In this embodiment, the driver icon I1 and the display bar I2 are displayed in the biological information area A6. The driver icon I1 is displayed in a color according to the degree of drowsiness. In this embodiment, blue is the most awake state, and it is displayed that the redness increases as the drowsiness increases. The display bar I2 is provided long in the left-right direction and shows the relationship between the display color of the driver icon I1 and the degree of drowsiness. In this embodiment, the display bar I2 is graduated so that the left side is blue and the redness increases toward the right. The driver D can know the degree of drowsiness from the position of the display color of the driver icon I1 on the display bar I2.

On the other hand, in step S2, if the automatic operation is about to end (YES), the process proceeds to step S4.

In step S4, as shown in FIG. 7, the control unit 5 further displays the button area A7 on the screen for automatic operation. The button area A7 is superimposed on the countdown area A5 and the surrounding situation area A1 on the right side of the biological information display area A6. The button area A7 is such that the button B (see FIG. 2) provided on the handle H is pressed in order to confirm whether the driver recognizes the switch to the manual operation or to switch to the manual operation. This is the area for display. In this embodiment, in the button area A7, a picture of the handle provided with the button and the characters "Please press the button" are displayed. The control unit 5 displays the screen for automatic operation shown in FIG. 7 until the operation is switched to manual operation.

After that, when the automatic operation is switched to the manual operation (YES in step S5), the control unit 5 displays a switching screen as shown in FIG. 8 (step S6). That is, the switching screen has an ambient situation region A1, a speedometer region A2, a fuel gauge region A3, a water temperature gauge region A4, and a biometric information region A6. That is, in FIGS. 6 and 7, the screen for switching is the screen in which the countdown area A5 and the button area A7 are erased from the screen for automatic operation. Further, the speedometer area A2 and the biometric information area A6 of the switching screen are displayed larger than the speedometer area A2 and the biometric information area A6 of the automatic driving screen. When switching from the automatic operation screen to the switching screen, the control unit 5 gradually displays the speedometer area A2 and the biological area A6 in a larger size.

After that, when a predetermined time elapses after switching to manual operation (YES in step S7), the control unit 5 displays the manual operation screen shown in FIG. 9 on the driver display 101 (step S8), and then returns to step S1.

The manual operation screen has a speedometer area A2, a fuel gauge area A3, a water temperature gauge area A4, a biometric information area A6, and a menu selection area A8, and does not include the surrounding situation area A1. On the manual operation screen, the menu selection area A8 is displayed near the center of the screen instead of the surrounding situation area A1. In the menu selection area A8, a plurality of menus (music, news, etc.) that can be selected by the operation unit 105 (see FIG. 2) arranged on the handle H are displayed. Further, the speedometer area A2 and the biometric information area A6 of the manual operation screen may have the same size as the speedometer area A2 and the biometric information area A6 of the switching screen, and their respective sizes are different. May be good.

According to the above-described embodiment, the control unit 5 displays the surrounding condition from the time when the vehicle is switched from the automatic driving to the manual driving until a predetermined time elapses. As a result, the surrounding condition is displayed for a while after switching to the manual operation, so that the driver D can easily grasp the surrounding condition when switching from the automatic operation to the manual operation.

Further, according to the above-described embodiment, the control unit 5 switches to the manual operation screen after a predetermined time has elapsed after switching from the automatic operation to the manual operation. As a result, the surrounding situation is displayed without switching to the manual driving screen for a while after switching to manual driving, so when switching from automatic driving to manual driving, driver D grasps the surrounding situation. It will be easier.

Further, according to the above-described embodiment, the control unit 5 displays an automatic driving screen including the surrounding situation during the automatic driving, and includes the surrounding situation until a predetermined time elapses after switching from the automatic driving to the manual driving. The switching screen is displayed, and after a predetermined time has elapsed after switching from automatic operation to manual operation, the screen is switched to the manual operation screen that does not include the surrounding conditions. As a result, the surrounding condition is displayed for a while after switching to the manual operation, so that the driver D can easily grasp the surrounding condition when switching from the automatic operation to the manual operation.

Further, according to the above-described embodiment, the vehicle outside information acquisition unit 2 acquires surrounding vehicles or obstacles as the surrounding conditions. This makes it easier for the driver D to grasp surrounding vehicles or obstacles when switching from automatic driving to manual driving.

Further, according to the above-described embodiment, the control unit 5 enlarges the display of the speedometer area A2 after switching from the automatic operation to the manual operation. This makes it easier for the driver D to grasp the speed information during manual driving.

Further, according to the above-described embodiment, the control unit 5 displays the distance and time from the switching from the automatic operation to the manual operation. As a result, it is possible to grasp how soon the driver D will switch to the manual operation.

Further, according to the above-described embodiment, the control unit 5 enlarges the display of the biological information area A6 after switching from the automatic operation to the manual operation. This makes it easier for the driver D to grasp the biological information during manual driving.

According to the above-described embodiment, the surrounding conditions are displayed from the time when the automatic operation is switched to the manual operation until a predetermined time elapses, but the present invention is not limited to this. The surrounding conditions may be displayed from the time when the automatic operation is switched to the manual operation until the vehicle travels in a predetermined section.

Further, according to the above-described embodiment, the surrounding situation area A1 is not included in the manual operation screen, but the screen is not limited to this. The surrounding situation area A1 may be included in the manual operation screen. When the surrounding situation area A1 is included in the manual driving screen, it is preferable to make the surrounding situation area A1 smaller than the surrounding situation area A1 of the automatic driving screen, or to display it in the corner of the driver display 101.

Further, according to the above-described embodiment, the vehicle outside information acquisition unit 2 acquires surrounding vehicles and obstacles as surrounding conditions and displays them in the surrounding situation area A1, but the present invention is not limited to this. The surrounding condition may be the surrounding condition of the vehicle, and may be information such as the condition of the road ahead (whether it is a curve or a straight line).

Further, according to the above-described embodiment, the speedometer area A2 and the biometric information area A6 of the switching screen are displayed larger than the screen for automatic operation, but the present invention is not limited to this. The size of the speedometer area A2 and the biometric information area A6 may be the same on the switching screen and the automatic operation screen.

Further, according to the above-described embodiment, the countdown area A5 of the automatic operation screen displays the distance and time from the automatic operation to the manual operation, but the present invention is not limited to this. In the countdown area A5, only one of the distance and the time may be displayed.

Further, according to the above-described embodiment, the drowsiness information is displayed as the biological information of the driver D, but the present invention is not limited to this. The biological information may be information such as a heartbeat.

The present invention is not limited to the above embodiment. That is, it can be modified in various ways without departing from the gist of the present invention.

1 Display device 2 External information acquisition unit (acquisition unit)
5 Control unit 101 Driver display (display unit)

Claims (11)

Display and
An acquisition unit that acquires the situation around the moving object, and
A control unit for displaying the surrounding conditions acquired by the acquisition unit on the display unit is provided.
The control unit
During the automatic operation of the moving body, the surrounding situation is displayed on the display unit.
A display device characterized in that the surrounding situation is displayed on the display unit until a predetermined time elapses or a predetermined section travels after switching from automatic operation to manual operation of the moving body. The first aspect of claim 1, wherein the control unit displays a screen for manual operation on the display unit after the predetermined time has elapsed after switching from the automatic operation to the manual operation or after traveling in a predetermined section. Display device. The control unit displays an automatic driving screen including the surrounding conditions on the display unit during automatic driving, and the control unit displays the screen for automatic driving on the display unit until a predetermined time elapses or a predetermined section travels after switching from the automatic driving to the manual driving. Claim 1 or 2 is characterized in that a switching screen including an ambient situation is displayed on the display unit, and a manual driving screen is displayed on the display unit after the predetermined time has elapsed or after traveling in the predetermined section. The display device described in. The display device according to claim 2 or 3, wherein the manual operation screen does not include the surrounding situation. The display device according to any one of claims 1 to 4, wherein the acquisition unit acquires another moving body or obstacle around the moving body as the surrounding situation. The display device according to any one of claims 1 to 5, wherein the control unit increases the display of speed information of the moving body after switching from the automatic operation to the manual operation. The display device according to any one of claims 1 to 6, wherein the control unit displays the distance and / or time from the automatic operation to the switching to the manual operation on the display unit. Further equipped with a biological detection unit that detects the driver's biological information,
The display device according to any one of claims 1 to 7, wherein the control unit enlarges the display of the biological information after switching from the automatic operation to the manual operation. It is a display method that displays the surrounding condition of the moving object acquired by the acquisition unit on the display unit.
During the automatic operation of the moving body, the surrounding situation is displayed on the display unit.
A display method characterized in that the surrounding situation is displayed on the display unit until a predetermined time elapses or a predetermined section travels after switching from automatic operation to manual operation of the moving body. A display control program executed by a computer that controls the display unit.
As a control unit that displays the surrounding conditions acquired by the acquisition unit on the display unit during the automatic operation of the moving body and from the switching from the automatic operation to the manual operation of the moving body until a predetermined time elapses or a predetermined section is traveled. A display control program characterized by operating the computer. A recording medium on which the display control program according to claim 10 is recorded.

Images