WO2019142893A1 - Automatic driving vehicle, notification device, notification method, program and storage medium - Google Patents

Abstract

An automatic driving vehicle 100 at least has a first driving mode and a second driving mode. Herein, the second driving mode involves more intervention in a passenger's driving than does the first driving mode. The notification device 50 notifies the passenger. The notification device 50 notifies the passenger that a switch to the second driving mode which is independent from the passenger's intention may occur.

Description

Automated Driving Vehicle, Notification Device, Notification Method, Program, Storage Medium

The present disclosure relates to an autonomous driving vehicle that outputs a notification, a notification device, a notification method, a program, and a storage medium.

The navigation device guides the road on which the vehicle is traveling. For example, when the road is a roundabout ring road, a guide mode different from other roads is required (see, for example, Patent Document 1).

JP, 2016-157403, A

A vehicle performing automatic driving needs to notify the driver to request transfer of the driving function when reaching the limit of automatic driving (fallback). However, during automatic driving, the driver may watch the content displayed on the screen as a task (secondary task) other than driving. Even in such a case, it is required to notify the transition of the driving function to smoothly transition.

The present disclosure has been made in view of such a situation, and an object thereof is to provide a technique for notifying a driving function to smoothly transition.

In order to solve the above-mentioned subject, an autonomous driving vehicle according to an aspect of the present disclosure is an autonomous driving vehicle having a notification device for notifying an occupant, at least a first operation mode, and a second operation mode. In the second operation mode, the notification that the intervention for the operation of the occupant is larger than the first operation mode and the notification device may switch to the second operation mode independently of the intention of the occupant Do.

Another aspect of the present disclosure is a notification device. This device can be mounted on an autonomous driving vehicle having at least a first operation mode and a second operation mode, and is a notification device for notifying an occupant of the occupant. It is notified that the intervention for driving is larger than the first driving mode and the second driving mode may be switched independently of the intention of the occupant.

Yet another aspect of the present disclosure is also an autonomous vehicle. The autonomous driving vehicle includes an acquisition device that acquires information outside the vehicle, an autonomous driving system that controls the vehicle, and a notification device. The notification device includes a reception unit that receives a signal from the acquisition device, and a notification unit. The notification unit determines whether or not the automatic driving system falls into the performance limit based on the signal, and determines that the automatic driving system falls into the performance limit at least when judging that the automatic driving system falls into the performance limit. Notify the driver of.

Yet another aspect of the present disclosure is a notification method. This method can be mounted on an autonomous vehicle having at least a first operation mode and a second operation mode, and is a notification method in a notification device for notifying an occupant of the vehicle, the second operation mode is And notifying that the intervention for the driver's driving is larger than the first driving mode and the second driving mode may be switched independently of the driver's intention.

Yet another aspect of the present disclosure is a storage medium. This storage medium is a storage medium that can be mounted on an autonomous driving vehicle having at least a first operation mode and a second operation mode, and stores a program in a notification device that notifies an occupant of the vehicle. The second operation mode causes the computer to execute notification that the intervention for the occupant's operation is larger than the first operation mode, and the second operation mode may be switched independently of the occupant's intention. Remember the program for.

It is to be noted that any combination of the above-described components, and one obtained by converting the expression of the present disclosure among methods, apparatuses, systems, recording media, computer programs, and the like are also effective as aspects of the present disclosure.

According to the present disclosure, the driving function can be notified to smoothly shift.

It is a figure showing composition which looked at a car interior of a vehicle concerning a 1st embodiment from the back. It is a figure which shows the structure of the vehicle of FIG. 3 (a)-(b) are diagrams showing screens displayed on the display unit of FIG. 4 (a)-(b) are diagrams showing other screens displayed on the display unit of FIG. It is a figure which shows the further another screen displayed on the display part of FIG. It is a figure which shows the further another screen displayed on the display part of FIG. 7 (a) and 7 (b) are diagrams showing still another screen displayed on the display unit of FIG. It is a flowchart which shows the process sequence by the notification apparatus of FIG. It is a flowchart which shows another processing procedure by the notification apparatus of FIG. It is a flowchart which shows the process sequence by the operation control part of FIG. It is a block diagram showing composition of an autonomous driving vehicle concerning a 2nd embodiment. It is a figure which shows the example of a notice of the automatically driven vehicle which concerns on 2nd Embodiment. It is a figure which shows the example of another notification of the autonomous driving vehicle concerning a 2nd embodiment. It is a figure which shows the example of the icon which concerns on 2nd Embodiment. It is a flowchart which shows the processing operation of the autonomous driving vehicle concerning a 2nd embodiment. It is a block diagram which shows the structure of the autonomous driving vehicle which concerns on the modification of 2nd Embodiment. It is a flowchart which shows the processing operation of the autonomous driving vehicle concerning the modification of a 2nd embodiment. It is a block diagram which shows the structure of the autonomous driving vehicle which concerns on 3rd Embodiment. It is a figure which shows the example of a notice of the automatically driven vehicle which concerns on 3rd Embodiment. It is a flowchart which shows the processing operation of the autonomous driving vehicle concerning a 3rd embodiment. It is a flowchart which shows the restart operation in the processing operation of the autonomous driving vehicle concerning a 3rd embodiment. It is a flowchart which shows the restart operation in the processing operation of the autonomous driving vehicle concerning the modification of a 3rd embodiment. It is a block diagram which shows the structure of the autonomous driving vehicle which concerns on other embodiment.

First Embodiment
Before specifically describing the present disclosure, an outline will be given. The first embodiment of the present disclosure includes a mode for executing automatic operation (hereinafter referred to as “automatic operation mode”) and a mode for executing manual operation (hereinafter referred to as “manual operation mode”), and The present invention relates to a vehicle provided with a notification device for displaying SAE (Society of Automotive Engineers) Level 3 automatic driving system recognizes the system limit, and when reaching it, notifies the driver of the driving function transfer request, and switches the automatic driving mode to the manual driving mode. This corresponds to transferring the driving function for driving the vehicle to the driver. Such a transition of the driving function should be smoothly performed even when the driver is viewing content in the vehicle traveling in the automatic driving mode.

In order to cope with this, the vehicle according to the first embodiment urges the driver who watches the content to give a gradual alert. Specifically, “display and approving alerting sentence before start of viewing”, “continuation of alerting sentence display during viewing”, and “notice of driving function transfer request at fallback” are executed. Driving functions are smoothly transferred by prompting such a gradual warning. Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings. In addition, each embodiment described below is an example, and this indication is not limited by these embodiments.

FIG. 1 shows a configuration of the vehicle interior of an autonomous driving vehicle 100 as viewed from the rear. A dashboard 10 extending to the left and right is disposed forward of the vehicle interior, and a display unit 64 is disposed at a central portion of the dashboard 10. The display unit 64 displays, for example, a moving image, a WWW (World Wide Web) browser, a map of navigation, and a call screen. Further, a windshield 12 is disposed above the dashboard 10, and a ceiling 14 is disposed rearward of the windshield 12 from above. A room mirror 16 is installed downward from a portion on the windshield 12 side of the ceiling 14.

FIG. 2 shows the configuration of the autonomous driving vehicle 100. As shown in FIG. The autonomous driving vehicle 100 includes an operation control unit 20, a position information acquisition unit 22, an automatic operation control unit 24, an electronic control unit (ECU) 26, an operation unit 30, a sensor 32, a controller area network (CAN) 34, and a notification device 50. Including. The operation unit 30 includes a steering 40, an accelerator pedal 42, and a brake pedal 44. The ECU 26 includes a steering ECU 70, an engine ECU 72, and a brake ECU 74. The notification device 50 includes a control unit 60, a wireless communication unit 62, a display unit 64, and an input unit 66. Here, the notification device 50 is connectable to the server 82 via the network 80.

Here, (i) processing in the automatic driving mode, (ii) processing in the manual driving mode, and (iii) content output processing will be described in this order (i) processing in the automatic driving mode. Switching between the automatic operation mode and the manual operation mode in Here, when the automatic operation mode is referred to as a first operation mode, the manual operation mode is referred to as a second operation mode, so that it can be said that the operation control unit 20 executes the operation mode switching. Further, in the second operation mode, the intervention for the driver's passenger's operation is larger than the first operation mode. Here, the automatic operation mode is selected. The sensor 32 detects the surrounding environment of the autonomous driving vehicle 100. The surrounding environment of the autonomous driving vehicle 100 indicates the road condition on which the vehicle travels including lane information, the presence of an obstacle around the vehicle, and the environment outside the vehicle like other vehicles in the vicinity. An example of the sensor 32 is an imaging device, a light detection and ranging (LIDAR) device, a millimeter wave sensor, a sonar, or any combination thereof. The detection result of the sensor 32 is output to the operation control unit 20 as a detection result.

The CAN 34 is a network that connects the devices mounted on the autonomous driving vehicle 100. The CAN 34 transmits, for example, information on the traveling state of the autonomous driving vehicle 100. The information on the traveling state of the autonomous driving vehicle 100 includes longitudinal velocity, longitudinal acceleration, lateral velocity, lateral acceleration, yaw angular velocity, and yaw angular acceleration. These pieces of information are acquired by a velocity sensor connected to the CAN 34, an acceleration sensor, a gyro sensor, a geomagnetic sensor, an inclination sensor, and the like. These pieces of information are collectively called vehicle state quantities. The vehicle state quantity from CAN 34 is received in operation control unit 20.

The driving control unit 20 outputs the detection result from the sensor 32 and the vehicle state amount from the CAN 34 to the automatic driving control unit 24. The position information acquisition unit 22 acquires the position information of the autonomous driving vehicle 100 from a GNSS (Global Navigation Satellite System (s)) receiver. Further, the position information acquisition unit 22 may acquire the position information of the autonomous driving vehicle 100 by autonomous navigation. The position information acquisition unit 22 outputs the position information to the automatic driving control unit 24.

The autonomous driving control unit 24 is an autonomous driving controller provided with an autonomous driving control function, and determines an action of the autonomous driving vehicle 100 in the autonomous driving. The configuration of the automatic operation control unit 24 can be realized by cooperation of hardware resources and software resources, or hardware resources only. A processor, ROM (Read Only Memory), RAM (Random Access Memory), and other LSIs can be used as hardware resources, and programs such as operating systems, applications, and firmware can be used as software resources.

The automatic driving control unit 24 receives the detection result from the sensor 32 and the vehicle state amount from the CAN 34 via the driving control unit 20. In addition, the automatic driving control unit 24 receives the position information from the position information acquisition unit 22. The autonomous driving control unit 24 applies the detection result, the vehicle state amount, the position information, and the like to the autonomous driving algorithm to calculate the vehicle control amount. The vehicle control amount is a control value for controlling an automatic control target, including longitudinal velocity, longitudinal acceleration, steering angle, and steering angular velocity. The automatic driving control unit 24 outputs the calculated vehicle control amount to the ECUs 26 to be controlled.

The ECU 26 includes a steering ECU 70, an engine ECU 72, and a brake ECU 74. The steering ECU 70, the engine ECU 72, and the brake ECU 74 drive actuators in accordance with the control amount supplied from the automatic driving control unit 24. In the case of an electric car or a hybrid car, instead of or in addition to the engine ECU 72, the motor ECU drives the actuator according to the control amount.

When the automatic operation mode is selected in the operation control unit 20, the operation control unit 20 monitors the occurrence of an abnormality in the sensor 32. For example, the operation control unit 20 waits for notification of a failure detected by the failure detection unit in the camera module in the imaging device. The failure detection unit detects a failure when the input voltage is out of the range of the specified value, that is, when a voltage abnormality occurs. The operation control unit 20 detects the occurrence of an abnormality in the sensor 32 when the notification of the occurrence of the failure is received. The operation control unit 20 may detect the occurrence of an abnormality in the sensor 32 when the combination of the sensing function deterioration and the failure in the plurality of sensors 32 continues for a certain period of time in order to prevent erroneous detection.

The detection method of the occurrence of the abnormality performed by the operation control unit 20 is not limited to these, but is repeatedly performed during the automatic operation mode. When detecting the occurrence of an abnormality in the sensor 32, the operation control unit 20 determines switching from the automatic operation mode to the manual operation mode as having reached the limit of automatic operation (fallback). That is, switching from the first driving mode to the second driving mode may occur independently of the rider's intention regardless of the rider's operation.

(Ii) Process in Manual Operation Mode The manual operation mode is selected in the operation control unit 20. The operation unit 30 includes a steering 40, an accelerator pedal 42, and a brake pedal 44, and receives an operation of manual driving by the driver. A signal of a manual driving operation performed by the driver (hereinafter, referred to as “manual driving signal”) is output from the operation unit 30 to the operation control unit 20. Operation control unit 20 receives a manual operation signal from operation unit 30. The operation control unit 20 outputs a manual operation signal to the ECUs 26 to be controlled. Therefore, the manual driving signal is indicated similarly to the above-mentioned vehicle control amount. The steering ECU 70, the engine ECU 72, and the brake ECU 74 included in the ECU 26 drive an actuator in accordance with the manual operation signal supplied from the operation control unit 20.

(Iii) Output Processing of Content The wireless communication unit 62 is connected to the network 80, and the server 82 is also connected to the network 80. Therefore, the wireless communication unit 62 can connect to the server 82 via the network 80. The server 82 provides the notification device 50 with predetermined content. An example of the predetermined content is a moving image, a WWW browser, and navigation. Since known techniques may be used to provide such predetermined content, the description thereof is omitted here, but the wireless communication unit 62 receives data of the content from the server 82. The wireless communication unit 62 outputs the data of the content to the control unit 60.

The display unit 64 is a display of a car navigation system installed in the autonomous driving vehicle 100 or a center display. The display unit 64 may be a head-up display. The display unit 64 can output the screen of the content received from the control unit 60. The screen of the content displayed on the display unit 64 is, for example, a moving image, a WWW browser, a map for navigation, and a call screen. The input unit 66 is a user interface device that can receive an operation of a passenger. The input unit 66 is a touch panel, a lever, a button, a switch, a controller such as a joystick or a volume, a sensor such as a camera that recognizes a gesture without contact, a sensor such as a microphone that recognizes voice, or a combination thereof. The input unit 66 outputs the received information as an operation signal to the control unit 60.

The control unit 60 controls the operation of the notification device 50. Control unit 60 receives the data of the content from wireless communication unit 62 according to the content of the operation signal received from input unit 66, and causes display unit 64 to display the screen of the content. The data of the content may not be received by the wireless communication unit 62, and may be stored in a storage unit (not shown). In the following, the screen generated in the control unit 60 is (1) alerting display and approval work before the start of viewing, (2) alerting display during viewing and content reproduction continued, (3-1) after the end of automatic operation The reproduction of the content, the (3-2) notification of the driving function transfer request at fallback, and the (4) content reproduction state during the manual operation will be described in this order.

(1) Warning display before start of viewing and approval operation The control unit 60 is connected to the operation control unit 20, and receives information on the operation mode selected in the operation control unit 20. Since the information of the driving mode here indicates the automatic driving mode, the autonomous driving vehicle 100 performs the automatic driving. Further, the control unit 60 receives an instruction to start content reproduction from the input unit 66. In such a situation, the control unit 60 outputs the screen shown in FIG. FIGS. 3A and 3B show screens displayed on the display unit 64. FIG. The control unit 60 arranges the first display 200 and the second display 202 at the top and bottom of the screen as shown in FIG. 3A. The first display 200 is a warning message that the manual mode may be switched independently of the rider's intention. In this case, a warning message "The driver may be able to take over the driving function if the automatic driving function is deteriorated or should be missed after starting the automatic driving" is displayed.

Further, the second display 202 is a display of approval for asking for confirmation of the passenger with respect to the alerting sentence. When the passenger agrees to the alerting sentence when the second display 202 is displayed, the passenger performs “approval work” such as pressing a button or touching the touch panel while using the input unit 66. In response to this, the control unit 60 receives a notification of approval from the input unit 66. After receiving the notification of approval, the control unit 60 reproduces the content. As a result, the passenger is warned to re-acknowledge the possibility of switching to the manual driving mode, that is, shifting of the driving function. On the other hand, when the control unit 60 does not receive a notification of approval from the input unit 66, the control unit 60 does not start content reproduction. Therefore, the display unit 64 does not display the content. Thus, the content reproduction is stopped until the approval work is performed.

(2) Attention display during viewing and continuation of content reproduction In (1), when the control unit 60 receives a notification of approval from the input unit 66, that is, when the control unit 60 reproduces a content, the control unit 60 Output the screen shown in 3 (b). The control unit 60 arranges the content 204 and the third display 206 vertically on the screen. As described above, the content 204 is at least one of a moving image, a WWW browser, a navigation map, and a call screen. The third display 206 is a warning message that the manual mode may be switched independently of the rider's intention. In this case, a warning message "The driving may be started if the automatic driving function is deteriorated" is displayed. The area of such a third display 206 is smaller than the area of the content 204. The third display 206 is disposed along at least one side, for example, the lower side, of the display unit 64 having a rectangular shape. Therefore, the third display 206 is disposed below the content 204. The third display 206 may be displayed intermittently.

As described above, by displaying the "alert alert statement" on the same display unit 64 while "viewing" the content on the display unit 64, the passenger may be transferred to the driving function by immersion in the content. It is prevented that it is forgotten. Furthermore, near the third display 206, an icon 214 may be arranged to indicate the state of automatic driving. An icon 214 indicates the possibility of functional deterioration (for example, a state such as ambient environment sensing function deterioration due to sudden change in weather). Therefore, a gradual alert is made by the icon 214. Return to FIG.

(3-1) Continuation of Content Reproduction after End of Automatic Operation When the automatic operation by the automatic operation control unit 24 is ended, for example, when arriving at the destination, the automatic operation control unit 24 instructs the operation control unit 20 to end the automatic operation. The notification is given, and the operation control unit 20 notifies the notification device 50 of the end of the automatic driving. When the content of the content 204 is output to the display unit 64 in (2), the control unit 60 outputs a screen shown in FIG. FIGS. 4A and 4B illustrate another screen displayed on the display unit 64. FIG. The control unit 60 arranges the content 204 and the fourth display 208 at the top and bottom of the screen as shown in FIG. 4A. The fourth display 208 is an automatic driving end notification for notifying that the automatic driving has ended. In this case, a notification of the end of automatic driving is displayed as "Arrive at destination. End of automatic driving." Also, the content 204 continues to be output. Return to FIG.

(3-2) Notification of Driving Function Delegation Request at Fallback When the driving control unit 20 determines switching from the automatic driving mode to the manual driving mode as fallback, the driving control unit 20 notifies the notification device 50 of switching. This corresponds to the case of switching from the automatic driving mode to the manual driving mode independently of the rider's intention. When the control unit 60 receives the notification of switching while outputting the content 204 to the display unit 64 in (2), the control unit 60 outputs the screen shown in FIG. The control unit 60 arranges the fifth display 210 in the screen. The fifth display 210 is a driving function transfer request notification to switch to the manual driving mode. The fifth display 210 is output to request the passenger to shift the driving function. Here, a driving function transfer request notification of "The automatic driving function is deteriorated. Please start driving immediately." Is shown. On the other hand, the control unit 60 does not output the content 204. When the reproduction of the content 204 is stopped, the control unit 60 warns the passenger. Return to FIG.

(4) Content Reproduction State During Manual Driving When the information of the operation mode received from the operation control unit 20 in the control unit 60 indicates the manual operation mode, that is, when the manual operation is performed in the automatically driven vehicle 100, the control unit 60. When an instruction to start content reproduction is received from the input unit 66, the screen shown in FIG. 5 is output. FIG. 5 shows still another screen displayed on the display unit 64. The control unit 60 arranges the content 204 in the screen without displaying the above-mentioned alerting sentence. The control unit 60 may output the content 204 when the autonomous driving vehicle 100 is stopped, or may not output the content 204 when the autonomous driving vehicle 100 is traveling. Good.

Below, the modification of the screen produced | generated in the control part 60 is demonstrated. FIG. 6 shows still another screen displayed on the display unit 64. The control unit 60 outputs the screen shown in FIG. 6 after a predetermined period, for example, 10 minutes, after the screen shown in FIG. 4A is output in the case of (3-1). That is, FIG. 6 is a screen for notifying the end of the automatic driving again. The control unit 60 arranges the content 204 and the sixth display 212 at the top and bottom of the screen. A sixth display 212 shows an automatic operation end notification that "the automatic driving has been completed. Please continue the safe driving." Although the sixth display 212 and the fourth display 208 are both automatic driving end notifications, the contents of the messages are different. Also, the content 204 continues to be output.

7 (a)-(b) show still another screen displayed on the display unit 64. FIG. Before outputting the screen shown in FIG. 4B in the case of (3-2), the control unit 60 outputs the screens shown in FIGS. 7A and 7B. When the control unit 60 receives the notification of switching when the content 204 is output to the display unit 64 in (2), the screen shown in FIG. 7A is displayed instead of the screen shown in FIG. Output As shown in FIG. 7A, the control unit 60 arranges the first reduced content 220 and the fifth display 210 on the screen. The first reduced content 220 is a display in which the content 204 is reduced. The control unit 60 displays the screen shown in FIG. 7B after, for example, 30 seconds have elapsed after a predetermined period has elapsed since the screen shown in FIG. 7A is output. As illustrated in FIG. 7B, the control unit 60 arranges the second reduced content 222 and the fifth display 210 on the screen. The second reduced content 222 is a display in which the content 204 is reduced more than the first reduced content 220.

The control unit 60 displays the screen shown in FIG. 4B after a predetermined period, for example, 30 seconds, after the screen shown in FIG. 7B is output. That is, when the control unit 60 receives the notification of switching while outputting the content 204 to the display unit 64 in (2), the control unit 60 reduces the display area of the content 204 as time passes. The fifth display 210 continues to be displayed after accepting the notification of switching when the content 204 is output to the display unit 64 in (2).

In terms of hardware, this configuration can be realized with the CPU, memory, or other LSI of any computer, and with software, it can be realized by a program loaded into the memory, etc. Are drawing functional blocks. However, it is understood by those skilled in the art that these functional blocks can be realized in various forms only by hardware and by a combination of hardware and software.

The operation of the autonomous driving vehicle 100 having the above configuration will be described. FIG. 8 is a flowchart showing the processing procedure of the notification device 50. The input unit 66 receives an instruction to start content reproduction (S10). When the autonomous driving vehicle 100 is in automatic operation (Y in S12), the control unit 60 displays a warning message and an approval button on the display unit 64 (S14). When the input unit 66 receives the pressing of the approval button (Y in S16), the control unit 60 starts content reproduction (S18). If the input unit 66 does not receive the pressing of the approval button (N in S16), the control unit 60 counts the time after receiving the content reproduction start instruction (S20). If the predetermined time has not elapsed (N in S22), the process returns to step S14. If the predetermined time has elapsed (Y in S22), the control unit 60 returns to the menu screen without starting the reproduction of the content (S24). When the autonomous driving vehicle 100 is not in automatic driving (N in S12), the control unit 60 starts reproduction of content in manual driving (S26).

FIG. 9 is a flowchart showing another processing procedure by the notification device 50. The control unit 60 continues the reproduction of the content (S50). If the notification of fallback is received (Y of S52), the control unit 60 displays a driving function transfer request notification on the display unit 64 (S54). If the manual operation is not started (N at S56), the process returns to step 54. If the manual operation is started (Y of S56), the process is ended. When the notification of fallback is not received (N of S52) and the automatic driving is ended (Y of S58), the control unit 60 displays the notification of the completion of the automatic driving on the display unit 64 (S60). If the manual operation is not started (N at S62), the process returns to step 60. If the manual operation is started (Y of S62), the process is ended. If the automatic operation is not ended (N of S58), if the input unit 66 does not receive the reproduction end instruction (N of S64), the process returns to Step 50. When the input unit 66 receives the reproduction end instruction (Y in S64), the control unit 60 ends the reproduction of the content (S66).

FIG. 10 is a flowchart showing the processing procedure of the operation control unit 20. The operation control unit 20 executes an abnormality check process (S100). When the sensing function does not fail (N of S102), the sensing function does not deteriorate (N of S104), the braking function does not fail (N of S106), and the braking function does not deteriorate (N of S108), The operation control unit 20 executes normal processing (S110). When the sensing function fails (Y at S102), when the sensing function decreases (Y at S104), or when the braking function fails (Y at S106), or when the braking function decreases (Y at S108) The operation control unit 20 executes an abnormality (fallback) process (S112).

According to the present embodiment, the third display indicating that there is a possibility of switching to the manual operation mode when outputting content in the automatic operation mode is output, and the third display is not output when switching to the manual operation mode. Attention can be drawn when outputting content in the automatic operation mode. In addition, since caution is called when outputting content in the automatic driving mode, it can be notified that the driving function can be smoothly shifted. Further, since the third display indicating that there is a possibility of switching to the second operation mode and the content are simultaneously output, attention can be drawn while viewing the content. In addition, since the third display indicating that there is a possibility of switching to the second driving mode and the content are simultaneously output, the driver may forget that the driving function may be delegated due to immersion. It can prevent.

Further, since the present invention is applied to the mode of automatic driving and the mode of manual driving, it is possible to call attention when switching from the mode of automatic driving to the mode of manual driving. In addition, since switching from the automatic driving mode to the manual driving mode occurs independently of the intention of the rider, it is possible to call attention in a situation not intended by the rider. Further, since the fifth display indicating that the mode is switched to the manual operation mode is output, the switching can be notified. Further, since the area of the third display is made smaller than the area of the predetermined content, it is possible to suppress the decrease in the visibility of the content. Further, since the third display is displayed along at least one side of the quadrangle, the visibility of the third display can be improved.

In addition, when a predetermined operation is received after outputting the second display for asking for confirmation of the passenger, the third display and content indicating that there is a possibility of switching to the manual operation mode are output, so the second display Can make it hard to forget In addition, when the predetermined operation is not received, the content is not output, so the content can be output when the passenger is approved. In addition, since the content is not output when switching from the automatic operation mode to the manual operation mode, it is possible to concentrate on the operation in the manual operation mode. Also, since the content is received from the server, various content can be output.

Second Embodiment
The transfer of operating authority to the driver takes place suddenly when the driving situation falls into a situation where the autonomous driving system can not cope. Therefore, the driver could not grasp the surrounding situation, and there was a problem that it could not respond appropriately to the transfer of the operation authority.
(Configuration of the autonomous driving vehicle 1000)
FIG. 11 is a block diagram showing a configuration of an autonomous driving vehicle 1000 according to the second embodiment. FIG. 12 is a diagram showing an example of notification of the autonomous driving vehicle 1000. As shown in FIG. FIG. 13 is a diagram showing another notification example of the autonomous driving vehicle 1000. As shown in FIG. FIG. 14 is a view showing an example of the icon according to the second embodiment. As shown in FIG. 11, the autonomous driving vehicle 1000 includes a first acquisition device 110, a second acquisition device 120, a notification device 50, and an autonomous driving system 140. The first acquisition device 110 and the second acquisition device 120 (hereinafter, the first acquisition device 110 and the second acquisition device 120 are collectively referred to as acquisition devices 110 and 120) are the notification device 50 and the automatic driving system 140, and It is connected to the. The notification device 50 is connected to the automatic driving system 140.

The first acquisition device 110 (an example of an acquisition device) includes an imaging device capable of capturing an image outside the vehicle. As one example, the imaging device includes a visible light camera. The imaging device outputs image information (signal) as information outside the vehicle to the notification device 50 and the automatic driving system 140. The imaging device images, for example, the front outside the vehicle, and acquires image information such as an obstacle 600 as shown in FIG. 12 as the information outside the vehicle. In addition, the obstacle 600 is not limited to a vehicle, and may be a human, a cone, a stop plate, etc. not shown. Further, the imaging device is not limited to the visible light camera, and may be, for example, a CCD camera or a CMOS camera. Further, the image to be captured may be a still image or a moving image.

As another example, the first acquisition device 110 includes a distance measurement sensor. As an example, the distance measuring sensor has an ultrasonic sonar. For example, when the autonomous driving vehicle 1000 is traveling, the ultrasonic sonar emits ultrasonic waves, and the obstacle 600 present around the autonomous driving vehicle 1000 is reflected based on the reflected wave detected. To detect. The ultrasonic sonar outputs a detection result (signal) as information outside the vehicle to the notification device 50 and the automatic driving system 140. The distance measuring sensor is not limited to the ultrasonic sensor, and may be, for example, a millimeter wave radar or LiDAR (Light Detection and Ranging, Laser Imaging Detection and Ranging). The first acquisition device 110 may correspond to the sensor 32 so far.

The second acquisition device 120 (an example of an acquisition device) has a road traffic information receiver. More specifically, a navigation system can be used as a road traffic information receiver.

As one example, the navigation system includes a GPS positioning unit and a navigation database. The GPS positioning unit may correspond to the position information acquisition unit 22 so far, and acquires position coordinates of the autonomous driving vehicle 1000. The GPS positioning unit receives a GPS signal transmitted from a GPS satellite, and acquires position coordinates of the autonomous driving vehicle 1000 by calculation based on the GPS signal. The navigation database receives accident information, construction information, etc. from the transportation infrastructure outside the vehicle. The navigation system can acquire the traffic information on the road on which the autonomous driving vehicle 1000 travels by acquiring the position coordinates from the GPS positioning unit and referring to the navigation database. The navigation system outputs traffic information (signals) to the notification device 50 and the automatic driving system 140.

In addition, although the autonomous driving vehicle 1000 includes the first acquisition device 110 and the second acquisition device 120, only one of them may be used. In addition, both the imaging device and the distance measuring sensor may be provided. Moreover, although the navigation system was used as a road traffic information receiver, road traffic information receivers other than navigation systems, such as a road information infrastructure receiver, may be used. Moreover, you may have both a navigation system and a road traffic information receiver.

The autonomous driving system 140 includes a vehicle control unit 141, an engine actuator 142, a brake actuator 143, and a steering actuator 144. The vehicle control unit 141 may correspond to the automatic driving control unit 24 and the ECU 26 so far, and based on the information outside the vehicle acquired by the acquisition devices 110 and 120, the engine actuator 142, the brake actuator 143, and the steering actuator 144 Control. The engine actuator 142 adjusts the amount of fuel and air supplied to the engine based on the output of the vehicle control unit 141. The brake actuator 143 adjusts the braking force of the wheel based on the output of the vehicle control unit 141. The steering actuator 144 adjusts the steering angle of the vehicle based on the output of the vehicle control unit 141.

The notification device 50 includes a reception unit 131 and a notification unit 132. The receiving unit 131 receives the information outside the vehicle output from the acquisition devices 110 and 120. The receiving unit 131 outputs the received information outside the vehicle to the notifying unit 132.

The notification unit 132 includes a control unit 60 and a notification unit 134.

The control unit 60 determines whether the autonomous driving system 140 falls within the performance limit, based on the information outside the vehicle output from the receiving unit 131. Here, the performance limit means the limit of detection and processing performed by the autonomous driving vehicle 1000. As an example, the control unit 60 processes information outside the vehicle output from the imaging device and detects an obstacle 600 present on the road. When detecting the obstacle 600 on the road, the control unit 60 determines that the automatic driving system 140 falls within the performance limit, and outputs a notification signal to the notification unit 134. In addition, the method of detecting the obstacle 600 from the information outside the vehicle may use an existing method such as pattern matching. Further, as another example, the control unit 60 determines, based on the traffic information output from the acquisition device 120, whether the obstacle 600 is present on the traveling route on which the autonomous driving vehicle 1000 travels. When it is determined that the obstacle 600 is present on the traveling route, the control unit 60 determines that the automatic driving system 140 falls within the performance limit, and outputs a notification signal to the notification unit 134.

The notification unit 134 may correspond to the display unit 64 so far, and when the notification signal is received from the control unit 60, the falling of the performance limit and the factor of the performance limit will be described. Report to the driver. As an example, the notification unit 134 is a display or a head-up display. As shown in FIG. 12 and FIG. 13, the reporting unit 134 reports the falling into the performance limit and the factors falling into the performance limit by displaying or projecting the icon 510 including the character information, the graphic information, and the like. In addition, as shown in FIG. 14, the icon 510 may be an icon 520a, 520b, 520c or the like indicating a factor due to construction. Further, as another example, the notification unit 134 is a speaker. In this case, when the control unit 60 outputs a notification signal, the notification unit 134 outputs a voice “There is an obstacle ahead. There is a possibility that the automatic operation may be canceled.” Note that the reporting unit 134 reports that the performance limit and the factors that cause the performance limit, but may report only that the performance limit.

(Processing operation of the autonomous driving vehicle 1000)
Subsequently, the processing operation of the autonomous driving vehicle 1000 will be described. FIG. 15 is a flowchart showing the processing operation of the autonomous driving vehicle 1000.

First, the acquisition devices 110 and 120 acquire information outside the vehicle (step S300).

For example, the first acquisition device 110 captures the front outside the vehicle and acquires image information such as an obstacle 600 as illustrated in FIG. 12. In addition, the second acquisition device 120 receives accident information, construction information, and the like from the transportation infrastructure outside the vehicle, and further acquires position coordinates of the autonomous driving vehicle 1000 to obtain traffic information on the road on which the autonomous driving vehicle 1000 travels. To get

Subsequently, the control unit 60 determines whether the automatic driving system 140 falls within the performance limit (step S310). Specifically, as shown in FIG. 12, an obstacle 600 present on the road is detected. The control unit 60 determines that the autonomous driving system 140 falls within the performance limit when the obstacle 600 is detected on the road. Further, the control unit 60 determines whether an obstacle 600 exists on the traveling route on which the autonomous driving vehicle 1000 travels. When the controller 60 determines that the obstacle 600 exists on the traveling route, the controller 60 determines that the automatic driving system 140 falls within the performance limit.

When the control unit 60 determines that the automatic driving system 140 falls within the performance limit (Yes in step S310), the reporting unit 134 reports (step S320). For example, the notification unit 134 displays the performance limit and causes of the performance limitation by displaying or projecting the icon 510 on the display or the head-up display. Further, the reporting unit 134 may report a factor falling into the performance limit and a factor falling into the performance limit by a voice saying "There is an obstacle ahead. There is a possibility that the automatic driving may be cancelled."

If the control unit 60 determines that the automatic driving system 140 does not fall within the performance limit (No in step S310), the process returns to step S300.

Subsequently, the acquisition devices 110 and 120 acquire information outside the vehicle (step S330). Here, step S330 is similar to step S300.

Subsequently, the control unit 60 determines whether the automatic driving system 140 falls within the performance limit (step S340). Here, step S340 is similar to step S310.

When control unit 60 determines that automatic operation system 140 falls within the performance limit (Yes in step S340), the process returns to step S320.

When the control unit 60 determines that the automatic driving system 140 does not fall within the performance limit (No in step S340), the notification unit 134 cancels the notification (step S350).

(Action effect)
The autonomous driving vehicle 1000 has the following effects.

The autonomous driving vehicle 1000 includes acquisition devices 110 and 120, a notification device 50, and an autonomous driving system 140. The acquisition devices 110 and 120 acquire information outside the vehicle. The autonomous driving system 140 controls the vehicle. The notification device 50 includes a reception unit 131 and a notification unit 132. The receiving unit 131 receives signals from the acquisition devices 110 and 120. The notification unit 132 determines from the signal whether the automatic driving system 140 falls within the performance limit, and if it determines that the automatic driving system 140 falls within the performance limit, at least the automatic driving system 140 falls within the performance limit. , Notify the driver. As a result, the driver can respond to the transfer of the operation authority even if it is difficult to drive automatically.

The notification unit 134 notifies factors that cause the autonomous driving system 140 to fall within the performance limit. Thereby, the driver can recognize the factor falling into the performance limit, and can respond promptly to the transfer of the operation authority.

[Modification of Second Embodiment]
(Configuration of the autonomous driving vehicle 2000)
Subsequently, a configuration of an autonomous driving vehicle 2000 according to a modification of the second embodiment will be described.

FIG. 16 is a block diagram showing the configuration of the autonomous driving vehicle 2000. As shown in FIG. The autonomous driving vehicle 2000 differs from the autonomous driving vehicle 1000 in that the notification unit 132 further includes a storage unit 135. In the following, only differences from the autonomous driving vehicle 1000 will be described, and the description of the same points will be omitted.

The storage unit 135 can record traveling data on which the autonomous driving vehicle 2000 travels. The travel data recorded by the storage unit 135 is, for example, a travel route including data (for example, position coordinates) indicating a position at which the autonomous driving system 140 has previously entered the performance limit. The storage unit 135 outputs the traveling data to the control unit 60. As an example of the storage unit 135, a semiconductor memory device such as a flash memory, or a recording medium such as a hard disk or an optical disk can be used.

The control unit 60 determines, based on the traveling data output from the storage unit 135, whether the automatic driving system 140 falls within the performance limit. As an example, when the route traveled by the autonomous driving vehicle 2000 includes a position at which the autonomous driving vehicle 2000 travels before based on the position coordinates of the autonomous driving vehicle 2000, the control unit 60 may fall to the performance limit. to decide.

(Processing operation of the autonomous driving vehicle 2000)
The processing operation of the autonomous driving vehicle 2000 will be described with reference to FIG. FIG. 17 is a flowchart showing the processing operation of the autonomous driving vehicle 2000.

About processing of Step S320 and Step S350, since it is processing similar to self-driving vehicle 1000, it omits.

First, the travel route including the position coordinates at which the storage unit 135 previously fell into the performance limit is output to the control unit 60 (step S400).

Subsequently, the control unit 60 determines whether the automatic driving system 140 falls within the performance limit (step S410). Specifically, based on the position coordinates of the autonomous driving vehicle 2000 acquired by the second acquisition device 120, the control unit 60 includes position coordinates at which the traveling route on which the autonomous driving vehicle 2000 travels previously fell within the performance limit. In this case, it is determined that the autonomous driving system 140 falls within the performance limit.

Subsequently, after the process of step S320, the control unit 60 determines whether the automatic driving system 140 falls within the performance limit (step S420). Here, step S420 is the same processing as step S410.

If the control unit 60 determines that the automatic driving system 140 falls within the performance limit (Yes in step S420), the process returns to step S320.

When the control unit 60 determines that the automatic driving system 140 does not fall within the performance limit (No in step S420), the notification unit 134 cancels the notification (step S350).

(Action effect)
The autonomous driving vehicle 2000 has the following effects. The second acquisition device 120 can acquire the position coordinates of the autonomous driving vehicle 2000, and the notification device 50 further includes a storage unit 135 that stores data of the position coordinates when the performance limit is reached. As a result, the notification device 50 can predict that the autonomous driving system 140 will fall into the performance limit based on the data of the position coordinates when the performance limit has previously been made.

Third Embodiment
(Configuration of the autonomous driving vehicle 3000)
Subsequently, the configuration of the autonomous driving vehicle 3000 according to the third embodiment will be described.

FIG. 18 is a block diagram showing the configuration of the autonomous driving vehicle 3000. As shown in FIG. FIG. 19 is a diagram showing an example of notification of the autonomous driving vehicle 3000. As shown in FIG. The autonomous driving vehicle 3000 is different from the autonomous driving vehicle 1000 of the second embodiment in that the notification unit 132 further includes a setting unit 136. In the following, differences from the autonomous driving vehicle 3000 will be described, and descriptions of the same points will be omitted.

The setting unit 136 sets a first threshold for the control unit 60 to determine whether the automatic driving system 140 falls within the performance limit. As an example, the setting unit 136 sets a first threshold corresponding to the number of pedestrians. The setting unit 136 outputs the set first threshold to the control unit 60. In addition, the number of pedestrians may include a person riding a bicycle. The setting unit 136 also sets a second threshold for the control unit 60 to determine whether the automatic driving system 140 is at the performance limit. As an example, the setting unit 136 sets a second threshold corresponding to the number of pedestrians.

The control unit 60 determines whether the automatic driving system 140 falls within the performance limit, based on the information outside the vehicle output from the receiving unit 131 and the first threshold set by the setting unit 136. As one example, as shown in FIG. 19, the control unit 60 processes information outside the vehicle output from the imaging device, and detects a pedestrian 530 present on the road. The control unit 60 compares the detected number of pedestrians with the first threshold output from the setting unit 136. When the number of pedestrians is equal to or more than the first threshold value, the control unit 60 determines that the performance limit is reached, and outputs a notification signal to the notification unit 134. In addition, the existing method of pattern matching etc. should just be used for the method of detecting the pedestrian 530 from the information of the vehicle exterior.

Further, based on the information outside the vehicle output from the receiving unit 131 and the second threshold set by the setting unit 136, the control unit 60 determines whether the automatic driving system 140 is at the performance limit. Here, the second threshold is larger than the first threshold. As an example, control part 60 judges that it is a performance limit, when the number of pedestrians is more than the 2nd threshold, and outputs a stop signal which stops vehicle control to automatic driving system 140.

Furthermore, when the number of pedestrians falls below the second threshold after the number of pedestrians exceeds the second threshold, the controller 60 resumes resuming vehicle control. A signal is output to the automatic driving system 140.

The autonomous driving system 140 stops the control of the vehicle based on the stop signal output from the control unit 60, and transfers the operation authority to the driver. In addition, the autonomous driving system 140 resumes the control of the vehicle based on the restart signal output from the control unit 60.

(Processing operation of the autonomous driving vehicle 3000)
The processing operation of the autonomous driving vehicle 3000 will be described with reference to FIG. FIG. 20 is a flowchart showing the processing operation of the autonomous driving vehicle 3000. FIG. 21 is a flowchart showing the restart operation in the processing operation of the autonomous driving vehicle 3000.

First, the setting unit 136 sets the first threshold and the second threshold (step S500). Specifically, the first threshold and the second threshold correspond to the number of pedestrians. The first threshold can be arbitrarily set to five, ten, fifteen, etc., according to the performance limit of the autonomous driving vehicle 3000. In addition, the second threshold may be larger than the first threshold, and can be arbitrarily set to 10, 15, 20, and so on.

Next, the acquisition devices 110 and 120 acquire information outside the vehicle (step S510).

For example, the imaging device of the first acquisition device 110 captures the front outside the vehicle, and acquires image information of a pedestrian 530 or the like as shown in FIG. Alternatively, the ultrasonic sonar emits ultrasonic waves, and detects the pedestrian 530 present around the autonomous driving vehicle 1000 based on the reflected and detected reflected wave.

Subsequently, the control unit 60 determines whether the number of pedestrians is equal to or more than a first threshold (step S520). If the control unit 60 determines that the number of pedestrians is equal to or greater than the first threshold (Yes in step S520), the control unit 60 determines whether the number of pedestrians is equal to or greater than the second threshold (steps S530). If the control unit 60 determines that the number of pedestrians is not the first threshold or more (No in step S520), the process returns to step S510.

Next, when the control unit 60 determines that the number of pedestrians is equal to or more than the second threshold (Yes in step S530), the control unit 60 outputs a stop signal for stopping the vehicle control to the automatic driving system 140 ( Step S540). Thereafter, the control unit 60 performs processing for the resumption operation of the automatic driving system 140 (step S550).

If the control unit 60 determines that the number of pedestrians is not equal to or greater than the second threshold (No in step S530), the reporting unit 134 reports (step S560). For example, as illustrated in FIG. 19, the notification unit 134 falls into the performance limit and falls within the performance limit by displaying or projecting the icon 540 indicating the factor by the pedestrian 530 on the display or the head-up display. Report the cause. Further, the reporting unit 134 may report a factor falling into the performance limit and a factor falling into the performance limit by a voice saying “There is a pedestrian 530 in front. There is a possibility that automatic driving may be cancelled.”.

Subsequently, control unit 60 determines whether the number of pedestrians is smaller than the first threshold (step S570). If the control unit 60 determines that the number of pedestrians is smaller than the first threshold (Yes in step S570), the notification unit 134 cancels the notification (step S580). When the control unit 60 determines that it is not smaller than the first threshold (No in step S570), the process returns to the process of step S530.

Next, the restart operation (step S550) of the automatic driving system 140 will be described with reference to FIG.

When control unit 60 outputs a stop signal for stopping the vehicle control to automatic driving system 140 by step S540, control unit 60 determines whether the number of pedestrians is smaller than the second threshold (step When the control unit 60 determines that the number of pedestrians is smaller than the second threshold (Yes in step S551), the control unit 60 outputs a restart signal for restarting vehicle control to the automatic driving system 140. (Step S552). Subsequently, the process returns to the process of step S510. If the control unit 60 determines that the number of pedestrians is not smaller than the second threshold (No in step S551), the process returns to the process of step S551.

(Action effect)
The autonomous driving vehicle 3000 has the following effects.

The signal includes information on the number of pedestrians, and the notification unit 132 determines that the performance limit is reached when the number of pedestrians is equal to or greater than the first threshold. Thereby, when the number of pedestrians is more than the first threshold, the driver can cope with the transfer of the operation authority.

If the number of pedestrians is equal to or greater than a second threshold that is greater than the first threshold, the notification unit 132 outputs a stop signal to stop the vehicle control to the automatic driving system 140. Thereby, when the number of pedestrians is more than a 2nd threshold, operation authority can be transferred to a driver.

If the number of pedestrians falls below the second threshold, the notification unit 132 outputs a restart signal to restart the vehicle control to the automatic driving system 140. Thus, when the number of pedestrians falls below the second threshold, the autonomous driving system 140 can resume the driving operation.

[Modification of Third Embodiment]
(Configuration of the autonomous driving vehicle 4000)
The configuration of the autonomous driving vehicle 4000 will be described. The autonomous driving vehicle 4000 differs from the autonomous driving vehicle 3000 in that the control unit 60 outputs a restart signal to the autonomous driving system 140 when the number of pedestrians is equal to or less than the third threshold. In the following, differences from the autonomous driving vehicle 3000 will be described, and descriptions of the same points will be omitted.

The setting unit 136 sets a third threshold for determining whether the automatic driving system 140 can restart. As an example, the setting unit 136 sets a third threshold corresponding to the number of pedestrians. The setting unit 136 outputs the set third threshold to the control unit 60. Here, the third threshold is smaller than the first threshold.

The control unit 60 determines whether the automatic driving system 140 can be resumed based on the information outside the vehicle output from the receiving unit 131 and the third threshold set by the setting unit 136. When the number of pedestrians becomes equal to or less than the third threshold value, the control unit 60 determines that the automatic driving system 140 can restart, and outputs a restart signal to restart the vehicle control to the automatic driving system 140.

(Processing operation of the autonomous driving vehicle 4000)
The processing operation of the autonomous driving vehicle 4000 will be described with reference to FIG. FIG. 22 is a flowchart showing the restart operation in the processing operation of the autonomous driving vehicle 4000.

The processing operation of the autonomous driving vehicle 4000 differs from the autonomous driving vehicle 3000 in the restart operation (step S550) of the autonomous driving vehicle 4000. Hereinafter, the restart operation (step S550 in FIG. 20) will be described, and the description of the same points as those in FIGS. 20 and 21 will be omitted.

When control unit 60 outputs a stop signal for stopping the vehicle control to automatic driving system 140 by step S540, control unit 60 determines whether the number of pedestrians is equal to or less than the third threshold (step S553). When the control unit 60 determines that the number of pedestrians is equal to or less than the third threshold (Yes in step S553), the control unit 60 outputs a restart signal for restarting vehicle control to the automatic driving system 140 (step S 554). Subsequently, the process returns to the process of step S510. When control unit 60 determines that the number of pedestrians is not less than or equal to the third threshold (No in step S553), the process returns to step S553.

(Action effect)
The autonomous driving vehicle 4000 has the following effects.

When the number of pedestrians is equal to or less than a third threshold smaller than the first threshold, the notification unit 132 outputs a restart signal for restarting vehicle control to the automatic driving system 140. As a result, the automatic driving system 140 can resume the driving operation when the automatic driving system 140 is in a situation where the possibility of falling into the performance limit is low.

[Other Embodiments of Second and Third Embodiments and Their Modifications]
As mentioned above, although the example of composition of this indication was explained based on the 2nd, 3rd embodiment, and those modifications, this indication is not limited to the above-mentioned embodiment. For example, the automatic driving vehicle 1000 may be configured by combining the partial configurations of the automatic driving vehicle 1000 to the automatic driving vehicle 4000 as appropriate. Furthermore, it is possible to add an appropriate change to the configuration of the autonomous vehicle 1000 to the autonomous vehicle 4000 without departing from the scope of the technical idea of the present disclosure.

For example, the setting unit 136 may set first to third threshold values corresponding to the number of vehicles or the amount of precipitation. The setting unit 136 outputs the set first to third threshold values to the control unit 60. The reporting unit 134 reports the factors falling into the performance limit and the factors falling into the performance limit, for example, by displaying or projecting an icon 550 or the like indicating a factor due to snowfall illustrated in FIG. 14.

The control unit 60 determines that the performance limit occurs when the number of vehicles or the amount of precipitation is equal to or more than the first threshold. Thereby, the driver can cope with the transfer of the operation authority when the number of vehicles or the amount of precipitation is equal to or more than the first threshold.

The control unit 60 outputs a stop signal for stopping the vehicle control to the automatic driving system 140 when the number of vehicles or the amount of precipitation is equal to or more than the second threshold larger than the first threshold. Thereby, the operation authority is transferred to the driver when the number of vehicles or the amount of precipitation is equal to or more than the second threshold. By thus making the second threshold larger than the first threshold, the driver can prepare for the transfer of the operation authority.

When the number of vehicles or the amount of precipitation falls below the second threshold, the control unit 60 outputs a restart signal for restarting vehicle control to the automatic driving system 140. Thus, when the number of vehicles or the amount of precipitation falls below the second threshold, the autonomous driving system 140 can resume the driving operation.

When the number of vehicles or the amount of precipitation is equal to or less than a third threshold smaller than the first threshold, the control unit 60 outputs a restart signal to restart the vehicle control to the automatic driving system 140. Thereby, when the number of vehicles or the amount of precipitation is equal to or less than a third threshold smaller than the first threshold, the autonomous driving system 140 can resume the driving operation.

FIG. 23 is a block diagram showing the configuration of the autonomous driving vehicle 5000. As shown in FIG. The setting unit 137 is a threshold that determines that the performance limit is reached when the information outside the vehicle including at least two or more of the number of pedestrians or the number of vehicles or the amount of precipitation is received from the acquisition devices 110 and 120 May be set to a value smaller than the first threshold.

In this way, it is possible to set a threshold value that is determined to fall into the performance limit in accordance with the situation outside the vehicle (such as an irregular weather and a large number of people). Therefore, compared with the case where the first threshold is set, it can be notified that the autonomous driving system 140 falls into the performance limit earlier.

In the automatically driven vehicle 1000 to the automatically driven vehicle 5000 described in the above embodiment, the blocks such as the control unit 60, the notification unit 134, the storage unit 135, the setting unit 136, and the setting unit 137 are individualized by a semiconductor device such as an LSI. In one chip, or may be in one chip to include part or all.

Fourth Embodiment
The fourth embodiment corresponds to the case where the first embodiment is combined with at least one of the embodiments other than the first embodiment. Therefore, the fourth embodiment has a configuration in which the autonomous driving vehicle 100 is combined with at least one of the autonomous driving vehicle 1000 to the autonomous driving vehicle 5000. As in the first embodiment, the control unit 60 causes the display unit 64 to display the screens shown in FIGS. 3 (a) and 3 (b) while the automatic operation is being performed. In this state, the control unit 60 causes the display unit 64 to display the screens shown in FIG. 12, FIG. 13, FIG. 14, and FIG.

As a result, it is possible to notify the driver of falling into the performance limit when falling into the performance limit while drawing attention when outputting the content in the automatic driving mode. Therefore, the driver can cope with the transfer of the operation authority even if it is difficult to drive automatically.
it can.

Part or all of the processing of each functional block in each of the above embodiments may be realized by a computer program. In addition, each process of the above-described embodiment may be realized by hardware or may be realized by software (including the case where it is realized with an operating system (OS), middleware, or a predetermined library). Good. Furthermore, it may be realized by mixed processing of software and hardware.

Further, the order of execution of the processing method according to the above embodiment is not necessarily limited to the description of the above embodiment, and the order of execution can be interchanged without departing from the scope of the present disclosure.

The processing method executed by the autonomous driving vehicle 1000 to the autonomous driving vehicle 5000, the computer program that causes the computer to execute the processing method, and the computer readable recording medium recording the program are included in the scope of the present disclosure. Here, as a computer readable recording medium, for example, a flexible disk, a hard disk, a CD-ROM, an MO, a DVD, a DVD, a DVD-ROM, a DVD-RAM, a BD (Blu-ray (registered trademark) Disc), a semiconductor memory It can be mentioned. The computer program is not limited to one recorded on the above recording medium, but may be transmitted via a telecommunication line, a wireless or wired communication line, a network represented by the Internet, or the like.

Reference Signs List 10 dashboard, 12 front glass, 14 ceiling, 16 room mirror, 20 operation control unit, 22 position information acquisition unit, 24 automatic operation control unit, 26 ECU, 30 operation unit, 32 sensor, 40 steering, 42 accelerator pedal, 44 Brake pedal, 50 notification devices, 60 control units, 62 wireless communication units, 64 display units, 66 input units, 70 steering ECUs, 72 engine ECUs, 74 brake ECUs, 80 networks, 82 servers, 100 autonomous driving vehicles, 110 first Acquisition device, 120 second acquisition device, 131 reception unit, 132 notification unit, 134 notification unit, 135 storage unit, 136, 137 setting unit, 140 automatic driving system 141 vehicle control unit, 142 the engine actuators, 143 brake actuator, 144 the steering actuator, 1000,1000,2000,3000,4000,5000 automatically driven vehicle.

According to the present disclosure, the driving function can be notified to smoothly shift.

Claims (31)

1. A notification device for notifying an occupant;
   An autonomously operating vehicle having at least a first operating mode and a second operating mode,
   In the second operation mode, the intervention for the driver's operation is larger than the first operation mode,
   The notification device notifies that the second operation mode may be switched independently of the intention of the occupant.
   Automated driving vehicle.
2. The autonomous driving vehicle according to claim 1,
   The notification device includes a display unit capable of outputting predetermined content.
   In the first operation mode, when the display unit outputs the predetermined content, the display unit may switch to the second operation mode independently of the intention of the rider. Output and the predetermined content,
   When the display unit switches from the first operation mode to the second operation mode while the display unit is outputting the predetermined display and the predetermined content, the display unit performs at least the predetermined display. Do not output,
   Automated driving vehicle.
3. The autonomous driving vehicle according to claim 2,
   In the first operation mode, when the display unit outputs the predetermined content, the display unit may switch to the second operation mode independently of the intention of the rider. Simultaneously displaying the display of the content and the predetermined content,
   Automated driving vehicle.
4. It is an autonomous driving vehicle according to claim 2 or 3,
   The first operation mode is a mode of automatic operation, and
   The second operation mode is a mode of manual operation,
   Automated driving vehicle.
5. The autonomous driving vehicle according to any one of claims 2 to 4, wherein
   Switching from the first driving mode to the second driving mode may occur independently of the rider's intention.
   Automated driving vehicle.
6. The autonomous driving vehicle according to claim 5, wherein
   When switching from the first driving mode to the second driving mode independently of the intention of the rider, the display unit displays that the switching to the second driving mode is performed.
   Automated driving vehicle.
7. The autonomous driving vehicle according to any one of claims 2 to 6, wherein
   When the display unit displays the predetermined display and the predetermined content,
   The area of the predetermined display in the display unit is smaller than the area of the predetermined content,
   Automated driving vehicle.
8. The autonomous driving vehicle according to any one of claims 2 to 7, wherein
   The display unit has a rectangular shape,
   The predetermined display is displayed along at least one side of the square.
   Automated driving vehicle.
9. The autonomous driving vehicle according to any one of claims 2 to 8, wherein
   It further has an input unit that can accept the operation of the passenger,
   In the first operation mode, when the display unit outputs the predetermined content, the display unit may switch to the second operation mode independently of the intention of the passenger. Output 1 and the second display asking for confirmation of the passenger,
   When the input unit receives a predetermined operation after the display unit performs the second display, the display unit may be switched to the second operation mode independently of the rider's intention. Output a third indication indicating that there is a predetermined content and
   Automated driving vehicle.
10. The autonomous driving vehicle according to claim 9,
    If the input unit does not receive the predetermined operation after the display unit performs the second display, the display unit does not output the predetermined content.
    Automated driving vehicle.
11. The autonomous driving vehicle according to any one of claims 2 to 10, wherein
    When the display unit switches from the first operation mode to the second operation mode while the display unit is outputting the predetermined display and the predetermined content, the display unit outputs the predetermined content do not do,
    Automated driving vehicle.
12. An autonomous driving vehicle according to any one of claims 2 to 11, wherein
    It further comprises a wireless communication unit,
    The predetermined content is received from the outside via the wireless communication unit.
    Automated driving vehicle.
13. The autonomous driving vehicle according to claim 12, wherein
    The predetermined content is at least one of the following (1) to (4):
    Automated driving vehicle.
    (1) Moving image (2) WWW browser (3) Map of navigation (4) Call screen
14. An autonomous driving vehicle according to any one of claims 1 to 13,
    An acquisition device for acquiring information outside the vehicle,
    An automatic driving system for controlling a vehicle in the first driving mode;
    The notification device includes a reception unit that receives a signal from the acquisition device, and a notification unit.
    The notification unit determines whether or not the automatic driving system falls into the performance limit based on the signal, and when it is judged that the automatic driving system falls into the performance limit, at least the automatic driving system reaches the performance limit. Notifying the driver of the autonomous driving vehicle
    Automated driving vehicle.
15. 15. The autonomous driving vehicle according to claim 14, wherein
    The notification unit further notifies the cause of the automatic driving system falling into the performance limit.
    Automated driving vehicle.
16. An autonomous driving vehicle according to claim 14 or 15,
    The signal includes precipitation information or the number of pedestrians or vehicles included in the detection range of the acquisition device,
    The notification unit determines that the performance limit falls when the amount of precipitation or the number of pedestrians or the number of vehicles is equal to or greater than a first threshold.
    Automated driving vehicle.
17. 17. The autonomous driving vehicle according to claim 16, wherein
    If the amount of precipitation or the number of pedestrians or the number of vehicles is equal to or greater than a second threshold larger than the first threshold, the notification unit may stop the vehicle control with the stop signal as the automatic driving. Output to the system,
    Automated driving vehicle.
18. The autonomous driving vehicle according to claim 17, wherein
    When the amount of precipitation or the number of pedestrians or the number of vehicles falls below the second threshold, the notification unit outputs a restart signal for restarting the vehicle control to the automatic driving system.
    Automated driving vehicle.
19. The autonomous driving vehicle according to claim 17, wherein
    When the amount of precipitation or the number of pedestrians or the number of vehicles is equal to or less than a third threshold smaller than the first threshold, the notification unit automatically drives a restart signal for restarting the vehicle control. Output to the system,
    Automated driving vehicle.
20. 20. The autonomous driving vehicle according to any one of claims 16 to 19, wherein
    When the notification device receives information from the acquisition device outside the vehicle including at least two or more of the amount of precipitation or the number of pedestrians or the number of vehicles, the notification device determines a threshold value that determines that the performance limit falls. Set to a value smaller than the first threshold,
    Automated driving vehicle.
21. 21. The autonomous driving vehicle according to any one of claims 14 to 20, wherein
    The acquisition device includes an imaging device that images the outside of the vehicle and outputs image data as the signal.
    Automated driving vehicle.
22. 21. The autonomous driving vehicle according to any one of claims 14 to 20, wherein
    The acquisition device includes a road traffic information receiver that receives road traffic information and outputs the road traffic information as the signal.
    Automated driving vehicle.
23. An autonomous driving vehicle according to claim 14 or 15,
    The acquisition device can acquire position coordinates of the vehicle, and
    The notification device further includes a storage unit that stores data of position coordinates when the performance limit is reached.
    Automated driving vehicle.
24. A notification device which can be mounted on an autonomous driving vehicle having at least a first operation mode and a second operation mode, and which notifies an occupant of the vehicle.
    In the second operation mode, the intervention for the driver's operation is larger than the first operation mode,
    Informing that there is a possibility that the second operation mode may be switched independently of the intention of the occupant,
    Notification device.
25. An acquisition device for acquiring information outside the vehicle,
    An automated driving system that controls the vehicle;
    Equipped with a notification device,
    The notification device includes a reception unit that receives a signal from the acquisition device, and a notification unit.
    The notification unit determines whether or not the automatic driving system falls into the performance limit based on the signal, and when it is judged that the automatic driving system falls into the performance limit, at least the automatic driving system reaches the performance limit. To notify the driver of the autonomous driving vehicle
    Automated driving vehicle.
26. A notification method in a notification device that can be mounted on an autonomous driving vehicle having at least a first operation mode and a second operation mode, and notifies an occupant of the vehicle.
    In the second operation mode, the intervention for the driver's operation is larger than the first operation mode,
    Informing that there is a possibility that the second operation mode may be switched independently of the intention of the occupant,
    Notification method.
27. A program in a notification device which can be mounted on an autonomous driving vehicle having at least a first operation mode and a second operation mode, and which notifies an occupant of the vehicle.
    In the second operation mode, the intervention for the driver's operation is larger than the first operation mode,
    A program for causing a computer to execute notification that the second operation mode may be switched independently of the intention of the occupant.
28. A storage medium that can be mounted on an autonomous driving vehicle having at least a first operation mode and a second operation mode, and stores a program in a notification device that notifies an occupant of the vehicle.
    In the second operation mode, the intervention for the driver's operation is larger than the first operation mode,
    A storage medium storing a program for causing a computer to execute notification that the second operation mode may be switched independently of the intention of the occupant.
29. 27. The notification method according to claim 26, wherein
    Acquiring information outside the vehicle in an acquisition device;
    Receiving a signal from the acquisition device;
    In the first operation mode of the automatic driving system, it is determined whether or not the automatic driving system falls into the performance limit based on the signal, and when it is judged that the automatic driving system falls into the performance limit, at least the automatic Notifying the driver of the autonomous driving vehicle that the driving system falls within the performance limit.
    Notification method.
30. The program according to claim 27, which is
    Acquiring information outside the vehicle in an acquisition device;
    Receiving a signal from the acquisition device;
    In the first operation mode of the automatic driving system, it is determined whether or not the automatic driving system falls into the performance limit based on the signal, and when it is judged that the automatic driving system falls into the performance limit, at least the automatic Notifying the driver of the autonomous driving vehicle that the driving system falls within the performance limit.
    program.
31. The storage medium according to claim 28, wherein
    Acquiring information outside the vehicle in an acquisition device;
    Receiving a signal from the acquisition device;
    In the first operation mode of the automatic driving system, it is determined whether or not the automatic driving system falls into the performance limit based on the signal, and when it is judged that the automatic driving system falls into the performance limit, at least the automatic Notifying the driver of the autonomous driving vehicle that the driving system falls within the performance limit.
    Storage medium.

Images