JP7043444B2 - Vehicle control systems, vehicle control methods, and vehicle control programs - Google Patents

Description

The present invention relates to a vehicle control system, a vehicle control method, and a vehicle control program.

In recent years, research has been conducted on a technology for automatically controlling at least one of acceleration / deceleration or steering of a vehicle (hereinafter referred to as automatic driving) so that the vehicle travels along a route to a destination. In relation to this, an operation regulation control means that regulates the operation of a predetermined function among AV functions during manual driving, and an automatic driving determination means that determines whether or not the vehicle is in the state of automatic driving. , A control means that enables the operation of the AV function in a state where the restriction on the operation of the predetermined function is released in response to the determination by the automatic driving determination means that the vehicle is in the state of the automatic driving. An in-vehicle AV device having the above is disclosed (see, for example, Patent Document 1).

Japanese Unexamined Patent Publication No. 2011-16385

However, in the device of the prior art, the regulation of the predetermined function may be lifted only because the automatic operation is in progress, so that the occupant's awareness of peripheral monitoring may be lowered.

The present invention has been made in consideration of such circumstances, and an object of the present invention is to provide a vehicle control system, a vehicle control method, and a vehicle control program capable of more appropriately controlling the functions of the devices. I will do it.

The vehicle control system, vehicle control method, and program according to the present invention have adopted the following configurations.
(1): The vehicle control system according to one aspect of the present invention is a control unit that executes a follow-up running that follows a preceding vehicle, and a driver's control unit that is used during the execution of the follow-up run. It is a vehicle control system including a device control unit that does not regulate the use of a specific function in which the line of sight deviates from the periphery of the vehicle.

(2): The vehicle control system according to one aspect of the present invention is operated by being used by a control unit that executes a follow-up running that follows the preceding vehicle and when the follow-up run is not being executed. It is a vehicle control system including a device control unit that regulates the use of a specific function in which the line of sight of a person deviates from the periphery of the vehicle.

(3): The vehicle control system according to one aspect of the present invention is operated by being used by a control unit that executes a constant speed traveling mode of constant speed traveling at a predetermined speed or less and during execution of the constant speed traveling. It is a vehicle control system including a device control unit that does not regulate the use of a specific function in which the line of sight of a person deviates from the periphery of the vehicle.

(4): In any of the above embodiments (1) to (3), the specific function is a videophone function.

(5): In the embodiment described in (4) above, the device control unit further includes a display unit and a speaker, and the device control unit performs the follow-up travel from a state in which the control unit is executing follow-up travel or constant-speed travel. Alternatively, when the vehicle shifts to a state in which the vehicle is not running at a constant speed and the video telephone function is used as the specific function, the image of the display unit is switched and the utterance output by the speaker is continued.

(6): In the embodiment described in (5) above, after switching the image of the display unit, the device control unit has not executed the follow-up running or the constant-speed running, and then the follow-up running or the constant-speed running. When the state is changed to the state in which the running is executed, the image before the switching is displayed again on the display unit.

(7): The vehicle control system according to any one of (4) to (6) above, further comprising an image pickup unit for capturing an image of an occupant, and the image captured by the image pickup section is the videophone function. And the occupant condition monitoring unit that monitors the occupant's condition is used to monitor the occupant's condition.

(8): The vehicle control method according to one aspect of the present invention is a vehicle control method in which an in-vehicle computer executes a follow-up run that follows a preceding vehicle and is used during the follow-up run, whereby the driver This is a vehicle control method that does not restrict the use of specific functions that deviate from the surroundings of the vehicle.

(9): The vehicle control program according to one aspect of the present invention causes an in-vehicle computer to execute a follow-up running that follows a preceding vehicle, and is used during the execution of the follow-up run to drive a driver. It is a vehicle control program that does not restrict the use of specific functions that deviate from the surroundings of the vehicle.

According to the above (1) to (5), (8) or (9), the function of the device can be controlled more appropriately.

According to (6) above, when the state shifts from the state in which low-speed follow-up or constant-speed running is not executed to the state in which low-speed follow-up or constant-speed running is executed, the image of the stopped call partner is displayed again on the display unit. Therefore, the convenience for the occupants is improved.

According to the above (7), the image captured by the image pickup unit is used by the occupant condition monitoring unit for monitoring the condition of the videophone and the occupant to monitor the condition of the occupant, so that the cost can be suppressed. ..

It is a block diagram of the vehicle system 1 including the vehicle control system of an embodiment. It is a figure which shows the mode that the relative position and posture of the own vehicle M with respect to the traveling lane L1 are recognized by the own vehicle position recognition unit 322. It is a figure which shows how the target track is generated based on the recommended lane. It is a figure (the 1) for demonstrating the process at the time of a lane change. It is a figure (the 2) for demonstrating the process at the time of a lane change. It is a figure which shows an example of HMI 400 in own vehicle M. It is a figure for demonstrating the 1st positional relationship of the 3rd display part 470 and the light emitting part 472. It is a figure exemplifying another aspect of the positional relationship between the 3rd display unit 470 and the light emitting unit 472. It is a figure for demonstrating that a part area of the screen of the 3rd display part 470 is used, and the 3rd display part 470 is notified that it is available. It is a figure which shows various scenes from the manual driving to the automatic driving start of the own vehicle M, and the lane change by the automatic driving is executed. It is a figure which shows an example of the 1st screen IM1-1 and the 2nd screen IM2-1 displayed at the time of manual operation. It is a figure which shows an example of the 3rd screen IM3-1 and the 4th screen IM4-1 displayed by operating the main switch 412. It is a figure which shows an example of the screen IM3-2 and the screen IM4-2 displayed on the 1st display unit 450 and HUD460 when the auto switch 414 is operated. It is a figure which shows an example of the image displayed in the driving support state display area 620-2 at the time of execution of the driving support of the first degree. It is a figure which shows the display example of the request operation notification image 623 including the accelerator pedal and the foot of an occupant. It is a figure which shows an example of the screen displayed on the 1st display unit 450 and HUD460 during the operation support of the 2nd degree. It is a figure which shows an example of the 3rd screen IM3-4 and the 4th screen IM4-4 which are displayed at the start of a lane change. It is a figure which shows an example of the 3rd screen IM3-5 and the 4th screen IM4-5 which are displayed during execution of a lane change. It is a flowchart which shows an example of the flow of the process executed by the HMI control unit 120 in scenes (1) to (3). It is a flowchart which shows an example of the process which the HMI control unit 120 displays the 3rd screen IM3-1 on the 1st display unit 450. It is a flowchart which shows an example of the display control processing when the event which changes the behavior of own vehicle M occurs. It is a figure which shows various scenes from executing the driving support in the 3rd degree to the own vehicle M, and then executing the driving support in the 3rd degree to the 2nd degree. It is a figure which shows an example of the 3rd screen IM3-6 and the 4th screen IM4-6 displayed at the time of acceleration control of own vehicle M. It is a figure which shows an example of the 3rd screen IM3-7 and the 4th screen IM4-7 which are displayed at the time of low-speed follow-up running. It is a figure which shows an example of the 3rd screen IM3-8 and the 4th screen IM4-8 which are displayed to request the occupant to monitor the periphery. It is a figure which shows an example of the 3rd screen IM3-9 and the 4th screen IM4-9 when switching from the 3rd degree to the 2nd degree. It is a flowchart which shows an example of the flow of the process executed by the HMI control unit 120 in scenes (4) to (6). It is a flowchart which shows the flow of the execution process of a specific function by the HMI control unit 120. It is a figure which shows an example of how the image displayed on the 3rd display unit 470 changes depending on the degree of operation. It is a figure which shows various scenes from the switching of the own vehicle M from the driving support of the second degree to the driving by manual driving. It is a figure which shows an example of the 3rd screen IM3-10 and the 4th screen IM4-10 which are displayed at the time of the switching request to the manual operation. It is a figure which shows an example of the 3rd screen IM3-11 and the 4th screen IM4-11 which strengthened the warning for making an occupant perform manual operation. It is a figure for demonstrating that the seat belt is vibrated to give a warning to an occupant. It is a figure which shows an example of the 3rd screen IM3-12 and the 4th screen IM4-12 which displays the information to end the automatic operation. It is a figure which shows an example of the 3rd screen IM3-13 and the 4th screen IM4-13 at the time of emergency stop of own vehicle M. It is a flowchart which shows an example of the flow of the process executed by the HMI control unit 120 in scenes (7) to (9). It is a figure for demonstrating the switching timing of various devices or control related to driving support. It is a figure for demonstrating the switching control of the driving support in an embodiment.

Hereinafter, embodiments of the vehicle control system, vehicle control method, and vehicle control program of the present invention will be described with reference to the drawings. In the embodiment, the vehicle control system is applied to an autonomous driving vehicle capable of autonomous driving (autonomous driving). In principle, automatic driving means that the vehicle runs in a state that does not require operation by the occupants, and is considered to be a kind of driving support. The self-driving vehicle can also be driven by manual driving. In the following description, the "occupant" refers to an occupant seated in the driver's seat, that is, the seat provided with the driver's operator.

In the present embodiment, the degree of driving support includes, for example, the first degree of driving support by operating a driving support device such as ACC (Adaptive Cruise Control System) or LKAS (Lane Keeping Assistance System). The degree of control is higher than that of the first degree, and the occupant automatically controls at least one of acceleration / deceleration or steering of the vehicle without operating the driver of the vehicle to perform automatic driving. The second degree, which imposes a certain degree of peripheral monitoring obligation, and the degree of control, which is higher than the second degree, does not impose the peripheral monitoring obligation on the occupants (or imposes a lower peripheral monitoring obligation than the second degree). It is assumed that there is a degree of 3. In the present embodiment, the second degree and the third degree of driving support correspond to automatic driving.

[overall structure]
FIG. 1 is a configuration diagram of a vehicle system 1 including a vehicle control system of an embodiment. The vehicle on which the vehicle system 1 is mounted (hereinafter referred to as own vehicle M) is, for example, a vehicle such as a two-wheeled vehicle, a three-wheeled vehicle, or a four-wheeled vehicle, and its drive source is an internal combustion engine such as a diesel engine or a gasoline engine, an electric motor, or the like. Alternatively, it is a combination of these. The electric motor operates by using the electric power generated by the generator connected to the internal combustion engine or the electric power generated by the secondary battery or the fuel cell.

The vehicle system 1 includes, for example, a camera 10, a radar device 12, a finder 14, an object recognition device 16, a communication device 20, a navigation device 50, an MPU (Map Positioning Unit) 60, a vehicle sensor 70, and the like. The driving controller 80, the vehicle interior camera 90, the master control unit 100, the driving support control unit 200, the automatic driving control unit 300, the HMI (Human Machine Interface) 400, the driving force output device 500, and the brakes. The device 510 and the steering device 520 are provided. These devices and devices are connected to each other by a multiplex communication line such as a CAN (Controller Area Network) communication line, a serial communication line, a wireless communication network, or the like. The configuration shown in FIG. 1 is merely an example, and a part of the configuration may be omitted or another configuration may be added.

In the embodiment, the "vehicle control system" includes, for example, a master control unit 100, a driving support control unit 200, an automatic driving control unit 300, and an HMI 400. The master control unit 100, the operation support control unit 200, and the automatic operation control unit 300 are examples of the "control unit". The HMI control unit 120 is an example of a “device control unit”.

The camera 10 is, for example, a digital camera using a solid-state image sensor such as a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor). One or a plurality of cameras 10 are attached to any position of the own vehicle M on which the vehicle system 1 is mounted. When photographing the front, the camera 10 is attached to the upper part of the front windshield, the back surface of the rear-view mirror, and the like. When photographing the rear, the camera 10 is attached to the upper part of the rear windshield, the back door, or the like. When taking a side image, the camera 10 is attached to a door mirror or the like. The camera 10 periodically and repeatedly images the periphery of the own vehicle M, for example. The camera 10 may be a stereo camera.

The radar device 12 radiates radio waves such as millimeter waves around the own vehicle M, and also detects radio waves (reflected waves) reflected by the object to detect at least the position (distance and direction) of the object. One or a plurality of radar devices 12 may be attached to any position of the own vehicle M. The radar device 12 may detect the position and velocity of the object by the FMCW (Frequency Modulated Continuous Wave) method.

The finder 14 is a LIDAR (Light Detection and Ranging or Laser Imaging Detection and Ranging) that measures scattered light with respect to the irradiation light and detects the distance to the target. One or a plurality of finder 14s may be attached to any position of the own vehicle M.

The object recognition device 16 performs sensor fusion processing on the detection results of a part or all of the camera 10, the radar device 12, and the finder 14, and recognizes the position, type, speed, and the like of the object. The object recognition device 16 outputs the recognition result to the driving support control unit 200 and the automatic driving control unit 300.

The communication device 20 communicates with another vehicle existing in the vicinity of the own vehicle M by using, for example, a cellular network, a Wi-Fi network, Bluetooth (registered trademark), DSRC (Dedicated Short Range Communication), or wirelessly. Communicates with various server devices via the base station. Further, the communication device 20 communicates with a terminal device owned by a person outside the vehicle.

The navigation device 50 includes, for example, a GNSS (Global Navigation Satellite System) receiver 51, a navigation HMI 52, and a routing unit 53, and the first map information 54 is stored in a storage device such as an HDD (Hard Disk Drive) or a flash memory. Holds. The GNSS receiver 51 identifies the position of the own vehicle M based on the signal received from the GNSS satellite. The position of the own vehicle M may be specified or complemented by an INS (Inertial Navigation System) using the output of the vehicle sensor 70. The navigation HMI 52 includes a display device, a speaker, a touch panel, keys, and the like. The navigation HMI 52 may be partially or wholly shared with the HMI 400 described later. The route determination unit 53, for example, has a route (for example, a route) from the position of the own vehicle M specified by the GNSS receiver 51 (or an arbitrary position input) to the destination input by the occupant using the navigation HMI 52. (Including information on waypoints when traveling to the destination) is determined with reference to the first map information 54. The first map information 54 is, for example, information in which a road shape is expressed by a link indicating a road and a node connected by the link. The first map information 54 may include road curvature, POI (Point Of Interest) information, and the like. The route determined by the route determination unit 53 is output to the MPU 60. Further, the navigation device 50 may perform route guidance using the navigation HMI 52 based on the route determined by the route determination unit 53. The navigation device 50 may be realized by the function of a terminal device such as a smartphone or a tablet terminal owned by the user, for example. Further, the navigation device 50 may transmit the current position and the destination to the navigation server via the communication device 20 and acquire the route returned from the navigation server.

The MPU 60 functions as, for example, a recommended lane determination unit 61, and holds the second map information 62 in a storage device such as an HDD or a flash memory. The recommended lane determination unit 61 divides the route provided by the navigation device 50 into a plurality of blocks (for example, divides the route into 100 [m] units with respect to the vehicle traveling direction), and refers to the second map information 62 for each block. Determine the recommended lane. The recommended lane determination unit 61 determines which lane to drive from the left. When a branch point, a merging point, or the like exists in the route, the recommended lane determination unit 61 determines the recommended lane so that the own vehicle M can travel on a reasonable traveling route to proceed to the branch destination.

The second map information 62 is more accurate map information than the first map information 54. The second map information 62 includes, for example, information on the center of the lane, information on the boundary of the lane, and the like. Further, the second map information 62 may include road information, traffic regulation information, address information (address / zip code), facility information, telephone number information, and the like. Road information includes information indicating the type of road such as highways, toll roads, national roads, and prefectural roads, the number of lanes on the road, the area of the emergency parking zone, the width of each lane, the slope of the road, and the position of the road (longitudinal). , Latitude, 3D coordinates including height), lane curve curvature, lane confluence and branch point positions, signs on roads, etc. are included. The second map information 62 may be updated at any time by accessing another device using the communication device 20.

The vehicle sensor 70 includes a vehicle speed sensor that detects the speed of the own vehicle M, an acceleration sensor that detects the acceleration, a yaw rate sensor that detects the angular velocity around the vertical axis, an orientation sensor that detects the direction of the own vehicle M, and the like.

The operation operator 80 may include, for example, an accelerator pedal, a brake pedal, a shift lever, a steering wheel and other controls. A sensor for detecting the amount of operation or the presence or absence of operation is attached to the operation controller 80, and the detection result is the master control unit 100, the operation support control unit 200, the automatic operation control unit 300, or the traveling driving force. It is output to any one or more of the output device 500, the brake device 510, and the steering device 520.

The vehicle interior camera 90, for example, captures an image centering on the face of an occupant (particularly, an occupant seated in the driver's seat) seated in a seat installed in the vehicle interior. The vehicle interior camera 90 is a digital camera that uses a solid-state image sensor such as a CCD or CMOS. The vehicle interior camera 90 periodically images the occupant, for example. The captured image of the vehicle interior camera 90 is output to the master control unit 100.

[Various control devices]
The vehicle system 1 includes, for example, a master control unit 100, a driving support control unit 200, and an automatic driving control unit 300 as a part of the configuration of the control system. The master control unit 100 may be integrated into either the operation support control unit 200 or the automatic operation control unit 300.

[Master control unit]
The master control unit 100 switches the degree of driving support and controls the HMI 400 related thereto. The master control unit 100 includes, for example, a switching control unit 110, an HMI control unit 120, an operator state determination unit 130, and an occupant condition monitoring unit 140. The switching control unit 110, the HMI control unit 120, the operator state determination unit 130, and the occupant state monitoring unit 140 are each realized by executing a program by a processor such as a CPU (Central Processing Unit). Further, some or all of these functional parts may be realized by hardware such as LSI (Large Scale Integration), ASIC (Application Specific Integrated Circuit), FPGA (Field-Programmable Gate Array), or software. And may be realized by the cooperation of hardware.

The switching control unit 110 switches the degree of driving support based on, for example, an operation signal input from a predetermined switch (for example, a main switch and an auto switch described later) included in the HMI 400. Further, even if the switching control unit 110 cancels the driving support and switches to manual operation based on an operation for instructing acceleration, deceleration, or steering to the driving controller 80 such as the accelerator pedal, the brake pedal, and the steering wheel, for example. good. The details of the function of the switching control unit 110 will be described later.

The switching control unit 110 may switch the degree of driving support based on the action plan generated by the action plan generation unit 323. For example, the switching control unit 110 may end the driving support at the scheduled end point of the automatic driving defined by the action plan.

The HMI control unit 120 causes the HMI 400 to output notifications and the like related to switching the degree of driving support. Further, the HMI control unit 120 may output the information regarding the determination result by one or both of the operator state determination unit 130 and the occupant condition monitoring unit 140 to the HMI 400. Further, the HMI control unit 120 may output the information received by the HMI 400 to one or both of the operation support control unit 200 and the automatic operation control unit 300. The details of the function of the HMI control unit 120 will be described later.

The operator state determination unit 130 is, for example, in a state in which the steering wheel included in the operation operator 80 is operated (specifically, when an intentional operation is actually performed, a state in which the steering wheel can be immediately operated or gripped. It is determined whether or not it is a state). The details of the function of the actuator state determination unit 130 will be described later.

The occupant condition monitoring unit 140 monitors the condition of the occupant seated at least in the driver's seat of the own vehicle M based on the captured image of the vehicle interior camera 90. For example, as one of the monitoring, the occupant condition monitoring unit 140 determines whether or not the occupant is monitoring the surroundings of the own vehicle M. The details of the function of the occupant condition monitoring unit 140 will be described later.

[Driving support control unit]
The driving support control unit 200 executes the first degree of driving support. The driving support control unit 200 executes, for example, ACC, LKAS, or other driving support control. For example, when the driving support control unit 200 executes the ACC, the driving support control unit 200 and the own vehicle M and the front running based on the information input from the camera 10, the radar device 12, and the finder 14 via the object recognition device 16. The traveling driving force output device 500 and the braking device 510 are controlled so as to travel while keeping the distance between the vehicle and the vehicle constant. That is, the driving support control unit 200 performs acceleration / deceleration control (speed control) based on the distance between the vehicle and the vehicle in front. Further, when the driving support control unit 200 executes LKAS, the driving support control unit 200 controls the steering device 520 so that the own vehicle M travels while maintaining (lane keeping) the traveling lane in which the vehicle is currently traveling. That is, the driving support control unit 200 performs steering control for maintaining the lane. The type of driving support of the first degree may include various controls other than automatic operation (second degree and third degree) that do not require an operation on the driving operator 80.

[Automatic operation control unit]
The automatic driving control unit 300 executes the second degree and the third degree of driving support. The automatic operation control unit 300 includes, for example, a first control unit 320 and a second control unit 340. The first control unit 320 and the second control unit 340 are each realized by executing a program by a processor such as a CPU. Further, a part or all of each of these functional units may be realized by hardware such as LSI, ASIC, FPGA, or may be realized by the cooperation of software and hardware.

The first control unit 320 includes, for example, an outside world recognition unit 321, a vehicle position recognition unit 322, and an action plan generation unit 323.

The outside world recognition unit 321 recognizes the positions, speeds, accelerations, and the like of peripheral vehicles based on the information input from the camera 10, the radar device 12, and the finder 14 via the object recognition device 16. The position of the peripheral vehicle may be represented by a representative point such as the center of gravity or a corner of the peripheral vehicle, or may be represented by a region represented by the outline of the peripheral vehicle. The "state" of the peripheral vehicle may include the acceleration and jerk of the peripheral vehicle, or the "behavioral state" (eg, whether or not the vehicle is changing lanes or is about to change lanes).

The outside world recognition unit 321 may recognize at least one of the above-mentioned peripheral vehicles, obstacles (for example, guardrails, utility poles, parked vehicles, people such as pedestrians), road shapes, and other objects.

The own vehicle position recognition unit 322 recognizes, for example, the lane (traveling lane) in which the own vehicle M is traveling, and the relative position and posture of the own vehicle M with respect to the traveling lane. The own vehicle position recognition unit 322 is, for example, around the own vehicle M recognized from the pattern of the road marking line (for example, the arrangement of the solid line and the broken line) obtained from the second map information 62 and the image captured by the camera 10. By comparing with the pattern of the road lane marking, the driving lane is recognized. In this recognition, the position of the own vehicle M acquired from the navigation device 50 and the processing result by the INS may be added.

Then, the own vehicle position recognition unit 322 recognizes, for example, the position and attitude of the own vehicle M with respect to the traveling lane. FIG. 2 is a diagram showing how the own vehicle position recognition unit 322 recognizes the relative position and posture of the own vehicle M with respect to the traveling lane L1. The own vehicle position recognition unit 322 is formed on, for example, a line connecting the deviation OS of the reference point (for example, the center of gravity) of the own vehicle M from the central CL of the traveling lane and the central CL of the traveling lane in the traveling direction of the own vehicle M. The angle θ is recognized as the relative position and posture of the own vehicle M with respect to the traveling lane L1. Instead of this, the own vehicle position recognition unit 322 recognizes the position of the reference point of the own vehicle M with respect to any side end of the traveling lane L1 as the relative position of the own vehicle M with respect to the traveling lane. May be good. The relative position of the own vehicle M recognized by the own vehicle position recognition unit 322 is provided to the recommended lane determination unit 61 and the action plan generation unit 323.

The action plan generation unit 323 generates an action plan for the own vehicle M to automatically drive to the destination or the like. For example, the action plan generation unit 323 sequentially executes events in the automatic driving control so as to drive in the recommended lane determined by the recommended lane determination unit 61 and to respond to the surrounding conditions of the own vehicle M. decide. The event in the automatic driving of the embodiment includes, for example, a constant-speed driving event in which the vehicle travels in the same driving lane at a constant speed, and low-speed tracking that follows the vehicle in front under the condition of a low speed (for example, 60 [km / h] or less). Event, lane change event to change the driving lane of own vehicle M, overtaking event to overtake the preceding vehicle, merging event to join vehicles at the merging point, branching event to drive own vehicle M in the desired direction at the junction of the road , There is an emergency stop event that makes the own vehicle M stop in an emergency. In addition, during the execution of these events, actions for avoidance may be planned based on the surrounding conditions of the own vehicle M (existence of surrounding vehicles and pedestrians, lane narrowing due to road construction, etc.).

The action plan generation unit 323 generates a target track on which the own vehicle M will travel in the future. The target track is expressed as an arrangement of points (track points) to be reached by the own vehicle M in order. The track point is a point to be reached by the own vehicle M for each predetermined mileage, and separately, the target speed and the target acceleration for each predetermined sampling time (for example, about 0 commas [sec]) are the target tracks. Generated as part of. Further, the track point may be a position to be reached by the own vehicle M at the sampling time for each predetermined sampling time. In this case, the information of the target velocity and the target acceleration is expressed by the interval of the orbital points.

FIG. 3 is a diagram showing how a target track is generated based on the recommended lane. As shown, the recommended lanes are set to be convenient for driving along the route to the destination. When the action plan generation unit 323 approaches a predetermined distance before the switching point of the recommended lane (may be determined according to the type of event), the action plan generation unit 323 activates a lane change event, a branch event, a merging event, and the like. If it becomes necessary to avoid an obstacle during the execution of each event, an avoidance trajectory is generated as shown in the figure.

Further, when the action plan generation unit 323 activates the lane change event, the action plan generation unit 323 generates a target trajectory for the lane change. 4 and 5 are diagrams for explaining a process when changing lanes. First, the action plan generation unit 323 is an adjacent lane adjacent to the lane (own lane) L1 in which the own vehicle M travels, and two peripheral vehicles from the peripheral vehicle traveling in the adjacent lane L2 to which the lane is changed. Select to set the lane change target position TAs between these peripheral vehicles. Hereinafter, the peripheral vehicle traveling immediately before the lane change target position TAs in the adjacent lane will be referred to as a front reference vehicle mB, and the peripheral vehicle traveling immediately after the lane change target position TAs in the adjacent lane will be referred to as a rear reference vehicle mC. .. The lane change target position TAs are relative positions based on the positional relationship between the own vehicle M and the front reference vehicle mB and the rear reference vehicle mC.

In the example of FIG. 4, the action plan generation unit 323 sets the lane change target position TAs. In the figure, mA represents a front-running vehicle, mB represents a front reference vehicle, and mC represents a rear reference vehicle. Further, the arrow d indicates the traveling (traveling) direction of the own vehicle M. In the case of the example of FIG. 4, the action plan generation unit 323 sets the lane change target position TAs between the front reference vehicle mB and the rear reference vehicle mC on the adjacent lane L2.

Next, the action plan generation unit 323 satisfies the primary condition for determining whether or not the lane change target position TAs (that is, between the front reference vehicle mB and the rear reference vehicle mC) can be changed. Is determined.

The primary condition is that, for example, there are no peripheral vehicles in the prohibited area RA provided in the adjacent lane, and the TTC of the own vehicle M and the front reference vehicle mB and the rear reference vehicle mC is larger than the threshold value, respectively. That is. It should be noted that this determination condition is an example when the lane change target position TAs is set on the side of the own vehicle M. If the primary condition is not satisfied, the action plan generation unit 323 resets the lane change target position TAs. At this time, the speed control for waiting until the timing at which the lane change target position TAs that satisfy the primary conditions can be set, or changing the lane change target position TAs and moving to the side of the lane change target position TAs is performed. It may be done.

As shown in FIG. 4, the action plan generation unit 323 projects, for example, the own vehicle M onto the adjacent lane L2 at the lane change destination, and sets a prohibited area RA having a slight margin in the front-rear direction. The prohibited area RA is set as an area extending from one end to the other end in the lateral direction of the adjacent lane L2.

When there are no peripheral vehicles in the prohibited area RA, the action plan generation unit 323 may, for example, extend the front end and the rear end of the own vehicle M to the adjacent lane L2 side of the lane change destination virtually. And assume the extension line RM. The action plan generation unit 323 calculates the collision margin time TTC (B) between the extension line FM and the front reference vehicle mB, and the collision margin time TTC (C) between the extension line RM and the rear reference vehicle mC. The collision margin time TTC (B) is a time derived by dividing the distance between the extension line FM and the front reference vehicle mB by the relative speeds of the own vehicle M and the front reference vehicle mB. The collision margin time TTC (C) is a time derived by dividing the distance between the extension line RM and the rear reference vehicle mC by the relative speeds of the own vehicle M and the rear reference vehicle mC. The trajectory generation unit 118 determines that the primary condition is satisfied when the collision margin time TTC (B) is larger than the threshold value Th (B) and the collision margin time TTC (C) is larger than the threshold value Th (C). .. The threshold values Th (B) and Th (C) may be the same value or may be different values.

When the primary condition is satisfied, the action plan generation unit 323 generates a track candidate for changing lanes. In the example of FIG. 5, the action plan generation unit 323 assumes that the front vehicle MA, the front reference vehicle mB, and the rear reference vehicle mC travel at a predetermined speed model, and the speed models of these three vehicles and themselves. Based on the speed of the vehicle M, a track candidate is generated so that the own vehicle M does not interfere with the preceding vehicle MA and is located between the front reference vehicle mB and the rear reference vehicle mC at a certain time in the future. do. For example, the action plan generation unit 323 has a spline curve or the like from the current position of the own vehicle M to the position of the forward reference vehicle mB at a certain time in the future, the center of the lane to which the lane is changed, and the end point of the lane change. The orbital points K are arranged smoothly at equal intervals or unequal intervals on this curve by smoothly connecting them using the polymorphic curve of. At this time, the action plan generation unit 323 generates a track so that at least one of the track points K is arranged in the lane change target position TAs.

In various situations, the action plan generation unit 323 generates a plurality of target trajectory candidates, and selects the optimum target trajectory that matches the route to the destination at that time.

The second control unit 340 includes, for example, a travel control unit 342. The travel control unit 342 controls the travel drive force output device 500, the brake device 510, and the steering device 520 so that the own vehicle M passes the target trajectory generated by the action plan generation unit 323 on time. do.

The HMI 400 presents various information to the occupants in the vehicle and accepts input operations by the occupants. The HMI 400 includes, for example, a part or all of various display devices, a light emitting unit, a speaker, a buzzer, a touch panel, various operation switches, keys and the like. Further, the HMI 400 may include a seatbelt device that holds the occupant in a seated state by a seatbelt. Details of the functions of the HMI 400 will be described later.

The traveling driving force output device 500 outputs a traveling driving force (torque) for the vehicle to travel to the drive wheels. The traveling driving force output device 500 includes, for example, a combination of an internal combustion engine, an electric motor, a transmission, and the like, and an ECU (Electronic Control Unit) that controls them. The ECU controls the above configuration according to the information input from the travel control unit 342 or the information input from the operation controller 80.

The brake device 510 includes, for example, a brake caliper, a cylinder that transmits hydraulic pressure to the brake caliper, an electric motor that generates hydraulic pressure in the cylinder, and a brake ECU. The brake ECU controls the electric motor according to the information input from the travel control unit 342 or the information input from the operation controller 80, so that the brake torque corresponding to the braking operation is output to each wheel. The brake device 510 may include a mechanism for transmitting the hydraulic pressure generated by the operation of the brake pedal included in the operation operator 80 to the cylinder via the master cylinder as a backup. The brake device 510 is not limited to the configuration described above, but controls the actuator according to the information input from the travel control unit 342 or the information input from the operation controller 80 to transmit the hydraulic pressure of the master cylinder to the cylinder. It may be an electronically controlled hydraulic brake device. Further, the brake device 510 may be provided with a plurality of systems of brake devices such as hydraulic and electric.

The steering device 520 includes, for example, a steering ECU and an electric motor. The electric motor, for example, exerts a force on the rack and pinion mechanism to change the direction of the steering wheel. The steering ECU drives the electric motor according to the information input from the travel control unit 342 or the information input from the operation controller 80, and changes the direction of the steering wheel.

During manual operation, the input information from the driving operator 80 is directly output to the traveling driving force output device 500, the brake device 510, and the steering device 520. Further, the input information from the driving controller 80 may be output to the traveling driving force output device 500, the braking device 510, and the steering device 520 via the automatic driving control unit 300. Each ECU of the traveling driving force output device 500, the brake device 510, and the steering device 520 performs its own operation based on the input information from the driving operator 80 and the like.

[Structure of HMI400]
Hereinafter, a configuration example of the HMI 400 of the embodiment will be described. FIG. 6 is a diagram showing an example of the HMI 400 in the own vehicle M. The HMI 400 includes, for example, a first operation unit 410, a second operation unit 420, light emitting units 430R and 430L, a third operation unit 440, a first display unit 450, and a HUD (Head Up Display). A (second display unit) 460 and a third display unit 470 are provided.

The first operation unit 410, the second operation unit 420, and the light emitting unit 430R and 430L are provided on the steering wheel 82, which is one of the operation controls 80. Further, the steering wheel 82 is provided with a grip sensor 82A. The grip sensor 82A is, for example, a capacitance sensor provided along the circumferential direction of the steering wheel 82. The grip sensor 82A detects that an object approaches or comes into contact with the area to be detected as a change in capacitance. When the capacitance is equal to or greater than the threshold value, the grip sensor 82A outputs a predetermined detection signal to the operator state determination unit 130 of the master control unit 100. This threshold is set, for example, to a value lower than the capacitance generated when the occupant is holding the steering wheel 82. Further, the gripping sensor 82A may output a detection signal indicating the capacitance to the operator state determination unit 130 regardless of whether or not it is equal to or higher than the threshold value.

The first operation unit 410 includes, for example, a main switch 412 and an auto switch 414. The main switch 412 is a switch for making driving support startable. In other words, a switch for starting the processing (internal processing) in the preparatory stage before executing the driving support, which will be described later, or a switch for making it possible to determine whether or not the driving support can be started. Is.

When the main switch 412 is operated, the own vehicle M does not immediately start the execution of the driving support, but performs the processing in the preparatory stage before the execution of the driving support. The processing in the preparatory stage is, for example, the start of the processing of object recognition (specifically, the start of operation of the Kalman filter, etc.). When the auto switch 414 is operated while the main switch 412 is operated and the driving support can be started (that is, after a certain amount of time has passed since the operation), the control for the driving support is performed. Is started. That is, the auto switch 414 is a switch for actually starting the first degree of driving support in a state where the driving support can be started.

The second operation unit 420 includes an operation switch 422 for starting to provide a call function with an image (also referred to as a videophone). The light emitting portions 430R and 430L are arranged, for example, in the spoke portions extending from the central boss portion of the steering wheel 82 toward the annular rim portion. The lighting state of the light emitting units 430R and 430L is controlled by the control of the HMI control unit 120.

The third operation unit 440 includes, for example, a rotation operation unit 442 protruding toward the front side when viewed from the occupant, and a switch operation unit 444. The rotation operation unit 442 is formed in a substantially cylindrical shape and can be rotated around an axis. The switch operation unit 444 is provided around the rotation operation unit 442 and on the top surface of the rotation operation unit 442. The third operation unit 440 includes a rotation sensor (not shown) such as an encoder that detects the rotation angle and rotation speed of the rotation operation unit 442, and a displacement sensor (not shown) that detects the displacement of the switch operation unit 444, respectively. The detected value output from the sensor is output to the master control unit 100. The detected value output to the master control unit 100 is used for operations such as arrows, selection buttons, and confirmation buttons output on the screen of the third display unit 470, and for selection and confirmation of input characters.

Further, the third operation unit 440 may be a so-called touch panel type operation unit that performs selection and confirmation operations by touching the display screen with a fingertip. Further, the third operation unit 440 is provided with a light emitting unit 446 capable of emitting light in a predetermined color.

The first display unit 450 is, for example, a display device provided near the front of the driver's seat in the instrument panel and visible to the occupant from the gap of the steering wheel 82 or through the steering wheel 82. The first display unit 450 is, for example, an LCD (Liquid Crystal Display), an organic EL (Electro Luminescence) display device, or the like. The first display unit 450 displays information necessary for driving the own vehicle M during manual driving or automatic driving, or information regarding instructions to the occupants. The information necessary for the running of the own vehicle M during manual operation is, for example, the speed of the own vehicle M, the engine speed, the remaining fuel amount, the radiator water temperature, the mileage, and other information. On the other hand, the information necessary for the running of the own vehicle M during automatic driving is, for example, information such as the future track of the own vehicle M, the degree of driving support, and instructions to the occupants.

The HUD 460 is arranged at a position higher than, for example, the first display unit 450. The HUD460 projects an image onto a predetermined imaging unit. For example, the HUD460 projects an image onto a part of the front windshield in front of the driver's seat, so that the eyes of the occupant seated in the driver's seat can see the virtual image. The display area of the image projected by the HUD 460 is smaller than the display area of the image in the first display unit 450. This is to prevent the occupant from overlooking the real object ahead of the image projected by the HUD460. In the embodiment, the front windshield of the own vehicle M may be used as the second display unit instead of the HUD460. In this case, for example, an LED (Light Emitting Diode) incorporated in the instrument panel may be made to emit light, and the light emission of the LED may be reflected by the front windshield.

The third display unit 470 is attached to, for example, the central portion of the instrument panel. The third display unit 470 is, for example, an LCD, an organic EL display device, or the like. The third display unit 470 displays, for example, an image corresponding to the navigation process executed by the navigation device 50, an image of the other party in a videophone, or the like. Further, the third display unit 470 may display a TV program, play a DVD, or display contents such as a downloaded movie.

Further, the third display unit 470 may be provided with a light emitting unit 472. FIG. 7 is a diagram illustrating one aspect of the positional relationship between the third display unit 470 and the light emitting unit 472. For example, the light emitting unit 472 is provided in a part or in the vicinity of the third display unit 470. The neighborhood is a range in which the shortest distance between the light emitting unit 472 and the third display unit 470 is, for example, several [cm] (more specifically, about 3 [cm]) or less. In the example of FIG. 7, a light emitting unit 472 extending along at least one side forming the screen shape of the third display unit 470 is attached.

FIG. 8 is a diagram illustrating another aspect of the positional relationship between the third display unit 470 and the light emitting unit 472. In the example of FIG. 8, the third display unit 470 is provided at the lower part of the visor unit 474 of the instrument panel unit at the upper part in front of the display unit 470. Further, the light emitted from the light emitting unit 472 is visible to the occupant without being blocked by the visor unit 474. By adopting this form, the visor unit 474 can suppress the irradiation of the third display unit 470 of external light such as sunlight and shield at least a part of the external light inserted into the light emitting unit 472. Therefore, the visibility of the light emission by the occupant can be improved.

The light emitting unit 472 is controlled by the HMI control unit 120 so as to emit light when the third display unit 470 is available. "Usable" means that, for example, a screen related to a telephone function with an image is displayed on the third display unit 470 by operating the second operation unit 420, or a movie or a television is displayed by operating the third operation unit 440. An image related to the program can be displayed on the third display unit 470.

FIG. 9 is a diagram for explaining that a part of the screen of the third display unit 470 is used to notify that the third display unit 470 is available. The HMI control unit 120 allocates the first display area 476 and the second display area 478 to the entire screen area of the third display unit 470. The first display area 476 is a pixel area extending along any side of the entire screen of the third display unit 470. The HMI control unit 120 turns on or blinks the first display area 476 in one or both of a predetermined color or a predetermined shape when the third display unit 470 becomes available. As a result, it is possible to notify the occupant that the third display unit 470 can be used without providing the light emitting unit 472.

Further, the HMI control unit 120 displays in the second display area 478 the contents operated by the second operation unit 420 or the third operation unit 440, or the contents executed by the operation.

[Display control of HMI400 related to automatic driving]
Next, the display control of the HMI 400 related to the automatic operation will be described. The layout of the display screen shown below is just an example and can be changed arbitrarily. Layout refers to placement, color, scale, and more.

FIG. 10 is a diagram showing various scenes from the manual driving to the automatic driving of the own vehicle M until the lane change by the automatic driving is executed. In the example of FIG. 10, the scene (1) is a scene in which the own vehicle M enters the highway from the general road by manual driving. The scene (2) is a scene in which the own vehicle M switches from manual driving to automatic driving. The scene (3) is a scene in which the own vehicle M executes a lane change by automatic driving. The display control corresponding to each of the scenes (1) to (3) will be described below.

<Scene (1)>
The scene (1) is, for example, a scene before entering the highway. In this scene, since the main switch 412 and the auto switch 414 of the first operation unit 410 are not operated, the driving support is not executed and the manual operation is performed. When manual driving is performed, the HMI control unit 120 causes the first display unit 450 to display information necessary for the occupant in the driver's seat to manually drive the own vehicle M using the driving controller 80. Further, the HMI control unit 120 causes the HUD 460 to display a part of the information displayed on the first display unit 450. The screen in this case is shown in FIG.

FIG. 11 is a diagram showing an example of the first screen IM1-1 and the second screen IM2-1 displayed during manual operation. The first screen IM1-1 is a screen displayed by the first display unit 450, and the second screen IM2-1 is a screen projected by the HUD460 so as to be reflected in the eyes of the occupant. The HMI control unit 120 displays, for example, the remaining amount of the battery of the own vehicle M, the rotation speed, the shift position, the indoor temperature, and the mileage as information necessary for the running of the own vehicle M during manual operation on the first screen IM1-1. , Running speed, fuel level, etc. are displayed. Further, the HMI control unit 120 causes the second screen IM2-1 to display the speed information of the images displayed on the first screen IM1-1 smaller than that of the first screen IM1-1. As described above, the recognition area of the image projected by the HUD 460 to the eyes of the occupant is smaller than the display area of the image by the first display unit 450. Therefore, the HMI control unit 120 causes the first display unit 450 to display relatively detailed first information (detailed information) regarding the driving support of the own vehicle M, and the HUD460 is simpler than the detailed information. It is information, and the second information (simple information) about driving support is displayed. The simple information is, for example, information whose amount of information is smaller than that of detailed information. Further, the simple information may be information in which the type and number of items to be displayed are smaller than the type and number of items to be displayed as detailed information. Further, the simple information may be an image whose resolution is lowered, simplified or deformed with respect to the image displayed as detailed information. Further, the second information may be highly important information or highly urgent information among the first information.

For example, the HMI control unit 120 causes the HUD460 to display information extracted from a part of the detailed information as simple information. For example, in FIG. 11, the HMI control unit 120 extracts the information indicating the speed of the own vehicle M from the detailed information displayed on the first screen IM1-1, and the extracted information is the second screen IM2-1. To display. In this way, by displaying the detailed information on the first display unit 450 and displaying the simple information on the HUD460, it is possible to appropriately provide information on driving support and prevent the eyes of the occupants from getting tired. ..

<Scene (2)>
In scene (2), the own vehicle M is entering the highway. When the HMI control unit 120 receives that the main switch 412 has been operated by the occupant, the HMI control unit 120 changes the screen to be displayed on the first display unit 450 and the HUD460. The screen after the change is shown in FIG.

FIG. 12 is a diagram showing an example of the third screen IM3-1 and the fourth screen IM4-1 displayed when the main switch 412 is operated. The third screen IM3-1 is a screen displayed by the first display unit 450, and the fourth screen IM4-1 is a screen projected by the HUD460 so as to be reflected in the eyes of the occupant. The same applies to the third screen IM3-X (X is an arbitrary natural number) and the fourth screen IM4-X shown in the drawings below. The third screen IM3-X and the fourth screen IM4-Y are continuously displayed in a state in which driving support can be executed and a state in which driving support is being executed.

The third screen IM3-1 includes a peripheral detection information display area 600-1, a driving support status display area 620-1, and a driving support start operation guide area 640-1 as areas for displaying information related to driving support. ing. Hereinafter, each area on the third screen IM3-X will be referred to as a peripheral detection information display area 600-X, a driving support status display area 620-X, and a driving support start operation guide area 640-X.

The HMI control unit 120 has an image showing the road shape in front of the own vehicle M acquired from the second map information 62 in the peripheral detection information display area 600-1, and the own vehicle M recognized by the own vehicle position recognition unit 322. And an image showing the peripheral vehicle m recognized by the outside world recognition unit 321 are displayed. The HMI control unit 120 causes the first display unit 450 to display an image showing all the peripheral vehicles m recognized by the outside world recognition unit 321. Further, the HMI control unit 120 causes the first display unit 450 to display only the peripheral vehicle m that affects the future track of the own vehicle M among all the peripheral vehicle m recognized by the outside world recognition unit 321. May be good. As a result, the number of vehicles to be monitored by the occupant can be reduced, and the monitoring burden can be reduced.

Further, the HMI control unit 120 causes the driving support status display area 620-1 to display all the information indicating the candidate of the driving support (including automatic driving) status that the own vehicle M can execute. In the example of FIG. 12, an image 621 showing three indicators of "Assist", "Hands Off", and "Eyes Off" is shown as information indicating a candidate for a driving support state. For example, the degree of driving assistance is expressed by each indicator alone or by a combination of a plurality of indicators.

The indicator "Assist" indicates that the own vehicle M is executing driving support at the first degree such as ACC or LKAS, or is in a state where it can transition to the driving support at the first degree. Whether the driving support is executed in the first degree or the state in which the transition to the driving support in the first degree is possible can be grasped by the request operation notification image 622 described later.

The indicator "Hands Off" is a state in which the own vehicle M does not have to operate the driving controller 80 by the occupant, but is executing driving support to the second degree in which the occupant is obliged to monitor the surroundings. Alternatively, it indicates that it is in a state where it is possible to transition to driving support in the second degree. Whether the driving support is executed in the second degree or the state in which the transition to the driving support in the second degree is possible can be grasped by the requested operation notification image 622.

The indicator "Eyes Off" is a state in which the own vehicle M is executing driving support to a third degree in which the occupant does not have to operate the driving controller 80 and the occupant is not obliged to monitor the surroundings. , Indicates that the vehicle is in a state where it is possible to transition to driving support in the third degree. Whether the driving support is executed in the third degree or the state in which the transition to the driving support in the third degree is possible can be grasped by the requested operation notification image 622. The example of FIG. 12 shows a state in which the driving support of the own vehicle M is not executed (manual driving state).

Further, the HMI control unit 120 has a request operation notification image at a display position corresponding to an image 621 showing three indicators of "Assist", "Hands Off", and "Eyes Off" in the driving support state display area 620-1. Display 622. "Corresponding" means that the correspondence can be recognized by a person, such as having a guideline indicating horizontal arrangement, vertical arrangement, and correspondence. As an example, the "display position corresponding to the image 621" is a display position adjacent to the image 621, and is a number [cm] or less (for example, 3 [cm]) on at least one of the top, bottom, left, and right with respect to the display position of the image 621. The display position of) is shown below. The requested operation notification image 622 is, for example, an image showing a predetermined operation performed by the occupant on the driving operator 80. The requested operation notification image 622 includes, for example, an image showing the driving operator 80 and an image showing a predetermined portion of the occupant. The requested operation notification image 622 is, for example, an image schematically showing the positional relationship between the steering wheel 82 and the occupant's hand.

The HMI control unit 120 causes the driving support start operation guide area 640-1 to display information for guiding the operation of the occupant for starting the driving support. In the example of FIG. 12, in the driving support start operation guide area 640-1, it is guided that the driving support is started by the occupant operating the auto switch 414.

The HMI control unit 120 displays in the driving support start operation guide area 640-1 that the driving support is started by the occupant operating the auto switch 414, or instead, the occupant operates the auto switch 414. The voice indicating that the driving support is started may be output from the speaker included in the HMI 400 by operating.

Even if at least a part of the information displayed in each of the peripheral detection information display area 600-1, the driving support status display area 620-1, and the driving support start operation guide area 640-1 is displayed in other display areas. good. Further, information on the mileage, the temperature inside the vehicle, the fuel, the speed, and the shift position of the own vehicle M may be displayed on the third screen IM3-1.

The HMI control unit 120 causes the fourth screen IM4-1 of the HUD460 to display simple information extracted from a part of the detailed information with respect to the detailed information displayed on the third screen IM3-1. The fourth screen IM4-1 of the HUD460 has information on the road shape in front of the own vehicle M and the speed of the own vehicle M among the information on the driving support displayed on the display screen IM3-1 of the first display unit 450. Information is displayed.

When it is detected that the auto switch 414 is operated by the occupant in the state shown in FIG. 12, the master control unit 100 causes the operation support control unit 200 to execute the first degree of operation support. Further, the HMI control unit 120 changes the screen displayed on the first display unit 450 and the HUD460 to, for example, the screen shown in FIG.

FIG. 13 is a diagram showing an example of the screen IM3-2 and the screen IM4-2 displayed on the first display unit 450 and the HUD460 when the auto switch 414 is operated. The HMI control unit 120 displays an image showing the degree of driving support being executed so as to be distinguishable from other images showing the degree of driving support. For example, the HMI control unit 120 highlights the image of the indicator “Assist” in the driving support state display area 620-2 of the third screen IM3-2. As a result, the occupant can know that the first degree of driving support is being provided.

Here, the HMI control unit 120 requests, as the requested operation notification image 622, a moving image that requests the occupant to perform the operation necessary for shifting to the degree of driving support (automatic driving) corresponding to "Hands Off". It is displayed as an image 622. The moving image is, for example, an image including a dynamic object in which a predetermined object dynamically moves with the passage of time. In addition, the moving image may include an animation.

For example, the HMI control unit 120 switches to the second degree of driving support when the first degree of driving support is being executed and the second degree of driving support is feasible. As information on the operation method of the occupant, the request operation notification image 622 which schematically shows the operation contents of the occupant for keeping the occupant's hand away from the steering wheel 82 is provided with the driving support of the third screen IM3-2. It is displayed in the status display area 620-2.

FIG. 14 is a diagram showing an example of an image displayed in the driving support state display area 620-2 when the driving support of the first degree is executed. The HMI control unit 120 causes the driving support status display area 620-2 to display an image 621 showing the three indicators and a request operation notification image 622. The requested operation notification image 622 includes, for example, an image 622A showing the steering wheel 82 and images 622BL and 622BR showing the occupant's hand.

For example, the HMI control unit 120 displays an animation in which the images 622BL and 622BR showing the occupant's hands move away from the image 622A showing the steering wheel 82 in the directions of arrows A and B. Further, the HMI control unit 120 may highlight the image 622A showing the steering wheel 82 and the images 622BL and 622BR showing the occupant's hand. As a result, the occupant intuitively knows that the first degree of driving assistance is being executed because the image showing the "Assist" indicator is highlighted out of the images 621 showing the three indicators. It can be grasped, and further, it is possible to intuitively grasp that the motion of releasing the hand from the steering wheel 82 is requested by the animation of the request motion notification image 622.

Further, the HMI control unit 120 replaces or in addition to the requested operation notification image 622 of the image 622A showing the steering wheel 82 and the images 622BL and 622BR showing the occupant's hand, and additionally, the positional relationship between the accelerator pedal and the occupant's foot. An image schematically showing or an image showing the positional relationship between the brake pedal and the foot of the occupant is displayed as a request operation notification image 623 in the driving support state display area 620-2 of the third screen IM3-2. You may.

FIG. 15 is a diagram showing a display example of the requested operation notification image 623 including the accelerator pedal and the foot of the occupant. The HMI control unit 120 causes the driving support state display area 620-2 shown in FIG. 15 to display an image 621 showing the three indicators and a request operation notification image 623. The requested operation notification image 623 includes an image 623A showing the accelerator pedal and an image 623B showing the foot of the occupant. For example, the HMI control unit 120 switches to the second degree of driving support when the first degree of driving support is being executed and the second degree of driving support is feasible. Displays an animation in which the image 623B showing the foot of the occupant moves away from the image 623A showing the accelerator pedal in the direction of the arrow C. Further, the HMI control unit 120 may highlight the image 623A showing the accelerator pedal and the image 623B showing the occupant's foot. As a result, the occupant can intuitively grasp that the action of taking the foot off the accelerator pedal is required.

Further, the HMI control unit 120 may display information indicating that driving support is started by the occupant performing the operation corresponding to the requested operation notification image 622 in the peripheral detection information display area 600-2. good. In the example of FIG. 13, in the peripheral detection information display area 600-2, there is information that driving support (“automatic driving” in the figure) is started by releasing the steering wheel 82 (“steering wheel” in the figure). Is displayed.

Further, the HMI control unit 120 may turn on or blink the light emitting units 430R and 430L provided on the steering wheel 82 when requesting the occupant to take his / her hand off the steering wheel 82.

Further, when the HMI control unit 120 requests the occupant to take his / her hand off the steering wheel 82, the HMI control unit 120 may output a voice to that effect from the speaker included in the HMI 400. The HMI control unit 120 may output from various devices by combining a plurality of display of the request operation notification image 622 corresponding to the operation of releasing the hand from the steering wheel 82, lighting or blinking of the light emitting unit 430R and 430L, and voice output. ..

The HMI control unit 120 causes the fourth screen IM4-2 of the HUD460 to display the same information as the fourth screen IM4-1.

Here, the operator state determination unit 130 determines whether or not the steering wheel 82 is in a gripped state by the occupant. The operator state determination unit 130 determines, for example, whether or not the steering wheel 82 is in an operated state based on the output from the grip sensor 82A described above.

After the auto switch 414 is operated by the occupant, the switching control unit 110 is determined by the operator state determination unit 130 that the steering wheel 82 is being gripped by the occupant. Let 200 continue the first degree of driving support.

Further, the switching control unit 110 satisfies the conditions for shifting to the second degree of driving support in the state where the auto switch 414 is operated, and the steering wheel 82 is not gripped by the occupant. If it is determined by the operator state determination unit 130, the automatic operation control unit 300 is made to execute the second degree of operation support (that is, automatic operation).

Further, the HMI control unit 120 changes the screen displayed on the first display unit 450 and the HUD 460 to, for example, the screen shown in FIG. 16 when the automatic operation control unit 300 executes the second degree of driving support. ..

FIG. 16 is a diagram showing an example of a screen displayed on the first display unit 450 and the HUD 460 during the second degree of driving support. The HMI control unit 120 highlights and displays an image of “Hands Off” corresponding to the second degree of driving support in the driving support status display area 620-3 of the third screen IM3-3. As a result, the occupant can know that the second degree of driving support is being provided.

Further, the HMI control unit 120 is recognized in the peripheral detection information display area 600-3 by, for example, an image showing the road shape in front of the own vehicle M acquired from the second map information 62 and the own vehicle position recognition unit 322. An image showing the own vehicle M, an image showing the peripheral vehicle m acquired by the outside world recognition unit 321 and a future track image 602 showing the future track of the own vehicle M generated by the action plan generation unit 323 are displayed. .. Further, the HMI control unit 120 starts driving support (automatic driving in the figure) in the second degree in the peripheral detection information display area 600-3, but causes the occupant to continuously monitor the traffic conditions in the surrounding area. Display information.

The occupant condition monitoring unit 140 of the master control unit 100 monitors that the occupants are continuously monitoring the traffic conditions in the surrounding area. For example, the occupant condition monitoring unit 140 acquires a face image of an occupant sitting in the driver's seat from an image captured by the vehicle interior camera 90, and acquires a line-of-sight direction from the acquired face image. For example, the occupant condition monitoring unit 140 may acquire the line-of-sight direction of the occupant from the captured image of the vehicle interior camera 90 by deep learning using a neural network or the like. For example, a neural network trained to output the line-of-sight direction by inputting feature information such as eyes, nose, mouth, etc. obtained by analyzing an unspecified number of facial images and the position of the black eye of the eyeball is constructed in advance. I will do it. Then, the occupant condition monitoring unit 140 acquires the line-of-sight direction of the occupant by inputting the face image of the occupant of the own vehicle M into this neural network.

Further, the occupant condition monitoring unit 140 determines whether or not the occupant is monitoring the periphery of the own vehicle M depending on whether or not the occupant's line-of-sight direction is included in the range of the direction in which the occupant's line of sight can be monitored. do. The occupant condition monitoring unit 140 does not perform peripheral monitoring when the occupant's line-of-sight direction is not included in the range of the direction in which the occupant's line of sight can be monitored, or when the occupant's line-of-sight direction cannot be acquired. Is determined. If it is determined that the peripheral monitoring is not performed, the HMI control unit 120 may give a warning by voice or the like in order to have the occupant monitor the peripheral area.

Further, the occupant condition monitoring unit 140 determines that the occupant is monitoring the periphery when the line-of-sight direction of the occupant is included in the range of the direction in which the occupant's line of sight can be monitored. In this case, the automatic driving control unit 300 continues the second degree of driving support. When the driving support of the own vehicle M is being started, nothing is displayed in the driving support start operation guide area 640-3.

The HMI control unit 120 causes the fourth screen IM4-3 of the HUD460 to display a future track image 602 showing the future track of the own vehicle M in addition to the same information as the fourth screen IM4-2.

<Scene (3)>
In the scene (3), the automatic driving control unit 300 changes the lane of the own vehicle M by the second degree of driving support. In this case, the HMI control unit 120 causes one or both of the first display unit 450 and the HUD460 to display the screen corresponding to the driving support.

For example, the HMI control unit 120 displays an image showing the occurrence of a lane change event of the own vehicle M executed by the automatic driving control unit 300 at the first timing (for example, the behavior changes) before the behavior of the own vehicle M changes. 5 seconds before the operation), the display is performed in the first aspect.

FIG. 17 is a diagram showing an example of the third screen IM3-4 and the fourth screen IM4-4 displayed at the first timing before the behavior of the own vehicle M changes. The HMI control unit 120, in addition to the contents displayed in the peripheral detection information display area 600-3 in the peripheral detection information display area 600-4 of the third screen IM3-4, for example, the direction in which the own vehicle M changes lanes. An image 604 indicating that the above is displayed is displayed. In the example of FIG. 17, the image 604 in which the own vehicle M changes lanes to the right lane adjacent to the traveling lane is displayed.

The image 604 is, for example, an image containing no text. In the example of FIG. 17, the image 604 is a figure showing the course change direction of the own vehicle M along the road width direction. For example, the HMI control unit 120 attaches an outer frame to a figure indicating the course change direction of the own vehicle M, and causes the first display unit 450 to display the added outer frame image. Further, the HMI control unit 120 divides the image 604 into a plurality of regions, and assigns an outer frame to each of the divided plurality of regions to display the image 604. Further, the HMI control unit 120 may display the outer frames of each of the plurality of divided areas by an animation in which the outer frames of the plurality of divided areas are displayed in order along the course change direction of the own vehicle M.

Further, the HMI control unit 120 causes the driving support state display area 620-4 to display the winker indicator 624 indicating the course change of the own vehicle M. The winker indicator 624 is, for example, a figure such as an arrow indicating a course change direction. The HMI control unit 120 causes the winker indicator 624 to be displayed on the first display unit 450 at a timing synchronized with the first timing for displaying the image 604.

The HMI control unit 120 causes the fourth screen IM4-4 of the HUD460 to display the same information as the fourth screen IM4-3.

Further, the HMI control unit 120 emphasizes the image 604 at a timing after the first timing and before the behavior of the own vehicle M changes (for example, 2 seconds before the behavior changes). The displayed image is displayed in the peripheral detection information display area 600-4.

FIG. 18 is a diagram showing an example of the third screen IM3-5 and the fourth screen IM4-5 displayed at the second timing before the behavior of the own vehicle M changes. The HMI control unit 120 causes the peripheral detection information display area 600-5 of the third screen IM3-5 to display the image 606 in which the image 604 is highlighted. The HMI control unit 120 displays, for example, a display mode in which the inside of the outer frame of the image 604 is colored is displayed in the peripheral detection information display area 600-5. Further, the HMI control unit 120 may animate the outer frames of the plurality of regions divided in the image 604 so that they are highlighted in order along the course change direction of the own vehicle M. good. Further, the HMI control unit 120 may display the image 606 at the first timing and blink the image 606 at the second timing. Further, the HMI control unit 120 may display the image 606 at the first timing and display the image 606 at the second timing in a color that is more conspicuous than the color displayed at the first timing. This makes it possible for the occupant to intuitively grasp the direction of course change.

Further, the HMI control unit 120 changes the future orbit image 602 displayed in the peripheral detection information display area 600-5 in a direction corresponding to the course change direction at a timing synchronized with the second timing. As a result, the occupant can intuitively grasp that the change in behavior when the lane change of the own vehicle M is started.

The HMI control unit 120 causes the fourth screen IM4-5 of the HUD460 to display the same information as the fourth screen IM4-4. Further, the HMI control unit 120 changes and displays the future orbit image 602 to be displayed on the fourth screen IM4-5 of the HUD460 in the direction corresponding to the course change at the timing synchronized with the second timing.

<Processing flow corresponding to scenes (1) to (3)>
FIG. 19 is a flowchart showing an example of the flow of processing executed by the HMI control unit 120 in the scenes (1) to (3). First, the HMI control unit 120 determines whether or not the operation of the main switch 412 has been accepted (step S100). When the operation of the main switch 412 is not accepted, the HMI control unit 120 displays the first screen IM1-1 on the first display unit 450 of the own vehicle M (step S102), and displays the second screen IM2- on the HUD460. 1 is displayed (step S104).

When the operation of the main switch is accepted, the HMI control unit 120 displays the third screen IM3-1 on the first display unit 450 (step S106), and displays the fourth screen IM4-1 on the HUD460. (Step S108). The details of the process of step S106 will be described later.

Next, the HMI control unit 120 notifies the occupant of an operation request for operating the auto switch (step S110). Next, the HMI control unit 120 determines whether or not the operation of the auto switch 414 has been accepted (step S112). When the operation of the auto switch 414 is accepted, the HMI control unit 120 displays an image indicating that the first degree of driving support is being executed on the third screen IM3-1 and the fourth screen IM4-1. (Step S114). Next, the HMI control unit 120 notifies the occupant of the operation request to release the steering wheel 82 (step S116).

Next, the HMI control unit 120 determines whether or not the occupant's hand has left the steering wheel 82 by the operator state determination unit 130 (step S118). When the occupant's hand is separated from the steering wheel 82, the HMI control unit 120 displays an image indicating that the third screen IM3-3 is executing the second degree of driving assistance (step S120). The details of the process of step S120 will be described later. This ends the processing of this flowchart.

Next, the details of the process of step S106 will be described. FIG. 20 is a flowchart showing an example of a process in which the HMI control unit 120 causes the first display unit 450 to display the third screen IM3-1. In the example of FIG. 20, the HMI control unit 120 causes the peripheral detection information display area 600-1 to display an image showing the road shape in front of the vehicle, an image showing the vehicle, and an image showing the peripheral vehicle (step). S200). Next, the HMI control unit 120 causes the driving support state display area 620-1 to display an image showing the degree of driving support and an image related to the operation required of the occupant (step S202). Next, the HMI control unit 120 causes the driving support start operation guide area 640-1 to display information for guiding the operation of the occupant for starting the driving support (step S204). This ends the processing of this flowchart.

Next, in the process of step S120, the display control process when an event that changes the behavior of the own vehicle M occurs while the image indicating that the second degree of driving support is being executed is displayed. Will be explained. FIG. 21 is a flowchart showing an example of display control processing when an event that changes the behavior of the own vehicle M occurs. The process of FIG. 21 is repeatedly executed during the execution of the second degree or the third degree of driving support. Execution operation execution In FIG. 21, the automatic operation control unit 300 determines whether or not an event that changes the behavior of the own vehicle M occurs due to the automatic operation (step S300). When an event that changes the behavior of the own vehicle M occurs, the HMI control unit 120 displays an image showing the occurrence of the event that accompanies the change in the behavior of the own vehicle M in the first image before the behavior of the own vehicle M occurs. It is displayed at the timing (step S302).

Next, the HMI control unit 120 determines whether or not the second timing before the change in the behavior of the own vehicle M has been reached (step S304). If the second timing before the change in the behavior of the own vehicle has not been reached, the HMI control unit 120 waits until the second timing is reached, and when the second timing is reached, the HMI control unit 120 waits until the second timing is reached. An image showing the occurrence of an event accompanied by a change in the behavior of the vehicle M is highlighted (step S306). This ends the processing of this flowchart. The process of FIG. 21 makes it easier for the occupant to grasp the timing at which the behavior of the vehicle changes.

Next, scenes (4) to (6) will be described. FIG. 22 is a diagram showing various scenes from executing driving support in the third degree to the own vehicle M and then executing driving support in the third degree to the second degree. In the example of FIG. 22, the scene (4) is a scene in which the driving support of the own vehicle M is switched from the second degree to the third degree by following the peripheral vehicle m in the traffic jam. The scene (5) is a scene in which the own vehicle M is performing low-speed follow-up running with a third degree of driving support. Low-speed follow-up travel (TJP; Traffic Jam Pilot) is a control mode that follows a vehicle in front at a predetermined speed or less. The predetermined speed is (for example, 60 [km / h] or less). The low-speed follow-up running is activated when the speed of M of the own vehicle is equal to or less than the predetermined speed and the distance between the vehicle and the preceding vehicle m is within the predetermined distance (confirmation). In low-speed follow-up driving, highly reliable automatic driving can be realized by continuing relatively easy control of following the vehicle in front on a congested road. It should be noted that the low-speed follow-up running may be triggered on the condition that the speed is equal to or lower than the predetermined speed or the vehicle is following the vehicle in front. The scene (6) is a scene in which the driving support of the own vehicle M is switched from the third degree to the second degree. The display control corresponding to each of the scenes (4) to (6) will be described below.

<Scene (4)>
In the scene (4), the automatic driving control unit 300 has not yet reached the low-speed follow-up running, and is performing acceleration control of the own vehicle M. In this case, the HMI control unit 120 displays a screen corresponding to the driving support on one or both of the first display unit 450 and the HUD460.

FIG. 23 is a diagram showing an example of the third screen IM3-6 and the fourth screen IM4-6 displayed at the time of acceleration control of the own vehicle M. In the scene shown in this figure, the conditions for invoking low-speed follow-up running have not yet been satisfied. The HMI control unit 120 causes the peripheral detection information display area 600-6 of the third screen IM3-6 to display an image 608 indicating that acceleration control is being executed. The image 608 is a figure showing the acceleration of the own vehicle M. The image 608 is displayed in front of the image showing the own vehicle M. In this case, the HMI control unit 120 displays the image 608 in a display mode with an outer frame at the first timing before the own vehicle M accelerates, and at the second timing before the own vehicle M accelerates. , The inside of the outer frame of the image may be displayed in a colored display mode. Further, the HMI control unit 120 may display an animation in which the image 608 moves in the traveling direction of the own vehicle at the time of acceleration. On the contrary, the HMI control unit 120 may display an animation in which the image 608 moves toward the own vehicle at the time of deceleration. As a result, the occupant can intuitively grasp that the acceleration control of the own vehicle M is being executed.

The HMI control unit 120 causes the fourth screen IM4-6 of the HUD460 to display the same information as the fourth screen IM4-5.

<Scene (5)>
In the scene (5), low-speed follow-up running is executed. In this case, the HMI control unit 120 displays a screen corresponding to the low-speed follow-up running on the first display unit 450 and the HUD460.

FIG. 24 is a diagram showing an example of the third screen IM3-7 and the fourth screen IM4-7 displayed during low-speed follow-up running. The HMI control unit 120 causes the peripheral detection information display area 600-7 to display the peripheral detection image 610A indicating that the third degree of driving support is being executed.

The peripheral detection image 610A is an image showing that the surroundings of the own vehicle M are being monitored by, for example, the camera 10, the radar device 12, the finder 14, the object recognition device 16, and the outside world recognition unit 321. The peripheral detection image 610A is, for example, an animation in which ripples spread from the center of the own vehicle M toward the outside.

Further, the HMI control unit 120 has an indicator "Eyes Off" indicating that the own vehicle M does not impose an obligation to monitor the surroundings of the occupant in the driving support status display area 620-7 of the third screen IM3-7. The image of the indicator "Hands OFF" indicating that the operation of the operation controller 80 is not required is highlighted. Further, the HMI control unit 120 monitors the surroundings of the own vehicle M in the driving support state display area 620-7 by the camera 10, the radar device 12, the finder 14, the object recognition device 16, and the outside world recognition unit 321. An image 626 showing that the image is displayed.

Further, the HMI control unit 120 displays a peripheral detection image indicating that the fourth screen IM4-7 of the HUD460 is provided with the same information as that of the fourth screen IM4-6, as well as a third degree of driving support. Display 610B. The peripheral detection image 610B is, for example, an animation in which ripples spread from the center of the own vehicle M toward the outside.

The HMI control unit 120 links one or both of the operation speed and the operation cycle of the peripheral detection image 610A displayed on the third screen IM3-7 and the peripheral detection image 610B displayed on the fourth screen IM4-8. .. As a result, the occupant can intuitively understand that the peripheral detection image 610A displayed on the third screen IM3-7 and the peripheral detection image 610B displayed on the fourth screen IM4-7 have the same information. can.

Further, the HMI control unit 120 displays the peripheral detection image displayed on the fourth screen IM4-7 by thinning out the display mode from the animation display mode (detailed display mode) in the peripheral detection image 610A displayed on the third screen IM3-7. It may be the display mode (simple display mode) of 610B. For example, the HMI control unit 120 defines a display mode in which one or both of the operation speed and the operation cycle of the dynamic object (annular ripple) of the peripheral detection image 610A to be displayed by the detailed display mode is slowed down as the simple display mode. do.

Further, the HMI control unit 120 may use a display mode in which the number of dynamic objects in the detailed display mode is reduced as a simple display mode.

Further, the HMI control unit 120 displays the range of the field of view of the outside world to be displayed on the peripheral detection information display area 600-7 of the third screen IM3-7 as a detailed display mode and the display on the fourth screen IM4-7 as a simple display mode. The range of the field of view of the outside world may be different. The range of the field of view of the outside world is a range determined by the direction and degree of zooming of the outside world from the occupant. For example, the size of an annular dynamic object (eg, maximum radius) corresponds to the range of the field of view of the outside world in each image.

Further, in a state where the occupant is not obliged to monitor the surroundings, the HMI control unit 120 controls to notify the occupant of the equipment that can be used. For example, it is assumed that the third display unit 470 can be used when the automatic driving control unit 300 is executing the driving support according to the third degree. In this case, as shown in FIG. 7 or 8, the HMI control unit 120 causes the light emitting unit 472 provided in a part or the vicinity of the third display unit 470 to emit light in a predetermined color.

Further, when the third display unit 470 is available, the HMI control unit 120 uses the first display area 476 of the screen display areas of the third display unit 470 as shown in FIG. It may be displayed in a predetermined color or one or both of a predetermined shape.

Further, when it is necessary to operate the third operation unit 440 in order to select the content to be displayed on the third display unit 470, the HMI control unit 120 emits light emitted from the third operation unit 440. The unit 446 is controlled to emit light in a predetermined color. For example, the HMI control unit 120 causes the light emitting unit 472 and the light emitting unit 446 to emit light in the same color. As a result, the occupant can intuitively grasp the usable equipment and the operation unit of the equipment.

For example, when the third operation unit 440 is operated while the third display unit 470 can be used, the HMI control unit 120 causes the third display unit 470 to display a screen corresponding to the operation content. Further, the HMI control unit 120 is an image of the other party who makes a call to the third display unit 470 when the operation switch 422 of the second operation unit 420 is operated while the third display unit 470 is available. Is displayed. As a result, the occupant can enjoy the call while looking at the other party displayed on the third display unit 470. That is, the occupant can use the videophone.

Further, the HMI control unit 120 associates the image captured by the vehicle interior camera 90 with the voice of the occupant acquired by the microphone (not shown) provided in the vehicle interior, and the vehicle of the other party of the call or the terminal device. Send to.

For example, the image sensor included in the vehicle interior camera 90 has sensitivity in the wavelength range of infrared light and visible light. The vehicle interior camera 90 may include a lens filter that blocks infrared light and transmits visible light in the direction of the image pickup device. The lens filter is set to a position (set position) or a position (non-set position) that blocks infrared light incident on the vehicle interior camera 90 by operating a mechanical mechanism under the control of the HMI control unit 120. Be controlled. For example, the HMI control unit 120 controls the lens filter to a set position when the image is used for a videophone, and controls the lens filter to a non-set position when the image is used for occupant monitoring. As a result, the image captured only by visible light is used for the videophone, and the image captured by visible light and infrared light is used for occupant monitoring. As a result, an image suitable for the intended use is acquired. In particular, when the image is used for a videophone, the image without a sense of discomfort is transmitted to the device of the other party.

The own vehicle M may be provided with a camera dedicated to the videophone instead of the vehicle interior camera 90. In this case, the HMI control unit 120 associates the image captured by the camera dedicated to the videophone with the voice acquired by the microphone, and transmits the image to the vehicle or the terminal device of the other party.

<Scene (6)>
In the scene (6), the automatic driving control unit 300 switches the own vehicle M from the third degree to the second degree of driving support because the preceding vehicle m following the low speed does not exist. In this case, as shown in FIG. 25, the HMI control unit 120 displays information requesting the occupant to suggest the occupant's monitoring target or operation target, based on the change in the degree of driving assistance, to the first display unit 450 or the occupant. Display on one or both of the HUD460.

FIG. 25 is a diagram showing an example of the third screen IM3-8 and the fourth screen IM4-8 displayed for requesting the occupant to monitor the surroundings. The HMI control unit 120 has information in the peripheral detection information display area 600-8 that low-speed follow-up driving (“traffic jam follow-up automatic driving” in the figure) is completed and information indicating that the occupant is to confirm the traffic conditions in the surrounding area. And are displayed.

Further, the HMI control unit 120 causes the fourth screen IM4-8 to display a forward gaze request image 650 that requires the occupant to gaze at the front of the own vehicle M. The forward gaze request image 650 is an image including an elliptical region showing a predetermined region in front of the own vehicle M. Further, the forward gaze request image 650 may have a predetermined shape such as a circular shape or a rectangular shape, or may be information such as a mark or a symbol character that calls attention to the occupant. Further, the HMI control unit 120 lights or blinks the forward gaze request image 650 in a predetermined color. Further, the HMI control unit 120 may urge the occupant to look forward by emitting the LED incorporated in the instrument panel and reflecting the LED emission by the front windshield.

The occupant condition monitoring unit 140 determines whether or not the occupant is monitoring the surroundings based on the captured image of the vehicle interior camera 90. When it is determined that the occupant is monitoring the surroundings, the switching control unit 110 causes the automatic driving control unit 300 to switch the driving support of the own vehicle M from the third degree to the second degree. As shown in FIG. 26, the HMI control unit 120 causes one or both of the first display unit 450 and the HUD460 to display a screen corresponding to the driving support according to the second degree.

FIG. 26 is a diagram showing an example of the third screen IM3-9 and the fourth screen IM4-9 when the third degree is switched to the second degree. In the example of FIG. 26, an example is shown in which the own vehicle M accelerates to a target speed (for example, 80 [km / h]) determined by the action plan generation unit 323 by the second degree of driving support. The HMI control unit 120 displays, for example, an image 608 indicating that acceleration control is being executed in the peripheral detection information display area 600-9 of the third screen IM3-9.

Further, the HMI control unit 120 highlights and displays the image of "Hands OFF" corresponding to the second degree of driving support of the own vehicle M in the driving support state display area 620-9 of the third screen IM3-9. .. Further, the HMI control unit 120 causes the driving support status display area 620-9 to display a requested operation notification image 622 showing the operation contents of the occupant corresponding to the second degree of driving support. As a result, the occupant can intuitively grasp that the driving support of the own vehicle M has been switched from the third degree to the second degree.

<Processing flow corresponding to scenes (4) to (6)>
FIG. 27 is a flowchart showing an example of the flow of processing executed by the HMI control unit 120 in the scenes (4) to (6). First, the HMI control unit 120 determines whether or not the automatic driving control unit 300 has started low-speed follow-up running (step S400). When the low-speed follow-up running is started, the HMI control unit 120 displays an image indicating that the third degree of driving support is being executed on the third screen IM3 and the fourth screen IM4 (step S402). Next, the HMI control unit 120 causes the light emitting unit provided in the device that can be used by the operation support of the third degree to emit light (step S404).

Next, the HMI control unit 120 determines whether or not the automatic driving control unit 300 ends the low-speed follow-up running of the own vehicle M (step S406). If the low-speed follow-up running is not completed, the image display and the light emission of the light emitting unit by the processing of steps S402 and S404 are continued. That is, in the process of S404, the HMI control unit 120 continues the light emission of the light emitting unit provided in the device while the device can be used.

Further, when the low-speed follow-up running is terminated, the HMI control unit 120 displays information for causing the occupant to perform peripheral monitoring on the third screen IM3 and the fourth screen IM4 (step S408). Next, the HMI control unit 120 displays an image indicating that the second degree of driving support is being executed (step S410). This ends the processing of this flowchart.

Further, as in the scenes (4) to (6), when the vehicle is not stopped or the degree of driving support is not the third degree, the HMI control unit 120 is used so that the line of sight of the occupant is the vehicle. Restrict the use of specific functions that deviate from the surrounding area, and lift the restrictions on the use of specific functions when the vehicle is stopped or when the degree of driving support is the third degree. The specific function includes, for example, a video telephone function, and is a function of displaying contents not related to control or running of the own vehicle M on the third display unit 470. Content that is not related to the control or running of the own vehicle M is, for example, an image stored in a DVD that is viewed by an occupant as entertainment, an image transmitted from a broadcasting station (television image), or a call partner in a videophone. It is an image or the like showing.

FIG. 28 is a flowchart showing a flow of execution processing of a specific function by the HMI control unit 120. In the processing of this flowchart, the specific function will be described as being a videophone function. The videophone function is to send and receive an image (real-time image) and voice to make a call while looking at an image showing the other party. The image of the other party is displayed on the third display unit 470. Further, the HMI control unit 120 controls the communication device 20 to establish communication with the communication device of the other party, thereby transmitting and receiving information including images and sounds, thereby realizing a video telephone function.

First, the HMI control unit 120 determines whether or not the own vehicle M is stopped based on the information acquired from the driving support control unit 200 and the automatic driving control unit 300 (step S500). When the own vehicle M is stopped, the HMI control unit 120 releases the restriction on the use of the video telephone function (step S502). As a result, the occupant can use the videophone function.

When the own vehicle M is not stopped, the HMI control unit 120 determines whether or not the own vehicle M is traveling at low speed based on the information acquired from the automatic driving control unit 300 (step S504). When the own vehicle M is traveling at low speed, the HMI control unit 120 releases the restriction on the use of the video telephone function (step S502). This allows the occupants to use the videophone.

When the own vehicle M is neither stopped nor running at low speed, the HMI control unit 120 permits the use of only voice (step S506). This ends the processing of one routine in this flowchart.

FIG. 29 is a diagram showing an example of how the image displayed on the third display unit 470 changes depending on the degree of driving support. As shown in FIG. 29 (A), for example, when the third degree of driving support is executed, the image of the other party is displayed on the third display unit 470, and the voice of the other party is output from the speaker. .. This allows the occupants to use the videophone. On the other hand, as shown in FIG. 29 (B), for example, when the third degree of driving support is changed to another degree of driving support or manual operation, the display is displayed on the third display unit 470. The video of the other party is stopped, and only the voice of the other party is output from the speaker. As a result, the occupant can monitor the vicinity of the own vehicle M.

As described above, when the driving support shifts to the third degree and the occupant of the own vehicle M does not need to monitor the surroundings (when the time T4 in FIG. 37 described later is reached). In addition, by removing the restrictions on the use of specific functions, it is possible to control specific functions more appropriately.

Next, scenes (7) to (9) will be described. FIG. 30 is a diagram showing various scenes from the switching of the own vehicle M from the second degree of driving support to the driving by manual driving. In the example of FIG. 30, the scene (7) is a scene in which the own vehicle M changes lanes to pass through the highway based on the action plan. The scene (8) is a scene in which the own vehicle M is switched to manual driving. The scene (9) is a scene in which the own vehicle M moves from the highway to the general road by manual driving. The display control corresponding to each of the scenes (7) to (9) will be described below.

<Scene (7)>
In the scene (7), the automatic driving control unit 300 executes driving support for the own vehicle M to change lanes to the left side. In this case, the HMI control unit 120 displays a screen corresponding to the driving support on one or both of the first display unit 450 and the HUD460. Regarding the display example at the start and execution of the lane change, the content of the lane change to the right lane of the own vehicle M shown in FIGS. 17 and 18 is replaced with the lane change to the left lane, and the same display is displayed. Therefore, the specific description here will be omitted.

<Scene (8)>
In the scene (8), the automatic driving control unit 300 controls the own vehicle M to switch to manual driving. In this case, the HMI control unit 120 displays an image for causing the occupant to perform the manual operation on one or both of the first display unit 450 and the HUD460.

FIG. 31 is a diagram showing an example of the third screen IM3-10 and the fourth screen IM4-10 displayed at the time of requesting switching to the manual operation. Since the exit of the expressway is approaching, the HMI control unit 120 requests the occupant to operate the steering wheel 82 in the peripheral detection information display area 600-10 of the third screen IM3-10. Is displayed. Further, the HMI control unit 120 may display, as the request operation notification image 628, an animation in which the image showing the occupant's hand approaches from the image showing the steering wheel 82.

Further, the HMI control unit 120 displays an image of "Hands OFF" corresponding to the second degree of driving support and the first degree of driving support in the driving support status display area 620-10 of the third screen IM3-10. The image of "Assist" corresponding to is highlighted.

Here, the HMI control unit 120 determines whether or not the occupant is in a state of gripping the steering wheel 82 based on the determination result of the operator state determination unit 130. When the HMI control unit 120 determines by the operator state determination unit 130 that the occupant is not gripping the steering wheel 82 even after a predetermined time has elapsed, one or both of the first display unit 450 and the HUD460. Intensifies the warning step by step and displays an image for the occupant to perform manual operation.

FIG. 32 is a diagram showing an example of the third screen IM3-11 and the fourth screen IM4-11 in which the warning for causing the occupant to execute the manual operation is strengthened. For example, the HMI control unit 120 emphasizes the driving support status display area 600-11 of the third screen IM3-11 rather than the display of the surrounding situation of the own vehicle M, and requests the occupant to monitor or operate the occupant. Display information that suggests. Specifically, the HMI control unit 120 has an image showing the road shape in front of the own vehicle M, an image showing the own vehicle M, and the own vehicle M in the driving support state display area 600-11 of the third screen IM3-11. Instead of the image showing the future trajectory of the vehicle, information indicating that the steering wheel 82 of the occupant is to be operated is superimposed and displayed.

Further, the HMI control unit 120 causes the fourth screen IM4-11 to display a request operation notification image 660 schematically showing the positional relationship between the steering wheel 82 and the occupant's hand. As the request operation notification image 660, the HMI control unit 120 may display an animation in which the image showing the occupant's hand approaches and grips the image showing the steering wheel 82. Further, the HMI control unit 120 may give a warning by voice or the like in order to make the occupant grip the steering wheel 82.

Further, the HMI control unit 120 causes the light emitting units 430R and 430L provided on the steering wheel 82 to emit light, blink, or stop the light emission in order to allow the occupant to grip the steering wheel 82. This makes it easier for the occupant to recognize what is required of the occupant as the degree of driving support changes.

Further, when the HMI control unit 120 requests the occupant to grip the steering wheel 82 while the light emitting units 430R and 430L are emitting light and blinking according to the degree of driving support of the own vehicle M, for example. , The light emitting state of the light emitting units 430R and 430L is different from the current light emitting state. For example, the HMI control unit 120 makes at least one of the light emitting, blinking, light emitting color, and light emitting luminance of the light emitting unit 430R and 430L different from the current light emitting state.

Further, the HMI control unit 120 causes the light emitting units 430R and 430L to emit light, blink, or stop light emission when the degree of driving support changes to a degree lower than the degree of current driving support. As a result, it is possible to inform the occupant that the driving support is such that it is highly necessary to grip the steering wheel 82.

Further, when the HMI control unit 120 determines by the operator state determination unit 130 that the occupant is not holding the steering wheel 82 even after the lapse of a predetermined time, the HMI control unit 120 gradually intensifies the warning and makes a voice voice to the speaker. May be output. Further, the HMI control unit 120 may operate a vibrating unit that vibrates the seat or seat belt to vibrate the seat or seat belt with a stepwise strength to give a warning.

FIG. 33 is a diagram for explaining that the seat belt is vibrated to give a warning to the occupant. In FIG. 31, for example, the seat 480 of the own vehicle M, the seat belt device 482, and the vibrating portion 484 are provided. The seatbelt device 482 is a so-called three-point seatbelt device. The seatbelt device 482 includes, for example, a seatbelt 482A, a take-up portion 482B for winding up the seatbelt 482A, an anchor 482C for fixing the seatbelt 482A at a predetermined position on the seat 480, and a tongue provided on the seat belt 482A. It is equipped with a removable buckle 482D. The vibrating unit 484 vibrates the seat belt with a predetermined period and a predetermined strength under the control of the HMI control unit 120.

The HMI control unit 120 operates the vibration unit 484 at the timing when the occupant grips the steering wheel 82. As a result, the occupant can intuitively grasp that the steering wheel 82 is grasped and the manual operation is started.

Further, when the operator state determination unit 130 determines that the occupant is not gripping the steering wheel 82 even after a predetermined time has elapsed from the display shown in FIG. 32 by the HMI control unit 120, the HMI control unit 120 Displays a screen to the effect that driving support (for example, automatic driving) is terminated, as shown in FIG. 34.

FIG. 34 is a diagram showing an example of the third screen IM3-12 and the fourth screen IM4-12 displaying the information indicating the end of the automatic operation. The HMI control unit 120 displays an image showing the road shape in front of the own vehicle M, an image showing the own vehicle M, and a future trajectory of the own vehicle M in the driving support state display area 600-12 of the third screen IM3-12. By superimposing on the image shown, information prompting the change of driving operation is displayed in order to end the automatic driving. Further, the HMI control unit 120 highlights the image of "Hands Off" in the driving support state display area 620-12 of the third screen IM3-12, but the color is different from the highlight display shown in FIG. 29. It may be highlighted by such as.

Further, the HMI control unit 120 causes the fourth screen IM4-12 to display a request operation notification image 660 schematically showing the positional relationship between the steering wheel 82 and the occupant's hand. Further, the HMI control unit 120 gives a warning by voice or the like to the third screen IM3-11 and the fourth screen IM4-12 shown in FIG. 30 in order to make the occupant grip the steering wheel 82. You may. Further, the HMI control unit 120 may turn on or blink the light emitting units 430R and 430L in order for the occupant to grip the steering wheel 82. For example, the HMI control unit 120 shortens the blinking cycle in order to strengthen the warning, or lights or blinks the light emitting units 430R and 430L in a plurality of colors.

Further, the HMI control unit 120, for example, displays the third screen IM3-12 on the first display unit 450 and operates the vibration unit 484 at the timing of displaying the fourth screen IM4-12 on the HUD460, thereby seating the seat. The belt 482A may be vibrated. In this case, the HMI control unit 120 sets the vibration unit 484 so that the vibration is stronger than the vibration of the seat belt 482A when the image is displayed on the third screen IM3-11 and the fourth screen IM4-11. May be activated. As a result, the occupant can intuitively know that the automatic driving is finished.

Further, when the operator state determination unit 130 determines that the occupant is not gripping the steering wheel 82 even after a predetermined time has elapsed from the display shown in FIG. 32 by the HMI control unit 120, the master control unit 100 Causes the automatic driving control unit 300 to execute automatic driving for urgently stopping the own vehicle M at a predetermined position (for example, a road shoulder or the nearest parking area). In this case, as shown in FIG. 35, the HMI control unit 120 causes the third screen IM3-13 to display a screen indicating that the emergency stop of the own vehicle M is executed by automatic driving.

FIG. 35 is a diagram showing an example of the third screen IM3-13 and the fourth screen IM4-13 at the time of emergency stop of the own vehicle M. The HMI control unit 120 causes the operation support status display area 600-13 of the third screen IM3-13 to display information indicating that an emergency stop is to be performed. The notification of the aspect of the third screen IM3-13 is a stronger alarm than the notification of the aspect of the third screen IM3-10 to IM3-12.

<Scene (9)>
In the scene (9), the occupant receives an instruction to grip the steering wheel 82, grips the steering wheel 82 by the end of the driving support, starts manual driving, and enters the general road from the highway. It is a scene. The switching control unit 110 switches the traveling state of the own vehicle M to a state in which the occupant manually operates the vehicle. The HMI control unit 120 causes the first display unit 450 to display the first screen IM2-1 and causes the HUD460 to display the second screen IM1-2.

<Processing flow corresponding to scenes (7) to (9)>
FIG. 36 is a flowchart showing an example of the flow of processing executed by the HMI control unit 120 in the scenes (7) to (9). In this process, as described above, the HMI control unit 120 notifies the occupant of the own vehicle M to request a predetermined action (for example, gripping the steering wheel 82) when the automatic driving is being executed, and the notification is given. As time elapses from the start, the mode of the notification is changed so that the notification is emphasized step by step, and the notification is output to the output unit. The output unit is a display unit that displays an image, a speaker that outputs sound, and the like. In this process, it is assumed that the predetermined action is to grip the steering wheel 82 as an example, but instead of (in addition), the occupant monitors the surroundings and the driving controller 80 ( For example, the accelerator pedal, the brake pedal) may be placed so that the occupant can operate the pedal.

First, the HMI control unit 120 determines whether or not to end the driving support (step S600). When the driving support is terminated, the HMI control unit 120 prompts the occupant to grip the steering wheel 82 while maintaining the image showing the track on which the own vehicle M is traveling on the first display unit 450 (for example,). The third screen IM3-10) is displayed (step S602).

Next, the HMI control unit 120 determines whether or not the occupant has gripped the steering wheel 82 within the first predetermined time based on the determination result by the operator state determination unit 130 (step S604).

When it is determined that the occupant has grasped the steering wheel within the first predetermined time, the HMI control unit 120 causes the first display unit 450 to display the first screen IM1 (step S606), and causes the HUD460 to display the second screen. The IM2 is displayed (step S608).

Further, in step S604, if it is not determined that the occupant has gripped the steering wheel within the first predetermined time, the HMI control unit 120 displays an icon on the first display unit 450 indicating the track on which the own vehicle M travels. Instead, an image (for example, third screen IM3-11) indicating that the occupant is requested to grip the steering wheel 82 is displayed (step S610).

Next, the HMI control unit 120 determines whether or not the occupant has gripped the steering wheel 82 within the second predetermined time based on the determination result by the operator state determination unit 130 (step S612). When it is determined that the occupant has grasped the steering wheel within the second predetermined time, the HMI control unit 120 causes the first display unit 450 to display the first screen IM1 (step S606), and causes the HUD460 to display the second screen. The IM2 is displayed (step S608).

In step S612, if it is not determined that the occupant has gripped the steering wheel within the second predetermined time, the HMI control unit 120 displays an image indicating that the first display unit 450 ends the driving support (for example, the first image). 3 screen IM3-12) is displayed (step S614). At this time, the HMI control unit 120 operates the vibration unit 484 that vibrates the seat belt 482A. In the embodiment, the sheet 480 may be provided with a vibrating portion that vibrates the sheet 480. In this case, if it is not determined that the occupant has gripped the steering wheel within the second predetermined time, the HMI control unit 120 may operate the vibration unit provided on the seat 480.

Next, the HMI control unit 120 determines whether or not the occupant has gripped the steering wheel 82 within a third predetermined time based on the determination result by the operator state determination unit 130 (step S616). When it is determined that the occupant has grasped the steering wheel within the third predetermined time, the HMI control unit 120 causes the first display unit 450 to display the first screen IM1 (step S606), and causes the HUD460 to display the second screen. The IM2 is displayed (step S608).

In step S616, if it is not determined that the occupant has gripped the steering wheel within the third predetermined time, the HMI control unit 120 has an image to the effect that the first display unit 450 executes an emergency stop of the own vehicle M. Is displayed (step S618). This ends the processing of this flowchart.

<Timing of switching various devices or controls related to driving support>
Here, the switching timing of various devices or controls related to the driving support of the own vehicle M will be described with reference to the drawings. FIG. 37 is a diagram for explaining various devices related to driving support or switching timing of control.

In FIG. 37, as switching related to driving support, (A) main switch 412 on / off, (B) auto switch 414 on / off, (C) manual operation mode display on / off, and (D) operation. Assist mode display on / off, (E) first degree driving support on / off, (F) steering wheel 82 gripped / not gripped, (G) second degree driving support On / off, (H) on / off of the driving support of the third degree, (I) the switching timing with respect to the lapse of the required / unnecessary time of the occupant's operation monitoring is shown.

At time T0, the own vehicle M is traveling by the manual operation of the occupant. In this case, the main switch 412 and the auto switch 414 are not operated, and the screens in the manual operation mode (first screen IM1, second screen IM2) are displayed on the first display unit 450 and HUD460. Further, at time T0, the driving support (first degree to third degree) for the own vehicle M is not implemented, and the occupant needs to hold the steering wheel 82 and monitor the surroundings.

At time T1, the occupant is executing an operation of turning on the main switch 412. In this case, the screens in the driving support mode (third screen IM3, fourth screen IM4) are displayed on the first display unit 450 and the HUD460. In the states from time T1 to T2, the running control by the driving support is not performed, and the manual driving is continued.

At time T2, an operation of turning on the auto switch 414 is executed by the occupant. In this case, the master control unit 100 causes the operation support control unit 200 to execute the first degree of operation support. In the driving support mode display, the HMI control unit 120 displays an image showing that the second degree of driving support is executed when the occupant releases his / her hand from the steering wheel 82.

At time T3, the occupant has released his hand from the steering wheel 82 while the own vehicle M is capable of providing a second degree of driving support. In this case, the switching control unit 110 causes the automatic driving control unit 300 to execute the second degree of driving support from the first degree of driving support by the driving support control unit 200.

At time T4, for example, the own vehicle M performs low-speed follow-up driving, so that driving support of a third degree is executed. In this case, it is not necessary to monitor the surroundings of the occupants.

At time T5, the third degree of driving support ends, and the second degree of driving support is switched to. Therefore, it is necessary to monitor the surroundings of the occupants. Further, at time T5, a display for switching from the second degree of driving support to manual operation is performed. In this case, the HMI control unit 120 displays information for causing the occupant to grip the steering wheel 82 in the driving support mode display.

At time T6, the occupant grips the steering wheel 82. In this case, the switching control unit 110 switches from the second degree of driving support by the automatic driving control unit 300 to the first degree of driving support by the driving support control unit 200. Further, the switching control unit 110 switches to manual operation after a predetermined time has elapsed for the operation support of the first degree.

At time T7, the own vehicle M is switched to manual operation. In this case, the main switch 412 and the auto switch 414 are switched off in accordance with the timing at which the own vehicle M is switched to manual operation.

Next, the switching control of the driving support in the embodiment will be described. FIG. 38 is a diagram for explaining switching control of driving support in the embodiment. The driving control of the own vehicle M according to the embodiment includes the driving control by the driving support of the first to third degrees and the driving control by the manual driving of the occupant. The switching control unit 110 switches the operation control according to the switching pattern shown in FIGS. 38 (a) to 38 (h) based on, for example, the traveling state of the own vehicle M and the state of the occupants.

In the switching pattern (a), the switching control unit 110 switches the driving control of the own vehicle M from the manual driving to the driving support of the first degree. In this case, the switching control unit 110 causes the operation support control unit 200 to execute the first degree of operation support.

In the switching pattern (b), the switching control unit 110 switches from the first degree of driving support to the second degree of driving support. In this case, the switching control unit 110 causes the automatic operation control unit 300 to execute the second degree of operation support.

In the switching pattern (c), the switching control unit 110 switches from the second degree of driving support to the third degree of driving support. In this case, the switching control unit 110 causes the automatic operation control unit 300 to execute the operation support of the third degree.

In the switching pattern (d), the switching control unit 110 switches from the driving support of the third degree to the driving support of the second degree. In this case, the switching control unit 110 causes the automatic operation control unit 300 to execute the second degree of operation support.

In the switching pattern (e), the switching control unit 110 switches from the second degree of driving support to the first degree of driving support. In this case, the switching control unit 110 causes the operation support control unit 200 to execute the first degree of operation support.

In the switching pattern (f), the switching control unit 110 switches from the first degree of driving support to manual operation. In this case, the switching control unit 110 executes operation control by manual operation.

In the switching pattern (g), the switching control unit 110 switches from the second degree of driving support to manual operation when a predetermined event occurs in the own vehicle M while the second degree of driving support is being executed. The predetermined event is, for example, when the value received by the automatic operation control unit 300 is different from the value in the predetermined range assumed in advance, or when the signal from another device is cut off, the signal is transmitted to the device to be controlled. This is the case when you cannot do it.

In the switching pattern (h), the switching control unit 110 causes the automatic driving control unit 300 to continue the second degree of driving support when the occupant is holding the steering wheel 82 in a specific situation. .. The specific screen is, for example, a scene in which the own vehicle M travels on a ramp (connecting road) such as an interchange or a junction. The switching control unit 110 switches the operation control of the own vehicle M in correspondence with each switching pattern.

According to the embodiment described above, the vehicle system 1 has a control unit that switches between a plurality of driving support modes including a low-speed following driving mode in which the vehicle follows a vehicle in front at a predetermined speed or less and executes driving support. , When the low-speed follow-up driving mode is executed by the control unit, it is more appropriate by providing the HMI control unit 120 that cancels the usage restriction of the specific function that the driver's line of sight deviates from the periphery of the vehicle by being used. It is possible to control the function of a predetermined device.

Although the embodiments for carrying out the present invention have been described above using the embodiments, the present invention is not limited to these embodiments, and various modifications and substitutions are made without departing from the gist of the present invention. Can be added.

1 ... Vehicle system, 10 ... Camera, 12 ... Radar device, 14 ... Finder, 16 ... Object recognition device, 20 ... Communication device, 50 ... Navigation device, 60 ... MPU, 70 ... Vehicle sensor, 80 ... Driving controller, 90 ... Vehicle interior camera, 100 ... Master control unit, 110 ... Switching control unit, 120 ... HMI control unit, 130 ... Operator status determination unit, 140 ... Crew status monitoring unit, 200 ... Driving support control unit, 300 ... Automatic driving control Unit, 320 ... 1st control unit, 340 ... 2nd control unit, 400 ... HMI, 500 ... Travel driving force output device, 510 ... Brake device, 520 ... Steering device, M ... Own vehicle

Claims (8)

A control unit that executes follow-up driving that follows the vehicle in front,
A display unit that displays images related to the videophone function,
A device control unit that does not restrict the use of the videophone function during the follow-up running.
Equipped with
The display unit has a first display area for notifying that the display unit has been released from the usage restriction by the device control unit and can be used, and a second display for displaying an image related to the video telephone function. With an area,
Vehicle control system. A control unit that executes follow-up driving that follows the vehicle in front,
A display unit that displays images related to the videophone function,
A device control unit that regulates the use of the videophone function when the follow-up running is not being executed.
Equipped with
The display unit includes a first display area for notifying that the display unit has become available, and a second display area for displaying an image related to the videophone function.
Vehicle control system. A control unit that executes a constant speed running mode that runs at a constant speed below a predetermined speed,
A display unit that displays images related to the videophone function,
A device control unit that does not restrict the use of the videophone function during execution of the constant speed running.
Equipped with
The display unit includes a first display area for notifying that the display unit has become available, and a second display area for displaying an image related to the videophone function.
Vehicle control system. Further equipped with a display unit and a speaker,
The device control unit shifts from a state in which the control unit is executing follow-up running or constant-speed running to a state in which the follow-up running or non-constant-speed running is not performed, and further, when the videophone function is used, the device control unit said. While switching the image on the display unit, the utterance output from the speaker continues.
The vehicle control system according to any one of claims 1 to 3. When the device control unit shifts from a state in which the follow-up running or the constant-speed running is not executed to a state in which the follow-up running or the constant-speed running is executed after switching the image of the display unit, the videophone Display the Noh image on the display again,
The vehicle control system according to claim 4. Further equipped with an imaging unit that captures the occupant,
The image captured by the image pickup unit is used by the videophone function and the occupant condition monitoring unit that monitors the condition of the occupant to monitor the condition of the occupant.
The vehicle control system according to any one of claims 1 to 5. In-vehicle computer
Executes follow-up driving that follows the vehicle in front,
Executes the display process to display the image related to the videophone function on the display unit,
During the follow-up running, the use of the videophone function is not restricted.
In the display process, the display unit displays a first display area for notifying that the usage restriction has been lifted and the product can be used, and a second display area for displaying an image related to the videophone function. ,
Vehicle control method. For in-vehicle computers
Execute a follow-up run that follows the vehicle in front,
Execute the display process to display the image related to the videophone function on the display unit.
During the follow-up running, the use of the videophone function is not restricted.
In the display process, the display unit displays a first display area for notifying that the usage restriction has been lifted and the product can be used, and a second display area for displaying an image related to the videophone function. ,
Vehicle control program.

Images