WO2022030269A1 - 車両用表示制御装置、車両用表示制御システム、及び車両用表示制御方法 - Google Patents

車両用表示制御装置、車両用表示制御システム、及び車両用表示制御方法 Download PDF

Info

Publication number
WO2022030269A1
WO2022030269A1 PCT/JP2021/027428 JP2021027428W WO2022030269A1 WO 2022030269 A1 WO2022030269 A1 WO 2022030269A1 JP 2021027428 W JP2021027428 W JP 2021027428W WO 2022030269 A1 WO2022030269 A1 WO 2022030269A1
Authority
WO
WIPO (PCT)
Prior art keywords
driving
display
vehicle
change
situation
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/JP2021/027428
Other languages
English (en)
French (fr)
Japanese (ja)
Inventor
祐輔 三宅
敬久 藤野
敏治 白土
しおり 間根山
一輝 和泉
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Denso Corp
Original Assignee
Denso Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Denso Corp filed Critical Denso Corp
Publication of WO2022030269A1 publication Critical patent/WO2022030269A1/ja
Priority to US18/161,869 priority Critical patent/US12533953B2/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/20—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
    • B60K35/21—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor using visual output, e.g. blinking lights or matrix displays
    • B60K35/22—Display screens
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/20—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
    • B60K35/28—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor characterised by the type of the output information, e.g. video entertainment or vehicle dynamics information; characterised by the purpose of the output information, e.g. for attracting the attention of the driver
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/20—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
    • B60K35/29—Instruments characterised by the way in which information is handled, e.g. showing information on plural displays or prioritising information according to driving conditions
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/60—Instruments characterised by their location or relative disposition in or on vehicles
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/80—Arrangements for controlling instruments
    • B60K35/81—Arrangements for controlling instruments for controlling displays
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
    • B60W40/02—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to ambient conditions
    • B60W40/04—Traffic conditions
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W50/08—Interaction between the driver and the control system
    • B60W50/14—Means for informing the driver, warning the driver or prompting a driver intervention
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W60/00—Drive control systems specially adapted for autonomous road vehicles
    • G—PHYSICS
    • G08—SIGNALLING
    • G08G—TRAFFIC CONTROL SYSTEMS
    • G08G1/00—Traffic control systems for road vehicles
    • G08G1/16—Anti-collision systems
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/16—Type of output information
    • B60K2360/172—Driving mode indication
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/18—Information management
    • B60K2360/186—Displaying information according to relevancy
    • B60K2360/1868—Displaying information according to relevancy according to driving situations

Definitions

  • the present disclosure relates to a vehicle display control device, a vehicle display control system, and a vehicle display control method.
  • Patent Document 1 discloses a technique for starting and stopping automatic operation that automatically controls acceleration / deceleration according to a traffic jam situation.
  • automatic operation is started when a traffic jam occurs and the length of the section where the traffic jam occurs is equal to or more than a predetermined value.
  • a technique for stopping automatic operation when it is considered that the vehicle has escaped from a congested section is disclosed.
  • One purpose of this disclosure is a display control device for vehicles and a display for vehicles that enable the driver to give a more understandable notification according to the situation when the driving is changed from automatic driving during traffic congestion to driving requiring a driver. It is an object of the present invention to provide a control system and a display control method for a vehicle.
  • the vehicle display control device of the present disclosure limits the automatic driving in which the system on the vehicle side can perform all the driving tasks in the automatic driving to the conditions including at least the time of congestion.
  • a display control unit that displays a display regarding the change of driving from automatic driving during congestion to driving required by a driver, and a situation specifying unit that specifies the situation of a vehicle that is requested to switch from automatic driving during congestion to driving required by a driver.
  • the display control unit changes at least one of the display timing and contents related to the driving change according to the situation specified by the situation specifying unit.
  • the display control method for a vehicle of the present disclosure limits the automatic driving in which the system on the vehicle side can perform all the driving tasks to the conditions including at least the time of congestion. It is a display control method for a vehicle used in a vehicle capable of automatic driving at the time of congestion and driver-required driving in which the driver must also perform a driving task, and is executed by at least one processor.
  • a display control process that displays a display regarding the change of driving from automatic driving during congestion to driving required by a driver, and a display control process from automatic driving during congestion to a driver requiring a driver.
  • the situation specifying process for specifying the situation of the vehicle for which switching to driving is requested in the display control process, at least one of the display timing and contents regarding the driving change is set according to the situation specified in the situation specifying process. Let me change.
  • the display control system for a vehicle of the present disclosure limits the automatic driving in which the system on the vehicle side can perform all the driving tasks in the automatic driving to the conditions including at least the time of congestion.
  • the above-mentioned vehicle display control device that controls the display on the display.
  • the above-mentioned display control device for vehicles since the above-mentioned display control device for vehicles is included, it is possible to give a more understandable notification to the driver according to the situation when the driving is changed from the automatic driving at the time of traffic jam to the driving required by the driver.
  • the vehicle system 1 shown in FIG. 1 is used in a vehicle capable of automatic driving (hereinafter referred to as an automatic driving vehicle).
  • the vehicle system 1 includes an HCU (Human Machine Interface Control Unit) 10, a communication module 20, a locator 30, a map database (hereinafter, map DB) 40, a vehicle status sensor 50, and a peripheral monitoring sensor 60.
  • HCU Human Machine Interface Control Unit
  • map DB map database
  • vehicle status sensor 50 a vehicle status sensor 50
  • peripheral monitoring sensor 60 a vehicle status sensor
  • This vehicle system 1 corresponds to a vehicle display control system.
  • the vehicle using the vehicle system 1 is not necessarily limited to an automobile, but the case where the system 1 is used for an automobile will be described below as an example.
  • the automation level As the degree of automatic driving of an autonomous vehicle (hereinafter referred to as the automation level), there may be a plurality of levels as defined by SAE, for example.
  • the automation level is divided into levels 0 to 5 as follows, for example.
  • Level 0 is the level at which the driver performs all driving tasks without the intervention of the system.
  • the driving task may be paraphrased as a dynamic driving task.
  • Driving tasks are, for example, steering, acceleration / deceleration, and peripheral monitoring.
  • Level 0 corresponds to so-called manual operation.
  • Level 1 is the level at which the system supports either steering or acceleration / deceleration.
  • Level 1 corresponds to so-called driving support.
  • Level 2 is the level at which the system supports both steering and acceleration / deceleration. Level 2 corresponds to so-called partial operation automation. Levels 1 and 2 shall also be part of autonomous driving.
  • level 1 and 2 automatic driving is automatic driving in which the driver has a monitoring obligation related to safe driving (hereinafter, simply monitoring obligation). Obligation to monitor is to visually monitor the surrounding area.
  • Levels 1 and 2 automatic driving can be rephrased as automatic driving in which the second task is not permitted.
  • the second task is an act other than driving permitted to the driver, and is a predetermined specific act.
  • the second task can also be rephrased as a secondary activity, another activity, and the like.
  • the second task must not prevent the driver from responding to the request to take over the driving operation from the autonomous driving system. As an example, viewing of contents such as videos, operation of smartphones, reading, eating, etc. are assumed as second tasks.
  • Level 3 is a level at which the system can perform all driving tasks in a specific place such as a highway, and the driver performs driving operations in an emergency. At level 3, the driver is required to be able to respond promptly when there is a request for a driver change from the system. Level 3 corresponds to so-called conditional operation automation. Level 4 is a level at which the system can perform all driving tasks except under specific circumstances such as unresponsive roads and extreme environments. Level 4 corresponds to so-called advanced driving automation. Level 5 is the level at which the system can perform all driving tasks in any environment. Level 5 corresponds to so-called complete operation automation.
  • level 3 to 5 automatic driving is automatic driving where the driver is not obliged to monitor.
  • Levels 3 to 5 autonomous driving can be rephrased as autonomous driving in which a second task is permitted.
  • the presence or absence of monitoring obligation is switched by switching between the automation level of level 3 or higher and the automation level of level 2 or lower. Therefore, when switching from an automation level of level 3 or higher to an automation level of level 2 or lower, the driver is required to monitor the safe driving.
  • the configuration required when switching from the automation level of level 2 or higher to the automation level of level 1 or lower may be used. In the present embodiment, a case where a driver is required to change driving when switching from an automation level of level 3 or higher to an automation level of level 2 or lower will be described as an example.
  • the automation level of the autonomous driving vehicle of this embodiment can be switched.
  • the automation level may be configured to be switchable only between some of the levels 0 to 5.
  • the case where the autonomous driving vehicle can switch between the automatic driving of the automation level 3 and the automatic driving or the manual driving of the automation level 2 or less will be described as an example.
  • the automatic operation of the automation level 3 is permitted only in the case of a traffic jam.
  • the automatic driving of the automation level 3 may be permitted only when the vehicle is congested and when the vehicle is traveling on a specific road section such as an expressway or a motorway.
  • the automatic driving of the automation level 3 will be described by taking as an example the case where the automatic driving is permitted only when the vehicle is congested and when driving on a specific road section such as a highway or a motorway.
  • Such automatic driving of automation level 3 which is permitted only in the time of traffic jam is hereinafter referred to as automatic driving in traffic jam.
  • automatic operation and manual operation of automation level 2 or lower are hereinafter referred to as driver-required operation.
  • the communication module 20 transmits / receives information to / from another vehicle via wireless communication. That is, vehicle-to-vehicle communication is performed.
  • the communication module 20 may transmit and receive information via wireless communication with the roadside unit installed on the roadside. That is, road-to-vehicle communication may be performed.
  • the communication module 20 may receive information on the peripheral vehicle transmitted from the peripheral vehicle of the own vehicle via the roadside unit.
  • the communication module 20 may send and receive information to and from a center outside the own vehicle via wireless communication. That is, wide area communication may be performed.
  • the communication module 20 may receive information on the peripheral vehicle transmitted from the peripheral vehicle of the own vehicle via the center.
  • the communication module 20 may receive traffic congestion information, weather information, and the like around the own vehicle from the center.
  • the locator 30 is equipped with a GNSS (Global Navigation Satellite System) receiver and an inertial sensor.
  • the GNSS receiver receives positioning signals from a plurality of positioning satellites.
  • the inertial sensor includes, for example, a gyro sensor and an acceleration sensor.
  • the locator 30 sequentially positions the vehicle position of the own vehicle (hereinafter referred to as the own vehicle position) on which the locator 30 is mounted by combining the positioning signal received by the GNSS receiver and the measurement result of the inertial sensor.
  • the position of the own vehicle shall be represented by, for example, the coordinates of latitude and longitude.
  • the mileage obtained from the signals sequentially output from the vehicle speed sensor mounted on the vehicle may also be used.
  • the map DB 40 is a non-volatile memory and stores high-precision map data.
  • the high-precision map data is map data with higher accuracy than the map data used for route guidance in the navigation function.
  • the map DB 40 may also store map data used for route guidance.
  • the high-precision map data includes information that can be used for automatic driving, such as three-dimensional shape information of a road, information on the number of lanes, and information indicating an allowable traveling direction for each lane.
  • the high-precision map data may include information on node points indicating the positions of both ends of the road marking such as a lane marking.
  • the locator 30 may be configured not to use a GNSS receiver by using the three-dimensional shape information of the road.
  • the locator 30 is a peripheral monitoring sensor such as a lidar (Light Detection and Ringing / Laser Imaging Detection and Ringing) or a peripheral monitoring camera that detects three-dimensional shape information of a road and a point cloud of a road shape and a feature point of a structure.
  • the position of the own vehicle may be specified by using the detection result of 60.
  • the three-dimensional shape information of the road may be generated based on the captured image by REM (Road Experience Management).
  • the communication module 20 may receive the map data distributed from the external server by, for example, wide area communication and store it in the map DB 40.
  • the map DB 40 may be used as a volatile memory, and the communication module 20 may be configured to sequentially acquire map data of an area corresponding to the position of the own vehicle.
  • the vehicle state sensor 50 is a group of sensors for detecting various states of the own vehicle.
  • the vehicle state sensor 50 includes a vehicle speed sensor that detects a vehicle speed, a steering sensor that detects a steering angle, and the like.
  • the vehicle state sensor 50 includes a steering torque sensor, an accelerator sensor, a brake sensor, and the like.
  • the steering torque sensor detects the steering torque applied to the steering wheel.
  • the accelerator sensor detects whether or not the accelerator pedal is depressed.
  • an accelerator pedal force sensor that detects the pedaling force applied to the accelerator pedal may be used.
  • an accelerator stroke sensor that detects the amount of depression of the accelerator pedal may be used.
  • an accelerator switch that outputs a signal depending on whether or not the accelerator pedal is depressed may be used.
  • the brake sensor detects whether or not the brake pedal is depressed.
  • a brake pedal force sensor that detects the pedal effort applied to the brake pedal may be used.
  • a brake stroke sensor that detects the amount of depression of the brake pedal may be used.
  • a brake switch that outputs a signal depending on whether or not the brake pedal is depressed may be used.
  • the vehicle status sensor 50 outputs the detected sensing information to the in-vehicle LAN.
  • the sensing information detected by the vehicle state sensor 50 may be output to the in-vehicle LAN via the ECU mounted on the own vehicle.
  • the peripheral monitoring sensor 60 monitors the surrounding environment of the own vehicle.
  • the peripheral monitoring sensor 60 detects obstacles around the own vehicle such as moving objects such as pedestrians and other vehicles, and stationary objects such as falling objects on the road. In addition, it detects road markings such as driving lane markings around the vehicle.
  • the peripheral monitoring sensor 60 is, for example, a peripheral monitoring camera that captures a predetermined range around the own vehicle, a millimeter wave radar that transmits an exploration wave to a predetermined range around the own vehicle, a sonar, a sensor such as LIDAR.
  • the peripheral monitoring camera sequentially outputs the captured images to be sequentially captured as sensing information to the automatic driving ECU 80.
  • Sensors that transmit exploration waves such as sonar, millimeter-wave radar, and LIDAR sequentially output scanning results based on the received signal obtained when the reflected wave reflected by an obstacle is received to the automatic operation ECU 80 as sensing information.
  • the sensing information detected by the peripheral monitoring sensor 60 may be output to the in-vehicle LAN via the automatic driving ECU 80.
  • the vehicle control ECU 70 is an electronic control device that controls the running of the own vehicle. Examples of the traveling control include acceleration / deceleration control and / or steering control.
  • the vehicle control ECU 70 includes a steering ECU that performs steering control, a power unit control ECU that performs acceleration / deceleration control, a brake ECU, and the like.
  • the vehicle control ECU 70 performs driving control by outputting control signals to each traveling control device such as an electronically controlled throttle, a brake actuator, and an EPS (Electric Power Steering) motor mounted on the own vehicle.
  • EPS Electronic Power Steering
  • the automatic operation ECU 80 includes, for example, a processor, a memory, an I / O, and a bus connecting these, and executes a process related to automatic operation by executing a control program stored in the memory.
  • the memory referred to here is a non-transitory tangible storage medium that stores programs and data that can be read by a computer non-temporarily. Further, the non-transitional substantive storage medium is realized by a semiconductor memory, a magnetic disk, or the like.
  • the automatic operation ECU 80 includes a first automatic operation ECU 81 and a second automatic operation ECU 82.
  • the following description will be made assuming that the first automatic operation ECU 81 and the second automatic operation ECU 82 each include a processor, a memory, an I / O, and a bus connecting them. It should be noted that a common processor may be configured to carry out the functions of the first automatic operation ECU 81 and the second automatic operation ECU 82 by the virtualization technology.
  • the first automatic operation ECU 81 is responsible for the above-mentioned automatic operation function of level 2 or lower. In other words, the first automatic operation ECU 81 enables automatic operation for which monitoring is obligatory.
  • the first automatic driving ECU 81 can execute at least one of vertical control and horizontal control of the own vehicle.
  • the vertical direction is a direction that coincides with the front-rear direction of the own vehicle.
  • the lateral direction is a direction that coincides with the width direction of the own vehicle.
  • the first automatic driving ECU 81 executes acceleration / deceleration control of the own vehicle as vertical control.
  • the first automatic driving ECU 81 executes steering control of the own vehicle as lateral control.
  • the first automatic operation ECU 81 includes a first environment recognition unit, an ACC control unit, an LTA control unit, and the like as functional blocks.
  • the first environment recognition unit recognizes the driving environment around the own vehicle based on the sensing information acquired from the peripheral monitoring sensor 60. As an example, the first environment recognition unit recognizes the detailed position of the own vehicle in the traveling lane from the information such as the left and right lane markings of the own vehicle's traveling lane (hereinafter, the own lane). In addition, the first environment recognition unit recognizes the position and speed of obstacles such as vehicles around the own vehicle. The first environment recognition unit recognizes the position and speed of obstacles such as vehicles in its own lane. In addition, the first environment recognition unit recognizes the position and speed of obstacles such as vehicles in the lanes around the own lane.
  • the peripheral lane may be, for example, an adjacent lane to the own lane. In addition, the peripheral lane may be a lane other than the own lane in the road section where the own vehicle is located.
  • the first environment recognition unit may have the same configuration as the second environment recognition unit described later.
  • the ACC control unit executes ACC (Adaptive Cruise Control) control that realizes constant speed running of the own vehicle at a target speed or following running of the preceding vehicle.
  • the ACC control unit may execute the ACC control using the position and speed of the vehicle around the own vehicle recognized by the first environment recognition unit.
  • the ACC control unit may execute the ACC control by causing the vehicle control ECU 70 to perform acceleration / deceleration control.
  • the LTA control unit executes LTA (Lane Tracing Assist) control for maintaining the vehicle running in the lane.
  • the LTA control unit may execute the LTA control using the detailed position of the own vehicle in the own lane recognized by the first environment recognition unit.
  • the LTA control unit may execute the LTA control by causing the vehicle control ECU 70 to perform steering control.
  • the ACC control is an example of vertical control.
  • LTA control is an example of lateral control.
  • the first automatic operation ECU 81 realizes level 2 automatic operation by executing both ACC control and LTA control.
  • the first automatic operation ECU 81 may realize level 1 automatic operation by executing either ACC control or LTA control.
  • the second automatic operation ECU 82 has the above-mentioned automatic operation function of level 3 or higher. In other words, the second automatic operation ECU 82 enables automatic operation without monitoring obligation.
  • the second automatic operation ECU 82 includes a second environment recognition unit, an action determination unit, a trajectory generation unit, and the like as functional blocks.
  • the second environment recognition unit is based on the sensing information acquired from the peripheral monitoring sensor 60, the position of the own vehicle acquired from the locator 30, the map data acquired from the map DB 40, the information of other vehicles acquired by the communication module 20, and the like. Recognize the driving environment around the car. As an example, the second environment recognition unit uses this information to generate a virtual space that reproduces the actual driving environment.
  • the second environment recognition unit determines the manual driving area (hereinafter referred to as MD area) in the driving area of the own vehicle.
  • the second environment recognition unit determines the automatic driving area (hereinafter referred to as AD area) in the traveling area of the own vehicle.
  • the second environment recognition unit determines the ST section in the AD area.
  • the second environment recognition unit determines the non-ST section in the AD area.
  • the MD area is an area where automatic driving is prohibited.
  • the MD area is an area defined by the driver to perform all of the vertical control, horizontal control, and peripheral monitoring of the own vehicle.
  • the MD area may be a general road.
  • the AD area is an area where automatic driving is permitted.
  • the AD area is an area defined in which the vehicle can substitute one or more of the vertical control, the horizontal control, and the peripheral monitoring.
  • the AD area may be a highway or a motorway.
  • the AD area is divided into a non-ST section where automatic operation of level 2 or lower is possible and an ST section where automatic operation of level 3 or higher is possible.
  • the non-ST section where the level 1 automatic operation is permitted and the non-ST section where the level 2 automatic operation is permitted are not separately classified.
  • the ST section may be, for example, a traveling section in which traffic congestion occurs (hereinafter referred to as a traffic jam section). Further, the ST section may be, for example, a traveling section in which high-precision map data is prepared.
  • the non-ST section may be a section that does not correspond to the ST section.
  • the action judgment unit determines the planned action (hereinafter referred to as future action) for the own vehicle based on the recognition result of the driving environment in the second environment recognition unit.
  • the action judgment unit judges future actions for driving the own vehicle by automatic driving.
  • the action judgment unit may determine the type of behavior that the vehicle should take in order to reach the destination as a future action. Examples of this type include going straight, turning right, turning left, and changing lanes.
  • the action judgment unit determines that the transfer of the driving control right to the driver (that is, the driving change) is necessary, the action judgment unit generates a change request and outputs it to the HCU 10.
  • a driving change there is a case where the own vehicle moves from the ST section to the non-ST section of the AD area.
  • the own vehicle moves from the ST section of the AD area to the MD area.
  • Other causes of driving changes include elimination of traffic congestion and lack of high-precision map data.
  • the shortage of high-precision map data can be predicted.
  • the action judgment unit uses the position of the own vehicle for positioning the lack of high-precision map data with the locator 30 and the high-precision map data stored in the map DB 40 to obtain the high-precision map data of the planned course of the own vehicle. You can predict the shortage. Then, when the behavior judgment unit predicts a shortage of high-precision map data, it determines that a driving change is necessary, and requests a change before the vehicle reaches the point where the shortage of high-precision map data is predicted. May be output to the HCU 10.
  • the elimination of traffic congestion may or may not be predictable. Specifically, if the communication module 20 can receive traffic jam information and information on surrounding vehicles, it is possible to predict the elimination of the traffic jam from these information.
  • the action determination unit may predict the elimination of the congestion in the planned course of the own vehicle by using the position of the own vehicle determined by the locator 30 and the congestion information received by the communication module 20.
  • the behavior prediction unit may predict the elimination of the congestion in the planned course of the own vehicle by using the number and speed of the peripheral vehicles specified from the information of the peripheral vehicles received by the communication module 20. Then, if the action judgment unit predicts that the traffic jam will be eliminated, it determines that a driving change is necessary, and outputs a change request to the HCU 10 before the vehicle reaches the point where the congestion is predicted to be eliminated. good.
  • the communication module 20 cannot receive the traffic jam information and the information of surrounding vehicles, it is assumed that the elimination of the traffic jam cannot be predicted. If the elimination of the traffic jam cannot be predicted, the elimination of the traffic jam may be determined by using the number of peripheral vehicles, the speed, etc. recognized by the second environment recognition unit using the peripheral monitoring sensor 60. Then, when the action determination unit determines that the traffic congestion is resolved, it may determine that a driving change is necessary and output a change request to the HCU 10.
  • the action judgment unit uses the position of the own vehicle determined by the locator 30 and the high-precision map data stored in the map DB 40 to end the section where the median strip of the planned course of the own vehicle exists, and to determine the number of lanes.
  • the behavior determination unit may predict changes in the road structure such as entry of the own vehicle into the construction section from the presence of a signboard or the like under construction recognized by the second environment recognition unit using the peripheral monitoring sensor 60. Then, when the behavior judgment unit predicts these changes in the road structure, it determines that a driving change is necessary, and makes a change request before the vehicle reaches the point where these changes in the road structure occur. You can output to.
  • Sudden sensor loss is a failure of the peripheral monitoring sensor 60, a failure to recognize the driving environment using the peripheral monitoring sensor 60, and the like. Sudden bad weather is heavy rain, snow, fog, etc. Sudden bad weather causes a change in driving because the accuracy of recognizing the driving environment using the peripheral monitoring sensor 60 may decrease. In addition, sudden bad weather causes a change in driving because there is a possibility that a communication problem may occur in the communication module 20. Sudden sensor loss and sudden bad weather are unpredictable.
  • the behavior judgment unit may judge a sudden sensor loss or a sudden bad weather from the recognition result of the driving environment by the second environment recognition unit. Further, when the action determination unit determines that a sudden sensor loss or a sudden bad weather condition is made, it may determine that a driving change is necessary and output a change request to the HCU 10.
  • the action judgment unit If the cause of the change can be predicted, the action judgment unit outputs the change request to the HCU 10 before the cause of the change occurs. On the other hand, if the cause of the change cannot be predicted, the action judgment unit outputs a change request to the HCU 10 after the cause of the change occurs.
  • the causes of change can be classified into the following four patterns.
  • the first pattern is the elimination of predictable congestion.
  • the second pattern is the elimination of unpredictable congestion.
  • the third pattern is a predictable cause other than the elimination of traffic congestion.
  • the fourth pattern is an unpredictable cause other than the elimination of traffic congestion.
  • the third pattern includes lack of high-precision map data and changes in road structure.
  • the fourth pattern includes sudden sensor loss and sudden bad weather. Predictable sensor lost and predictable bad weather may be included in, for example, the third pattern.
  • the four patterns from the first pattern to the fourth pattern can be grouped as shown in FIG.
  • the SU in FIG. 2 shows that the vehicle speed of the own vehicle increases after the driving change.
  • the SM in FIG. 2 shows that the vehicle speed of the own vehicle is maintained even after the driving change.
  • P in FIG. 2 indicates that the driving change is predictable. Being able to predict a driving change can be rephrased as being able to give a notification instructing a driving change (hereinafter referred to as a driving change notification) before the cause of the change occurs.
  • a driving change notification a notification instructing a driving change
  • Up in FIG. 2 indicates that the driving change is unpredictable.
  • the unpredictability of a driving change can be rephrased as the inability to notify the driving change before the cause of the change occurs.
  • the first pattern and the second pattern are classified into a group in which the vehicle speed of the own vehicle increases after the driving change. This is because in the first pattern and the second pattern, the cause of the change is the elimination of traffic congestion, and the vehicle speed increases after the change of driving.
  • the third pattern and the fourth pattern are classified into a group in which the vehicle speed of the own vehicle is maintained even after the driving change. This is because, in the third pattern and the fourth pattern, the cause of the change is other than the elimination of the traffic jam, and the traffic jam continues even after the driving change, and the vehicle speed cannot be increased.
  • the first pattern and the third pattern are classified into a group in which the operation change can be predicted.
  • the second pattern and the fourth pattern classify the driving change into an unpredictable group.
  • the track generation unit generates a driving track of the own vehicle in a section where automatic driving can be executed, based on the recognition result of the driving environment in the second environment recognition unit and the future action determined by the action judgment unit.
  • the traveling track includes, for example, a target position of the own vehicle according to the progress, a target speed at each target position, and the like.
  • the track generation unit sequentially provides the generated travel track to the vehicle control ECU 70 as a control command to be followed by the own vehicle in automatic driving.
  • the automatic driving system including the above automatic driving ECU 80 enables automatic driving of level 2 or lower and level 3 or higher in the own vehicle.
  • the automatic driving ECU 80 may be configured to switch the automation level of the automatic driving of the own vehicle as needed.
  • the automatic driving of level 3 may be switched to the automatic driving of level 2 or lower.
  • the automatic driving ECU 80 may switch from level 3 automatic driving to manual driving when the own vehicle moves from the ST section of the AD area to the MD area.
  • the display device 90 is a display device provided in the own vehicle.
  • the display 90 is provided in the vehicle interior of the own vehicle so that the display surface faces.
  • the display 90 is provided so that the display surface is located in front of the driver's seat of the own vehicle.
  • various displays such as a liquid crystal display, an organic EL display, and a head-up display (hereinafter, HUD) can be used.
  • the HCU 10 is mainly composed of a computer equipped with a processor, a volatile memory, a non-volatile memory, an I / O, and a bus connecting these, and is connected to the display 90 and the in-vehicle LAN.
  • the HCU 10 controls the display on the display 90 by executing a control program stored in the non-volatile memory.
  • This HCU 10 corresponds to a vehicle display control device. The configuration of the HCU 10 regarding the control of the display on the display 90 will be described in detail below.
  • the HCU 10 has a change request acquisition unit 101, a situation identification unit 102, an interrupt identification unit 103, an override detection unit 104, and a display control unit 105 as functional blocks for controlling the display on the display 90. Be prepared. Further, the execution of the processing of each functional block of the HCU 10 by the computer corresponds to the execution of the display control method for the vehicle. In addition, a part or all of the functions executed by the HCU 10 may be configured in terms of hardware by one or a plurality of ICs or the like. Further, a part or all of the functional blocks included in the HCU 10 may be realized by a combination of software execution by a processor and hardware members.
  • the replacement request acquisition unit 101 acquires the replacement request output from the automatic operation ECU 80.
  • the replacement request acquisition unit 101 acquires the replacement request when the replacement request is output from the automatic operation ECU 80.
  • the situation specifying unit 102 identifies the situation of the own vehicle that requires switching from automatic driving during traffic congestion to driving requiring a driver (that is, driving change).
  • the process in the situation specifying unit 102 corresponds to the situation specifying process.
  • the situation specifying unit 102 may specify the situation of the own vehicle (hereinafter, the replacement situation) that requires the driving change requested by the replacement request.
  • the first situation is a change situation in which the cause of the change corresponds to the above-mentioned first pattern.
  • the second situation is a change situation in which the cause of the change corresponds to the above-mentioned second pattern.
  • the third situation is a replacement situation in which the cause of the replacement corresponds to the above-mentioned third pattern.
  • the fourth situation is a replacement situation in which the cause of the replacement corresponds to the above-mentioned fourth pattern. That is, the first situation and the second situation correspond to a situation in which the cause of the change is the elimination of the traffic jam. On the other hand, the third situation and the fourth situation correspond to the situation where the cause of the change is not the elimination of the traffic jam.
  • the first situation and the third situation correspond to situations in which the driving change can be predicted. In other words, it is a situation where it is possible to notify the driving change before the cause of the change occurs.
  • the second situation and the fourth situation correspond to a situation in which the driving change is unpredictable. In other words, it is a situation where it is impossible to notify the driving change before the cause of the change occurs.
  • the situation specifying unit 102 may specify that it is the first situation when the behavior determination unit of the automatic driving ECU 80 predicts that the traffic jam will be eliminated.
  • the situation specifying unit 102 may specify that it is the second situation when the behavior determination unit of the automatic driving ECU 80 determines that the elimination of the traffic jam is unpredictable.
  • the situation specifying unit 102 may specify that it is the third situation when the action determination unit of the automatic driving ECU 80 predicts a cause of change other than the elimination of the traffic jam. Predictable causes of change other than the elimination of traffic congestion include the above-mentioned lack of high-precision map data and changes in road structure.
  • the situation specifying unit 102 may specify that it is the fourth situation when the behavior determination unit of the automatic driving ECU 80 determines that the cause of the change other than the elimination of the traffic jam is unpredictable.
  • the causes of unpredictable changes other than the elimination of traffic congestion include the sudden sensor loss and sudden bad weather mentioned above.
  • the interruption specifying unit 103 specifies whether or not there is an interruption of a vehicle around the own vehicle into the traveling lane of the own vehicle (that is, the own lane).
  • the interruption specifying unit 103 specifies, for example, whether or not there is an interruption of the peripheral vehicle into the own lane from the recognition result of the peripheral vehicle of the own vehicle in the driving environment recognized by the first environment recognition unit of the automatic driving ECU 80. Just do it. For example, it may be specified whether or not there is an interruption of the peripheral vehicle into the own lane based on whether or not the acceleration of the peripheral vehicle toward the own lane exceeds the threshold value.
  • the lighting of the winker lamp of the peripheral vehicle may be configured to be recognized by the first environment recognition unit by image analysis of the image captured by the peripheral surveillance camera.
  • the information on the peripheral vehicle received by the communication module 20 includes information for transmitting the interruption of the peripheral vehicle to the own lane, is there an interruption of the peripheral vehicle to the own lane using this information? You may specify whether or not.
  • the override detection unit 104 detects an override, which is an operation for the driver of the own vehicle to voluntarily acquire the control right of the own vehicle.
  • the override detection unit 104 may detect the override from the sensing information obtained from the vehicle condition sensor 50. For example, the override detection unit 104 may detect the override when the steering torque detected by the steering torque sensor exceeds the threshold value. Further, the override detection unit 104 may detect the override when the accelerator sensor detects that the accelerator pedal is depressed. In addition, the override detection unit 104 may detect the override when the brake sensor detects that the brake pedal is depressed.
  • the display control unit 105 causes the display regarding the change of driving from the automatic driving during traffic jam to the driving required by the driver when it is necessary to switch from the automatic driving during traffic jam to the driving required by the driver.
  • the process in the display control unit 105 corresponds to the display control process. Since the display control unit 105 has acquired the replacement request by the replacement request acquisition unit 101, it may determine that it is necessary to switch from the automatic operation during traffic congestion to the driver-required operation.
  • Examples of the display related to the driving change include a change instruction display, a display after the driving change, and a preceding display.
  • the change instruction display is a display as a driving change notification instructing a driving change.
  • As an example of the change instruction display there is a display of texts, icons, etc. that prompt the driver to change the driving.
  • the display after the driving change is the display after the driving change.
  • the display after the operation change is the display of the information necessary for the automatic operation and the manual operation of the automation level 2 or less after the operation change.
  • As an example of the display after the driving change there is a display such as an image showing information about the vehicle speed of the own vehicle and the surroundings of the own vehicle.
  • the preceding display is a display in which the information displayed after the driving change is displayed prior to the driving change.
  • Examples of the preceding display include a display in which the information of the change instruction display and the information of the operation change display are combined, a display in which the information of the simplified change instruction display and the information of the operation change display are combined, and the like.
  • the display control unit 105 changes at least one of the display timing and contents related to the driving change according to the situation specified by the situation specifying unit 102. More specifically, the timing of the change instruction display, the content of the change instruction display, the presence / absence of the preceding display, the content of the display after the operation change, etc. are changed.
  • the display control unit 105 changes the timing and content of the display related to the operation change depending on whether or not the situation specified by the situation specifying unit 102 is a situation in which the change instruction display is performed before the occurrence of the change cause. Is preferable.
  • the timing of the replacement instruction display and the driver's margin from the replacement instruction display to the driving change differ depending on whether or not the situation causes the replacement instruction display to be performed before the occurrence of the replacement cause.
  • the timing of the replacement instruction display can be changed or the driver's margin can be adjusted depending on whether or not the situation is such that the replacement instruction display is performed before the occurrence of the replacement cause. It is possible to change the contents of the replacement instruction display.
  • the first situation and the third situation correspond to the situation in which the replacement instruction is displayed before the occurrence of the replacement cause.
  • the display control unit 105 precedes the information to be displayed after the operation change before the operation change is completed. It is preferable to display in advance. On the other hand, it is preferable that the display control unit 105 does not perform the preceding display in the case of a situation in which the replacement instruction display is performed before the occurrence of the replacement cause. In a situation where the replacement instruction is displayed after the cause of the replacement occurs, the grace period from the display of the replacement instruction to the driving change is short. On the other hand, the preceding display makes it possible for the driver to quickly grasp the situation by displaying the information to be displayed after the driving change in advance before the driving change is completed.
  • the second situation and the fourth situation correspond to the situation in which the replacement instruction is displayed after the occurrence of the replacement cause.
  • the change instruction display is also performed together with the advance display until the operation change is completed. According to this, even when the advance display is performed, the driver can easily recognize from the change instruction display that the driving change is necessary.
  • the replacement instruction display may be displayed by simplifying the information or narrowing the display area as compared with the case where the replacement instruction display is not displayed together with the preceding display. Further, when the replacement instruction display is performed together with the preceding display, the other may be superimposed on one of the display areas, or the respective display areas may be displayed separately.
  • the display control unit 105 provides information about the surroundings of the own vehicle when the situation specified by the situation specifying unit 102 is a situation in which the cause of the change is not the elimination of the traffic jam, as compared with the case where the cause of the change is the elimination of the traffic jam. It is preferable to display after the operation change, which has a low degree of detail. Further, when the situation specified by the situation specifying unit 102 is a situation in which the cause of the change is not the elimination of the traffic jam, the display control unit 105 is more about the surroundings of the own vehicle than in the case of the situation where the cause of the change is the elimination of the traffic jam. It is preferable to display the information after the operation change, which has a low degree of detail.
  • the vehicle speed of the own vehicle will increase after the change of driving, and it will be necessary to pay more attention to the surroundings of the own vehicle. Therefore, there is a high need for more detailed information about the surroundings of the vehicle.
  • the cause of the change is not the elimination of the traffic jam
  • the traffic jam continues even after driving and the vehicle speed does not increase, so it is less necessary to pay attention to the surroundings of the vehicle. Therefore, there is less need for more detailed information about the surroundings of the vehicle.
  • the degree of detail of the information about the surroundings of the own vehicle is determined according to the need for more detailed information about the surroundings of the own vehicle after the driving change in each situation. It will be possible to change.
  • the third situation and the fourth situation correspond to the situation where the cause of the change is not the elimination of the traffic jam.
  • the first situation and the second situation correspond to the situation where the cause of the change is the elimination of the traffic jam.
  • the display control unit 105 includes driving change including information on the own lane and surrounding lanes as information on the surroundings of the own vehicle. It is preferable to have the posterior display performed.
  • the display control unit 105 uses the own lane and the own lane of the surrounding lanes as information about the surroundings of the own vehicle. It is preferable to display after the operation change including only the information.
  • the information on the own lane may be, for example, a diagram showing the division line of the own lane and the positional relationship of the surrounding vehicles in the own lane with respect to the own vehicle.
  • the information on the peripheral lane may be, for example, a diagram showing the division line of the own lane and the positional relationship of the peripheral vehicles in the peripheral lane with respect to the own vehicle.
  • the display control unit 105 displays after the driving change including information on only the own lane and the surrounding lane as information about the surroundings of the own vehicle, and the interrupt specifying unit 103 shifts to the own lane.
  • the display control unit 105 detects the override in the override detection unit 104 in a situation where the display is performed after the driving change including the information of only the own lane among the own lane and the surrounding lane as the information about the surroundings of the own vehicle. If this is the case, it is preferable to change the display after the driving change to the display after the driving change including information on the surrounding lanes in addition to the own lane.
  • the behavior of the vehicle may change suddenly, so it is highly necessary to pay attention to the surrounding lanes.
  • FIG. 4 is a diagram for explaining the timing of an event related to display control in the first situation.
  • the vertical axis of FIG. 4 shows the vehicle speed of the own vehicle.
  • the horizontal axis of FIG. 4 indicates time.
  • ADTJ in FIG. 4 shows a period of automatic operation during traffic congestion.
  • the DDR in FIG. 4 shows the period of driver-required driving.
  • the PCE in FIG. 4 shows the timing at which the elimination of the traffic jam could be predicted.
  • the TOR in FIG. 4 indicates the timing at which the change instruction display is performed.
  • the CF in FIG. 4 indicates the timing of completion of the driving change.
  • the SUT in FIG. 4 indicates the timing at which the vehicle speed of the own vehicle increases.
  • the PE in FIG. 4 indicates the period during which the congestion is predicted to be eliminated. Since the elimination of traffic congestion is a prediction, it is assumed that the congestion will be eliminated anywhere within a wide period.
  • the action judgment unit predicts the elimination of the congestion based on the information received by the communication module 20 before the congestion is resolved (see PCE in FIG. 4). Then, before the period in which the elimination of the traffic jam is predicted (see PE in FIG. 4), the change instruction display is performed by the control of the display control unit 105 (see TOR in FIG. 4). The period during which the congestion is expected to be eliminated may be predicted by the action determination unit based on the information received by the communication module 20.
  • the change instruction display in the first situation in addition to the content requesting the driving change, the display including the content indicating that the congestion is expected to be eliminated may be displayed. For example, in the area A shown in FIG.
  • a display such as "The traffic jam will disappear after XX seconds. Please prepare for driving.” May be displayed. Sc in FIG. 5 shows the display surface of the display 90.
  • the area A may be the entire display surface of the display 90, or may be a part of the display surface of the display 90.
  • the driving change is completed (see CF in Fig. 4).
  • the completion of the driving change may be determined by the HCU 10 based on the fact that, for example, the grip sensor provided on the steering wheel detects the grip of the steering wheel. It is preferable that the change instruction display is displayed until the operation change is completed.
  • the display after the operation change is started under the control of the display control unit 105 (see ACI in FIG. 4).
  • the automatic driving at the time of traffic jam is switched to the driver-required driving. It should be noted that the switching from the automatic driving during traffic congestion to the driver-required driving may be performed at the same timing as the completion of the driving change.
  • the vehicle speed can be increased, so that the vehicle speed of the own vehicle can be increased by the driving operation of the driver (see SUT in FIG. 4).
  • the vehicle speed of the own vehicle may be increased by the control of the automatic driving system side.
  • a diagram showing the positional relationship between the vehicle and the surrounding vehicles in the own lane (see OLV in FIG. 6) and a diagram showing the positional relationship between the vehicle and the surrounding vehicles in the peripheral lane (FIG. 6). 6) and may be displayed.
  • a line indicating a dividing line between the own lane and the surrounding lane may also be displayed.
  • an image showing the vehicle speed of the own vehicle (Ve in FIG. 6) may be displayed.
  • FIG. 7 is a diagram for explaining the timing of an event related to display control in the second situation.
  • the vertical axis of FIG. 7 shows the vehicle speed of the own vehicle.
  • the horizontal axis of FIG. 7 indicates time.
  • the PC of FIG. 7 shows the timing at which the congestion is cleared.
  • the FI in FIG. 7 indicates the timing at which the preceding display is performed.
  • the congestion cannot be predicted and the congestion suddenly disappears (see the PC in Fig. 7).
  • the elimination of the traffic jam itself may be performed by the action judgment unit as described above.
  • the change instruction display is performed under the control of the display control unit 105 (see TOR in FIG. 7).
  • the display including the content indicating that the traffic jam has been resolved may be displayed. For example, in the area A shown in FIG. 5, a display such as "The traffic jam has been resolved. Please prepare for driving immediately.” May be displayed.
  • the preceding display is started by the control of the display control unit 105 (see FI in FIG. 7).
  • the preceding display may be configured to start within the period estimated to be the minimum necessary from the start of the change instruction display to the completion of the operation change.
  • the preceding display may be started at the same timing as the change instruction display.
  • the preceding display in the second situation the same display as the display after the driving change in the first situation may be performed.
  • a display such as "Please prepare for operation" may be displayed on B of FIG.
  • the replacement instruction display to be performed together with the preceding display may have the same content as the case where it is not performed together with the preceding display, or may be a simplified content. Further, when the replacement instruction display is performed together with the preceding display, it is preferable to narrow the display area as compared with the case where the preceding display is not performed together so as not to interfere with the preceding display.
  • the driving change is completed (see CF in Fig. 7).
  • the display after the operation change is started under the control of the display control unit 105 (see ACI in FIG. 7).
  • the display after the operation change may be the same as the preceding display.
  • the replacement instruction display is performed together with the preceding display, the information obtained by removing the information of the replacement instruction display from the information of the preceding display may be used as the display after the driving change.
  • the automatic driving at the time of traffic jam is switched to the driver-required driving. It should be noted that the switching from the automatic driving during traffic congestion to the driver-required driving may be performed at the same timing as the completion of the driving change.
  • the vehicle speed can be increased, so that the vehicle speed of the own vehicle can be increased by the driving operation of the driver (see SUT in FIG. 7).
  • the vehicle speed of the own vehicle may be increased by the control of the automatic driving system side.
  • the display after the driving change in the second situation may be the same as the table after the driving change in the first situation. For example, it may be the same as the example of FIG.
  • FIG. 9 is a diagram for explaining the timing of an event related to display control in the third situation.
  • the vertical axis of FIG. 9 shows the vehicle speed of the own vehicle.
  • the horizontal axis of FIG. 9 indicates time.
  • the timing at which the PCC in FIG. 9 can predict the cause of the change other than the elimination of the traffic jam is shown.
  • the PC of FIG. 9 shows the timing at which a change cause other than the elimination of the traffic jam occurs.
  • the cause of the change other than the elimination of the traffic jam in the third situation is a predictable cause of the change.
  • the behavior judgment unit predicts the occurrence of a change cause other than the elimination of the traffic jam based on the high-precision map data, etc., before the change cause other than the elimination of the traffic jam occurs (Fig. 9). See PCC). Then, the replacement instruction is displayed by the control of the display control unit 105 before the timing at which the replacement cause other than the elimination of the traffic jam occurs (see TOR in FIG. 9).
  • the timing at which a change cause other than the elimination of the traffic jam may be determined by the action judgment unit based on, for example, the point where the change cause occurs and the vehicle speed of the own vehicle.
  • the display including the content indicating that the cause of the change other than the elimination of the traffic jam is predicted may be displayed.
  • a display such as "Automatic driving is not possible because of a single lane in the future. Please prepare for driving.” May be displayed.
  • the driving change is completed (see CF in Fig. 9). It is preferable that the change instruction display is displayed until the operation change is completed.
  • the display after the operation change is started under the control of the display control unit 105 (see ACI in FIG. 9).
  • the automatic driving at the time of traffic jam is switched to the driver-required driving. It should be noted that the switching from the automatic driving during traffic congestion to the driver-required driving may be performed at the same timing as the completion of the driving change. In the third situation, the traffic congestion is not eliminated even after the driving change is completed, and the vehicle speed is not increased. Therefore, the vehicle speed of the own vehicle is maintained even after the driving change.
  • the display after the driving change in the third situation it is sufficient to display the information including only the information of the own lane out of the information of the own lane and the information of the surrounding lanes.
  • the vehicle speed of the own vehicle does not increase, and it is less necessary to pay more attention to the surroundings of the own vehicle.
  • a diagram (see OLV in FIG. 10) showing the positional relationship between the vehicle and the surrounding vehicles in the vehicle lane may be displayed.
  • the diagram showing the positional relationship between the vehicle and the peripheral vehicle in the peripheral lane is not displayed.
  • an image showing the vehicle speed of the own vehicle (Ve in FIG. 10) may be displayed.
  • the interruption identification unit 103 interrupts the surrounding vehicle to the own lane.
  • the display may be changed to the display after the driving change including the information of the surrounding lane in addition to the own lane.
  • a diagram showing the positional relationship between the vehicle and the surrounding vehicles in the own lane see OLV in FIG. 11
  • a diagram showing the positional relationship between the vehicle and the surrounding vehicles in the peripheral lane FIG. 11
  • a line indicating a dividing line between the own lane and the surrounding lane may be displayed.
  • an image showing the vehicle speed of the own vehicle (Ve in FIG. 11) may be displayed.
  • FIG. 12 is a diagram for explaining the timing of an event related to display control in the fourth situation.
  • the vertical axis of FIG. 12 shows the vehicle speed of the own vehicle.
  • the horizontal axis of FIG. 12 indicates time.
  • the timing at which the PC in FIG. 12 causes a change other than the elimination of the traffic jam is shown.
  • the cause of the change other than the elimination of the traffic jam in the fourth situation is an unpredictable cause of the change.
  • the cause of the change other than the elimination of the traffic jam cannot be predicted, and the cause of the change other than the elimination of the traffic jam suddenly occurs (see the PC in FIG. 12).
  • the occurrence of a change cause other than the elimination of the traffic jam may be performed by the action judgment unit as described above.
  • the change instruction display is performed by the control of the display control unit 105 (see TOR in FIG. 12).
  • the display including the content indicating that the cause of the change other than the elimination of the traffic jam has occurred may be displayed. For example, in the area A shown in FIG. 5, a display such as "Automatic operation is stopped due to bad weather. Please prepare for operation immediately.” May be displayed.
  • the preceding display is started by the control of the display control unit 105 (see FI in FIG. 12).
  • the preceding display may be configured to start within the period estimated to be the minimum necessary from the start of the change instruction display to the completion of the operation change.
  • the preceding display may be started at the same timing as the change instruction display.
  • the same display as the display after the driving change in the third situation may be performed.
  • a display such as "Please prepare for operation" may be displayed on C of FIG.
  • the replacement instruction display to be performed together with the preceding display may have the same content as the case where it is not performed together with the preceding display, or may be a simplified content. Further, when the replacement instruction display is performed together with the preceding display, it is preferable to narrow the display area as compared with the case where the preceding display is not performed together so as not to interfere with the preceding display.
  • the driving change is completed (see CF in Fig. 12).
  • the display after the operation change is started under the control of the display control unit 105 (see ACI in FIG. 12).
  • the display after the operation change may be the same as the preceding display.
  • the replacement instruction display is performed together with the preceding display, the information obtained by removing the information of the replacement instruction display from the information of the preceding display may be used as the display after the driving change.
  • the automatic driving at the time of traffic jam is switched to the driver-required driving. It should be noted that the switching from the automatic driving during traffic congestion to the driver-required driving may be performed at the same timing as the completion of the driving change.
  • the display after the driving change in the fourth situation may be the same as the table after the driving change in the third situation. For example, it may be the same as the example of FIG.
  • the interruption identification unit 103 interrupts the surrounding vehicle to the own lane.
  • the display may be changed to the display after the driving change including the information of the surrounding lane in addition to the own lane. For example, it may be the same as the example of FIG.
  • FIG. 14 may be configured to be started when, for example, the own vehicle starts automatic driving during a traffic jam.
  • step S1 if the cause of the change is predicted (YES in S1), the process proceeds to step S2. On the other hand, if the cause of the change is not predicted (NO in S1), the process proceeds to step S3. Whether or not the cause of the change is predicted may be determined by the HCU 10 acquiring the determination result in the action determination unit of the automatic driving ECU 80.
  • step S2 the HCU 10 performs the change cause prediction processing and ends the display control-related processing.
  • the flowchart of FIG. 1 An example of the flow of processing at the time of predicting the cause of change will be described using the flowchart of FIG.
  • step S21 if the predicted cause of the change is the elimination of traffic congestion (YES in S21), the process proceeds to step S22. On the other hand, if the predicted cause of the change is other than the elimination of the traffic jam (NO in S21), the process proceeds to step S25.
  • step S22 the display control unit 105 causes the display 90 to display the same change instruction as described in the above-mentioned example of the display mode according to the first situation.
  • step S23 when the operation change is completed (YES in S23), the display control unit 105 ends the change instruction display and proceeds to step S24.
  • the process returns to S22 and the process is repeated. Whether or not the driving change is completed may be determined by whether or not the HCU 10 has detected the gripping of the steering wheel, for example, as described above.
  • step S24 the display control unit 105 causes the display 90 to display the same post-operation change display as described in the above-mentioned example of the display mode according to the first situation, and ends the display control-related processing.
  • the display is performed after the driving change, which includes only the information of the own lane out of the information of the own lane and the information of the surrounding lanes.
  • step S25 the display control unit 105 causes the display unit 90 to display the same change instruction as described in the example of the display mode according to the third situation described above.
  • step S26 when the operation change is completed (YES in S26), the display control unit 105 ends the change instruction display and proceeds to step S27. On the other hand, when the operation change is not completed (NO in S26), the process returns to S25 and the process is repeated.
  • step S27 the display control unit 105 causes the display 90 to display the same post-operation change display as described in the above-mentioned example of the display mode according to the third situation, and ends the display control-related processing. For details, display after the driving change including information on the own lane and information on the surrounding lanes.
  • step S3 when the cause of the change is determined (YES in S3), the process proceeds to step S4. On the other hand, if the cause of the change is not determined (NO in S3), the process proceeds to step S5. Whether or not the cause of the replacement has been determined may be determined by whether or not the HCU 10 has acquired the replacement request by the replacement request acquisition unit 101.
  • step S4 the HCU 10 performs a process when a change cause occurs and ends the display control-related process.
  • a change cause occurs and ends the display control-related process.
  • step S41 if the cause of the change is the elimination of traffic congestion (YES in S41), the process proceeds to step S42. On the other hand, if the cause of the change is other than the elimination of the traffic jam (NO in S41), the process proceeds to step S46.
  • step S42 the display control unit 105 causes the display 90 to display the same change instruction as described in the above-mentioned example of the display mode according to the second situation.
  • step S43 the display control unit 105 causes the display device 90 to perform the same preceding display as described in the above-mentioned example of the display mode according to the second situation.
  • the advance display including only the information of the own lane out of the information of the own lane and the information of the surrounding lane is performed. It should be noted that the display control unit 105 may be configured to also perform the alternate instruction display even when the preceding display is started.
  • step S44 when the operation change is completed (YES in S44), the display control unit 105 ends the change instruction display and the preceding display, and proceeds to step S24.
  • the preceding display may be used as the display after the driving change described later.
  • the process returns to S42 and the process is repeated.
  • step S45 the display control unit 105 causes the display 90 to perform the same post-operation change display as described in the example of the display mode according to the third situation described above, and ends the display control related processing.
  • the display is performed after the driving change, which includes only the information of the own lane out of the information of the own lane and the information of the surrounding lanes.
  • step S46 the display control unit 105 causes the display unit 90 to display the same change instruction as described in the above-mentioned example of the display mode according to the fourth situation.
  • step S47 the display control unit 105 causes the display device 90 to perform the same preceding display as described in the example of the display mode according to the fourth situation described above.
  • the advance display including the information of the own lane and the information of the surrounding lanes is performed. It should be noted that the display control unit 105 may be configured to also perform the alternate instruction display even when the preceding display is started.
  • step S48 when the operation change is completed (YES in S48), the display control unit 105 ends the change instruction display and the preceding display, and proceeds to step S49.
  • the preceding display may be used as the display after the driving change described later.
  • the process returns to S46 and the process is repeated.
  • step S49 the display control unit 105 causes the display 90 to perform the same post-operation change display as described in the example of the display mode according to the fourth situation described above, and ends the display control-related processing. For details, display after the driving change including information on the own lane and information on the surrounding lanes.
  • step S5 when it is the end timing of the display control-related process (YES in S5), the display control-related process is terminated. On the other hand, if it is not the end timing of the display control related processing (NO in S5), the process returns to S1 and the processing is repeated.
  • An example of the end timing of display control-related processing is that the power switch is turned off.
  • the interrupt identification unit 103 shifts to the own lane.
  • the display may be changed to the display after the driving change including the information of the surrounding lane in addition to the own lane.
  • ⁇ Summary of Embodiment 1> when it is necessary to switch from the automatic driving during congestion to the driver-required driving, the situation of the own vehicle that needs to switch from the automatic driving during congestion to the driver-required driving is determined. At least one of the timing and contents of the display regarding the change of driving from the automatic driving at the time of congestion to the driving required by the driver will be changed. Therefore, it is possible to display at least one of the timing and the content suitable for the situation of the vehicle that needs to switch from the automatic driving at the time of traffic jam to the driving requiring a driver. As a result, it becomes possible to give a more understandable notification to the driver according to the situation when the driving is changed from the automatic driving at the time of traffic jam to the driving required by the driver.
  • Embodiment 2 In the first embodiment, as an example of switching the degree of detail of the information about the surroundings of the own vehicle in the display after the driving change, the information of only the own lane of the own lane and the surrounding lanes is displayed or the own lane is displayed. In addition to this, the configuration for switching whether to display information on surrounding lanes is shown, but this is not always the case. For example, in the post-change driving display with a low degree of detail, information about the vicinity of the own vehicle is displayed, while in the post-change driving display with a high degree of detail, not only the vicinity of the own vehicle but also the distance from the own vehicle is displayed. Information may also be displayed.
  • control unit and the method thereof described in the present disclosure may be realized by a dedicated computer constituting a processor programmed to execute one or a plurality of functions embodied by a computer program.
  • the apparatus and method thereof described in the present disclosure may be realized by a dedicated hardware logic circuit.
  • the apparatus and method thereof described in the present disclosure may be realized by one or more dedicated computers configured by a combination of a processor for executing a computer program and one or more hardware logic circuits.
  • the computer program may be stored in a computer-readable non-transitional tangible recording medium as an instruction executed by the computer.

Landscapes

  • Engineering & Computer Science (AREA)
  • Transportation (AREA)
  • Mechanical Engineering (AREA)
  • Chemical & Material Sciences (AREA)
  • Combustion & Propulsion (AREA)
  • Automation & Control Theory (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • Mathematical Physics (AREA)
  • General Physics & Mathematics (AREA)
  • Traffic Control Systems (AREA)
  • Control Of Driving Devices And Active Controlling Of Vehicle (AREA)
PCT/JP2021/027428 2020-08-07 2021-07-22 車両用表示制御装置、車両用表示制御システム、及び車両用表示制御方法 Ceased WO2022030269A1 (ja)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US18/161,869 US12533953B2 (en) 2020-08-07 2023-01-30 Vehicle display control device, vehicle display control system, and vehicle display control method

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2020-134987 2020-08-07
JP2020134987A JP7363710B2 (ja) 2020-08-07 2020-08-07 車両用表示制御装置、車両用表示制御システム、及び車両用表示制御方法

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US18/161,869 Continuation US12533953B2 (en) 2020-08-07 2023-01-30 Vehicle display control device, vehicle display control system, and vehicle display control method

Publications (1)

Publication Number Publication Date
WO2022030269A1 true WO2022030269A1 (ja) 2022-02-10

Family

ID=80119729

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2021/027428 Ceased WO2022030269A1 (ja) 2020-08-07 2021-07-22 車両用表示制御装置、車両用表示制御システム、及び車両用表示制御方法

Country Status (3)

Country Link
US (1) US12533953B2 (https=)
JP (1) JP7363710B2 (https=)
WO (1) WO2022030269A1 (https=)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2023154876A (ja) * 2022-04-08 2023-10-20 ダイハツ工業株式会社 車両用制御装置
CN120220667A (zh) * 2023-12-26 2025-06-27 通用汽车环球科技运作有限责任公司 语音辅助系统和方法

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2017097519A (ja) * 2015-11-20 2017-06-01 オムロン株式会社 自動運転支援装置、自動運転支援システム、自動運転支援方法、プログラムおよび記録媒体
JP2017165289A (ja) * 2016-03-16 2017-09-21 本田技研工業株式会社 車両制御システム、車両制御方法、および車両制御プログラム
JP2018177064A (ja) * 2017-04-17 2018-11-15 株式会社デンソーテン コンテンツ再生装置及びコンテンツ再生方法

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4428134B2 (ja) 2004-05-13 2010-03-10 アイシン・エィ・ダブリュ株式会社 車両制御装置
WO2017154396A1 (ja) 2016-03-08 2017-09-14 株式会社デンソー 運転交代制御装置及び運転交代制御方法
JP6394687B2 (ja) 2016-03-08 2018-09-26 株式会社デンソー 運転交代制御装置及び運転交代制御方法
JP6831190B2 (ja) 2016-08-15 2021-02-17 トヨタ自動車株式会社 自動運転車両の制御システム及び制御方法
KR102014262B1 (ko) * 2017-12-11 2019-08-26 엘지전자 주식회사 차량에 구비된 디스플레이 장치 및 디스플레이 장치의 제어방법
JP6973930B2 (ja) * 2017-12-18 2021-12-01 日産自動車株式会社 運転支援方法及び運転支援装置
KR102924246B1 (ko) * 2019-11-06 2026-02-10 엘지전자 주식회사 차량용 디스플레이 장치 및 그 제어 방법
US11417188B2 (en) * 2020-06-25 2022-08-16 Toyota Motor North America, Inc. Control of vehicle status display for occupant threat reduction

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2017097519A (ja) * 2015-11-20 2017-06-01 オムロン株式会社 自動運転支援装置、自動運転支援システム、自動運転支援方法、プログラムおよび記録媒体
JP2017165289A (ja) * 2016-03-16 2017-09-21 本田技研工業株式会社 車両制御システム、車両制御方法、および車両制御プログラム
JP2018177064A (ja) * 2017-04-17 2018-11-15 株式会社デンソーテン コンテンツ再生装置及びコンテンツ再生方法

Also Published As

Publication number Publication date
US20230166596A1 (en) 2023-06-01
JP2022030768A (ja) 2022-02-18
JP7363710B2 (ja) 2023-10-18
US12533953B2 (en) 2026-01-27

Similar Documents

Publication Publication Date Title
JP7658472B2 (ja) 車両用表示制御装置、車両用表示制御システム、及び車両用表示制御方法
CN115884908B (zh) 路径确认装置以及路径确认方法
US11402844B2 (en) Vehicle control apparatus, vehicle control method, and storage medium
WO2021075454A1 (ja) 車載装置及び運転支援方法
JP7215596B2 (ja) 運転制御方法及び運転制御装置
US20200174470A1 (en) System and method for supporting autonomous vehicle
US20190196465A1 (en) Input from a plurality of teleoperators for decision making regarding a predetermined driving situation
CN110281931B (zh) 车辆用控制装置以及车辆
US11541892B2 (en) Vehicle control method and vehicle control device
US20200074851A1 (en) Control device and control method
KR20230136821A (ko) 운전자 보조 시스템 및 그를 가지는 차량
JP2021006448A (ja) 単一車両走行用に設計された自動運転システムでの車両隊列実施
US20230166767A1 (en) Path checking device, path checking method and vehicle control method
US12533953B2 (en) Vehicle display control device, vehicle display control system, and vehicle display control method
JP7726313B2 (ja) 車両用表示制御装置、車両用表示制御システム、及び車両用表示制御方法
JP7487593B2 (ja) 車両用表示制御装置、車両用表示制御システム、及び車両用表示制御方法
US12384400B2 (en) Vehicle presentation control device, vehicle presentation control system, and vehicle presentation control method
JP7652164B2 (ja) 車両用制御装置及び車両用制御方法
JP7661682B2 (ja) 車両用表示制御装置、車両用表示制御システム、及び車両用表示制御方法
WO2023021930A1 (ja) 車両用制御装置及び車両用制御方法
US20240308537A1 (en) Vehicle control device and vehicle control method
WO2024181080A1 (ja) 車両用制御装置及び車両用制御方法

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21853438

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21853438

Country of ref document: EP

Kind code of ref document: A1