WO2023194794A1 - 情報提供装置及び情報提供方 法 - Google Patents

情報提供装置及び情報提供方 法 Download PDF

Info

Publication number
WO2023194794A1
WO2023194794A1 PCT/IB2023/000134 IB2023000134W WO2023194794A1 WO 2023194794 A1 WO2023194794 A1 WO 2023194794A1 IB 2023000134 W IB2023000134 W IB 2023000134W WO 2023194794 A1 WO2023194794 A1 WO 2023194794A1
Authority
WO
WIPO (PCT)
Prior art keywords
vehicle
intersection area
intersection
pass
driving
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/IB2023/000134
Other languages
English (en)
French (fr)
Japanese (ja)
Inventor
龍馬 三角
誠秀 中村
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Renault SAS
Nissan Motor Co Ltd
Original Assignee
Renault SAS
Nissan Motor Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Renault SAS, Nissan Motor Co Ltd filed Critical Renault SAS
Priority to US18/853,600 priority Critical patent/US12570307B2/en
Priority to JP2024513566A priority patent/JP7768360B2/ja
Priority to CN202380031636.XA priority patent/CN118984789A/zh
Publication of WO2023194794A1 publication Critical patent/WO2023194794A1/ja
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/60—Instruments characterised by their location or relative disposition in or on vehicles
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/20—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
    • B60K35/21—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor using visual output, e.g. blinking lights or matrix displays
    • B60K35/22—Display screens
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/20—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
    • B60K35/26—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor using acoustic output
    • B60K35/265—Voice
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/20—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
    • B60K35/28—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor characterised by the type of the output information, e.g. video entertainment or vehicle dynamics information; characterised by the purpose of the output information, e.g. for attracting the attention of the driver
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/50—Instruments characterised by their means of attachment to or integration in the vehicle
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/80—Arrangements for controlling instruments
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/90—Calibration of instruments, e.g. setting initial or reference parameters; Testing of instruments, e.g. detecting malfunction
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W50/08—Interaction between the driver and the control system
    • B60W50/14—Means for informing the driver, warning the driver or prompting a driver intervention
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W50/08—Interaction between the driver and the control system
    • B60W50/14—Means for informing the driver, warning the driver or prompting a driver intervention
    • B60W2050/146—Display means

Definitions

  • the present invention relates to an information providing device and an information providing method.
  • Patent Document 1 When displaying the stopped state of a vehicle with an autonomous driving function, the surrounding situation of the vehicle is detected, and if the vehicle becomes stopped in the future in the surrounding situation while autonomously driving, a display that extends upward from the road surface of the surrounding situation is detected. It is known to cause a display device to display a stop display indicating the reason for stopping the vehicle (Patent Document 1).
  • the reasons for stopping that are notified to vehicle occupants are limited to those based on traffic regulations, road signs, and traffic lights.
  • the occupants are not notified of the reason for the stop. Therefore, the above-mentioned conventional technology has a problem in that the occupants of the vehicle have to wait until the vehicle departs without being informed of the cause of the stoppage, which makes them feel uneasy.
  • the problem to be solved by the present invention is to provide an information providing device and an information providing method that can suppress the anxiety felt by the occupants before the vehicle departs.
  • the present invention acquires intersecting areas where other moving objects intersect with movable areas in a driving route set by autonomous driving control, recognizes the driving environment around the vehicle, and based on the recognized driving environment, It is determined whether the vehicle can pass through the intersection area, and when it is determined that the vehicle cannot pass through the intersection area, if the vehicle stoppage time is longer than a predetermined time, the in-vehicle terminal and/or electronic terminal in the vehicle is activated. On the other hand, the above problem is solved by notifying the cause of the vehicle not being able to pass through the intersection area.
  • the anxiety felt by the occupants before the vehicle departs can be suppressed.
  • FIG. 1 is a block diagram showing an example of a driving support system including a driving support device according to the present invention.
  • FIG. 2 is a diagram (part 1) showing an example of an image displayed when driving support is executed by the driving support system shown in FIG. 1;
  • FIG. 2 is a diagram (part 2) showing an example of an image displayed when driving support is executed by the driving support system shown in FIG. 1;
  • FIG. 3 is a diagram (part 3) showing an example of an image displayed when driving support is executed by the driving support system shown in FIG. 1;
  • FIG. 4 is a diagram (Part 4) showing an example of an image displayed when driving support is executed by the driving support system shown in FIG. 1;
  • FIG. 5 is a diagram (part 5) showing an example of an image displayed when driving support is executed by the driving support system shown in FIG. 1;
  • 2 is a flowchart (part 1) showing an example of a processing procedure in the driving support device of FIG. 1;
  • 2 is a flowchart (Part 2) illustrating an example of a processing procedure in the driving support device of FIG. 1;
  • 3 is a flowchart (Part 3) illustrating an example of a processing procedure in the driving support device of FIG. 1;
  • 3 is a flowchart showing an example of a processing procedure in the driving support device of FIG. 1 (part 4).
  • FIG. 1 is a block diagram showing a driving support system 10 according to the present invention.
  • the driving support system 10 is an in-vehicle system that uses autonomous driving control to drive the vehicle to a destination set by the occupants of the vehicle (including the driver).
  • Autonomous driving control refers to autonomously controlling the driving behavior of a vehicle using a driving support device (described later), and the driving behavior includes acceleration, deceleration, starting, stopping, and turning to the right or left. This includes all driving movements, such as steering, changing lanes, and pulling alongside.
  • autonomously controlling the driving operation means that the driving support device controls the driving operation using a device of the vehicle. In other words, the driving support device intervenes and controls these driving operations within a predetermined range. Driving operations that do not require intervention are manually operated by the driver.
  • the driving support system 10 includes an imaging device 11, a distance measuring device 12, a state detection device 13, a map information 14, a position detection device 15, a navigation device 16, a vehicle control device 17, a display device 18, and A driving support device 19 is provided.
  • the driving support device 19 of this embodiment includes, as a part thereof, an information providing device having an information providing function.
  • the devices constituting the driving support system 10 are connected via a CAN (Controller Area Network) or other in-vehicle LAN, and can exchange information with each other.
  • CAN Controller Area Network
  • the imaging device 11 is a device that recognizes objects around the vehicle using images, and is, for example, a camera equipped with an imaging device such as a CCD, an ultrasonic camera, an infrared camera, or the like.
  • a plurality of imaging devices 11 can be provided in one vehicle, and can be arranged, for example, in the front grille of the vehicle, below the left and right door mirrors, and near the rear bumper. This can reduce blind spots when recognizing objects around the vehicle.
  • the distance measuring device 12 is a device for calculating the relative distance and relative speed between the vehicle and the target object, and includes, for example, a laser radar, a millimeter wave radar, etc. (LRF, etc.), a LiDAR (light detection and ranging) unit, a super A radar device such as a sonic radar or a sonar.
  • a plurality of distance measuring devices 12 can be provided in one vehicle, and can be arranged, for example, at the front, right side, left side, and rear of the vehicle. Thereby, the relative distance and relative speed of the vehicle to surrounding objects can be calculated accurately.
  • Objects detected by the imaging device 11 and distance measuring device 12 include road lane boundaries, center lines, road signs, median strips, guardrails, curbs, expressway side walls, road signs, traffic lights, crosswalks, and construction work. These include the scene, accident scene, and traffic restrictions.
  • the objects also include obstacles that may affect the running of the vehicle, such as cars other than the own vehicle (other vehicles), motorcycles, bicycles, and pedestrians.
  • the detection results of the imaging device 11 and the distance measuring device 12 are acquired by the driving support device 19 at predetermined time intervals as necessary.
  • the detection results of the imaging device 11 and the distance measuring device 12 can be integrated or synthesized (so-called sensor fusion) in the driving support device 19, thereby complementing missing information about the detected object.
  • the driving support device 19 calculates the position information of the object based on the self-position information, which is the position where the vehicle is traveling, acquired by the position detection device 15 and the relative position (distance and direction) of the vehicle and the object. can.
  • the calculated object position information is integrated with multiple pieces of information such as the detection results of the imaging device 11 and the distance measuring device 12 and the map information 14 in the driving support device 19, and is combined with driving environment information around the vehicle. Become. Further, using the detection results of the imaging device 11 and the distance measuring device 12 and the map information 14, it is also possible to recognize objects around the vehicle and predict their movements.
  • the state detection device 13 is a device for detecting the running state of the vehicle, and includes a vehicle speed sensor, an acceleration sensor, a yaw rate sensor (eg, a gyro sensor), a steering angle sensor, an inertial measurement unit, and the like. There are no particular limitations on these devices, and known devices can be used. Further, the arrangement and number of these devices can be set as appropriate within a range that can appropriately detect the driving state of the vehicle. The detection results of each device are acquired by the driving support device 19 at predetermined time intervals as necessary.
  • the map information 14 is information used for generating driving routes, controlling driving operations, etc., and includes road information, facility information, and their attribute information.
  • Road information and road attribute information include road width, road radius of curvature, road shoulder structures, road traffic regulations (speed limit, lane change availability), road merging and branching points, increase in number of lanes, etc. Contains information such as the location of the decrease.
  • the map information 14 is high-definition map information that can grasp the movement trajectory for each lane, and includes two-dimensional position information and/or three-dimensional position information at each map coordinate, road/lane boundary information at each map coordinate, and road attribute information. , lane up/down information, lane identification information, connection destination lane information, etc.
  • the road/lane boundary information in the high-definition map information is information that indicates the boundary between the road on which the vehicle travels and other areas.
  • a road on which a vehicle travels is a road on which a vehicle travels, and the form of the road is not particularly limited.
  • the map information 14 is stored in a readable state in a recording medium provided in a driving support device 19, an in-vehicle device, or a server on a network.
  • the driving support device 19 acquires the map information 14 as necessary.
  • the position detection device 15 is a positioning system for detecting the current position of the vehicle, and is not particularly limited, and a known device can be used.
  • the position detection device 15 calculates the current position of the vehicle from, for example, radio waves received from a GPS (Global Positioning System) satellite. Further, the position detection device 15 estimates the current position of the vehicle from the vehicle speed information and acceleration information acquired from the vehicle speed sensor, acceleration sensor, and gyro sensor that are the state detection device 13, and compares the estimated current position with the map information 14. In this way, the current position of the vehicle may be calculated.
  • GPS Global Positioning System
  • the navigation device 16 is a device that refers to the map information 14 and calculates a driving route from the current position of the vehicle detected by the position detection device 15 to a destination set by the occupant (including the driver).
  • the navigation device 16 uses the road information, facility information, etc. of the map information 14 to search for a travel route for the vehicle to reach the destination from the current location.
  • the travel route includes at least information about the road on which the vehicle travels, the travel lane, and the travel direction of the vehicle, and is displayed, for example, in a linear format. There may be multiple travel routes depending on the search conditions.
  • the travel route calculated by the navigation device 16 is output to the driving support device 19.
  • the vehicle control device 17 is an on-vehicle computer such as an electronic control unit (ECU), and electronically controls on-vehicle equipment that governs the running of the vehicle.
  • the vehicle control device 17 includes a vehicle speed control device 171 that controls the traveling speed of the vehicle, and a steering control device 172 that controls the steering operation of the vehicle.
  • the vehicle speed control device 171 and the steering control device 172 autonomously control the operations of these drive devices and steering devices according to control signals input from the driving support device 19. This allows the vehicle to autonomously travel along the set travel route.
  • Information necessary for autonomous control by the vehicle speed control device 171 and the steering control device 172 such as the traveling speed, acceleration, steering angle, and attitude of the vehicle, is acquired from the state detection device 13.
  • the drive devices controlled by the vehicle speed control device 171 include an electric motor and/or an internal combustion engine that are driving sources, a power transmission device including a drive shaft and an automatic transmission that transmit the output from these driving sources to the drive wheels, Examples include a drive device that controls a power transmission device.
  • the braking device controlled by the vehicle speed control device 171 is, for example, a braking device that brakes wheels.
  • a control signal corresponding to a set traveling speed is input to the vehicle speed control device 171 from the driving support device 19.
  • the vehicle speed control device 171 generates signals to control these drive devices based on the control signals input from the driving support device 19, and transmits the signals to the drive devices to autonomously control the running speed of the vehicle. to control.
  • the steering device controlled by the steering control device 172 is a steering device that controls the steered wheels according to the steering angle of the steering wheel, and includes, for example, a steering actuator such as a motor attached to a column shaft of the steering wheel.
  • the steering control device 172 controls the steering so that the vehicle travels while maintaining a predetermined lateral position (position in the left-right direction of the vehicle) with respect to the set travel route based on the control signal input from the driving support device 19.
  • This control includes at least the detection results of the imaging device 11 and the distance measuring device 12, the driving state of the vehicle obtained by the state detection device 13, the map information 14, and the information on the current position of the vehicle obtained by the position detection device 15. Use one.
  • the display device 18 is a device for providing necessary information to the occupants of the vehicle, and is, for example, a projector such as a liquid crystal display provided on an instrument panel or a head-up display (HUD).
  • the display device 18 may include an input device for a vehicle occupant to input instructions to the driving support device 19. Examples of the input device include a touch panel that receives input using a user's finger or a stylus pen, a microphone that obtains a user's voice instructions, and a switch attached to a vehicle steering wheel. Further, the display device 18 may include a speaker as an output device.
  • the driving support device 19 is a device that controls the driving of the vehicle by controlling and cooperating with the devices that make up the driving support system 10, and drives the vehicle to a set destination.
  • the destination is set, for example, by a vehicle occupant.
  • the driving support device 19 is, for example, a computer, and includes a CPU (Central Processing Unit) 191 that is a processor, a ROM (Read Only Memory) 192 in which a program is stored, and a RAM (Random Access Memory) that functions as an accessible storage device. y ) 193.
  • the CPU 191 is an operating circuit that executes a program stored in the ROM 192 and realizes the functions of the driving support device 19.
  • the driving support device 19 has a driving support function that allows the vehicle to travel to a set destination using autonomous driving control. Further, the driving support device 19 of this embodiment includes an information providing device as a part thereof. As an information providing function, the information providing device has an intersection area acquisition function that acquires an intersection area where the vehicle's driving route intersects with an area in which other moving objects can move, and a driving environment recognition function that recognizes the driving environment around the vehicle. , a passage determination function that determines whether the vehicle can pass through the intersection area, and a notification function that notifies the occupants of the vehicle whether or not the vehicle can pass through the intersection area.
  • the programs stored in the ROM 192 include programs for realizing these functions, and these functions are realized by the CPU 191 executing the programs stored in the ROM 192.
  • FIG. 1 shows extracted functional blocks for realizing each function for convenience.
  • the support unit 20 has a driving support function that allows the vehicle to travel to a set destination using autonomous driving control.
  • the driving support device 19 executes driving support using the driving support function
  • the driving support device 19 uses the information providing function to display an image showing the driving environment of the vehicle on the display device 18.
  • FIG. 2A is a diagram showing an example of an image displayed on the display device 18.
  • the image shown in FIG. 2A is a bird's-eye view image obtained when a virtual viewpoint is set diagonally upward behind the vehicle V and the front of the vehicle V is photographed from the position of the viewpoint.
  • Information such as the lane and sign of the road on which the vehicle V is traveling, the traveling position of the vehicle V, and obstacles existing around the vehicle V is displayed on the bird's-eye image.
  • the vehicle V will also be referred to as the own vehicle V to distinguish it from other vehicles.
  • the image shown in FIG. 2A is a two-dimensional image created by computer graphics (CG)
  • the image showing the driving environment of the vehicle V displayed on the display device 18 is not limited to this.
  • the image showing the driving environment may be a three-dimensional image, or may be an image acquired by the imaging device 11.
  • an image created by CG may be displayed superimposed on the image acquired by the imaging device 11.
  • the driving scene shown in FIG. 2A corresponds to the actual driving scene of the vehicle V. That is, in the driving scene shown in FIG. 2A, the vehicle V is traveling on a road with one lane on each side.
  • the driving direction of the vehicle in lane L1 is from the bottom to the top of the drawing (from the front side to the back side), and the driving direction of the vehicle in lane L2 is from the top side to the bottom of the drawing (from the back side to the near side).
  • the direction is towards.
  • the road on which the vehicle V is traveling intersects with a road with one lane on each side in front of the vehicle V.
  • the traveling direction of the vehicle in lane L3 is from the left side to the right side in the drawing
  • the traveling direction of the vehicle on lane L4 is from the right side to the left side in the drawing.
  • intersection X the range where two roads intersect is intersection X. It is assumed that no traffic lights are installed at the intersection X shown in FIG. 2A. At the intersection Crosswalks C2 and C3 are provided for this purpose.
  • a vehicle traveling in lane L1 can turn left or right at intersection X
  • a vehicle traveling in lane L3 can go straight or turn right at intersection X
  • a vehicle traveling in lane L4 can turn left or right at intersection X. be able to go straight or turn left.
  • the navigation device 16 sets the driving route R of the vehicle V using the driving support function of the support unit 20.
  • the navigation device 16 sets, for example, a travel route R shown in FIG. 2A.
  • the driving route R is a route in which the vehicle goes straight in the lane L1, turns right at the intersection X, travels in the lane L3, and reaches the destination Px.
  • the vehicle V is traveling along the driving route R in the lane L1, as shown in FIG. 2A.
  • a pedestrian Y1 at a position P1 moves by walking from a position P1 to a position P2 and crosses a crosswalk C1
  • a pedestrian Y2 at a position P3 moves from a position P3 to a position P4.
  • the user moves by walking and crosses the crosswalk C3.
  • another vehicle Z is stopped at a position P5 in front of the crosswalk C2 in the lane L3.
  • the driving support device 19 uses the driving support function to drive the vehicle V to the destination Px while providing appropriate information to the occupants of the vehicle using the information providing device included as a part thereof. Executes driving support for driving.
  • This driving support including information provision is mainly realized by the functions of the acquisition section 21, the recognition section 22, the determination section 23, and the notification section 24.
  • the acquisition unit 21 has an intersection area acquisition function that acquires an intersection area where another moving object intersects with a movable area in the travel route R set by autonomous driving control.
  • Other moving objects are traffic participants other than the vehicle V, such as other vehicles, motorcycles, bicycles, and pedestrians.
  • the area in which other moving objects can move is an area in which traffic participants other than the vehicle V can move when moving from the current position to the destination.
  • areas where pedestrians can move are areas where pedestrians can walk, such as sidewalks, crosswalks, and pedestrian bridges.
  • the area in which other vehicles and motorcycles can move is the area on the road where they can travel, similar to the vehicle V.
  • the driving support device 19 uses the intersection area acquisition function of the acquisition unit 21 to acquire the driving route R from the navigation device 16. Next, in the travel route R, an intersection area where another moving object intersects with a movable area is acquired. Traveling route R intersects with an area in which other moving objects can move if a traffic participant other than vehicle V is present in an area in which that traffic participant can move. When the vehicle V travels along this line, the vehicle V comes into contact with another moving body. In other words, when the travel route R of the vehicle V and the area where traffic participants other than the vehicle V can move exist on the same plane, and when viewed from above, the travel route R of the vehicle V is This refers to overlapping part or all of the area in which traffic participants can move.
  • a crosswalk existing on the travel route R becomes a crossing area.
  • a pedestrian bridge exists on the travel route R, even if the vehicle V travels along the travel route R while the pedestrian is walking on the pedestrian bridge, the relationship between the vehicle V and the pedestrian is There will be no contact. This is because the road on which the vehicle V travels and the pedestrian bridge on which the pedestrian walks do not exist on the same plane.
  • the map information 14 includes road information of roads that the vehicle V passes when traveling along the travel route R. Furthermore, the map information 14 also includes information on areas on the road through which the vehicle V can move, where traffic participants other than the vehicle V can move, and their attributes. Therefore, the driving support device 19 can extract the intersection area existing on the travel route R using the intersection area acquisition function of the acquisition unit 21.
  • intersection area examples include an intersection where a road on which the vehicle V is traveling and a road on which other vehicles other than the vehicle V are traveling, a crosswalk installed on the road on which the vehicle V is traveling, etc. .
  • vehicle V enters a facility located in a position facing a road, if a sidewalk is provided between the roadway and the facility, the portion of the sidewalk facing the facility will be in the intersection area.
  • a sidewalk is provided between the roadway and the facility
  • the portion of the sidewalk facing the facility will be in the intersection area.
  • Become In other words, when a pedestrian is walking on a sidewalk that exists between the facility and the roadway, when a vehicle V enters the facility, the vehicle V and the pedestrian will come into contact, so the sidewalk will be in the intersection area. becomes.
  • the intersection X becomes an intersection area.
  • the crosswalk C1 becomes a crossing area.
  • the crosswalk C2 becomes the crossing area
  • the crosswalk C3 becomes the crossing area.
  • the recognition unit 22 has a driving environment recognition function that recognizes the driving environment around the vehicle V.
  • the driving support device 19 uses the driving environment recognition function of the recognition unit 22 to acquire the detection results of the imaging device 11 and the distance measuring device 12, performs processing such as pattern matching and sensor fusion on the acquired detection results, and Recognize V's driving environment. For example, the driving support device 19 detects other vehicles traveling around the vehicle V based on the detection results of the imaging device 11, and determines the distance from the vehicle V to the other vehicle and the vehicle The direction in which the other vehicle exists with respect to V is detected, and the position of the other vehicle with respect to vehicle V is recognized.
  • the driving support device 19 detects a pedestrian crossing the crosswalk in front of the vehicle V from the detection result of the imaging device 11, and detects a pedestrian crossing the crosswalk in front of the vehicle V from the detection result of the distance measuring device 12. The distance is detected and the position of the other vehicle with respect to the vehicle V is recognized.
  • a traffic light may be installed at intersection X, which is a crossing area.
  • the driving support device 19 uses the driving environment recognition function of the recognition unit 22 to determine whether a traffic light exists in front of the vehicle V from the detection results of the imaging device 11 and the map information 14. Determine whether or not. If it is determined that a traffic light exists in front of the vehicle V, the state of the traffic light is detected as the driving environment.
  • the state of a traffic light is, for example, the state of the light of the traffic light. Specifically, the state of the traffic light is red (that is, the state where vehicle V must stop before intersection X), and the state where the traffic light is yellow.
  • a light state that is, a state in which the vehicle V cannot enter the intersection X unless it is unable to stop
  • a state in which the traffic light is blue that is, a state in which the vehicle V can enter the intersection X.
  • the state of the traffic light is detected from an image acquired by the imaging device 11.
  • the driving support device 19 uses the driving environment recognition function of the recognition unit 22 to recognize, for example, a preceding vehicle and a following vehicle traveling in lane L1, and an oncoming vehicle traveling in lane L2.
  • the vehicle and vehicles traveling in lanes L3 and L4 are detected as other vehicles. Then, based on the direction and distance of the other vehicle with respect to the vehicle V, the position of the other vehicle traveling around the vehicle V is recognized.
  • another vehicle Z that has stopped at a position P5 in front of the crosswalk C2 in the lane L3 is recognized as another vehicle that is traveling around the vehicle V.
  • the driving support device 19 detects pedestrians crossing the crosswalks C1, C2, and C3, and recognizes the presence of pedestrians as the driving environment of the vehicle V. In the driving scene shown in FIG. 2A, pedestrian Y1 who is about to cross the crosswalk C1 and pedestrian Y2 who is about to cross the crosswalk C3 are detected. Recognized as a pedestrian. Furthermore, the driving support device 19 determines whether or not a traffic light is installed at the intersection X. In the driving scene shown in FIG. 2A, since no traffic light is installed at intersection X, it is recognized that no traffic light exists at intersection X.
  • the determination unit 23 has a passage determination function that determines whether the vehicle V can pass through the intersection area based on the travel environment of the vehicle V recognized by the travel environment recognition function.
  • the driving support device 19 uses the passage determination function of the determination unit 23 to determine whether or not an obstacle exists in the intersection area, and if it is determined that there is no obstacle in the intersection area, the vehicle V is allowed to cross the intersection area. It is determined that it is possible to pass. On the other hand, if it is determined that an obstacle exists in the intersection area, it is determined that the vehicle V cannot pass through the intersection area.
  • the driving support device 19 uses the passage determination function of the determination unit 23 to determine whether a traffic light is installed in the intersection area (specifically, intersection X).
  • the driving support device 19 acquires the position information of the traffic light from, for example, the map information 14, compares the position of the intersection area with the position of the traffic light, and determines whether a traffic light is installed in the intersection area. If it is determined that a traffic light is installed in the intersection area (specifically, intersection X), it is determined whether the traffic light is in a state that instructs the vehicle to stop.
  • the state of the traffic light is a state instructing a stop (that is, a red light state)
  • the state of the traffic light is not a state instructing a stop (in other words, If it is determined that the vehicle V is in a blue light state), it is determined that the vehicle V can pass through the intersection area.
  • vehicle V can stop before intersection X based on the running state of vehicle V (particularly the running speed of vehicle V) and the distance from vehicle V to the intersection area (intersection X). Determine whether or not. If it is determined that the vehicle V cannot stop before the intersection X, the driving support device 19 determines that the traffic light is not in a state that instructs a stop and that the vehicle V can pass through the intersection area (intersection X). On the other hand, if it is determined that the vehicle V can stop before the intersection area (intersection It is determined that it is not possible.
  • the driving support device 19 determines whether the obstacle is present in the intersection area or not. , and when it is determined that the traffic light is not in a state that instructs a stop, it is determined that the vehicle V can pass through the intersection area. On the other hand, if the driving support device 19 determines that an obstacle exists in the intersection area or if it determines that the traffic light is in a state that instructs a stop, the driving support device 19 determines that the vehicle V cannot pass through the intersection area. do.
  • the determination of the presence or absence of an obstacle in the intersection area and the state of the traffic light may be performed at the same time, or the state of the traffic light may be determined first, and then the presence or absence of an obstacle in the intersection area may be determined. .
  • the driving support device 19 recognizes that the intersection X and the crosswalks C1 and C2 are intersection areas, and that no traffic lights are installed at the intersection X. In the driving scene shown in FIG. 2A, since no traffic light is installed at the intersection X, the driving support device 19 determines the presence or absence of obstacles at the intersection X and the crosswalks C1, C2, and C3.
  • the driving support device 19 detects the presence or absence of an obstacle when crossing the crosswalk C1 with another vehicle Z stopped at a position P5 in front of the crosswalk C2 in the lane L3 in the driving scene shown in FIG. 2A. It is recognized that there is a pedestrian Y1 who is about to cross the street and a pedestrian Y2 who is crossing the crosswalk C3. Based on this recognition, the driving support device 19 determines that pedestrians Y1 and Y2 are present at the crosswalks C1 and C3, respectively, and that the vehicle V cannot pass through the crosswalks C1 and C3.
  • the driving support device 19 determines that there is a possibility that another parked vehicle Z will enter the crosswalks C1 to C3 and the intersection X. Therefore, in the driving scene shown in FIG. 2A, the driving support device 19 determines that the vehicle V cannot pass through the intersection area.
  • the driving support device 19 uses the passage determination function of the determination unit 23 to determine whether a plurality of intersection areas exist at one point.
  • the presence of a plurality of intersection areas at one point means, for example, the presence of a plurality of intersection areas adjacent to each other.
  • the driving support device 19 determines that a plurality of intersection areas exist at one point.
  • there is only one crosswalk at a location that is not a road intersection there are no adjacent crosswalks that are crosswalks, so there are multiple crosswalks at one point. It is determined that it does not exist.
  • An example of where multiple intersection areas do not exist is a point where a crosswalk is installed in front of a facility facing the road for the convenience of facility users. It will be done.
  • the notification unit 24 has a notification function that notifies an in-vehicle terminal and/or an electronic terminal in the vehicle V whether or not the vehicle V can pass through the intersection area.
  • the in-vehicle terminal and electronic terminal of the vehicle V are, for example, the display device 18, but are not limited thereto, and are not limited to the display portion of the instrument panel, which provides information to the occupants of the vehicle V when executing the driving assistance of the above-mentioned assistance level 3 or 4. Including terminals for providing services.
  • the driving support device 19 uses the notification function of the notification unit 24 to notify the occupants of the vehicle V whether or not the vehicle V can pass through the intersection area, using an on-vehicle terminal and/or an electronic terminal in the vehicle V. do.
  • the driving support device 19 repeatedly performs the passage determination process using the passage determination function while the vehicle V travels from the current position to the intersection area. Then, the information provided to the in-vehicle terminal and/or electronic terminal (that is, the occupant of the vehicle V) in the vehicle V is changed according to the obtained determination result.
  • the information that the driving support device 19 provides to the occupants of the vehicle V includes information indicating that it is determined whether or not an obstacle exists in the intersection area, and information indicating that it is determined whether or not an obstacle exists in the intersection area (i.e. Examples of information include information indicating the type of traffic participant), information indicating the lighting status of a traffic light installed in the intersection area, and information indicating whether the vehicle V can pass through the intersection area. These pieces of information are displayed on the display device 18 to show them to the occupants of the vehicle V, but instead, they may be output as audio from a speaker included in the display device 18.
  • the occupant when the vehicle V is approaching an intersection area, the occupant is notified that the vehicle V is approaching the intersection area by a voice such as "We are almost at the intersection.” In addition to this, when the vehicle V can pass through an intersection area, the occupants are notified with a voice message such as "You can pass through the intersection ahead as is.” The audio will be recorded or synthesized.
  • these pieces of information may be displayed together with the distance from the vehicle V to the intersection area. Alternatively or in addition to this, this information may be displayed at the position of the intersection area on the travel route R displayed on the display device 18. Alternatively or in addition to this, this information may be displayed superimposed on the image outside the vehicle acquired from the imaging device 11. Further, the display device 18 on which this information is displayed includes not only a display mounted on the vehicle V but also a display of a terminal owned by a passenger of the vehicle V.
  • the driving support device 19 performs all driving tasks of the vehicle V and the supervisor monitors the running of the vehicle V at a remote location away from the vehicle V, as in an unmanned taxi, the above-mentioned
  • the information may be displayed on a display included in a terminal for monitoring the running of the vehicle V.
  • the driving support device 19 determines that the vehicle cannot pass through the crosswalk C1 because the pedestrian Y1 is present, as described above. Based on this determination result, the driving support device 19 uses the notification function of the notification unit 24 to notify the occupant of the vehicle V that the vehicle V cannot pass the crosswalk C1 and therefore will stop in front of the crosswalk C1. The driving support device 19 notifies the occupant that the vehicle will stop before the crosswalk C1, for example, by changing the color of the display portion of the driving route R displayed on the display device 18. In the driving route R shown in FIG.
  • the part up to this side of the crosswalk C1 is lightly hatched as a driveable part, and the crosswalk C1 and the crosswalk C1 The area beyond is marked with dark hatching to indicate the area where it is impossible to drive.
  • the driving support device 19 displays an image (icon) I1 labeled "STOP" shown in FIG. 2A on the display device 18 to notify the occupants that the vehicle V will stop before the crosswalk C1. Notice.
  • the position where the image I1 is displayed is the position of the intersection X on the driving route R displayed on the display device 18.
  • the driving support device 19 outputs a voice message from the speaker of the display device 18 saying, "Stop before the crosswalk ahead," and the vehicle V Notify passengers that the vehicle will stop before the vehicle.
  • the driving support device 19 notifies the occupant by the above-mentioned display and audio that the vehicle will stop before the crosswalk C1, and then uses the driving support function of the support unit 20 to cause the vehicle V to travel along the travel route R.
  • the running speed of the vehicle V is controlled via the vehicle speed control device 171 of the vehicle control device 17, and the vehicle V is stopped in front of the crosswalk C1.
  • the steering control device 172 is also controlling the steering wheel of the vehicle V.
  • FIG. 2B is an example of an image displayed on the display device 18 when the vehicle V stops in front of the crosswalk C1.
  • pedestrian Y1 is walking at position P1a of crosswalk C1 toward position P2.
  • pedestrian Y2 is walking toward position P4 at position P3a of crosswalk C3.
  • the driving support device 19 recognizes the positions of pedestrians Y1 and Y2 from the detection results of the imaging device 11 and the distance measuring device 12.
  • the driving support device 19 determines that the vehicle V cannot pass through the crosswalks C1 and C3 because pedestrians Y1 and Y2 are present at each of the crosswalks C1 and C3.
  • the driving support device 19 controls the running operation of the vehicle V via the vehicle control device 17 so that the vehicle V is maintained in a stopped state.
  • the driving support device 19 recognizes the other vehicle Z stopped at position P5, and also recognizes that in the driving scene shown in FIG. 2B, the other vehicle Z continues to stop at the same position P5 as in the driving scene shown in FIG. 2A. Guess the factors.
  • the driving support device 19 estimates that the vehicle has stopped before the crosswalk C2 in order to avoid stopping at the intersection X. If another vehicle Z goes straight through intersection X, it will stop before crosswalk C3 to avoid contact with pedestrian Y2, and if another vehicle Z turns right at intersection In order to avoid contact with pedestrians, you must stop before the C1 crosswalk. In other words, the other vehicle Z will stop at the intersection X whether it is going straight or turning right.
  • FIG. 2C is an example of an image displayed on the display device 18 after the vehicle V has stopped in front of the crosswalk C1 and after the pedestrians Y1 and Y2 have finished crossing the crosswalks C1 and C3, respectively.
  • pedestrian Y1 is walking at position P2
  • pedestrian Y2 is walking at position P4.
  • the driving support device 19 recognizes the positions of pedestrians Y1 and Y2 from the detection results of the imaging device 11 and the distance measuring device 12. The driving support device 19 then determines that the vehicle V can pass through the crosswalks C1 and C3 because there are no obstacles on the crosswalks C1 and C3.
  • the driving support device 19 recognizes the other vehicle Z that is stopped at the position P5, and determines whether the other vehicle Z starts and enters the intersection X in the driving scene shown in FIG. 2C.
  • the driving support device 19 stops the other vehicle Z in front of the crosswalk C2 because it is necessary to stop inside the intersection X to avoid contact with pedestrians Y1 and Y2. I guessed that it was.
  • pedestrians Y1 and Y2 have finished crossing the crosswalk, and other vehicle Z needs to stop at intersection X to avoid contact with pedestrians Y1 and Y2. do not have. Therefore, the driving support device 19 determines that the other vehicle Z starts and enters the intersection X. On the other hand, if obstacles other than pedestrians Y1 and Y2 exist at the intersection judge.
  • the driving support device 19 autonomously controls the driving operation of the vehicle V via the vehicle control device 17 so that the vehicle V departs after the other vehicle Z passes the intersection X, as described above. do. This is to reliably avoid contact between the vehicle V and another vehicle Z.
  • the occupant of vehicle V has an expectation that vehicle V will depart once pedestrians Y1 and Y2 have finished crossing the crosswalk. Since no traffic lights are installed at the intersection X shown in FIG. This is because we think that we can pass through X.
  • the occupant of the vehicle V is such that the pedestrian Y1 moves on foot from the position P1a shown in FIG.
  • the image I1 notifying the occupants that the vehicle V has stopped remains displayed on the display device 18, and the vehicle V has not stopped. continue.
  • the driving support device 19 determines that the other vehicle Z will enter the intersection X, and performs control to cause the vehicle V to depart after the other vehicle Z has passed the intersection X.
  • the occupants of the vehicle V think that because the vehicle V continues to stop contrary to their expectations, the autonomous driving control by the driving support device 19 is not being executed appropriately, and as a result, the vehicle V is stopped. I feel uneasy about it.
  • intersection Judgments need to be made in a relatively short time. This is because the vehicle V cannot depart unless it is determined that all the intersection areas are passable. Therefore, in a driving scene as shown in FIG. 2C, it is difficult for the occupant of the vehicle V to intuitively grasp the cause of the vehicle V stopping, and the occupant is likely to feel uneasy. Further, when the departure of the other vehicle Z is delayed, or when the other vehicle Z is a parked vehicle, the departure of the vehicle V is delayed, and the occupants of the vehicle V feel anxious.
  • the notification unit 24 of the present embodiment provides a system in which the stoppage time of the vehicle V is longer than a predetermined time when the determination unit 23 determines that the vehicle V cannot pass through the intersection area.
  • the time When the time is long, it has a function of notifying the occupants of the vehicle V of the reason why the vehicle V cannot pass through the intersection area.
  • the driving support device 19 uses the notification function of the notification unit 24 to acquire the stopping time of the vehicle V. If the stopping time of the vehicle V is longer than a predetermined time, the occupants of the vehicle V are notified of the reason why the vehicle V cannot pass through the intersection area. On the other hand, if the stopping time of the vehicle V is less than or equal to the predetermined time, the occupant of the vehicle V is not notified of the reason why the vehicle V cannot pass through the intersection area.
  • the stopping time of the vehicle V refers to the time that has passed since the vehicle V stopped before an intersection area that was determined to be impassable. Whether the vehicle V is stopped is determined based on, for example, the traveling speed of the vehicle V acquired from the state detection device 13 and the position information of the vehicle V acquired from the position detection device 15. Specifically, when the traveling speed of the vehicle V obtained from the state detection device 13 is 0 km/h and the position information of the vehicle V obtained from the position detection device 15 has not changed, the vehicle V is stopped. It is determined that there is.
  • the driving support device 19 stores in the RAM 193 or the like the time point when the driving support function of the support unit 20 determines that the vehicle V has stopped. Then, if necessary, the time that has passed since it was determined that the vehicle V has stopped is acquired as the stopping time.
  • the predetermined time period which is the standard for notifying the cause of the stoppage, is set to an appropriate value within a range that does not make the occupants of the stopped vehicle V feel uneasy when the occupants of the vehicle V cannot grasp the cause of the stoppage of the vehicle V. can.
  • a predetermined time is set to be a general time period when a traffic light is in a state instructing a stop (that is, a red light state). Instead, the stop time required for passing through each intersection area is recorded, and the average value of the stop times recorded for each intersection area is set to a predetermined time.
  • the amount of time that passengers can wait for departure without feeling anxious is determined in advance through an experiment, and the stopping time determined from the experiment is set to a predetermined time.
  • the factor that prevents the vehicle V from passing through the intersection area is another moving object that exists in the intersection area where it is determined that the vehicle V cannot pass through. For example, bicycles and pedestrians walking at a crosswalk, other vehicles and motorcycles existing at an intersection, etc.
  • the driving support device 19 uses the notification function of the notification unit 24 to notify the cause of the inability of the vehicle V to pass through the intersection area, the driving support device 19 displays the display portion of the other vehicle Z as a broken-line rectangular image, as shown in FIG. 2C, for example. Highlight and display with I2. In this manner, when the display device 18 is used to notify the cause of the inability of the vehicle V to pass through the intersection area, the driving support device 19 changes the color of the display portion of the cause to emphasize it. Alternatively or in addition to this, the driving support device 19 surrounds the display portion of the factor with a rectangular or circular image.
  • the driving support device 19 outputs a voice from the speaker of the display device 18 saying, "We are stopped due to another vehicle Z on the left side in front,” and notifies the occupants of the cause of the stop. do.
  • the driving support device 19 changes the original color to a color (for example, red) that draws more attention.
  • the driving support device 19 When notifying that the cause is that the vehicle V cannot pass through the intersection X, the driving support device 19 continues to notify the cause until it is determined that the vehicle V can pass through the intersection area.
  • the other vehicle Z passes through the intersection X, and until it is determined that the vehicle V can enter the intersection X, the other vehicle Z is displayed with increased emphasis in the image I2. Additionally, if there are multiple factors that prevent the vehicle V from passing through the intersection area, it is determined for each factor whether or not the vehicle V can pass through the intersection area, and notification of each factor is notified according to the determination result for each factor. Continue. For example, in the driving scene shown in FIG.
  • pedestrian Y1 and other vehicle Z may Determine whether the object will become an obstacle. Then, while it is determined that the pedestrian Y1 and the other vehicle Z are the factors that prevent the vehicle V from passing through the intersection X, they continue to be displayed in an emphasized manner. After that, if it is determined that pedestrian Y1 does not become an obstacle when entering intersection X, and other vehicle Z is the only factor that prevents vehicle V from passing through intersection , and continue to highlight and display only the other vehicle Z.
  • the driving support device 19 uses the notification function of the notification unit 24 to notify the cause of the vehicle V not being able to pass through the intersection area using the display device 18, the driving support device 19 uses the notification function of the notification unit 24 to notify the cause of the vehicle V not being able to pass through the intersection area.
  • the contrast with respect to the display portion around the traveling route R is lowered.
  • the driving support device 19 increases the contrast of the displayed portion of the intersection region with respect to the displayed portion of the travel route R.
  • the driving support device 19 increases the degree of emphasis of the displayed portion of the intersection area. For example, in the driving scene shown in FIG.
  • the contrast of the displayed portion of the driving route R beyond the crosswalk C3 with respect to the displayed portion of the lane L3 is lowered.
  • the contrast of the display portions of the crosswalks C1 and C3 and the intersection X with respect to the driving route R is increased, and the degree of emphasis is increased by enclosing them in rectangular images.
  • the driving support device 19 lowers the contrast of the displayed portion of the intersection area with respect to the displayed portion of the travel route R, and increases the degree of emphasis of the displayed portion of the cause of the vehicle V not being able to pass through the intersection area.
  • the contrast of the displayed portions of the crosswalks C1 and C3 and the intersection X is lowered with respect to the displayed portion of the driving route R while increasing the degree of emphasis of the other vehicle Z in the image I2.
  • the driving support device 19 stops the vehicle V when it is determined that the vehicle V cannot pass through the intersection area.
  • the notification of the cause may be started from the time when the time exceeds a predetermined time.
  • the driving support device 19 uses the driving environment recognition function of the recognition unit 22 to classify the obstacle into stationary obstacles and other obstacles. Stationary obstacles and other obstacles may be notified in different ways.
  • a stationary obstacle is an obstacle that is placed in place and does not move itself. If a stationary obstacle is the cause of the stoppage, the vehicle V cannot continue traveling along the travel route R unless the stationary obstacle is avoided. prompt the vehicle occupants and others to take maneuvers to avoid obstacles.
  • FIG. 2D is an example of an image displayed on the display device 18 when another vehicle Z has started and is passing through the crosswalk C2, the intersection X, and the crosswalk C3.
  • the other vehicle Z starts from position P5 and travels straight through intersection X to position P6. It is assumed that pedestrians Y1 and Y2 are walking outside the screen of the display device 18.
  • the driving support device 19 recognizes that the other vehicle Z is traveling at the position P6 from the detection results of the imaging device 11 and the distance measuring device 12, and determines that the other vehicle Z has passed through the intersection X. .
  • the driving support device 19 determines that the vehicle V can pass through the intersection area, it changes the display portion of the intersection area on the display device 18. Instead or in addition to this, the driving support device 19 superimposes a message on the display portion of the intersection area to indicate that the intersection area is passable. In the driving scene shown in FIG. 2D, for example, the degree of emphasis on the displayed portion of the intersection X is reduced, and an image indicating that the intersection X is passable is displayed superimposed on the displayed portion of the intersection X. Instead or in addition to this, the color of the display portion of the travel route R is changed. For example, the color of the displayed portion of the driving route R shown in FIG. 2D is changed from dark hatching indicating areas where travel is not possible to light hatching indicating areas where travel is possible.
  • FIG. 2E shows an example of the driving route R in which the color of the display part has been changed.
  • vehicle V starts from a stopping position in front of crosswalk C1 and enters intersection X.
  • the driving support device 19 causes the vehicle V to travel along the travel route R using the driving support function of the support unit 20.
  • the vehicle V passes through the intersection X and the crosswalks C1 and C3 under the control of the drive device and the steering device via the vehicle control device 17, and reaches the destination Px under autonomous driving control.
  • FIGS. 3A to 3D are examples of flowcharts showing information processing executed in the driving support system 10 of this embodiment. The processing described below is executed at predetermined time intervals by the CPU 191, which is the processor of the driving support device 19.
  • step S1 of FIG. 3A the intersection area acquisition function acquires the travel route R from the navigation device 16, and in the subsequent step S2, the area in which other moving objects can move is acquired from the map information 14.
  • step S3 an intersection area is acquired.
  • step S4 the current position of the vehicle V is acquired from the position detection device 15 by the driving environment recognition function, and in the subsequent step S5, the driving route R is displayed on the display device 18 by the notification function.
  • step S6 it is determined by autonomous driving control whether the vehicle V can travel to the intersection area.
  • step S7 If it is determined by the autonomous driving control that the vehicle V cannot travel to the intersection area, such as when there is an unavoidable obstacle in front of the vehicle V, the execution of the routine ends and the driver shifts to manual driving. On the other hand, if it is determined that the vehicle V can travel to the intersection area by the autonomous driving control, the process proceeds to step S7.
  • step S7 the notification function displays on the display device 18 that it is possible to drive up to the intersection area, and in the subsequent step S8, the driving support function causes the vehicle V to move along the set travel route R. run.
  • step S9 it is determined whether the distance from the vehicle V to the intersection area is less than or equal to a predetermined distance. If it is determined that the distance from the vehicle V to the intersection area is longer than the predetermined distance, the process proceeds to step S8, and the vehicle V is moved along the travel route R until the distance from the vehicle V to the intersection area becomes less than or equal to the predetermined distance. Keep it running. On the other hand, if it is determined that the distance from the vehicle V to the intersection area is less than or equal to the predetermined distance, the process proceeds to step S10.
  • step S10 the passage determination function determines whether a traffic light is installed in the intersection area. If it is determined that a traffic light is installed in the intersection area, the process advances to step S21 in FIG. 3B. On the other hand, if it is determined that no traffic light is installed in the intersection area, the process advances to step S51 in FIG. 3C. In the following description, it is assumed that the intersection area determined to have a traffic light installed is an intersection X where a crosswalk is installed.
  • step S10 of FIG. 3A determines whether a traffic light is installed in the intersection area. If it is determined in step S10 of FIG. 3A that a traffic light is installed in the intersection area, the process proceeds to step S21 of FIG. 3B.
  • step S21 of FIG. 3B the passage determination function determines whether the state of the traffic light indicates a stop. If it is determined that the traffic light is instructing a stop, the process proceeds to step S22, and the vehicle V is caused to travel along the set travel route R. In the following step S23, it is determined whether the vehicle V has reached the crosswalk, and if it is determined that the vehicle V has not reached the crosswalk, the process proceeds to step S21, and the vehicle V starts traveling along the travel route R. The state of the traffic light is detected while continuing. On the other hand, if it is determined that the vehicle V has reached the crosswalk, the process proceeds to step S24 and the vehicle V is stopped in front of the crosswalk. After that, the process advances to step S21, and the state of the traffic light is detected
  • step S21 If it is determined in step S21 that the state of the traffic light does not instruct the vehicle to stop, the process proceeds to step S25.
  • step S25 it is determined whether the vehicle V is going straight through the intersection X. If it is determined that the vehicle V will go straight through the intersection X, the process proceeds to step S26, in which obstacles present at the intersection do. If it is determined that the vehicle V can pass through the intersection X, the process proceeds to step S40, where the vehicle V is caused to travel along the travel route R and pass through the intersection X. On the other hand, if it is determined that the vehicle V cannot pass through the intersection X, the process proceeds to step S26 and the obstacle detection is repeated. Note that when the vehicle V reaches the intersection X, the vehicle V is stopped in front of the intersection X.
  • step S25 determines whether the vehicle V will turn right at the intersection X. If it is determined that the vehicle V will turn right at the intersection X, the process advances to step S29. On the other hand, if it is determined that the vehicle V does not turn right (that is, turns left) at the intersection X, the process advances to step S34.
  • step S29 the notification function displays on the display device 18 that it is possible to drive to the center of the intersection X
  • step S30 the driving support function causes the vehicle V to drive to the center of the intersection X.
  • step S31 the driving environment recognition function detects an oncoming vehicle based on the detection results of the imaging device 11 and the distance measuring device 12, and in the subsequent step S32, it is determined whether the oncoming lane is passable. If it is determined that there is no oncoming vehicle and the oncoming lane is passable, the process advances to step S34. On the other hand, if it is determined that there is an oncoming vehicle and the oncoming lane is not passable, the process proceeds to step S33 and the vehicle V is stopped at the center of the intersection X. Then, the process advances to step S31, and an oncoming vehicle is detected again.
  • step S34 the notification function displays on the display device 18 that it is possible to travel to a position in front of the crosswalk.
  • step S35 the vehicle V is driven to a position in front of the crosswalk.
  • step S36 pedestrians and bicycles passing through the crosswalk are detected, and in step S37, it is determined whether or not the crosswalk is passable. If it is determined that there are no pedestrians or bicycles and the crosswalk is passable, the process proceeds to step S39, where the display device 18 displays that the intersection X is passable, and then the process proceeds to step S40.
  • step S38 the process proceeds to step S38, and the vehicle V is stopped at a position in front of the crosswalk. Then, the process advances to step S36, and pedestrians and bicycles are detected again.
  • step S51 of FIG. 3C the passage determination function determines whether a plurality of intersection areas exist in front of the vehicle V. If it is determined that a plurality of intersection areas exist in front of the vehicle V, the process advances to step S61 in FIG. 3D. On the other hand, if it is determined that there are no multiple intersection areas in front of the vehicle V, the process advances to step S52. In step S52, the driving environment recognition function detects an obstacle present in the intersection area, and in the subsequent step S53, the passage determination function determines whether or not the intersection area is passable.
  • step S56 the notification function displays on the display device 18 that the intersection area is passable
  • step S57 the driving support function displays the information that the intersection area is passable.
  • the vehicle V is driven to pass through the intersection area.
  • step S54 it is determined whether it is necessary to stop before the intersection area. If it is determined that the vehicle does not need to stop, the process proceeds to step S52 and the obstacle detection is performed again. On the other hand, if it is determined that it is necessary to stop, the process proceeds to step S55, where the vehicle V is stopped in front of the intersection area, and the process proceeds to step S52.
  • step S61 of FIG. 3D the driving environment recognition function detects an obstacle present in the intersection area, and in the subsequent step S62, the passage determination function determines whether or not the intersection area is passable. If it is determined that the intersection area is passable, the process proceeds to step S69, where the notification function displays on the display device 18 that the intersection area is passable, and in subsequent step S70, the driving support function displays the information that the intersection area is passable. , the vehicle V is driven to pass through the intersection area.
  • step S63 it is determined whether it is necessary to stop before the intersection area. If it is determined that the vehicle does not need to stop, the process advances to step S61 and the obstacle detection is performed again. On the other hand, if it is determined that it is necessary to stop, the process proceeds to step S64, and the vehicle V is stopped in front of the intersection area.
  • step S65 the notification function determines whether the vehicle V has stopped for a longer time than a predetermined time. If it is determined that the stopping time of the vehicle V is longer than the predetermined time, the process proceeds to step S66, and the obstacles in the intersection area are classified into stationary obstacles and other obstacles, and in the subsequent step S67, the stopping time of the vehicle V is determined to be longer than the predetermined time. The cause of the stop is recognized and the cause of the stop is displayed on the display device 18 in step S68. After that, the process advances to step S61, and obstacle detection is performed again. On the other hand, if it is determined that the stopping time of the vehicle V is less than or equal to the predetermined time, the process advances to step S61 and the obstacle detection is performed again.
  • the present embodiment includes an acquisition unit 21 that acquires an intersection region where another moving object intersects with a movable region in a travel route R set by autonomous driving control, and a travel environment around the vehicle V. a recognition unit 22 that recognizes, a determination unit 23 that determines whether the vehicle V can pass through the intersection area based on the driving environment, and a determination unit 23 that determines whether the vehicle V can pass through the intersection area. If it is determined that this is not possible, and the stopping time of the vehicle V is longer than a predetermined time, the onboard terminal and/or electronic terminal in the vehicle V is notified of the reason why the vehicle V cannot pass through the intersection area.
  • An information providing device is provided, which includes a notification section 24 that provides information. Thereby, it is possible to suppress the anxiety felt by the occupants before the vehicle V departs.
  • the notification unit 24 when notifying the cause using the display device 18, the notification unit 24 adjusts the contrast of the display portion of the intersection area with respect to the display portion of the travel route R. At the same time, the degree of emphasis of the displayed portion of the factor is increased. Thereby, the occupant of the vehicle V can intuitively grasp the reason why the vehicle V stops.
  • the notifying unit 24 determines that the stopping time exceeds the predetermined time. Notification of the above-mentioned factors will begin from the time when Thereby, it is possible to suppress excessively emphasizing and displaying the cause of the vehicle V stopping and giving the occupants of the vehicle V a sense of discomfort.
  • the notification unit 24 displays the intersection area on the display device 18. changing a portion, or superimposing a message on the display portion of the intersection region that the intersection region is passable. Thereby, the occupant of the vehicle V can intuitively understand that the vehicle V can pass through the intersection area.
  • the notification unit 24 when notifying the cause using the display device 18, displays a portion of the display portion of the travel route R beyond the intersection area. , lowering the contrast with respect to the display portion around the travel route R, increasing the contrast of the display portion of the intersection area with respect to the display portion of the travel route R, and increasing the degree of emphasis of the display portion of the intersection area. Do at least one of the following: Thereby, the occupant of the vehicle V can intuitively grasp the reason why the vehicle V stops.
  • the notification unit 24 when notifying the cause using the display device 18, changes the color of the display portion of the cause and displays the cause. Execute at least one of enclosing the part in a rectangle or a circle. Thereby, the occupant of the vehicle V can intuitively grasp the reason why the vehicle V stops.
  • the recognition unit 22 classifies the obstacle into a stationary obstacle and other obstacles, and the notifying unit 24 notifies the stationary obstacles and other obstacles in different ways. Thereby, the occupant of the vehicle V can be prompted to perform a driving operation to avoid the stationary obstacle.
  • the notification unit 24 continues to notify the cause until the determination unit 23 determines that the vehicle V can pass through the intersection area. Thereby, the occupant of the vehicle V can be notified of the cause of the stoppage more reliably.
  • the determination unit 23 determines for each factor whether or not the vehicle V can pass through the intersection area, The notification unit 24 continues to notify each factor according to the determination result of the determination unit 23. This makes it possible to receive notifications for each cause of a stop.
  • the notification unit 24 includes a display mounted on the vehicle V, a display provided on a terminal for monitoring the running of the vehicle V, and a display on a terminal of an occupant of the vehicle. The factors are displayed on at least one of the displays. As a result, the person who supervises the running of the vehicle can also be notified of the cause of the stoppage.
  • the present embodiment is an information providing method executed using a processor, in which the processor acquires an intersecting area where another moving object intersects with a movable area in a driving route R set by autonomous driving control. , if the driving environment around the vehicle V is recognized, and based on the driving environment it is determined whether the vehicle V can pass through the intersection area, and if it is determined that the vehicle V cannot pass through the intersection area; and an information providing method of notifying an in-vehicle terminal and/or an electronic terminal in the vehicle V of the cause of the inability of the vehicle V to pass through the intersection area when the vehicle V is stopped for a longer time than a predetermined time. I will provide a. Thereby, it is possible to suppress the anxiety felt by the occupants before the vehicle V departs.
  • Driving support system 11... Imaging device 12... Distance measuring device 13... State detection device 14... Map information 15... Position detection device 16... Navigation device 17... Vehicle control device 171... Vehicle speed control device 172... Steering control device 18... Display Device 19...Driving support device (information providing device) 191...CPU (processor) 192...ROM 193...RAM 20... Support unit 21... Acquisition unit 22... Recognition unit 23... Judgment unit 24... Notification unit C1, C2, C3... Crosswalk I1, I2... Image L1, L2, L3, L4...

Landscapes

  • Engineering & Computer Science (AREA)
  • Transportation (AREA)
  • Mechanical Engineering (AREA)
  • Chemical & Material Sciences (AREA)
  • Combustion & Propulsion (AREA)
  • Automation & Control Theory (AREA)
  • Human Computer Interaction (AREA)
  • Traffic Control Systems (AREA)
PCT/IB2023/000134 2022-04-05 2023-03-17 情報提供装置及び情報提供方 法 Ceased WO2023194794A1 (ja)

Priority Applications (3)

Application Number Priority Date Filing Date Title
US18/853,600 US12570307B2 (en) 2022-04-05 2023-03-17 Information providing device and information providing method
JP2024513566A JP7768360B2 (ja) 2022-04-05 2023-03-17 情報提供装置及び情報提供方法
CN202380031636.XA CN118984789A (zh) 2022-04-05 2023-03-17 信息提供装置及信息提供方法

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2022-062782 2022-04-05
JP2022062782 2022-04-05

Publications (1)

Publication Number Publication Date
WO2023194794A1 true WO2023194794A1 (ja) 2023-10-12

Family

ID=88244154

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/IB2023/000134 Ceased WO2023194794A1 (ja) 2022-04-05 2023-03-17 情報提供装置及び情報提供方 法

Country Status (4)

Country Link
US (1) US12570307B2 (https=)
JP (1) JP7768360B2 (https=)
CN (1) CN118984789A (https=)
WO (1) WO2023194794A1 (https=)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2015008588A1 (ja) * 2013-07-19 2015-01-22 日産自動車株式会社 車両用運転支援装置及び車両用運転支援方法
JP2016177729A (ja) * 2015-03-23 2016-10-06 本田技研工業株式会社 車両用衝突回避支援装置
WO2018055731A1 (ja) * 2016-09-23 2018-03-29 日産自動車株式会社 運転支援方法及び運転支援装置
JP2018049445A (ja) * 2016-09-21 2018-03-29 日産自動車株式会社 運転支援方法及び運転支援装置

Family Cites Families (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3229832B2 (ja) * 1997-03-27 2001-11-19 富士通テン株式会社 ナビゲーション装置
JP4722433B2 (ja) * 2004-08-25 2011-07-13 アルパイン株式会社 車載用ナビゲーション装置
JP2007206014A (ja) * 2006-02-06 2007-08-16 Matsushita Electric Ind Co Ltd ナビゲーション装置
JP2009259257A (ja) * 2009-05-18 2009-11-05 Ryohei Komurasaki 交通整理支援方法、及び当該方法を実現する装置
WO2011148611A1 (ja) * 2010-05-24 2011-12-01 三菱電機株式会社 ナビゲーション装置
US10787172B2 (en) * 2017-05-19 2020-09-29 Nissan Motor Co., Ltd. Driving assistance device and driving assistance method
RU2721438C1 (ru) * 2017-05-24 2020-05-19 Ниссан Мотор Ко., Лтд. Способ помощи при движении устройством помощи при движении
JP6952778B2 (ja) * 2017-07-12 2021-10-20 三菱電機株式会社 運転支援装置および運転支援方法
JP7019239B2 (ja) 2017-08-02 2022-02-15 日産自動車株式会社 車両用表示方法及び車両用表示装置
JP6836206B2 (ja) * 2018-05-29 2021-02-24 株式会社デンソー 表示制御装置、及び表示制御プログラム
RU2768091C1 (ru) * 2018-07-12 2022-03-23 Ниссан Мотор Ко., Лтд. Способ помощи при вождении и устройство помощи при вождении
JP7439911B2 (ja) * 2020-04-15 2024-02-28 日産自動車株式会社 走行支援方法、及び、走行支援装置
CN112710321A (zh) * 2020-12-21 2021-04-27 戴姆勒股份公司 路口引导方法及路口引导装置

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2015008588A1 (ja) * 2013-07-19 2015-01-22 日産自動車株式会社 車両用運転支援装置及び車両用運転支援方法
JP2016177729A (ja) * 2015-03-23 2016-10-06 本田技研工業株式会社 車両用衝突回避支援装置
JP2018049445A (ja) * 2016-09-21 2018-03-29 日産自動車株式会社 運転支援方法及び運転支援装置
WO2018055731A1 (ja) * 2016-09-23 2018-03-29 日産自動車株式会社 運転支援方法及び運転支援装置

Also Published As

Publication number Publication date
CN118984789A (zh) 2024-11-19
JPWO2023194794A1 (https=) 2023-10-12
US12570307B2 (en) 2026-03-10
JP7768360B2 (ja) 2025-11-12
US20250236308A1 (en) 2025-07-24

Similar Documents

Publication Publication Date Title
KR102254750B1 (ko) 회전들을 위한 자율 차량들의 준비
US11900812B2 (en) Vehicle control device
US12319282B2 (en) Travel assistance method and travel assistance device for vehicle
JP7202208B2 (ja) 自動運転システム
JP7613608B2 (ja) 車両の走行支援方法及び走行支援装置
JP7521613B2 (ja) 表示制御装置及び表示制御方法
WO2023067793A1 (ja) 運転支援方法及び運転支援装置
JP7819573B2 (ja) 経路生成方法及び経路生成装置
JP7768360B2 (ja) 情報提供装置及び情報提供方法
JP7743933B2 (ja) 車両の運転支援方法及び運転支援装置
JP2023167861A (ja) 車両の運転支援方法及び運転支援装置
JP7782682B2 (ja) 情報提供装置及び情報提供方法
WO2024013997A1 (ja) 車両の運転支援方法及び運転支援装置
JP7826816B2 (ja) 運転支援方法及び運転支援装置
JP7826768B2 (ja) 運転支援方法及び運転支援装置
JP7428294B2 (ja) 走行支援方法及び走行支援装置
JP7532242B2 (ja) 走行支援方法および走行支援装置
JP7679267B2 (ja) 車両の走行制御方法および走行制御装置
WO2024069690A1 (ja) 運転支援方法及び運転支援装置
WO2024100855A1 (ja) 表示制御装置及び表示制御方法
JP2023154618A (ja) 運転支援方法及び運転支援装置
JP2021183450A (ja) 車両の走行支援方法および走行支援装置

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 23784410

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2024513566

Country of ref document: JP

Kind code of ref document: A

WWE Wipo information: entry into national phase

Ref document number: 202380031636.X

Country of ref document: CN

WWE Wipo information: entry into national phase

Ref document number: 18853600

Country of ref document: US

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 23784410

Country of ref document: EP

Kind code of ref document: A1

WWP Wipo information: published in national office

Ref document number: 18853600

Country of ref document: US

WWG Wipo information: grant in national office

Ref document number: 18853600

Country of ref document: US