WO2018172886A1 - Device and method for augmented reality driving assistance - Google Patents

Device and method for augmented reality driving assistance Download PDF

Info

Publication number
WO2018172886A1
WO2018172886A1 PCT/IB2018/051701 IB2018051701W WO2018172886A1 WO 2018172886 A1 WO2018172886 A1 WO 2018172886A1 IB 2018051701 W IB2018051701 W IB 2018051701W WO 2018172886 A1 WO2018172886 A1 WO 2018172886A1
Authority
WO
WIPO (PCT)
Prior art keywords
vehicle
path
data relating
head
transmitting
Prior art date
Application number
PCT/IB2018/051701
Other languages
French (fr)
Inventor
Benoît Chauveau
Original Assignee
Visteon Global Technologies, Inc.
Mclean, Robert
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Visteon Global Technologies, Inc., Mclean, Robert filed Critical Visteon Global Technologies, Inc.
Priority to EP18713019.0A priority Critical patent/EP3600938A1/en
Publication of WO2018172886A1 publication Critical patent/WO2018172886A1/en

Links

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60KARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60KARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/10Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60KARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/20Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
    • B60K35/21Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor using visual output, e.g. blinking lights or matrix displays
    • B60K35/23Head-up displays [HUD]
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60KARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/20Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
    • B60K35/28Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor characterised by the type of the output information, e.g. video entertainment or vehicle dynamics information; characterised by the purpose of the output information, e.g. for attracting the attention of the driver
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60KARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/20Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
    • B60K35/28Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor characterised by the type of the output information, e.g. video entertainment or vehicle dynamics information; characterised by the purpose of the output information, e.g. for attracting the attention of the driver
    • B60K35/285Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor characterised by the type of the output information, e.g. video entertainment or vehicle dynamics information; characterised by the purpose of the output information, e.g. for attracting the attention of the driver for improving awareness by directing driver's gaze direction or eye points
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60KARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/20Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
    • B60K35/29Instruments characterised by the way in which information is handled, e.g. showing information on plural displays or prioritising information according to driving conditions
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60KARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/80Arrangements for controlling instruments
    • B60K35/81Arrangements for controlling instruments for controlling displays
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60KARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/85Arrangements for transferring vehicle- or driver-related data
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01CMEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C21/00Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
    • G01C21/26Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network
    • G01C21/34Route searching; Route guidance
    • G01C21/36Input/output arrangements for on-board computers
    • G01C21/3626Details of the output of route guidance instructions
    • G01C21/365Guidance using head up displays or projectors, e.g. virtual vehicles or arrows projected on the windscreen or on the road itself
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01CMEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C21/00Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
    • G01C21/26Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network
    • G01C21/34Route searching; Route guidance
    • G01C21/36Input/output arrangements for on-board computers
    • G01C21/3626Details of the output of route guidance instructions
    • G01C21/3658Lane guidance
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60KARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/11Instrument graphical user interfaces or menu aspects
    • B60K2360/119Icons
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60KARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/16Type of output information
    • B60K2360/166Navigation
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60KARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/16Type of output information
    • B60K2360/167Vehicle dynamics information
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60KARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/16Type of output information
    • B60K2360/168Target or limit values
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60KARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/16Type of output information
    • B60K2360/177Augmented reality
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60KARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/16Type of output information
    • B60K2360/178Warnings
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60KARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/18Information management
    • B60K2360/188Displaying information using colour changes
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60KARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/20Optical features of instruments
    • B60K2360/21Optical features of instruments using cameras
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60KARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/20Optical features of instruments
    • B60K2360/33Illumination features
    • B60K2360/334Projection means
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60KARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/40Hardware adaptations for dashboards or instruments
    • B60K2360/48Sensors
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60KARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/592Data transfer involving external databases
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/0101Head-up displays characterised by optical features
    • G02B2027/014Head-up displays characterised by optical features comprising information/image processing systems

Definitions

  • the present invention relates to the field of augmented reality driving assistance devices of a vehicle on a lane and also relates to an associated head-up display device, an associated vehicle and an augmented reality driving assistance method.
  • Driving assistance devices for vehicles comprising a central display disposed at the dashboard of the vehicle and a camera disposed at the rear of the vehicle, are already known.
  • the central display allows displaying the image filmed by the camera when the driver reverses to give him an indication of the situation at the rear of the vehicle and without the need for him to turn his head towards the rear of the vehicle. It is possible to display, in addition to the image filmed by the camera, lines indicating to the driver the trajectory that the vehicle will take from data collected by the steering angle sensor steering wheel.
  • This function helps the driver when reversing and, especially, facilitates the parking of the vehicle.
  • an assistance device provides no indication to the driver of the situation at the front of the vehicle, the driver's attention is diverted to the central display and the result is that the driver is less attentive to the situation at the front of the vehicle.
  • U.S. Pat. 2014/0267398 describes an augmented reality system, device and method for safely guiding a vehicle driver with respect to pedestrians.
  • a vehicle navigator can detect a turn depending on the proximity of a vehicle approaching it.
  • a target sensor can detect a pedestrian entering the turn and a pedestrian crossing.
  • An indication to warn the driver of the proximity of a pedestrian can be displayed in a head-up display device in the background.
  • this assistance device does not provide the driver with other information useful to the driver to assist him in his driving.
  • the object of the present invention is to propose an improved solution making it possible to overcome at least the main limitations of the state of the art indicated above.
  • the present invention relates to an augmented reality driving assistance device of a vehicle on a lane comprising: a head-up display device suitable and intended to form at least one virtual image in a field of vision of a driver, at least one sensor for measuring the speed of the vehicle and/or a sensor for measuring the steering angle of the steering wheel of the vehicle, a communication module in communication with the head-up display device through first transmission means and with said measuring sensors through second transmission means, the assistance device is characterized in that it comprises: a computer suitable and intended for: acquiring in real time the vehicle speed and/or the steering angle of the steering wheel by means of the communication module, calculating an approximation of the vehicle's path according to the speed of the vehicle and/or the steering angle of the steering wheel, determining from the approximation of the vehicle's path a display signal representative of the vehicle's path, transmitting the display signal to the head-up display device to display a virtual image representative of the path of the vehicle superimposed on at least a portion of the lane in the driver's field
  • suitable and intended means “configured”, for example, a “computer suitable and intended” to perform certain functions, will be configured to perform those functions, for example on account of its hardware, firmware, software, etc.
  • the invention also relates to a vehicle characterized in that it comprises the assistance device as described above.
  • the invention also relates to a head-up display device characterized in that it comprises a computer suitable and intended for: acquiring in real time a vehicle speed and/or a steering angle of the steering wheel, calculating an approximation of the vehicle's path according to the speed of the vehicle and/or the steering angle of the steering wheel, determining from the approximation of the vehicle's path a display signal representative of the vehicle's path, transmitting the display signal to the head-up display device to display a virtual image representative of the vehicle's path superimposed on at least a portion of the lane in the driver's field of vision.
  • the invention also relates to an augmented reality driving assistance method of a vehicle on a lane comprising at least the following steps: measuring at least from a sensor measuring the vehicle speed and/or a sensor measuring the steering angle of the vehicle steering wheel, the vehicle speed and/or the steering angle of the vehicle steering wheel, transmitting to a communication module in communication with said measuring sensors through second transmission means, the speed of the vehicle and/or the steering angle of the steering wheel, transmitting to a computer in real time the speed of the vehicle and/or the steering angle of the steering wheel from the communication module, calculating by means of the computer an approximation of the vehicle's path according to the speed of the vehicle and/or the steering angle of the steering wheel, determining by means of the computer from the approximation of the vehicle's path a display signal representative of the vehicle's path, - transmitting the display signal to the head-up display device, displaying a virtual image representative of the vehicle's path superimposed on at least part of the lane in the driver's field of vision by means of the head
  • Figure 1 is a schematic view of the assistance device according to the invention implanted in a vehicle
  • Figure 2 is a view of the vehicle interior showing the dashboard and the windshield as well as the representative virtual image of the vehicle's path displayed by the head-up display device,
  • Figures 3A and 3B are representative views of the real image of the lane and of the environment seen by the driver, to which is superimposed the virtual image representative of the vehicle's path displayed by the head-up display device,
  • Figure 4A is a view of the actual image of the lane and the environment seen by the driver.
  • Figure 4B is a representative view of the real image of the lane and the environment seen by the driver, to which the virtual image representative of the vehicle's path is superposed, and a warning displayed by the head-up display device combined with a first or second or third or fourth or fifth warning virtual image.
  • the augmented reality driving assistance device of a vehicle 1 on a lane 2 comprises: - a head-up display device 3 suitable and intended to form at least one virtual image 5, 6 in a field of vision of a driver 4, at least one sensor for measuring the speed of the vehicle 1 and/or one sensor for measuring the steering angle of the steering wheel of the vehicle 1 , a communication module in communication with the head-up display device 3 through first transmission means and with said measuring sensors through second transmission means.
  • head-up display device 3 means a device comprising display means comprising a combiner or associated with the windshield 7 of the vehicle 1 to create a virtual image 5, 6 in the field of vision of the driver 4 ( Figure 1 ).
  • the head-up display device 3 may be, at least partially, integrated into the vehicle dashboard 1 .
  • the assistance device is characterized in that it comprises: a computer suitable and intended for: acquiring in real time the speed of the vehicle 1 and/or the steering angle of the steering wheel 9 from the communication module, calculating an approximation of the vehicle's path 1 according to the speed of the vehicle 1 and/or the steering angle of the steering wheel 9, determining from the approximation of the vehicle's path 1 a display signal representative of the vehicle's path 1 , transmitting the display signal to the head-up display device 3 to display a virtual image representative of the vehicle's path 5 superimposed on at least a portion of the lane 2 in the field of vision of the driver 4 ( Figures 2, 3A, 3B, 4B).
  • such an assistance device makes it possible to improve the safety of the driving conditions of a driver 4 in a vehicle 1 .
  • the driver 4 has at his disposal, directly in his field of vision, information in real time on the path that the vehicle 1 will follow. Since the virtual image representative of the vehicle's path displayed in the head-up display device is advantageously superimposed on the real image of the lane 2 and the environment ( Figure 4A), the driver 4 is able to analyze, anticipate and make decisions faster which improves security.
  • the assistance device according to the invention makes it possible to display a curved line or a surface representative of the shape of the turn, enabling the driver 4 to anticipate the turn and to adapt his driving ( Figures 3A, 3B and 4B).
  • the communication module may be a serial bus system, preferably a Controller Area Network (CAN) bus according to ISO 1 1898 standard.
  • CAN Controller Area Network
  • the senor for measuring the speed of the vehicle 1 may be a sensor of the speed of the wheels 8 of the vehicle 1 and may be arranged at the wheels 8 of the vehicle 1 .
  • the sensor for measuring the steering angle of the steering wheel 9 may be arranged at the steering wheel 9 of the vehicle 1 . It makes it possible to measure the deflection angle of the front wheels 8 of the vehicle 1 .
  • the speed measuring sensor and the steering angle measuring sensor of the steering wheel 9 may each comprise a microprocessor for transmitting the data relating to the speed or the steering angle of the steering wheel 9 to the CAN bus.
  • the speed measuring sensor of the vehicle 1 and the steering angle measuring sensor of the steering wheel 9 may preferentially be sensors already installed in the vehicle 1 .
  • the assistance device may include at least one measuring sensor for measuring climactic condition related data and/or a remote network including climactic condition related data.
  • the communication module may be in communication with said at least one sensor for measuring climactic conditions and/or said remote network through third transmission means and the computer may be suitable and intended for: acquiring real-time climactic data through the communication module, determining from the data relating to the climactic conditions a display signal representative of the climactic conditions, transmitting the display signal representative of the climactic conditions to the head-up display device 3 to display a virtual image representative of the vehicle's path 5 and a warning 6 relating to the climactic conditions.
  • the virtual image displayed is both representative of the vehicle's path 5, and a warning 6 to warn the driver 4 of current climactic conditions.
  • the driver 4 then has at his disposal, in addition to the information on the path, information on the climactic conditions directly in his field of vision.
  • the warning 6 may be a graphic representation or a metaphor informing the driver 4 that it is raining, for example in the form of a message.
  • the driver 4 can adapt his path or his speed according to this information.
  • the sensor for measuring climactic conditions may be a temperature, depression, hygrometry or similar probe that may be implanted in the vehicle 1 and is connected to the communication module, preferably to the CAN bus.
  • the remote network may be a remote server in which data relating to climactic conditions are stored.
  • means may be connected to the communication module so as to allow a wireless communication connected to the remote network which in this case forms the third transmission means.
  • Data on climactic conditions can be air temperature, atmospheric pressure, humidity rate, precipitation amount, wind direction. However, these examples are not limiting.
  • the assistance device may include at least one climactic condition measuring sensor for measuring climactic related data and/or a remote network including climactic data.
  • the communication module may be in communication with said at least one climactic condition measuring sensor and/or said remote network through third transmission means and the computer may be suitable and intended for: acquiring climactic data in real time through the communication module, comparing the climactic condition data and the data relating to the speed of the vehicle 1 and/or the steering angle of the steering wheel 9 to define a criticality level of the path and/or speed of the vehicle 1 based on the climactic condition data, determining from the criticality level a display signal representative of the criticality level of the path and/or the speed based on the climactic conditions, transmitting the display signal of the criticality level of the path and/or the speed, based on the climactic conditions, to the head-up display device 3 to display a virtual image representative of the vehicle's path 5 and a warning 6 relating to the criticality level of the
  • the virtual image displayed is both representative of the vehicle's path 5, and a warning 6 making it possible to warn the driver 4 of the level of dangerousness of his driving based on his speed and the climactic conditions.
  • the driver 4 then has at his disposal directly in his field of vision, in addition to the information on the path, information on the level of dangerousness of his driving.
  • the warning 6 may be a graphic representation or a metaphor informing the driver 4 that it is raining and that his speed is too high, for example in the form of a message.
  • the driver 4 can adapt his path or his speed based on this information.
  • the assistance device may comprise a navigation system for collecting data relating to a recommended route according to the geography of the lane 2.
  • the communication module may be in communication with the navigation module through fourth transmission means and the computer may be suitable and intended for: acquiring the data relating to a recommended route in real time through the communication module, determining from the data relating to a recommended route a display signal representative of the recommended route, transmitting the display signal representative of the recommended route to the head-up display device 3 to display a virtual image representative of the vehicle's path 5 and the recommended route of the vehicle 1 .
  • the virtual image displayed is both representative of the vehicle's path 5 and the route recommended by the navigation module.
  • the driver 4 then has at his disposal, directly in his field of vision, in addition to the information on the path, information on the route recommended by the navigation module.
  • the navigation module may be a global positioning system (GPS) device.
  • GPS global positioning system
  • the navigation module can be connected to the communication module, preferably to the CAN bus.
  • the assistance device may comprise at least one detection sensor of lane 2 for collecting data relating to a lane 2 departure of the vehicle 1 .
  • the communication module may be in communication with said at least one lane 2 detection sensor through fifth transmission means and the computer may be suitable and intended for: acquiring the data relating to a departure from lane 2 of the vehicle 1 in real time through the communication module, determining from the data relating to a departure from lane 2 of the vehicle 1 a display signal representative of a departure from lane 2 of the vehicle 1 , transmitting the display signal representative of the recommended route to the head-up display device 3 to display a virtual image representative of the vehicle's path 5 and a warning 6 relating to a lane departure of the vehicle 1 .
  • the virtual image displayed is both representative of the vehicle's path 5 and a warning 6 making it possible to warning the driver 4 of a lane departure of the vehicle 1 .
  • the driver 4 then has at his disposal, directly in his field of vision, in addition to information about the path, information allowing him to optimally rectify his path.
  • the lane detection sensor may consist of at least one camera which may be connected to the communication module, preferably to the CAN bus, or to an ADAS sensor management module outside the HUD.
  • the assistance device may comprise at least one module for correcting the path of vehicle 1 to collect data relating to the correction of the path of vehicle 1 .
  • the communication module may be in communication with said module for correcting the path of vehicle 1 through sixth transmission means and the computer can be suitable and intended for:
  • the communication module determining from the data relating to the correction of the path of vehicle 1 a display signal representative of the correction of the path of vehicle 1 , transmitting the display signal representative of the correction of the path of vehicle 1 to the head-up display device 3 to display a virtual image representative of the vehicle's path 5 and a warning 6 relating to the correction of the path of vehicle 1 .
  • the virtual image displayed is both representative of the vehicle's path 5 and a warning 6 making it possible to warning the driver 4 of a lane departure of the vehicle 1 .
  • the driver 4 then has at his disposal, directly in his field of vision, in addition to the information on the path, information allowing him to optimally rectify his path.
  • the module for correcting the path of vehicle 1 may be an ESP computer, also called programmed electrostabilizer, which can be connected to the communication module, preferably to the CAN bus.
  • the head-up display device 3 may comprise the computer.
  • the head- up display device 3 integrating the computer can receive the data generated by the different sensors and/or by the path correction module of the communication module, preferably by the CAN bus.
  • the display signal representative of the path of vehicle 1 is transmitted directly from the computer to the display device.
  • the computer can be connected to the communication module, preferably to the CAN bus or can be integrated in another computer, itself connected to the CAN bus.
  • the computer is then an entity separate from the head-up display device 3.
  • the head-up display device 3 may be devoid of a computer.
  • the display signal representative of the path of vehicle 1 can be transmitted from the computer to the display device through the CAN bus.
  • the representative virtual image of the vehicle's path 5 may be selected from a curved line ( Figures 2, 3A, 4B), a straight line, a surface ( Figure 3B) and a grid.
  • the representative virtual image of the vehicle's path 5 may be in color.
  • the representative virtual image of the vehicle's path 5 and a warning 6 may be selected from a curved line, a straight line, a surface or a grid combined with a graphic representation, preferably a pictogram (Figure 4B).
  • a graphic representation known to the driver 4 such as a pictogram, is ideal for forming a warning 6 and makes it possible to reduce the reaction time of the driver 4.
  • the representative virtual image of the vehicle's path 5 and a warning 6 relating to the criticality level of the path and/or the speed based on the climactic conditions may be selected from a curved line, a straight line, a surface, a grid, in color and the color may be based on the criticality level of the path and/or the speed of the vehicle 1 according to the data relating to the climactic conditions.
  • this virtual image may be red to indicate a danger to the driver 4 or green to indicate the absence of danger to the driver 4.
  • the invention also relates to a vehicle 1 characterized in that it comprises the assistance device as described above.
  • the invention also relates to a head-up display device 3 comprising a computer.
  • the head-up display device 3 is characterized in that the computer is suitable and intended for: acquiring in real time the speed of the vehicle 1 and/or the steering angle of the steering wheel 9, calculating an approximation of the path of vehicle 1 based on the speed of the vehicle 1 and/or the steering angle of the steering wheel 9, determining from the approximation of the path of vehicle 1 a display signal representative of the path of vehicle 1 , transmitting the display signal to the head-up display device 3 to display a virtual image representative of the vehicle's path 5 superimposed on at least a portion of the lane 2 in the field of vision of the driver 4.
  • the computer comprises all the other functions described previously allowing the display of a virtual image representative of the vehicle's path 5 and a warning 6 that may relate to: the climactic conditions, and/or the criticality level of the path and/or the speed based on the climactic conditions, and/or - the correction of the path of vehicle 1 , and/or a lane departure of the vehicle 1 , and/or a virtual image representative of the vehicle's path 5 and the recommended route.
  • the invention also relates to an augmented reality driving assistance method of a vehicle 1 on a lane 2 comprising at least the following steps: measuring at least from a speed measuring sensor of the vehicle 1 and/or a sensor for measuring the steering angle of the steering wheel 9 of the vehicle 1 , the speed of the vehicle 1 and/or the steering angle of the steering wheel 9, transmitting to a communication module in communication with said measuring sensors through second transmission means, the speed of the vehicle 1 and/or the steering angle of the steering wheel 9, transmitting to a computer in real time the speed of the vehicle 1 and/ or the steering angle of the steering wheel 9 from the communication module, calculating by means of the computer an approximation of the path of the vehicle 1 based on the speed of the vehicle 1 and/or the steering angle of the steering wheel 9, determining from the approximation of the path of vehicle 1 , using the computer, a display signal representative of the path of vehicle 1 , transmitting the display signal to the head-up display device 3, displaying a virtual image representative of the vehicle's path 5 superimposed on at least
  • the method may further comprise at least the following steps: measuring at least from a climatic condition measuring sensor data relating to climactic conditions and/or acquiring from a remote network data relating to climactic conditions, transmitting to a communication module in communication with said at least one climatic condition measuring sensor and/or said remote network, through third transmission means, the data relating to the climatic conditions, transmitting in real time from the communication module to the computer the data relating to the climatic conditions, determining from the data relating to the climatic conditions, using the computer, a display signal representative of the climatic conditions, - transmitting the display signal representative of the climatic conditions to the head-up display device 3, displaying a virtual image representative of the vehicle's path 5 and a warning 6 relating to the climatic conditions by means of the head-up display device 3.
  • the method may further comprise at least the following steps: measuring at least from a climatic condition measuring sensor data relating to climactic conditions and/or acquiring from a remote network data relating to climactic conditions, transmitting to a communication module in communication with said at least one climatic condition measuring sensor and/or said remote network, through third transmission means, the data relating to the climatic conditions, transmitting in real time from the communication module to the computer the data relating to the climatic conditions, comparing by means of the computer the data relating to the climatic conditions and the data relating to the speed of the vehicle 1 and/or the steering angle of the steering wheel 9 to define a criticality level of the path and/or the speed of the vehicle 1 based on climactic conditions, determining by means of the computer from the criticality level a display signal representative of the criticality level of the path and/or the speed according to the climatic conditions, transmitting the display signal of the criticality level of the path and/or the speed according to the climatic conditions, to the head-
  • the method may further comprise at least the following steps: measuring data relating to a recommended route according to the geography of lane 2 from a navigation module, transmitting to a communication module in communication with the navigation module through fourth means of transmission, the data relating to a recommended route, transmitting in real time from the communication module to the computer the data relating to a recommended route, determining from the data relating to a recommended path, using the computer, a display signal representative of the recommended route, transmitting the display signal representative of the recommended route to the head-up display device 3, - displaying a virtual image representative of the vehicle's path 5 and the recommended route of the vehicle 1 by means of the head-up display device 3.
  • the method may further comprise at least the following steps: measuring data relating to a vehicle departure from lane 2 from at least one detection sensor of lane 2, - transmitting to a communication module in communication with said at least one detection sensor of lane 2, through fifth transmission means, data relating to a departure of vehicle 1 from lane 2, transmitting in real time from the communication module to the computer the data relating to a departure of vehicle 1 from lane 2, - determining from the data relating to a departure of vehicle 1 from lane 2, using the computer, a display signal representative of a departure of vehicle 1 from lane 2, transmitting the display signal representative of the recommended path to the head-up display device 3, displaying a virtual image representative of the vehicle's path 5 and a warning 6 relating to a lane departure of the vehicle by means of the head-up display device 3.
  • the method may further comprise at least the following steps: measuring data relating to the correction of the path of the vehicle 1 from at least one correction module of the path of vehicle 1 , transmitting to the communication module, in communication with said correction module of the path of vehicle 1 , through sixth transmission means, the data relating to the correction of the path of vehicle 1 , transmitting in real time from the communication module to the computer the data relating to the correction of the path of vehicle 1 , determining from the data relating to the correction of the path of vehicle 1 , using the computer, a display signal representative of the correction of the path of vehicle 1 , transmitting the display signal representative of the correction of the path of vehicle 1 to the head-up display device 3, displaying a virtual image representative of the vehicle's path 5 and a warning 6 relating to the correction of the vehicle's path by means of the head-up display device 3.
  • the method which has just been described can be implemented by the driving assistance device as described above.

Landscapes

  • Engineering & Computer Science (AREA)
  • Chemical & Material Sciences (AREA)
  • Combustion & Propulsion (AREA)
  • Transportation (AREA)
  • Mechanical Engineering (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Automation & Control Theory (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Optics & Photonics (AREA)
  • Instrument Panels (AREA)
  • Traffic Control Systems (AREA)

Abstract

The present invention relates to an augmented reality driving assistance device of a vehicle (1) comprising: - a head-up display device, - a sensor for measuring the speed of the vehicle (1) and/or a sensor for measuring the steering angle of the steering wheel (9) of the vehicle (1), - a communication module in communication with the head-up display device and said measuring sensors, - a computer suitable and intended for: acquiring the speed of the vehicle (1) and/or the steering angle of the steering wheel (9), calculating an approximation of the path of vehicle (1), determining a display signal from the approximation of the path of vehicle (1), transmitting the display signal to the head-up display device to display a virtual image representative of the vehicle's path (5), superimposed on the lane (2) in the field of vision of the driver.

Description

DEVICE AND METHOD FOR AUGMENTED REALITY DRIVING ASSISTANCE
The present invention relates to the field of augmented reality driving assistance devices of a vehicle on a lane and also relates to an associated head-up display device, an associated vehicle and an augmented reality driving assistance method. Driving assistance devices for vehicles, comprising a central display disposed at the dashboard of the vehicle and a camera disposed at the rear of the vehicle, are already known. The central display allows displaying the image filmed by the camera when the driver reverses to give him an indication of the situation at the rear of the vehicle and without the need for him to turn his head towards the rear of the vehicle. It is possible to display, in addition to the image filmed by the camera, lines indicating to the driver the trajectory that the vehicle will take from data collected by the steering angle sensor steering wheel. This function helps the driver when reversing and, especially, facilitates the parking of the vehicle. However, such an assistance device provides no indication to the driver of the situation at the front of the vehicle, the driver's attention is diverted to the central display and the result is that the driver is less attentive to the situation at the front of the vehicle.
U.S. Pat. 2014/0267398 describes an augmented reality system, device and method for safely guiding a vehicle driver with respect to pedestrians. A vehicle navigator can detect a turn depending on the proximity of a vehicle approaching it. A target sensor can detect a pedestrian entering the turn and a pedestrian crossing. An indication to warn the driver of the proximity of a pedestrian can be displayed in a head-up display device in the background. However, this assistance device does not provide the driver with other information useful to the driver to assist him in his driving. The object of the present invention is to propose an improved solution making it possible to overcome at least the main limitations of the state of the art indicated above.
The present invention relates to an augmented reality driving assistance device of a vehicle on a lane comprising: a head-up display device suitable and intended to form at least one virtual image in a field of vision of a driver, at least one sensor for measuring the speed of the vehicle and/or a sensor for measuring the steering angle of the steering wheel of the vehicle, a communication module in communication with the head-up display device through first transmission means and with said measuring sensors through second transmission means, the assistance device is characterized in that it comprises: a computer suitable and intended for: acquiring in real time the vehicle speed and/or the steering angle of the steering wheel by means of the communication module, calculating an approximation of the vehicle's path according to the speed of the vehicle and/or the steering angle of the steering wheel, determining from the approximation of the vehicle's path a display signal representative of the vehicle's path, transmitting the display signal to the head-up display device to display a virtual image representative of the path of the vehicle superimposed on at least a portion of the lane in the driver's field of vision.
In this specification, the term "suitable and intended" means "configured", for example, a "computer suitable and intended" to perform certain functions, will be configured to perform those functions, for example on account of its hardware, firmware, software, etc.
The invention also relates to a vehicle characterized in that it comprises the assistance device as described above.
The invention also relates to a head-up display device characterized in that it comprises a computer suitable and intended for: acquiring in real time a vehicle speed and/or a steering angle of the steering wheel, calculating an approximation of the vehicle's path according to the speed of the vehicle and/or the steering angle of the steering wheel, determining from the approximation of the vehicle's path a display signal representative of the vehicle's path, transmitting the display signal to the head-up display device to display a virtual image representative of the vehicle's path superimposed on at least a portion of the lane in the driver's field of vision.
Finally, the invention also relates to an augmented reality driving assistance method of a vehicle on a lane comprising at least the following steps: measuring at least from a sensor measuring the vehicle speed and/or a sensor measuring the steering angle of the vehicle steering wheel, the vehicle speed and/or the steering angle of the vehicle steering wheel, transmitting to a communication module in communication with said measuring sensors through second transmission means, the speed of the vehicle and/or the steering angle of the steering wheel, transmitting to a computer in real time the speed of the vehicle and/or the steering angle of the steering wheel from the communication module, calculating by means of the computer an approximation of the vehicle's path according to the speed of the vehicle and/or the steering angle of the steering wheel, determining by means of the computer from the approximation of the vehicle's path a display signal representative of the vehicle's path, - transmitting the display signal to the head-up display device, displaying a virtual image representative of the vehicle's path superimposed on at least part of the lane in the driver's field of vision by means of the head-up display device.
The invention will be better understood thanks to the following description, which relates to several preferred embodiments, given by way of non-limiting examples, and explained with reference to the accompanying schematic drawings, in which:
Figure 1 is a schematic view of the assistance device according to the invention implanted in a vehicle, Figure 2 is a view of the vehicle interior showing the dashboard and the windshield as well as the representative virtual image of the vehicle's path displayed by the head-up display device,
Figures 3A and 3B are representative views of the real image of the lane and of the environment seen by the driver, to which is superimposed the virtual image representative of the vehicle's path displayed by the head-up display device,
Figure 4A is a view of the actual image of the lane and the environment seen by the driver, and
Figure 4B is a representative view of the real image of the lane and the environment seen by the driver, to which the virtual image representative of the vehicle's path is superposed, and a warning displayed by the head-up display device combined with a first or second or third or fourth or fifth warning virtual image.
The augmented reality driving assistance device of a vehicle 1 on a lane 2 comprises: - a head-up display device 3 suitable and intended to form at least one virtual image 5, 6 in a field of vision of a driver 4, at least one sensor for measuring the speed of the vehicle 1 and/or one sensor for measuring the steering angle of the steering wheel of the vehicle 1 , a communication module in communication with the head-up display device 3 through first transmission means and with said measuring sensors through second transmission means.
The term "head-up display device 3" means a device comprising display means comprising a combiner or associated with the windshield 7 of the vehicle 1 to create a virtual image 5, 6 in the field of vision of the driver 4 (Figure 1 ). Generally, the head-up display device 3 may be, at least partially, integrated into the vehicle dashboard 1 .
The term "communication module" means any means of data transmission, such as a serial bus system, integrated into the vehicle 1 . According to the invention, the assistance device is characterized in that it comprises: a computer suitable and intended for: acquiring in real time the speed of the vehicle 1 and/or the steering angle of the steering wheel 9 from the communication module, calculating an approximation of the vehicle's path 1 according to the speed of the vehicle 1 and/or the steering angle of the steering wheel 9, determining from the approximation of the vehicle's path 1 a display signal representative of the vehicle's path 1 , transmitting the display signal to the head-up display device 3 to display a virtual image representative of the vehicle's path 5 superimposed on at least a portion of the lane 2 in the field of vision of the driver 4 (Figures 2, 3A, 3B, 4B).
Advantageously, such an assistance device makes it possible to improve the safety of the driving conditions of a driver 4 in a vehicle 1 . Indeed, thanks to the invention, the driver 4 has at his disposal, directly in his field of vision, information in real time on the path that the vehicle 1 will follow. Since the virtual image representative of the vehicle's path displayed in the head-up display device is advantageously superimposed on the real image of the lane 2 and the environment (Figure 4A), the driver 4 is able to analyze, anticipate and make decisions faster which improves security. For example, the assistance device according to the invention makes it possible to display a curved line or a surface representative of the shape of the turn, enabling the driver 4 to anticipate the turn and to adapt his driving (Figures 3A, 3B and 4B).
Preferably, the communication module may be a serial bus system, preferably a Controller Area Network (CAN) bus according to ISO 1 1898 standard.
Preferably, the sensor for measuring the speed of the vehicle 1 may be a sensor of the speed of the wheels 8 of the vehicle 1 and may be arranged at the wheels 8 of the vehicle 1 .
Preferably, the sensor for measuring the steering angle of the steering wheel 9 may be arranged at the steering wheel 9 of the vehicle 1 . It makes it possible to measure the deflection angle of the front wheels 8 of the vehicle 1 .
The speed measuring sensor and the steering angle measuring sensor of the steering wheel 9 may each comprise a microprocessor for transmitting the data relating to the speed or the steering angle of the steering wheel 9 to the CAN bus.
The speed measuring sensor of the vehicle 1 and the steering angle measuring sensor of the steering wheel 9 may preferentially be sensors already installed in the vehicle 1 . Advantageously, it is not necessary to implant new ones.
The assistance device may include at least one measuring sensor for measuring climactic condition related data and/or a remote network including climactic condition related data. The communication module may be in communication with said at least one sensor for measuring climactic conditions and/or said remote network through third transmission means and the computer may be suitable and intended for: acquiring real-time climactic data through the communication module, determining from the data relating to the climactic conditions a display signal representative of the climactic conditions, transmitting the display signal representative of the climactic conditions to the head-up display device 3 to display a virtual image representative of the vehicle's path 5 and a warning 6 relating to the climactic conditions.
Advantageously, the virtual image displayed is both representative of the vehicle's path 5, and a warning 6 to warn the driver 4 of current climactic conditions. The driver 4 then has at his disposal, in addition to the information on the path, information on the climactic conditions directly in his field of vision. For example, the warning 6 may be a graphic representation or a metaphor informing the driver 4 that it is raining, for example in the form of a message. Advantageously, the driver 4 can adapt his path or his speed according to this information.
The sensor for measuring climactic conditions may be a temperature, depression, hygrometry or similar probe that may be implanted in the vehicle 1 and is connected to the communication module, preferably to the CAN bus.
The remote network may be a remote server in which data relating to climactic conditions are stored. In this case, means may be connected to the communication module so as to allow a wireless communication connected to the remote network which in this case forms the third transmission means.
Data on climactic conditions can be air temperature, atmospheric pressure, humidity rate, precipitation amount, wind direction. However, these examples are not limiting.
The assistance device may include at least one climactic condition measuring sensor for measuring climactic related data and/or a remote network including climactic data. The communication module may be in communication with said at least one climactic condition measuring sensor and/or said remote network through third transmission means and the computer may be suitable and intended for: acquiring climactic data in real time through the communication module, comparing the climactic condition data and the data relating to the speed of the vehicle 1 and/or the steering angle of the steering wheel 9 to define a criticality level of the path and/or speed of the vehicle 1 based on the climactic condition data, determining from the criticality level a display signal representative of the criticality level of the path and/or the speed based on the climactic conditions, transmitting the display signal of the criticality level of the path and/or the speed, based on the climactic conditions, to the head-up display device 3 to display a virtual image representative of the vehicle's path 5 and a warning 6 relating to the criticality level of the path and/or the speed based on the climactic conditions.
Advantageously, the virtual image displayed is both representative of the vehicle's path 5, and a warning 6 making it possible to warn the driver 4 of the level of dangerousness of his driving based on his speed and the climactic conditions. The driver 4 then has at his disposal directly in his field of vision, in addition to the information on the path, information on the level of dangerousness of his driving. For example, the warning 6 may be a graphic representation or a metaphor informing the driver 4 that it is raining and that his speed is too high, for example in the form of a message. Advantageously, the driver 4 can adapt his path or his speed based on this information.
The assistance device may comprise a navigation system for collecting data relating to a recommended route according to the geography of the lane 2. The communication module may be in communication with the navigation module through fourth transmission means and the computer may be suitable and intended for: acquiring the data relating to a recommended route in real time through the communication module, determining from the data relating to a recommended route a display signal representative of the recommended route, transmitting the display signal representative of the recommended route to the head-up display device 3 to display a virtual image representative of the vehicle's path 5 and the recommended route of the vehicle 1 . Advantageously, the virtual image displayed is both representative of the vehicle's path 5 and the route recommended by the navigation module. The driver 4 then has at his disposal, directly in his field of vision, in addition to the information on the path, information on the route recommended by the navigation module.
The navigation module may be a global positioning system (GPS) device. The navigation module can be connected to the communication module, preferably to the CAN bus.
The assistance device may comprise at least one detection sensor of lane 2 for collecting data relating to a lane 2 departure of the vehicle 1 . The communication module may be in communication with said at least one lane 2 detection sensor through fifth transmission means and the computer may be suitable and intended for: acquiring the data relating to a departure from lane 2 of the vehicle 1 in real time through the communication module, determining from the data relating to a departure from lane 2 of the vehicle 1 a display signal representative of a departure from lane 2 of the vehicle 1 , transmitting the display signal representative of the recommended route to the head-up display device 3 to display a virtual image representative of the vehicle's path 5 and a warning 6 relating to a lane departure of the vehicle 1 .
Advantageously, the virtual image displayed is both representative of the vehicle's path 5 and a warning 6 making it possible to warning the driver 4 of a lane departure of the vehicle 1 . The driver 4 then has at his disposal, directly in his field of vision, in addition to information about the path, information allowing him to optimally rectify his path.
The lane detection sensor may consist of at least one camera which may be connected to the communication module, preferably to the CAN bus, or to an ADAS sensor management module outside the HUD.
The assistance device may comprise at least one module for correcting the path of vehicle 1 to collect data relating to the correction of the path of vehicle 1 . The communication module may be in communication with said module for correcting the path of vehicle 1 through sixth transmission means and the computer can be suitable and intended for:
acquiring in real time the data relating to the correction of the path of vehicle
1 through the communication module, determining from the data relating to the correction of the path of vehicle 1 a display signal representative of the correction of the path of vehicle 1 , transmitting the display signal representative of the correction of the path of vehicle 1 to the head-up display device 3 to display a virtual image representative of the vehicle's path 5 and a warning 6 relating to the correction of the path of vehicle 1 . Advantageously, the virtual image displayed is both representative of the vehicle's path 5 and a warning 6 making it possible to warning the driver 4 of a lane departure of the vehicle 1 . The driver 4 then has at his disposal, directly in his field of vision, in addition to the information on the path, information allowing him to optimally rectify his path.
The module for correcting the path of vehicle 1 may be an ESP computer, also called programmed electrostabilizer, which can be connected to the communication module, preferably to the CAN bus.
The head-up display device 3 may comprise the computer. In this case, the head- up display device 3 integrating the computer can receive the data generated by the different sensors and/or by the path correction module of the communication module, preferably by the CAN bus. In this case, the display signal representative of the path of vehicle 1 is transmitted directly from the computer to the display device.
Alternatively, the computer can be connected to the communication module, preferably to the CAN bus or can be integrated in another computer, itself connected to the CAN bus. The computer is then an entity separate from the head-up display device 3. In these cases, the head-up display device 3 may be devoid of a computer. In these cases, the display signal representative of the path of vehicle 1 can be transmitted from the computer to the display device through the CAN bus.
The representative virtual image of the vehicle's path 5 may be selected from a curved line (Figures 2, 3A, 4B), a straight line, a surface (Figure 3B) and a grid. The representative virtual image of the vehicle's path 5 may be in color.
The representative virtual image of the vehicle's path 5 and a warning 6 may be selected from a curved line, a straight line, a surface or a grid combined with a graphic representation, preferably a pictogram (Figure 4B).
The use of a graphic representation known to the driver 4, such as a pictogram, is ideal for forming a warning 6 and makes it possible to reduce the reaction time of the driver 4.
The representative virtual image of the vehicle's path 5 and a warning 6 relating to the criticality level of the path and/or the speed based on the climactic conditions may be selected from a curved line, a straight line, a surface, a grid, in color and the color may be based on the criticality level of the path and/or the speed of the vehicle 1 according to the data relating to the climactic conditions.
For example, this virtual image may be red to indicate a danger to the driver 4 or green to indicate the absence of danger to the driver 4. The invention also relates to a vehicle 1 characterized in that it comprises the assistance device as described above.
The invention also relates to a head-up display device 3 comprising a computer.
According to the invention, the head-up display device 3 is characterized in that the computer is suitable and intended for: acquiring in real time the speed of the vehicle 1 and/or the steering angle of the steering wheel 9, calculating an approximation of the path of vehicle 1 based on the speed of the vehicle 1 and/or the steering angle of the steering wheel 9, determining from the approximation of the path of vehicle 1 a display signal representative of the path of vehicle 1 , transmitting the display signal to the head-up display device 3 to display a virtual image representative of the vehicle's path 5 superimposed on at least a portion of the lane 2 in the field of vision of the driver 4.
In this case, the computer comprises all the other functions described previously allowing the display of a virtual image representative of the vehicle's path 5 and a warning 6 that may relate to: the climactic conditions, and/or the criticality level of the path and/or the speed based on the climactic conditions, and/or - the correction of the path of vehicle 1 , and/or a lane departure of the vehicle 1 , and/or a virtual image representative of the vehicle's path 5 and the recommended route.
The invention also relates to an augmented reality driving assistance method of a vehicle 1 on a lane 2 comprising at least the following steps: measuring at least from a speed measuring sensor of the vehicle 1 and/or a sensor for measuring the steering angle of the steering wheel 9 of the vehicle 1 , the speed of the vehicle 1 and/or the steering angle of the steering wheel 9, transmitting to a communication module in communication with said measuring sensors through second transmission means, the speed of the vehicle 1 and/or the steering angle of the steering wheel 9, transmitting to a computer in real time the speed of the vehicle 1 and/ or the steering angle of the steering wheel 9 from the communication module, calculating by means of the computer an approximation of the path of the vehicle 1 based on the speed of the vehicle 1 and/or the steering angle of the steering wheel 9, determining from the approximation of the path of vehicle 1 , using the computer, a display signal representative of the path of vehicle 1 , transmitting the display signal to the head-up display device 3, displaying a virtual image representative of the vehicle's path 5 superimposed on at least a portion of the lane 2 in the field of vision of the driver 4 by means of the head-up display device 3.
The method may further comprise at least the following steps: measuring at least from a climatic condition measuring sensor data relating to climactic conditions and/or acquiring from a remote network data relating to climactic conditions, transmitting to a communication module in communication with said at least one climatic condition measuring sensor and/or said remote network, through third transmission means, the data relating to the climatic conditions, transmitting in real time from the communication module to the computer the data relating to the climatic conditions, determining from the data relating to the climatic conditions, using the computer, a display signal representative of the climatic conditions, - transmitting the display signal representative of the climatic conditions to the head-up display device 3, displaying a virtual image representative of the vehicle's path 5 and a warning 6 relating to the climatic conditions by means of the head-up display device 3. The method may further comprise at least the following steps: measuring at least from a climatic condition measuring sensor data relating to climactic conditions and/or acquiring from a remote network data relating to climactic conditions, transmitting to a communication module in communication with said at least one climatic condition measuring sensor and/or said remote network, through third transmission means, the data relating to the climatic conditions, transmitting in real time from the communication module to the computer the data relating to the climatic conditions, comparing by means of the computer the data relating to the climatic conditions and the data relating to the speed of the vehicle 1 and/or the steering angle of the steering wheel 9 to define a criticality level of the path and/or the speed of the vehicle 1 based on climactic conditions, determining by means of the computer from the criticality level a display signal representative of the criticality level of the path and/or the speed according to the climatic conditions, transmitting the display signal of the criticality level of the path and/or the speed according to the climatic conditions, to the head-up display device 3, displaying a virtual image representative of the vehicle's path 5 and a warning 6 relating to the criticality level of the path and/or the speed according to the climatic conditions by means of the head-up display device 3.
The method may further comprise at least the following steps: measuring data relating to a recommended route according to the geography of lane 2 from a navigation module, transmitting to a communication module in communication with the navigation module through fourth means of transmission, the data relating to a recommended route, transmitting in real time from the communication module to the computer the data relating to a recommended route, determining from the data relating to a recommended path, using the computer, a display signal representative of the recommended route, transmitting the display signal representative of the recommended route to the head-up display device 3, - displaying a virtual image representative of the vehicle's path 5 and the recommended route of the vehicle 1 by means of the head-up display device 3.
The method may further comprise at least the following steps: measuring data relating to a vehicle departure from lane 2 from at least one detection sensor of lane 2, - transmitting to a communication module in communication with said at least one detection sensor of lane 2, through fifth transmission means, data relating to a departure of vehicle 1 from lane 2, transmitting in real time from the communication module to the computer the data relating to a departure of vehicle 1 from lane 2, - determining from the data relating to a departure of vehicle 1 from lane 2, using the computer, a display signal representative of a departure of vehicle 1 from lane 2, transmitting the display signal representative of the recommended path to the head-up display device 3, displaying a virtual image representative of the vehicle's path 5 and a warning 6 relating to a lane departure of the vehicle by means of the head-up display device 3.
The method may further comprise at least the following steps: measuring data relating to the correction of the path of the vehicle 1 from at least one correction module of the path of vehicle 1 , transmitting to the communication module, in communication with said correction module of the path of vehicle 1 , through sixth transmission means, the data relating to the correction of the path of vehicle 1 , transmitting in real time from the communication module to the computer the data relating to the correction of the path of vehicle 1 , determining from the data relating to the correction of the path of vehicle 1 , using the computer, a display signal representative of the correction of the path of vehicle 1 , transmitting the display signal representative of the correction of the path of vehicle 1 to the head-up display device 3, displaying a virtual image representative of the vehicle's path 5 and a warning 6 relating to the correction of the vehicle's path by means of the head-up display device 3.
Advantageously, the method which has just been described can be implemented by the driving assistance device as described above.
Of course, the invention is not limited to the embodiments described and shown in the accompanying drawings. Modifications are possible, in particular from the point of view of the constitution of the various elements or by substitution of technical equivalents, without departing thereby from the scope of protection of the invention.

Claims

1 . An augmented reality driving assistance device of a vehicle (1 ) on a lane (2) comprising: - a head-up display device (3) suitable and intended to form at least one virtual image (5, 6) in a field of vision of a driver (4), at least one speed measuring sensor of the vehicle (1 ) and/or a sensor for measuring the steering angle of the steering wheel (9) of the vehicle (1 ), a communication module in communication with the head-up display device (3) through first transmission means and with said measuring sensors through second transmission means, the assistance device being characterized in that it comprises: - a computer suitable and intended for: acquiring in real time the speed of the vehicle (1 ) and/or the steering angle of the steering wheel (9) through the communication module, calculating an approximation of the path of the vehicle (1 ) according to the speed of the vehicle (1 ) and/or the steering angle of the steering wheel (9), determining from the approximation of the path of the vehicle (1 ) a display signal representative of the path of the vehicle (1 ) transmitting the display signal to the head-up display device (3) to display a virtual image representative of the vehicle's path (5) superimposed on at least a portion of the lane (2) in the field of vision of the driver (4).
2. The device according to Claim 1 , characterized in that it comprises at least one climatic condition measuring sensor for measuring data relating to climatic conditions and/or a remote network comprising data relating to climatic conditions, in that the communication module is in communication with said at least one climatic condition measuring sensor and/or said remote network through third transmission means, and in that the computer is suitable and intended for: acquiring data relating to climactic conditions in real-time weather through the communication module, determining, from the data relating to climatic conditions, a display signal representative of the climatic conditions, transmitting the display signal representative of the climatic conditions to the head-up display device (3) to display a representative virtual image of the vehicle's path (5) and a warning (6) relating to climatic conditions.
3. The device according to Claim 1 , characterized in that it comprises at least one climatic condition measuring sensor for measuring data relating to climatic conditions and/or a remote network comprising data relating to climatic conditions, in that the communication module is in communication with said at least one climatic condition measuring sensor and/or said remote network through third transmission means, and in that the computer is suitable and intended for: acquiring data relating to climactic conditions in real-time weather through the communication module, comparing the data relating to the climatic conditions and the data relating to the speed of the vehicle (1 ) and/or the steering angle of the steering wheel (9) to define a criticality level of the path and/or the speed of the vehicle (1 ) based on the data relating to the climatic conditions, determining, from the criticality level, a display signal representative of the criticality level of the path and/or the speed based on the climatic conditions, transmitting the display signal of the criticality level of the path and/or the speed based on the climatic conditions, to the head-up display device (3) to display a representative virtual image of the vehicle's path (5) and a warning (6) relative to the criticality level of the path and/or the speed based on the climatic conditions.
4. The device according to any one of Claims 1 to 3, characterized in that it comprises a navigation module for collecting data relating to a route according to the geography of the lane (2), in that the communication module is in communication with the navigation module through fourth transmission means, and in that the computer is suitable and intended for: acquiring, in real time, the data relating to a recommended route through the communication module, determining a display signal representative of the recommended route from the data relating to a recommended route, transmitting the display signal representative of the recommended route to the head- up display device (3) to display a virtual image representative of the vehicle's path (5) and the recommended route of the vehicle (1 ).
5. The device according to any one of Claims 1 to 4, characterized in that it comprises at least one detection sensor of lane (2) for collecting data relating to a departure from lane (2) of vehicle (1 ), in that the communication module is in communication with said at least one detection sensor of lane (2) through fifth transmission means, and in that the computer is suitable and intended for: acquiring the data relating to a departure from lane (2) of the vehicle (1 ), in real time, through the communication module, determining from the data relating to a departure from lane (2) of the vehicle (1 ), a display signal representative of a departure from lane (2) of the vehicle (1 ), transmitting the display signal representative of the recommended path to the head- up display device (3) to display a virtual image representative of the vehicle's path (5) and a warning (6) relating to a departure from lane (2) of the vehicle (1 ).
6. The device according to any one of Claims 1 to 5, characterized in that it comprises at least one correction module of the path of vehicle (1 ) for collecting data relating to the correction of the path of vehicle (1 ), in that the communication module is in communication with said correction module of the path of vehicle (1 ), through sixth means of transmission, and in that the computer is suitable and intended for: acquiring, in real time, the data relating to the correction of the path of vehicle (1 ) through the communication module, determining from the data relating to the correction of the path of vehicle (1 ) a display signal representative of the correction of the path of vehicle (1 ), transmitting the display signal representative of the correction of the path of vehicle (1 ) to the head-up display device (3) to display a virtual image representative of the vehicle's path (5) and a warning (6) relative to the correction of the path of vehicle
(1 )-
7. The device according to any one of Claims 1 to 6, characterized in that the head-up display device (3) comprises the computer.
8. The device according to any one of Claims 1 to 7, characterized in that the virtual image representative of the vehicle's path (5) is selected from a curved line, a straight line, a surface or a grid.
9. The device according to any one of Claims 1 to 8, characterized in that the virtual image representative of the vehicle's path (5) is in color.
10. The device according to any one of Claims 1 to 9, characterized in that the virtual image representative of the vehicle's path (5) and a warning (6) is selected from a curved line, a straight line, a surface, a grid combined with a graphic representation or a metaphor, preferably a pictogram.
1 1 . Device according to Claims 3 to 10, characterized in that the virtual image representative of the vehicle's path (5) and a warning (6) relative to the criticality level of the path and/or speed based on climatic conditions is selected from a curved line, a straight line, a surface, a color grid, and in that the color is a function of the criticality level of the path and/or the speed of the vehicle (1 ) based on climatic conditions.
12. A vehicle (1 ) characterized in that it comprises the assistance device according to any one of Claims 1 to 1 1 .
13. A head-up display device (3) comprising a computer, head-up display device (3), characterized in that the computer is suitable and intended for: acquiring, in real time, the speed of the vehicle (1 ) and/or the steering angle of the steering wheel (9), calculating an approximation of the path of vehicle (1 ) according to the speed of the vehicle (1 ) and/or the steering angle of the steering wheel (9), - determining, from the approximation of the path of vehicle (1 ), a display signal representative of the path of vehicle (1 ),
- transmitting the display signal to the head-up display device (3) to display a virtual image representative of the vehicle's path (5), superimposed on at least a portion of the lane (2) in the field of vision of the driver (4).
14. An augmented reality driving assistance method in a vehicle (1 ) on a lane (2) comprising at least the following steps:
- measuring at least, from a speed measuring sensor of the vehicle (1 ) and/or a sensor for measuring the steering angle of the steering wheel (9) of the vehicle (1 ), the speed of the vehicle (1 ) and/or the steering angle of the steering wheel (9), - transmitting to a communication module, in communication with said measuring sensors through second transmission means, the speed of the vehicle (1 ) and/or the steering angle of the steering wheel (9),
- transmitting, in real time, from the communication module to a computer, the speed of the vehicle (1 ) and/or the steering angle of the steering wheel (9), - calculating, using the computer, an approximation of the path of vehicle (1 ) according to the speed of the vehicle (1 ) and/or the steering angle of the steering wheel (9),
- determining, using the computer, from the approximation of the path of vehicle (1 ) a display signal representative of the path of vehicle (1 ), - transmitting the display signal to the head-up display device (3),
- displaying a virtual image representative of the vehicle's path (5), superimposed on at least a portion of the lane (2) in the field of vision of the driver (4) by means of the head-up display device (3).
15. The method according to Claim 14, characterized in that it further comprises at least the following steps:
- measuring, at least from a climatic condition measuring sensor, data relating to climatic conditions, and / or acquiring from a remote network data relating to climatic conditions,
- transmitting to a communication module, in communication with said at least one climatic condition measuring sensor and/or said remote network through third transmission means, the data relating to the climatic conditions,
- transmitting to the computer the data relating to the conditions in real time from the communication module,
- determining, from the data relating to climatic conditions, using the computer, a display signal representative of the climatic conditions,
- transmitting the display signal representative of the climatic conditions to the head- up display device (3), - displaying a virtual image representative of the vehicle's path (5) and a warning (6) relating to the climatic conditions by means of the head-up display device (3).
16. The method according to Claim 14, characterized in that it further comprises at least the following steps:
- measuring, at least, data relating to the climatic conditions from a climatic condition measuring sensor, and/or acquiring data relating to the climatic conditions from a remote network,
- transmitting to a communication module, in communication with said at least one climatic condition measuring sensor and/or said remote network through third transmission means, the data relating to the climatic conditions, - transmitting, in real time, from the communication module to the computer, the data relating to the climatic conditions,
- comparing, using the computer, the data relating to the climatic conditions and the data relating to the speed of the vehicle (1 ) and/or the steering angle of the steering wheel (9) to define a level of criticality of the path and/or the speed of the vehicle (1 ) based on the data relating to the climatic conditions,
- determining, using the computer, from the criticality level, a display signal representative of the criticality level of the path and/or the speed based on the climatic conditions,
- transmitting the display signal of the criticality level of the path and/or the speed, based on the climatic conditions, to the head-up display device (3),
- displaying a virtual image representative of the vehicle's path (5) and a warning (6) relative to the criticality level of the path and or the speed based on the climatic conditions by means of the head-up display device (3).
17. The method according to any one of Claims 14 to 16, characterized in that it further comprises at least the following steps:
- measuring data relating to a recommended route according to the geography of the lane (2) from a navigation module, - transmitting to a communication module, in communication with the navigation module through fourth means of transmission, the data relating to a recommended path,
- transmitting, in real time, from the communication module to the computer, the data relating to a recommended route, - determining, using the computer, from the data relating to a recommended route, a display signal representative of the recommended route,
- transmitting the display signal representative of the recommended route to the head-up display device (3),
- displaying a virtual image representative of the vehicle's path (5) and the recommended route of the vehicle (1 ) by means of the head-up display device (3).
18. The method according to any one of Claims 14 to 17, characterized in that it further comprises at least the following steps: - measuring data relating to a departure from lane (2) of the vehicle (1 ) from at least one detection sensor of lane (2),
- transmitting to a communication module, in communication with said at least one detection sensor of lane (2) through fifth transmission means, data relating to a departure from lane (2) of the vehicle (1 ),
- transmitting, in real time, from the communication module to the computer, the data relating to a departure from lane (2) of the vehicle (1 ),
- determining, using the computer, from the data relating to a departure from lane (2) of the vehicle (1 )), a display signal representative of a departure from lane (2) of the vehicle (1 ),
- transmitting the display signal representative of the recommended path to the head-up display device (3),
- displaying a virtual image representative of the vehicle's path (5) and a warning (6) relating to a lane departure of the vehicle by means of the head-up display device (3).
19. The method according to any one of Claims 14 to 18, characterized in that it further comprises at least the following steps:
- measuring data relating to the correction of the path of vehicle (1 ) from at least one correction module of the path of vehicle (1 ), - transmitting to the communication module, in communication with said correction module of the path of vehicle (1 ) through sixth transmission means, the data relating to the correction of the path of vehicle (1 ),
- transmitting, in real time, from the communication module to the computer, the data relating to the correction of the path of vehicle (1 ), - determining, using the computer, from the correction data of the path of the vehicle (1 ) a display signal representative of the correction of the path of vehicle (1 ),
- transmitting the display signal representative of the correction of the path of vehicle (1 ) to the head-up display device (3), - displaying a virtual image representative of the vehicle's path (5) and a warning (6) relating to the correction of the vehicle's path by means of the head-up display device (3).
PCT/IB2018/051701 2017-03-21 2018-03-14 Device and method for augmented reality driving assistance WO2018172886A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
EP18713019.0A EP3600938A1 (en) 2017-03-21 2018-03-14 Device and method for augmented reality driving assistance

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
FR1752298 2017-03-21
FR1752298A FR3064372A1 (en) 2017-03-21 2017-03-21 VEHICLE INCREASED DRIVING ASSISTANCE ASSISTANCE DEVICE, ASSOCIATED VEHICLE ASSOCIATED VEHICLE DISPLAY DEVICE, AND ASSOCIATED METHOD

Publications (1)

Publication Number Publication Date
WO2018172886A1 true WO2018172886A1 (en) 2018-09-27

Family

ID=58707868

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/IB2018/051701 WO2018172886A1 (en) 2017-03-21 2018-03-14 Device and method for augmented reality driving assistance

Country Status (3)

Country Link
EP (1) EP3600938A1 (en)
FR (1) FR3064372A1 (en)
WO (1) WO2018172886A1 (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20220169298A1 (en) * 2019-02-27 2022-06-02 Honda Motor Co., Ltd. Steering operation element
US11376963B2 (en) * 2020-04-23 2022-07-05 Hyundai Motor Company User interface generating apparatus and method for vehicle
JP2022549148A (en) * 2019-10-24 2022-11-24 ネイバーラボス コーポレーション Driving information guidance method and system
US20230121388A1 (en) * 2021-10-14 2023-04-20 Taslim Arefin Khan Systems and methods for prediction-based driver assistance
US11705007B2 (en) * 2021-02-18 2023-07-18 Toyota Jidosha Kabushiki Kaisha Vehicle display device

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
FR3087734B1 (en) * 2018-10-24 2020-11-27 Institut De Recherche Tech Systemx DRIVING ASSISTANCE PROCESS, ASSOCIATED SYSTEM AND VEHICLE
FR3127165A1 (en) 2021-09-22 2023-03-24 Psa Automobiles Sa Method and device for aiding driving in augmented reality

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102007063226A1 (en) * 2007-12-31 2009-07-02 Still Gmbh Driving assistance providing method for industrial truck i.e. fork-lift truck, involves determining possible traffic lane of industrial truck through computing unit on basis of longitudinal axis, and displaying lane on screen
DE102009027026A1 (en) * 2009-06-18 2010-12-23 Robert Bosch Gmbh Generation and display of virtual road marking for driver following curve, combines data from navigational and optical interfaces for representation in head-up display
DE102011121948A1 (en) * 2011-12-22 2013-06-27 Gm Global Technology Operations, Llc Perspective on actions of an autonomous driving system
US20140267398A1 (en) 2013-03-14 2014-09-18 Honda Motor Co., Ltd Augmented reality heads up display (hud) for yield to pedestrian safety cues
EP2988098A1 (en) * 2014-08-22 2016-02-24 Toyota Jidosha Kabushiki Kaisha Driver assistance system with non-static symbol of fluctuating shape

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102007063226A1 (en) * 2007-12-31 2009-07-02 Still Gmbh Driving assistance providing method for industrial truck i.e. fork-lift truck, involves determining possible traffic lane of industrial truck through computing unit on basis of longitudinal axis, and displaying lane on screen
DE102009027026A1 (en) * 2009-06-18 2010-12-23 Robert Bosch Gmbh Generation and display of virtual road marking for driver following curve, combines data from navigational and optical interfaces for representation in head-up display
DE102011121948A1 (en) * 2011-12-22 2013-06-27 Gm Global Technology Operations, Llc Perspective on actions of an autonomous driving system
US20140267398A1 (en) 2013-03-14 2014-09-18 Honda Motor Co., Ltd Augmented reality heads up display (hud) for yield to pedestrian safety cues
EP2988098A1 (en) * 2014-08-22 2016-02-24 Toyota Jidosha Kabushiki Kaisha Driver assistance system with non-static symbol of fluctuating shape

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20220169298A1 (en) * 2019-02-27 2022-06-02 Honda Motor Co., Ltd. Steering operation element
US11952032B2 (en) * 2019-02-27 2024-04-09 Honda Motor Co., Ltd. Steering wheel with display and light source
JP2022549148A (en) * 2019-10-24 2022-11-24 ネイバーラボス コーポレーション Driving information guidance method and system
JP7365500B2 (en) 2019-10-24 2023-10-19 ネイバーラボス コーポレーション Driving information guidance method and system
US11376963B2 (en) * 2020-04-23 2022-07-05 Hyundai Motor Company User interface generating apparatus and method for vehicle
US11705007B2 (en) * 2021-02-18 2023-07-18 Toyota Jidosha Kabushiki Kaisha Vehicle display device
US20230121388A1 (en) * 2021-10-14 2023-04-20 Taslim Arefin Khan Systems and methods for prediction-based driver assistance
US11794766B2 (en) * 2021-10-14 2023-10-24 Huawei Technologies Co., Ltd. Systems and methods for prediction-based driver assistance

Also Published As

Publication number Publication date
EP3600938A1 (en) 2020-02-05
FR3064372A1 (en) 2018-09-28

Similar Documents

Publication Publication Date Title
EP3600938A1 (en) Device and method for augmented reality driving assistance
JP4882285B2 (en) Vehicle travel support device
CN107458375B (en) Speed limit display device for vehicle
US11486726B2 (en) Overlaying additional information on a display unit
US10643470B2 (en) Method for assisting a driver of a motor vehicle with respect to an imminent overtaking maneuver, and motor vehicle
CN101727759B (en) For the driver assistance system of automobile
CN103707811B (en) Visual guidance system
US7605773B2 (en) Head-up display system and method for carrying out the location-correct display of an object situated outside a vehicle with regard to the position of the driver
US9514650B2 (en) System and method for warning a driver of pedestrians and other obstacles when turning
US7216035B2 (en) Method and device for displaying navigational information for a vehicle
EP2455927A1 (en) Driving support device, driving support method, and program
JP4992755B2 (en) Intersection driving support system, in-vehicle equipment, and roadside equipment
US9952058B2 (en) Driver visibility detection system and method for detecting driver visibility
US20090187333A1 (en) Method and System for Displaying Navigation Instructions
CN111731101A (en) AR-HUD display method and system fusing V2X information
CN210139859U (en) Automobile collision early warning system, navigation and automobile
JP6415583B2 (en) Information display control system and information display control method
EP3207494B1 (en) Systems and methods for traffic sign validation
CN108791062B (en) Dynamic information system and method of operation
US20200318989A1 (en) Route guidance apparatus and method
US11620902B2 (en) Method and device for displaying lane information in a vehicle
JP2008046766A (en) Vehicle external information display device
US20190371281A1 (en) Display control device for vehicle and display unit for vehicle
JP4600391B2 (en) Display device, display system, and display method
KR101826627B1 (en) Apparatus for displaying safety driving information using head-up display and control method thereof

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18713019

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 2018713019

Country of ref document: EP

Effective date: 20191021