EP3762684A1 - Incrustation d'informations additionnelles sur une unité d'affichage - Google Patents

Incrustation d'informations additionnelles sur une unité d'affichage

Info

Publication number
EP3762684A1
EP3762684A1 EP19707299.4A EP19707299A EP3762684A1 EP 3762684 A1 EP3762684 A1 EP 3762684A1 EP 19707299 A EP19707299 A EP 19707299A EP 3762684 A1 EP3762684 A1 EP 3762684A1
Authority
EP
European Patent Office
Prior art keywords
vehicle
display
waypoint
distance
driver
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
EP19707299.4A
Other languages
German (de)
English (en)
Inventor
Andro Kleen
Michael Wittkämper
Robert Jan Wyszka
Adrian HAAR
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Volkswagen AG
Original Assignee
Volkswagen AG
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Volkswagen AG filed Critical Volkswagen AG
Publication of EP3762684A1 publication Critical patent/EP3762684A1/fr
Ceased legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
    • G01C21/26—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network
    • G01C21/34—Route searching; Route guidance
    • G01C21/36—Input/output arrangements for on-board computers
    • G01C21/3626—Details of the output of route guidance instructions
    • G01C21/365—Guidance using head up displays or projectors, e.g. virtual vehicles or arrows projected on the windscreen or on the road itself
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
    • G01C21/26—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network
    • G01C21/34—Route searching; Route guidance
    • G01C21/36—Input/output arrangements for on-board computers
    • G01C21/3626—Details of the output of route guidance instructions
    • G01C21/3632—Guidance using simplified or iconic instructions, e.g. using arrows
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
    • G01C21/26—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network
    • G01C21/34—Route searching; Route guidance
    • G01C21/36—Input/output arrangements for on-board computers
    • G01C21/3626—Details of the output of route guidance instructions
    • G01C21/3655—Timing of guidance instructions
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/16—Type of output information
    • B60K2360/166—Navigation
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/16—Type of output information
    • B60K2360/177—Augmented reality
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/18—Information management
    • B60K2360/188—Displaying information using colour changes
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/18—Information management
    • B60K2360/191—Highlight information
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/20—Optical features of instruments
    • B60K2360/33—Illumination features
    • B60K2360/347—Optical elements for superposition of display information
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/20—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
    • B60K35/21—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor using visual output, e.g. blinking lights or matrix displays
    • B60K35/23—Head-up displays [HUD]
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/20—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
    • B60K35/28—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor characterised by the type of the output information, e.g. video entertainment or vehicle dynamics information; characterised by the purpose of the output information, e.g. for attracting the attention of the driver
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/20—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
    • B60K35/29—Instruments characterised by the way in which information is handled, e.g. showing information on plural displays or prioritising information according to driving conditions
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/014—Head-up displays characterised by optical features comprising information/image processing systems
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/0141—Head-up displays characterised by optical features characterised by the informative content of the display

Definitions

  • the proposal concerns the technical field of driver information systems, also known as infotainment systems. Such systems are used primarily in vehicles. But there is also the possibility of using the invention in pedestrians, cyclists, etc. with data glasses.
  • the proposal further relates to a suitably designed apparatus for carrying out the method and a
  • AR augmented reality
  • Less familiar is the corresponding German-language term of "augmented reality”.
  • the real environment is enriched with virtual elements. This has several advantages: The view down to other displays than the windshield is omitted because many relevant information is displayed on the windshield. So the driver does not have to avert his gaze from the road.
  • the special feature of the AR representations is that a positionally accurate location of the virtual elements in the real environment is possible. In the place where the driver turns his gaze into the real environment, the virtual element is also displayed.
  • the real environment can be "superimposed" from the user's point of view and provided with additional information, e.g. a navigation path can be displayed.
  • additional information e.g. a navigation path can be displayed.
  • Perceptual habits can take place.
  • HUD Head-Up Displays
  • the "BNd” is composed as follows: It is less a virtual display, but rather a kind of "keyhole” in the virtual world.
  • the virtual environment is theoretically placed over the real world and contains the virtual objects that support and inform the driver while driving.
  • the limited display area of the HUD has the consequence that a section of it can be seen. So you look through the display area of the HUD on the section of the virtual world. Because this virtual
  • a first approach is not to completely relieve the driver of his duties, but to ensure that the driver at any time the
  • Control of the vehicle can take over.
  • the driver also takes
  • HUD Head-Up Display
  • LTE V2X Long Term Evolution
  • WLAN p WLAN p
  • Field-of-view display device for a vehicle known.
  • images of navigation information are thus placed in a driver's field of vision
  • Vehicle superimposed that the images are superimposed objects in the field of view.
  • the images can be tracked dynamically so that the images appear fixed to the objects. For this purpose, a distance between the vehicle and a location for displaying navigation information in an environment of the vehicle is determined. The driver can with the help of this technique z.
  • navigation instructions are given, in which the road ahead is marked in color to the horizon or navigation instructions that are displayed as arrows that are directly on the road.
  • Navigation information displayed by the HUD display unit may include, for example, projecting a distance to a next turn and the current speed of the vehicle compared to a
  • a driver assistance system with automatic longitudinal control for a vehicle in which the route ahead section is visualized on a display surface, wherein at least one graphical object, which is a function of the automatic
  • Video image sequence is recorded and reproduced in real time on the display surface and the at least one graphical object of the video image sequence is superimposed.
  • a distance bar can be displayed, which visualizes a safety distance.
  • a method for displaying a distance information on a display device of a vehicle is known.
  • the method is characterized in that a real image of the lane ahead of the vehicle is recorded with the camera, and a safety distance to the vehicle in front is determined as a function of at least one vehicle-dynamic size of the vehicle.
  • the real image is extended by a virtual image portion in the form of a crossbar, which indicates the safety distance in the correct position to the vehicle in front.
  • AR augmented reality
  • the invention sets itself the task of finding such an approach.
  • This object is achieved by a method for calculating a fade of
  • Additional information for a display on a display unit in particular a head-up display (HUD) of a vehicle or a data glasses according to claim 1, an apparatus for performing the method according to claim 8 and a motor vehicle according to claim 11 and a computer program according to claim 12 solved.
  • the insertion of additional information serves the purpose of assisting the driver in the longitudinal guidance of the vehicle.
  • the solution according to the invention is based on that with blended
  • the distance to the waypoint is displayed.
  • the waypoint can be specified by the navigation system.
  • the solution has the advantage that the voice announcements or numerical distance indications are made more comprehensible for the driver and better associated with the actual environment can, even where no real distance beacons have been installed on the roadside.
  • the navigation system provides a navigation path, which can also be displayed as an AR overlay on the real environment.
  • the insertion of the navigation path can advantageously be done in raster form.
  • the grid consists of individual
  • Raster elements that are interpreted by the driver as a continuous navigation path, without covering the real environment more than necessary.
  • “Navigation grids” at regular intervals are highlighted graphically e.g. by color coding, or by other types of animation, such as by a single change of shape or by a change of position, e.g. putting up a previously lying on the floor element.
  • Classic distance beacons can also be shown, but they do not really exist. With this approach, distance information can be prepared by onboard systems as "milestones" and thus create an improved spatial understanding.
  • the distance markers can advantageously be displayed at equidistant intervals, such as 10 m, 25 m, 50 m, 75 m, 80 m, 100 m, 160 m, 200 m, 240 m, or 300 m before the waypoint.
  • the distance marks each consist of several
  • Grid points of animation graphics composed. This has the advantage that the distance markers appear as integrated on the road, the driver does not have to avert his gaze and still gets a precise distance to the announced waypoint.
  • the distance marks may consist of three or five halftone dots
  • the grid points are represented by symbols.
  • the shape of a rhombus is suitable because it can be aligned in the direction of travel. If the Rhombus symbols are not filled out, they embed themselves distracting into the environment, without obscuring significant parts of the environment.
  • Distance markers occur in smaller cycles (for example every 10 m), while on motorways distance markers, as usual there, are displayed at 100 meter intervals.
  • Driving scenario and speed are considered as separate determinants, e.g.
  • the raster symbols on the highway in traffic jams could have a different color than in "liquid" motorway traffic.
  • the driving scenario includes at least in part the
  • a device for carrying out the method that it can locate the navigation point predetermined waypoint in the recorded by the detection means environment.
  • One variant is to use highly accurate maps and locate them on this map, e.g. by GPS or one
  • Image evaluation method can be used, which evaluate the images supplied by one or more front cameras. Especially suitable for this application is a
  • Stereo camera capable of delivering 3D image sequences. Also, a LIDAR or RADAR sensor would be considered.
  • the image evaluation methods can either on it
  • the device will then receive and evaluate the signal of the radio beacons to display the corresponding distance beacon in the correct position at the height of the beacon in the navigation route.
  • the driver's characteristics such as sitting position, eye position and eye distance as well as the exact HUD settings ("look-down angle", etc.) can also be taken into account in order to optimize the display of the "distance beacons" , This requires a HUD display system in which these parameters are entered or recorded.
  • the display unit of the device is designed as a head-up display.
  • a data goggle or a monitor can be used in the device as a display unit, on which a camera image is displayed, in which the grid is displayed.
  • the device according to the invention can be used in a motor vehicle.
  • the invention is preferably realized so that the display unit is permanently installed in the vehicle, e.g. in the form of a head-up display.
  • the invention can also be advantageously used if the display unit corresponds to data glasses. Then, the invention can be
  • Fig. 2 shows the typical cockpit of a vehicle
  • FIG. 3 shows the block diagram of the infotainment system of the vehicle
  • Fig. 4 is a representation of a grid overlay with highlighted color
  • FIG. 6 is a flow chart for a program for calculating AR inserts for displaying the navigation route with nested range marks.
  • Fig. 1 illustrates the basic operation of a head-up display.
  • the head-up display 20 is in the vehicle 10 below / behind the instrument cluster in
  • Additional information is displayed in the driver's field of vision.
  • This additional information appears as if it were projected onto a projection surface 21 at a distance of 7 - 15 m in front of the vehicle 10.
  • the additional information displayed creates a kind of virtual environment.
  • the virtual environment is theoretically placed over the real world and contains the virtual objects that support and inform the driver while driving. However, it is only projected onto a part of the windshield, so that the additional information can not be arbitrarily arranged in the field of vision of the driver.
  • Fig. 2 shows the cockpit of the vehicle 10. Shown is a passenger car. As vehicle 10, however, any other vehicles would also be considered. Examples of other vehicles are: buses, commercial vehicles, especially trucks trucks, agricultural machinery, construction machinery, rail vehicles, etc. The use of the invention would be Generally possible with land vehicles, rail vehicles, watercraft and aircraft.
  • the cockpit three display units of an infotainment system are shown. It is the head-up display 20 and a touch-sensitive screen 30 which is mounted in the center console.
  • the center console When driving, the center console is not in the driver's field of vision. Therefore, the additional information is not displayed on the display unit 30 while driving.
  • the touch-sensitive screen 30 serves in particular for the operation of functions of the vehicle 10. For example, about a radio, a radio, a radio, a
  • An infotainment system refers to motor vehicles, especially passenger cars, the merger of car radio, navigation system,
  • infotainment is a boxword word composed of the words information and entertainment (entertainment).
  • touch screen To operate the infotainment system mainly the touch-sensitive screen 30 ("touch screen") is used, this screen 30 can be well viewed and operated in particular by a driver of the vehicle 10, but also by a passenger of the vehicle 10.
  • mechanical operating elements for example keys, rotary encoders or combinations thereof, such as, for example, a push-dial regulator, can be arranged in an input unit 50.
  • This unit is not shown separately, but is considered part of the input unit 50.
  • the operation device includes the touch-sensitive display unit 30, a calculator 40, an input unit 50, and a memory 60.
  • the display unit 30 includes both a display surface for displaying variable graphic information and a control surface (touch-sensitive layer) disposed above the display surface
  • the display unit 30 is connected to the computing device 40 via a data line 70.
  • the data line can be designed according to the LVDS standard, corresponding to Low Voltage Differential Signaling.
  • the display unit 30 receives control data for driving the display surface of the touch screen 30 from the
  • Computing device 40 Via the data line 70 are also control data of
  • Reference numeral 50 denotes the input unit. It includes the already mentioned control elements such as buttons, knobs, sliders, or rotary pushbuttons, with the help of which the operator can make inputs via the menu. Input is generally understood as selecting a selected menu item, as well as changing a parameter, turning a function on and off, and so on.
  • the memory device 60 is connected to the computing device 40 via a data line 80.
  • a pictogram directory and / or symbol directory is stored with the pictograms and / or symbols for the possible overlays of additional information.
  • the points / symbols can be stored, which serve as the basis for the calculation of the raster overlay.
  • the other parts of the infotainment system camera 150, radio 140, navigation device 130, telephone 120 and instrument cluster 110 are connected via the data bus 100 with the device for operating the infotainment system.
  • the data bus 100 is the high-speed variant of the CAN bus according to ISO standard 11898-2.
  • Ethernet-based bus system such as BroadR-Reach in question.
  • Bus systems in which the data is transmitted via optical fibers can also be used. Examples are the MOST Bus (Media Oriented System Transport) or the D2B Bus (Domestic Digital Bus).
  • the camera 150 can be designed as a conventional video camera. In this case, it will record 25 frames / s, which is equivalent to 50 fields / s in the interlace recording mode.
  • the vehicle 10 is with a special camera that captures more images / sec to increase the accuracy of object detection on faster moving objects.
  • a special camera can be used that captures more images / sec to increase the accuracy of object detection on faster moving objects.
  • Several cameras can be used for monitoring the environment.
  • the already mentioned RADAR or LIDAR systems could be used in addition or alternatively to carry out or expand the field observation.
  • the vehicle 10 is with a
  • Communication module 160 equipped. This module is often referred to as an on-board unit. It can be used for mobile communication, e.g. according to LTE standard,
  • Wi-Fi Communication according to Long Term Evolution, be designed. It can also be used for Wi-Fi Communication, according to wireless LAN, be designed, be it for communication to devices of the occupants in the vehicle or for vehicle-to-vehicle communication, etc.
  • the basis of the display according to the invention of the longitudinal guidance function of the vehicle 10 on the HUD 20 is the display of a virtual grid which is displayed at a distance above the actual road or without distance to the road.
  • the road is located as a real road course in the field of vision of the driver.
  • the AR fade in by means of the HUD 20 is done as shown in FIG.
  • the grid 22 is projected to be on the road or "floating in space" at a distance from the road.
  • the grid is composed of a plurality of diamond symbols 23, which are shown to be transparent, of which therefore only the edge can be seen, in order to avoid a concealment of large areas. It is shown that a grid 22 is displayed along the roadway course. This extends along the navigation route predicted by the navigation system 130.
  • the navigation route leads to a crossroads where it turns left.
  • the distance to the turn-off point is 50 m and is shown in the lower edge of the screen in the form of the distance indication 26, next to the turn-off arrow 25 to the left.
  • From the navigation system 130 came the acoustic announcement that the turn should be made in 50 m. Since there is another crossing point before the turn-off point, it is difficult for the driver to recognize at which point he should turn. Also is the
  • distance markers 24 are displayed at a distance of 10 m along the navigation path represented by the grid 22.
  • the distance marks are each composed of five diamond symbols 23 of the grid 22 and are highlighted by a blue color.
  • the other grid symbols 23 are shown in white. The driver intuitively recognizes the distance marks 24.
  • Distance marks 24 are selected so that the shape of a forward arrow results, ie in the direction of travel. This shape is created by composing the distance mark 24 from a raster center symbol and two left and right raster page symbols, respectively. The side symbols are offset to the rear, resulting in the shape of a forward arrow. This composition of the distance mark 24 from grid symbols 23 is shown in greater detail in FIG.
  • the program start is designated by the reference numeral 405.
  • the program step 410 the environment of the observer vehicle 10 is detected.
  • the images supplied by the front camera 150 are evaluated with the object recognition algorithms provided for this purpose.
  • program step 415 the takeover of the waypoint predetermined by the navigation system 130, which is announced by the navigation system 130, takes place
  • the image evaluation takes place.
  • the image evaluation can be done with an algorithm programmed to it, based on the curvature of the image
  • the calculation of the raster 22 for the display of the navigation path and the calculation of the position of the distance marks in the raster 22 takes place in the program step 425. As shown in FIG. 4, in this step it is determined which raster symbols 23 in FIG Color blue must be presented to one
  • the grid 22 is calculated in perspective.
  • the AR data for the raster representation of the Navigation path with the nested distance marks 24 calculated.
  • the instantaneous speed of the observer vehicle 10 is detected by on-board sensors or also taken over in step 415 by the navigation system 130.
  • step 435 the AR data calculated for the AR display of the navigation path is transmitted to the HUD 20.
  • steps 420 to 435 a loop is formed in the program, which is run through until it is recognized in query 440 that the announced waypoint has already been reached or exceeded. If so, the program is terminated in program step 445.
  • the program can be ended at any time.
  • Special purpose processors may include Application Specific Integrated Circuits (ASICs), Reduced Instruction Set Computer (RISC), and / or Field Programmable Gate Arrays (FPGAs).
  • ASICs Application Specific Integrated Circuits
  • RISC Reduced Instruction Set Computer
  • FPGAs Field Programmable Gate Arrays
  • the proposed method and apparatus is implemented as a combination of hardware and software.
  • the software is preferably installed as an application program on a program storage device. Typically it is a machine based on a
  • Computer platform that has hardware, such as one or more
  • CPU Central processing units
  • RAM random access memory
  • I / O Input / output interface
  • the computer platform also typically installs an operating system.
  • the different processes and functions that may be part of the application program or part that is executed via the operating system.
  • the invention can always be used when the field of view of a driver, an operator or even just a person with data glasses can be enriched with AR impressions.

Landscapes

  • Engineering & Computer Science (AREA)
  • Remote Sensing (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Automation & Control Theory (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Chemical & Material Sciences (AREA)
  • Combustion & Propulsion (AREA)
  • Transportation (AREA)
  • Mechanical Engineering (AREA)
  • Optics & Photonics (AREA)
  • Navigation (AREA)
  • Traffic Control Systems (AREA)

Abstract

L'invention concerne un procédé pour le calcul d'une incrustation d'informations additionnelles destinées à être affichées sur une unité d'affichage (20), en particulier un affichage tête haute (HUD) d'un véhicule (10) ou des lunettes à réalité augmentée. L'incrustation d'informations additionnelles sert à assister le conducteur lors du contrôle longitudinal d'un véhicule (10). La position d'un point de passage à parcourir, qui est prédéfini par le système de navigation, est détectée. Lorsque le véhicule (10) d'observateur se rapproche du point de passage, un graphique d'animation est calculé, le graphique d'animation présentant une forme de trame. Le graphique d'animation est calculé de sorte que, en partant du véhicule (10) d'observateur jusqu'au point de passage, des repères de distance (24) soient intégrés, qui permettent une meilleure évaluation de la distance par rapport au point de passage.
EP19707299.4A 2018-03-07 2019-02-14 Incrustation d'informations additionnelles sur une unité d'affichage Ceased EP3762684A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
DE102018203462.1A DE102018203462A1 (de) 2018-03-07 2018-03-07 Verfahren zur Berechnung einer Einblendung von Zusatzinformationen für eine Anzeige auf einer Anzeigeeinheit, Vorrichtung zur Durchführung des Verfahrens sowie Kraftfahrzeug und Computerprogramm
PCT/EP2019/053743 WO2019170387A1 (fr) 2018-03-07 2019-02-14 Incrustation d'informations additionnelles sur une unité d'affichage

Publications (1)

Publication Number Publication Date
EP3762684A1 true EP3762684A1 (fr) 2021-01-13

Family

ID=65529657

Family Applications (1)

Application Number Title Priority Date Filing Date
EP19707299.4A Ceased EP3762684A1 (fr) 2018-03-07 2019-02-14 Incrustation d'informations additionnelles sur une unité d'affichage

Country Status (5)

Country Link
US (1) US11486726B2 (fr)
EP (1) EP3762684A1 (fr)
CN (1) CN111788459A (fr)
DE (1) DE102018203462A1 (fr)
WO (1) WO2019170387A1 (fr)

Families Citing this family (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2020144129A1 (fr) * 2019-01-10 2020-07-16 Jaguar Land Rover Limited Système de commande, système et procédé pour fournir une assistance à un occupant d'un véhicule
DE102020200047A1 (de) * 2020-01-06 2021-07-08 Volkswagen Aktiengesellschaft Verfahren und Vorrichtung zur Darstellung von virtuellen Navigationselementen
DE102020201242A1 (de) 2020-01-31 2021-08-05 Volkswagen Aktiengesellschaft Verfahren zum Anzeigen einer Hinweisinformation als Hinweis für ein nachfolgendes Abbiegen eines Fahrzeugs an einer Abbiegestelle auf einer Anzeigeeinheit des Fahrzeugs kontaktanalog, sowie Anzeigevorrichtung und Fahrzeug
CN111896015A (zh) * 2020-07-22 2020-11-06 Oppo广东移动通信有限公司 导航方法、装置、存储介质及电子设备
US11562576B2 (en) * 2020-08-05 2023-01-24 GM Global Technology Operations LLC Dynamic adjustment of augmented reality image
GB2598556A (en) * 2020-08-26 2022-03-09 Badweather Systems Inc Device and associated method for triggering an event during capture of an image sequence
JP7415855B2 (ja) * 2020-08-31 2024-01-17 トヨタ自動車株式会社 車両用情報表示システム
DE102020211298A1 (de) * 2020-09-09 2022-03-10 Volkswagen Aktiengesellschaft Verfahren zur Darstellung eines virtuellen Elements
DE102020214843A1 (de) 2020-11-26 2022-06-02 Volkswagen Aktiengesellschaft Verfahren zur Darstellung eines virtuellen Elements
JP2023044096A (ja) 2021-09-17 2023-03-30 トヨタ自動車株式会社 車両用表示制御装置、車両用表示システム、車両、表示方法及びプログラム
US20230099770A1 (en) * 2021-09-29 2023-03-30 Ncr Corporation Indoor route mapping
WO2023063066A1 (fr) * 2021-10-12 2023-04-20 パナソニックＩｐマネジメント株式会社 Procédé de fourniture d'informations d'assistance, et support d'enregistrement
CN114323017B (zh) * 2021-11-23 2023-09-19 杭州易现先进科技有限公司 Ar导航内容生成方法和系统
CN114993337B (zh) * 2022-08-08 2022-11-15 泽景(西安)汽车电子有限责任公司 导航动画的显示方法、装置、arhud及存储介质

Family Cites Families (35)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH08190696A (ja) 1994-11-07 1996-07-23 Nippondenso Co Ltd 経路誘導データ表示装置
JP4619023B2 (ja) * 2004-03-18 2011-01-26 クラリオン株式会社 車載ナビゲーション装置、ナビゲーションシステム
JP2006036179A (ja) * 2004-06-21 2006-02-09 Nissan Motor Co Ltd 車両の視界調整方法及び装置
JP2007121001A (ja) * 2005-10-26 2007-05-17 Matsushita Electric Ind Co Ltd ナビゲーション装置
DE102006010481A1 (de) * 2006-03-07 2007-09-13 Robert Bosch Gmbh Verfahren und Anordnung zur Anzeige von Navigationshinweisen
DE102008042397A1 (de) 2008-09-26 2010-04-01 Robert Bosch Gmbh Navigationssystem mit kontaktanaloger Anzeige
JP5173031B2 (ja) * 2009-09-28 2013-03-27 株式会社東芝 表示装置及び表示方法
JP4868055B2 (ja) * 2009-11-04 2012-02-01 株式会社デンソー 表示装置
JP5275963B2 (ja) * 2009-12-08 2013-08-28 株式会社東芝 表示装置、表示方法及び移動体
JP5218607B2 (ja) * 2011-06-17 2013-06-26 パナソニック株式会社 ナビゲーション装置
CN102393967B (zh) * 2011-06-27 2013-04-17 中国科学院软件研究所 基于虚拟驾驶的线形要素矢量化作业方法
DE102011112943B4 (de) 2011-09-13 2020-08-27 Volkswagen Aktiengesellschaft Verfahren zum Bereitstellen eines Fahrerassistenzsystems mit automatischer Längsregelung für ein Fahrzeug und Fahrerassistenzsystem dazu
WO2013046424A1 (fr) * 2011-09-30 2013-04-04 パイオニア株式会社 Affichage tête haute, procédé de commande et dispositif d'affichage
DE102011121763B4 (de) 2011-12-21 2023-04-06 Volkswagen Aktiengesellschaft Verfahren zur Darstellung einer Abstandsinformation auf einer Anzeigevorrichtung eines Fahrzeugs und Anzeigevorrichtung
DE102012215038A1 (de) * 2012-08-23 2014-05-28 Bayerische Motoren Werke Aktiengesellschaft Kontaktanaloge Anzeige der Entfernung bis zum auszuführenden Fahrmanöver
TWM454356U (zh) * 2013-01-21 2013-06-01 Darfon Electronics Corp 具有投影裝置的顯示裝置、照明裝置與交通工具
US20160054563A9 (en) * 2013-03-14 2016-02-25 Honda Motor Co., Ltd. 3-dimensional (3-d) navigation
US9041741B2 (en) 2013-03-14 2015-05-26 Qualcomm Incorporated User interface for a head mounted display
DE102013010818A1 (de) * 2013-06-28 2013-12-12 Daimler Ag Verfahren und Fahrerassistenzsystem zur Einblendung von Texturen in eine Abbildung eines sich vor einem Fahrzeug befindlichen Straßenverlaufs und/oder in ein Sichtfeld eines Fahrers eines Fahrzeugs
DE102014200407A1 (de) 2014-01-13 2015-07-16 Robert Bosch Gmbh Verfahren und Vorrichtung zum Betreiben eines Sichtfeldanzeigegeräts
DE102014008152A1 (de) 2014-05-30 2014-10-23 Daimler Ag Verfahren und Vorrichtung zur augmentierten Darstellung mindstens einer Zusatzinformation in mindestens einem Bild einer Umgebung
DE102014009608A1 (de) * 2014-06-27 2015-12-31 Audi Ag Betrieb einer AR-Brille im Kraftfahrzeug
US20160109701A1 (en) 2014-10-15 2016-04-21 GM Global Technology Operations LLC Systems and methods for adjusting features within a head-up display
US9625270B2 (en) * 2014-12-01 2017-04-18 Thinkware Corporation Electronic apparatus, control method thereof, computer program, and computer-readable recording medium
MY169019A (en) * 2015-10-09 2019-01-29 Nissan Motor Vehicular display device and vehicular display method
KR20170060652A (ko) 2015-11-24 2017-06-02 현대오트론 주식회사 헤드업 디스플레이의 좌표 매칭 장치 및 그 방법
US9581457B1 (en) * 2015-12-03 2017-02-28 At&T Intellectual Property I, L.P. System and method for displaying points of interest on a heads-up display
EP3246664A3 (fr) * 2016-05-19 2018-02-14 Ricoh Company, Ltd. Système de traitement d'informations et appareil d'affichage d'informations
JP6870447B2 (ja) * 2016-05-20 2021-05-12 株式会社リコー Ｈｕｄ装置、車両装置、情報表示方法。
JP6834537B2 (ja) * 2017-01-30 2021-02-24 株式会社リコー 表示装置、移動体装置、表示装置の製造方法及び表示方法。
US11254327B2 (en) * 2016-08-16 2022-02-22 Ford Global Technologies, Llc Methods and apparatus to present anticipated vehicle maneuvers to a passenger
DE102017221191B4 (de) * 2017-11-27 2019-06-13 Volkswagen Aktiengesellschaft Verfahren zur Anzeige des Verlaufs einer Sicherheitszone vor einem Fahrzeug oder einem Objekt mit einer Anzeigeeinheit, Vorrichtung zur Durchführung des Verfahrens sowie Kraftfahrzeug und Computerprogramm
DE102017221488A1 (de) * 2017-11-30 2019-06-06 Volkswagen Aktiengesellschaft Verfahren zur Anzeige des Verlaufs einer Trajektorie vor einem Fahrzeug oder einem Objekt mit einer Anzeigeeinheit, Vorrichtung zur Durchführung des Verfahrens sowie Kraftfahrzeug und Computerprogramm
JP6954850B2 (ja) * 2018-02-09 2021-10-27 トヨタ自動車株式会社 表示装置
DE102018204254B4 (de) * 2018-03-20 2020-12-03 Volkswagen Aktiengesellschaft Verfahren zur Berechnung einer Einblendung von Zusatzinformationen für eine Anzeige auf einer Anzeigeeinheit, Vorrichtung zur Durchführung des Verfahrens sowie Kraftfahrzeug und Computerprogramm

Also Published As

Publication number Publication date
DE102018203462A1 (de) 2019-09-12
CN111788459A (zh) 2020-10-16
US11486726B2 (en) 2022-11-01
US20200393263A1 (en) 2020-12-17
WO2019170387A1 (fr) 2019-09-12

Similar Documents

Publication Publication Date Title
WO2019170387A1 (fr) Incrustation d'informations additionnelles sur une unité d'affichage
EP3543059B1 (fr) Procédé de calcul d'une surimpression des informations supplémentaires pour un affichage sur une unité d'affichage, dispositif de mise en oeuvre du procédé, ainsi que véhicule automobile et programme informatique
DE102017221191B4 (de) Verfahren zur Anzeige des Verlaufs einer Sicherheitszone vor einem Fahrzeug oder einem Objekt mit einer Anzeigeeinheit, Vorrichtung zur Durchführung des Verfahrens sowie Kraftfahrzeug und Computerprogramm
DE112015004218B4 (de) Fahrassistenzvorrichtung
EP2655119B1 (fr) Dispositif d'affichage conçu pour un véhicule automobile
DE102013200862B4 (de) Optimaler Blickort an Anzeige für gesamte Frontscheibe
EP3765324B1 (fr) Procédé, dispositif et support d'enregistrement lisible par ordinateur doté d'instructions pour la commande d'un affichage d'un dispositif d'affichage à réalité augmentée pour un véhicule automobile
DE102017212367B4 (de) Vorrichtung zur Anzeige des Verlaufs einer Trajektorie vor einem Fahrzeug oder einem Objekt mit einer Anzeigeeinheit sowie Kraftfahrzeug
EP3803275A1 (fr) Procédé de calcul d'une incrustation à réalité augmentée pour la représentation d'un itinéraire de navigation sur une unité d'affichage à réalité augmentée, dispositif servant à mettre en oeuvre le procédé, ainsi que véhicule à moteur et programme informatique
DE102016106832A1 (de) Fahrzeugsteuerungsvorrichtung
EP3425442B1 (fr) Procédé d'enrichissement d'un champ de vision d'un conducteur d'un véhicule avec des informations additionnelles, dispositif d'utilisation dans un véhicule observateur, ainsi que véhicule automobile
EP3717954B1 (fr) Procédé d'affichage du déroulement d'une trajectoire devant un véhicule ou un objet pourvu d'une unité d'affichage, dispositif de mise en oeuvre du procédé
EP3570225A1 (fr) Procédé de calcul d'une surimpression de « la réalité augmentée » pour la présentation d'un itinéraire de navigation sur une unité d'affichage ar, dispositif de mise en uvre dudit procédé ainsi que véhicule automobile et programme informatique
DE102018203121B4 (de) Verfahren zur Berechnung einer AR-Einblendung von Zusatzinformationen für eine Anzeige auf einer Anzeigeeinheit, Vorrichtung zur Durchführung des Verfahrens sowie Kraftfahrzeug und Computerprogramm
DE102017221871A1 (de) Verfahren zur Berechnung der Bewegungsdaten des Kopfes eines Fahrers eines Fahrzeuges, Datenbrille sowie Fahrzeug zur Verwendung bei dem Verfahren und Computerprogramm
EP2608185A1 (fr) Procédé et dispositif de préparation dýune aide au stationnement dans un véhicule
DE102008028374A1 (de) Verfahren zur kombinierten Ausgabe eines Bildes und einer Lokalinformation, sowie Kraftfahrzeug hierfür
DE102010003851A1 (de) Verfahren und Informationssystem zum Markieren eines Zielorts für ein Fahrzeug
WO2019057452A1 (fr) Procédé, dispositif et support de mémoire lisible par un ordinateur pourvu d'instructions de commande d'un affichage d'un dispositif d'affichage à tête haute en réalité augmentée pour un véhicule automobile
DE102012220100A1 (de) Verfahren und Informationsgerät zum Darstellen von einer Fahrerinformation auf einer Blickfeldanzeige für ein Fahrzeug
DE102017122543A1 (de) Verfahren zum Unterstützen eines Fahrers eines Kraftfahrzeugs beim Überholen eines Objektes sowie Fahrerassistenzsystem
EP2756490B1 (fr) Procédé et dispositif pour représenter une information de signalisation routière
DE112022000986T5 (de) Anzeigesteuervorrichtung und anzeigesteuerprogramm
DE102021121666A1 (de) Anzeigesteuervorrichtung, anzeigesteuerverfahren und anzeigesteuerprogramm
DE102017215024A1 (de) Verfahren, Vorrichtung und computerlesbares Speichermedium mit Instruktionen zum Bereitstellen von Informationen für eine Head-Up-Display-Vorrichtung für ein Kraftfahrzeug

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: UNKNOWN

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20201007

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

17Q First examination report despatched

Effective date: 20211202

REG Reference to a national code

Ref country code: DE

Ref legal event code: R003

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION HAS BEEN REFUSED

18R Application refused

Effective date: 20230319