EP3762684A1

EP3762684A1 - Overlaying additional information on a display unit

Info

Publication number: EP3762684A1
Application number: EP19707299.4A
Authority: EP
Inventors: Andro Kleen; Michael Wittkämper; Robert Jan Wyszka; Adrian HAAR
Original assignee: Volkswagen AG
Current assignee: Volkswagen AG
Priority date: 2018-03-07
Filing date: 2019-02-14
Publication date: 2021-01-13
Also published as: CN111788459A; DE102018203462A1; US20200393263A1; US11486726B2; WO2019170387A1

Abstract

The invention relates to a method for calculating an overlay of additional information for a display on a display unit (20), in particular a head-up display (HUD) of a vehicle (10) or data glasses. The overlay of additional information serves the purpose of supporting the driver in the longitudinal control of a vehicle (10). The position of an upcoming waypoint is detected, which is specified by the navigation system. When the observer vehicle (10) approaches the waypoint, an animation graphic is calculated, wherein the animation graphic has a grid shape. The animation graphic is calculated such that, distance markers (24) are inserted from the observer vehicle (10) to the waypoint, which permit an improved estimation of the distance to the waypoint.

Description

description

DISPLAYING ADDITIONAL INFORMATION ON A DISPLAY UNIT

The proposal concerns the technical field of driver information systems, also known as infotainment systems. Such systems are used primarily in vehicles. But there is also the possibility of using the invention in pedestrians, cyclists, etc. with data glasses. The proposal further relates to a suitably designed apparatus for carrying out the method and a

Motor vehicle and a computer program.

A future vision in the automotive industry is to be able to record the windscreen of one's own vehicle with virtual elements, in order to offer the driver some advantages. The so-called "augmented reality" technology (AR) is used. Less familiar is the corresponding German-language term of "augmented reality". The real environment is enriched with virtual elements. This has several advantages: The view down to other displays than the windshield is omitted because many relevant information is displayed on the windshield. So the driver does not have to avert his gaze from the road. The special feature of the AR representations is that a positionally accurate location of the virtual elements in the real environment is possible. In the place where the driver turns his gaze into the real environment, the virtual element is also displayed. With these overlays, the real environment can be "superimposed" from the user's point of view and provided with additional information, e.g. a navigation path can be displayed. As a result, a lesser cognitive effort on the part of the driver is achieved, since no interpretation of an abstracting graphic must be done, but an intuitive understanding in the sense of the normal

Perceptual habits can take place.

Currently Head-Up Displays (HUD) are used in the vehicles. These also have the advantage that the image of the HUD appears closer to the real environment. These displays are actually projection units that take a picture of the

Project the windshield. However, from the driver's point of view, this image is located a few meters to 15 meters in front of the vehicle, depending on the design of the module. This has the advantage that the displayed information is presented in such a way that the eyes of the driver are even relieved of accommodation activity. The "BNd" is composed as follows: It is less a virtual display, but rather a kind of "keyhole" in the virtual world. The virtual environment is theoretically placed over the real world and contains the virtual objects that support and inform the driver while driving. The limited display area of the HUD has the consequence that a section of it can be seen. So you look through the display area of the HUD on the section of the virtual world. Because this virtual

Surrounding the real environment complements, one speaks in this case of a "mixed reality".

At the moment, intensive work is also being done on technologies that will later enable autonomous driving. A first approach is not to completely relieve the driver of his duties, but to ensure that the driver at any time the

Control of the vehicle can take over. The driver also takes

Monitoring functions true. Due to newer technologies in the field of

Driver information systems such as Head-Up Display (HUD), it is possible to better inform the driver about the happenings in the environment of his vehicle.

In order to achieve this, the use of newer technologies (vehicle-to-vehicle communication, use of databases, vehicle sensors, etc.) is required so that comprehensive information about objects (in particular vehicles) in the immediate vicinity of one's own vehicle will be available. In the field of vehicle sensors in particular the following components are called, which enable an environment observation: RADAR devices according to Radio Detection and Ranging, LIDAR devices, according to Light Detection and Ranging, mainly for the range distance detection / warning, and cameras with appropriate image processing for the Area of object recognition. This data on the environment can be used as the basis for system-side driving recommendations, warnings, etc.

be used. For example, it is conceivable to display / warn in which direction (possibly in the own trajectory) another, surrounding vehicle wants to turn.

The vehicle-to-vehicle communication is now also possible by means of mobile communication with systems such as LTE according to Long Term Evolution. Here, a specification called LTE V2X was adopted by the 3GPP organization. Alternatively, systems based on WLAN technology for direct vehicle communication are available, in particular the system according to WLAN p. Due to the current trend towards higher levels of autonomy, but where many vehicles are still controlled by the driver, it can be assumed that corresponding additional information can already be used in the medium term for manually-operated vehicles and not for long-term highly automated systems. In this case, the solution described in more detail below can be used both for manually controlled and for automatically controlled vehicles.

For the driver-vehicle interaction, this raises the question of how this information can be presented in such a way that real added value for the human driver is created and he can also locate the information provided quickly or intuitively. The following solutions in this area are already known from the prior art.

From DE 10 2014 200 407 A1 a method for operating a

Field-of-view display device (head-up display) for a vehicle known. In the method, images of navigation information are thus placed in a driver's field of vision

Vehicle superimposed that the images are superimposed objects in the field of view. The images can be tracked dynamically so that the images appear fixed to the objects. For this purpose, a distance between the vehicle and a location for displaying navigation information in an environment of the vehicle is determined. The driver can with the help of this technique z. B. navigation instructions are given, in which the road ahead is marked in color to the horizon or navigation instructions that are displayed as arrows that are directly on the road.

From DE 10 2015 117 381 A1 a method and a device are known in which also information such as navigation information is superimposed on a HUD display unit. Navigation information displayed by the HUD display unit may include, for example, projecting a distance to a next turn and the current speed of the vehicle compared to a

Speed limit including an alarm when exceeding the

Include speed limit.

Most vehicles today have a navigation system to a destination and

Provide road guidance for a driver. Furthermore, vehicles having a HUD mounted therein are offered on the market, the HUD projecting desired information onto the windshield of a vehicle and allowing the driver to view the projected information while the driver is looking forward. From the DE 10 2016 223 179 A1 discloses a coordinate adjustment device and a corresponding method for a head-up display (HUD) which not only align a coordinate of an environment information measuring device with a coordinate of the HUD, but also the position of an object in such a way convert the viewing angles to match information measured by the environmental information measuring device.

From DE 10 201 1 112 943 A1 a method for providing a

A driver assistance system with automatic longitudinal control for a vehicle is known in which the route ahead section is visualized on a display surface, wherein at least one graphical object, which is a function of the automatic

Longitudinal control is assigned, is shown in the visualized section. The method for providing a driver assistance system with automatic longitudinal control is characterized in that a

Video image sequence is recorded and reproduced in real time on the display surface and the at least one graphical object of the video image sequence is superimposed. As an object, a distance bar can be displayed, which visualizes a safety distance.

From DE 10 201 1 121 763 A1 a method for displaying a distance information on a display device of a vehicle is known. The method is characterized in that a real image of the lane ahead of the vehicle is recorded with the camera, and a safety distance to the vehicle in front is determined as a function of at least one vehicle-dynamic size of the vehicle. The real image is extended by a virtual image portion in the form of a crossbar, which indicates the safety distance in the correct position to the vehicle in front.

A major advantage of the so-called "augmented reality" (AR) displays is that they display the corresponding ads directly within or as part of the environment. Relatively obvious examples mostly relate to the field of navigation. While classic navigation displays (in conventional HUDs) typically display schematic representations (e.g., a right-angled arrow indicating that you want to turn right at the next opportunity), AR displays offer much more effective options. Since the ads can be viewed as "part of the environment", extremely fast and intuitive interpretations are possible for the user. Nevertheless, the previously known approaches also different

Problems for which there are no known solutions at the moment. This was recognized within the scope of the invention. While current navigation systems issue navigation hints, they are not properly reconciled with the environment, so they can not be understood intuitively. If, for example, a motorway is to be left at a certain exit, a voice announcement is made in current systems with just that request and an associated distance indication (eg "leave the motorway at the second exit in 500 meters"). In addition, the usual turn-off pictograms and geometric shapes are displayed, which visualize the achievement of the correct exit through an "expiring loading bar". The problem here is that this information is difficult to relate to the realities of the road. If there are no metric points of orientation in the environment, it is very difficult to understand whether, for example, 250 m or 400 m have already passed. This circumstance is especially in indifferent or ambiguous contexts, so for example in several

Motorway exits that are directly behind each other, very problematic.

There is therefore a need for further improvements in the longitudinal guidance of a

Vehicle and the related feedback to the driver via the infotainment system.

The invention sets itself the task of finding such an approach.

This object is achieved by a method for calculating a fade of

Additional information for a display on a display unit, in particular a head-up display (HUD) of a vehicle or a data glasses according to claim 1, an apparatus for performing the method according to claim 8 and a motor vehicle according to claim 11 and a computer program according to claim 12 solved. The insertion of additional information serves the purpose of assisting the driver in the longitudinal guidance of the vehicle.

The dependent claims contain advantageous developments and improvements of the invention according to the following description of these measures.

The solution according to the invention is based on that with blended

Distance markers the distance to the waypoint is displayed. The waypoint can be specified by the navigation system. The solution has the advantage that the voice announcements or numerical distance indications are made more comprehensible for the driver and better associated with the actual environment can, even where no real distance beacons have been installed on the roadside.

The navigation system provides a navigation path, which can also be displayed as an AR overlay on the real environment. The insertion of the navigation path can advantageously be done in raster form. The grid consists of individual

Raster elements that are interpreted by the driver as a continuous navigation path, without covering the real environment more than necessary.

If e.g. As in the example described above, it is recommended by the navigation system to leave the motorway at 500 m

"Navigation grids" at regular intervals (e.g., every 100 m) are highlighted graphically e.g. by color coding, or by other types of animation, such as by a single change of shape or by a change of position, e.g. putting up a previously lying on the floor element. Classic distance beacons can also be shown, but they do not really exist. With this approach, distance information can be prepared by onboard systems as "milestones" and thus create an improved spatial understanding.

The distance markers can advantageously be displayed at equidistant intervals, such as 10 m, 25 m, 50 m, 75 m, 80 m, 100 m, 160 m, 200 m, 240 m, or 300 m before the waypoint.

In another variant, the distance marks each consist of several

Grid points of animation graphics composed. This has the advantage that the distance markers appear as integrated on the road, the driver does not have to avert his gaze and still gets a precise distance to the announced waypoint.

For example, the distance marks may consist of three or five halftone dots

be assembled and symbolize an arrow in the direction of travel. The driver's gaze is intuitively directed in the direction of the announced waypoint. At the waypoint itself, another symbol can be composed of grid points, such as a turn-off arrow.

It is also advantageous if the grid points are represented by symbols. Here, for example, the shape of a rhombus is suitable because it can be aligned in the direction of travel. If the Rhombus symbols are not filled out, they embed themselves distracting into the environment, without obscuring significant parts of the environment.

In a further advantageous embodiment, the calculation of the

Distance marks depending on the environment, the own speed of the

Observer vehicle and / or a driving scenario. Thus, e.g. in an urban space, with low maximum permissible speeds, the calculation of

Distance markers occur in smaller cycles (for example every 10 m), while on motorways distance markers, as usual there, are displayed at 100 meter intervals.

Driving scenario and speed are considered as separate determinants, e.g. The raster symbols on the highway in traffic jams could have a different color than in "liquid" motorway traffic. The driving scenario includes at least in part the

Traffic conditions.

In order to realize this procedure technically, in addition to the exact localization of a vehicle and the recognition of the environment, a computer-assisted procedure is required, which scales or dimensioned the AR displays in such a way that they exactly match the physical and physical characteristics of the respective driver and his perception apparatus Conditions corresponds. Thus, on the one hand, the corresponding algorithms must reconcile a position determined by the localization system with the position of a maneuver to be performed and, on the basis of this calculation, adapt the AR representations so that the distance marks actually correspond to the real distances.

Therefore, it is advantageous for a device for carrying out the method that it can locate the navigation point predetermined waypoint in the recorded by the detection means environment. One variant is to use highly accurate maps and locate them on this map, e.g. by GPS or one

to identify improved localization systems. There would be no more for that

Sensors on the vehicle required. In another variant, built-in imaging sensors are additionally used. For this purpose are adapted accordingly

Image evaluation method can be used, which evaluate the images supplied by one or more front cameras. Especially suitable for this application is a

Stereo camera capable of delivering 3D image sequences. Also, a LIDAR or RADAR sensor would be considered. The image evaluation methods can either on it

be programmed based on the curvature of the roadway edge to recognize a waypoint (turning or inflection of a road) or by detecting stationary traffic signs or other infrastructure objects or points, such as traffic lights, Railroad crossings, crosswalks, etc. to determine the waypoint. Another possibility is to use fixed radio beacons that transmit the exact distance to the waypoint and are designed so that they are easily recognizable by image analysis. The device will then receive and evaluate the signal of the radio beacons to display the corresponding distance beacon in the correct position at the height of the beacon in the navigation route.

On the other hand, the driver's characteristics such as sitting position, eye position and eye distance as well as the exact HUD settings ("look-down angle", etc.) can also be taken into account in order to optimize the display of the "distance beacons" , This requires a HUD display system in which these parameters are entered or recorded.

Incidentally, the same advantages apply to the device for carrying out the method with the correspondingly programmed arithmetic unit, as mentioned in the claims with the corresponding method steps.

It is particularly advantageous if the display unit of the device is designed as a head-up display. Instead of a head-up display, a data goggle or a monitor can be used in the device as a display unit, on which a camera image is displayed, in which the grid is displayed.

Advantageously, the device according to the invention can be used in a motor vehicle. In the vehicle, the invention is preferably realized so that the display unit is permanently installed in the vehicle, e.g. in the form of a head-up display.

Nevertheless, a possible form of realization would also be possible with the aid of data glasses, if the use of data glasses by the driver would be permitted in the future.

As mentioned, the invention can also be advantageously used if the display unit corresponds to data glasses. Then, the invention can be

Use procedures even for pedestrians, cyclists, bikers, etc.

For a computer program that comes in the arithmetic unit of the device for processing to perform the inventive method, the corresponding advantages apply as described for the inventive method. Embodiments of the invention are illustrated in the drawings and are explained in more detail with reference to FIGS.

Show it:

1 shows the principle of the superimposition of information in the field of vision of the driver of a vehicle while driving with the aid of a head-up display;

Fig. 2 shows the typical cockpit of a vehicle;

3 shows the block diagram of the infotainment system of the vehicle;

Fig. 4 is a representation of a grid overlay with highlighted color

Distance markers for better orientation of the driver at particular waypoints in the navigation of the vehicle;

5 shows an example of a visualization of a distance mark by composition and highlighting of grid symbols; and

6 is a flow chart for a program for calculating AR inserts for displaying the navigation route with nested range marks.

The present description illustrates the principles of the disclosure of the invention. It will thus be understood that those skilled in the art will be able to devise various arrangements which, while not explicitly described herein, are intended to embody principles of the invention and to be equally limited in scope.

Fig. 1 illustrates the basic operation of a head-up display. The head-up display 20 is in the vehicle 10 below / behind the instrument cluster in

Dashboard area attached. By projection onto the windshield, additional information is displayed in the driver's field of vision. This additional information appears as if it were projected onto a projection surface 21 at a distance of 7 - 15 m in front of the vehicle 10. Through this projection surface 21, however, the real world remains visible. The additional information displayed creates a kind of virtual environment. The virtual environment is theoretically placed over the real world and contains the virtual objects that support and inform the driver while driving. However, it is only projected onto a part of the windshield, so that the additional information can not be arbitrarily arranged in the field of vision of the driver.

Fig. 2 shows the cockpit of the vehicle 10. Shown is a passenger car. As vehicle 10, however, any other vehicles would also be considered. Examples of other vehicles are: buses, commercial vehicles, especially trucks trucks, agricultural machinery, construction machinery, rail vehicles, etc. The use of the invention would be Generally possible with land vehicles, rail vehicles, watercraft and aircraft.

In the cockpit three display units of an infotainment system are shown. It is the head-up display 20 and a touch-sensitive screen 30 which is mounted in the center console. When driving, the center console is not in the driver's field of vision. Therefore, the additional information is not displayed on the display unit 30 while driving.

The touch-sensitive screen 30 serves in particular for the operation of functions of the vehicle 10. For example, about a radio, a

Navigation system, playback of stored music and / or air conditioning, other electronic devices or other comfort functions or applications of the vehicle 10 are controlled. In summary, there is often talk of an "infotainment system". An infotainment system refers to motor vehicles, especially passenger cars, the merger of car radio, navigation system,

Handsfree, driver assistance systems and other functions in a central control unit. The term infotainment is a boxword word composed of the words information and entertainment (entertainment). To operate the infotainment system mainly the touch-sensitive screen 30 ("touch screen") is used, this screen 30 can be well viewed and operated in particular by a driver of the vehicle 10, but also by a passenger of the vehicle 10. In addition, below the screen 30, mechanical operating elements, for example keys, rotary encoders or combinations thereof, such as, for example, a push-dial regulator, can be arranged in an input unit 50. Typically, steering wheel control of parts of the infotainment system is also possible. This unit is not shown separately, but is considered part of the input unit 50.

3 shows schematically a block diagram of the infotainment system 200 as well as by way of example some subsystems or applications of the infotainment system. The operation device includes the touch-sensitive display unit 30, a calculator 40, an input unit 50, and a memory 60. The display unit 30 includes both a display surface for displaying variable graphic information and a control surface (touch-sensitive layer) disposed above the display surface

Entering commands by a user. The display unit 30 is connected to the computing device 40 via a data line 70. The data line can be designed according to the LVDS standard, corresponding to Low Voltage Differential Signaling. Via the data line 70, the display unit 30 receives control data for driving the display surface of the touch screen 30 from the

Computing device 40. Via the data line 70 are also control data of

entered commands from the touch screen 30 to the computing device 40. Reference numeral 50 denotes the input unit. It includes the already mentioned control elements such as buttons, knobs, sliders, or rotary pushbuttons, with the help of which the operator can make inputs via the menu. Input is generally understood as selecting a selected menu item, as well as changing a parameter, turning a function on and off, and so on.

The memory device 60 is connected to the computing device 40 via a data line 80. In the memory 60, a pictogram directory and / or symbol directory is stored with the pictograms and / or symbols for the possible overlays of additional information. Here also the points / symbols can be stored, which serve as the basis for the calculation of the raster overlay.

The other parts of the infotainment system camera 150, radio 140, navigation device 130, telephone 120 and instrument cluster 110 are connected via the data bus 100 with the device for operating the infotainment system. The data bus 100 is the high-speed variant of the CAN bus according to ISO standard 11898-2. Alternatively, for example, The use of an Ethernet-based bus system such as BroadR-Reach in question. Bus systems in which the data is transmitted via optical fibers can also be used. Examples are the MOST Bus (Media Oriented System Transport) or the D2B Bus (Domestic Digital Bus). Here it is mentioned that the camera 150 can be designed as a conventional video camera. In this case, it will record 25 frames / s, which is equivalent to 50 fields / s in the interlace recording mode.

Alternatively, a special camera can be used that captures more images / sec to increase the accuracy of object detection on faster moving objects. Several cameras can be used for monitoring the environment. In addition, the already mentioned RADAR or LIDAR systems could be used in addition or alternatively to carry out or expand the field observation. For inbound and outbound wireless communication, the vehicle 10 is with a

Communication module 160 equipped. This module is often referred to as an on-board unit. It can be used for mobile communication, e.g. according to LTE standard,

according to Long Term Evolution, be designed. It can also be used for Wi-Fi Communication, according to wireless LAN, be designed, be it for communication to devices of the occupants in the vehicle or for vehicle-to-vehicle communication, etc.

The inventive method for calculating a display of

Additional information for a display on a display unit 20 will be explained below with reference to an embodiment.

For the other figures, the same reference numerals denote the same fields and symbols as explained in the description of FIGS. 1 to 3.

The basis of the display according to the invention of the longitudinal guidance function of the vehicle 10 on the HUD 20 is the display of a virtual grid which is displayed at a distance above the actual road or without distance to the road. The road is located as a real road course in the field of vision of the driver. The AR fade in by means of the HUD 20 is done as shown in FIG. The grid 22 is projected to be on the road or "floating in space" at a distance from the road. The grid is composed of a plurality of diamond symbols 23, which are shown to be transparent, of which therefore only the edge can be seen, in order to avoid a concealment of large areas. It is shown that a grid 22 is displayed along the roadway course. This extends along the navigation route predicted by the navigation system 130. As shown, the navigation route leads to a crossroads where it turns left. The distance to the turn-off point is 50 m and is shown in the lower edge of the screen in the form of the distance indication 26, next to the turn-off arrow 25 to the left. From the navigation system 130 came the acoustic announcement that the turn should be made in 50 m. Since there is another crossing point before the turn-off point, it is difficult for the driver to recognize at which point he should turn. Also is the

Turnstile difficult to see by a truck coming from the left. To assist the driver, distance markers 24 are displayed at a distance of 10 m along the navigation path represented by the grid 22. The distance marks are each composed of five diamond symbols 23 of the grid 22 and are highlighted by a blue color. The other grid symbols 23 are shown in white. The driver intuitively recognizes the distance marks 24. The grid symbols 23 for the

Distance marks 24 are selected so that the shape of a forward arrow results, ie in the direction of travel. This shape is created by composing the distance mark 24 from a raster center symbol and two left and right raster page symbols, respectively. The side symbols are offset to the rear, resulting in the shape of a forward arrow. This composition of the distance mark 24 from grid symbols 23 is shown in greater detail in FIG.

A computer program for the calculation of the AR impressions for the distance marks 24 will be explained with reference to FIG. The program is in the

Processing unit 40 processed. The program start is designated by the reference numeral 405. In the program step 410, the environment of the observer vehicle 10 is detected. For this purpose, the images supplied by the front camera 150 are evaluated with the object recognition algorithms provided for this purpose.

Subsequently, in program step 415, the takeover of the waypoint predetermined by the navigation system 130, which is announced by the navigation system 130, takes place

Distance indication 26 and also of the navigation path.

In program step 420, the image evaluation takes place. The image evaluation can be done with an algorithm programmed to it, based on the curvature of the image

Fahrbahnrandes to recognize a waypoint (turn or inflection of a

Roadway). There are powerful algorithms for edge detection or edge extraction, which can also detect the edge of the road. Another variant consists in detecting the current waypoint by recognizing stationary traffic signs or other infrastructure objects or points, such as traffic lights, level crossings, crosswalks, etc. Another possibility is to use permanently installed wireless beacons that transmit the exact distance to the waypoint and that are designed so that they are easily recognizable by image analysis. The device will then receive and evaluate via the on-board unit 160 the signal of the radio beacon to display the corresponding distance mark 24 in the correct position at the height of the radio beacon in the navigation route.

After the waypoint has been recognized, the calculation of the raster 22 for the display of the navigation path and the calculation of the position of the distance marks in the raster 22 takes place in the program step 425. As shown in FIG. 4, in this step it is determined which raster symbols 23 in FIG Color blue must be presented to one

Distance mark 24 to form. Preferably, the grid 22 is calculated in perspective. In program step 430, the AR data for the raster representation of the Navigation path with the nested distance marks 24 calculated. The

Calculation takes place taking into account the instantaneous velocity of the

Observer vehicle 10. The instantaneous speed of the observer vehicle 10 is detected by on-board sensors or also taken over in step 415 by the navigation system 130.

In step 435, the AR data calculated for the AR display of the navigation path is transmitted to the HUD 20. Via steps 420 to 435, a loop is formed in the program, which is run through until it is recognized in query 440 that the announced waypoint has already been reached or exceeded. If so, the program is terminated in program step 445. When the driver engages and the

Comfort function leaves, the program can be ended at any time.

All examples mentioned herein as well as conditional formulations are to be understood without limitation to such specifically mentioned examples. This is how it is done, for example

Those skilled in the art will recognize that the block diagram presented here represents a conceptual view of exemplary circuitry. Similarly, it will be appreciated that an illustrated flowchart, state transition diagram, pseudocode, and the like represent various variants for representing processes that are described in the

Essentially stored in computer-readable media and thus can be executed by a computer or processor. The object mentioned in the claims can expressly also be a person.

It should be understood that the proposed method and apparatus may be embodied in various forms of hardware, software, firmware,

Special processors or a combination thereof can be implemented.

Special purpose processors may include Application Specific Integrated Circuits (ASICs), Reduced Instruction Set Computer (RISC), and / or Field Programmable Gate Arrays (FPGAs). Preferably, the proposed method and apparatus is implemented as a combination of hardware and software. The software is preferably installed as an application program on a program storage device. Typically it is a machine based on a

Computer platform that has hardware, such as one or more

Central processing units (CPU), random access memory (RAM) and one or more

Input / output (I / O) interface (s). The computer platform also typically installs an operating system. The different processes and functions that may be part of the application program or part that is executed via the operating system.

The disclosure is not limited to the embodiments described herein. There is room for various adjustments and modifications that would be considered by one of ordinary skill in the art as well as in the disclosure.

The invention will be explained in more detail in the embodiments using the example of the use in vehicles. Here is also referred to the use of aircraft and helicopters, for example, in landing maneuvers or search missions, etc.

It should be noted, however, that the use is not limited to this. The invention can always be used when the field of view of a driver, an operator or even just a person with data glasses can be enriched with AR impressions.

Even with remote-controlled devices such as robots, in which the remote control via a monitor on which a camera image is played, AR displays can facilitate the operation. So there is also an application here.

LIST OF REFERENCE NUMBERS

10 vehicle

20 Head-Up Display HUD

21 virtual projection screen

22 grid

23 grid icon

24 distance mark

25 turn-off arrow

26 Distance information

30 touch-sensitive display unit

40 arithmetic unit

50 input unit

60 storage unit

70 data line to the display unit

80 data line to the memory unit

90 data line to the input unit

100 data bus

110 instrument cluster

120 phone

130 navigation device

140 radio

150 camera

160 communication module

200 infotainment system

405 different ones

445 program steps

Claims

claims

1. A method for calculating an AR overlay, corresponding augmented reality, of additional information for a display on a display unit (20), in particular a head-up display (HUD) of an observer vehicle (10) or a data glasses, wherein the Display of additional information serves the purpose of assisting the driver in the longitudinal guidance of an observer vehicle (10), wherein the

Insertion in the manner of augmented reality according to "augmented reality"

contact analog to one or more objects in the environment of the observer vehicle (10) is calculated, characterized in that the position of a waypoint along a navigation route is detected that when approaching the waypoint a

Is calculated, which leads along the navigation route, and the

Animation graphic is calculated so that starting from the observer vehicle (10) to the waypoint distance markers (24) are displayed along the navigation route.

2. The method of claim 1, wherein the animation graphics in raster form consisting of a plurality of screen dots (23) is calculated and the distance marks (24) by color or shape highlighting of grid points (23) are displayed in the animation graphics.

3. The method of claim 2, wherein the distance marks (24) at equidistant intervals, such as 10 m, 25 m, 50 m, 75 m, 80 m, 100 m, 160 m, 200 m, 240 m, or 300 m before Waypoint will be displayed.

4. The method according to any one of the preceding claims, wherein the distance marks (24) depending on the instantaneous speed of the observer vehicle (10) and / or of the driving scenario to which the observer vehicle (10) is traveling and / or from the environment in which the vehicle moves to be positioned in the animation graphic.

5. The method according to any one of the preceding claims, wherein the distance marks (24) are each composed of a plurality of grid points (23).

6. The method of claim 5, wherein the distance marks from three grid points (23) are assembled and symbolize an arrow in the direction of travel.

7. The method according to any one of the preceding claims, wherein the grid points (23) are represented by blank grid symbols, which in particular have the shape of a rhombus.

8. A device for carrying out the method according to one of the preceding claims, comprising a display unit (20), with the virtual additional information in the field of view of the driver or the operator of the object can be displayed, and a computing unit (40), wherein the arithmetic unit (40 ) is designed to calculate the distance of the observer vehicle (10) relative to a waypoint thereby

in that the vehicle (10) has detection means (110, 150) which detect the position of the preceding waypoint along a navigation route, that the

Arithmetic unit (40) is designed to approximate the waypoint to calculate an animation graphic that leads along the navigation route at least to the waypoint, the animation graphics having a grid shape consisting of a plurality of grid points (22) and the arithmetic unit (40) the animation graphics calculated to have a number of distance marks (24) from the observer vehicle (10) to the waypoint.

The apparatus of claim 8, wherein the arithmetic unit (40) is further configured to perform the calculations of any one of claims 2 to 7.

10. Apparatus according to claim 8 or 9, wherein the display unit (20) is a head-up display (HUD) or a data glasses.

11. Motor vehicle, characterized in that the motor vehicle (10) comprises a device according to one of claims 8 to 10.

12. Computer program, characterized in that the computer program is designed, when executed in a computing unit (40) to perform the steps of the method for calculating an AR display of additional information for a display on a display unit (20) according to one of claims 1 to 7 ,