DE102013016249A1 - Method for displaying navigation instructions on display of navigation system, involves determining representation of image of background of display and determining degradation stage based on additional information - Google Patents

Abstract

The method involves displaying an augmented representation of additional information (Z1-Zx) in image (Br,Bd) of a vehicle lying ahead vehicle environment (U), on a display (2). The representation of image of background (H-Br,H-A) of display and degradation stage (DS1-DSm) is determined on the basis of additional information and/or the background is output accordingly. An independent claim is included for a device for displaying navigation instructions on display of navigation system.

Description

The invention relates to a method for displaying navigation instructions. Furthermore, the invention relates to a device for carrying out the method.

Devices for augmented presentation superimpose generated additional information with a recorded or perceptible environment. The additional information is displayed in the correct position in the surrounding images, whereby the surrounding images are output in the background. Such devices are, for example, partially transparent display units, such as a HUP display unit (HUP), an HMD display unit (HMD = Head Mounted Display), or opaque display units, for example a conventional screen.

From the US 2010/0292886 A1 For example, visual markings of preceding, adjacent or oncoming vehicles by congruent or adjacent superposition of virtual objects and an indication of the distance to the vehicle in front or adjacent and its speed are known.

From the DE 10 2005 062 151 B4 In addition, an augmented distance and collision warning as a function of occurring environmental conditions, such as occurring virtual road signs, color changing guidelines and rugs and augmented turn and lane change indications known.

The invention is based on the object of specifying an improved method and an improved device for displaying at least one navigation instruction.

With regard to the method, the object is achieved by the features of claim 1. With regard to the device, the object is achieved by the features of claim 9.

Advantageous embodiments of the invention are the subject of the dependent claims.

In the method according to the invention for displaying navigation instructions of a navigation system on a display by augmented presentation of at least one additional navigation information containing additional information in at least one image of a preceding vehicle environment, the image forms a background of the display, wherein at least one degradation level of the representation is determined based on the at least Additional information and / or the background are output and adjusted accordingly.

The invention has the advantage that situation, sensor and / or data dependent both the background and the augmented presentation are automatically adjusted gradually, so that a user without having to make additional settings, the current driving situation including navigation instructions comfortable, especially easy and intuitively perceive in the real or digital background of the ad. This leads to a relief of the driver, since he can better perceive the present driving situation and in particular pending driving actions, in particular early and estimate better and faster.

Embodiments of the invention are explained in more detail below with reference to drawings. Showing:

1 schematically a device for augmented presentation of additional information in a background,

2 schematically a processing unit of the device for augmented representation in detail,

3 2 schematically shows an embodiment for a background of a display with superimposed additional information for displaying navigation instructions in a first degradation stage, FIG.

4 FIG. 2 schematically, an embodiment for a background of a display with superimposed additional information for displaying navigation instructions in a second degradation stage, FIG.

5 1 is a schematic illustration of an example of a background of a display with overlaid additional information for displaying navigation instructions in a third stage of degradation;

6 schematically an embodiment of a background of a display with superimposed additional information for displaying navigation instructions in a fourth degradation stage, and

7 schematically an embodiment of a background of a display with superimposed additional information to display navigation instructions in a fifth Degradationsstufe.

Corresponding parts are provided in all figures with the same reference numerals.

1 schematically shows a device 1 for the augmented presentation of at least one, in particular, virtual additional information Z1 to Zx in an image that has a background H on an output unit 2 forms. The image may be a real image Br of an environment U lying in the field of vision of the user, or a digitally recorded image Bd of the preceding environment U.

In other words, in one embodiment, the image forming the background H is the real environment U lying ahead. In an alternative embodiment, which will be described in more detail here, a digital image Bd of the real environment U lying ahead is taken as an image and transformed into an output image A. putting the background H on the output unit 2 forms.

The device 1 includes a receiving unit 3 , which continuously receives digital images Bd of the environment U in the manner of a video sequence. The digital images Bd become a processing unit 4 for processing and generating a resulting output image A or a sequence of output images An supplied. The generated and output output image A in this embodiment forms the background H. In addition, the processing unit generates 4 virtual additional information Z1 to Zx, which are superimposed in the background H superimposed.

The device 1 For example, it is integrated in a vehicle, not shown, where it is used to detect the environment U of the vehicle, in particular the detection of a vehicle environment ahead in the direction of travel (a traffic environment). The vehicle includes, for example, as a receiving unit 3 at least one on-board camera (or a radar unit, an ultrasonic sensor unit, a lidar unit), which is arranged at least in the front area. In addition, the vehicle can further recording units 3 , z. B. integrated in the side mirror and / or in the rear of the vehicle include.

The recording unit 3 is designed such that this two- or multi-dimensional digital images Bd with or without depth information of the environment U receives.

The processing unit 4 is in particular a separate control unit and / or an image processing unit, which may be integrated in another control unit and / or driver assistance system.

The output unit 2 is in particular a display in the form of a screen in the dashboard area and / or a projection screen in the windscreen area. In training the output unit 2 the generated digital output image A, in which the additional virtual information Z1 to Zx are superimposed, is output in the background H as the screen. In training the output unit 2 as a projection screen or head-up display, the real underlying environment U forms the background H, on which the additional virtual information Z1 to Zx are superimposed.

The output unit 2 will be displayed below 2 called.

The invention is intended in particular for use in a navigation system and relates in particular to a contact-analog representation of navigation instructions N as augmented additional information Z1 to Zx in a display designed as a head-up display 2 or a live video image of an on-screen display 2 inside the vehicle. By means of the augmented contact-analog representation of navigation instructions N in the real or digital background H of the preceding environment U, it is possible to image-guided navigation on a track-by-track basis. The driver receives so exact information on which lane he should be classified. Hereinafter, the invention for an embodiment of the display 2 described as a screen and thus with an output image A transformed from a captured digital image Bd, which forms the (digital) background H (also called H (A)). The described method for augmented presentation of the additional information Z1 to Zx on a screen and thus in a digital background H is analogous to the augmented representation of the additional information Z1 to Zx on a projection screen or head-up display applicable, where there the real background H (also H (Br)) is formed by the real image Br of the preceding environment U with the objects O1 to Oz.

In this case, the device comprises 1 additionally at least one database 5 (please refer 1 ), in which data D, such as accurate map, road and / or navigation data / information (number of lanes / lanes, turning lanes, geometry of intersections, etc.) are stored, that of the processing unit 4 be supplied.

In addition, the device includes 1 a number of sensors S1 to Sy, which determine, for example, on the basis of associated sensor data SD, on which lane the own vehicle is located and at which point in the background H of the display 2 For example, a navigation hint N is to be displayed.

If these data D and / or sensor data SD are not available, insufficient data quality or due to available algorithms are not available in sufficient quality, a suitable degradation strategy is the display of the background H and / or the augmented additional information Z1 to Zx on the display 2 necessary. The degradation level is thus dependent on the quality of the environmental detection (D, SD).

The device 1 , in particular the processing unit 4 For this purpose, it is designed in such a way that at least one additional information Z1 to Zx to be augmented in the background H is determined on the basis of the data D and / or the sensor data SD. Optionally for a display designed as a screen 2 For example, the captured digital image Bd of the surroundings U becomes an output image A as the background H of the display 2 transformed. In addition, on the basis of the data D and / or the sensor data SD, at least one degradation stage DS1 to DSm of the representation is determined on the basis of which the at least one additional information Z1 to Zx and / or the background H are output appropriately.

In other words, both the background display and the augmented presentation of the additional information Z1 to Zx are automatically adjusted step by step according to situation, sensor and / or data, so that a user, without having to make additional settings, makes the current driving situation comfortable, in particular simple and intuitively in the real or digital background H of the display 2 can perceive.

That is, by simple stepwise adaptation or modification of the additional information Z1 to Zx to be overlaid, such as the navigation advice N, it can be highlighted in the digital output image A and / or in the real image Br of the background H of the display 2 and thus appear before the digital or real background H of the preceding traffic environment. Thus, the driver is always with a representation in the display 2 supplied, which offers the most information content in the respective situation.

2 schematically shows a module 6 the processing unit 4 for determining at least one of the degradation levels DS1 to DSm. The module 6 can do this in the processing unit 4 be implemented as a software module. The module 6 In this case, different input data ED1 to ED7 are supplied from one of the sensors S1 to Sy and / or another processing module for processing these input data ED1 to ED7 and for determining at least one of the degradation levels DS1 to DSm for the display.

When input data ED1 to ED7 of sensors S1 to Sy, it may be in particular the sensor data SD, such. B. the vehicle speed of a speedometer act.

Thus, as input data ED1 at least the current geographical position and / or as input data ED2 further geographical information, such as country information, the module 6 fed.

In addition, as input data ED3 a quality of the detected sensor data SD, in particular the resolution rate of navigation signals, and / or as input data ED4 a quality of environment detection, such as signal strength of radar sensors and / or image quality of a camera, the module 6 fed.

As input data ED5 the module 6 further supplied information and / or data for the assessment of a current driving situation.

As further input data ED6 and ED7 become the module 6 Information about the availability of map, road and / or navigation data or other suitable data supplied to other driver assistance systems.

• • Informationen über die Anzahl der Fahrbahnen und/oder Fahrspuren;
• • Informationen über die Abbiegerichtung der Fahrspuren und/oder der Fahrbahnen;
• • Breite der Fahrspuren und/oder der Fahrbahnen;
• • Geometrie einer Kreuzung oder Abbiegung, einschließlich Winkelinformationen.

In detail, to realize a precise-to-lane navigation by means of augmented presentation of the additional information Z1 to Zx in the digital or real background H, different data D and / or information from the database are obtained 5 , z. An internal navigation database, the processing unit 4 fed. For example, as the data D of the database 5 at least the following information is read out:

• • information about the number of lanes and / or lanes;
• • information about the turning direction of lanes and / or lanes;
• • width of lanes and / or lanes;
• • Geometry of an intersection or turn, including angle information.

To realize a contact-analogue representation in a real background H of a display designed as a head-up display 2 or in a digital background H a sequence of output images to additional information, in particular navigation data about the current geographical position of the vehicle is determined.

In addition to the geographical position, in particular a GPS position of the vehicle, the information is additionally required on which lane the vehicle is currently located and where the vehicle is located within the lane. This information is determined using at least one of the sensors S1 to Sy.

As sensors S1 to Sy, for example, a camera, a stereo camera, a lidar, a radar or ultrasonic sensors are used.

In addition, using the stored data D in the database 5 and / or the Sensor data SD of the sensors S1 to Sy shape, course and / or geometry of the lanes and lanes determined. In the case of an intersection, for example, the geometry of the intersecting and intersecting roadways and lanes are detected in order to display N turn-by-turn turn-by-turn indications in the background H as augmented navigation instructions.

3 to 7 schematically show various embodiments of a display 2 with a digital background H (A) comprising the output image A, or a real background H (Br) perceived by a user ahead in the travel direction as a real environment U, with superimposed additional information Z1 to Zx for displaying navigation hints N1 to N8 in different degradation levels DS1 to DS5. Below is in the following 3 to 7 does not distinguish between the digital background H (A) and the real background H (Br). For this reason, the background is called "H" for short.

3 schematically shows an embodiment for displaying a navigation advice N1 in a first degradation stage DS1. The first degradation level DS1 represents a realistic representation and not yet a degradation of the representation. It is the best possible representation with the highest possible quality.

In other words, the background H of the ad 2 , representing the surrounding reality and the traffic situation ahead, is superimposed with additional digital information - the virtual navigation reference N1 as additional virtual information Z1, wherein the superposition in the background H perspective correct to the real objects O1 to O4 with O1 equal to an oncoming vehicle, O2 same as a vehicle ahead on its own lane O3 and O4 equal road boundaries. Thereby, the virtual navigation pointer N1 directly corresponds to the real objects O1 to O4 in the real environment U. The background H may be the real image Br or the digital output image A of the captured digital image Bd.

In the described embodiment in an application in the own vehicle, the background H of the environment U moves with the drive of the own vehicle.

In the 3 illustrated first degradation level DS1 of the display 2 is automatically detected when using the module 6 Based on the input data ED1 to ED7, a cross reference within the own lane O3 and a longitudinal reference to the preceding environment U is determined. For example, by means of the module 6 a longitudinal reference to entering or crossing lanes and lanes determined.

In this first degradation stage DS1, the background H is true to reality, i. H. in a head-up display, the background H is formed by the real underlying traffic environment, or realistically, d. H. in a screen, the background H is formed by the digital output image A of the real traffic environment ahead.

The augmented navigation instruction N1 is shown in the form of a plurality of arrows indicating the preceding determined driving route in the background H for the navigation of the driver of the vehicle.

4 shows a second degradation level DS2 of the representation when using the module 6 a cross reference to the own lane O3 is determined, but no longitudinal reference can be made to merge or crossing lanes and / or lanes. In other words: Opposite in 3 the traffic situation has approached the own vehicle of the intersection in such a way that the still in 2 identified, preceding left cross road to own lane O3 in 3 can no longer be identified, with the left cross street is now immediately to the left of your own vehicle in reality. Instead of a plurality of arrows indicating a distance or route (navigation instruction N1 according to FIG 3 ), an abstracted representation in the form of an enlarged individual bending arrow in the second degradation stage DS2 is used for the representation of the augmented navigation advice N2.

5 shows a third degradation stage DS3 for the display of navigation instructions N3 to N5, when by means of the device 1 , in particular by means of the module 6 Based on the input data ED1 to ED7 neither a cross reference nor a longitudinal reference to the real environment U can be determined. In this case, the presentation of the accurate-to-navigation information is done in a schematic form. 5 shows two output images A1, A2 on the display 2 the preceding traffic route in different magnification levels and abstracts in a schematic form. The output images A1, A2 are determined based on map data of the current geographical position and the input navigation target for the own vehicle. As navigation information N3 while the preceding route to the destination is highlighted in the output image A1, z. B. by a different colored bar, which is displayed on the own lane O3. As navigation instruction N4, a directional arrow is displayed in the output image A2. As navigation reference N5 is a distance to the next Departure or turn shown by a bar graph in the output image A2.

For the augmented presentation of the navigation instructions N1 to N5 in the first, second or third degradation stage DS1 to DSm, suitable track-accurate information is required in the database 5 , in particular stored in a navigation database.

6 shows a fourth degradation level DS4 for the display of navigation instructions N6 to N7 when using the device 1 , in particular by means of the module 6 On the basis of the input data ED1 to ED7, neither a cross-reference nor a longitudinal reference to the real environment U can be determined, and, if appropriate, no suitable, accurate-to-the-trace information in the database 5 For example, because there is no information about the number of lanes or lapses of the lanes on the routes recorded in a map. In this case, a graphical element such as a directional arrow without reference to a background H (without representation of the reality) is displayed in the output image A3 as a navigation reference N6. As a navigation reference N7 is a text, in particular a more detailed information text to explain the route ahead, augmented on the display 2 output.

In addition, further degradation levels DSm are possible, for example if only an approximate longitudinal reference can be produced.

If navigation takes place via a roadway carpet, a row of successive arrows, a virtual cable, a combination thereof or the like, the representation can advantageously be adapted in one embodiment of the method according to the invention, depending on the curvature, complexity of the route, Vehicle speed or similar parameters of the route to the viewer is rotated. This results, for example, in curves, a kind of steep curve, which can be about a turn-off more clearly and earlier and better advantage.

This shows 7 schematically an embodiment for displaying a navigation advice N8 in a fifth Degradationsstufe DS5. The fifth degradation stage DS5 represents an extension of the realistic representation of the navigation reference N1 in the first degradation stage DS1 3 represents.

In this embodiment of the invention, an augmented navigation instruction N1 is expanded in curves by a wholly or partially horizontal, augmented navigation instruction N8 or replaced in an alternative, not shown embodiment. In this way, a kind of virtual guardrail appears in curves that sets the direction. The transition between these types of navigation can be done based on one or more driving conditions of the vehicle descriptive parameters such as longitudinal speed, yaw rate and speed, acceleration or other parameters such as curvature of the route, distance to the viewer, current geographical position of the vehicle or the like. By means of such parameters, in this variant of the method according to the invention, a step-by-step or stepless transition of various augmented representations of a navigation instruction can take place.

LIST OF REFERENCE NUMBERS

1

Device for augmented presentation

2

Output unit (display)

3

recording unit

4

processing unit

5

Database

6

module

A, A1, A2, A3

output image

At

Sequence of output images

bd

digital image of the environment

br

real picture of the environment

D

dates

DS1 to DSm

Degradationsstufen

ED1 to ED7

input data

H, H (Br), H (A)

background

N1 to N8

navigation Note

O1 to Oz

real object

S1 to Sy

sensors

SD

sensor data

U

Surroundings

Z1 to Zx

extra information

QUOTES INCLUDE IN THE DESCRIPTION

This list of the documents listed by the applicant has been generated automatically and is included solely for the better information of the reader. The list is not part of the German patent or utility model application. The DPMA assumes no liability for any errors or omissions.

Cited patent literature

• US 2010/0292886 A1 [0003]
• DE 102005062151 B4 [0004]

Claims (10)

Method for displaying navigation instructions (N1 to N8) of a navigation system on a display ( 2 ) by augmented representation of at least one additional information (Z1 to Zx) in at least one image (Br, Bd) of a vehicle surroundings (U) ahead of a vehicle, the image (Br, Bd) having a background (H, H (Br), H ( A)) of the advertisement ( 2 ) and at least one degradation stage (DS1 to DSm) of the representation is determined on the basis of which the at least one additional information (Z1 to Zx) and / or the background (H, H (Br), H (A)) are output in a correspondingly adapted manner. A method according to claim 1, characterized in that the degradation stage (DS1 to DSm) is determined as a function of a current geographical position of the vehicle or a driving condition of the vehicle. A method according to claim 1 or 2, characterized in that the degradation stage (DS1 to DSm) is determined in dependence on available map data, road data and / or navigation data at a predetermined geographical position of the vehicle. Method according to one of the preceding claims, characterized in that the degradation step (DS1 to DSm) depends on the nature of the background (H, H (Br), H (A)) of the display ( 2 ) and / or the quality of the environmental detection (D, SD) is determined. Method according to one of the preceding claims, characterized in that the degradation step (DS1 to DSm) is determined as a function of one in the background (H, H (Br), H (A)). Method according to one of the preceding claims, characterized in that in one or more of the degradation stages (DS1 to DSm) a longitudinal reference and / or a cross reference of the augmented additional information (Z1 to Zx) relative to real lanes and / or real lanes in the background (H , H (Br), H (A)). Method according to one of the preceding claims, characterized in that in one of the degradation stages (DS1 to DSm) without reference to real lanes and / or lanes as augmented additional information (Z1 to Zx) track-accurate information from a database ( 5 ) and output in a schematic output image (A; A1, A2). Method according to one of the preceding claims, characterized in that in one of the degradation levels (DS1 to DSm) as augmented additional information (Z1 to Zx) only directional instructions are output. Contraption ( 1 ) for carrying out a method according to one of claims 1 to 8, comprising: - at least one receiving unit ( 3 ) for capturing or capturing an image (Br, Bd) of an environment (U) forming a background (H, H (Br), H (A)) of a display, - at least one processing unit ( 4 ) for graphically processing a recorded digital image (Bd) and / or generating and superposing at least one additional information (Z1 to Zx) in the background (H, H (Br), H (A)) and - at least one output unit ( 2 ) for outputting the additional information (Z1 to Zx) in the background (H, H (Br), H (A)). Contraption ( 1 ) according to claim 9, characterized in that the output unit ( 2 ) is a head-up display.

Images