DE102012022717A1 - Method for assisting user of motor car, involves determining diagram of environment of motor car in dependence of virtual eye point and displaying diagram with virtual eye point for representing contents perceptible to user - Google Patents

Abstract

The method involves representing contents perceptible to a user (3). A virtual eye point (11) is given and is deviated from the user into a sitting position (15) in a motor car (1). A diagram of an environment (9) of the motor car is determined in dependence of the virtual eye point and is displayed with the virtual eye point for representing the contents. Independent claims are included for the following: (1) device for assisting user of motor car; and (2) motor car.

Description

The invention relates to a method according to the preamble of claim 1, an assistance device according to the preamble of claim 5 and a method and / or device according motor vehicle.

Generic methods and assistance devices for assisting a user of a motor vehicle are known. In particular, these can be designed as part of a man-machine interface for operating the motor vehicle, for which purpose information necessary for the user of the motor vehicle can be obtained. In particular, so-called head-up displays are known in which the information is displayed in a field of view of the user. In particular, the information is displayed in a windshield of the user. In addition, it is known to perform such overlays so as to augment information perceived by the user through the windshield by a real scenario. Such applications are also known by the term 'augmented reality'. Moreover, it is known to make such reflections in a windshield so that the information can be perceived from an exterior of the motor vehicle. The DE 102 51 405 A1 relates to a head-up display for a motor vehicle, which is used to display information in a virtual image by means of a projector. The projector displays the virtual image as a mirror image.

The object of the invention is to improve a method and an assistance device for supporting a user of a motor vehicle in such a way that it can perceive an environment of the motor vehicle in a simpler and / or more intuitive manner.

The object is achieved by a method according to claim 1 by the characterizing part of claim 1. Advantageously, the user of the motor vehicle, the environment perceive easier and more intuitive, since he can virtually assume a different, especially higher, eye point. The representation of the surroundings of the motor vehicle preferably takes place as if the user of the motor vehicle were sitting in an elevated sitting position and therefore perceives the surroundings from the virtual eye point. As a result, traffic safety can be increased, in particular an overview, so that possibly existing hazardous situations can be detected more quickly by the user of the motor vehicle. The content can be displayed in any desired manner, in particular in a field of view, in particular by means of a so-called head-up display in a windshield lying in front of the user. By "virtual" it can be understood that the virtual eye point is selectable or specifiable, in particular freely specifiable, independently of imaging properties of a corresponding imaging device.

A preferred embodiment of the method is carried out according to claim 2. Advantageously, the model of the environment can first be determined or calculated. This can be done on the basis of corresponding data, in particular image data. Advantageously, if the model is present, this can be reproduced in any manner. By 'extracting the image' it can be understood that a particular image, in particular a projection from the three-dimensional model into the two-dimensional image, is presented to the user as content. Advantageously, this can be done in any way, so that the virtual eye point is freely selectable. This is advantageously chosen in particular so that it simulates the increased seating position of the user.

A further preferred embodiment of the method is carried out according to claim 3. Depending on the position of corresponding imaging devices and / or imaging devices, it may happen that the object can not or only partially be converted into image data. Accordingly, the three-dimensional model may have gaps. However, these gaps can advantageously be closed by the fact that, if appropriate, corresponding data about the object has been collected at an earlier point in time. Advantageously, this data can be completed on the basis of these possibly previously collected and / or determined data of the object. Likewise, the movement data of the object can be collected at an earlier point in time and a prediction of the movement path can be determined therefrom. Advantageously, this makes it possible to provide the elevated seat position, ie the virtual eye point, even when the object is currently not visible by the user in his actual position, ie via his actual eye point and / or by means of the corresponding imaging devices / or is obscured.

A further preferred embodiment of the method is carried out according to claim 4. Advantageously, the three-dimensional model can be supplemented by means of the image data received from the environment. The received image data can be understood, in particular, as meaning that are generated outside the motor vehicle, in particular by traffic surveillance cameras and / or imaging devices carried by other vehicles and / or by mobile devices Communication devices, in particular mobile phones and / or smartphones and / or the like. The image data generated outside of the motor vehicle can be transmitted in any manner to the motor vehicle, in particular via a network, an Internet, a vehicle-to-X communication, a vehicle-to-vehicle communication, a vehicle-to-infrastructure -Communication and / or the like. Advantageously, areas of the user which could not be discerned from his own vehicle, in particular at least partially concealed, can therefore be viewed on the basis of the three-dimensional model thus supplemented, in particular by objects located in front of the motor vehicle, in particular other motor vehicles.

The object is also achieved in an assistance device according to the preamble of claim 5 by the characterizing part of claim 5. In particular, the assistance device may be part of a man-machine interface of the motor vehicle, in particular fixedly connected thereto and / or installed in it. Alternatively or additionally, however, the assistance device can also be embodied as a portable or mobile device, in particular smart phone, mobile phone, tablet PC and / or the like. The assistance device is in particular set up, designed, constructed and / or equipped with software for carrying out a previously described method. Advantageously, the user can perceive the environment as if he held the virtual eye point, that would preferably sit in an elevated seating position. By freely definable, it can be understood that the virtual actual eye point can be freely simulated, in particular, is variable independently of the imaging properties of an image determination. In particular, it can be understood that this is selectable by the user. In particular, not to be understood by a fixed predetermined eye point, which results, for example, by a fixed predetermined optics. Incidentally, the advantages described above arise.

A preferred embodiment of the assistance device is designed according to claim 6. Advantageously, the environment can be detected by means of the imaging device, in particular an image of the environment can be detected. Alternatively or additionally, the image data describing the environment can be detected by means of the imaging device, wherein the three-dimensional model of the environment can be determined as a function of this data. Depending on this, the image may be displayed to the user of the motor vehicle as the content. An imaging device may, in particular, be understood to mean a camera, a video camera, a stereo camera and / or the like. Alternatively or additionally, however, other imaging devices such as an infrared camera, a radar-based imaging device, a laser-based imaging device and / or the like can be understood.

A further preferred embodiment of the assistance device is designed according to claim 7. Advantageously, the three-dimensional model can first be determined by means of the control device. Advantageously, the virtual eye point can be specified in any desired manner in this three-dimensional model. In particular, it is predetermined such that it lies above the actually detectable actual eye point of the user of the motor vehicle. Optionally, however, the virtual eye point can also be changed in any desired way, so that, for example, the user can perceive his own motor vehicle from above, from behind, from the side, from diagonally in front, diagonally from behind, from diagonally laterally below and / or the like , If appropriate, such changes of the virtual eye point can be linked to safety conditions, for example, be taken only during a standstill and / or during a very slow driving, in particular during a parking operation.

A further preferred embodiment of the assistance device is designed according to claim 8. A display device may, in particular, be understood as a display, in particular a so-called head-up display for mirroring the content into a field of view of the user. Advantageously, the content, ie the image, in particular a two-dimensional image of the three-dimensional model of the environment, can be displayed to the user as content by means of the presentation device. This can advantageously be done with the virtual eye point, so that the user virtually has the feeling of occupying a different sitting position, in particular the raised sitting position.

A further preferred embodiment of the assistance device is designed according to claim 9. Advantageously, the content can be superimposed exactly where the driver can perceive this most easily, namely in particular without having to take a look from the environment of the motor vehicle. Advantageously, the fading into the field of view can take place in such a way that the real perceptible environment is widened by means of the displayable content, wherein in particular a so-called augmented reality application is possible.

The object is also achieved by a motor vehicle according to claim 10. The motor vehicle is set up, designed, constructed and / or equipped with software for carrying out a previously described method and / or has an assistant device described above. This results in the advantages described above.

Further advantages, features and details will become apparent from the following description in which - where appropriate, with reference to the drawings - at least one embodiment is described in detail. Described and / or illustrated features may form the subject of the invention itself or in any meaningful combination, optionally also independent of the claims, and in particular may also be the subject of one or more separate application / s. The same, similar and / or functionally identical parts are provided with the same reference numerals.

Show it:

1 a schematic side view of an assistance device for supporting a user of the motor vehicle having motor vehicle in a traffic situation with two other objects;

2 in the 1 shown traffic situation, but in a schematic plan view;

3 a schematic view of a man-machine interface, by means of a content to the user of the in 1 and 2 shown motor vehicle is displayed; and

4 a flowchart of a method for supporting the user of the in the 1 - 3 shown motor vehicle.

1 shows a schematic side view of a motor vehicle 1 , the two objects 19 after driving. This in 1 illustrated motor vehicle 1 has an assistant device 27 on, by means of a user 3 of the motor vehicle 1 is supportable.

The in 1 represented users 3 of the motor vehicle 1 has an actual eye point 13 on, which corresponds in particular to an eye position. From this actual eye point 13 can out the user 3 by a windbreak of the motor vehicle 1 through an environment 9 of the motor vehicle 1 perceive, in particular at least one of the objects 19 see.

In the 1 illustrated assistance device 27 of the motor vehicle 1 has an imaging device 29 on, by means of the environment 9 detectable, in particular by means of image data 23 can be mapped. In addition, the assistant device 27 a control device 31 on, by means of the image data 23 are processable. The image data 23 can become one in 1 not shown three-dimensional model 17 the environment 9 be further processed. Advantageously, an image of the three-dimensional model 17 the user 3 of the motor vehicle 1 be presented as if this is a virtual eye point 11 would take. The user 3 So see a picture of the environment 9 , the virtual eye point 11 underlying. The virtual eye point 11 is preferably above the actually ingestible eye point 13 so that the user 3 the environment 9 perceive as if this would sit in an elevated seating position. By means of the assistance device 27 Thus, preferably, a virtual elevated seating position may be simulated which is higher than an actual seating position 15 , The actual seating position 15 is in 1 drawn by solid lines. The elevated virtual seating position is in 1 by means of a dotted outline of the user 3 symbolizes.

2 shows the in 1 shown traffic situation, but in a plan view. It can be seen that one directly in front of the motor vehicle 1 moving object 19 the view of a further ahead of the motor vehicle 1 moving object 19 at least partially blocked. Advantageously, the forward moving object 19 from the imaging device 29 be at least partially recorded. Advantageously, by means of the control device 31 the forward moving object 19 be supplemented. Alternatively or additionally, also a trajectory 21 of the object moving forward 19 by means of the control device 31 be predicted. Advantageously, the in 2 not shown three-dimensional model 17 the environment 9 be completed. Advantageously, this completion can be done exactly when the corresponding object 19 which is to be supplemented, is just visible. Advantageously, the object so supplemented 19 if this is later further and / or completely obscured, nevertheless in the three-dimensional model 17 remain and be displayed if necessary. Advantageously, therefore, determining the image of the environment 9 with the virtual eye point 11 best possible independent of an actual view of the imaging device 29 respectively.

3 shows a schematic view of a man-machine interface 37 to operate in the 1 and 2 shown motor vehicle 1 , The man-machine interface 37 has a windshield 39 through, through which a field of view 35 for the user 3 opened.

In addition, the illustrated human-machine interface 37 a head unit 41 as well as a central display 43 on. On the central display 43 and / or mirrored in the windshield 39 , ie in the field of vision 35 , can the user 3 a content 5 being represented. The content 5 has an illustration ( 7 ) in the 1 and 2 shown environment 9 of the motor vehicle 1 on. This is especially the three-dimensional model 17 taken. Advantageous is the figure ( 7 ) so in the human-machine interface 37 reproduced that this is the virtual eye point 11 having. When perceiving the picture ( 7 ) the user feels 3 So in particular a virtual elevated seating position. In particular, by means of the content 5 the real environment 9 be extended so that the user 3 occupies a virtual elevated seating position.

The central display 43 , the head unit 41 and / or a non-illustrated head-up display for displaying the content 5 in the field of view 35 the Windschutzschreibe 39 are part of a presentation device 33 the man-machine interface 37 , Accordingly, the display device 33 Projection devices and / or displays and / or lights and / or the like.

4 FIG. 12 is a flowchart of a method for assisting the user. FIG 3 in the 1 - 3 shown motor vehicle 1 , In a first step 45 will the picture ( 7 ) of the environment 9 of the motor vehicle 1 determined. In a second step 47 becomes the virtual eye point 11 predetermined, this is preferably higher than the actual ingestible actual eye point 13 of the user 3 on his actual sitting position 15 ,

In a third step 49 will the picture ( 7 ) with the virtual eye point 11 in the form of the content 5 the user 3 shown. Presenting the content 5 takes place by means of in 3 illustrated human-machine interface 37 ,

First, a three-dimensional model is preferred 17 the environment 9 created. Based on the three-dimensional model 17 the environment 9 is the two-dimensional mapping ( 7 ) of the environment 9 determined in such a way that the figure ( 7 ) the given virtual eye point 11 having.

According to a preferred alternative, the in 1 illustrated motor vehicle 1 a receiving device 25 on, by means of the environment 9 obtained external image data are receivable. Optionally, these may be from an environment imaging device 51 come. The environment imaging device 51 For example, part of one of the front of the vehicle 1 moving objects 19 be. Alternatively or additionally, the environmental imaging device 51 but also part of a transport infrastructure. Advantageously, thereby the three-dimensional model 17 supplemented and / or better and / or more completely determined. Advantageously, thereby the representation with the virtual eye point 11 more complete.

Advantageously, a conflict of goals optimal seating position 15 and a comparatively small and / or low body of the motor vehicle 1 be solved. Advantageous to the content 5 , in particular the figure ( 7 ) of the content 5 with the virtual eye point 11 being represented. Advantageously, in spite of a comparatively low and / or flat construction of the motor vehicle 1 the advantage of increased virtual seating position can be used. Advantageously, by the environment 9 be perceived better, in particular in order to take the increased virtual sitting position during a parking and / or Ausparken and / or on a slow ride and / or in unknown areas. In particular, the virtual eye point 11 be changed according to the situation, in particular for a parking and / or Ausparken and / or for a slow ride and / or in the unknown areas. For a faster ride in particular the virtual eye point 11 be lowered again and / or in particular be chosen so that he with the actual eye point 13 matches. In addition to a change in the virtual eye point 11 in a z-direction, so preferably up, are also applications for moving the virtual eyepoint 11 conceivable in other directions. Alternatively or additionally, a virtual displacement of the sitting position, so the virtual eye point 11 , on positions outside the motor vehicle 1 take place, in particular when parking the motor vehicle 1 to look at from the outside.

By means of a so-called augmented reality application, the virtual sitting position can be at least apparently changed, in particular by the reflection of the image ( 7 ) in the form of the content 5 in the field of view 35 of the user 3 , For this purpose it is assumed that by means of conventional displays, in particular the central display 43 and / or the head unit 41 and / or by means of an augmentation of the actually perceptible environment 9 passing through the windshield 39 is real viewable, and / or by means of a display that the complete Windschutzschreibe 39 covered, partially and / or completely an artificially generated image in the form of the image ( 7 ) is displayed. Due to the imaging device 29 , which in particular has one or more ambient cameras, the three-dimensional model 17 be fully calculated. The three-dimensional model 17 allows the viewing position, ie the virtual eye point 11 to change freely. Advantageously, for the motor vehicle 1 the apparent viewing position of the user 3 , in particular the driver of the motor vehicle 1 , changed, in particular, be increased.

First, by means of the imaging device 29 , especially the cameras, the environment 9 of the motor vehicle 1 detected. Subsequently, the three-dimensional model 17 determined, in particular by means of the control device 31 the assistant device 27 , In particular, then the virtual eye point 11 , Specified in particular in the form of a viewing position and / or selected. Subsequently, the content is displayed, in particular the fade-in of the image ( 7 ). The three-dimensional model 17 is generated in particular from camera images. The image information of the three-dimensional model 17 become dependent on the virtual eye point 11 especially the real image of the environment 9 superimposed and / or displayed in this.

It becomes the three-dimensional model 17 calculates the apparent viewing position, especially in the form of the virtual eye point 11 in the three-dimensional model 17 from which the figure ( 7 ) and the user 3 in the form of the content 5 is shown, in particular in the field of view 35 is displayed. The virtual seating position is determined using the virtual eyepoint 11 for the user 3 changed so that it seems to be in a larger and / or smaller and / or lower and / or higher motor vehicle 1 sitting and / or apparently centered and / or left and / or right front and / or back sitting and / or seemingly outside of the vehicle 1 located.

According to the invention, in particular, a determination of the three-dimensional model takes place 17 the environment 9 of the motor vehicle 1 in particular via environmental cameras of the imaging device 29 , A relevant image of this three-dimensional model 17 becomes in the form of the picture 7 partially or completely in the field of vision 35 of the user 3 , in particular driver, of the motor vehicle 1 projected. This is done in particular via a so-called head-up display on a viewing direction of the user 3 lying windshield 39 , The illustration ( 7 ), from the three-dimensional model 17 was created, takes place for the user 3 of the motor vehicle 1 especially as if the surroundings were 9 of the motor vehicle 1 from a virtual higher seating position within the motor vehicle 1 from view.

Although the invention has been further illustrated and explained in detail by way of preferred embodiments, the invention is not limited by the disclosed examples, and other variations can be derived therefrom by those skilled in the art without departing from the scope of the invention. It is therefore clear that a multitude of possible variations exists. It is also to be understood that exemplified embodiments are really only examples that are not to be construed in any way as limiting the scope, applicability, or configuration of the invention. Rather, the foregoing description and description of the figures enable one skilled in the art to practice the exemplary embodiments, and those skilled in the art, having the benefit of the disclosed inventive concept, can make various changes, for example, to the function or arrangement of individual elements recited in an exemplary embodiment, without Protected area, which is defined by the claims and their legal equivalents, such as further explanation in the description.

LIST OF REFERENCE NUMBERS

1

motor vehicle

3

user

5

content

7

Illustration

9

Surroundings

11

virtual eye point

13

Actual eye point

15

seating position

17

model

19

object

21

trajectory

23

image data

25

receiving device

27

assistance device

29

imaging device

31

control device

33

displayer

35

field of view

37

Human-machine interface

39

Windshield

41

Head Unit

43

Central display

45

first step

47

second step

49

Third step

51

Environment imaging device

QUOTES INCLUDE IN THE DESCRIPTION

This list of the documents listed by the applicant has been generated automatically and is included solely for the better information of the reader. The list is not part of the German patent or utility model application. The DPMA assumes no liability for any errors or omissions.

Cited patent literature

• DE 10251405 A1 [0002]

Claims (10)

Method for supporting a user ( 3 ) of a motor vehicle ( 1 ), comprising: - presenting one of the user ( 3 ) perceptible content ( 5 ), characterized by: - specifying a virtual eye point ( 11 ), by one of the user ( 3 ) in a sitting position ( 15 ) in the motor vehicle ( 1 ) actually ingestible actual eye point ( 13 ), - determining an image ( 7 ) an environment ( 9 ) of the motor vehicle ( 1 ) depending on the virtual eye point ( 13 ), - showing the figure ( 7 ) with the virtual eye point ( 11 ) for presenting the content ( 5 ). Method according to the preceding claim, characterized by: - determining a three-dimensional model ( 17 ) the environment ( 9 ), - taking the picture ( 7 ) from the three-dimensional model ( 17 ). Method according to one of the preceding claims, characterized by: modeling in the environment ( 9 ) ( 19 ) by means of the three-dimensional model ( 17 ), - completing and / or predicting a trajectory ( 21 ) of the object ( 19 ), if this is shown in the indirect illustration ( 7 ) at least partially or not at all. Method according to one of the preceding claims, characterized by: receiving image data ( 23 ) the environment ( 9 ), - completing the three-dimensional model ( 17 ) by means of the image data ( 23 ). Assistance device ( 27 ) for supporting a user ( 3 ) of a motor vehicle ( 1 ), by means of which the user ( 3 ) of the motor vehicle ( 1 ) a content ( 5 ), characterized in that the content ( 5 ) an illustration ( 7 ) an environment ( 9 ) of the motor vehicle ( 1 ) with a virtual eye point ( 11 ), wherein the virtual eye point ( 11 ) is freely definable and by one of the user ( 3 ) in a sitting position ( 15 ) in the motor vehicle ( 1 ) actually ingestible actual eye point ( 13 ) deviates. Assistance device according to the preceding claim, characterized by an imaging device ( 29 ) for detecting the environment ( 9 ). Assistance device according to one of the preceding two claims, characterized by one of the imaging device ( 29 ) downstream control device ( 31 ), by means of which a three-dimensional model ( 17 ) of the detected environment ( 9 ) can be determined. Assistance device according to the preceding claim, characterized by a display device ( 33 ), by means of which, depending on the three-dimensional model ( 17 ) the illustration ( 7 ) the environment ( 9 ) with the determined virtual eye point ( 11 ) the user ( 3 ) can be displayed. Assistance device according to the preceding claim, characterized in that the figure ( 7 ) the environment ( 9 ) in a field of view ( 35 ) of the user ( 5 ) can be faded in. Motor vehicle ( 1 ) with an assistance device ( 27 ) according to claims 5-9, and / or arranged, designed, constructed and / or equipped with software for carrying out a method according to one of the preceding claims 1 to 4.

Images