DE102015015676A1 - A method for automatically connecting an environmental image on a display unit of a vehicle - Google Patents

Abstract

The invention relates to a method for automatically connecting an environmental image to a display unit of a vehicle, in which a current image of an environment of the vehicle (1) is generated and an observer position of a driver is determined. In one method, depending on an eye position of the driver, a position of a traffic light contained in the environment (3) and CAD data of a windshield (13) of the vehicle (1) determines whether a view of the traffic light (3) is covered in which, when the view is hidden, the image of the environment containing the traffic light (3) is switched to the display unit (9).

Description

The invention relates to a method for automatically connecting an environmental image to a display unit of a vehicle, in which a current image of an environment of the vehicle is generated and an observer position of a driver is determined.

From the DE 10 2013 226 596 A1 a drive device for a display device is known, which has a camera for recording a video image. This video image represents an environment of the vehicle on a display surface. At the same time, a viewing signal is processed which has information about a relative position of an observer to the display surface. By means of a controller which generates an indication signal when a representation of a hidden from the display surface for the observer part of the environment is to be effected on the display surface. Thereby, a factual looking through the display unit is realized in that the display surface appears transparent in this case. In this way, for example, a traffic light can be made visible to the driver. A constant switching on of the video image of the environment can also cause the driver to be distracted.

The object of the invention is to provide a method for automatically connecting an environmental image of the vehicle, which is only switched on when the driver of the vehicle can not properly view the environment.

The invention results from the features of the independent claims. Advantageous developments and refinements are the subject of the dependent claims. Other features, applications and advantages of the invention will become apparent from the following description, as well as the explanation of embodiments of the invention, which are illustrated in the figures.

The object is achieved by a method in that is determined depending on an eye position of the driver, a position of a traffic light contained in the environment and CAD data of a windshield of the vehicle, whether a view is obscured on the traffic light, with a hidden view the image of the environment containing the traffic light is displayed on the display unit. The video image will only be activated if it is necessary for security reasons. This has the advantage that increases the comfort for the driver. The result is the impression of an intelligent vehicle, which knows whether the driver has trouble finding the traffic light. This results in a high-quality overall experience without annoying automatic video intercom on a vehicle display unit.

Advantageously, it is determined at a stop of the vehicle via a map, if the stop is at a traffic light and the view is checked when the traffic light is present in the environment. This allows reliably that the environment image is only really switched on when the stop was made at a traffic light.

In one embodiment, it is determined at a stop of the vehicle, whether another vehicle is in front of the vehicle, the view is checked when no other vehicle is in front of the vehicle. The determination of a standing in front of the vehicle further vehicle can be done via radar, ultrasound, Lidar sensors or a camera. Only if the vehicle is the first at a traffic light, the examination of the view of the traffic light is performed for safety reasons.

In one embodiment, the driver's eye position is determined by means of a seat adjustment. From the seat adjustment, the position of the driver to the windshield can be easily derived and thus determine the driver's line of sight.

In an alternative, the driver's eye position is determined with an interior camera, preferably a head-eye tracking camera or a gesture camera. By means of such an interior camera, the eye position can be determined very reliably, which has a positive effect on the driver's vision.

In a variant, the switched-on image of the environment containing the traffic light is generated by a video camera. Such video cameras are present in vehicles, so that no additional components are required to carry out the method. This reduces the cost of the process.

Alternatively, an image of the environment which is present on the display unit and contains the traffic light is enlarged. This takes advantage of the ability to zoom in on zoomed images of the camera in case of need, giving the driver a good view of the traffic light.

In a further alternative, a self-existing image of the environment containing the traffic light is changed in a perspective or view. This ensures that the driver has an optimal view of the traffic light.

In a further embodiment, the perspective of the image is changed into a wide-angle perspective or a picture section with the traffic light increased. This ensures that the entire traffic light is always visible to the driver.

• – eine Kamera zur Aufnahme einer Umgebung des Fahrzeuges,
• – eine mit der Kamera verbundene Anzeigeeinheit zur Wiedergabe eines von der Kamera erzeugten Bildes der Umgebung,
• – eine Erfassungseinrichtung zur Bestimmung einer Augenposition eines Fahrers und eine, mit der Kamera, der Anzeigeeinheit und der Erfassungseinrichtung verbundenen Recheneinheit zur Auswertung der Augenposition des Fahrers und zur Prüfung, ob eine Ampel in dem Bild der Umgebung enthalten ist und zur Erzeugung eines Signales zur Anzeige des Bildes der Umgebung, wenn eine Sicht auf die Ampel eingeschränkt ist.

A vehicle in which the driver always has a reliable view of a hidden traffic light comprises

• A camera for receiving an environment of the vehicle,
• A display unit connected to the camera for displaying an image of the environment generated by the camera,
• A detection device for determining an eye position of a driver and a computing unit connected to the camera, the display unit and the detection device for evaluating the eye position of the driver and for checking whether a traffic light is contained in the image of the environment and for generating a signal for display the image of the environment when a view of the traffic light is restricted.

Further advantages, features and details will become apparent from the following description in which - where appropriate, with reference to the drawings - at least one embodiment is described in detail. Described and / or illustrated features may form the subject of the invention itself or in any meaningful combination, optionally also independent of the claims, and in particular may also be the subject of one or more separate application / s. The same, similar and / or functionally identical parts are provided with the same reference numerals.

Show it:

1 An embodiment of the vehicle according to the invention.

In 1 is a vehicle 1 shown at an intersection with a traffic light 3 stands. The vehicle 1 includes a camera mounted behind the rearview mirror 5 which is a video image of the environment of the vehicle 1 recording in the direction of travel, the traffic light 3 is visible in the video image. The camera 5 is there with a computing unit 7 connected to a display unit 9 is coupled. At the same time is in the interior of the vehicle 1 a head-eye tracking camera 11 arranged exactly the eye movement of the driver of the vehicle 1 receives. Also this head-eye tracking camera 11 is with the arithmetic unit 7 connected.

To make sure that from the camera 5 taken picture really only on the display unit 7 is visible to the driver when the driver's view of the traffic light 3 is locked in the arithmetic unit 7 a method for automatically connecting the environmental image to the display unit 9 of the vehicle 1 stored. The arithmetic unit 7 checks whenever a vehicle stop occurs via a map, whether the stop is at an intersection with a traffic light 3 is done. In a second step is via a radar sensor, an ultrasonic sensor, a lidar sensor or the camera 5 determines if in front of the vehicle 1 yet another vehicle is. Is your own vehicle 1 the first thing that is at the traffic light intersection, the approximate position of his eyes can be determined by means of a seat adjustment of the driver. A more precise eye position is but alternatively with the head-eye tracking camera 11 certainly. In addition, the arithmetic unit determines 7 the exact position of the traffic light 3 from the map. Should the position of the traffic light 3 not included in the map, this is estimated by a heuristic.

From the information gathered in this way, such as the driver's eye position, the traffic light position and the CAD data of the windscreen 13 of the vehicle 1 , calculates the arithmetic unit 7 whether the driver is the traffic light 3 able to see. This is significant because the driver's view of the traffic light 3 often by driver assistance cameras or the A-pillar of the vehicle 1 is blocked. Comes the arithmetic unit 7 to the conclusion that the driver's view of the traffic light 3 is locked on the display unit 9 that from the camera 5 Recorded video image automatically turned on, giving the driver adequate visibility to the traffic light 3 receives.

Using the head-eye tracking camera 11 It determines where the driver is looking and if he bends forward from his seat. This data is also used to decide whether the traffic light view should be activated.

If it is common in the vehicle, that of the camera 5 recorded video image always as a thumbnail on the display unit 9 is displayed, it is determined that the driver is the view of the traffic light 3 is blocked, this small video image enlarged. There is also the possibility that the perspective or the viewing angle of the already existing video image is changed. Thus, for example, a video image with a normal or telepective could already be present, as it is, for. B. for Augmented Reality or Night Vision is needed. This perspective of the video image is then changed to a wide-angle perspective as soon as the traffic light 3 from the driver is not visible. Alternatively, it is also possible, instead of the perspective change to enlarge a picture detail, so that the traffic light 3 clearly visible in the picture.

In a further variant, only a part of the data mentioned is used for the decision to switch on the video image. For example, the decision is made based on the speed and the distance measurement to the preceding vehicle, so that, for example, the perspective of the video image, the viewing angle or the image section is changed as soon as the vehicle comes to a standstill and / or no vehicle is detected immediately ahead.

Although the invention has been further illustrated and explained in detail by way of preferred embodiments, the invention is not limited by the disclosed examples, and other variations can be derived therefrom by those skilled in the art without departing from the scope of the invention. It is therefore clear that a multitude of possible variations exists. It is also to be understood that exemplified embodiments are really only examples that are not to be construed in any way as limiting the scope, applicability, or configuration of the invention. Rather, the foregoing description and description of the figures enable one skilled in the art to practice the exemplary embodiments, and those of skill in the knowledge of the disclosed inventive concept may make various changes, for example as to the function or arrangement of individual elements recited in an exemplary embodiment, without Protection area defined by the claims and their legal equivalents, such as further explanations in the description.

LIST OF REFERENCE NUMBERS

1

vehicle

3

traffic light

5

camera

7

computer unit

9

display unit

11

Head-eye tracking camera

13

Windshield

QUOTES INCLUDE IN THE DESCRIPTION

This list of the documents listed by the applicant has been generated automatically and is included solely for the better information of the reader. The list is not part of the German patent or utility model application. The DPMA assumes no liability for any errors or omissions.

Cited patent literature

• DE 102013226596 A1 [0002]

Claims (10)

Method for automatically displaying an environmental image on a display unit of a vehicle, in which a current image of an environment of the vehicle ( 1 ) and an observer position of a driver is determined, characterized in that, depending on an eye position of the driver, a position of a traffic light contained in the environment ( 3 ) and CAD data of a windshield ( 13 ) of the vehicle ( 1 ) determines whether a view of the traffic light ( 3 ), whereby, with a hidden view, the traffic light ( 3 ) image of the environment on the display unit ( 9 ) is switched on. A method according to claim 1, characterized in that at a stop of the vehicle ( 1 ) is determined via a map, whether the stop at a traffic light ( 3 ) and the view of the traffic light ( 3 ) is checked when the traffic light ( 3 ) is present in the environment. Method according to claim 1 or 2, characterized in that at a stop of the vehicle ( 1 ) determines whether in front of the vehicle ( 1 ) another vehicle is standing, the view of the traffic light ( 3 ) is checked if there is no other vehicle in front of the vehicle ( 1 ) stands. A method according to claim 1, 2 or 3, characterized in that the eye position of the driver is determined by means of a seat adjustment. Method according to at least one of the preceding claims, characterized in that the eye position of the driver with an interior camera, preferably a head-eye tracking camera ( 11 ) or a gesture camera is determined. Method according to at least one of the preceding claims, characterized in that the displayed image of the traffic light ( 3 ) by a video camera ( 5 ) is recorded. Method according to at least one of the preceding claims, characterized in that a per se on the display unit ( 9 ) available, the traffic light ( 3 ) containing image of the environment is enlarged. Method according to at least one of the preceding claims, characterized in that an image of the traffic light ( 3 ) containing environment, is changed in a perspective or sight. A method according to claim 8, characterized in that the perspective of the image is changed into a wide-angle perspective or a picture section with the traffic light ( 3 ) is shown. Vehicle comprising - a camera ( 5 ) for receiving an environment of the vehicle ( 1 ), - one with the camera ( 5 ) connected display unit ( 9 ) to play one of the camera ( 5 ) generated image of the environment, - a detection device ( 11 ) for determining an eye position of a driver and - a, with the camera ( 5 ), the display unit ( 9 ) and the detection device ( 11 ) connected computing unit ( 7 ) for evaluating the eye position of the driver and for checking whether a traffic light ( 3 ) is contained in the image of the environment and for generating a signal for displaying the image of the environment in the display unit ( 9 ) when a driver's view of the traffic light ( 3 ) is restricted.

Images