DE102021202527A1 - Display device and method for displaying an object on a lighting device - Google Patents

Abstract

A display device (100) for an object (105) is specified, having a beam path determination device (101) and an illumination device (102). The beam path determination device (101) is set up to determine a beam path (103) from at least one point (104, R1, R2, Rn-1, Rn) of the object (105) to a target (106). The beam path determination device (101) is connected to the lighting device and is also set up to determine that the determined beam path (103) intersects with the lighting device (102) at an intersection position (104', K1, K2, Kn-1, Kn). The beam path determination device (101) is also set up to illuminate the intersection position (104', K1, K2, Kn-1, Kn) of the beam path (103) with the lighting device (102).

Description

The invention relates to the technical field of transport systems. In particular, the present invention relates to a display device for an object, a method for displaying an object on a lighting device and a means of transport

Easy-to-read display devices in particular contribute to the traffic safety of a means of transport. It may be useful for a good display of information to be displayed directly on the windshield of a vehicle. In this way, the driver of a vehicle may be distracted only to a small extent when reading the information.

In order to display information on a windshield, devices, in particular head-up displays (HUD), are used that use augmented reality (AR) technology, in which information is displayed for a driver by means of a projection on the windshield.

The pamphlet US2016/0082840A1 relates to an information display system for enabling high-safety driving in which a shape of a virtual image of an obstacle is changed depending on a degree of danger which the obstacle means to the vehicle.

The content of the publication US 10,332,292 B1 addresses the supplementation of a person's view that an augmentation system provides over the environment through which a vehicle is moving.

The pamphlet U.S. 2018/0120561 A1 describes an image processing method in which an image of an object is recorded using an AR device and an environmental parameter of the AR device is determined based on the image.

The pamphlet DE 10 2016 123 748 A1 describes an augmented reality navigation in reduced visibility system for detecting objects in reduced visibility conditions using a vehicle radar system and an augmented reality display on a windshield or rearview mirror.

The pamphlet JP 6-230132A describes obstacle detection for a vehicle in which the driver does not essentially have to move out of his line of sight in order to detect the position and direction of an obstacle.

The object of the present invention is to enable an effective representation of objects.

The invention results from the features of the independent claims. Advantageous developments and refinements are the subject matter of the dependent claims. Further features, possible applications and advantages of the invention result from the following description and the explanation of exemplary embodiments of the invention which are illustrated in the figures.

According to one aspect of the present invention, a display device for an object is specified, which has a beam path determination device and an illumination device, wherein the beam path determination device is connected to the illumination device and is set up to determine a beam path from at least one point of the object to a target.

The object is achieved with the display device in that the beam path determination device is set up to determine that the determined beam path intersects with the lighting device at an intersection position. The beam path determination device may also be set up to illuminate the intersection position of the beam path with the lighting device.

In other words, the beam path may be the line connecting a point on the object to the eye of a user of a means of transport. This beam path may intersect the lighting device, for example the plane of a monitor. The beam path may result from illuminating the object with an electromagnetic wave of a definable wavelength and reflecting this electromagnetic wave, for example visible light, directly into the target. The path of rays may be a model variable from radiation optics that can be used to explain the propagation of an electromagnetic wave.

However, in one example, this ray path may be attenuated or impossible altogether, for example because of matter between the target and the object attenuating and/or reducing the propagation of the reflected visible light. In particular, the reflection of a beam in a specific wavelength may be attenuated and/or absorbed.

In such a case, however, a reflection can then be caused by means of a beam of a different wavelength, which is not affected by the attenuation and/or absorption. However, this wavelength may be outside the wavelength range visible to the human eye. A lidar and/or a radar system may generate such a wavelength.

In order to still provide a visual impression for a human user, a predeterminable section of the beam path of a reflection of a beam with a wavelength that is not visible to the human eye can be made visible to the human eye by means of the lighting device, just as if the light effect of reflection from a distant object of light visible to the human eye.

Consequently, the display device may be regarded as a wavelength converter which makes a reflection invisible to the human eye from at least one point of the object visible to the human eye by changing the wavelength of the reflection. For example, a reflection detected by means of a lidar and/or radar system can be made visible to the human eye.

This wavelength conversion may take place at the intersection position of the determined beam path with the illumination device by illuminating the intersection position of the beam path with the illumination device. This lighting may be active, for example by converting electrical energy into visible light.

The lighting device is advantageously set up to display a contour of the object.

The contour of an object may be a composition of a large number of points of the object, for example the points of the object which lie on the edge areas of the object. In one example, the contour can be reproduced by connecting at least two and/or a large number of intersection points.

According to another aspect of the present invention, the beam path determination device has an object sensor and a target sensor. The object sensor is set up to determine a position of the at least one point of the object and the target sensor is set up to determine a position of the target.

The beam path determination device is then set up to determine the intersection position of the beam path with the illumination device from the determined position of the at least one point of the object and the position of the target.

In this way, it may be possible to determine a virtual beam path that would cause a light reflection from the point of the object if it were hit with visible light.

According to another aspect of the present invention, the beam path determination device is set up to determine a vector between the position of the at least one point of the object and the position of the target to determine the intersection position of the beam path with the illumination device.

Geometric models of straight lines in space can be determined by means of vectors, for example by means of direction vectors, as a result of which beam path calculations can be carried out using computing devices. A processor installed in an on-board system of a vehicle can thus carry out the beam path determination.

According to a further aspect of the present invention, the display device is set up to determine a distance of the object from the lighting device and to illuminate the intersection position of the beam path with the lighting device in a distance-dependent color.

Additional information can be encoded by different coloring of the illumination of the intersection position or the intersection point, which gives a user of the means of transport additional information, such as the distance to the object and/or a relative movement speed of the object in relation to the illumination device. It may also be possible to determine projections on the object that have an influence on the distance between the object and the lighting device, in particular the means of transport in which the display device is used, but are not visible there due to the two-dimensional representation on the lighting device are. The color coding may warn against such protrusions.

According to a further aspect of the present invention, the object sensor and/or the target sensor is selected from a group of sensors, the group of sensors consisting of a distance sensor, an imaging device, a radar (radio detection and ranging) sensor, a lidar (light detection and ranging) sensor and a camera.

The sensors chosen may enhance the capabilities of a user of a means of transport, particularly the capability of a user's sense organ. In this way, lidar and/or radar sensors can also work outside the wavelength of visible light and provide data about the property of the object regardless of the weather and/or lighting.

According to another aspect of the present invention, the lighting device is integrated into a windshield of a means of transport.

The windshield is there to enable the user of a means of transport to view surrounding objects, so information can be displayed there for the user to easily perceive

According to yet another aspect of the present invention, the lighting device is set up to display environmental parameters.

The environmental parameters can be status parameters of the means of transport, such as speed or direction of travel. However, the environmental parameters can also be determined and displayed in relation to the object, for example a distance from the object or a relative speed to the object. The status parameters can be determined, for example, using a vehicle status module.

According to a further aspect of the present invention, a method for displaying an object on an illumination device is specified, the method having the determination of a beam path or beam path from at least one point of the object to a target.

The object is achieved in that the method provides for determining that the determined beam path intersects at an intersection with the illumination device and/or with a plane of the illumination device and for illuminating the intersection of the beam path with the illumination device.

According to another aspect of the present invention, a program element is provided which, when executed by a processor, executes the method for displaying an object on a lighting device.

According to yet another aspect of the present invention, there is provided a computer-readable storage medium storing a program which, when executed by a processor, performs the method of displaying an object on a lighting device.

As a computer-readable storage medium, a floppy disk, a hard disk, a USB (Universal Serial Bus) storage device, a RAM (Random Access Memory), a ROM (Read Only Memory), or an EPROM (Erasable Programmable Read Only Memory) may be used. An ASIC (application-specific integrated circuit) or an FPGA (field-programmable gate array) can also be used as a storage medium, as can SSD (solid-state drive) technology or a flash-based storage medium. A web server or a cloud can also be used as a storage medium. A computer-readable storage medium may also be viewed as a communications network, such as the Internet, which may allow program code to be downloaded. A radio-based network technology and/or a wired network technology can be used.

According to one aspect of the present invention, a means of transport and/or a windshield with a display device according to the invention is provided.

It may be provided that the display device is used to implement an augmented reality obstacle highlighting system, i.e. a system which is able to at least partially highlight objects and/or obstacles on a lighting device and/or windshield as extended information.

With the aid of the display device and the method, the ability of the driver of a vehicle to recognize obstacles may be increased by augmented reality. The position and minimum distance from obstacles in front of the vehicle are determined by radar and/or lidar measurements. In addition, the position of the driver's eyes is measured with a camera. The connection vectors between the driver's eyes and the contour of the obstacle are determined from both measurements.

The points of intersection of these vectors with the windshield of the vehicle are calculated in order to obtain the position of the contour to be represented on the windshield. In one example, the stopping distance of the vehicle is calculated from the vehicle data. The color of the contour is selected depending on the distance of the obstacle in relation to the stopping distance. The color green may be used when there is sufficient distance, orange for a warning and red for a hazard

The contour can be displayed on the windshield, for example by projection or on an integrated micro-LED display. In addition, the distance of the obstacle can be specified.

Further advantages, features and details emerge from the following description in which - possibly with reference to the characters tion - at least one embodiment is described in detail. Described and/or illustrated features can form the subject of the invention on their own or in any meaningful combination, possibly also independently of the claims, and in particular can also be the subject of one or more separate applications. Identical, similar and/or functionally identical parts are provided with the same reference symbols.

• 1 eine schematische isometrische Ansicht auf ein Objekt zusammen mit einer Anzeigevorrichtung für das Objekt gemäß einem exemplarischen Ausführungsbeispiel der vorliegenden Erfindung.
• 2 eine schematische Ansicht auf ein Objekt durch eine Beleuchtungseinrichtung gemäß einem exemplarischen Ausführungsbeispiel der vorliegenden Erfindung.
• 3 eine schematische isometrische Ansicht für das Abbilden von Eckwerten eines Objekts auf eine Beleuchtungseinrichtung gemäß einem exemplarischen Ausführungsbeispiel der vorliegenden Erfindung.
• 4 eine Draufsicht auf ein Modell zur Darstellung der Erfassung von Eckpunkten und einem Punkt geringstem Abstands mittels eines Objektsensors gemäß einem exemplarischen Ausführungsbeispiel der vorliegenden Erfindung.
• 5 ein Blockdiagramm der Funktionsgruppen einer Anzeigevorrichtung gemäß einem exemplarischen Ausführungsbeispiel der vorliegenden Erfindung.
• 6 ein Flussdiagramm für ein Verfahren zum Darstellen eines Objekts auf einer Beleuchtungseinrichtung gemäß einem exemplarischen Ausführungsbeispiel der vorliegenden Erfindung

Show it:

• 1 a schematic isometric view of an object together with a display device for the object according to an exemplary embodiment of the present invention.
• 2 a schematic view of an object through an illumination device according to an exemplary embodiment of the present invention.
• 3 a schematic isometric view for mapping corner values of an object onto a lighting device according to an exemplary embodiment of the present invention.
• 4 a plan view of a model for representing the detection of corner points and a point of minimum distance by means of an object sensor according to an exemplary embodiment of the present invention.
• 5 a block diagram of the functional groups of a display device according to an exemplary embodiment of the present invention.
• 6 a flowchart for a method for displaying an object on a lighting device according to an exemplary embodiment of the present invention

1 10 shows a schematic isometric view of an object 105 together with a display device 100 for the object according to an exemplary embodiment of the present invention.

The display device 100 has a beam path determination device 101 and an illumination device 102 . The beam path determination device 101 is set up to determine a beam path 103 from at least one point 104 of the object to a target 106, for example the eye of a user of a means of transport. The beam path determination device 101 is connected to the lighting device 102 and has an object sensor 101a and a target sensor 101b as well as a control device 101c.

The beam path determination device 101 is set up to determine that the determined beam path 103 intersects with the illumination device 102 at an intersection position 104′ and to illuminate the intersection position of the beam path by means of the illumination device. In order to be able to illuminate the lighting device at the correct position, the beam path determination device 101 may inform the lighting device 102 of the cutting position 104′ and/or transfer already rendered image data in the form of polygon arrays.

The object sensor 101a of the beam path determination device 101 is set up to determine the position of the at least one point 104 of the object 105 . Target sensor 101b of beam path determination device 101 is set up to determine a position of target 106 .

The data or information determined can be forwarded to the control device 101c. The control device 101c can use the determined data from the determined position of the at least one point 104 of the object 105 and the position of the target 106 to determine the intersection position 104' of the beam path 103 with the illumination device 102.

If the determined point of intersection 104' and/or the determined intersection position 104' is illuminated, the impression can be given as if the illumination originates from the reflection of an electromagnetic wave at the at least one point 104 on the object.

Not only a single point of the object 105 can be displayed on the lighting device 102, but a multiplicity of points. A contour 104" of the object can thus be displayed at least partially on the illumination device 102.

By illuminating and imaging at least one point of the object and/or even the entire contour of the object, the challenge of driving in bad weather conditions, such as heavy rain, fog or moisture on the windshield, can be overcome. Different objects 105 and/or their contours 104" can be recognized regardless of the weather, for example other vehicles, obstacles or pedestrians. In this way, when driving under adverse weather conditions or poor visibility, the stress level that arises for a driver can be reduced would if the vehicle had to be moved without additional information about the environment.

Display device 100 supports the driver of a vehicle by displaying contours of objects in front of a driver in the direction of travel and/or of all obstacles. In addition, the contours can also be provided with a color code, the color code indicating an assessment of a dangerous situation, for example if the distance to an object driving ahead decreases. Alternatively or additionally, the distance to each of the objects lying ahead could also be specified. Specifying the distance may be useful, since information about the three-dimensional shape of the object is lost on a two-dimensional illumination device 102 and the depth of an object is difficult to assess.

It is also possible to display the contours 104'' of the different obstacles lying ahead in different light colors in order to enable the objects to be easily distinguished.

The beam path determination device 101 and in particular the object sensor 101a is set up as a measuring system which enables the geometric data and/or distance data of each object 105 to be recorded. In one example, this measuring system 101a may have an infrared sensor, a lidar sensor and/or a radar sensor. These sensors may be operated with a wavelength lying essentially outside the visible wavelength range and may detect points 104 of objects 105 even under poor visibility conditions.

At least one point 104 and/or a multiplicity of points 104 on the object 105 may be determined by the acquisition of the geometric data. By applying vector geometry rules, the positions of the points 104 of the object on the lighting device 102 can be converted, so that the contour 104" or contours 104" of at least one and/or a large number of discovered objects on the lighting device 102 can be viewed as augmented reality images are displayed. This expanded display can provide a driver of a means of transport with additional and helpful information that he can use to navigate the vehicle.

The illumination impression on the illumination device 102 can be brought about by active illumination elements, for example OLEDs (organic light emitting diodes) or μLEDs. In one example, the lighting device 102 may be embodied as a monitor utilizing direct-view display technology. The LEDs may have a very small size and be packed with a high density and be color-controllable.

In one example, the lighting device 102 is integrated into a windshield. For example, the lighting device 102 is integrated into a viewing area of the windshield 107 that a driver can easily overlook while concentrating on the traffic. The windshield 107 may only be partially equipped with the lighting device 102 . Like the lighting device 102 , the windshield 107 is arranged between the object 105 and the target 106 .

The lighting device 102 can be viewed as an intermediate image plane between the obstacle and the eye 106 of a driver, on which an image of at least part of the object 105 takes place. In order to be able to carry out such an imaging, at least one object 105 and/or at least one obstacle 105 is detected in the beam path determination device 101 and then at least one point 104 on the object is converted into an image plane of the lighting device 102. Through the imaging a large number of object points 104, the contour 104" of an object 105 can be displayed on the lighting device 102. The user of a means of transport thus receives a powerful impression of a particularly highlighted object, even in poor visibility, which is actually located at a specifiable distance in front of the means of transport .

In other words, the lighting device 102 may be used to characterize an object shining through the lighting device 102 by emphasizing its contour particularly, for example by special lighting. This highlighting can also be done in good visibility conditions. In poor light conditions, the illumination of the contour of the object 105 may also contribute to good visibility of the object and not only to identification.

The beam or beam path 103, which is emitted by the lighting device 102 in the direction of the target 106, may essentially overlap the beam 103 or beam path 103, which is emitted by the at least one point 104, in good and moderate visibility conditions.

In the dark or in very poor visibility conditions, the beam emanating from the lighting device 102 may be the only one be a ray relative to the object that creates a visual effect in a user's eye at target 106 . Both the beam path 103 that emanates from the object point 104 and the beam that emanates from the intersection point 104′ on the lighting device 102 may be essentially direct beam paths 103 and/or beams that reach the target essentially without deflection and/or reflection 106 arrive.

the 2 shows a schematic view of an object 105 through an illumination device 102 according to an exemplary embodiment of the present invention.

The representation in the 2 it can be seen that the at least one illuminated point of intersection 104' and/or the contour 104" formed from a plurality of points 104' are generated by the illumination device 102 and that the object 105 shines through this illuminated contour 104". For this purpose, the lighting device 102 is made of at least partially transparent material and/or corresponding partially transparent LEDs.

the 2 shows a situation with good visibility.

In poor visibility conditions, the visibility of the object 105 is poor and the object may only be visible very faintly or not at all through the windshield 107 and/or the lighting device 102 . However, the weather conditions have essentially no influence on the luminosity of the at least one illuminated intersection point 104' generated by the illumination device 102 in the immediate vicinity of the target 106 and/or on the illuminated contour 104" generated by the illumination device 102". Both images can be essentially undamped reach destination 106.

the 3 1 shows a schematic isometric view for the mapping or imaging of corner points R ₁ , R ₂ , R _n-1 to R _n and/or corner values R ₁ , R ₂ , R _n-1 to R _n of an object 105 onto an illumination device 102 according to FIG an exemplary embodiment of the present invention. Without loss of generality, the object 105 may have four corner points in one example.

The corner points R ₁ , R ₂ , R _n-1 to R _n are shown as a representative selection from a large number of points 104 on the object 105 . These points are physically located on the edge area of the object 105. Without loss of generality, the object 105 may have a rectangular shape in one example.

By viewing the object 105 with the eye 106 at the target position P, the beam paths 103 are generated due to the optical focusing properties of the eye 106 . In other words, in a beam model, the beams 103 or beam paths 103 reflected by the points R ₁ , R ₂ , R _n-1 to R _n follow the drawn beam paths 103 on their way to the eye 106. However, this is only one Modeling for the propagation of electromagnetic waves. The beam paths 103 are therefore not visible.

On their way in the direction of the target point P, 106, the beam paths 103 intersect the lighting device 102 at the points of intersection K ₁ , K ₂ , K _n−1 to K _n , provided they strike an area of the windshield that is equipped with the lighting device 103 . For the beam path determination device 101 (not shown in 3 ) the task, from the data available to it, which was essentially recorded with the object sensor 101a and the target sensor 101b, the intersections 104', K ₁ , K ₂ , K _n-1 to K _n of the corner points 104, R ₁ , R ₂ , R _n-1 to R _n in order to trace the contour 104" on the lighting device 102, which essentially uses the intersection points 104' as support points for drawing the contour 104", K ₁ , K ₂ , K _n-1 to K _n used.

The beam path determination device 101, in particular the control device 101c, calculates the mapping or the imaging of the corner points 104, R ₁ , R ₂ , R _n-1 to R _n onto the intersection points K ₁ , K ₂ , K _n-1 to K _n and determines the contour 104". Since the lighting device 102 is essentially integrated into the windshield 107, geometric adjustments may still have to be made, for example to take into account the curvature of a windshield and to generate an image that is as realistic as possible. The image on the lighting device 102 is a virtual image that has essentially been computed solely based on rules of ray geometry.

In order to determine a contour 104", edge points 104, R ₁ , R ₂ , R _n and/or peripheral points 104, R ₁ , R ₂ , R _n of the object can also be used instead of corner points 104, R ₁ , R ₂ , R _n 105 can be used, which lie either on the edge of the object 105 or on the perimeter of the object 106. The corner points 104, R ₁ , R ₂ , R _n essentially indicate the outermost boundaries and/or the greatest maximum extent of the object 105 in a two-dimensional projection.

FIG. 4 shows a plan view of a model for representing the detection of corner points 104, R ₁ to R _n , as well as the point D, which describes the point with the smallest distance d to the object sensor 101a, by means of an object sensor 101a, for example a lidar sensor and/or a radar sensor or a corresponding transceiver, according to an exemplary embodiment of the present invention.

The object 105 is at a distance d from the object sensor 101a. The object sensor 101a has a viewing area 401 or sensor detection area 401 . Although the extreme points 104, R ₁ , R ₂ to R _n and/or edge points 104, R ₁ , R ₂ to R _n indicate the maximum two-dimensional extension and are therefore relevant for determining the contour, an extension in the direction of travel of the means of transport substantially not captured or reproduced. This is because edge point D is also located among the outer points detected by sensor 101a. However, this edge point D is located between the two edge points R ₁ to R _n and is therefore within contour 104" of object 105, which extends from three-dimensional space to two-dimensional illumination device 102. Therefore, the point D is not taken into account in the imaging.

However, the edge point D could also have an impact on safety when using a means of transport, because it determines the smallest distance d between the object and the transport title and would have to be taken into account for braking. Since this information is not evaluated in the two-dimensional projection, it may be processed on another processing channel and, for example, returned to the two-dimensional representation in the form of a color code.

The edge point D is decisive for the depth of the object 105 and, like the edge points of the extension R ₁ to R _n , is detected with the object sensor 101a.

the 5 10 shows a block diagram of the functional groups of a display device 100 according to an exemplary embodiment of the present invention.

The structural composition of the components is divided into value acquisition or input, processing and output.

The value input stage, data provision stage, preprocessing stage and/or value acquisition stage essentially has a vehicle geometry data storage module I501 in which geometry data of the means of transport are stored. The vehicle geometry data storage module I501 has stored information about the geometry of the windshield 107, for example, which can be helpful when converting determined intersection data 104 to a contour 104" that is correctly represented in terms of perspective. The data is processed, for example, via a database interface I502 and the processing modules P510 , P511, P512 and P513 of the processing stage and/or processing stage The data can be provided as polygon arrays, which can be output by a graphics processor of the output module.

The value acquisition stage also has a target sensor driver module I503, via which the target sensor 101b makes its raw data available, which are then converted into coordinates of the target 106 by the preprocessing module I504. In one example, the target sensor 101b is implemented as a camera with an eye-tracking function. In this example, the coordinates of the target point P are provided as eye-tracking coordinates and/or eye-point coordinates of the driver's eye.

The situation is similar with the object sensor 101a, which is also assigned to the value input stage. It supplies its data to the preprocessing modules I506, I507 via an object sensor driver module I505.

The pre-processing module I506 supplies coordinate values of the object points 104, R ₁ , R ₂ , R _n or coordinate values of the extreme points 104, R ₁ , R ₂ , R _n .

Further data determined by the respective sensor 101a, which would be lost in the two-dimensional projection onto the lighting device, such as the depth information about a minimum distance value d to the object 105, in particular to an obstacle 105, is sent to the preprocessing module I507 and parallel to processed by the preprocessing module I506. This minimum distance value d, as in the 4 is shown with the reference symbol D, are closer to the object sensor 101a and are therefore important for the risk of collision, although it is not taken into account for the contour determination in the preprocessing module I506.

In order to be able to use all useful information, the processing of the data and/or values determined in the object sensor driver module I505 is divided between the two channels of the preprocessing modules I506, I507.

Additional collected status parameters may also be provided by the vehicle status module I508 in the value collection stage and are provided via the pre-processing module I509, such as a continuously updated value for the currently required braking distance.

Additional input sensors may also be present. For example, sensors can detect road users and/or obstacles and pass on the information obtained to the processing stage. In another example, sensors may detect the prevailing weather, such as whether it is raining or whether there is fog, and turn components on and/or off depending on the weather.

For example, the display device 100 could also be controlled depending on the weather and, for example, only be switched on when visibility is poor.

The display elements of the display device could also be switched on or off depending on other components. For example, the braking distance display on the lighting device 102 could be switched off when the adaptive cruise control (ACC, Adaptive Cruise Control) is switched on.

The value input modules essentially pass their values on to the modules of the processing stage. The processing essentially takes place in the control device 101c.

To calculate the vectors of the optical path 103, the processing stage has a vector calculation module P510, which receives input values from the pre-processing module I506 of the external sensors, such as the object sensor 101a and also from the pre-processing module I504 of the internal sensors 101b, such as the target sensor 101b. In this case, internal sensors are essentially installed in the interior of a means of transport and/or are directed inwards, while external sensors are essentially installed in the exterior of the means of transport and/or are directed to the exterior for value determination.

The coordinate values of the object points 104, R ₁ , R ₂ , R _n are passed on to the vector calculation module P510 by the pre-processing module I506 of the object sensor 101a, and the coordinate values of the target point P or the eye position of the user or driver are passed on by the pre-processing module I504 of the target sensor 101b.

$$

zwischen den Koordinatenwerten des Zielpunktes P und je einem Koordinatenwert der ermittelten Extrempunkte 104, R₁, R₂, R_n des Objekts 105. Die Richtung der ermittelten Vektoren ist auf den Zielpunkt P zu gerichtet.From this, the vector calculation module P510 calculates the beam path vectors $\stackrel{}{P{R}_{}}$$\overrightarrow{{}_1},\overrightarrow{P{R}_2},\cdots ,\overrightarrow{P{R}_n},$

$$

between the coordinate values of the target point P and a coordinate value of each of the determined extreme points 104, R ₁ , R ₂ , R _n of the object 105. The direction of the determined vectors is directed toward the target point P.

At the same time, the risk assessment module P511 determines a hazard assessment from the values of the additionally collected status parameters of the currently required braking distance provided by the preprocessing module I509 and the minimum distance value d from the object 105 provided by the preprocessing module I507 and encodes the result of the hazard assessment in a color value with which the contour 104" can be presented on the lighting device 102 according to the determined danger level. In one example, the color coding can be provided to use a red color tone for a very dangerous situation, an orange color tone for a warning and the green color tone as an indication a sufficient distance.

In this way, the object sensor 101a can assume a dual function. He can determine the edge boundary points 104, R ₁ , R ₂ , R _n of the object 105 for the contour representation. And the object sensor 101a can also determine the distance d to the depth edge point D, not shown in the contour representation, which can play a role in the risk of collision.

For the object sensors 101a and/or the target sensors 101b, sensor devices can be used which may already be installed in a means of transport for other functions, for example distance and/or location sensors. The functionality of the display device 100 may therefore be easy to add to a means of transport that is already in use.

aus dem Vektorberechnungsmodul P510 und die geometrischen Informationen über die Windschutzscheibe sowie über die Beleuchtungseinrichtung 102 aus dem Fahrzeug-Geometriedaten-Speichermodul I501 in Form eines Polygon-Arrays entnommen. Diese Daten werden kombiniert und daraus die Schnittpunkte 104', K₁, K₂, K_n der Vektoren $\overrightarrow{P{R}_1},\overrightarrow{P{R}_2},\cdots ,\overrightarrow{P{R}_n}$

und/oder Strahlengänge 103 mit der Ebene der Windschutzscheibe 107 ermittelt, insbesondere mit der Ebene der Beleuchtungseinrichtung 102. Die Windschutzscheibe 107 mag als Mittelebene und/oder Zwischenebene zwischen dem Objekt 105 und dem Ziel 106 angeordnet sein.In the intersection determination module P512, the information of the beam path vectors $\stackrel{}{P{R}_{}}$$\overrightarrow{{}_1},\overrightarrow{P{R}_2},\cdots ,\overrightarrow{P{R}_n}$

taken from the vector calculation module P510 and the geometric information about the windshield and about the lighting device 102 from the vehicle geometry data storage module I501 in the form of a polygon array. This data is combined and from this the intersection points 104', K ₁ , K ₂ , K _n of the vectors $\stackrel{}{P{R}_{}}$$\overrightarrow{{}_1},\overrightarrow{P{R}_2},\cdots ,\overrightarrow{P{R}_n}$

and/or beam paths 103 are determined with the plane of the windshield 107, in particular with the plane of the lighting device 102. The windshield 107 may be arranged as a central plane and/or intermediate plane between the object 105 and the target 106.

mit der Beleuchtungseinrichtung 102 gibt, denn außerhalb der Fläche der Beleuchtungseinrichtung 102 liegende Schnittpunkte 104', K₁, K₂, K_n müssen nicht dargestellt werden.Furthermore, it can be determined in the intersection determination module P512 whether there is an intersection of the respective beam path vector at all $\overrightarrow{\mathrm{<figure-callout\; id="1"\; label="P\; R"\; filenames="DE102021202527A1\_0007.png"\; state="\{\{state\}\}">P</figure-callout>}{R}_{}{}_1},\overrightarrow{P{R}_2},\cdots ,\overrightarrow{P{R}_n}$

with the Illumination device 102 exists, because intersection points 104′, K ₁ , K ₂ , K _n that lie outside the area of the illumination device 102 do not have to be represented.

In the contour calculation module P513, the color values for the risk situation and the coordinate values of the intersection points 104', K ₁ , K ₂ , K _n are combined and, by connecting the intersection points 104', K ₁ , K ₂ , K _n with a connecting line, the Contour 104" of the object 105 is traced on the lighting device 102. The connecting line is colored in the shade determined by the risk assessment module P511, so that the color of the contour 104" provides an indication of the risk situation.

The values determined are then passed on to the modules of the output stage, which are essentially located in the lighting device 102 . The values are passed to a graphics processing module (GPU, Graphical Processing Unit) O514, which writes the values to the graphics memory module O515 of the lighting device 102. The determined contours can thus be output in the corresponding colors by driving corresponding LEDs on the lighting device 102 .

Since the lighting device is integrated into the windshield as a transparent screen, the contours, values and/or data are also output on the windshield 107 . In this case, micro-LEDs of an active matrix display 102 may be controlled and stimulated to emit light signals of a corresponding color tone. The lighting device 102 may be recessed into the glass panel of the windshield such that there may be substantially no visual impact from the presence of the lighting device.

In addition, other data such as distance values and/or speed values can also be output.

The display device 100 can also provide for processing and completing incompletely visible outlines, for example when part of an obstacle is obscured by smoke, exhaust fumes or sand thrown up. A far-reaching perspective could also be realized and a vehicle or obstacle 105 that is not yet visible due to its distance could already be recognized and displayed on the lighting device 102 . In one example, Car2Car communication may make it possible to also calculate outlines 104" of completely invisible vehicles by using the sensors 101a of another vehicle.

6 10 shows a flow chart for a method for displaying an object on a lighting device 102 according to an exemplary embodiment of the present invention.

Starting from the idle state S600, the method starts in the state S601, in which a beam path 103 from at least one point 104 of the object 105 to a target 106 is determined.

In state S602, it is determined that the determined beam path 103 intersects with the lighting device 102 at an intersection position 104′, and in state S603 the intersection position of the beam path is illuminated with the lighting device.

In the end state S604, the method ends.

Although the invention has been illustrated and explained in more detail by means of preferred exemplary embodiments, the invention is not restricted by the disclosed examples and other variations can be derived therefrom by a person skilled in the art without departing from the protective scope of the invention. It is therefore clear that a large number of possible variations exist. It is also understood that the exemplary embodiments given are really only examples and should not be construed as limiting in any way the scope, applications or configuration of the invention. Rather, the preceding description and the description of the figures enable the person skilled in the art to concretely implement the exemplary embodiments, whereby the person skilled in the art, knowing the disclosed inventive concept, can make a variety of changes, for example with regard to the function or the arrangement of individual elements mentioned in an exemplary embodiment. without departing from the scope of protection defined by the claims and their legal equivalents, such as further explanations in the description.

Reference List

100

display device

101

beam path determination device

101a

object sensor

101b

target sensor

101c

control device

102

lighting device

103

beam path

104

Point on object eg R ₁ , R ₂ , R _n-1 , R _n

104'

Point of intersection, e.g. K ₁ , K ₂ , _- K _n-1 , K _n

104"

contour

105

object

106

target

107

windshield

401

Field of view of the object sensor.

I501...I509

Input level modules

P510 ... P513

Processing stage modules

O514...O515

Modules for value output

P

position of the target

i.e

Distance

D

closest point of the object to the object sensor

S600...S604

process steps

QUOTES INCLUDED IN DESCRIPTION

This list of the documents cited by the applicant was generated automatically and is included solely for the better information of the reader. The list is not part of the German patent or utility model application. The DPMA assumes no liability for any errors or omissions.

Patent Literature Cited

• US 2016/0082840 A1 [0004]
• US10332292B1 [0005]
• US 2018/0120561 A1 [0006]
• DE 102016123748 A1 [0007]
• JP6230132A [0008]

Claims (10)

Display device (100) for an object (105), having a beam path determination device (101) and an illumination device (102), wherein the beam path determination device (101) is set up to detect a beam path (103) from at least one point (104, R ₁ , R ₂ , R _n-1 , R _n ) of the object (105) to a target (106), wherein the beam path determination device is connected to the lighting device, wherein the beam path determination device (101) is set up to determine that the determined beam path (103 ) intersects with the illumination device (102) at a cutting position (104', K ₁ , K ₂ , K _n-1 , K _n ), and wherein the beam path determination device (101) is set up to determine the cutting position (104', K ₁ , K ₂ , K _n-1 , K _n ) of the beam path (103) with the lighting device (102). Display device (100) after claim 1 , wherein the lighting device (102) is set up to display a contour (104") of the object (105). Display device (100) after claim 1 or 2 , wherein the beam path determination device (101) further comprises an object sensor (101a) and a target sensor (101b), wherein the object sensor (101a) is set up to determine a position of the at least one point (104, R ₁ , R ₂ , R _n-1 , R _n ) of the object (105), the target sensor (101b) being set up to determine a position of the target (106, P), and the beam path determination device (101) being set up from the determined position of the at least one point ( 104, R ₁ , R ₂ , R _n-1 , R _n ) of the object (105) and the position of the target (106, P) the intersection position (104', K ₁ , K ₂ , K _n-1 , K _n ) of the beam path (103) with the lighting device (102). Display device (100) after claim 3 , wherein the beam path determination device (101) is set up to determine the intersection position (104', K ₁ , K ₂ , K _n-1 , K _n ) of the beam path (103) with the illumination device (102), a vector between the position of the at least determining a point (104, R ₁ , R ₂ , R _n-1 , R _n ) of the object (105) and the position of the target (106, P). Display device (100) according to any one of Claims 1 until 4 , wherein the display device (100) is set up to determine a distance (d) of the object from the lighting device and the intersection position (104 ', K ₁ , K ₂ , K _n-1 , K _n ) of the beam path (103) with the lighting device (102) in a distance dependent color. Display device (100) according to any one of claims 3 until 5 , wherein the object sensor (101a) and/or the target sensor (101b) is selected from the group of sensors consisting of: - a distance sensor; - an imaging device; - a radar sensor; - a lidar sensor; and - a camera. Display device (100) according to any one of Claims 1 until 6 , wherein the lighting device (102) is integrated into a windshield (107) of a means of transport. Display device (100) according to any one of Claims 1 until 7 wherein the lighting device (102) is set up to display environmental parameters. Method for displaying an object on a lighting device, having the following steps: - Determining a beam path from at least one point of the object to a target; - Determining that the determined beam path intersects at an intersection position with the lighting device; Illuminating the intersection position of the beam path with the illumination device. Means of transport with a display device (101) according to one of Claims 1 until 8th .

Images