DE102019131740A1 - Method and display device for generating a depth effect in the perspective of an observer on a flat display medium and a motor vehicle - Google Patents

Abstract

The invention relates to a method for generating a depth effect in the perspective of an observer on a two-dimensional display medium (D) with the aid of a spatial displacement of several planes according to an effect of parallax, characterized in that the two-dimensional display medium (D) provides a two-dimensional display surface, the planes are provided as virtual planes (VE1, VE2, VE3) and to generate the parallax when a change in position of the eyes (A1, A2) of the observer (B) is detected with the aid of a camera and / or a sensor (S) that is configured, movements of the observer (B) to recognize, the virtual planes (VE1, VE2, VE3) are shifted relative to one another as a function of the recognized change in position on the two-dimensional display surface. The invention provides that an amount of the shift (Δd2, Δd3) is determined as a function of a respective virtual distance between the respective plane and the observer (B).

Description

The invention relates to a method for generating a depth effect in the perspective or a perception of an observer when viewing a display content on a display medium.

From the DE 10 2014 019 122 A1 a display system of a motor vehicle is known in which several image planes are arranged one behind the other by means of three different displays, so that a three-dimensional display of content is created. This system has a camera that detects the movements of an observer and compensates for a parallax effect by shifting the respective display levels so that all objects are displayed in line with the observer's line of sight. This device uses three different displays, which are transparent and partially transparent, in order to generate these different display levels. This system therefore requires a correspondingly large amount of installation space.

From the DE 10 2017 203 173 A1 a display arrangement of a motor vehicle is known which has two display devices arranged one behind the other, between which a virtual display plane is generated, at least one of the display devices being controlled as a function of an observer's eye position in order to compensate for a parallax effect. In this way, an impression of depth, as it is caused by the parallax effect, is destroyed.

From the DE 10 2017 208 339 A1 a projection display device for displaying a display image in different display planes is known. A method for operating this projection display device is also presented in this document. In this system, the display takes place via a projection device. This projection display device generates a virtual display image corresponding to a projection image in one or more display planes, which can also be perceived as a plurality of display planes. A position of an adjustable display element of the projection content for providing the projection image to be displayed is set along an optical axis of the projection unit, so that the distance from the display plane to the display of the virtual display image can be set variably. A control unit is used to set a position of one of the display levels as a function of an angle of a driver's line of sight.

The invention is based on the object of producing a depth effect in the perspective of an observer in a motor vehicle on an only two-dimensional display medium.

The object is achieved by the subjects of the independent claims. Advantageous further developments of the invention are described by the dependent claims, the following description and the figures.

In the invention, a method is provided for creating an effect of depth in the perspective or perception of an observer when viewing display content on a display medium. The depth effect is generated with the aid of a spatial displacement of several planes according to an effect of parallax, the display medium providing a two-dimensional display surface and the planes being provided or managed as virtual or digital planes. To generate the parallax when a change in position of the eyes of an observer is detected, a camera and / or a sensor that is configured to detect movements of the observer is used to shift the virtual planes relative to one another as a function of the detected change in position on the two-dimensional display surface. In other words: in order to create an effect of parallax on a two-dimensional display medium, such as a monitor or display or a head-up display, several virtual planes are created in a virtual world in which objects are each arranged in the planes, shifted against each other. The display device executing the method with a camera and / or a movement-recognizing sensor recognizes the head or eye movement of an observer and accordingly moves the virtual planes in the virtual world against one another. The effect of parallax is visible, for example, when an observer stands in front of a colonnade made up of two rows of columns arranged in parallel. Along the colonnade there are always pairs of columns made up of two columns each, which are at the same distance from the viewer and one of which belongs to one of the rows of columns. If the observer, who stands in front of this colonnade in the middle and looks through between the two rows of columns, moves to the left, for example, so that he no longer sees the columns on the left, but only the foremost column behind the others Columns of the left column row disappear, so at the same time the columns on the right side visually move further to the left when viewed from the front, so if they would spread open. It can be seen that the several levels, which are at the same level as or at a distance from each individual pair of pillars in this exemplary colonnade, are shifted to the left from one another, the further the greater the distance from the viewer. This effect is now shown on a two-dimensional display medium by artificially moving virtual levels, each corresponding to the level of each individual Pairs of columns correspond to the colonnade, causes. As a result, if the display device executing the method detects a change in position of the observer by means of a camera and / or a sensor, it can simulate a parallax effect.

The invention has the advantage that, in contrast to the prior art, a three-dimensional effect, which is achieved by creating a depth effect, is achieved on a simple two-dimensional display. The invention only requires a single two-dimensional or flat display medium on which a parallax effect is generated virtually or simulated by simulating the parallax when the viewer changes position in a virtual world by means of virtually spaced planes. This is done by virtually shifting the planes into one another or against one another in order to generate a parallax effect when the observer changes his position. The observer looks directly at the display. The parallax effect is thus generated by means of a simple two-dimensional display unit and a corresponding control circuit.

The invention also encompasses embodiments which result in additional advantages.

One embodiment provides that the display medium represents a virtual world with several virtual planes which, when the position of the observer's eyes relative to the display medium is changed, causes the parallax to be generated with a computer-based displacement of the respective virtual planes in relation to one another in the virtual world, with an amount the displacement is determined as a function of a respective virtual distance between the respective planes and the observer. In other words, the distances between the respective virtual planes can be variable and adjusted as required. This has the advantage that, in a virtual world, different information media with a certain priority can also be better presented in a three-dimensional spatial representation. If, for example, an information display is shown in a plane far back and there is a speed display, for example, far in front, this distance, which is large in the virtual world, will also result in a change in position of the observer when shifting the virtual planes to one another The observer is also shown accordingly. This makes the representation of the virtual world even more realistic. This is a similar effect, for example, if, as in the example above, the observer looking at a colonnade moves from the middle of the aisle to the left, for example, and he perceives the columns differently, whether these columns are now each five meters apart, ten meters or 20 meters. This effect can be simulated. This has the advantage that the representation of the virtual world can be made even more realistic.

One embodiment provides that the change in position of the observer's eyes is due to a movement of the observer's eyes alone or a movement of the observer's head alone or a mixed movement of the observer's eyes. In other words, the system can detect whether the observer is moving only his head, only his eyes or both and in doing so generates the parallax effect accordingly. This makes the system look more realistic.

One embodiment provides that the number of virtual planes in the virtual world on the two-dimensional display medium is two planes or more than two planes. In other words, the display can show a virtual world with any number of virtual levels. This corresponds, for example, to a colonnade with at least two pairs of columns or any number of pairs of columns, which enables greater flexibility in the presentation of display media, such as icons. This has the advantage that any virtual world with any number of adjustable information displays can be displayed in the system. The user can perceive this world as realistically as possible and a greater display and information option can be implemented. This makes it possible to create different user interfaces in a three-dimensional world, the division and assignment of the display elements and objects in the virtual world to a virtual plane in each case reducing the computational effort. Because the rasterization of the virtual world into discrete levels limits the computation effort for the displacement to the discrete number of levels, since the displacement only has to be calculated once per level.

One embodiment provides that in the two-dimensional display medium one or more display elements can be displayed in a graded depth according to priority data which indicate a priority of the respective display elements with respect to one another. In other words: A user interface contains several information displays that are ranked according to a certain priority. This tiering of priorities is recorded in a priority list which tabulates the respective display and information medium and their respective priority. Using this list, a system can now determine the level on which a certain display element is now displayed. This results in new possibilities for displaying a user interface with a three-dimensional effect.

One embodiment provides that the distances between the virtual planes in the virtual world for display on the two-dimensional display medium can each be set via a user interface, both subsequently and during operation. In other words: the distances between the individual virtual levels can be set on the one hand when the user interface is being programmed or during operation by the observer, such as the driver of the motor vehicle. This has the advantage that a user, such as the driver of the motor vehicle, can set the display according to his preferences so that he does not perceive an unpleasant 3D effect.

One embodiment provides that an intensity of the displacement of the virtual planes in the virtual world relative to one another for generating the parallax on the two-dimensional display medium can be set. Intensity is the functional relationship between the change in position or movement of the observer and the displacement of the planes with respect to one another. It may be, for example, that the system allows a certain movement tolerance of the observer in an adjustable manner before it begins to shift the virtual planes relative to one another in order to produce the effect of parallax. The method then provides, as it were, a trigger threshold that can be set as desired, be it by the programmer or by the observer, so that the effect can be individually adapted for an observer in order not to become uncomfortable for the observer. This has the advantage that the system can be adjusted to the individual preferences of observers, such as motor vehicle drivers.

One embodiment provides that the triggering threshold for recognizing the change in position of the observer's eyes can be set via a configuration interface. In other words, the observer can also determine this trigger threshold afterwards during operation, before the system shifts the virtual planes against each other, so that a certain movement tolerance range of the observer arises, according to his needs. This means that the system is also suitable for several people who each have their own preferences.

One embodiment provides that a display device is set up to carry out an embodiment of the method. Another embodiment provides a display device with a control circuit which is set up to carry out an embodiment of the method. In other words: the method is carried out in a display device, such as a screen, and by a control circuit, the screen displaying the results of the method. This has the advantage that a three-dimensionality is shown on a two-dimensional display without further aids. A control circuit can include one or more processors that carry out the method for generating the effect of parallax. The one processor or the plurality of processors can be coupled to a data memory in which program instructions can be stored which, when executed by the control circuit, cause the control circuit to carry out the said embodiment of the method.

One embodiment provides a motor vehicle in which the above-mentioned display device and the corresponding control circuit are used. In other words, in the motor vehicle, for example in an instrument cluster for displaying driving data to the driver, a virtual 3D image is displayed on a simple two-dimensional display. The corresponding control circuit that carries out the method can be installed in the display or elsewhere in the motor vehicle. This results in the advantage that the installation space of conventional three-dimensional displays in the motor vehicle, which as a rule consist of several displays, can be limited to one display. This is easier to install in the motor vehicle and also more cost-effective.

The motor vehicle according to the invention is preferably designed as a motor vehicle, in particular as a passenger vehicle or truck, or as a passenger bus or motorcycle.

The invention also includes the combinations of the features of the described embodiments.

• 1 eine Übersicht über das System umfassend einen Beobachter mit zwei Augen, der mittig auf ein zweidimensionales Anzeigemedium schaut;
• 2 die Darstellung einer virtuellen Welt mit drei virtuellen Ebenen, die in einer Flucht in der Blickrichtung des Beobachters dargestellt sind; und
• 3 die Verschiebung der virtuellen Ebenen, wenn sich die Position des Beobachters nach links verschiebt.

Exemplary embodiments of the invention are described below. This shows:

• 1 an overview of the system including a two-eyed observer looking centrally at a two-dimensional display medium;
• 2 the representation of a virtual world with three virtual planes, which are shown in a line in the direction of view of the observer; and
• 3rd the shift of the virtual planes when the observer's position shifts to the left.

The exemplary embodiments explained below are preferred embodiments of the invention. In the exemplary embodiments, the components described of the embodiments each represent individual features of the invention which are to be considered independently of one another and which further develop the invention in each case also independently of one another. Therefore, the disclosure is also intended to include combinations of the features of the embodiments other than those illustrated. Furthermore, the described embodiments can also be supplemented by further features of the invention already described.

In the figures, the same reference symbols denote functionally identical elements.

1 shows a two-dimensional display medium on the left D. . The two-dimensional display medium D. is in 1 shown at the top in a frontal view. The two-dimensional display medium shows D. a portico consisting of three pairs of columns 1 , 2 and 3rd . The first pair of pillars is marked with 1, the second pair of pillars with 2 and the third pair of pillars with 3. For clarity, the pairs of pillars are 2 and 3rd of the portico shown in black. Under the two-dimensional display medium D. there is a view from above of the two-dimensional display medium D. . This two-dimensional display medium D. opposite is an observer B who has two eyes A1 and A2 owns. With the eyes A1 and A2 the user can now see in the line of sight L1 and L2 on the two-dimensional display medium D. and recognizes the portico 1 , 2 and 3rd . The position of the observer B is recognized by the recognition device S, which can be, for example, a camera or a sensor that recognizes movements. The observer B now looks at the center of the two-dimensional display medium D. . In the two-dimensional display medium D. there are now three virtual levels VE1, VE2 and VE3, which are on the right-hand side of the 1 are shown. There is now a pair of columns on one of these virtual levels VE1, VE2 and VE3 1 , 2 and 3rd arranged. The order of the arrangement is that on the virtual level VE1 the pair of columns 1 , the pair of columns on the virtual level VE2 2 and the pair of columns on the virtual level VE3 3rd is shown. When the observer B is now centered on the two-dimensional display medium D. looks, he sees the portico 1 , 2 and 3rd in a flight so that he has all six pillars of the portico 1 , 2 and 3rd can recognize. If the position of the observer B changes, the virtual planes VE2 and VE3 can now be shifted in relation to the virtual plane VE1 in such a way that there is an effect of parallax towards the eyes A1 and A2 is simulated as if the observer B is now in reality his position from the center of the aisle of the portico 1 , 2 and 3rd changed and this view along the lines of sight L1 and L2 on the pillars of the portico 1 , 2 and 3rd would now perceive in a real way.

That in the 1 The embodiment shown corresponds exactly to the case that an observer B is in the middle in front of a colonnade 1 , 2 and 3rd with three pillars stands and now from the front on all these six pillars of the colonnade 1 , 2 and 3rd looks. Any movement of observer B along a plane horizontal to that of the arcade 1 , 2 and 3rd is now simulated.

2 shows on the left the case that the observer B is on the colonnade 1 , 2 and 3rd with the eyes A1 and A2 looks. These pairs of pillars 1 , 2 and 3rd are now shown in a frontal view analogous to the real colonnade. The pair of pillars has 1 from the pair of pillars 2 the distance d12 and the pair of columns 2 from the pair of pillars 3rd the distance d23. Further up is observer B's view of the pairs of pillars 1 , 2 and 3rd now shown on the two-dimensional display medium in a front view. Here are the respective pairs of pillars 1 , 2 and 3rd numbered analogously. If the user is now from the front on the pairs of pillars 1 , 2 and 3rd of the portico, he sees all the columns in line with the respective line of sight L1 and L2 . The respective viewing axes are now further down in the frontal view L1 of the eye A1 of observer B to the pairs of columns 1 , 2 and 3rd along the line of sight L1 shown. The lines of sight are analogous to this L1 and L2 to the pairs of pillars 1 , 2 and 3rd of the portico along the line of the line of sight L2 . On the right side of the 2 is now the two-dimensional display medium D. represented in the virtual world. This virtual world comprises three virtual levels VE1, VE2 and VE3, each level being a pair of columns 1 , 2 and 3rd of the portico. These virtual levels VE1, VE2 and VE3 are now the first virtual level VE1, the second virtual level VE2 and the third virtual level VE3. There is now a pair of pillars on each of these virtual levels 1 , 2 and 3rd of the portico. The pair of columns is on the first virtual level VE1 1 shown, on the second virtual level VE2 is the pair of columns 2 shown. The pair of columns is on the third virtual level VE3 3rd shown. These virtual planes now also have the analog distance d12 of the pair of columns 1 to the pair of pillars 2 to each other. In the virtual world, too, this corresponds to the virtual distance d12 between the virtual plane VE1 and the virtual plane VE2. Furthermore, the distance between the pair of pillars forms d23 2 to the pair of pillars 3rd also the same distance d23 from the virtual plane VE2 to the virtual plane VE3. This real world is now reproduced analogously in the virtual world. The direction of view of the observer is also shown. This now also includes the flight along the line of sight L1 and also the line of sight L2 . The observer B is in front of the colonnade and looks at the center of the pairs of columns 1 , 2 and 3rd of the portico.

3rd Now the example on the left shows that observer B, who is in front of the portico 1 , 2 and 3rd stands, now moving to the left. This is now represented by the second head, which is located to the left of head B. This also changes the viewing direction of the observer B. For example, they are on the left side in the viewing axis L1 the columns 2 and 3rd behind the pillar 1 hidden. The distances Δd2 and Δd3 between the columns 1 , 2 and 3rd have themselves in the line of sight L2 enlarged. This effect is now shown in a front view on the two-dimensional display medium D. shown above. Analogous to this change in the field of view, in 3rd the virtual planes VE2 and VE3 are shifted relative to the virtual plane VE1 by the distances Δd2 and Δd3, respectively. The virtual plane VE1 remains fixed, as does the view along the viewing axes L1 and L2 on the pair of pillars 1 does not change. Such are the pillars of the pair of pillars 1 still normally visible to observer B. The virtual plane VE2 is now shifted to the left by the distance Δd2 with respect to the virtual plane VE1. This will make the pillar 2 in the line of sight L1 from the pillar 1 covered. This shift also causes the column to move 2 further to the left opposite the line of sight L2 . Furthermore, the virtual plane VE3 is shifted by the distance Δd3 with respect to the virtual plane VE2. This gives the effect that the pillar 3rd behind the pillar 2 in the line of sight L1 is hidden and the pillar 3rd opposite the column 2 is still shifted to the left by the distance Δd3. This staggered shifting of the virtual levels forms the real change in the viewing angle along the viewing axes L1 and L2 in the portico. Similarly, depending on the position changes, the virtual planes VE2 and VE3 are shifted in a staggered manner with respect to the virtual plane VE1 along the direction of movement of the observer B, either to the left or to the right. The intensity of the change in position of observer B is also represented by the intensity of the shift. If the observer B would now be in the example on the left side of the 3rd If you move even further to the left, the virtual plane VE3 and VE2 would be on the right-hand side of the 3rd Move even further to the left so that the pillars 2 and 3rd again behind the pillar 1 become visible. The distance between the respective pairs of columns 1 , 2 and 3rd to each other in the real world is simulated in the virtual world by the distances between the virtual levels VE1, VE2 and VE3.

The example of the colonnade is an exemplary embodiment of how the method works. The two-dimensional display medium D. can also represent any other virtual world.

Due to the virtual generation of the parallax effect, a display medium with several two-dimensional display media is dispensed with. This enables a three-dimensional representation of display elements on a two-dimensional display. The creation of the depth effect by means of the effect of parallax also means that the user does not need to use 3D glasses to experience a 3D effect.

The display medium can be a display or a monitor in a vehicle (for example an instrument cluster / center screen, virtual exterior mirror). This represents images that lie on a single image plane. However, these images on this one image plane do not have any depth effect, hence no spatiality. The image in a display can be made up of several virtual levels. In a real three-dimensional world one experiences this spatiality through the two eyes ( A1 , A2 ) and when moving due to the spatial displacement over several levels. Now a virtual 3D image is to be generated on the display. Due to the 3D effect of the image on the display, information can be staggered in depth and displayed with priority. The prioritization can be made on the basis of the design of the virtual world. The image in the display is made up of several virtual levels. A camera records the position of the head and eyes. The movements of the observer are lateral or transverse with respect to the display medium. If the position of the head and eyes is changed, this is included in the display so that the new image is modified in such a way that the virtual planes are shown shifted and thus the impression of a three-dimensionality, similar to the real image, is created. The three virtual levels are digital deep projections. These three levels can each have individual virtual distances predetermined by parameters. These depth parameters can now be changed by the programmer or by the user afterwards as part of a digital depth input. Furthermore, these depth parameters each contain not only the distances between the virtual planes, but also the intensity of the movements and the reaction of the virtual planes to the changes in position of the user, which represents a sensitivity to small movements or large movements. In addition, the depth parameters can determine a trigger threshold from which the system causes the virtual planes to shift relative to one another when the user changes their position. This allows a certain tolerance before the system reacts to changes in position of the observer. A sensitivity of the system can thus be set for small movements of the observer. Both the depth and the sensitivity of the system can be adjusted during operation. This means that the escape can also be adjusted in the system. The camera can be connected to the Observers recognize either the eye position or certain features of the head, such as the eye frame or the nose, on the basis of which, as a marker, it can recognize a change in position of the observer.

Overall, the example shows how the invention can bring about a three-dimensional effect on a two-dimensional display medium by generating a parallax effect.

Overall, the examples show how a virtual 3D display can be provided by the invention.

QUOTES INCLUDED IN THE DESCRIPTION

This list of the documents listed by the applicant was generated automatically and is included solely for the better information of the reader. The list is not part of the German patent or utility model application. The DPMA assumes no liability for any errors or omissions.

Patent literature cited

• DE 102014019122 A1 [0002]
• DE 102017203173 A1 [0003]
• DE 102017208339 A1 [0004]

Claims (10)

Method for generating a depth effect in the perspective of an observer (B) on a display medium with the aid of a spatial displacement of several planes according to an effect of parallax, characterized in that the display medium provides a two-dimensional display surface (D), the planes as virtual planes (VE1 , VE2, VE3) are provided and to generate the parallax when a change in position of the eyes (A1, A2) of an observer (B) is detected with the aid of a camera and / or a sensor (S) which is configured, movements of the observer (B ), then the virtual planes (VE1, VE2, VE3) are shifted relative to one another on the two-dimensional display surface (D) as a function of the detected change in position of the observer (B). Procedure according to Claim 1 , the two-dimensional display area (D) showing a virtual world with several virtual planes (VE1, VE2, VE3) which, when the position of the eyes (A1, A2) of the observer (B) changes relative to the two-dimensional display area (D), generates parallax with a computer-based shifting of the respective virtual planes (VE1, VE2, VE3) against each other in the virtual world, an amount of the shift (Δd2, Δd3) being determined as a function of a respective virtual distance between the respective plane and the observer (B) . Method according to one of the preceding claims, wherein the change in position of the eyes (A1, A2) of the observer (B) is based on a movement of the eyes (A1, A2) of the observer (B) alone or a movement of the head of the observer (B) alone or a mixed movement of the eyes (A1, A2) and the head of the observer (B) takes place. Method according to one of the preceding claims, wherein the number of virtual levels (VE1, VE2, VE3) in the virtual world on the two-dimensional display medium (D) is two levels or more than two levels. Method according to one of the preceding claims, wherein in the two-dimensional display medium (D) one or more display elements are displayed staggered at a depth according to priority data which indicate a priority of the respective display elements with respect to one another. Method according to one of the preceding claims, wherein the distances (d12, d23) of the virtual planes (VE1, VE2, VE3) to one another in the virtual world for display on the two-dimensional display medium (D) can be set in each case via a user interface. Method according to one of the preceding claims, wherein an intensity of the shift (Δd2, Δd3) of the virtual planes (VE1, VE2, VE3) in the virtual world for generating the parallax on the two-dimensional display medium (D) is adjustable. Method according to one of the preceding claims, wherein a trigger threshold for recognizing the change in position of the eyes (A1, A2) of the observer (B) can be set via a configuration interface. Device which is designed as a display device and / or as a control circuit and which is set up to implement an embodiment of the method according to one of the Claims 1 to 8th perform. Motor vehicle that has a display device and / or a control circuit according to Claim 9 includes.

Images