DE102010041348B4 - display device - Google Patents

Abstract

Display device with a holding device (2) which can be placed on the head of a user, an imaging device (5) attached to the holding device (2) for generating an image, a control unit (9) for controlling the imaging device (5) and one on the holding device (2) attached multifunctional glass (3, 4), which has a first coupling-in area (12) and a first coupling-out area (13), the generated image being coupled into the multifunctional glass (3) via the first coupling-in area (12), in the multifunctional glass (3) up to first decoupling area (13) and is decoupled via the first decoupling area (13) so that the user, when the holding device (2) is placed on the head, the decoupled image as a virtual image in a display area in front of the multifunction glass (3, 4) (40), characterized in that the display device (1) has a detector (8) and the multifunction glass (3) has a return channel (17), ü Via which at least part of the display area (40), when the holding device (2) is placed on the head, is imaged on the detector (8) for detecting the position of a pointing element, the detector (8) being connected to the control unit (9) which controls the image generation as a function of the detected pointing element position.

Description

The present invention relates to a display device according to the preamble of claim 1.

Such a display device can be used, for example, to display an image of a device that can be connected to the display device. The device can be, for example, a computer, a navigation device, an organizer, a smartphone, etc. However, operation is only possible on the device itself, which is cumbersome.

Furthermore, the display device can be used to generate a section of a document to be displayed using the image generator as an image, which the user can then perceive. In this case, it is difficult to easily move or position the cutout in the document.

Proceeding from this, it is therefore an object of the invention to develop the display device of the type mentioned at the outset in such a way that it provides a simplified input option.

The object is achieved in a display device of the type mentioned at the outset in that the display device has a detector and the multifunction glass has a return channel, via which at least part of the display area is imaged on the detector when the holding device is placed on the head for detecting the position of a pointing element is connected, the detector being connected to the control unit which controls the image generation as a function of the detected pointing element position.

Thus, in the display device according to the invention, input can be made via a pointing element of the user, since the pointing element position can be detected. At the same time, the display device can be made extremely compact, since the return channel is also formed in the multifunctional glass, so that the return channel can be provided in a space-saving manner.

The display device can in particular be designed in the manner of glasses. In this case, the holding device is designed as a spectacle frame. In particular, a conventional spectacle lens can be designed as a multifunction lens. For this purpose, essentially only the first coupling-in area and the first coupling-out area need to be formed in the spectacle lens.

Furthermore, the display device according to the invention can be designed such that the user - in the state of the holding device placed on the head - can perceive the decoupled image in superimposition with the surroundings.

The first coupling-in area and the first coupling-out area are preferably formed on the front of the multifunctional glass facing away from the user's eye when the holding device is placed on the head. In particular, the first coupling-in area and the first coupling-out area are each designed as reflective areas.

Furthermore, in the display device according to the invention, the return channel can have a second coupling-in area and a second coupling-out area, with the second coupling-out area on the front of the multifunctional glass facing away from the user's eye and the second coupling-in area on the eye of the user, when the holding device is placed on the head User facing back of the multifunctional glass are formed.

In particular, the hand of the user or a finger of the hand of the user can be used as the pointing element. In this case, a red filter or infrared filter is preferably arranged in front of the detector. This allows the recorded hand or finger to be spectrally separated from the recorded image background.

The red or infrared filter is preferably arranged on the back of the multifunction glass and / or in the second coupling-out area. Any other positioning is also possible, provided that it is ensured that the light for imaging the at least part of the display area passes through the filter before it hits the detector.

Instead of the filter or in addition to the filter, the control unit can carry out a pattern recognition or other image evaluation in order to detect a predetermined pointing element. The prescribed pointing element can be, for example, a pen, a pointing stick or another pointing element.

In the display device according to the invention, the control unit can be set up to display at least one input area in the decoupled image and to evaluate the detected pointing element position as a selection of the input area if the input area is selected in the virtual image with the pointing element. The input area can be a menu item of a menu structure or also another selection area or an input or selection item to be activated. With the generated image For example, several menu items can be presented, from which the user can then select the desired menu item using the pointing element.

In the device according to the invention, the control unit can in particular be set up to trigger the image generation of a changed image in response to the evaluated selection. The changed image can then be, for example, a submenu for the selected menu item.

Thus, according to the invention, a contact-free input interface is provided, in which one can carry out inputs in the virtual image even without touching a keyboard, mouse or other objective input unit. In particular, the display device can be designed as information glasses.

Furthermore, the display device according to the invention can have a sensor module which is preferably attached to the holding device and with which the rotation of the holding device about at least one axis can be detected, the sensor module emitting a corresponding sensor signal to the control unit and the control unit only taking the sensor signal into account for image generation when a predetermined pointing element position is detected at the same time.

Thus, the consideration of the detected rotation about the at least one axis during image generation can be activated and deactivated via the pointing element detection.

The control device can be set up to display a section of a document with the generated image, the position of the section in the document being determined as a function of the sensor signal. The sensor signal is preferably only taken into account if a predetermined pointing element position is detected at the same time.

In the display device according to the invention, the first coupling-in area, the second coupling-in area, the first coupling-out area and / or the second coupling-out area can each be designed as a Fresnel structure.

The respective Fresnel structures can have an imaging property. The imaging property can be used, for example, to correct any imaging errors that may occur during guidance in the multifunction glass.

The respective Fresnel structure can in particular be formed on the material interface of the multifunctional glass, the material interface being in particular a curved material interface. This provides a high degree of design freedom for the multifunction glass, which is hardly or not at all limited by the necessary optical function of the coupling or decoupling area, since the optical function of the coupling or decoupling area is realized by means of the Fresnel structure.

The respective Fresnel structure can be designed to be transmissive or reflective. If it is designed to be transmissive, it is preferably formed on the material interface of the multifunctional glass facing the user's eye when the holding device is placed on the user's head. If the Fresnel structure is reflective, it is preferably designed for the first coupling-in area and the first and second coupling-out areas, in each case on the front of the multifunctional glass facing away from the user's eye when the holding device is placed on the head, and it is preferably for the second coupling-in area formed on the back of the multifunction glass.

The respective Fresnel structure can have several Fresnel segments, the optically active facets of the Fresnel segments optically imitating an imaginary optical active surface. The optical active surface is particularly curved. Furthermore, it can have no mirror symmetry, no rotational symmetry and / or no translation symmetry.

Furthermore, the Fresnel structure can effect a beam path folding.

The guidance of the image in the multifunctional glass from the first coupling-in area to the first coupling-out area or from the second coupling-in area to the second coupling-out area is preferably carried out by total internal reflection on the front and rear of the multifunctional glass.

The maximum height of each facet is preferably the same size in the Fresnel structure. For example, it is in the range from 5 to 500 μm, in particular in the range from 0.01 to 0.1 mm. A range from 200 to 300 μm and a range from 0.05 to 0.3 mm are particularly preferred.

The facet shape can be a approximation, in particular a linear approximation of the shape of the corresponding surface section of the imaginary active surface. In particular, the facets can be concave, convex or linear in section.

The Fresnel segments can be directly adjacent, as is the case with a “classic” Fresnel structure. However, it is possible that the Fresnel segments are spaced from one another, the normal course of the material interface then preferably being present between them.

In the display device according to the invention, the return channel can provide at least two different magnifications for imaging the part of the display area, one of the images being selectively detectable by means of the detector. For selective detection, the detector can be tiltable about an axis and / or displaceable along an axis. In this case, selective detection is possible in particular because the images with the different magnifications either emerge laterally offset and / or emerge from the multifunctional glass with an angular offset.

In particular, the return channel can have a plurality of second coupling-in areas which contribute to the different magnification in the images or which bring about different magnifications.

In the display device according to the invention, the multifunction glass can have at least a third coupling-out area which is offset relative to the first coupling-out area, the coupling-in direction and / or the coupling-in location of the generated image being adjustable and, depending on this, the generated image from the first coupling-out area or from the third coupling-out area as that virtual image is coupled out.

Thus, according to the invention, an adjustment to different nose-eye distances can only be carried out by adjusting the coupling direction and / or the coupling location of the generated image. It is no longer necessary to change the multifunction glass itself.

In the display device according to the invention, the image generated can either be coupled out only from the first coupling-out area or only from the third coupling-out area.

The third decoupling area can partially overlap the first decoupling area. However, it is also possible that the third coupling-out area does not overlap the first coupling-out area.

Furthermore, a plurality of third coupling-out areas can be provided in order to carry out a finer adaptation of the display device to the present nose-eye distance.

In the display device according to the invention, the imager can be tiltable about an axis to set the coupling direction. Furthermore, the imaging device can be displaceable along an axis for setting the coupling-in location. However, the coupled-in image always strikes the first coupling-in area, which carries out the desired coupling-in or redirection.

Furthermore, the display device can have a fixing unit which fixes the set tilt or rotational position and / or the set displacement and thus the set position of the imager. The fixing unit can be designed such that the fixing is effected by means of a form, friction and / or material connection. If desired, the fixing unit can also serve to fix the position of the detector, provided that its position can also be adjusted and is selected accordingly to match the selected position of the imager.

The display device according to the invention can have a second multifunction glass, which is fastened to the holding device, and a second image generator. The second multifunctional glass is preferably designed in the same or corresponding manner. In particular, it can be mirror-symmetrical to the first multifunctional glass. Images can thus be presented to both eyes of the user. This can be used, for example, for a three-dimensional image display. The second multifunction glass can, but need not, have a return channel.

Furthermore, the display device according to the invention preferably has an interface in order to connect a device to the display device. This is particularly a data interface. The device can be, for example, a computer, a smartphone, a navigation device, etc. In this case, a combined display device is provided, which comprises the display device according to the invention and the device connected to it.

It goes without saying that the features mentioned above and those yet to be explained below can be used not only in the specified combinations but also in other combinations or on their own without departing from the scope of the present invention.

• 1 eine perspektivische Ansicht einer ersten Ausführungsform der erfindungsgemäßen Anzeigevorrichtung;
• 2 eine vergrößerte Detailansicht der Anzeigevorrichtung von 1;
• 3 eine Draufsicht auf den Aufnahmesensor der Anzeigevorrichtung von 1;
• 4 eine Darstellung zur Erläuterung des mittels der Anzeigevorrichtung dargestellte Bildes;
• 5 eine weitere Draufsicht des Aufnahmesensors der Anzeigevorrichtung von 1;
• 6 ein Blockdiagramm zur Erläuterung des Aufbaus und der Funktionsweise der Anzeigevorrichtung von 1;
• 7 eine perspektivische Ansicht eines Teils der ersten Fresnel-Struktur des Multifunktionsglases der Anzeigevorrichtung von 1;
• 8 den Verlauf der optischen Wirkfläche, der mit der ersten Fresnel-Struktur gemäß 7 nachgebildet ist;
• 9 eine Draufsicht der ersten Fresnel-Struktur gemäß 7;
• 10 einen xz-Schnitt der Wirkfläche 108;
• 11 eine vergrößerte Darstellung des Details CC von 10;
• 12-15 verschiedene Profilformen der Fresnel-Struktur 12 der erfindungsgemäßen Anzeigevorrichtung;
• 16 eine Darstellung einer optischen Wirkfläche, die auf einer gekrümmten Grundfläche optisch gleichwirkend als Fresnel-Struktur umgesetzt wird;
• 17-18 Schnittansichten der ersten Fresnel-Struktur an der gekrümmten Vorderseite des Multifunktionsglases;
• 19 eine Schnittansicht einer kompletten Facette 105 der Fresnel-Struktur 12 des Multifunktionsglases 3 von 1;
• 20 eine Abwandlung der Facette 105 von 19;
• 21 eine weitere Abwandlung der Facette 105 von 19;
• 22 eine Schnittansicht einer weiteren Ausbildung der ersten Fresnel-Struktur;
• 23 eine Schnittansicht der Ausbildung der Fresnel-Struktur als nicht zusammenhängende Fresnel-Struktur;
• 24 eine Schnittansicht der zweiten Fresnel-Struktur 13;
• 25 eine schematische Draufsicht auf die zweite Fresnel-Struktur 13;
• 26 eine schematische Ansicht zur Erläuterung der Dokumentennavigation mit der erfindungsgemäßen Anzeigevorrichtung;
• 27 einen Signalfluß für die Dokumentennavigation;
• 28 einen weiteren Signalflußplan für die Dokumentennavigation;
• 29 eine schematische Darstellung eines Multifunktionsglases gemäß einer weiteren Ausführungsform, und
• 30 eine vergrößerte Detailansicht einer Abwandlung der Anzeigevorrichtung von 1.

The invention is explained in more detail below, for example with reference to the accompanying drawings, which also disclose features essential to the invention. Show it:

• 1 a perspective view of a first embodiment of the display device according to the invention;
• 2 an enlarged detail view of the display device of 1 ;
• 3 a plan view of the recording sensor of the display device of 1 ;
• 4 a representation for explaining the image displayed by means of the display device;
• 5 a further plan view of the recording sensor of the display device of 1 ;
• 6 a block diagram for explaining the structure and operation of the display device of 1 ;
• 7 a perspective view of part of the first Fresnel structure of the multifunction glass of the display device of FIG 1 ;
• 8th the course of the optical active surface, which corresponds to the first Fresnel structure 7 is simulated;
• 9 a plan view of the first Fresnel structure according to 7 ;
• 10 an xz section of the effective area 108 ;
• 11 an enlarged view of the detail CC of 10 ;
• 12-15 different profile shapes of the Fresnel structure 12 the display device according to the invention;
• 16 a representation of an optical active surface, which is implemented on a curved base surface optically equivalent effect as a Fresnel structure;
• 17-18 Sectional views of the first Fresnel structure on the curved front of the multifunction glass;
• 19 a sectional view of a complete facet 105 the Fresnel structure 12 of the multifunctional glass 3 of 1 ;
• 20 a variation of the facet 105 of 19 ;
• 21 another variation of the facet 105 of 19 ;
• 22 a sectional view of a further embodiment of the first Fresnel structure;
• 23 a sectional view of the formation of the Fresnel structure as a non-contiguous Fresnel structure;
• 24 a sectional view of the second Fresnel structure 13 ;
• 25 is a schematic plan view of the second Fresnel structure 13 ;
• 26 is a schematic view for explaining document navigation with the display device according to the invention;
• 27 a signal flow for document navigation;
• 28 another signal flow plan for document navigation;
• 29 a schematic representation of a multifunctional glass according to a further embodiment, and
• 30 an enlarged detail view of a modification of the display device of 1 ,

At the in 1 Embodiment shown includes the display device according to the invention 1 a holding device which can be placed on the head of a user 2 who z. B. can be designed in the manner of conventional glasses, and a first and second multifunctional glasses 3 . 4 that on the holding device 2 are attached. The outer shape of the multifunction glasses 3 . 4 can correspond to the usual glasses.

As best seen from the enlarged detailed view in 2 can be seen, includes the display device 1 also an imager 5 , a recording sensor 8th , which can be designed, for example, as a CCD or CMOS sensor, and a control unit 9 , The Elements 5 . 8th and 9 are in 1 only schematically as a block with the reference number 10 located.

How again 2 can be seen, the multifunction glass 3 on its front 11 a first Fresnel structure 12 and laterally spaced from it a second Fresnel structure 13 on. The two Fresnel structures 12 and 13 are used to couple in and out of the imager 5 coming light.

The imager 5 is in operation of the display device 1 from the control unit 9 driven to generate a desired image. The light from the imager 5 occurs over the back 14 of the multifunctional glass 3 into this and is by means of the first Fresnel structure 12 so deflected that it is in the multifunction glass 3 due to total internal reflection on the front and back 11 . 14 to the second Fresnel structure 13 running. The second Fresnel structure 13 directs the light in the direction of the user's eye A, so that this is done by the imager 5 generated image in a front of the multifunction glass 3 lying display area 40 as a virtual image 15 as schematically in 2 is shown, can perceive.

Thus, the multifunctional glass 3 as a forward channel 16 used for the display of a virtual image for the user, the first Fresnel structure 12 can be referred to as the first coupling-in area since it is the light of the imaging device 5 so deflected that it is in the multifunction glass 3 by means of total internal reflection on the front and back 11 . 14 to the second Fresnel structure 13 to be led. The second Fresnel structure 13 can be referred to as the first decoupling area because it deflects the light so that it strikes the eye A of the user.

Furthermore, the multifunction glass 3 a return channel 17 on. The back channel 17 comprises a third Fresnel structure 41 that at the back 14 of the multifunctional glass 3 is formed, and a fourth Fresnel structure 42 that at the front 11 of the multifunctional glass 3 is trained. The back channel 17 serves to at least part of the display area 40 on the recording sensor 8th map. To do this, the display area 40 coming light coming across the front 11 into the multifunction glass 3 enters and onto the third Fresnel structure 41 hits, so redirected that it is by means of total internal reflection on the front and back 11 . 14 up to the fourth Fresnel structure 42 is performed on a deflection towards the recording sensor 8th takes place so that the light through the back 14 of the multifunctional glass 3 exits and onto the recording sensor 8th meets.

In the exit area on the back 14 is a filter layer 6 arranged, which is designed here as a red filter or infrared filter. By mapping at least part of the display area 40 can also be one in the viewport 40 positioned hand 7 of the user, the filter being used to hold the hand 7 spectrally separated from the recorded image background. As will be described in more detail below, the hand can be used as a pointing element for an input interface provided by the display device.

Due to the described mode of operation of the third and fourth Fresnel structures 41 . 42 can the third Fresnel structure 41 as the second coupling area and the fourth Fresnel structure 42 are referred to as the second decoupling area.

The recording sensor 8th can, as in the schematic top view in 3 is shown, for example four recording cells in the row direction 18 and five recording cells in the column direction 18 have to the position of the schematically drawn hand 7 to detect.

Because both the recording sensor 8th as well as the imager 5 with the control unit 9 are connected, the detected hand position can be used for the image generation by means of the image generator 5 depending on the detected hand positions 7 is controlled.

This can be used, for example, for a user to select one of several menu items only with his hand. This can be done using the imaging device 5 shown image 15 several menu items 21 . 22 . 23 included, as schematically in 4 is shown. In the area 24 for example, a text can be displayed. The information text can then be, for example: "Please choose:".

How 4 can also be seen, the user is shown the image 15 presented in superposition with the environment U.

With the individual in the picture 15 Menu items shown can be various functions that the display device 1 and / or a device connected to it 25 , this in 1 is shown schematically. So the menu item 21 stand for a navigation function. The menu item 22 can stand for a biofeedback function and the menu item 23 can stand for an organizer.

The user positions his hand 7 so in front of the multifunction glass 3 that when looking at the picture it is practically one of the menu items 21 to 23 he wants to choose, with his hand or e.g. B. touched his index finger. Due to the image of the hand on the exposure sensor 8th can the control unit 9 determine which of the menu items 21 to 23 the user "touches", In 5 is that of the control unit 9 overlay of the displayed image to be carried out with the recorded hand 7 represented graphically. From this representation it can be seen that the user selects the menu item 22 tapped so that it is selected.

In 6 is a block diagram for explaining the structure and operation of the display device according to the invention 1 and the device connected to it 25 is shown schematically. Block B essentially describes the structure of the display device 1 , Block C shows the image processing for determining the pupil position and block D describes the device 25 that with the display device 1 connected is.

When represented in 6 a flow of information between the individual elements and blocks is shown by dashed arrows and actually connections (such as interfaces) by arrows with a solid line.

As shown in 6 can be removed, the imager creates 5 under control of the control unit 9 the desired image using the multifunction glass 3 is presented to the user. On the other hand, the multifunction glass serves 3 to the hand 7 on the recording sensor 8th map (in the schematic representation according to 6 optical imaging always ends and begins on the multifunction glass 3 ).

As shown in block C, the image of the pupil is on the exposure sensor 9 first a preprocessing (step C1 ) and then the position of the hand 7 or z. B. the index finger (step C2 ) determined. In step C3 a correlation or overlay is then carried out with the menu items shown, so that the selected menu item can be determined. This will go to the other device 25 , which can be a smartphone, for example. The steps C1 - C3 are preferred by the control unit 9 performed through a device interface D1 with the device 25 connected is.

The selected menu item becomes the device 25 communicated (step D2 ) that this information for the further flow of the device 25 provided functionality uses what in step D3 and the image to be displayed is changed (for example, submenu items for the selected menu item are displayed).

The display device according to the invention 1 thus provides an input interface for a pointer, such as. B. a hand, a finger, a pen, etc., ready. The display device according to the invention 1 can therefore be designed as information glasses with such an input interface, which is particularly ergonomic.

Due to the input interface provided, a menu selection in the virtual image can be done by hand 7 respectively. So z. B. the currently necessary operation directly on the device 25 eliminated. With the device 25 can in particular be a smartphone, a navigation device and / or a biocomputer.

Since in the display device according to the invention 1 both the forward channel 16 as well as the return channel 17 in the multifunctional glass 3 can run, the display device 1 be extremely compact. The entire imaging range from the imager 5 to the eye pupil is designed so that the image field (imager 5 ) is mapped into the eye pupil (pupil plane) and transformed. The imaging path for imaging the hand on the image sensor 8th is preferably designed so that it has a short focal length to keep the hand sharp and the background out of focus on the recording sensor 8th map.

Because the filter 6 on the back side 14 of the multifunctional glass 3 is arranged in such a way that the light passes through the filter when imaging the hand, thereby making a spectral distinction by hand 7 or fingers and background possible. Of course, the filter 6 not on the back 14 be arranged. It can also be arranged at any other point on the return channel, for example directly on the recording sensor 8th , It is also possible to use the filter 6 to do without and carry out the evaluation purely via a pattern recognition. In particular, the filter 6 not necessary if as pointer or pointing element 7 not the hand or the finger of the hand is used, but for example a pen that the user holds in his hand.

In addition to the menu items described 21 to 23 The user can also be presented with other selectable input areas. So z. B. a virtual keyboard can be displayed so that the user can enter letters and digits a destination address if the connected device is a navigation device or provides a navigation functionality. Of course, text and number input can also be used for other purposes. For example, a short message can be entered that can be sent via a mobile phone.

The recording sensor 8th points in the described embodiment 20 receiving cells 18 on. However, it can also contain more or fewer absorption cells. For example, it can be designed as a multi-quadrant sensor with 4 x 4 acquisition cells similar to the computer mouse sensors or it can be a low-resolution CCD or CMOS sensor.

The following is an example of the formation of the first Fresnel structure 12 described. The fourth Fresnel structure 42 can be designed in the same way, but only the first Fresnel structure is referred to below. In 7 is an enlarged view of the front 11 in the area of the first Fresnel structure 12 shown. The first Fresnel structure 12 points to the front 11 several Fresnel segments 104 on.

Every Fresnel segment 104 has an optically effective facet 105 that are mirrored here. To the in 7 Achieving the step shape shown generally includes each Fresnel segment 105 another flank 106 ,

The common optical effect of the facets 105 corresponds to an imaginary optical surface 108 as in 8th is shown, the optical active surface 108 is curved here. Furthermore, it may, but need not, have no mirror or rotational symmetry. As from comparing the 7 and 8th is easy to see, the representation in 8th by 90 ° around the z-axis compared to the representation in 7 turned. The imaginary active surface 108 can be as the first Fresnel structure as follows 12 according to 7 be implemented.

The effective area 108 is divided into sections of equal height Δh in the z direction. This creates cutting lines 109 , which can also be called contour lines and each have a surface section 110 the effective area 108 limit. The surface sections 110 are all shifted towards each other in the z direction so that the lower cutting line (the one with the lower z value) and thus the lower edge of the facet 105 lie at the same height (in the z direction). From the respective top cut line of the surface sections 110 and thus the top of the facet 105 then becomes the vertical flank 106 to the lower intersection of the directly adjacent surface section 110 led to the graded formation of the Fresnel structure 12 according to 7 to get. The top view in 9 the first Fresnel structure 12 of 7 you can see the top edges.

The steps to be taken to get from the imaginary optical surface 108 , which is curved and has no mirror or rotational symmetry, for example, to the desired first Fresnel structure 12 to get there are below in connection with 10 explained in detail in the xz section of the effective area 108 is shown, which is different from the active surface 108 of 8th , but is curved and has no mirror or rotational symmetry. The division into surface sections 110 (in the sectional view of 10 are these surface sections of course line sections) of the same height is indicated by the dashed cut lines in 10 shown.

In the enlarged view of the detail CC in 11 it can be seen that the surface section shown 110 is clearly defined on the basis of the predetermined distance Δh and then lowered to the height z ₀ , as indicated by the arrow P101 is shown schematically. Furthermore, is still on the left side of the surface element 110 the flank 106 added, which extends perpendicular to the height z ₀ . There is therefore a flat base at height z ₀ 111 on which the first Fresnel structure 12 is trained. The footprint 111 however, it can also be curved.

For the first Fresnel structure 12 the following formula 1 can thus be set up, where z _{F is} the Fresnel structure 12 , z _{base area} the surface shape of the base area 111 (here one level) on which the Fresnel structure 12 is applied, and z _facet the Fresnel facets 105 relative to the base area describes: $$z_F=Z_{GrundflacHe}+z_{Facette}$$

wobei die Wirkfläche 108 durch die nachfolgende Flächenformel z_Wirkfläche beschrieben ist $$z_{Wirkfläche}\left(x,y\right)=K1+K2+b_{10}x+b_{01}y+b_{11}xy+b_{21}{x}^{2}y+b_{12}x{y}^2+{\displaystyle \sum _{\begin{array}{l}i=2\\ j=2\end{array}}^{\begin{array}{l}N\\ M\end{array}}{b}_{ij}x\text{'}y\text{'}}$$

bei der K1 den konischen Term in x-Richtung und K2 den konischen Term in y-Richtung, wie nachfolgend angegeben ist, bezeichnen $$K1=\frac{C_x{x}^2}{1+\sqrt{1-\left(1+k_x\right)c^2{x}^2}}$$

$$K2=\frac{C_y{y}^2}{1+\sqrt{1-\left(1+k_y\right)c^2{y}^2}}$$

The area z _{facet of} the facets, which can also be called a "frayed" free-form surface, is calculated according to the following formula 2 $$z_{Facette}=\text{modulo}\left({\text{z}}_{\text{effective area}}.\Delta H\right)$$

being the effective area 108 is described by the following area formula z _{active area} $$z_{WirkfläcHe}\left(x.y\right)=\mathrm{<figure-callout\; id="1"\; label="K"\; filenames="DE102010041348B4\_0025.png,DE102010041348B4\_0026.png"\; state="\{\{state\}\}">K</figure-callout>}1+\mathrm{<figure-callout\; id="2"\; label="K"\; filenames="DE102010041348B4\_0016.png"\; state="\{\{state\}\}">K</figure-callout>}2+b_{10}x+b_{01}y+b_{11}xy+b_{21}{x}^{2}y+b_{12}\mathrm{<figure-callout\; id="2"\; label="x\; y"\; filenames="DE102010041348B4\_0016.png"\; state="\{\{state\}\}">x\; </figure-callout>}{y}^{}{}^2+{\displaystyle \underset{\begin{array}{l}i=2\\ j=2\end{array}}{\overset{\begin{array}{l}N\\ M\end{array}}{\Sigma }}{b}_{ij}x\text{'}y\text{'}}$$

where K1 denotes the conical term in the x direction and K2 the conical term in the y direction, as indicated below $$\mathrm{<figure-callout\; id="1"\; label="K"\; filenames="DE102010041348B4\_0025.png,DE102010041348B4\_0026.png"\; state="\{\{state\}\}">K</figure-callout>}1=\frac{C_x{x}^2}{1+\sqrt{1-\left(1+k_x\right)c^2{x}^2}}$$

$$\mathrm{<figure-callout\; id="2"\; label="K"\; filenames="DE102010041348B4\_0016.png"\; state="\{\{state\}\}">K</figure-callout>}2=\frac{C_y{y}^2}{1+\sqrt{1-\left(1+k_y\right)c^2{\mathrm{<figure-callout\; id="2"\; label="y"\; filenames="DE102010041348B4\_0016.png"\; state="\{\{state\}\}">y</figure-callout>}}^2}}$$

wobei die Gaußklammer $\lfloor \frac{a}{m}\rfloor$

die größte ganze Zahl bezeichnet, die kleiner oder gleich der Zahl in der Gaußklammer ist, also das Ergebnis der Division a/m ohne den Rest der Division.By applying the modulo function to the active surface 108 becomes the effective area 108 divided in the z direction at intervals of the same height Δh. Thus, the maximum height of the facets 105 each Δh. The modulo function used is shown below $$\text{modulo}\left(a.m\right)=a-\lfloor \frac{a}{m}\rfloor \cdot m$$

being the Gaussian bracket $\lfloor \frac{a}{m}\rfloor$

denotes the largest integer that is less than or equal to the number in the Gauss bracket, i.e. the result of the division a / m without the rest of the division.

This results in the following formula for the faceted surfaces $$z_{Facette}=\text{modulo}\left({\text{z}}_{\text{Wurkfläche}}.H\right)={\text{z}}_{\text{Wurkfläche}}-\lfloor \frac{{\text{z}}_{\text{Wurkfläche}}}{\Delta H}\rfloor \cdot \Delta H$$

According to the procedure described above, based on a desired optical effective area 108 , the corresponding Fresnel structure 12 can be derived, which provides the corresponding optical effect. Due to the step shape, you can use the Fresnel structure 12 not the same optical effect that an interface would have, that according to the free-form surface 108 is formed, but a comparable optical effect is achieved.

As shown in 10 and 11 the facets show 105 through the freeform surface 108 given curvatures in the height range Δh. To manufacture the Fresnel structure 12 To simplify, it is possible to change the course of the individual facets 105 to approximate the corresponding surface shape of the free-form surfaces. In the simplest case, the course can be linearized, as in the sectional view of 12 is shown schematically. However, it is also possible to use a convex curvature ( 13 ) or a concave curvature ( 14 ) to provide. An approximation by a different curvature curve is also possible, as shown for example in 15 is indicated.

In 16 An example is shown in which the Fresnel structure 12 optical effective area to be adjusted 108 opposite the spherically curved front 11 is heavily tilted. In this case too, there is no problem with the effective area 108 as a Fresnel structure 12 on the front side 11 train without the macroscopic shape of the front 11 must be changed. As in all other embodiments, the height Δh can be in the range from 5 to 500 μm, in particular in the range from 0.01 to 0.1 mm and particularly preferably in the range from 0.05 to 0.3 mm. Furthermore, the height Δh does not have to be constant, but can vary here as in all other embodiments. For example, Δh itself can increase or decrease with increasing z-value.

In 17 is a sectional view of the Fresnel structure 12 on the curved front 11 shown where the facets 105 are each linear. The individual flanks 106 are aligned parallel to each other, with the original course of the front 11 is still shown schematically. In this embodiment, the facet function z _{facet was} subtracted from the base area function z _{base area} so that the Fresnel structure 12 can be described as follows: $$z_F=z_{GrundfläcHe}-z_{Facette}$$

This type of calculation of z _F is of course also possible in all of the embodiments already described and in all of the subsequent embodiments.

In 18 is a modification of the profile of 17 shown that differs essentially in that the flanks 106 are no longer oriented parallel to each other on average, but radially to the center of the front, not shown 11 ,

In 19 is a sectional view of a complete facet 105 the Fresnel structure 12 shown. As can be seen from the illustration, the facet shows 105 a mirroring V, so that the desired beam deflection of the light rays of the imager 5 takes place.

In 20 A variation is shown in the free areas due to the inclination of the facet 105 relative to the front 11 of the multifunctional glass 3 is formed with material 134 to the front 11 is filled. The filling is preferably carried out so that a smooth, continuous front 11 is formed. As a material 134 can in particular be the same material as for the multifunction glass 3 be used yourself.

However, it is also possible to use the Fresnel structure 12 to be interpreted so that the deflection of the light beams of the imaging device 5 by total internal reflection, so that mirroring is no longer necessary, as in 21 is indicated.

In 22 is a sectional view of another possible embodiment of the Fresnel structure 12 shown. With this Fresnel structure 12 extend the flanks 106 not vertical (as in most of the previously described embodiments, i.e. here in the z direction), but are also somewhat inclined. This simplifies the manufacture of the Fresnel structure 12 , However, it is preferred if the angle of inclination of the flanks 106 is as small as possible so that they run almost vertically.

All Fresnel structures described so far 12 were coherent Fresnel structures. It is understood here that the individual Fresnel facets 105 always through the flanks 106 are interconnected. However, it is also possible to use the Fresnel facets 105 to be provided spaced apart and between the individual Fresnel facets 105 sections 123 insert the example sections 123 the front 11 could be. This can be achieved simply by replacing the determined Fresnel surface z _F areas or sections by the course of the base surface z _{base surface} in these sections. A profile of such a Fresnel structure 12 is in 23 indicated schematically.

If you look at the Fresnel facets 105 the second Fresnel structure can be mirrored in this way 13 are provided, as in the enlarged sectional view in 24 is shown. With the second Fresnel structure 13 can the imager 5 coming bundles of rays BS are superimposed with a second bundle of rays US to form a common bundle of rays GS. As shown in 24 are the Fresnel facets 105 compared to the normal the front 11 tilted so that the part of the first ray bundle BS (also referred to as image ray bundle BS) points to the respective Fresnel facet 105 hits, is deflected to the right as the image beam BS '. The rest of the image ray bundle BS, which is not on the Fresnel facets 105 hits, will be at the front 11 reflected and / or transmitted so that it does not become part of the common beam GS.

The part of the ambient ray bundle US (in 24 from left) on the back of the Fresnel facets 105 meets, is from the Fresnel facets 105 shadowed so that it does not become part of the common ray bundle GS. This part of the ambient ray bundle US is therefore shown hatched. The remaining part of the ambient ray bundle US passes through the transmissive areas as ambient partial rays US ' 123 between the Fresnel facets 105 therethrough.

The inconsistent Fresnel structure 13 according to 24 thus causes the transmissive areas to overlap 123 part US 'of the ambient ray bundle US that passes through it with the Fresnel facets 105 reflected part BS 'of the image beam BS to a common beam GS.

The second Fresnel structure can preferably be used 13 several spaced-apart Fresnel sections 140 have according to 24 or in the same way as the first Fresnel structure 12 are trained. The Fresnel sections 140 can, as in the schematic top view in 25 to the rectangular overlay area, for example 129 is shown to be distributed arbitrarily. The multifunction glass remains in the areas in between 3 obtained so that these areas represent normal light transmission areas.

A regular arrangement or structure of the Fresnel sections 140 to prevent this z. B. can be arranged as follows. Circular areas are defined, the diameter of which can be determined as follows $$D=\sqrt{\left(100-T\right)/100/\pi }\cdot 2\cdot APX/N$$

Where T is the required transmission for the ambient light in percent, N is the number of circles in the x direction and APX is the aperture width in the x direction. The circles are first arranged in a fixed grid with grid spacing APX / N in x and y equidistant. After that, the circle center positions are slightly modified by dicing the direction and length of the center shift. The length is chosen so that there is no overlap effect between adjacent circles.

The following formulas can be used as statistical functions for length and angle.

Statistical shift length: $$r=\left(APX/N/2-D/2\right)\cdot randf$$

Statistical shift direction: $$w=360\cdot randf$$

$$y=\left(j/N\right)\cdot APX+r\cdot \text{sin}\left(w\right)$$

$$M=round\left(APY/APX\right)$$

Wobei die Funktion round das Argument (APY/APX) auf ganze Zahlen rundet.Where randf returns a random value between 0 and 1. The modified position of the circles 140 then results from the following formulas: $$x=\left(i/N\right)\cdot APX+r\cdot \text{cos}\left(w\right)$$

$$y=\left(j/N\right)\cdot APX+r\cdot \text{sin}\left(w\right)$$

$$M=rOund\left(APY/APX\right)$$

The round function rounds the argument (APY / APX) to whole numbers.

Of course, any other type of distribution of the Fresnel sections can also be used 140 can be selected, preferably a non-regular arrangement is selected.

The third Fresnel structure 41 can be done in the same way as the first or second Fresnel structure 12 . 13 be formed.

Furthermore, the display device according to the invention can be a sensor module 26 have that schematically in 1 is shown. Here is the sensor module 26 arranged in the left temple.

The sensor module 26 is designed such that it detects a head rotation (rotation about the x-axis) and a head inclination (rotation about the y-axis) and corresponding detection signals to the control unit 9 emits. So-called MEMS sensors (MEMS = Micro-Electro-Mechanical System) and in particular inclination and acceleration sensors can be used to detect these movements.

The sensor module 26 can be used to image depending on the position of the hand 7 and to control the head rotation and / or head inclination. This can be used, for example, to implement intelligent document navigation become. For example, as in 26 is shown schematically, the document to be displayed 27 is larger than the image field 28 that the user can perceive, the following control can be implemented.

When the user has a predetermined input range by hand 7 selects what through the illustration of the hand 7 on the recording sensor 8th can be detected, the document navigation is activated. This means that then by means of rotations and inclinations with the head, that by means of the sensor module 26 be detected, the image field 28 about the document to be displayed 27 is moved as by the arrows 29 and 30 in 26 is indicated. For example, turning the head to the right can also cause the image field to shift to the right and to provide the user with an enlarged view of the content of the document to be displayed, as in 26 by the letter combinations shown and the arrows 29 and 30 is indicated. In the same way, a nod leads to a shift up or down relative to the document to be displayed, as by the arrows 30 is indicated.

A signal flow diagram of this embodiment is shown in FIG 27 shown. So contains the display device 1 a block 31 that for hand tracking 7 or is responsible for evaluating the hand position, and outputs a positive signal when the user selects in the predetermined input range. The block 31 represents the return channel 17 of the multifunctional glass 3 , the recording sensor 8th as well as the control unit 9 , which carries out the necessary evaluation and, if necessary, outputs the positive signal.

The display device also contains 1 the sensor module 26 , with which the rotation about the x-axis (angle γ and change in angle γ and thus Δγ) and the rotation around the y-axis (angle φ) and change in angle φ and thus Δφ) are measured and output. These signals Δγ and Δφ are via an OR gate 32 an AND gate 33 then fed (when pupil tracking 31 the predetermined direction of view is detected and the positive signal is output) a trigger signal (arrow 34 ) to a document control unit 35 of the device 25 invests. The document control unit 35 are also from the sensor module 26 the angles of rotation γ and φ about the x and y axes are also fed. The document control unit 35 generates the necessary shift of the image section to be displayed in the x and y directions and applies this to a graphical user interface module 36 on. The module 36 generates the corresponding data and sends it to the control unit 9 to the importer 5 controls so that the desired (shifted) image section 28 is presented to the user.

If there is no positive signal at the AND gate 33 is present, since the user does not select the predetermined input range, a head rotation and an inclination of the head naturally do not lead to a shift of the image section.

The selection and thus the consideration of the head movement in the image display can last as long as the user selects the input area. Or the user has to make a second selection so that the head movements are no longer taken into account.

If you add more functionality to the display device 1 want to integrate yourself, you can change the signal flow so that the document control 35 in the information glasses 1 is included, as shown in 28 can be seen. This allows the number of necessary transmission channels between the display device 1 and device 25 be reduced.

This embodiment is particularly suitable for people with a restricted image field. These persons can then view documents, images or other graphic representations section by section in the manner described, the persons themselves being able to carry out the movement of the section within the illustrated image in the manner described by means of the manual control and the head rotation and head inclination.

In particular, in this embodiment the second Fresnel structure 13 be positioned so that it is outside the normal viewing direction. Then the user must actively go to the second Fresnel structure 13 look to be able to use the intelligent document navigation.

In this way, information glasses can be provided that the user can use in everyday use. In particular, the information glasses can be conventional glasses for correcting ametropia, which additionally also have the described virtual information reflection (representation of the image 15 respectively. 28 ) enables.

In the exemplary embodiments described so far, only the first multifunctional glass was used 3 as well as the assigned optics and control described in detail. Of course, the second multifunctional glass 4 be designed in the same or similar manner. A three-dimensional display is also possible. It is also possible to use only one of the two glasses 3 . 4 to be trained as a multifunctional glass and not the other.

In 29 is a modification of the first multifunctional glass 3 shown, which differ from the previously described embodiments by the formation of the return channel 17 different. The back channel 17 not only has a second coupling area, but 3 second coupling areas 43 . 44 . 45 that together with the second decoupling area 42 each form an imaging optics, these imaging optics having different magnifications and different directions of exit of the light rays from the rear 14 towards the recording sensor 8th have. This means that three images are always carried out at the same time, of which the recording sensor always records only one.

The different images are selected by tilting the sensor around the x-axis. Of course, any other type of selective recording of the light rays of one of the three imaging optics is also possible. In particular, there is also a translational displacement of the recording sensor 8th possible in the y direction to achieve the desired magnification when taking the hand 7 to reach.

In 30 Fig. 4 is an enlarged detailed view of a modification of the display device 1 of 1 shown, wherein the same or similar elements are denoted by the same reference numerals and for the description of which reference is made to the above statements. In addition, the display device includes 1 of 30 two further second Fresnel structures 60 . 61 that laterally offset to the second Fresnel structure 13 are arranged. As in 30 are shown are the second Fresnel structure 60 to the right of the second Fresnel structure 13 and the second Fresnel structure 61 to the left of the second Fresnel structure 13 arranged. The other second Fresnel structures 60 . 61 are intended to adapt to the individual nose-eye distance of the user, taking it from the angle of incidence of the imager 5 on the first Fresnel structure 12 light depends on which of the three second Fresnel structures 13 . 60 and 61 the decoupling of light causes.

To adapt the display device 1 The user is thus given a suitable rotary position of the imaging device 5 selected so that the optimal lateral position (in the z direction) of the displayed virtual image is then for the present nose-eye distance 15 is present.

The position of the pickup sensor may also have to be turned 8th be adapted because the corresponding second Fresnel structure 13 . 60 . 61 as a second coupling area for the return channel 17 is being used.

The forward channel 16 can together with the first coupling area 12 and the decoupling areas 13 . 60 and 61 also be designed such that, depending on the coupling location (eg in the z direction) within the first coupling region 12 a decoupling from one of the decoupling areas 13 . 60 and 61 he follows. In this case, the imager 5 provided, for example, that it can be displaced in the z direction. The same applies if necessary for the exposure sensor 8th ,

Furthermore, a fixing unit can be provided which detects the set position (rotational position and / or lateral position) of the imager 5 and possibly the recording sensor 8th fixed.

The second Fresnel structures 60 and 61 can be the same or similar to the second Fresnel structure 13 be trained.

Claims (14)

Display device with a holding device (2) that can be placed on the head of a user, an image generator (5) attached to the holding device (2) for generating an image, a control unit (9) for controlling the image generator (5) and one on the holding device (2 ) attached multifunction glass (3, 4), which has a first coupling-in area (12) and a first coupling-out area (13), the generated image being coupled into the multifunctional glass (3) via the first coupling-in area (12) in the multifunctional glass (3) to is led to the first decoupling area (13) and is decoupled via the first decoupling area (13) such that the user, when the holding device (2) is placed on the head, has the decoupled image as a virtual image in a front of the multifunction glass (3, 4) Can display area (40), characterized in that the display device (1) has a detector (8) and the multifunctional glass (3) has a return channel (17) via which at least a part of the display area (40) is imaged on the detector (8) in order to detect the position of a pointing element when the holding device (2) is placed on the head, the detector (8) with the control unit (9) is connected, which controls the image generation as a function of the detected pointing element position. Display device after Claim 1 , characterized in that the first coupling-in area (12) and the first coupling-out area (13) are formed on the front (11) of the multifunctional glass (3) facing away from the user's eye when the holding device (2) is placed on the head. Display device after Claim 1 or 2 , characterized in that the return channel (17) has a second coupling-in area (41) and a second coupling-out area (42), the second coupling-out area (42) on the front facing away from the user's eye when the holding device is placed on the head (11) of the multifunctional glass (3) and the second coupling area (41) are formed on the rear side (14) of the multifunctional glass (3) facing the user's eye. Display device according to one of the above claims, characterized in that the control unit (9) is set up to display at least one input area (21, 22, 23) in the decoupled image and to detect the detected pointing element position as a selection of the input area (21, 22, 23) evaluate if the input area in the virtual image with the pointing element (7) is selected. Display device after Claim 4 , characterized in that the control unit (9) is set up to control the image generation of a changed image in response to the evaluated selection. Display device according to one of the above claims, characterized by a sensor module with which the rotation of the holding device (2) about at least one axis can be detected and which emits a corresponding sensor signal to the control unit (9), the control unit only taking the sensor signal into account for image generation when a predetermined pointing element position is detected at the same time. Display device after Claim 6 , characterized in that the control unit (9) is set up to display a section of a document with the generated image, the position of the section in the document being determined as a function of the sensor signal. Display device according to one of the above claims, characterized in that the first coupling-in area, the second coupling-in area, the first coupling-out area and / or the second coupling-out area are / are each designed as a Fresnel structure. Display device after Claim 8 , characterized in that the respective Fresnel structure has an imaging property and causes radiation folding. Display device according to one of the above claims, characterized in that the first coupling-out area is designed as a Fresnel structure, in particular as a non-contiguous Fresnel structure. Display device according to one of the above claims, characterized in that the return channel provides at least two different magnifications for imaging the part of the display area, one of the images being selectively detectable by means of the detector (8). Display device after Claim 11 , characterized in that the detector is selectively tiltable about an axis and / or displaceable along an axis. Display device after Claim 11 or 12 , characterized in that the return channel has a plurality of second coupling areas (43, 44, 45) which contribute to the different magnification in the images or which cause different magnifications. Display device according to one of the above claims, characterized by a red and / or infrared filter (6) which is arranged in front of the detector (8) in such a way that the light for imaging the at least part of the display area (40) through the filter (6) runs before it hits the detector (8).

Images