DE102016212801A1 - Data glasses for displaying information - Google Patents

Abstract

The invention relates to data glasses for wearing on a user's head, comprising: at least one display device for displaying electronically generated information on a transparent display surface in order to superimpose a perception of a real environment in the field of vision of the user with information to be displayed on the display surface; - At least one haptic signal generator, which is selectively activated to output a haptic signal.

Description

Technical area

The invention relates to data glasses with which an electronically generated information can be faded into the field of vision of a wearer of the data glasses.

Technical background

There are a variety of types of data glasses are known, with which users information can be displayed on a display area. The data glasses are worn like ordinary glasses on the user's head, so that the display surface is located immediately in front of an eye. By being able to provide a display area for each eye, the information presented may also contain a spatial component.

The information displayed to the user may be in the form of text, graphics, or combinations thereof. The display areas may be partially transparent, so that the user can continue to perceive the environment behind the displayed information. In particular, this makes it possible to display the information contact analog in the form of an "augmented reality", wherein the user of the data glasses, the information is displayed on the display surface, that their display position is always coupled to the location of an object in the area. The display position of the information to be displayed on the display surface therefore depends on the position in the field of vision of the user at whom the object is perceived. For example, the information can be displayed graphically adjacent to the object or superimposed on it.

To realize the contact analog display, the pose of the data glasses, i. both the position of the data glasses and the orientation (orientation) of the data glasses with respect to the object, and therefrom determines the perception position of the object of the real environment in the field of view and accordingly the display position, orientation and perspective of the information coupled thereto. To determine the pose, initial sensors for measuring acceleration and optionally an acceleration sensor, gyroscope or compass are usually integrated in the data glasses in order to be able to determine a relative orientation and a position of the data glasses.

From the publication WO 2013/012914 For example, data goggles comprising a camera for taking pictures in the direction of the user's eye are known, so that information to be displayed can be presented in contact-analogous manner with objects that can be perceived in the field of vision of the user.

From the publication DE 10 2014 206 626 A1 a method is known for detecting fatigue of a wearer of data glasses, in particular the driver of a vehicle, wherein the data glasses comprise motion sensors; wherein measurements of the motion sensors of the data glasses are made and a movement of the data glasses, which indicates the tiredness or the sleeping of the wearer of the data glasses, is detected by the measurements. In response to the detection, an indication is issued that the tiredness of the wearer of the data glasses has been detected. The hint can be a haptic hint issued by the data glasses.

However, information can only be displayed contact-analogically if the object to be identified is located wholly or partially in the field of vision of the user who wears the data glasses or in the field of vision that is predetermined by the data glasses. Objects outside the field of view are not perceived by the user and therefore can not naturally be marked with information via the display area in the data glasses. Thus, u.U. important information that should be displayed contact-analogous and thus close to be marked objects, the user is not displayed when he looks in a direction by which the object in question outside the field of view of the user or the data glasses. Important information that may possibly be used in the motor vehicle to avoid a collision may therefore not be perceived by users of the data glasses.

It is therefore an object of the present invention to provide an improved data glasses and a method for operating such data glasses, which intuitively informs a user of which pose he is to take in order to obtain an indication of contact-analog information on the display surface.

Disclosure of the invention

This object is achieved by the data glasses for displaying a contact-analog information according to claim 1 and a method for operating such data glasses and a system with a data glasses according to the independent claims.

• – mindestens eine Anzeigeeinrichtung zur Anzeige von elektronisch generierten Informationen auf einer transparenten Anzeigefläche, um eine Wahrnehmung einer Realumgebung im Sichtfeld des Benutzers mit einer anzuzeigenden Information auf der Anzeigefläche zu überlagern;
• – mindestens ein haptischer Signalgeber, wobei der haptische Signalgeber zur Ausgabe eines haptischen Signals selektiv aktivierbar ist.

Further embodiments are specified in the dependent claims. In one aspect, a smart phone is provided for wear on a user's head, comprising:

• - at least one display device for displaying electronically generated information on a transparent display surface in order to superimpose a perception of a real environment in the field of vision of the user with information to be displayed on the display surface;
• - At least one haptic signal generator, wherein the haptic signal generator for outputting a haptic signal is selectively activated.

Furthermore, a control unit may be provided which is configured to activate the at least one haptic signal generator selectively depending on a request for a viewing direction change, wherein the request for a viewing direction change indicates that the viewing direction of the user is to be changed.

In order to intuitively inform a user of the data glasses of an event in the real environment or contact-analog information to be displayed outside the face of the user wearing the data glasses, the above data glasses provide for arranging one or more haptic signal transmitters in the data glasses. The haptic signalers serve to direct the user's attention to move the head, to change the field of view in one direction, so that the user can perceive an object in the real environment or information analogous to contact.

Since a display of information on the display area is often in combination with other displayed information, the user needs a certain perception time to interpret the displayed information. The perception time may be too high for urgent or security-relevant information, so that it is provided in the above data glasses to provide one or more additional haptic signal generator in the data glasses. Depending on the situation, a haptic signal can be generated by the one or more haptic signal transmitters, which the user immediately perceives due to the sensitivity of the head for mechanical stimuli and to which the user can react intuitively. For example, issuing a haptic signal to the side of the data glasses may cause the user to move the head in the appropriate direction. The fact that the haptic signal is felt only for the wearer of the data glasses, this is perceptible only for this and thus does not lead to a disturbance of bystanders or passengers in a vehicle.

In particular, the control unit may be configured to selectively activate the at least one haptic signal generator in response to the gaze-change request so that the user is directed to change the pose of his head so that contact-analog information can be displayed on the at least one display area.

According to one embodiment, the control unit may be configured to set or activate a pattern of the haptic signal to be output and / or a strength of the haptic signal to be output by the at least one haptic signal generator depending on the direction and / or the height of the requested viewing direction change.

Furthermore, a plurality of haptic signal generator may be provided, wherein the control unit is adapted to selectively activate at least one of the plurality of haptic signal generator depending on the requested viewing direction change.

Furthermore, a plurality of haptic signal generator may be provided, which are arranged on the left side and the right side of the data glasses.

According to one embodiment, the at least one haptic signal transmitter may comprise a vibration generator.

In particular, a plurality of haptic signal transmitters can be provided, which are designed to output a haptic signal in different vibration patterns and / or in different vibration intensities.

According to a further aspect, there is provided a method of operating the above data glasses, wherein the at least one haptic buzzer is selectively activated in response to a request for a gaze change, the gaze change request indicating that the gaze direction of the user is to be changed.

Furthermore, the request for the viewing direction change can be generated as a function of a priority of information that is not displayed on the at least one display area in the current viewing direction of the user.

Brief description of the drawings

Embodiments are explained below with reference to the accompanying drawings. Show it:

1 a schematic representation of a data glasses with display surfaces and haptic signalers; and

2 a flow diagram illustrating a method for operating such a data glasses.

Description of embodiments

1 schematically shows a data glasses 1 with two lenses 2 in a frame 3 are enclosed in a conventional manner. The frame 3 is

with eyeglass temples 4 provided so that the data glasses can be worn on the head of a user in a conventional manner.

The lenses 2 are transparent, allowing the user the environment through the viewing panes 2 can perceive. The lenses 2 may be formed with lenses for optical correction of visual impairments.

The lenses 2 are still each with a transparent display area 5 provided by suitable means, such as one on the frame 3 arranged display device 6 , which may be in the form of a projection device or the like, an electronically generated image can be displayed. Due to the transparent design of the display surface 5 The electronically generated image can pass through the transparent display area 5 Superimposed perceptible real environment.

The data glasses 1 can be worn like a typical visual aid on the user's head, the data glasses 1 with the frame 3 rests on the nose of the user and the strap enclose the user's head. The viewing direction of the user in the straight-ahead direction then takes place through the viewing windows 2 essentially through the transparent display surfaces 5 ,

Furthermore, the data glasses can be a camera 7 include, in the direction of the user, the data glasses 1 carries, is aligned when the user looks forward.

The data glasses 1 can with a pose detection 12 be provided to detect a pose of the head. The pose detection 12 may for this purpose have suitable initial sensors, position sensors and / or the like, so that the spatial position of the head and its orientation, which then indicates a viewing direction of the user, can be determined. Others to the data glasses 1 External devices can be used to detect the pose of the head or the data glasses 1 be used.

It is a control unit 8th provided with the camera 7 , the pose recognition 12 and the display device 6 communicates. Furthermore, the control unit 8th with a communication device 9 communicate wirelessly or with corded or wireless data. The display device 6 , the camera 7 , the control unit 8th and the communication device 9 be via an electrical energy storage 10 supplied with electrical energy.

In the temples 4 or in the frame 3 can have one or more haptic signalers 11 be arranged. The haptic signalers 11 should serve to give the user in a clear and attention-steering manner, a certain line of sight, so that the user can change the pose of his head. Thus, a particular object of the real environment through the lens 2 or the transparent display area 5 be perceived by the user's field of view, or a contact-analog information presented to the user, which is displayed only in a particular line of sight, for example, when the contact-analog information points to an obscured example by a vehicle part object.

In the simplest, in 1 Case shown can left and right in the ironing 4 each a haptic signal generator 11 be provided so that when activating one of the haptic signal generator 11 The user is prompted to intuitively turn his head in the appropriate direction, ie to the left or to the right. The direction is given by the strap 4 in which the haptic signal generator 11 is activated. Likewise, alternatively or additionally, haptic signalers may be provided on the left and / or right nose pad surfaces 15l . 15r be arranged to request a corresponding intuitive head movement.

The haptic signalers 11 For example, they may be formed as a vibration generator.

The control unit 8th is designed to handle the haptic signal 11 to trigger accordingly, if it is recognized that on a particular object of the real environment, not through the lens 2 or the transparent display area 5 is perceptible, should be pointed out.

Using the control unit 8th can the haptic signalers 11 also for outputting a vibration pattern, ie a modulation of a higher-frequency vibration frequency with a low-frequency modulation pattern, are driven so that the user perceives the corresponding haptic signal faster and so can respond intuitively by changing the pose of the head.

The control unit 8th can be formed, a method as shown in the flow chart of 2 shown to execute.

In step S1, one or more information to be displayed in contact-analogy is first of all provided in a particular line of sight of the user, ie pose of the head, on the display surface 5 with respect to an object of the real environment. This information can be transmitted via the communication device 9 be received externally or in the control unit 8th generated or stored in a memory provided therein.

In step S2 is now using the pose detection 12 a pose of the head detected.

In step S3, from among the one or more pieces of information to be displayed, those for display are selected and displayed on the display surface 5 can be displayed at the current pose of the head without having to change the viewing direction by the user.

The information to be displayed is assigned priorities, with a high priority indicating that the user should be brought to the information with increased urgency for the perception. In step S4, it is checked whether one of the information to be displayed lies outside the field of view of the user and thus in the current viewing direction of the user, ie the pose of the head, not on the display surface 5 is displayed and this information has a priority that is higher than any of the priorities currently on the display area 5 displayed information. If this is the case (alternative: yes), then in step S5 a corresponding signaling by the haptic signal transmitter or take place, so that the user can be made aware of the corresponding information to be displayed outside of his field of view. Otherwise (alternative: no), jump back to step S1.

About the pose detection 12 can the control unit 8th determine whether the user has changed his direction of view towards the information to be displayed with increased priority as a result of the signaling of step S5. If this is not the case, the pattern of the output of the haptic signal by the haptic signal generator (s) can be successively produced in one or more steps 11 to be changed.

If a distance to an object in the real environment is to be indicated by the information to be displayed, this can be achieved by a vibration sequence, such as an intermittent vibration signal of the haptic signal generator 11 be made. The haptic pulses, for example, as a simple intermittent vibration signal through those haptic signal generator 11 are executed, which are to intuitively indicate to the user the line of sight to be taken.

The haptic signalers 11 For example, for a general warning can be controlled synchronously or asynchronously, in particular, the asynchronous control can point to a particularly high or particularly low urgency of the desired direction of sight change.

Furthermore, the haptic signal generator 11 be designed to output haptic signals in different patterns and / or strengths. Thus, the control unit 8th adjust an adjustable frequency vibration signal, adaptive modulation (intermittent, swelling / decaying) of the vibration signal, and / or adjust the intensity of the haptic pulse in accordance with the prioritization or urgency of the information to be displayed in contact.

For example, if there is a risk of collision with an object in the real environment, for example, it could be in the appropriate direction around the display area (s) 5 arranged haptic signalers 11 which are coded with a high vibration frequency, eg from 5 to 10 Hz, with a pulse pattern (intermittent signal) with a modulation frequency of 1-2 Hz. A merely informative indication by information to be displayed could correspondingly be coded in a slightly lower vibration frequency, such as between 1 and 5 Hz, with a pulse pattern with a low modulation frequency of 0.5-1 Hz.

Through the pose detection 12 can be recognized that the viewing direction change has been made by the user, and the haptic signal for intuitive steering of the viewing direction are turned off. The timing of the shutdown may be dependent on the size of the object in the real environment. If the object in the real environment is completely perceptible in the field of vision of the user, such as a sign, a previously activated haptic signal can be switched off, for example, if the object has come to a certain predetermined proportion, such as 50% in the field of view , If the object in the real environment is too close and / or too large to be fully perceived in the user's field of vision, as may be the case, for example, in a nearby building, a threshold, such as 20%, may be used to cover the area Field of view are defined with the entire visible surface of the object in the real environment, in which a shutdown of the previously activated haptic signal for the desired viewing direction change takes place.

In addition to the haptic signals, a visual indication in the display area (s) 5 the data glasses 1 respectively. This can be done, for example, in the form of an arrow or text, so that the user already intuitively during the introduced head movement for viewing direction change can capture the information displayed and thus can adjust to the expected situation faster.

LIST OF REFERENCE NUMBERS

1

data glasses

2

Window

3

frame

4

hanger

5

display area

6

display

7

camera

8th

control unit

9

communicator

10

electrical energy storage

11

haptic signaler

12

Posen recognition

15l, 15r

Nose-engaging surfaces

QUOTES INCLUDE IN THE DESCRIPTION

This list of the documents listed by the applicant has been generated automatically and is included solely for the better information of the reader. The list is not part of the German patent or utility model application. The DPMA assumes no liability for any errors or omissions.

Cited patent literature

• WO 2013/012914 [0005]
• DE 102014206626 A1 [0006]

Claims (11)

Data glasses ( 1 ) for wearing on a user's head, comprising: - at least one display device ( 6 ) for displaying electronically generated information on a transparent display area ( 5 ) in order to obtain a perception of a real environment in the field of vision of the user with information to be displayed on the display surface ( 5 ) to superimpose; At least one haptic signal transmitter ( 11 ), which is selectively activatable to output a haptic signal. Data glasses ( 1 ) according to claim 1 with a control unit ( 8th ) which is adapted to the at least one haptic signal transmitter ( 11 ) to activate selectively depending on a request for a gaze change, wherein the one of a gaze change request indicates that the gaze direction of the user is to be changed. Data glasses ( 1 ) according to claim 2, wherein the control unit ( 8th ) is formed to the at least one haptic signal transmitter ( 11 ) to selectively activate in response to the request for viewing direction change, so that the user is directed to change the pose of his head so that contact-analogue information is displayed on the at least one display area (FIG. 5 ) can be displayed. Data glasses ( 1 ) according to claim 2 or 3, wherein the control unit ( 8th ) is adapted to form a pattern of the haptic signal to be output and / or a strength of the haptic signal to be output by the at least one haptic signal generator ( 11 ) depending on the direction and / or height of the requested gaze change. Data glasses ( 1 ) according to one of claims 2 to 4, wherein a plurality of haptic signal transmitters ( 11 ) are provided, wherein the control unit ( 8th ) is adapted to at least one of the plurality of haptic signal transmitter ( 11 ) to selectively activate depending on the requested viewing direction change. Data glasses ( 1 ) according to one of claims 2 to 5, wherein the control unit ( 8th ) is configured to generate the request for the viewing direction change depending on a priority of an information which, in the current viewing direction of the user, is not displayed on the at least one display surface ( 5 ) is shown. Data glasses ( 1 ) according to one of claims 1 to 6, wherein a plurality of haptic signal transmitters ( 11 ) are provided, the left side and right side of the data glasses ( 1 ), in particular in or on their ironing ( 4 ) or at their nose pads ( 15l . 15r ) are arranged. Data glasses ( 1 ) according to one of claims 1 to 7, wherein the at least one haptic signal generator ( 11 ) comprises a vibration generator. Data glasses ( 1 ) according to one of claims 1 to 8, wherein a plurality of haptic signal transmitters ( 11 ) are provided, which are designed to output a haptic signal in different vibration patterns and / or in different vibration intensities. Method for operating data glasses ( 1 ) according to one of claims 1 to 9, wherein the at least one haptic signal generator ( 11 ) is selectively activated depending on a request for a change of sight, wherein the request for a change of sight indicates that the view direction of the user is to be changed. Method according to claim 10, wherein the request for the change of sight is generated as a function of a priority of an information which, in the current viewing direction of the user, is not displayed on the at least one display surface ( 5 ) is shown.

Images