CN110740896B

CN110740896B - User interface for a vehicle and vehicle having a user interface

Info

Publication number: CN110740896B
Application number: CN201880039361.3A
Authority: CN
Inventors: M·霍夫曼; M·萨卡
Original assignee: Bayerische Motoren Werke AG
Current assignee: Bayerische Motoren Werke AG
Priority date: 2017-07-04
Filing date: 2018-06-28
Publication date: 2023-11-07
Anticipated expiration: 2038-06-28
Also published as: WO2019007811A1; DE102017211378A1; CN110740896A

Abstract

The invention relates to a user interface (1) for a vehicle (10), comprising: -a display device (13) having a first display means (2) and a hologram means (7) for freely generating a display (3), hereinafter referred to as "hologram (3)", in space, -an evaluation unit (6) and-a data input, the evaluation unit (6) being configured for recognizing a predefined input and/or an approach of a user (4) and/or a system output and/or a traffic situation and/or a driving situation and/or a vehicle running state by means of the data input and the hologram means (7) being configured for generating or disabling the hologram (3) in response thereto.

Description

User interface for a vehicle and vehicle having a user interface

Technical Field

The present invention relates to a user interface for a vehicle and a vehicle having such a user interface.

Background

Currently, driver interaction with automobiles is becoming increasingly of competing importance in the perception of driving tasks by driver assistance systems. The main solution involves displaying virtual buttons and other elements that are displayed "floating in space" to the driver. In this way the user can maintain a natural body posture during operation and can be aesthetically and crashproof mounted in a safe location for the hardware required to display the user interface.

WO 2014/181084 A1 discloses an apparatus for generating a sound field by ultrasound. The ultrasonic signal is modulated in terms of its amplitude at a frequency between 200Hz and 300Hz to produce perceptible feedback to the user.

US 2015/0192995 A1 discloses a user interface in which an array of ultrasonic transducers is arranged behind a screen on which a projector projects the user interface. The detection unit is configured to determine a position of the hand relative to the system.

US 2015/0279283 A1 discloses an apparatus for generating a aerial image generated by mapping a screen onto a grid structure having dihedral corner elements.

Disclosure of Invention

Based on the above prior art, the task of the present invention is to provide a user interface which ensures a more comfortable and safe use of the vehicle. Another task of the present invention is to provide a vehicle with a more comfortable and safer user interface.

The object is achieved by a user interface for a vehicle according to the invention. The user interface comprises a display device having first display means and holographic means for freely generating a display, hereinafter referred to as "hologram", in space. The user interface further comprises an evaluation unit and a data input, the evaluation unit being configured for identifying predefined inputs and/or the approach of the user and/or system outputs and/or traffic conditions and/or driving conditions and/or vehicle operating states by means of the data input. Furthermore, the holographic device is configured for generating or disabling a hologram in response thereto, the hologram representing screen content of the first display device.

The term "vehicle" herein includes any vehicle (e.g., car, truck, or truck, airplane and/or ship) suitable for having a user interface according to the present invention. The display device here comprises a first display means. The first display device may conveniently visualize various information for a user, such as a driver of a vehicle. The first display device may be implemented by any known technical means suitable for the purpose in a vehicle. In particular, the first display device may be a CID (central information display), a Head Up Display (HUD) or a combination (instrument). The first display device can thus be integrated particularly simply into the structure of the vehicle.

Furthermore, the display device according to the invention comprises holographic means, which are for example configured for generating holograms for representing the screen content of the first display element. Any known holographic device suitable for a vehicle is contemplated herein. The screen content of the first display element can thus be visualized simply. Preferably, the hologram can be used here, for example, as an interaction unit for user input.

Furthermore, the display device according to the invention comprises an evaluation unit (e.g. an electronic controller, a programmable processor, a microprocessor, etc.) which is connected to the data input, any known evaluation unit suitable for a user interface being contemplated. The data reception via the input data according to the invention may be caused by a triggering event, for example by detecting a hand movement of the user and by detection thereof by a suitable camera, or other suitable triggering event. The evaluation unit is configured to recognize predefined inputs, such as a button pressed by a user and/or a proximity of a user, such as a user's hand, and/or a system output by means of the data inputs. As system output, for example, messages sent by the vehicle to the user, indications of receipt of messages, notable traffic conditions, warning indications, etc. can be considered. The holographic device is configured for generating or deactivating a hologram by the evaluation unit in response to the data input. This allows the user to more easily manipulate the user interface and provides new degrees of freedom in design and interior chamber design. The user interface may be connected to a car battery or to a power supply in the vehicle provided specifically for this purpose.

Further, for example, when a traffic situation such as traffic jam or rush hour traffic is recognized by an external sensor of the vehicle, the user should not be distracted but focused on the traffic. The evaluation unit is thus configured to deactivate the hologram by the holographic device or to deactivate the hologram for other different messages/signals in this case. The technical principle can also be used in other conceivable traffic situations where the user should not be distracted. Furthermore, the evaluation unit is designed to recognize the driving situation by means of the data input and to correspondingly not generate or deactivate holograms by means of the holographic device, for example, in order not to distract the driver at high speeds. The principle is equally applicable to other driving situations. Furthermore, the evaluation unit is configured to recognize a respective vehicle operating state by means of the data input and to generate or deactivate a respective hologram by means of the holographic device. For example, a concise warning indication, such as "engine temperature up", may appear within the hologram that draws the user's attention, and the user may learn information by replying to the confirmation button on the hologram. The security is thus improved by the user interface according to the invention.

Thus, according to the present invention, a user interface can be provided which is more convenient for a user to operate and which improves security for the user. Furthermore, the user interface according to the invention can be integrated simply into a vehicle.

In an advantageous further development of the user interface according to the invention, the system output represents an incoming call and the hologram represents an incoming call answer button and/or represents a take over request, for example when the autopilot function of the vehicle is deactivated or an assistance is required by the user, wherein the hologram represents a visual display of the take over request and/or represents a received wireless reception message and the hologram represents a visual display of the wireless reception message and/or represents a response to a free space gesture, such as a parking assistance, wherein the hologram represents an operational selection menu for responding to the free space gesture and/or represents a warning indication, such as a thin ice layer hazard and the hologram represents a visual display of the warning indication. The display and input possibilities of holograms can be realized by conventional technical means. The interaction between the driver and the first display device is thereby made more comfortable, in particular in driving operation. The screen content of the display of the first display device by means of holograms may comprise, for example, icons and/or text and/or animations and/or numbers. In a particular embodiment, the system outputs a query representing a free space gesture for temperature control, the holographic illustration having, for example, a "yes" or "no" button. This improves the possibility of a dialogue with the vehicle and increases the control of the automatic operation of the vehicle.

According to a further advantageous embodiment of the invention, the approach of the user comprises a predefined approach and/or input and/or voice command and/or gaze input to a region predefined for the hologram in the vehicle cabin. This can be achieved, for example, by means of a conventional motion detector with respect to the proximity of the user. Whereby the user can communicate with the hologram in a contactless manner. The inputs may include various input possibilities in the vehicle. For example, the user may send a signal via a button on the steering wheel, which causes the holographic device to generate a hologram. Furthermore, the process may also be performed by means of voice input or gaze input. In summary, the user can effectively activate the user interface and focus entirely on the road without distraction.

Another advantageous embodiment of the user interface of the invention has an input device which is configured for detecting a contactless interaction of the user with the hologram in a predefined spatial interaction region. As the input device, for example, a high-speed camera can be considered. The input device may be an IR camera, a stereo camera or an IR-LED strip or an optical camera. In a preferred embodiment of this extension, the high-speed camera is a high-speed stereo camera system comprising a 3D camera system with a minimum frequency of 100Hz and configured for tracking the 3D position of the user's fingertip and classifying the user's hand. Whereby the interactive conversion between the user and the hologram can be performed in real time without significant delay. The use of high speed cameras may also improve local accuracy. The operation of the projected operating element is precisely performed at the time of "touch projection". In slower camera systems this operation may only be recognized when passing through the hologram. This results in a more unnatural and imprecise interaction with the hologram. Furthermore, the manipulation of hologram manipulating elements, such as buttons, can be recognized by a high-speed camera and processed by an evaluation unit.

In order to ensure as high ergonomics as possible for the user, the first display device of the user interface according to the invention is in an advantageous embodiment arranged in the user's main field of view and/or the hologram is arranged outside the user's main field of view. In order to be ideally ergonomic and to minimize the countersunk angle of the user's field of view, the first display device must be arranged as close as possible to the driving scene, such as the lower part of the windscreen. In particular, the display is arranged as far away from the user as possible. This means that the first display device is typically located outside the radius of action of the user's hand, and thus the haptic interaction by hand is not ergonomic. The hologram may thus be arranged outside the main field of view, i.e. in the optimized grip area of the user, but for example in the radius of action of the user.

According to one advantageous embodiment, the hologram has icons and/or graphics, which represent the text of the screen content of the first display device. This may be, for example, a warning symbol, such as a word for representing "careless overspeed". In this way, compared to the display of information in text form, space can be saved on holograms which are constructed smaller than the first display device if necessary. Furthermore, the hologram may have a reduced color space display representing a corresponding color display of the screen content of the first display device. Alternatively or additionally, the hologram may represent a reduced detail display of the screen content of the first display device. Thereby enabling the user to quickly and easily notice important information to be communicated. In addition, the hologram may have a fixed display representing an animated display of the screen content of the first display device. The display performance of the holographic device and/or the evaluation unit can thereby be saved. In addition, the hologram may thus have a lower resolution than the screen content of the first display device. For the same reason, the hologram may have a black and white display of the screen content of the first display device. In another embodiment, for example when the user is to pay attention to certain text paragraphs, the hologram may have a different font size and/or text highlighting than the screen content of the first display device. By means of a simplified display of this advantageous embodiment, the perception of the situation can be simplified for the user. This is particularly advantageous when the hologram is not arranged in the main field of view of the user.

It is furthermore advantageous if the user interface comprises ultrasonic speaker means for generating tactilely perceptible ultrasonic pulses on the skin of the user by means of a plurality of ultrasonic transducers. As the ultrasonic speaker apparatus, all ultrasonic speaker apparatuses known in the prior art can be considered. Where the user is subjected to a perceived stimulus of ultrasound, so that a tactile feedback is produced when touching the hologram. Whereby the user is less distracting, as he immediately receives confirmation that he has interacted with the hologram. This is particularly advantageous in terms of road traffic for safety. In a preferred embodiment, the ultrasound speaker means may be activated only when the hand is classified by the input means, so that the animal or object cannot trigger ultrasound based feedback. The plurality of ultrasonic transducers may comprise, for example, 10 to 500, 30 to 400, preferably 80 to 300 ultrasonic transducers. In a further preferred embodiment of the advantageous development, the ultrasound speaker arrangement comprises two or three smaller ultrasound speaker arrangements, which comprise, for example, 10 to 100, 20 to 70, preferably 30 to 50 ultrasound transducers. The spatially distributed arrangement of the individual ultrasound speaker arrangements here allows a more flexible response to the skin surface from different directions, in particular from multiple directions. It is also advantageous to generate different haptic feedback for different areas of the user's hand. Further, the user interface is configured to categorize the user's hand based on the portion of the hand. Where the fingertips are classified as fit and the palms or wrists are classified as not fit. Furthermore, by means of the input device it is ensured that only nerve cells of the hand are stimulated, without causing deflection of the user, such as the wrist. The sound pressure of the haptic feedback is, for example, 120dB.

According to a further advantageous embodiment, the ultrasound speaker arrangement is configured as an element for displaying the hologram tactilely protruding or perceptible or palpable to the user by means of sound pressure. Such elements may be, for example, operating elements such as buttons with graphics and/or letter combinations and/or numbers on the hologram. Whereby the user may be indicated tactilely upon approach and/or input. This is particularly advantageous because the user may have difficulty finding the correct element in case of tension, because he cannot (long enough) look at the hologram. The ultrasonic speaker device may assist the user by generating, for example, increasingly enhanced tactile feedback via ultrasonic waves upon tactile indication. Furthermore, different options on the hologram by means of the ultrasound speaker arrangement may have different haptic feedback. Thus again improving the operational assistance to the user, which in turn increases the security.

According to a further advantageous embodiment, the user interface according to the invention is configured for activating (e.g. generating or displaying) or deactivating (e.g. hiding or closing) holograms as a function of the vehicle operating state and/or traffic conditions and/or driving conditions. Thus, display can be performed according to circumstances and assistance and security to the user can be increased again.

The invention also relates to a vehicle comprising a user interface according to the invention. Accordingly, a vehicle may be provided having a user interface that combines the features, effects and advantages described above.

Drawings

The invention is described in detail below with reference to examples, and other details, features and advantages of the invention are given by the following description and the accompanying drawings. The drawings are as follows:

FIGS. 1a to 1c show views of various stages of interaction between a user and an embodiment of a user interface according to the invention;

FIG. 2 illustrates one embodiment of a user interface according to the present invention; and

fig. 3 shows a detailed view of the interaction between a user and a user interface according to the invention.

Detailed Description

Fig. 1a shows a user interface 1 according to the invention in a transport tool 10. The display device 13 here comprises a first display means 2 in the form of a HUD located in the main field of view of the user 4. In this state the hologram 3 is deactivated. Furthermore, the user interface 1 is configured for recording the approach of the user 4 via the infrared LED 12, and the holographic device 7 is configured for generating a hologram 3 as shown in fig. 1b via this type of incoming data of the evaluation unit 6 (not shown here for the sake of clarity). The predefined spatial interaction area is delimited by an infrared LED 12, which is configured to send a signal to the evaluation unit 6, whereby the hologram 3 is generated by the holographic device 7. The interaction area for generating the hologram 3 is indicated by a dashed line in the figure. The hologram 3 presents the screen content 9 of the first display device 2. For example when the hand 15 of the user 4 leaves the spatially predefined interaction area again or after a corresponding input by the user 4 in the hologram 3 (for example by pressing the "answer" button) the hologram 3 is deactivated. As the finger gets closer, the user 4 can interact with the hologram 3, which is recorded by the input means 8. The user can here for example operate the element 11 of the hologram 3, as shown in fig. 1 c. In other words, the user 4 enters the interaction region 12 into the spatial region assigned to the element 11 or in which the element 11 appears. The user interface 1 is configured for subsequent deactivation of the hologram 3 in one input request. In addition, the hologram 3 can be deactivated again by removing the finger of the user 4 and the user interface 1 returned to its original state (see fig. 1 a).

Fig. 2 shows a detailed view of one embodiment of a user interface 1 according to the invention in a transport tool 10, which illustrates a materialization of the embodiment of fig. 1. The hologram device 7 generates a hologram 3, which hologram 3 presents the text screen content 9 of the HUD 2 in the form of a button element 11 with a selection possibility. This allows the driver to concentrate comfortably and safely on important selection possibilities. The proximity of the hand 15 of the user 4 causes data to be transmitted through the infrared LED 12 into the evaluation unit 6, which controls the holographic device 7 and thus generates the hologram 3. Thus controlling the generation of hologram 3. The holographic device 7 can be realized by known technical means. The evaluation unit 6 can also be connected to the memory 14 and to other functions, such as a battery of the vehicle 10 and/or to the sensors 10 of the vehicle 10 for detecting traffic conditions and/or vehicle operating states and/or driving conditions, by means of the cable a. The interaction of the user with his finger with the button 11 on the hologram 3 is recognized by means of a high-speed stereo camera 8 as input means, which is also connected to the evaluation unit 6. Whereby data generated by the user interaction is transmitted to the HUD 2 and/or other vehicle functions. This allows for example real-time input by the user 4.

Furthermore, the touching of the hologram, in particular the fingertip, is classified by the evaluation unit 6 based on the captured data of the movement of the user when interacting with the hologram 3, which is provided by the high-speed stereo camera 8. The latter embodiment of the user interface 1 according to the invention comprises 200 ultrasound transducers, which are also connected to the evaluation unit 6. Thus not only is the tactilely perceptible ultrasonic pulse conducted to the user's finger when the user presses the button, but the hand is also ultrasonically directed toward the button 11 of the hologram 3, without the user 4 having to look at the hologram 3. The buttons 11 may have various ultrasonic signals as tactile feedback, respectively. This is more ergonomic and at the same time safer for the user 4.

Fig. 3 shows a detailed schematic diagram of the distance relationship of the hand 15 of the user 4 to the interaction area spatially predefined by the infrared LED 12 and the resulting output of the user interface 1. The input means 8 here recognize the x, y, z coordinates of the finger position of the user 4. The following variables are defined herein:

d = distance of the fingertip to the predefined spatial interaction region;

d = minimum distance;

h = preview distance;

0 = hologram plane/interaction area.

Here, the

If D > D, the haptic feedback and hologram are deactivated.

If h < D < = D, then hologram 3 is generated, as the hand is recorded by the infrared LED 12.

If D < = h, hologram 3 is generated and a slight haptic feedback is output informing the user 4 that he is in the vicinity of hologram 3.

If d=0, a hologram 3 is generated and a more pronounced or stronger tactile feedback is transmitted to the user 4 by the ultrasound speaker apparatus 5, for example by pressing the button 11.

If D < 0, the user's hand 15 is outside the spatially predefined interaction region. The input device 8 no longer sorts the hands 15, whereby the hologram 3 and the ultrasound speaker device 5 are deactivated or held for safety reasons or to avoid distraction.

List of reference numerals

1. User interface

2. First display device

3. Hologram pattern

4. User' s

5. Ultrasonic speaker device

6. Evaluation unit

7. Holographic device

8. Input device

9. Screen content

10. Transport means

11. Element

12. Infrared LED

13. Display apparatus

14. Memory device

15. User's hand

Claims

1. User interface (1) for a vehicle (10), comprising:

a display device (13) having a first display means (2) and a hologram means (7) for freely generating a hologram (3) in space,

-an evaluation unit (6), and

a data input is provided for the purpose of,

the evaluation unit (6) is designed to recognize predefined inputs and/or the approach of the user (4) and/or system outputs and/or traffic situations and/or vehicle operating states by means of data inputs,

-the hologram device (7) being configured for generating or disabling a hologram (3) in response thereto, the hologram (3) representing a screen content (9) of the first display device (2), wherein the hologram (3) is configured such that the hologram can have:

-an icon representing the text of the screen content (9) of the first display device (2); and

-a lower resolution than the resolution of the screen content (9) of the first display device (2); and

-a reduced color space display of the screen content (9) of the first display device (2); and

-a different font size and/or text highlighting compared to the screen content (9) of the first display device (2).

2. The user interface (1) according to claim 1, wherein the system output

-representing an incoming call and hologram (3) representing an incoming call answer button, and/or

-representing the take over request and the hologram (3) representing the visual display of the take over request, and/or

-representing a received wireless received message and the hologram (3) representing a visual display of the wireless received message, and/or

-representing a response to the free space gesture and the hologram (3) representing an operable selection menu for responding to the free space gesture, and/or

-representing a warning indication and the hologram (3) representing a visual display of the warning indication.

3. The user interface (1) according to claim 1 or 2, wherein the proximity of the user (4) comprises a predefined proximity to an area in a passenger compartment of the vehicle (10) predefined for the hologram (3), and/or the input comprises a voice command and/or a gaze input.

4. The user interface (1) according to claim 1 or 2, wherein the user interface further comprises an input device (8) configured for detecting a contactless interaction of the user (4) with the hologram in a predefined spatial interaction region (16).

5. User interface (1) according to claim 1 or 2, wherein,

-the first display means (2) are arranged in the main field of view of the user (4), and/or

-the hologram (3) is arranged outside the main field of view of the user (4).

6. User interface (1) according to claim 1 or 2, wherein the user interface (1) comprises an ultrasound speaker arrangement (5) for generating tactilely perceivable ultrasound pulses on the skin of a user (4) by means of a plurality of ultrasound transducers as feedback to the interaction.

7. The user interface (1) according to claim 6, wherein the ultrasound speaker device (5) is configured for tactilely highlighting an element (11) of the hologram (3).

8. The user interface (1) according to claim 1 or 2, wherein the user interface (1) is configured for generating or disabling a hologram (3) depending on a vehicle running state and/or traffic situation.

9. The user interface (1) according to claim 1 or 2, wherein the hologram (3) has a black and white display of the screen content (9) of the first display device (2).

10. The user interface (1) according to claim 1 or 2, wherein the hologram (3) is configured such that the hologram can have a fixed display representing an animated display of the screen content (9) of the first display device (2).

11. A vehicle (10) comprising a user interface (1) according to any one of claims 1 to 10.