DE102009057739A1 - Operating device for vehicle, has operating element with control button, where place of user finger on control button is detected by detecting device - Google Patents

Abstract

The operating device has an operating element (3) with a control button. A place of a user finger on the control button is detected by a detecting device. The detecting device also detects the impression, with which the finger is pressed on the control button. An independent claim is also included for a method for controlling vehicle component.

Description

The The present invention relates to an operating device for a vehicle with a control that has a control surface and a detection device with which a location of a Finger of a user on the control surface detectable is. Moreover, the present invention relates a method for controlling a vehicle component by detecting a finger on a control surface of an operating device and controlling the vehicle component in dependence on the detected finger.

From the publication DE 10 2005 056 458 A1 It is known in a display of a vehicle, a video image of a user's hand, which is located at the location of a central control element, overlaid with an operator display. This visually allows a direct operation similar to a touchscreen operation by the user. Actual operation is performed remotely on a touchpad. The hand operating the touchpad is detected by means of a digital video camera and subsequently the hand is separated from a background in a captured video image and superimposed on the operating display.

The Object of the present invention is an operating device of the type mentioned for more features to use.

According to the invention this problem solved by an operating device after Claim 1 or 5 and a method according to claim 4 or 8. Inventive Further developments of the invention will become apparent from the dependent claims.

According to the Accordingly, the present invention provides an operating device for a vehicle with a control that has a control surface and a detection device with which a location of a Finger of a user on the control surface is detectable, wherein with the detection device and a pressure is detected, with the finger presses on the control surface, and the detected location and the detected one of the detection means Printable and a the place and the recorded Print corresponding image on one of the control unit and the Detection device separate display unit can be displayed.

alternative is provided an operating device for a vehicle with a control element that has a control surface, a detection device with which a first finger of a user is detectable on the control surface, wherein with the detection device also a second finger and / or a movement of one of the fingers or both fingers is detectable and the detection device a signal from the detected fingers and / or sensed motion providable and corresponding to the signal and / or the movement Image on one of the control unit and the detector separate display unit can be displayed.

Further is provided a method for controlling a vehicle component by detecting a location of a user's finger on a control surface a control element and controlling the vehicle component in dependence from the position of the detected location of the finger, as well as detecting a Pressure with which the finger presses on the control surface, and controlling the vehicle component also depending from the detected pressure.

Furthermore is provided a method for controlling a vehicle component by detecting a first finger of a user on a control surface an operating device and controlling the vehicle component in dependence from the detected finger, and detecting a second finger and / or a movement of one of the fingers or both fingers, displaying a the detected fingers and / or the detected movement corresponding image and controlling the vehicle component also depending from the detected fingers and / or the sensed motion.

In Advantageously, it is through the detection of the pressure that the Fingers on the control surface, possible, to realize a multi-stage triggering of a signal. By detecting another finger and / or a movement one of the fingers or both fingers makes it possible to gestures to grasp the finger. Thus, intuitive control requests can be intuitive be entered with the fingers in the operating device.

Preferably has the detection device for pressure detection a compressible scattering medium, allowing light scattering therein Pressure on the scattering medium changeable and the change is optically detectable. It is favorable, for example, if the scattering medium has an open-pore foam material.

optional can with the detection device also the number of fingers on the control surface be detected. It may also be cheap be when with the detection device, a movement of the fingers absolute or relative to each other is detectable. Furthermore, too a combination of above operating devices would be advantageous if not just a second finger and / or a finger movement or both fingers, but also the location and / or pressure of a finger is detected.

The present invention will now be explained in more detail with reference to the accompanying drawings, in de show:

1 an operating device in a vehicle;

2 several possibilities of finger gestures;

3 a cross section through a pressure-sensitive control surface and

4 a diagram of different pressurizations.

The Below described embodiments represent preferred embodiments of the present invention represents.

According to the example of 1 an operating device according to the invention is installed in a motor vehicle, so that a user 1 the vehicle or a motor vehicle component can control comfortably. The operating device comprises an indicator here 2 by the user 1 can be easily viewed without taking your eyes off the road. In addition, the operating device has a control element 3 that the driver or the user 1 light with his fingers 4 can reach. A camera 5 captures one or more of the fingers 4 on the control 3 ,

In the display, a video image of the user's hand, located at the location of the ZBE (central control unit) here of the control element 3 , overlaid with a control screen. This will give the user 1 Visually allows direct operation (similar to the touch screen operation). Actual operation, however, is canceled.

In order to be able to display the operating hand or the operating fingers in the display, they are used with the digital video camera 5 detected. Subsequently, the hand is separated from the background in the video image and superimposed on the operating screen.

The operating element 3 can for example be realized as a so-called "touchpad". It is a touch-sensitive surface, which determines the position of a finger on the surface of the pad, for example, based on the electrical capacitance.

In a specific embodiment, with the operating element 3 Finger gestures according to 2 be recognized. Accordingly, it is possible, for example, that the operating device a first gesture 6 recognizes, which is that the user 1 Two fingers on the control surface moved vertically, horizontally or in another direction. With the first gesture 6 For example, scrolling on the screen can be achieved horizontally or vertically.

A second finger gesture 7 may be that the user 1 two fingertips turns around a virtual pivot on the control surface. This can be used, for example, a virtual knob.

A third finger gesture 8th may be that two fingers on the control surface are moved toward or away from each other. As a result, for example, the zoom factor of an image representation can be set.

A fourth finger gesture 9 may be that the operating device detects three or more fingers of a hand on the control surface and detects, for example, their common horizontal movement. This can be used, for example, a virtual slider.

As the above examples show, the operating device according to the invention can thus include a gesture recognition, are detected in the finger gestures on the user interface of a control element. Typical gestures are, as in the example of 2 Wiping, pushing, rotating, zooming, etc. Gesture recognition can be performed using the touchpad information as well as the camera image.

In addition, the operating device may be equipped with an approach identifier for activating or deactivating the camera system when the hand approaches the operating surface. As a result, the display or the display 2 be used as a touch control system or as a pure display system. In this case, a capacitive or optical proximity sensor can be used.

The Operating device may be based on an optical system that has a hand segmentation enabled by IR line pattern. In the optical system is For example, a control surface illuminated with IR diodes. The control surface is, for example, with a special Foam layer and a film realized with IR paint line pattern. An IR camera "looks" over z. Two Plan mirror on the control surface.

During operation, an evaluation of the line pattern for detecting the hand or the individual fingers on the operating surface then takes place using methods of image processing. This is followed by an analysis of the finger movements in the sense of touch gestures (wiping, pushing, turning, etc.). In detail, for example, the line patterns of the control surface are learned. Then it checks if the Lini enmuster is disturbed and it is generated an outline of, for example, a finger on the control surface. By interpolating the outlines with the help of splines, the finger can be pictorially cut out. It finally takes place on the head unit display, ie the display 2 , a scaling and overlay of the finger with any panels. Hand segmentation may be further supported by an (IR) pattern representation on the touchpad. The control surface is not homogeneously dark (IR-absorbing), but has a light / dark pattern (eg lines or dots). If the pattern for the camera is disturbed, it is assumed that an object, in particular a finger or a hand, is located on the operating surface, ie in the foreground.

The operating element 3 may have a layer structure with multiple paint or film layers. In a four-layer structure, for example, a white topcoat could be used as the lowest layer. In addition, strips can be applied with an IR-absorbing lacquer. In turn, an IR-transparent lacquer is applied. The uppermost protective layer is for example a transparent film. The IR line pattern applied in the second layer, for example by screen printing, is visible to an IR camera, but invisible to the human eye.

The Hand segmentation should be so refined that it can also be used in cases works without contrast between hand and background. So should For example, a black leather glove on the black or dark appearing control surface automatically segmented can be. Also, the control would have so be realized that different ambient light conditions are not affect the segmentation.

The Operating element or the operating surface is, for example ergonomically curved. It is then suitable for example a textile material that is easy on the curved Surface can be applied. Hereby lets also reach a small depth of the control.

According to another likewise preferred embodiment, the operating element 3 designed sensitive to pressure. 3 shows a cross section through a part of such a pressure-sensitive control element. A carrier 10 is with a reflective surface 11 fitted. On top is a layer of open-pore urethane foam 12 applied. The surface of the urethane foam 12 is with a protective membrane 13 overdrawn. At the boundary layer between the reflective surface 11 and the urethane foam 12 are two light guides 14 and 15 arranged. One of them conducts the light of, for example, an LED into the urethane foam 12 , The other of the two light guides 14 . 15 takes scattered light from the urethane foam 12 and leads it, for example, to a photodiode. This results in an optical Halbraumanordnung.

The urethane foam 12 forms a foam mat that can be pressed in with a finger. The urethane foam 12 represents a compressible scattering medium. To the exit of a light guide 14 . 15 , ie around the light source, results in diffuse light propagation in the scattering medium 12 , Now the scattering medium 12 compressed, so change its optical properties and in particular its optical density. As a result, the diffuse light propagation changes and a scattered light change can be detected at the photodiode.

A alternative solution of the pressure-sensitive control element may be that the control is a transparent plate has, for example, from an end face by an LED is illuminated. Now touch a finger the surface the transparent plate, so will the light on the surface broken differently than in the pristine state. The same Stray light can be at the opposite of the finger Detect the side of the transparent plate. Press that Users stronger on the transparent plate, so increases the area where a reflection change takes place, and this change is again at the finger opposite Side of the transparent plate detectable.

4 shows the evaluation of a pressure-sensitive touchpad. The touchpad is touched here with 5 fingers. The pressure with the index finger is greatest, which is at the area 16 can be seen. The print intensity can be measured, for example, in color or by the size of the area. A corresponding pressure signal can be provided for a controller.

With The above individually presented functions can also be a so-called "multi-touch pad" built become. For example, this pad is multi-fingered at the same time operable, under the fingers located "buttons" visually be highlighted. The multi-touch pad also has a "feeling of touch", d. H. through a foam mat the finger pressure can be felt. The strenght Finger pressure is evaluated, allowing a multi-stage triggering a signal is possible. Besides, are with suitable image processing Finger gestures recognizable and classifiable. So are special finger movements like sliding, zooming, turning etc. evaluable.

The technology described above allows for a robust hand segmentation process tion. The method with IR lattice pattern segmentation succeeds even under low-contrast conditions, eg. Dark hands, gloves, nail varnish, paving, etc. In addition, the segmentation works under real ambient light conditions in the vehicle (eg in sunlight). The presentation quality of the overlaid hand is optimized by a suitable segmentation algorithm. The control surface of the control element can be reliably produced by simple means. For example, a soft-touch film can be screen-printed with special IR-transparent colored inks of any pattern. This results in a design freedom in terms of color and decoration. In addition, any IR-visible patterns are possible by using matched IR coatings. The mechanical properties (scratch resistance, contamination, etc.) are for other applications, eg. B. Door controls with special shape for the respective car type secured.

About that In addition, with the above technology, a space optimization can be achieved become. Degrees of freedom in the arrangement of the plane mirror and the Camera allow a flexible, compact packaging (less overall depth, there camera directly under control panel). There is also an IR light integrated into the camera, so no additional space is required.

1

user

2

display

3

operating element

4

finger

5

camera

6 7, 8, 9

finger gestures

10

carrier

11

reflective surface

12

urethane

13

protective membrane

14 15

optical fiber

16

pressure range

QUOTES INCLUDE IN THE DESCRIPTION

This list The documents listed by the applicant have been automated generated and is solely for better information recorded by the reader. The list is not part of the German Patent or utility model application. The DPMA takes over no liability for any errors or omissions.

Cited patent literature

• - DE 102005056458 A1 [0002]

Claims (9)

Control device for a vehicle with - a control element ( 3 ), which has a control surface, and - a detection device with which a location of a finger ( 4 ) of a user ( 1 ) is detectable on the operating surface, characterized in that - with the detection device also a pressure can be detected, with which the finger ( 4 presses on the operating surface, and - the detected location and the detected pressure can be provided by the detection device and an image corresponding to the detected location and the detected pressure can be displayed on one of the control element ( 3 ) and the detection device separate display unit ( 2 ) is displayed. Operating device according to claim 1, characterized in that the detection device comprises a compressible scattering medium ( 12 ), so that a light scattering therein by pressure on the scattering medium ( 12 ) changeable and the change is optically detectable. Operating device according to claim 2, characterized in that the scattering medium ( 12 ) has an open-pored foam material. Method for controlling a vehicle component by - detecting a location of a finger ( 4 ) of a user ( 1 ) on a control surface of a control element ( 3 ) and - controlling the vehicle component as a function of the position of the detected location of the finger ( 4 ), characterized by - detecting a pressure with which the finger presses on the operating surface - displaying an image corresponding to the detected location and the detected pressure - also controlling the vehicle component as a function of the detected pressure. Control device for a vehicle with - a control element ( 3 ), which has a control surface, - a detection device, with which a first finger ( 4 ) of a user ( 1 ) is detectable on the control surface, characterized in that - with the detection device also a second finger ( 4 ) and / or a movement of one of the fingers or both fingers can be detected and - a signal from the detected fingers and / or the detected movement can be provided by the detection device and an image corresponding to the signal and / or the movement can be displayed on one of the control element ( 3 ) and the detection device separate display unit ( 2 ) can be displayed. Control device according to Claim 5, characterized in that the number of fingers ( 4 ) is detectable on the control surface. Operating device according to claim 5 or 6, characterized in that with the detection means a movement of the fingers ( 4 ) is absolute or relative to each other detectable. Operating device according to one of Claims 5 to 7, characterized in that the location of at least one of the fingers ( 4 ) on the control surface and / or a pressure with which the at least one finger ( 4 ) presses on the control surface, detectable and a corresponding signal can be provided. Method for controlling a vehicle component by - detecting a first finger ( 4 ) of a user ( 1 ) on a control surface of an operating device and - controlling the vehicle component as a function of the detected finger ( 4 ), characterized by - detecting a second finger and / or a movement of one of the fingers or both fingers, - displaying an image corresponding to the detected fingers and / or the detected movement and - controlling the vehicle component as a function of the detected fingers and / or the detected movement.