DE102019206606B4 - Method for contactless interaction with a module, computer program product, module and motor vehicle - Google Patents

Abstract

A method for contactless interaction with a module is described, with the following steps: - using a scanning device, determining a relative position of an operating object to the scanning device within an operating zone, - projecting at least one piece of operating information in a defined area onto the operating object using a projection device, - Determining a position of an operating device within the operating zone by means of the scanning device, - changing at least one operating parameter by means of the module, if the operating object assumes a defined spatial correlation to the operating information, - determining a change in position of the operating object compared to the relative position by means of the scanning device, whereby, if a position change distance is less than or equal to a minimum change distance, the projection is not spatially moved, - if the position change distance is greater than the minimum change distance, d The projection is spatially carried out with the movement of the control object. A computer program product, a module and a motor vehicle are also described.

Description

A method for contactless interaction with a module, a computer program product, a module and a motor vehicle are described here.

Methods for contactless interaction with a module, computer program products, modules and motor vehicles of the type mentioned at the beginning are known in the prior art. In order to operate electrical and electronic devices, it is necessary for a user of the corresponding device to interact with the device. A wide variety of user interfaces are known for this purpose, for example conventional interfaces with buttons, keys, sliders, rotary controls and the like, as well as advanced interfaces such as keyboards, mice, input fields (trackpads), rotary push-button controls, electronic pens, touch-sensitive screens, voice controls and gesture controls. Gesture controls with projection devices are known, inter alia, which can project control elements onto a surface, for example, which the user can then operate using tapping gestures.

So is from the DE 10 2013 000 081 A1 a camera-based gesture control for a motor vehicle is known.

In the DE 10 2014 207 963 A1 For example, a method for contactless interaction with a module is proposed, wherein the module has a first sub-module and a second sub-module, a primary beam being generated by the first sub-module in a first method step, the primary beam being generated by the second sub-module in a second method step is deflected in such a way that image information is projected into a projection area, wherein in a third method step the primary beam is deflected by the second sub-module in such a way that operating information is projected into an operating area, with a control signal being generated by the module in a fourth method step, if a control command is detected in a locating zone associated with the primary beam, wherein in the third method step the operating area is projected onto an operating object when the operating object is positioned in the locating zone. The operating area can for example be a hand of the user.

From the US 2013/0086531 A1 there is known an instruction issuing device having a detection unit and a projector. With a projection area detector, images of a graphical user interface (GUI) can be projected onto the projection area of a finger that is assigned to operate an assigned command.

Thus, the task arises of developing methods for contactless interaction with a module, computer program products, modules and motor vehicles of the type mentioned at the beginning in such a way that easier operation is possible.

The object is achieved by a method for contactless interaction with a module according to claim 1, a computer program product according to the independent claim 9, a module according to the independent claim 10 and a motor vehicle according to the independent claim 13. Further configurations and developments are the subject of the dependent claims .

• • mittels einer Scanvorrichtung Feststellen einer relativen Position eines Bedienobjektes zu der Scanvorrichtung innerhalb einer Bedienzone,
• • Projizieren wenigstens einer Bedieninformation in einen definierten Bereich auf das Bedienobjekt mittels einer Projektionsvorrichtung,
• • Feststellen einer Position einer Bedienvorrichtung innerhalb der Bedienzone mittels der Scanvorrichtung,
• • Ändern wenigstens eines Bedienparameters mittels des Moduls, wenn das Bedienobjekt eine festgelegte räumliche Korrelation zu der Bedieninformation einnimmt,
• • Feststellen einer Positionsveränderung des Bedienobjektes gegenüber der relativen Position mittels der Scanvorrichtung,
• • wobei,
  • o wenn eine Positionsveränderungsdistanz kleiner oder gleich einer Mindestveränderungsdistanz ist, die Bedieninformation räumlich nicht bewegt wird,
  • o wenn die Positionsveränderungsdistanz größer ist als die Mindestveränderungsdistanz, die Bedieninformation räumlich mit der Bewegung des Bedienobjektes mitgeführt wird.

A method for contactless interaction with a module is described below, with the following steps:

• • Using a scanning device to determine a relative position of an operating object to the scanning device within an operating zone,
• • Projecting at least one piece of operating information in a defined area onto the operating object by means of a projection device,
• • Determining a position of an operating device within the operating zone by means of the scanning device,
• • Changing at least one operating parameter by means of the module when the operating object adopts a fixed spatial correlation to the operating information,
• • Detecting a change in position of the operating object compared to the relative position by means of the scanning device,
• • in which,
  • o if a position change distance is less than or equal to a minimum change distance, the operating information is not spatially moved,
  • o if the position change distance is greater than the minimum change distance, the control information is spatially carried along with the movement of the control object.

The operating object is a hand of a user and / or the operating device is at least one finger of a user. By means of the scanning device, biometric data of the user are recorded using the hand and / or the at least one finger.

It can thus be achieved that the projected control information is not spatially moved if the control object only moves slightly, for example due to vibrations in a moving one Motor vehicle. Only when the operating object moves sufficiently strongly is the operating information updated with the movement of the operating object by changing the location of the projection of the operating information. This makes it easier to operate the module, as the projection and thus the display of the operating information remains more constant.

The operating parameter can be processed within the module or outside the module, for example as one of several systems that can be operated by means of the module. A corresponding system can be, for example, a multimedia or infotainment system of a motor vehicle.

The operating information can be, for example, an element of a list or a symbol in a selection of different symbols.

The defined spatial correlation can be touching the projected operating object at the location of the operating information.

In a first further refinement, it can be provided that the projection is continuously carried along.

As a result, sudden jumps in the projection can be avoided, which makes operation more pleasant for the user, since the at least one operating information item does not suddenly change from one location to the next. The risk of operating errors can also be reduced as a result if a user intends to operate certain operating information, but until the point in time when the established spatial correlation is established, other operating information is at the same location due to the tracking.

In a further refinement, it can be provided that the scanning device measures a direction of movement and a speed of movement of the operator control object and, with the aid of this information, calculates an entrainment trajectory of the operator control information.

In this way, continuous, non-abrupt tracking of the projection of the operating information can be achieved, which the user can intuitively understand and predict.

In a further refinement, it can be provided that the operating information is carried along both in position and in alignment with the operating object.

In this way, a constant alignment of the operating information on the operating object can be ensured regardless of its alignment relative to the projection device.

In a further refinement, it can be provided that the scanning device detects a second operating object in the operating zone, the projection device displaying the operating information on the second operating object if the first operating object and the second operating object are in a certain position relative to one another or are in relation to one another.

In this way, a transfer from one control object to another control object can take place.

A projection onto a hand of the user can, for example, prevent contamination of the hands of the user due to the necessity of touching publicly accessible operating elements. Instead, the user just has to touch the palm of his hand.

In combination with the further refinement mentioned above, it can be achieved that the operating information can be transferred from one hand to the other. The production of the specific position between the first and the second control object can be achieved, for example, by a predetermined gesture, e.g. by bringing the hands or palms together.

By capturing the biometric data, the user can be identified and the operating information can be customized.

In a further refinement, it can be provided that the biometric data include a fingerprint and / or anatomical data of the hand and / or hand lines and / or of the at least one finger.

This enables a user to be clearly identified.

In a further refinement, provision can be made for the biometric data to be compared with data in a memory, with a user profile being loaded if the biometric data matches a data record in the memory, the user profile relating to at least one piece of operating information.

This enables the control of an application to be continued seamlessly by means of the module.

In a further refinement, it can be provided that the module transmits the changed operating parameters to a Control device sends, wherein the control device changes at least one setting.

The control device can for example be a multimedia or infotainment control. The control device can also be an interface for operating functions of a motor vehicle (man-machine interface).

• • einer Scanvorrichtung zum Feststellen einer relativen Position eines Bedienobjektes zu der Scanvorrichtung innerhalb einer Bedienzone,
• • einer Projektionsvorrichtung zum Projizieren wenigstens einer Bedieninformation in einen definierten Bereich auf das Bedienobjekt,
• • einer mit der Scanvorrichtung und der Projektionsvorrichtung verbundenen Recheneinheit zum Feststellen einer Position einer Bedienvorrichtung innerhalb der Bedienzone mittels der Scanvorrichtung,
• • wobei die Recheneinheit zum Ändern wenigstens eines Bedienparameters ausgebildet ist, wenn das Bedienobjekt eine festgelegte räumliche Korrelation zu der Bedieninformation einnimmt,
• • wobei die Recheneinheit zum Feststellen einer Positionsveränderung des Bedienobjektes gegenüber der relativen Position mittels der Scanvorrichtung ausgebildet ist,
• • wobei die Recheneinheit dazu ausgebildet ist,
  • o die Projektion räumlich nicht zu bewegen, wenn eine Positionsveränderungsdistanz kleiner oder gleich einer Mindestveränderungsdistanz,
  • o die Projektion räumlich mit der Bewegung des Bedienobjektes mitzuführen, wenn die Positionsveränderungsdistanz größer ist als die Mindestveränderungsdistanz.

A first independent subject relates to a device for contactless interaction with a module with:

• • a scanning device for determining a relative position of an operating object to the scanning device within an operating zone,
• • a projection device for projecting at least one piece of operating information in a defined area onto the operating object,
• A computing unit connected to the scanning device and the projection device for determining a position of an operating device within the operating zone by means of the scanning device,
• • wherein the computing unit is designed to change at least one operating parameter when the operating object assumes a defined spatial correlation to the operating information,
• • wherein the computing unit is designed to determine a change in position of the operating object in relation to the relative position by means of the scanning device,
• • where the computing unit is designed to
  • o not moving the projection spatially if a position change distance is less than or equal to a minimum change distance,
  • o to move the projection spatially with the movement of the operating object if the position change distance is greater than the minimum change distance.

In a first further refinement, it can be provided that the computing unit is designed so that the projection is continuously carried along.

In a further refinement, it can be provided that the scanning device is designed to measure a direction of movement and a speed of movement of the operating object, the computing unit being designed to use this information to calculate an entrainment trajectory of the projection.

In a further refinement, it can be provided that the computing unit is designed to carry the operating information with it both in position and in alignment with the operating object.

In a further refinement, it can be provided that the scanning device is designed to recognize a second operating object in the operating zone, the arithmetic unit being designed for the projection device when the first operating object and second operating object are in a certain position relative to one another or move towards one another control so that the operating information is displayed on the second operating object.

In a further refinement, it can be provided that the operating object is a hand of a user and / or that the operating device is at least one finger of a user.

In a further refinement, it can be provided that the scanning device is designed to capture biometric data of the user using the hand and / or the at least one finger.

In a further refinement, it can be provided that the biometric data include a fingerprint and / or anatomical data of the hand and / or hand lines and / or of the at least one finger.

In a further refinement, it can be provided that the computing unit is set up to compare or have the biometric data compared with data in a memory, the computing unit being designed to create a user profile when the biometric data matches a data set in the memory to load, wherein the user profile relates to at least one piece of operating information.

In a further refinement, it can be provided that the module is designed to send the changed operating parameter to a control device, the control device being designed to change at least one setting as a function of the changed operating parameter.

Another independent subject matter relates to a computer program product with a computer-readable storage medium on which instructions are embedded which, when they are executed by at least one processing unit, cause the at least one processing unit to be set up for this purpose is to carry out the method according to one of the preceding claims.

The method can be carried out distributed on one or more processing units, so that certain method steps are carried out on one processing unit and other method steps are carried out on at least one further processing unit, with calculated data being able to be transmitted between the processing units if necessary.

Another independent subject matter relates to a module with a storage medium and at least one processing unit, a computer program product of the type described above being stored in the storage medium.

In a first further refinement, it can be provided that the module has a scanning device that scans the operating object with light in a non-visible wavelength range and / or a projection device with focusable optics.

Instead of focusable optics, in an alternative further refinement, a projection device can be provided without the need for focusing, for example with the aid of laser beams.

In a further refinement, it can be provided that the module is permanently installed in a motor vehicle.

Another independent subject matter relates to a motor vehicle with a module of the type described above.

• Es zeigen schematisch:
  • 1 ein Kraftfahrzeug mit einem Modul;
  • 2 ein Modul des Kraftfahrzeugs;
  • 3 eine Darstellung einer Bedienung eines Menüs auf einer Hand;
  • 4 eine Darstellung einer geringfügigen Bewegung der Hand aus 3;
  • 5 eine Darstellung einer größeren Bewegung der Hand aus 3, sowie
  • 6 eine Geste zur Übergabe der Projektion von einer Hand zur anderen.

Further features and details emerge from the following description in which at least one exemplary embodiment is described in detail - possibly with reference to the drawing. Described and / or graphically represented features form the subject matter individually or in any meaningful combination, possibly also independently of the claims, and in particular can also be the subject matter of one or more separate applications. Identical, similar and / or functionally identical parts are provided with the same reference symbols. They show schematically:

• They show schematically:
  • 1 a motor vehicle with a module;
  • 2 a module of the motor vehicle;
  • 3 an illustration of an operation of a menu on a hand;
  • 4th an illustration of a slight movement of the hand 3 ;
  • 5 an illustration of a larger movement of the hand 3 , such as
  • 6 a gesture to hand over the projection from one hand to the other.

1 shows a motor vehicle 2 with one module 4th .

The module 4th is for operating an infotainment system 6 intended. The infotainment system is for this purpose 6 with the module 4th connected to conduct signals. The module 4th can change operating parameters and transfer them to the infotainment system 6 send, which in turn changes settings, for example a music title, a playback volume or the like.

2 shows the module 4th of the motor vehicle 2 .

The module 4th has a scanning device 8th on. The scanning device 8th , here a camera, optically scans an operating zone 10 on objects. The operating zone 10 defines a spatial volume with a fixed spatial alignment to the module 4th , within which a use of the module 4th is possible.

The module 4th furthermore has a projection device 12th on that using an optic 14th Information on an area 16 within the operating zone 10 can project like a ray of light 18th is shown.

The module 4th also has a computing unit 20th as well as an associated memory 22nd on. In the memory 22nd A computer program product is stored which, when it is processed by the processing unit 20th is running, following the procedure described here.

In 2 it is also shown that a user has a left hand 24 into the operating zone 10 holds. The left hand 24 represents the area 16 ready as a projection surface for the projection device 12th can be used.

The scanning device 8th measures a relative position P the left hand 24 to the scanning device 8th . Using the scanning device 8th can hand orientation, size and location 24 relative to the scanning device 8th within the operating zone 10 be recognized.

The scanning device 8th can also have a fingerprint 26th the left hand 24 recognize and thus the left hand 24 uniquely assign to a specific user. For this purpose, corresponding biometric information can be stored in the memory 22nd be stored and thus individualization can be achieved, for example by providing favorites.

3 shows an illustration of an operation of a menu 28 .

The menu 28 comes with the projection device 12th on the left hand 24 projected. The menu 28 has a menu selection 30th on, one of which is the user with a right hand 32 by tapping with one finger 34 as an operating object to operating information 34 .

4th shows an illustration of a slight movement of the left hand 24 out 3 .

The left hand moves through vibrations 24 by a position change distance there . The position change distance there is from the scanning device 8th recorded and with a minimum change distance dm compared. Since in the present case the position change distance there is less than the minimum change distance dm , will project the menu 28 not changed, even if this changes a relative position of the menu from one position A. changed to a position A '.

5 shows an illustration of a major movement of the left hand 24 out 3 .

The scanning device 8th measures both a position change distance there as well as a change in angle dW the left hand 24 and calculates an entrainment trajectory from this T , according to which the projection device 12th must track the position and inclination to the menu 28 still fitting on the left hand 24 to represent.

6 shows a gesture to hand over the projection 24 to the other hand 30th .

When both hands 24 , 32 in the operating zone 10 perform a certain gesture, here bringing the fingers together to a distance smaller than x, this gesture is carried out by the scanning device 8th recognized and the computing unit 20th controls the projection device 12th so that in the future the menu 28 on the right hand 32 is shown.

Alternatively, other gestures than those shown here are possible.

Although the subject matter was illustrated and explained in more detail by means of exemplary embodiments, the invention is not restricted by the disclosed examples and other variations can be derived therefrom by the person skilled in the art. It is therefore clear that there is a multitude of possible variations. It is also clear that embodiments cited by way of example only represent examples that are not to be interpreted in any way as a limitation, for example, of the scope of protection, the possible applications or the configuration of the invention. Rather, the preceding description and the description of the figures enable the person skilled in the art to specifically implement the exemplary embodiments, whereby the person skilled in the art, with knowledge of the disclosed inventive concept, can make various changes, for example with regard to the function or the arrangement of individual elements mentioned in an exemplary embodiment, without the To leave the scope of protection which is defined by the claims and their legal equivalents, such as further explanation in the description.

List of reference symbols

2

Motor vehicle

4th

module

6th

Infotainment system

8th

Scanning device

10

Operating zone

12

Projection device

14th

optics

16

Area

18th

Beam of light

20th

Arithmetic unit

22nd

Storage

24

left hand

26th

fingerprint

28

menu

30th

Menu selection

32

right hand

34

finger

there

Position change distance

dm

Minimum change distance

dW

Change of angle

A, A '

relative position

P

relative position

T

Entrainment trajectory

x

distance

Claims (13)

Method for contactless interaction with a module (4), with the following steps: - by means of a scanning device (8) determining a relative position (P) of an operating object (24) to the scanning device (8) within an operating zone (10), - projecting at least one piece of operating information (28, 30) into a defined area (16) onto the Operating object (24) by means of a projection device (12), - determining a position (P) of an operating device (34) within the operating zone (10) by means of the scanning device (8), - changing at least one operating parameter by means of the module (4), if the Control object (24) assumes a fixed spatial correlation to the control information (28, 30), - determining a change in position of the control object (24) with respect to the relative position (P) by means of the scanning device (8), where, is less than or equal to a minimum change distance (dM), the operating information (28, 30) is not spatially moved, - if the position change distance (dA) is greater than the Mi ndest change distance (dM), the operating information (28, 30) is spatially carried along with the movement of the operating object (24), characterized in that the operating object is a hand (24, 32) of a user and / or the operating device is at least one finger (34 ) of a user, biometric data (26) of the user being recorded using the hand (24) and / or the at least one finger (34) by means of the scanning device (8). Procedure according to Claim 1 , the operating information (28, 30) is constantly carried along. Procedure according to Claim 1 or 2 , wherein the scanning device (8) measures a direction of movement and a movement speed of an operator control object (24) and uses this information to calculate an entrainment trajectory (T) of the operator control information (28, 30). Method according to one of the preceding claims, wherein the operating information (28, 30) is carried along both in position and in alignment with the operating object (24). Method according to one of the preceding claims, wherein the scanning device (8) detects a second operating object (24) in the operating zone (10), wherein when the first operating object (24) and second operating object (24) are or are in a certain position relative to one another , the projection device (12) displays the operating information (28, 30) on the second operating object. Method according to one of the preceding claims, wherein the biometric data (26) comprise a fingerprint (26) and / or anatomical data of the hand (24, 32) and / or hand lines and / or of the at least one finger (34). Procedure according to Claim 6 , the biometric data (26) being compared with data in a memory (22), with a user profile being loaded if the biometric data (26) matches a data record in the memory (22), the user profile at least one piece of operating information (28, 30) concerns. Method according to one of the preceding claims, wherein the module sends the changed operating parameters to a control device (6), wherein the control device (6) changes at least one setting. Computer program product with a computer-readable storage medium (22) on which instructions are embedded which, when executed by at least one processing unit (20), have the effect that the at least one processing unit (20) is set up to implement the method according to one of the preceding To carry out claims. Module with a storage medium (22) and at least one processing unit (20), wherein a computer program product is in the storage medium Claim 11 is stored. Module after Claim 10 with a scanning device (8) that scans the operating object (24) with light in a non-visible wavelength range and / or with a projection device (12) with focusable optics (14). Module after Claim 10 or 11 , wherein the module (4) is permanently installed in a motor vehicle (2). Motor vehicle with a module according to one of the Claims 10 to 12th .

Images