DE102023113998A1 - Gesture control for user-assigned vehicle functions - Google Patents

Abstract

An operating device (4) for a motor vehicle (2) for triggering a vehicle function (F1-3) by a gesture (G1-3) of a user (8) contains an assignment rule (14) between gestures (G1-3), vehicle functions (F1-3) and user classes (PK1-4), an identification module (16) for a current user class (PKa) of a user (8) within range (18) of the detection area (6) for gestures (G1-3), a detection module (20) for a current gesture (Ga) of a user and a control module (22) which only triggers the assigned vehicle function (F1-3) if the current user class (PKa) is assigned to the current gesture (Ga) in accordance with the assignment rule (14).
A motor vehicle (2) contains the operating device (4), the vehicle functions (F1-3), and the detection area (6).
In a method for operating the operating device (4) or the motor vehicle (2), the identification module (16) assigns the current user class (PKa) to the user (8), the detection module (20) detects the current gesture (Ga) of the user (8), and the control module (22) triggers the assigned vehicle functions (F1-3) only if the current user class (PKa) is at least one of the user classes (PK1-3) of the current gesture (Ga) according to the assignment rule (14).

Description

The invention relates to an operating device for a motor vehicle for triggering a vehicle function by a gesture of a user.

From the DE 20 2012 005 255 U1 an operating device is known, in particular for a vehicle or household appliance, with a gesture monitoring unit which is designed to detect non-tactile gestures of a user, and an actuation unit which is designed to actuate an associated device, wherein the operating device is designed either to be in a blocking state in which the actuation unit is not controlled, or to be in an operating state in which the operating device is designed, depending on the recognition of a non-tactile actuation gesture by the gesture monitoring unit, to control the actuation unit in order to actuate the associated device, wherein the operating device is designed to be put into the operating state when the gesture monitoring unit detects a non-tactile activation gesture, wherein the activation gesture differs from the actuation gesture.

The operating device has an identification device that is designed to carry out an identification, with a transition from the blocking state to the operating state only taking place if a positive identification takes place and the activation gesture is recognized. In particular, the identification takes place without contact. This can be done, for example, by biometric identification devices, such as facial recognition.

The invention is based on the object of proposing an improved operating device for a motor vehicle for triggering a vehicle function by a gesture of a user.

The object is achieved by an operating device according to patent claim 1. Preferred or advantageous embodiments of the invention and other categories of invention emerge from the further claims, the following description and the attached figures.

The operating device is one for a motor vehicle. The operating device serves or is designed to trigger a vehicle function. This applies in particular if the operating device is in an installed state in a motor vehicle as intended.

“Intended use” means that the operating device is designed for a specific motor vehicle or a specific type of motor vehicle and is set up for use there; e.g. it is designed for the geometry/material and system requirements etc. determined thereby. In other words, a motor vehicle in question is assumed to be known in terms of its geometry, size, material properties etc.

The vehicle function is triggered (when installed and in operation) by a user's gesture. The gesture is made within a detection area of or in the vehicle and is detected by or in or with the help of the operating device. The detection area can be inside and/or outside the vehicle.

The operating device contains an assignment rule, for example in the form of a table, e.g. a data set stored in a memory of the operating device, a database, data structure, etc. According to the assignment rule or with the help of the assignment rule, at least one of the vehicle functions and at least one user class is assigned to a respective gesture. There is therefore an assignment between gesture and vehicle function(s) and one or more user classes, whereby different gestures can also trigger the same vehicle function. Vehicle functions are e.g. "heating warmer", "music louder", "seat heating on", etc. Each gesture is assigned at least one user class. The user class identifies a certain type of user and/or an individual user. In particular, the user classes are assigned to users of certain age ranges. For example, one user class describes children up to 6 years of age, another describes adults over 18 years of age, etc.

The operating device contains an identification module. This is designed or serves to assign a current user class to at least one user. The prerequisite for assignment or identification is that the user is within range of the detection area. This means that he or she can potentially perform a gesture or gestures in the detection area from his or her current location. The current user class is therefore the one that characterizes the user. The current user class is one of the classes that are stored in the assignment rule.

The operating device contains a detection module. This is designed or serves to detect a current gesture of one of the users who are within range of the detection area and for which a current user class was consequently determined (before) / will be determined (simultaneously or after).

The operating device contains a control module. This is basically set up or serves to trigger the vehicle functions for the current, i.e. currently detected gesture, that are assigned to this gesture according to the assignment rule. However, the triggering only actually occurs if the current user class assigned to the user (who is performing the current gesture) (determined by the identification module) corresponds to at least one of the user classes that are assigned to the gesture according to the assignment rule.

In other words, it is checked whether the user who is performing the current gesture belongs to a user class for which the respective vehicle function is released according to the assignment rule. The "release" is carried out by assigning the user classes in the assignment rule. This prevents an unauthorized user from triggering a vehicle function. "Unauthorized" is the user who belongs to a user class that is not assigned to the respective vehicle function with the relevant gesture in the assignment rule. The assignment rule therefore ensures that only users of certain user classes are authorized to trigger associated vehicle functions using the associated gesture.

With the gesture control or gesture control according to the invention, specific, defined functions in the motor vehicle, e.g. a central information display (CID), can be controlled by hand gestures in the recognition area. Recognition is carried out in particular via 3D sensors and will not be explained in more detail here. In particular, five specific gestures can be carried out: swiping, pointing, turning to the right, turning to the left and point, plus two freely selectable gestures. The gestures can be used to operate vehicle functions in particular such as regulating the volume, accepting and rejecting a telephone call, closing specific pop-ups such as traffic announcements, confirming check control messages, triggering a personally configured function and surround view.

In a preferred embodiment, the identification module is designed or serves to assign the user to the current user class based on biometric features. The biometric features are specific to the respective user. The user therefore does not have to carry any additional or artificial identification feature, such as a chip card, personal identification or similar, in order to be assigned to the user class. The user cannot deceive the identification module in order to trigger a specific vehicle function, because the biometric features cannot be changed at will.

The biometric characteristics can also be determined in particular as part of facial recognition.

In a preferred variant of this embodiment, at least one of the biometric features is a feature correlated with the age of the person. Users can thus be assigned to a specific user class in an abstract manner, without taking their individual identity into account, by classifying them into user classes (in particular exclusively) according to their age. This can, for example, prevent children in a certain age range from being able to trigger certain vehicle functions.

In a preferred variant of this embodiment, at least one of the biometric features is a length of an extremity of the user or a head circumference of the user. The extremity is, for example, an arm of the user. Such features are particularly clearly dependent on the age of a user and can also be recorded and evaluated particularly easily, in particular with the help of a camera or image analysis (see below).

In a preferred embodiment, the identification module has a camera and is designed or serves to assign the user to the current user class based on a camera image recorded by the camera of the user in question. The camera images are recorded in particular when the operating device is in the installed state in the intended motor vehicle and in operation. The camera is then aligned so that users who are within range of the detection area can be shown in the camera image. The classification of users into user classes, i.e. the current user class based on camera images, is particularly simple and reliable.

In a preferred embodiment, the detection module is set up to only detect gestures from users if at least one assigned vehicle function exists in the assignment rule for the current user class determined by the identification module, i.e. the vehicle function is “activated”. If the user therefore belongs to a current user class for which no vehicle functions are activated gesture detection related to that user can be avoided, which saves resources.

The object of the invention is also achieved by a motor vehicle according to patent claim 7. This contains the operating device according to the invention as well as the above-mentioned vehicle functions and the detection range.

The motor vehicle and at least some of its possible embodiments as well as the respective advantages have already been explained in connection with the operating device according to the invention.

The object of the invention is also achieved by a method according to claim 8. This serves to operate the operating device according to the invention or the motor vehicle according to the invention. The operating device is in particular in the assembled state in the motor vehicle and is in operation. In the method, the identification module assigns a current user class to at least one user within range of the detection area (if such a user exists). The detection module detects a respective current gesture of one of the users in the detection area (if such a user performs a gesture). The control module only triggers the vehicle functions assigned according to the assignment rule for the currently detected gesture if the current user class assigned to the user corresponds to at least one of the user classes that are assigned to the current gesture according to the assignment rule.

The invention is based on the following findings, observations and considerations and also has the following preferred embodiments. These embodiments are sometimes referred to as "the invention" for the sake of simplicity. The embodiments can also contain parts or combinations of the above-mentioned embodiments or correspond to them and/or possibly also include embodiments not previously mentioned.

According to the invention, among other things, a method for determining the operating release for gesture control results.

The invention is based on the realization that in practice it is common for every occupant (user) to perform gestures that trigger a corresponding vehicle function, e.g. operating a screen. This can lead to incorrect operation or operation by unauthorized persons.

The invention is based on the idea of combining face/person recognition with gesture control in order to allow or block gestures (the execution of the assigned vehicle function) depending on the person (user, their user class).

According to the invention, it is therefore proposed in particular that in a first step it is checked whether a person is authorized to carry out an operation (current user class in the assignment rule for the gesture is present). This is done via the interior camera of the vehicle. In this case, it is classified whether the person has reached a certain age; for example, by measuring the head size or arm length, it is estimated whether the person is in a certain age range. Furthermore, certain people can be authorized to operate the device and determined by facial recognition. In a second step, the gestures for controlling the screen are tracked and used for inputs only for authorized people.

According to the invention, there is the advantage that gestures are only permitted for authorized persons.

According to the invention, it is therefore particularly about the release of content (vehicle function) that should not be operated by children (current user class), for example (current user class not assigned to the vehicle function in the assignment rule), who can also sit in the second row of seats (in the back of a motor vehicle) and can make inputs to a coupled system (or on the passenger seat) using the gesture control in the rear area (detection area there). For example, for age estimation (user class assigned to an age range), a measurement (biometric characteristics) of the corresponding occupants (users) is carried out via the camera and these are classified (current user class).

• 1 ein Kraftfahrzeug mit Bedienvorrichtung und Benutzer in einer Schemadarstellung.

Further features, effects and advantages of the invention emerge from the following description of a preferred embodiment of the invention and the attached figures. Each of these shows a schematic principle sketch:

• 1 a motor vehicle with operating device and user in a schematic representation.

1 shows a highly symbolized and block diagram of a section of a motor vehicle 2. The motor vehicle 2 contains an operating device 4 and has a detection area 6. Users 8 of the motor vehicle 2, of which One of them is shown here as an example. Within the detection range, 6 gestures can be carried out, of which gestures G1-3 are only symbolically indicated here. Gestures G1-3 are different hand movements. Specific gestures G1-3 are essentially used to trigger specific vehicle functions F1-3.

The operating device 4 contains an assignment rule 14. In the exemplary embodiment, this is a table that is stored as a data structure in a memory of the operating device 4 (not shown in detail). According to the assignment rule 14, each of the gestures G1-3 is assigned a respective vehicle function F1-3 (one row of the table each). In addition, each of the gestures G1-3 and vehicle functions F1-3 is assigned a respective user class PK1-3. In the example, the user class PK1 is the class of adult users 8 over 18 years of age, the user class PK2 is the class of users 8 between the ages of 10 and 18. The user class PK3 is the class of users 8 between the ages of 3 and 10, and the user class PK4 is for small children under 3 years of age.

The operating device 4 contains an identification module 16. This serves to assign a current user class PKa to those users 8 who are within range 18 (symbolically indicated here by a dashed line) of the detection area 6. In the present case, the user 8 is a small child under the age of 3, i.e. the user class PKa=PK4.

• Die Bedienvorrichtung 4 enthält ein Erfassungsmodul 20. Dieses dient dazu, im Erfassungsbereich 6 eine jeweilige de Gesten G1-3 als aktuelle Geste Ga des Benutzers 8 zu erfassen. Vorliegend führt der Benutzer 8 die Geste G1 aus, weshalb gilt Ga=G1.

The gestures G1-3 are made or executed by the user 8 within the detection area 6 and are detected by the operating device 2 as follows:

• The operating device 4 contains a detection module 20. This serves to detect a respective one of the gestures G1-3 in the detection area 6 as the current gesture Ga of the user 8. In this case, the user 8 performs the gesture G1, which is why Ga=G1 applies.

The operating device 4 also contains a control module 22. This serves to trigger the vehicle function F1-3 for the currently detected gesture Ga, which is assigned to it according to assignment rule 14, in this case the vehicle function F1 only if the current user class PKa assigned to the user 8 corresponds to at least one of the user classes PK1-3 that are assigned to the current gesture Ga according to assignment rule 14. In the present case, only the user classes PK1 and PK2 are assigned to the gesture G1 as the current gesture Ga, but not the current user class PKa = PK4. The current gesture Ga of the user 8 cannot therefore trigger the vehicle function F1.

The identification module 16 identifies the user 8 based on biometric features 24, i.e. assigns the current user class Ga to the user 8 based on the biometric features 24. In this case, the biometric features 24 are features correlated with the age of the user 8, namely the length L of an extremity 26 of the user 8, here his arm, or a head circumference K of the head 27 of the user 8.

For this purpose, the identification module 16 has a camera 28 which, during operation, records or provides camera images 30 of the user 8. The identification module 16 assigns the current user class PKa to the user 8 based on the camera image(s) 30.

• Gesten G1-3 werden von Benutzern 8 überhaupt nur erfasst, wenn für die vom Identifizierungsmodul 16 von der betreffenden Benutzer 8 ermittelte aktuelle Benutzerklasse PKa in der Zuordnungsvorschrift 14 überhaupt wenigstens eine zugeordnete Fahrzeugfunktion F1-3 existiert. Existiert eine solche nicht, werden Gesten G1-3 des Benutzers 8 überhaupt nicht erfasst, da diese aufgrund der Zuordnungsvorschrift 14 ohnehin nie zur Auslösung einer Fahrzeugfunktion F1-3 führen könnten. Vorliegend ist die Personenklasse PK4 keiner der Fahrzeugfunktionen F1-3 zugeordnet. Nachdem das Identifizierungsmodul 16 also die aktuelle Personenklasse PKa=PK4 ermittelt hat, findet keine Gestenerkennung statt.

The detection module 20 operates in an alternative embodiment as follows:

• Gestures G1-3 are only recorded by users 8 if at least one assigned vehicle function F1-3 exists in the assignment rule 14 for the current user class PKa determined by the identification module 16 for the relevant user 8. If such a function does not exist, gestures G1-3 of user 8 are not recorded at all, since due to the assignment rule 14 they could never trigger a vehicle function F1-3 anyway. In this case, the person class PK4 is not assigned to any of the vehicle functions F1-3. After the identification module 16 has determined the current person class PKa=PK4, no gesture recognition takes place.

In the exemplary embodiment, the motor vehicle 2 or its operating device 4 is therefore operated as follows: First, the identification module 16 assigns a current user class PKa to a user 8 located within range 18 of the detection area 6. Then (if a vehicle function F1-3 is present in the assignment rule 14 for the current user class PKa), the detection module 20 detects a respective current gesture Ga of the user 8 in the detection area 6. The control module 22 then triggers the vehicle function F1-3 assigned according to the assignment rule 14 for the currently detected gesture Ga only if the current user class PKa assigned to the user 8 corresponds to at least one of the user classes PK1-3 that are assigned to the gesture G1-3 according to the assignment rule 14.

list of reference symbols

2

motor vehicle

4

control device

6

detection range

8

user

14

assignment rule

16

identification module

18

reach

20

data acquisition module

22

control module

24

biometric feature

26

extremity

27

Head

28

camera

30

camera image

G1-3

gesture

F1-3

vehicle function

PK1-4

user class

PKa

user class (current)

Ga

gesture (current)

L

length

K

head circumference

QUOTES INCLUDED IN THE DESCRIPTION

This list of documents listed by the applicant was generated automatically and is included solely for the better information of the reader. The list is not part of the German patent or utility model application. The DPMA accepts no liability for any errors or omissions.

Cited patent literature

• DE 20 2012 005 255 U1 [0002]

Claims (8)

Operating device (4) for a motor vehicle (2) for triggering a vehicle function (F1-3) by a gesture (G1-3) of a user (8) within a detection area (6) of the motor vehicle (2), - with an assignment rule (14) according to which at least one of the vehicle functions (F1-3) and at least one user class (PK1-4) is assigned to a respective gesture (G1-3), - with an identification module (16) which is set up to assign a current user class (PKa) to at least one user (8) who is within range (18) of the detection area (6), - with a detection module (20) which is set up to detect a respective current gesture (Ga) of one of the users (8) in the detection area (6), - with a control module (22) which is set up to assign the vehicle functions (F1-3) assigned to the currently detected gesture (Ga) according to the assignment rule (14) only to trigger if the current user class (PKa) assigned to the user (8) corresponds to at least one of the user classes (PK1-3) assigned to the current gesture (Ga) according to the assignment rule (14). Operating device (4) according to claim 1 , characterized in that the identification module (16) is designed to assign the user (8) to the current user class (PKa) on the basis of biometric features (24). Operating device (4) according to claim 2 , characterized in that at least one of the biometric features (24) is a feature correlated with the age of the user (8). Operating device (4) according to claim 3 , characterized in that at least one of the biometric features (24) is a length (L) of an extremity (26) of the user (8) or a head circumference (K) of the user (8). Operating device (4) according to one of the preceding claims, characterized in that the identification module (16) has a camera (28) and is designed to assign the user (8) to the current user class (PKa) on the basis of a camera image (30) recorded of the user (8) by the camera (28). Operating device (4) according to one of the preceding claims, characterized in that the detection module (20) is set up to detect gestures (G1-3) only from users (8) if at least one assigned vehicle function (F1-3) exists in the assignment rule (14) for the current user class (PKa) determined by the identification module (16). Motor vehicle (2), - with the operating device (4) according to one of the preceding claims, - with the at least one vehicle function (F1-3), and - with the detection area (6). Method for operating an operating device (4) according to one of the Claims 1 until 6 or a motor vehicle (2) according to claim 7 , in which: - the identification module (16) assigns a current user class (PKa) to at least one user (8) within range (18) of the detection area (6), - the detection module (20) detects a respective current gesture (Ga) of one of the users (8) in the detection area (6), - the control module (22) triggers the vehicle functions (F1-3) assigned to the currently detected gesture (Ga) according to the assignment rule (14) only if the current user class (PKa) assigned to the user (8) corresponds to at least one of the user classes (PK1-3) that are assigned to the current gesture (Ga) according to the assignment rule (14).

Images