DE202012005255U1 - Operating device with a gesture monitoring unit - Google Patents

Operating device with a gesture monitoring unit

Info

Publication number
DE202012005255U1
DE202012005255U1 DE202012005255U DE202012005255U DE202012005255U1 DE 202012005255 U1 DE202012005255 U1 DE 202012005255U1 DE 202012005255 U DE202012005255 U DE 202012005255U DE 202012005255 U DE202012005255 U DE 202012005255U DE 202012005255 U1 DE202012005255 U1 DE 202012005255U1
Authority
DE
Germany
Prior art keywords
gesture
operating device
designed
device according
gestures
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Lifetime
Application number
DE202012005255U
Other languages
German (de)
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
YOUSE GMBH, DE
Original Assignee
YOUSE GmbH
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by YOUSE GmbH filed Critical YOUSE GmbH
Priority to DE202012005255U priority Critical patent/DE202012005255U1/en
Publication of DE202012005255U1 publication Critical patent/DE202012005255U1/en
Application status is Expired - Lifetime legal-status Critical
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R25/00Fittings or systems for preventing or indicating unauthorised use or theft of vehicles
    • B60R25/20Means to switch the anti-theft system on or off
    • B60R25/2045Means to switch the anti-theft system on or off by hand gestures
    • AHUMAN NECESSITIES
    • A47FURNITURE; DOMESTIC ARTICLES OR APPLIANCES; COFFEE MILLS; SPICE MILLS; SUCTION CLEANERS IN GENERAL
    • A47LDOMESTIC WASHING OR CLEANING; SUCTION CLEANERS IN GENERAL
    • A47L15/00Washing or rinsing machines for crockery or tableware
    • A47L15/42Details
    • A47L15/4293Arrangements for programme selection, e.g. control panels; Indication of the selected programme, programme progress or other parameters of the programme, e.g. by using display panels
    • FMECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F24HEATING; RANGES; VENTILATING
    • F24COTHER DOMESTIC STOVES OR RANGES; DETAILS OF DOMESTIC STOVES OR RANGES, OF GENERAL APPLICATION
    • F24C15/00Details
    • F24C15/20Removing cooking fumes
    • F24C15/2021Arrangement or mounting of control or safety systems
    • FMECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F24HEATING; RANGES; VENTILATING
    • F24COTHER DOMESTIC STOVES OR RANGES; DETAILS OF DOMESTIC STOVES OR RANGES, OF GENERAL APPLICATION
    • F24C7/00Stoves or ranges heated by electrical energy
    • F24C7/08Arrangement or mounting of control or safety devices
    • F24C7/082Arrangement or mounting of control or safety devices on ranges, e.g. control panels, illumination
    • F24C7/083Arrangement or mounting of control or safety devices on ranges, e.g. control panels, illumination on tops, hot plates
    • FMECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F24HEATING; RANGES; VENTILATING
    • F24COTHER DOMESTIC STOVES OR RANGES; DETAILS OF DOMESTIC STOVES OR RANGES, OF GENERAL APPLICATION
    • F24C7/00Stoves or ranges heated by electrical energy
    • F24C7/08Arrangement or mounting of control or safety devices
    • F24C7/082Arrangement or mounting of control or safety devices on ranges, e.g. control panels, illumination
    • F24C7/085Arrangement or mounting of control or safety devices on ranges, e.g. control panels, illumination on baking ovens
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017Gesture based interaction, e.g. based on a set of recognized hand gestures
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60KARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2370/00Details of arrangements or adaptations of instruments specially adapted for vehicles, not covered by groups B60K35/00, B60K37/00
    • B60K2370/10Input devices or features thereof
    • B60K2370/12Input devices or input features
    • B60K2370/146Input by gesture
    • FMECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F24HEATING; RANGES; VENTILATING
    • F24COTHER DOMESTIC STOVES OR RANGES; DETAILS OF DOMESTIC STOVES OR RANGES, OF GENERAL APPLICATION
    • F24C15/00Details
    • F24C15/02Doors specially adapted for stoves or ranges
    • FMECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F25REFRIGERATION OR COOLING; COMBINED HEATING AND REFRIGERATION SYSTEMS; HEAT PUMP SYSTEMS; MANUFACTURE OR STORAGE OF ICE; LIQUEFACTION SOLIDIFICATION OF GASES
    • F25DREFRIGERATORS; COLD ROOMS; ICE-BOXES; COOLING OR FREEZING APPARATUS NOT COVERED BY ANY OTHER SUBCLASS
    • F25D2700/00Means for sensing or measuring; Sensors therefor
    • F25D2700/04Sensors detecting the presence of a person
    • FMECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F25REFRIGERATION OR COOLING; COMBINED HEATING AND REFRIGERATION SYSTEMS; HEAT PUMP SYSTEMS; MANUFACTURE OR STORAGE OF ICE; LIQUEFACTION SOLIDIFICATION OF GASES
    • F25DREFRIGERATORS; COLD ROOMS; ICE-BOXES; COOLING OR FREEZING APPARATUS NOT COVERED BY ANY OTHER SUBCLASS
    • F25D29/00Arrangement or mounting of control or safety devices

Abstract

Operating device, in particular for a vehicle (16) or household appliance (1, 7, 8, 9, 10, 11, 12, 13, 14), with
a gesture monitoring unit (2) adapted to detect non-tactile gestures of a user (15), and
an actuator (4, 18) adapted to actuate an associated device (5, 17, 19, 20, 21, 22, 23),
wherein the operating device is designed, either
to be in a locked state in which the actuator unit (4, 18) is not driven, or
to be in an operating state in which the operating device is adapted, in response to the detection of a non-tactile actuating gesture by the gesture monitoring unit (2), to control the actuating unit (4, 18) to the associated device (5, 17, 19, 20 , 21, 22, 23),
characterized in that
the operating device is adapted to be placed in the operating state when the gesture monitoring unit (2) detects a non-tactile activation gesture, the activation gesture being different from the actuating gesture.

Description

  • The present invention relates to an operating device, in particular for a vehicle or household appliance, with a gesture-monitoring unit for non-tactile gestures and an actuating unit according to the preamble of claim 1.
  • In the prior art tactile and non-tactile gesture controls are known. Tactile gesture controls are usually a touchscreen that is operated by gestures on its surface by a user.
  • In non-tactile gesture controls, a user may enter actuation commands by means of a non-tactile gesture-monitoring unit, the gesture-monitoring unit comprising, in particular, a camera, infrared camera, or the like, and analyze to what extent a predetermined non-tactile gesture can be detected. Non-tactile gesture control may be served by executing non-tactile gestures, that is, gestures that are spaced from a gesture-monitoring unit.
  • From the DE 10 2010 004 518 A1 a vehicle mode activation by gesture control is known, wherein first a user validation can take place, which includes in particular a keystroke of the user to a key fob. Once the user validation is received, a controller processes signals received from one or more non-tactile gesture detectors. This allows, for example, based on the detection of a predetermined gesture, one of the doors, the sunroof or the folding roof of the vehicle can be opened by a suitable actuator.
  • Furthermore, it is known from a large number of documents in the prior art that gesture monitoring units are used in operating devices which enable actuation of different actuators, in particular in the vehicle sector. It is also known in the art that a gesture of a plurality of possible gestures activates a desired actuation mode in which, for example, an adjustment of an actuator is made proportional to the movement of the predetermined gesture. For example, depending on the movement of a hand-shaped gesture, a volume of a vehicle audio device or the temperature setting of an air conditioner may be adjusted. It is also known in the prior art that to prevent the erroneous operation of a gesture control, gestures are recognized only in a predetermined, spatially very limited area, while outside of this area no monitoring of the user's gestures takes place.
  • Furthermore, it is known that, also to prevent misoperation or to make operation more precise, a gesture having a vocal signal, i. H. a voice input of the user must be combined to operate an operating unit of an operating device.
  • In a tactile gesture control misuse can already be excluded by the fact that the user, the input element, for. As the touch screen, not touched.
  • Starting from the prior art, it is the object of the invention to provide an easy-to-use operating device with a gesture monitoring unit for non-tactile gestures, in which the risk of misuse is low.
  • This is achieved by an operating device, in particular for a vehicle or household appliance, having a gesture monitoring unit which is designed to detect non-tactile gestures of a user and an actuating unit which is designed to actuate an associated device, wherein the operating device is designed be either in a locked state in which the actuator unit is not driven, or in an operating state in which the operator device is adapted, in response to the detection of a non-tactile actuation gesture by the gesture monitoring unit, to control the actuator to the associated Device to operate, wherein the operating device is designed to be put into the operating state, when the gesture monitoring unit detects a non-tactile activation gesture, wherein the activation gesture is different from the actuating gesture. Through the combination of activation gesture and actuation gesture it is achieved that an altogether more complex non-tactile gesture is necessary in order to actuate the operating device. Thus, it can be prevented that the operating device is unintentionally actuated by an unconscious execution of an actuation gesture. Only when initially an activation gesture is executed, the operating device changes from the lock state to an operating state and can be operated by means of one or more actuation gestures. In particular, the activation gesture may be a somewhat more complex gesture, while the actuation gesture may be a simple, intuitive and easy-to-remember gesture. In particular, the gesture monitoring unit is designed to recognize only one activation gesture but several actuation gestures. Thus, the user only has to memorize a somewhat more complex activation gesture, while the catalog of various, relatively simple actuation gestures is easy to learn for him. Nevertheless, the probability of unwanted operation is significantly reduced. The gesture monitoring unit is designed to detect activation gestures or actuation gestures within a certain tolerance range.
  • In some embodiments, the operating device for each user is placed in the control station by just one possible activation gesture. This activation gesture can be the same for all users.
  • Furthermore, the operating device can be actuated without contact by the use of non-tactile gestures. This has several advantages for different applications. In contrast to the operation of buttons or a tactile gesture control, i. H. a touch screen, may allow non-tactile gesture control in the vehicle that the driver does not have to take his eyes off the road when he wants to operate while driving the various additional components in a vehicle, such as radio, navigation device, telephone or the glove box. In addition, the operation of the non-tactile gesture control according to the invention requires little driver attention because it does not have to deal with complex user interfaces or seek the correct actuator button on a user interface. Once he has memorized the activation gesture, he can resort to a simple set of actuation gestures, and in particular, it does not matter where exactly the actuation and activation gesture is executed.
  • Furthermore, the use of the operating device according to the invention is also extremely beneficial in the home. In particular, if the user has dirty hands in household work, or has both hands in use, he can still operate household appliances, especially refrigerators, taps, drawers, cabinets, doors and the like, or open and close. Furthermore, the control device according to the invention can be used extremely useful in the bathroom, for example, to operate the water temperature and water flow in the bath or shower, the flushing of the toilet, the operation of a light switch or dimmer, and so on. Further areas of application of the operating device according to the invention can be found, for example, in the garden, or in the control of household appliances in the form of household robots. When both hands of the user are being used, for example because he is about to lift an item into an oven, the activation gestures or gestures of activation may not be finger or arm gestures but, for example, gestures with other body parts, such as the head Leg, or the foot.
  • In contrast to the systems known in the prior art, which additionally require voice input, the operating device according to the invention is advantageous, since it can also be used in situations in which a voice input due to noise, or the desire for rest is not available.
  • The operating device according to the invention can be used in particular for operating units for associated devices, which are not within the immediate reach of the user, whose operation is physically demanding, whose operation can lead to injuries that are exposed to increased hygiene requirements, or must remain sterile, or their operation would lead to contamination of the user.
  • Generally, users want a standardized gesture control. An example of this would be that a thumb-up symbol causes an increase in a parameter, such as an increase in light intensity in a room, or a thumb-down gesture causes a reduction in that parameter. However, these standardized gestures are often too complex, so that unintentional misuse can not be ruled out. Therefore, the use of an activation gesture in combination with the actuation gesture is extremely advantageous.
  • Technically, non-tactile gestures can be detected by various gesture monitoring units, such as, for example, gloves with sensors, depth cameras with lightwave measurement, stereo cameras, cameras in combination with controller elements, and single cameras. Furthermore, a detection of gestures by cameras not only in the visible range, but for example, in the infrared range, so that in particular an operation in a darkened room is possible.
  • In particular, a gesture monitoring unit may comprise a plurality of room sensors, in particular cameras, so that the entire room and all orientations of the user can be detected.
  • The gesture monitoring unit may either be provided in an integrated device, which is the operating device, or be spaced therefrom and connected only by communication means, in particular by cable or radio. An integral design is particularly suitable for mobile operating devices.
  • In some embodiments of the operating device according to the invention, a display unit may also be provided which synchronously reproduces the gestures indicated by the user or shows the user the various gestures. In particular, an avatar of the user or the representation of a hand can be reproduced on such a screen. This allows the user to learn the gesture control more quickly.
  • In the locked state, the operating unit is not controlled by the operating device, d. H. the operating device does not cause actuation of the one or more associated devices by the one or more operating units of the operating device.
  • In one embodiment, the gesture monitoring unit is configured to detect an opening gesture or closing gesture as an actuating gesture, and the actuating unit is configured to open or close the associated device.
  • Advantageously, the associated device is a door, drawer or flap and the actuator unit is adapted to open or close the door, drawer or flap. Such use is particularly useful in household appliances, such as opening and closing a stove, kitchen cupboard, bathroom cabinet, a kitchen drawer, vehicle door, vehicle trunk lid, glove box flap, hood, a gas cap, a vent, a cup holder, or for folding the rear seats. In the bathroom, in particular, toilet lids can be opened or closed, a shower curtain or a shower cubicle can be opened, a drawer can be opened, or windows can be opened. In the kitchen, in particular the refrigerator or the oven can be opened or closed according to the invention.
  • Advantageously, the operating device is designed to return to the blocking state after a predetermined time from the operating state. In order for an accidental operation is subsequently avoided to a desired operation. In particular, the operating device can automatically return to the locked state after just one second from the operating state. In other applications, returning from the operating state to the lock state after one to ten seconds is advantageous. In certain applications, however, the return from the operating state into the blocking state can also take place after at least one minute, especially if usually several subsequent actuation inputs are to be expected by actuation gestures.
  • In some embodiments, the operating device is designed to recognize a blocking gesture in the operating state and to return to the blocking state after the detection of the blocking gesture. Thus, the user can complete the gesture input at a desired time, for example, when he has performed the one or more desired actuation gestures, and the actuator unit has been driven accordingly. The blocking gesture may also be used for operating devices which otherwise return from the operating state to the blocking state after a predetermined time, wherein the blocking gesture leads to an early return from the operating state into the blocking state. The return to the locked state can also be done by recognizing a vocal signal or a tactile actuation. Furthermore, the recognition of a predetermined number, in particular only one, actuation gesture trigger a return to the locked state.
  • In particular, the operating device is designed to signal the user the transition between the blocking state and operating state. The user can either be signaled only the transition from the locked state to the operating state, from the operating state to the blocking state, or both transitions. As a result, the user knows when recognition of the actuation gestures and the consequent activation of the actuation unit is possible. A futile or unwanted operation can thus be prevented. The transition can be signaled in particular by a light signal, vibration signal or by a visual sign, acoustic signal or haptic character, for. B. by an ad on a display.
  • In one embodiment, the gesture monitoring unit is configured to detect a movement comprising at least one change of direction as an activation gesture. Such a complex activation activation gesture can reliably prevent misuse. For example, a movement along a predetermined movement path may represent the activation gesture, in particular a spiral movement or a zigzag movement with the hand. Along with this movement, it may be necessary for a certain hand gesture to still be required by an arrangement of the fingers in a certain configuration for the activation gesture. Also, movements of several body parts, for example a simultaneous movement of the head and a hand, may represent a suitable activation gesture.
  • In one embodiment, the gesture monitoring unit is configured to capture a multi-level gesture that includes multiple sequential single gestures as an activation gesture. Such Multi-level gesture can be in particular a gesture sequence in the form of two individual gestures. The individual gestures can be, for example, different hand or finger positions.
  • In contrast, the gesture monitoring unit may be designed to detect a stationary gesture as an actuation gesture. For the actuation gesture, no increased complexity is necessary as for the activation gesture. Rather, it is advantageous if the actuation gesture can be intuitively learned and reproduced by the user, since in particular a plurality of actuation gestures allow several different functions of actuation units or can drive several different actuation units, whereby learning only one activation gesture is necessary.
  • In an advantageous embodiment, the gesture monitoring unit can be designed to detect a movement of the actuating gesture, and the actuating unit can be designed to actuate the associated device proportionally in dependence on the detected direction of movement and / or movement length. Thus, more complex inputs or operations can be made, for example, the continuous adjustment of a setting. Thus, following a complex activation gesture, a simple actuation gesture may be detected, instructing the operator to save the current position of the gesture, such as the hand. If the gesture is then moved starting from this position, the associated device is actuated depending on the direction and / or the length. For example, the associated device may be a ventilation element, the movement length of the air flow rate or the air velocity correspond, and the direction of movement correspond to the direction in which the air is to be discharged. Furthermore, for example, a water temperature, air temperature, volume, light intensity, etc. can be adjusted via the movement length of an actuation gesture. Alternatively, a proportional actuation of the actuation unit can take place over the duration of an actuation gesture.
  • In one embodiment, a plurality of actuator units are provided, wherein the gesture monitoring unit is configured to detect a direction of the actuation gesture, and the operator apparatus is configured to select one of the actuator units that is actuated according to the actuation gesture, depending on the direction. In particular, the actuating unit can be selected, to which the actuating gesture is directed. The direction of the actuating gesture can be determined in particular by the movement of the actuating gesture. But it is also possible that the actuation gesture as such is a directed gesture, such as pointing a finger at an actuator.
  • In one embodiment, the gesture monitoring unit is configured to capture a body gesture, particularly a finger gesture, arm gesture, foot gesture, leg gesture, head gesture, body gesture, or body combination gesture, as an activation gesture or an action gesture. A body combination gesture is in particular a combination of the aforementioned other body gestures. Furthermore, it is also possible that the gesture monitoring unit is designed as an activation gesture or gesture, facial gestures, d. H. the facial expressions of the user, to capture. In advantageous embodiments, however, only a body gesture, and no facial gesture is detected, since facial gestures are more complicated to detect. For example, a full body gesture is jumping or moving the entire body in a certain direction, a head gesture is, for example, a nod, a face gesture is, for example, a blink, a hand gesture is, for example, a wave, a finger gesture is, for example, to pull the fingers apart or point to something For example, a leg rest is the movement of a leg back and forth, and a foot gesture is, for example, pointing with the foot.
  • Whether rather expansive gestures, d. H. Arm gestures, leg gestures, hand gestures or gestures with a smaller range of motion, d. H. Finger or face gestures to be used depends on both the physical capabilities of the user and the distance to the gesture monitoring unit. Furthermore, it is relevant whether the control takes place in private or public spaces. For example, the entry of sensitive information in public, for example at an ATM, should be more of a finger gesture, for reasons of data security. Furthermore, people feel they are being watched and inhibited when they have to make grand gestures in public to control devices, such as opening a vehicle.
  • Advantageously, the operating device is designed such that it can be put into a learning state in which it is designed to store new activation gestures or actuation gestures in the gesture monitoring unit. In particular, in the learning state, the user can demonstrate gestures for the individual actuation gestures or for the activation gesture in front of the gesture monitoring unit, which are stored in the operating device, and used for future uses.
  • In one embodiment, the operating device has an identification device that is designed to make an identification, wherein a transition from the locked state to the operating state occurs only when a positive identification is made and the activation gesture is detected. In particular, the identification takes place without contact. This can be done for example by biometric identification devices, such as face recognition or by the use of electromagnetic communication, for example by RFID elements or a radio control.
  • Advantageously, the gesture monitoring unit is adapted to maintain a different set of activation gestures and actuation gestures depending on the identity of the user. Thus, the individual needs and possibilities of each user can be taken into account. In particular, the users may respectively place the operating device in a learning state to program their desired set of activation gestures and actuation gestures.
  • In particular, however, only one activation gesture is deposited per user. Only with this activation gesture, the operating device can be placed without contact in the operating state.
  • In the learning state, in particular, it can be checked whether the activation gesture has the recommended complexity, and the user can be made aware of this. In particular, it may be required that the activation gesture comprises a change of direction in its associated movement, or comprises a multi-level movement, or is a multi-level gesture.
  • In one embodiment, the operating device has a plurality of actuating units, wherein the operating device is designed to control none of the actuating units in the locked state. Thus, a misoperation can be prevented.
  • In particular, the actuating unit is a mechanical actuator, for example a servomotor, a pneumatic or hydraulic element, or a linear drive.
  • In other embodiments, the actuator unit may also be an electronic switching element that alters a parameter in an electronic device.
  • The present invention is directed in particular to a household appliance, primarily a refrigerator, a stove top or an oven, with the operating device according to the invention, which is designed to actuate a component of the household appliance, in particular a door, flap or drawer by means of the actuating unit. In particular, a mechanical actuator is used for this purpose.
  • In particular, the household appliance may also be a washing device in the bath, and the component of the household appliance may be a shower curtain, or a shower cubicle that is opened, a device for drawing a towel, or a fitting with which water can be provided at a certain temperature , or a control unit for setting the room temperature. Furthermore, a household appliance may be, for example, a toilet, and the operation of the component may relate to the opening and closing of a toilet lid, to the actuation of a flush or to the advancement of toilet paper. Furthermore, appropriate household appliances cabinets, drawers, windows or ventilation elements in all rooms of the house. Furthermore, the household appliance may be a lighting device, so that the light in the household can be controlled specifically. The household appliance may also be a door between living spaces, a front door, a cupboard or a window that can be opened and closed by the operating unit. But it is also possible that consumer electronics components, such as TVs, computers or video recorders are controlled with the control device according to the invention.
  • The opening of the shower curtain or the shower cubicle can take place by means of an actuating gesture in the form of a wiping movement by hand, the handing of a towel can be done for example by means of the actuating gesture that both hands are moved on the body, turning on water or pressing a flush can be done by waving as actuation gesture, the opening and closing of a toilet lid, or the regulation of a temperature can be done by an actuating gesture in the form of a movement of a hand up and down, the toilet paper feed can be controlled by the actuation gesture of Heranwinkens. The light intensity can be controlled up and down by the operation gesture of moving a hand. Lifting a telephone can be controlled by the actuation gesture of a telephone sign on the ear. The control of aeration can be controlled by the actuation gesture of holding the nose. Windows or cabinets can be opened by moving the hand up and down, or can be opened by moving the palm forward and closing by pulling on the fist. The control of the temperature of a stove can be done by a movement of the hand up and down. Opening a refrigerator can for example, by moving your foot under the refrigerator twice back and forth. Accordingly, an oven can be opened. The operation of a faucet can be done, for example, by the actuating gesture that the foot moves back and forth on the sink twice, or that the hand is moved up and down near the washbasin. A cleaning robot can be actuated, for example, by interpreting the finger with dirt. In addition, the cleaning robot may be called by voice control or by pointing it. Furthermore, for example, an electronic cookbook can be scrolled on a display in the kitchen by means of a swiping motion. These actuation gestures must each be combined with an additional preceding activation gesture.
  • The invention is further directed to a vehicle having an operating device according to the invention, wherein by means of the actuating unit a vehicle component, in particular a door, a window or a vehicle operating element, can be actuated.
  • In particular, a cup holder can be folded out, the air conditioning can be controlled, rear seats are folded, a window can be operated, a glove box can be opened or closed, a door can be opened or closed from the inside, a door can be opened or closed from the outside, the vehicle can be locked to open or close a fuel cap and / or open or close a trunk. In particular, a navigation device, a telephone, an audio system, an Internet display, or an interior light can be actuated on possible vehicle components. A zoom in the navigation device can be actuated by a finger zoom in the air as an actuation gesture, a selection navigation can be done by a jerky Vorschiebebewegung the hand, a change of view in the navigation device can be done by a hand wipe. Answering a telephone call can be done by nodding, a rejection of a telephone call can be made by shaking the head, a redial on the phone can be done by the representation of a circle with the finger, a volume adjustment of the audio system by a movement of the flat hand in vertical Direction of an adjustment of stations or songs can be done by a movement of the flat hand in the horizontal direction, a random playback can be done by moving the hand back and forth, a selection of the music source can be done by a swipe of the hand. In an Internet display, moving the fingers apart in the air may have a zooming effect, scrolling may occur by a jerky movement of the hand, and a selection operation by a manual swipe.
  • The operation of an interior light can be done by a movement of the hand over the head to the rear, unfolding of the cup holder can be done by moving a beverage receptacle to the beverage compartment and there made a reciprocating motion, a folding of the rear seats can by a movement of the hands or a movement of the window can be done by a movement of the hand up and down in the direction of the window opening the glove compartment can by moving with or without object twice with his hand in front of the glove compartment back and forth respectively. The locking of a car can be done by waving, which in particular an additional identification of the user is advantageous, opening the doors can be done by moving the elbow twice in the direction of the door, an opening of the door of the vehicle from the outside by a movement of the Foot under the door done, opening the tank lid can be done by a swipe in front of the tank lid, opening the trunk can be done by a movement of both hands on the trunk back and forth. In particular, the gesture input can be combined with a voice control. These actuation gestures must in turn be combined with a preceding activation gesture.
  • The present invention further relates to a method for operating an operating device, in particular in a vehicle or for a household appliance, by means of non-tactile gestures, wherein, when a gesture monitoring unit detects a non-tactile activation gesture, the operating device is put into an operating state, wherein the operating device is otherwise in a blocking state, wherein in the blocking state no activation of an actuating unit can take place, and wherein in the operating state the actuating unit is activated in response to a non-tactile actuating gesture in order to actuate an associated device.
  • The inventive method can be further developed in particular in other preferred embodiments with all the functions of the aforementioned devices according to the invention and their embodiments.
  • In the following, possible non-tactile actuation gestures are discussed. It should be noted that the actuation gestures are in particular relatively simple, intuitive gestures, as a Improper use of the more complex non-tactile activation gesture can be prevented.
  • As a confirmation gesture for an associated device, for example, the head gesture "nod", the facial gestures "smile" or "blink", or the finger gestures "thumbs up" or "circle of thumb and forefinger" can be used.
  • As negative gesture for an associated device, the head gesture "shaking the head", the facial gesture "mouth corner down", the hand gesture "hand horizontally forward and shake" or the finger gestures "thumb down" or "stretched forefinger back and forth" used become.
  • To turn on an associated device, the head gesture may include "nod," "blink" face gesture, "hand turn," "hand advance," "hand jerk up," or "finger gesture" turning Index finger "can be used.
  • To turn off an associated device, the head gesture "shaking the head", the face gesture "blinking", the hand gestures "turning in the opposite direction", in particular counterclockwise, "pulling back the fist", "hand jerking down", or " Waving ", or the finger gesture" turning the index finger "can be used.
  • To move an associated device upwards, the head gesture may "nod head up," the hand gestures "move flat hand up," "move both flat hands apart," or "flip flat hand up," the finger gesture, "thumb Move up twice "or use the foot-up foot gesture".
  • To move an associated device down, the head gesture "Look Down", the hand gestures "Move Flat Hand Down," "Move Both Flat Hands Toward Each Other," or "Flip Flat Hand Down Short," may include the finger gesture "Thumb Move down twice "or use the" Move foot down "foot gesture.
  • To open an associated device, the body gesture can be "front-to-front shift," head-up head-tilt, face-open face gesture, "hand-up" hand gesture, "both-flat hands Move apart "or" Flip flat hand up ", or use the finger gesture" Open Thumb and Finger ".
  • To close an associated device, the body gesture "simulated collapse," the face gesture "face down," the face gesture "mouth open," the hand gestures "move flat hand down," "move both flat hands toward each other," or " Flip the flat hand down ", or use the finger gesture" fold your thumb and fingers together ".
  • To magnify an ad, you can use the upright body gesture, face-up "eye-opening" gesture, "hand-up" or "hands-off" hand gesture, or "thumb-and-index finger-apart" finger gestures.
  • To reduce the size of an ad, you can use the body gesture "make yourself smaller", the face gesture "eye pinching", the hand gestures "move flat hand down" or "move hands towards each other" or the finger gesture "contract thumb and forefinger".
  • To retrieve an associated device, the body gesture may return "body movement back," the head gesture "upwards," the hand gestures "move the flat hand to the body," or "hand and arm move to the body," or the finger gestures "hand toward the body Collapse "or" index finger to move body "are used.
  • To move away an associated device, the body gesture "body movement forward," the head gesture "head shake," the hand gesture "push flat hand away from the body" or "flat hand push sideways" and the finger gesture "fingers down and away from the body "Or the foot gesture" step away with the foot "can be used.
  • To make an associated device brighter, the head gesture may move "head up right," the hand gesture "move hands over head," or the hand gesture "hold flat hand over eyes," or the finger gesture "fist open."
  • To darken an associated device, the head gesture "head down to the left", the hand gesture "hands over the head to move toward each other" or "flat hand on the eyes hold", or the finger gesture "Faustschließen" can be used.
  • To warmer an associated device, the body gesture "to move the shoulders back and forth," the hand gesture, "by hand to wave your forehead and then point your thumbs upwards, "hugging yourself and then pointing your thumbs up" or "rubbing your hands".
  • To colder an associated device, the hand gestures "Wipe your forehead with your hand, then point your thumb down", "Hug yourself and then point your thumb down" or "Shake hands" can be used.
  • To make an associated device louder, the face gesture "mouth opening", the hand gesture "hand turning clockwise", "holding the flat hand behind the ear", "moving the flat hand up the ear", "making a stroke with the hand Finger or hand painting to the top right "or the finger gesture" index finger and middle finger spread out from the fist to the top ".
  • To lower an associated device, the face gesture "mouth closing", the hand gesture "counterclockwise rotation of the hand", "the flat hand to hold in front of or to the ear", "the flat hand to move down the ear" , "Draw a line with your finger or hand to the lower left" or use the finger gesture "Forefinger and middle finger spread out from the fist down".
  • To move an associated device forward, the head gesture may "move the head up to the right", the hand gestures "wipe by hand from left to right," or "point the hand away from the body with the palm facing down" to swipe the finger gesture "Left to right with your fingers" or "Point right with your thumb" or use the "Stepping up" foot gesture.
  • To move an associated device rearward, the head gesture may "move the head to the bottom left with a twist", the hand gesture "wipe the hand right to left" or "the flat hand to the body with the palm up ", Or the finger gesture" Swipe with your finger from left to right or point your finger to the left ".
  • To adjust an associated device more quickly, the head gesture "turn the head twice to the right", the hand gesture "clockwise movement of the hand in a circle", "push both hands away from the body" or "with flat, vertical hand advancing" or Finger gesture "Using a forefinger to circle a circle clockwise" to be used.
  • To slow down an associated device, the head gesture may move the head "backwards", the hand gestures "move the hand counterclockwise in a circle," "move both hands slowly to the body," or "stretch the palm forward with the fingers pointing upwards." be used.
  • To select an associated device, the head gesture "nod", the face gesture "blink", the hand gesture "grip" or the finger gesture "index finger movement" or "index finger movement forward" can be used.
  • To start an associated device, the same gesture set as used for clicking or selecting can be used.
  • To stop or pause an associated device, the headshake head gesture, the face gesture "closing eyes for one or two seconds," the hand gesture "both hands moving down in front of the abdomen," especially with the edge of the hand first , "Straight hand movement around the neck in the horizontal direction" or "Covering the cheek with the hand", or the finger gesture "Forefinger and middle finger wrung out of the fist".
  • Furthermore, actuation gestures may also be specified that are directed directly to particular associated devices to select those associated devices.
  • In addition, natural movement processes can be imitated for the actuation gestures. An erroneous detection of the actual natural motion process is eliminated because the activation gesture has to be executed beforehand. Thus, with a stove top, a movement such as setting up a pot can turn on the stove, with a radio or TV, a remote control gesture activates the appliance, or with a coffee machine, a hand movement, d. H. a circular hand movement, activate the coffee maker.
  • In particular, the following gestures are used as activation gestures: a repeated zig-zag movement with the hand, a spiral movement with the hand, the juxtaposition of several hand or finger gestures, or a combination of gestures with different body parts, for example the combination of a hand gesture or finger gesture with a foot gesture.
  • The invention will now be described by way of example by way of example.
  • 1 shows a first embodiment of an operating device for an oven according to the invention.
  • 2 shows the first embodiment of the inventive operating device for a baking oven after pressing.
  • 3 shows several household appliances in a kitchen with an embodiment of the control device according to the invention.
  • 4 shows a vehicle with an embodiment of the operating device according to the invention.
  • In 1 is a household appliance, namely an oven 1 , which is provided with an embodiment of the operating device according to the invention, shown. The operating device has a gesture monitoring unit 2 which is designed to detect non-tactile gestures of a user, in the present embodiment by the user only the hand 3 shown. The operating device furthermore has an actuating unit in the form of a mechanical actuator 4 on, which is in particular a servo motor. The mechanical actuator 4 is with the door 5 coupled to the hearth and opens and closes this when it is driven by the operating device accordingly. Usually, the operating device is in a locked state, so that the actuator 4 not to open the door 5 can be controlled. If the user now the door 5 of the oven 1 First, he must first make a non-tactile activation gesture with his hand 3 carry out. In the present case, the activation gesture is represented as a spiraling movement of the hand with the index finger extended in space. Thus, the activation gesture is a combined hand-finger gesture with a predetermined movement of the hand 3 which has to assume a predetermined finger position. The gesture monitoring unit 2 , which is designed in particular in the form of a camera, monitors the movements of the user by means of image processing, and is designed to detect the non-tactile activation gesture. It should be emphasized that the gesture monitoring unit is designed with respect to the recognition of gestures with certain tolerances, so that the activation gesture, even with certain minor deviations can be detected safely. Once the gesture monitoring unit 2 has detected the activation gesture, the operating device enters an operating state which is maintained for a certain predetermined time, for example for 2 to 5 seconds. If during this period, as in 2 shown a non-tactile actuation gesture is detected, which the user with his hand 3 performs, the operating device controls the actuator 4 He then the door 5 opens. In particular, in the present case, the actuation gesture may be handspinning of the thumb. How clear from the comparison of gestures in 1 and 2 can be seen, the activation gesture is a more complex gesture than the activation gesture. Thus it can be achieved that not due to an unconscious movement with your thumb accidentally the door 5 of the oven 1 is opened. The operating device may be designed to be in the form of the actuator after the detection of an actuating gesture and the corresponding actuation of the actuating unit 4 automatically return to the locked state. Thus, an activation gesture must be performed before each actuation gesture. However, in other embodiments, the operating device can also remain independent of it for a certain time in the operating state, and only then return to the locked state, so that several different actuation gestures can be performed sequentially, for example, for opening the door, closing the door, turning on the oven 1 or raising the temperature of the oven 1 ,
  • In 3 is a further exemplary application situation of the operating device according to the invention shown. This is a kitchenette 6 with several household appliances, namely a dishwasher 7 , an oven 8th , a stove top 9 , a fume hood 10 a cupboard 11 with two doors, a sink 12 , a fridge 13 and a robotic vacuum cleaner 14 , The area around the household appliances is monitored by a gesture monitoring unit. When the gesture monitoring unit determines that the user 15 performs a non-tactile activation gesture, such as one of the activation gestures described above, the operator is placed in an operating state. In this operating state, it is possible for the user 15 performs non-tactile actuation gestures, for example pointing to one of the household appliances and then performs an associated action and thus actuates this appliance by means of an actuator unit in communication with the gesture-monitoring unit. In particular, the user can open the respective doors or flaps of household appliances, change the temperature of the oven and the hob, the withdrawal speed of the hood 10 change the flow of water in the sink 12 control and adjust its temperature, or the robotic vacuum cleaner 14 instruct you to take up activity, or to switch to a sleep mode, or the robot vacuum cleaner 14 to instruct to purify at a certain point. Depending on how the area monitored by the operating device is configured, in the operating device according to the invention several gesture monitoring units 2 can be used so that non-tactile activation and actuation gestures can be detected as reliably as possible. In particular, multiple gesture monitoring units can be used, so that regardless of the orientation of the user, the respective gestures can be detected.
  • In 4 Finally, another application situation for the operating device according to the invention is shown. Here is the user 15 outside a vehicle 16 namely an automobile. On the vehicle 16 is a gesture monitoring unit 2 provided that advantageously can detect non-tactile gestures in any position around the vehicle 16 by the user 15 be executed. In the present embodiment, the user is located 15 behind the vehicle 16 , After he has performed a non-tactile activation gesture, is in 4 just showing a non-tactile actuation gesture is shown, the user moves his arm up with his thumb outstretched. This actuation gesture is an opening of the boot lid 17 associated with, for a corresponding actuator 18 is provided. When the operating device is in an operating state as a result of the recognition of the non-tactile activation gesture, the non-tactile actuating gesture causes the operating unit to actuate the device associated therewith, namely the boot lid, in particular unlocking the latter, so that the boot lid becomes jammed due to a spring effect or an actuator opens. The actuator for opening or closing the boot lid 17 can also be part of the operating unit 18 be.
  • Other actuators can be used to operate the tank lid 19 the front door 20 , the rear door 21 , or the respective window 22 . 23 be provided. In the embodiment according to 4 it is particularly advantageous if the operating device further comprises an identification module 24 having. The identification module 24 is in particular in communication with an identification card 25 that the user 15 carries with itself. This communication can be done in particular via radio. The identification card 25 the user advantageously comprises an RFID chip. The operating device is activated only insofar as the gesture monitoring unit 2 can detect an activation gesture when it is detected that a user to be positively identified is in the area of the vehicle. Only after a positive identification is the gesture monitoring unit 2 monitors whether a non-tactile activation gesture can be detected, which then puts the operating device in an operating state. Thus, in the present embodiment, three states of the operation device are possible, namely, an inactivity state with respect to the gesture monitoring unit until a positive identification is made, a lock state until a non-tactile activation gesture is detected, and the operation state after detecting the non-tactile activation gesture.
  • In particular, by the identification device 24 also different users 15 be distinguished from each other, with each user 15 a different set of activation gestures and actuation gestures may be present.
  • Furthermore, the gesture control can also be inside the vehicle 16 be used, for example, to open and close the doors 20 . 21 from inside, the window 22 . 23 , of storage devices and for the operation of the entertainment system.
  • The operating device according to the invention can also be used for other electronic devices, for example for electronic entertainment devices, such as computers, audio equipment, televisions, etc.
  • Furthermore, the operating device can take into account not only the activation gesture and actuating gesture with respect to the activation of the operating unit, but also other factors, such as the position of the user, the current state of the device associated with the operating unit, for example if a door is already open, or if the user holding an object in his hands, or what kind of object the user holds in his hands. In particular, suitable image processing algorithms are to be used in the gesture monitoring unit.
  • The operating device according to the invention has particular advantages in use for people with restricted mobility. According to the movement restriction, a certain set of gestures can be selected from the gesture catalog, which can be carried out easily and comfortably within the scope of the movement restriction.
  • QUOTES INCLUDE IN THE DESCRIPTION
  • This list of the documents listed by the applicant has been generated automatically and is included solely for the better information of the reader. The list is not part of the German patent or utility model application. The DPMA assumes no liability for any errors or omissions.
  • Cited patent literature
    • DE 102010004518 A1 [0004]

Claims (20)

  1. Operating device, in particular for a vehicle ( 16 ) or household appliance ( 1 . 7 . 8th . 9 . 10 . 11 . 12 . 13 . 14 ), with a gesture monitoring unit ( 2 ), which is designed to allow non-tactile gestures of a user ( 15 ) and an operating unit ( 4 . 18 ), which is designed to be an associated device ( 5 . 17 . 19 . 20 . 21 . 22 . 23 ), wherein the operating device is designed to be either in a blocking state in which the actuating unit ( 4 . 18 ) is not driven, or in an operating state in which the operating device is designed, in response to the recognition of a non-tactile actuation gesture by the gesture monitoring unit ( 2 ), the operating unit ( 4 . 18 ) to control the associated device ( 5 . 17 . 19 . 20 . 21 . 22 . 23 ), characterized in that the operating device is designed to be put into the operating state when the gesture monitoring unit ( 2 ) detects a non-tactile activation gesture, wherein the activation gesture differs from the activation gesture.
  2. Operating device according to claim 1, wherein the gesture monitoring unit ( 2 ) is designed to detect an opening gesture or closing gesture as an actuating gesture, and the actuating unit ( 2 ), the associated device ( 5 . 17 . 19 . 20 . 21 . 22 . 23 ) to open or close.
  3. Operating device according to claim 2, wherein the associated device comprises a door ( 5 . 20 . 12 ), Drawer or flap is, and the actuator unit is designed to lock the door ( 5 . 20 . 21 ), Drawer or flap to open or close.
  4. Operating device according to one of the preceding claims, wherein the operating device is designed to return to the blocking state after a predetermined time from the operating state.
  5. Operating device according to one of the preceding claims, wherein the operating device is designed to detect a blocking gesture in the operating state and to return to the blocking state after the detection of the blocking gesture.
  6. Operating device according to one of the preceding claims, wherein the operating device is designed to allow the user ( 15 ) to signal the transition between blocking state and operating state.
  7. Operating device according to one of the preceding claims, wherein the gesture monitoring unit ( 2 ) is designed to detect a movement comprising at least one change of direction as an activation gesture.
  8. Operating device according to one of the preceding claims, wherein the gesture monitoring unit ( 2 ) is designed to capture a multi-level gesture comprising multiple sequential single gestures as an activation gesture.
  9. Operating device according to one of the preceding claims, wherein the gesture monitoring unit ( 2 ) is designed to detect a stationary gesture as an actuating gesture.
  10. Operating device according to one of the preceding claims, wherein the gesture monitoring unit ( 2 ) is adapted to detect a movement of the actuating gesture, and the actuating unit ( 4 . 18 ) is designed, depending on the detected movement direction and / or movement length, the associated device ( 5 . 17 . 19 . 20 . 21 . 22 . 23 ) proportional.
  11. Operating device according to one of the preceding claims, wherein a plurality of actuating units ( 4 . 18 ) and the gesture monitoring unit ( 2 ) is adapted to detect a direction of the actuating gesture, and the operating device is designed, depending on the direction of one of the actuating units ( 4 . 18 ), which is operated according to the operation gesture.
  12. Operating device according to one of the preceding claims, wherein the gesture monitoring unit ( 2 ) is adapted to detect a body gesture, in particular a finger gesture, arm gesture, foot gesture, leg gesture, head gesture, total body gesture or body combination gesture, as an activation gesture or an activation gesture.
  13. Operating device according to one of the preceding claims, wherein the operating device is designed such that it can be put into a learning state in which it is designed to store new activation gestures or gestures in the gesture monitoring unit.
  14. Operating device according to one of the preceding claims, wherein the operating device comprises an identification device ( 24 ), which is designed to provide an identification of the user ( 15 ), and a transition from the lock state to the operation state is made only when a positive identification is made and the activation gesture is recognized.
  15. Operating device according to claim 14, wherein the gesture monitoring unit ( 2 ), depending on the identity of the user ( 15 ) to hold a different set of activation gestures and action gestures.
  16. Operating device according to one of the preceding claims, wherein the operating device comprises a plurality of actuating units ( 4 . 18 ), wherein the operating device is designed, in the locked state, none of the actuating units ( 4 . 18 ) head for.
  17. Operating device according to one of the preceding claims, wherein the actuating unit ( 2 . 28 ) is a mechanical actuator.
  18. Operating device according to one of claims 1 to 15, wherein the actuating unit is an electronic switching element.
  19. Household appliance ( 1 . 7 . 8th . 9 . 10 . 11 . 12 . 13 . 14 ), in particular refrigerator ( 13 ), Oven ( 1 ) or hotplate ( 9 ), with the operating device according to one of the preceding claims, which is designed by means of the actuating unit ( 4 ) a component of the household appliance, in particular a door ( 5 ) or drawer to operate.
  20. Vehicle with an operating device according to one of claims 1 to 18, which is designed by means of the actuating unit ( 4 ) a vehicle component, in particular a door ( 20 . 21 ), a window ( 22 . 23 ) or a vehicle control element to operate.
DE202012005255U 2012-05-29 2012-05-29 Operating device with a gesture monitoring unit Expired - Lifetime DE202012005255U1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
DE202012005255U DE202012005255U1 (en) 2012-05-29 2012-05-29 Operating device with a gesture monitoring unit

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
DE202012005255U DE202012005255U1 (en) 2012-05-29 2012-05-29 Operating device with a gesture monitoring unit
DE102013009168A DE102013009168A1 (en) 2012-05-29 2013-05-29 Operating device with a gesture monitoring unit

Publications (1)

Publication Number Publication Date
DE202012005255U1 true DE202012005255U1 (en) 2012-06-26

Family

ID=46580022

Family Applications (2)

Application Number Title Priority Date Filing Date
DE202012005255U Expired - Lifetime DE202012005255U1 (en) 2012-05-29 2012-05-29 Operating device with a gesture monitoring unit
DE102013009168A Withdrawn DE102013009168A1 (en) 2012-05-29 2013-05-29 Operating device with a gesture monitoring unit

Family Applications After (1)

Application Number Title Priority Date Filing Date
DE102013009168A Withdrawn DE102013009168A1 (en) 2012-05-29 2013-05-29 Operating device with a gesture monitoring unit

Country Status (1)

Country Link
DE (2) DE202012005255U1 (en)

Cited By (35)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102012216936A1 (en) * 2012-09-20 2013-10-17 E.G.O. Elektro-Gerätebau GmbH Method for operating electric cooking appliance e.g. hob, involves performing selection of function unit by selection hand gesture in linear movement to function unit, and adjustment of power of function unit by circular motion of hand
CN103438658A (en) * 2013-08-15 2013-12-11 四川长虹电器股份有限公司 Intelligent refrigerator gesture control system
DE102012013503A1 (en) * 2012-07-06 2014-01-09 Audi Ag Method and control system for operating a motor vehicle
DE202013101825U1 (en) * 2013-04-26 2014-07-29 Zumtobel Lighting Gmbh HMI device for the control of lights, blinds and / or air conditioners
DE102013003064A1 (en) * 2013-02-22 2014-08-28 Audi Ag Method for operating smart glazing of motor vehicle i.e. passenger car, involves detecting predeterminable gesture of occupant with respect to window pane by utilizing detecting unit and holding fingers of hand of occupant
DE102013010018B3 (en) * 2013-06-14 2014-12-04 Volkswagen Ag Motor vehicle with a compartment for storing an object and method for operating a motor vehicle
US20150019017A1 (en) * 2013-07-12 2015-01-15 Whirlpool Corporation Home appliance and method of operating a home appliance
DE102013012466A1 (en) * 2013-07-26 2015-01-29 Audi Ag Operating system and method for operating a vehicle-side device
WO2015010790A1 (en) * 2013-07-24 2015-01-29 Giesecke & Devrient Gmbh Method and device for processing value documents
EP2827225A3 (en) * 2013-07-18 2015-04-08 Immersion Corporation System and method for activating a hidden control
WO2015062751A1 (en) * 2013-10-28 2015-05-07 Johnson Controls Gmbh Method for operating a device for the contactless detection of objects and/or persons and their gestures and/or of control operations in a vehicle interior
WO2015067513A1 (en) * 2013-11-08 2015-05-14 Brose Fahrzeugteile Gmbh & Co. Kommanditgesellschaft, Hallstadt Vehicle having an actuating apparatus for a vehicle door, actuating apparatus and use of an actuating apparatus
DE102013019335A1 (en) * 2013-11-20 2015-05-21 Expresso Deutschland Gmbh Operator controllable truck
DE102014000573A1 (en) 2013-12-19 2015-06-25 Diehl Ako Stiftung & Co. Kg Operating device for an electronic device
WO2015121173A1 (en) * 2014-02-17 2015-08-20 Volkswagen Aktiengesellschaft User interface and method for switching from a first operating mode of a user interface to a 3d gesture mode
EP2921936A1 (en) * 2014-03-22 2015-09-23 Monster & Devices Sp. z o.o. Method and apparatus for gesture control of a device
DE102014004675A1 (en) 2014-03-31 2015-10-01 Audi Ag Gesture evaluation system, gesture evaluation method and vehicle
EP2939885A1 (en) * 2013-01-29 2015-11-04 Yazaki Corporation Electronic control device
AT14570U1 (en) * 2014-11-28 2016-01-15 Zumtobel Lighting Gmbh Operating device for generating control information for the control of consumers
DE102015013777A1 (en) 2015-10-24 2016-04-21 Daimler Ag Method for operating at least one actuatable by means of at least one actuator unit by means of a gesture control
WO2016120251A1 (en) 2015-01-30 2016-08-04 Robert Bosch Gmbh Method for operating an input device, input device
DE102015001473A1 (en) * 2015-02-06 2016-08-11 Audi Ag Operating speed-dependent vehicle operation
DE102015115572A1 (en) 2015-09-16 2017-03-16 Miele & Cie. Kg Method and device for operating a household appliance, household appliance and system for operating at least one household appliance
WO2018007247A1 (en) * 2016-07-05 2018-01-11 Siemens Aktiengesellschaft Method for an interaction between an operator and a technical object
DE102013013226B4 (en) 2013-08-08 2018-04-26 Audi Ag Motor vehicle with a detection of an exit intention
DE102016224260A1 (en) * 2016-12-06 2018-06-07 Bayerische Motoren Werke Aktiengesellschaft User interface, means of locomotion and method for entering information into a means of transportation
DE102013001386B4 (en) 2013-01-26 2018-12-06 Audi Ag Operating device for a motor vehicle and method for operating such an operating device
DE102017211462A1 (en) * 2017-07-05 2019-01-10 Bayerische Motoren Werke Aktiengesellschaft Method for supporting a user of a means of locomotion, driver assistance system and means of transportation
DE102017216622B3 (en) 2017-09-20 2019-01-24 BSH Hausgeräte GmbH Home appliance with a sensor
DE102017213551A1 (en) * 2017-08-04 2019-02-07 Audi Ag Use of an animatronic head for test automation of camera-based head trackers
WO2019037961A1 (en) * 2017-08-21 2019-02-28 BSH Hausgeräte GmbH Method for controlling at least one function of a domestic appliance and control device
DE102012025320B4 (en) 2012-12-22 2019-04-04 Audi Ag Method for controlling an electrical device by detecting and evaluating a non-contact manual operation input of a hand of an operator as well as suitable control device and vehicle
DE102018200726A1 (en) * 2018-01-17 2019-07-18 BSH Hausgeräte GmbH Cleaning robot and method for controlling a cleaning robot
US10444831B2 (en) 2015-12-07 2019-10-15 Eyeware Tech Sa User-input apparatus, method and program for user-input
DE102018211908A1 (en) 2018-07-17 2020-01-23 Audi Ag Method for capturing a digital image of an environment of a motor vehicle and motor vehicle with an image capturing device

Families Citing this family (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP6373653B2 (en) * 2013-06-25 2018-08-15 東芝ライフスタイル株式会社 refrigerator
DE102014202441A1 (en) 2014-02-11 2015-08-13 BSH Hausgeräte GmbH Home appliance with specific gesture recognition and method for contactless opening a door of the household appliance
DE102014007172A1 (en) * 2014-05-15 2015-11-19 Diehl Ako Stiftung & Co. Kg Device for operating an electronic device
DE102014007173A1 (en) * 2014-05-15 2015-11-19 Diehl Ako Stiftung & Co. Kg Device for operating an electronic device
DE102014011771A1 (en) 2014-08-08 2016-02-11 Diehl Ako Stiftung & Co. Kg Operating device for an electronic household appliance
DE102014012629A1 (en) 2014-08-22 2016-02-25 Diehl Ako Stiftung & Co. Kg Operating device and mobile operating device, in particular for an electronic household appliance
DE102014017833A1 (en) 2014-12-03 2016-06-09 Diehl Ako Stiftung & Co. Kg Hood
DE102015103690A1 (en) * 2015-03-13 2016-09-29 Rational Aktiengesellschaft Method for detecting the direction of movement of an object in the region of a cooking chamber opening
DE102015017191A1 (en) 2015-07-28 2017-03-23 Diehl Ako Stiftung & Co. Kg Device and method for operating an electronic device
DE102015009805A1 (en) 2015-07-28 2017-02-02 Diehl Ako Stiftung & Co. Kg Device and method for operating an electronic device
DE102015009806B4 (en) 2015-07-28 2017-05-24 Diehl Ako Stiftung & Co. Kg Device and method for operating an electronic device
DE102017201312A1 (en) 2017-01-27 2018-08-02 Audi Ag Method for controlling a temperature control element of a container holder
DE102017111356A1 (en) 2017-05-24 2018-11-29 Miele & Cie. Kg Method and device for controlling a cooktop, hob with a device and hob and / or cooking container with a sensor device
DE102017126798A1 (en) * 2017-11-15 2019-05-16 Miele & Cie. Kg Self-propelled floor care device

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102010004518A1 (en) 2009-01-16 2010-09-16 GM Global Technology Operations, Inc., Detroit Vehicle mode activation by gesture recognition

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102010004518A1 (en) 2009-01-16 2010-09-16 GM Global Technology Operations, Inc., Detroit Vehicle mode activation by gesture recognition

Cited By (50)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102012013503A1 (en) * 2012-07-06 2014-01-09 Audi Ag Method and control system for operating a motor vehicle
DE102012013503B4 (en) * 2012-07-06 2014-10-09 Audi Ag Method and control system for operating a motor vehicle
US9493169B2 (en) 2012-07-06 2016-11-15 Audi Ag Method and control system for operating a motor vehicle
DE102012216936A1 (en) * 2012-09-20 2013-10-17 E.G.O. Elektro-Gerätebau GmbH Method for operating electric cooking appliance e.g. hob, involves performing selection of function unit by selection hand gesture in linear movement to function unit, and adjustment of power of function unit by circular motion of hand
DE102012025320B4 (en) 2012-12-22 2019-04-04 Audi Ag Method for controlling an electrical device by detecting and evaluating a non-contact manual operation input of a hand of an operator as well as suitable control device and vehicle
DE102013001386B4 (en) 2013-01-26 2018-12-06 Audi Ag Operating device for a motor vehicle and method for operating such an operating device
EP2939885A1 (en) * 2013-01-29 2015-11-04 Yazaki Corporation Electronic control device
EP2939885A4 (en) * 2013-01-29 2017-04-05 Yazaki Corporation Electronic control device
DE102013003064A1 (en) * 2013-02-22 2014-08-28 Audi Ag Method for operating smart glazing of motor vehicle i.e. passenger car, involves detecting predeterminable gesture of occupant with respect to window pane by utilizing detecting unit and holding fingers of hand of occupant
DE202013101825U1 (en) * 2013-04-26 2014-07-29 Zumtobel Lighting Gmbh HMI device for the control of lights, blinds and / or air conditioners
DE102013010018B3 (en) * 2013-06-14 2014-12-04 Volkswagen Ag Motor vehicle with a compartment for storing an object and method for operating a motor vehicle
US20150019017A1 (en) * 2013-07-12 2015-01-15 Whirlpool Corporation Home appliance and method of operating a home appliance
US10359857B2 (en) 2013-07-18 2019-07-23 Immersion Corporation Usable hidden controls with haptic feedback
EP2827225A3 (en) * 2013-07-18 2015-04-08 Immersion Corporation System and method for activating a hidden control
WO2015010790A1 (en) * 2013-07-24 2015-01-29 Giesecke & Devrient Gmbh Method and device for processing value documents
US9870501B2 (en) 2013-07-24 2018-01-16 Giesecke+Devrient Currency Technology Gmbh Method and apparatus for processing value documents
CN105378600A (en) * 2013-07-24 2016-03-02 德国捷德有限公司 Method and device for processing value documents
RU2667375C2 (en) * 2013-07-24 2018-09-19 Гизеке+Девриент Каренси Текнолоджи Гмбх Method and device for processing value documents
CN105378600B (en) * 2013-07-24 2019-04-16 捷德货币技术有限责任公司 Method and apparatus for valuable document processing
DE102013012466B4 (en) * 2013-07-26 2019-11-07 Audi Ag Operating system and method for operating a vehicle-side device
DE102013012466A1 (en) * 2013-07-26 2015-01-29 Audi Ag Operating system and method for operating a vehicle-side device
DE102013013226B4 (en) 2013-08-08 2018-04-26 Audi Ag Motor vehicle with a detection of an exit intention
CN103438658A (en) * 2013-08-15 2013-12-11 四川长虹电器股份有限公司 Intelligent refrigerator gesture control system
WO2015062751A1 (en) * 2013-10-28 2015-05-07 Johnson Controls Gmbh Method for operating a device for the contactless detection of objects and/or persons and their gestures and/or of control operations in a vehicle interior
WO2015067513A1 (en) * 2013-11-08 2015-05-14 Brose Fahrzeugteile Gmbh & Co. Kommanditgesellschaft, Hallstadt Vehicle having an actuating apparatus for a vehicle door, actuating apparatus and use of an actuating apparatus
US9982473B2 (en) 2013-11-08 2018-05-29 Brose Fahrzeugteile Gmbh & Co. Kommanditgesellschaft, Hallstadt Vehicle having an actuating apparatus for a vehicle door, actuating apparatus and use of an actuating apparatus
DE102013019335A1 (en) * 2013-11-20 2015-05-21 Expresso Deutschland Gmbh Operator controllable truck
DE102014000573A1 (en) 2013-12-19 2015-06-25 Diehl Ako Stiftung & Co. Kg Operating device for an electronic device
CN106030462A (en) * 2014-02-17 2016-10-12 大众汽车有限公司 User interface and method for switching from a first operating mode of a user interface to a 3D gesture mode
WO2015121173A1 (en) * 2014-02-17 2015-08-20 Volkswagen Aktiengesellschaft User interface and method for switching from a first operating mode of a user interface to a 3d gesture mode
EP2921936A1 (en) * 2014-03-22 2015-09-23 Monster & Devices Sp. z o.o. Method and apparatus for gesture control of a device
DE102014004675A1 (en) 2014-03-31 2015-10-01 Audi Ag Gesture evaluation system, gesture evaluation method and vehicle
US9874939B2 (en) 2014-03-31 2018-01-23 Audi Ag Using a gesture to evaluate displayed information and initiate an operation of a vehicle system
WO2015149914A1 (en) 2014-03-31 2015-10-08 Audi Ag Gesture evaluation system, method for evaluating gestures, and vehicle
AT14570U1 (en) * 2014-11-28 2016-01-15 Zumtobel Lighting Gmbh Operating device for generating control information for the control of consumers
DE102015201613A1 (en) 2015-01-30 2016-08-04 Robert Bosch Gmbh Method and device for operating an input device, input device
WO2016120251A1 (en) 2015-01-30 2016-08-04 Robert Bosch Gmbh Method for operating an input device, input device
DE102015001473A1 (en) * 2015-02-06 2016-08-11 Audi Ag Operating speed-dependent vehicle operation
DE102015115572A1 (en) 2015-09-16 2017-03-16 Miele & Cie. Kg Method and device for operating a household appliance, household appliance and system for operating at least one household appliance
DE102015013777A1 (en) 2015-10-24 2016-04-21 Daimler Ag Method for operating at least one actuatable by means of at least one actuator unit by means of a gesture control
US10444831B2 (en) 2015-12-07 2019-10-15 Eyeware Tech Sa User-input apparatus, method and program for user-input
WO2018007247A1 (en) * 2016-07-05 2018-01-11 Siemens Aktiengesellschaft Method for an interaction between an operator and a technical object
DE102016224260A1 (en) * 2016-12-06 2018-06-07 Bayerische Motoren Werke Aktiengesellschaft User interface, means of locomotion and method for entering information into a means of transportation
DE102017211462A1 (en) * 2017-07-05 2019-01-10 Bayerische Motoren Werke Aktiengesellschaft Method for supporting a user of a means of locomotion, driver assistance system and means of transportation
DE102017213551A1 (en) * 2017-08-04 2019-02-07 Audi Ag Use of an animatronic head for test automation of camera-based head trackers
WO2019037961A1 (en) * 2017-08-21 2019-02-28 BSH Hausgeräte GmbH Method for controlling at least one function of a domestic appliance and control device
DE102017216622B3 (en) 2017-09-20 2019-01-24 BSH Hausgeräte GmbH Home appliance with a sensor
WO2019057509A1 (en) * 2017-09-20 2019-03-28 BSH Hausgeräte GmbH Domestic appliance having a sensor
DE102018200726A1 (en) * 2018-01-17 2019-07-18 BSH Hausgeräte GmbH Cleaning robot and method for controlling a cleaning robot
DE102018211908A1 (en) 2018-07-17 2020-01-23 Audi Ag Method for capturing a digital image of an environment of a motor vehicle and motor vehicle with an image capturing device

Also Published As

Publication number Publication date
DE102013009168A1 (en) 2013-12-05

Similar Documents

Publication Publication Date Title
EP1477351B1 (en) Vehicle roof equipped with an operating device for electrical vehicle components
US9111076B2 (en) Mobile terminal and control method thereof
EP2153305B1 (en) Touchpad-enabled remote controller and user interaction methods
US9619020B2 (en) Delay warp gaze interaction
EP1998996B1 (en) Interactive operating device and method for operating the interactive operating device
US8552983B2 (en) Intelligent robotic interface input device
US20120194324A1 (en) Direction and holding-style invariant, symmetric design, and touch- and button-based remote user interaction device
EP2451672B1 (en) Method and device for providing a user interface in a vehicle
US20100188349A1 (en) Control panels for onboard instruments
KR101795837B1 (en) Remote control interface providing head-up operation and visual feedback
CN104246661B (en) Interacted using gesture with device
US10124648B2 (en) Vehicle operating system using motion capture
US20140237432A1 (en) Gesture-based user-interface with user-feedback
JP5261554B2 (en) Human-machine interface for vehicles based on fingertip pointing and gestures
US20070124694A1 (en) Gesture to define location, size, and/or content of content window on a display
KR20150028177A (en) control device and method for controlling the same
US8065624B2 (en) Virtual keypad systems and methods
US20160253044A1 (en) Systems, devices, and methods for touch-free typing
US20130204457A1 (en) Interacting with vehicle controls through gesture recognition
TWI411935B (en) System and method for generating control instruction by identifying user posture captured by image pickup device
JP2012234549A (en) Operating device of automated machine for handling, assembling or machining workpieces
US20110058107A1 (en) Remote Control and Gesture-Based Input Device
US20160170494A1 (en) Method and device for remote control of a function of a vehicle
CN104691449A (en) Vehicle control apparatus and method thereof
US20140145941A1 (en) Computer vision gesture based control of a device

Legal Events

Date Code Title Description
R207 Utility model specification

Effective date: 20120816

R163 Identified publications notified
R163 Identified publications notified

Effective date: 20130426

R082 Change of representative

Representative=s name: GRUENECKER PATENT- UND RECHTSANWAELTE PARTG MB, DE

R082 Change of representative

Representative=s name: GRUENECKER PATENT- UND RECHTSANWAELTE PARTG MB, DE

Effective date: 20150331

R081 Change of applicant/patentee

Owner name: YOUSE GMBH, DE

Free format text: FORMER OWNER: YOUSE GMBH, 81671 MUENCHEN, DE

Effective date: 20150331

R150 Term of protection extended to 6 years
R157 Lapse of ip right after 6 years