DE102015205950A1 - Apparatus, method and computer program for detecting acoustic control instructions - Google Patents

Abstract

Embodiments relate to a device, a method and a computer program for generating acoustic signals outside the audible range of the user by a movable element, e.g. a button. The acoustic signal propagates by structure-borne noise and / or airborne sound and is received by receiving means, e.g. one or more microphones. An evaluation according to transit time and / or signal characteristic allows the determination of the element, e.g. the pressed button.

Description

Embodiments of the present disclosure generally relate to the detection of control instructions by operators, and more particularly to the detection of such control instructions for operating motor vehicles and their internals.

Control instructions in the automotive environment are often given by operation of buttons. Fields with keys are often installed with individually executed standard contacts such as snap-springs, rocker switches or buttons. Furthermore, there are e.g. In the area of the keyboards, key matrices, whereby each key can trigger a signal at a crossing point of the row and column electrodes. There are also solutions with capacitive buttons where both touching and pressing a button can be detected separately. But here, too, an electrical connection is required for each key.

DE 603 16 259 T2 teaches a touchpad to navigate on a graphical user interface. More particularly, this document relates to an acoustic touchpad and method for processing acoustic signals resulting from touch events to determine the location of a touch event.

WO 2011/138071 A1 proposes a device for generating input signals with an input component, wherein the input component comprises a microphone, which is configured to generate the input signals in response to a rubbing movement and / or a jog movement.

DE 11 2006 001 225 T5 teaches an apparatus comprising: a sensor system including a sound sensor and a reference sensor; and a signal processing system (SPS) coupled to the sensor system, the SPS detecting a user tapping a surface by comparing signals from the sound sensor and the reference sensor.

A disadvantage of the general state of the art is that each of these keys must be individually connected to the control units, which initially has a high cost of lines result. This is synonymous with increased costs and heavier vehicle weight. Since there are different combinations of buttons in different vehicle variants, the connected wiring harness can also vary. This leads to a large number of variants, which lead to additional expense and corresponding costs in the logistics of production, repairs and provision in the warehouse (thus even years after the end of production of the vehicle). Furthermore, it is disadvantageous in the cited prior art that the input to keys or by rubbing or tapping on installations in the vehicle can cause unpleasant noises for the vehicle occupants.

Therefore, it would be desirable to reduce the variety and high variance of automotive control components.

This is supported by devices and methods each with the features of the independent claims. Advantageous embodiments and further developments are the subject of the dependent claims.

According to a first aspect, embodiments provide a recognition device in which operator-controlled input means are operated with at least one element, wherein the element generates an acoustic signal, also referred to as sounds, outside the audible range of the operator during its movement. The detection device further comprises receiving means for receiving and converting the acoustic signal and assigning means for associating the converted acoustic signal to the associated movable element.

Optionally, the receiving means may be designed as a microphone or as microphones. These are not classic microphones, e.g. Membrane microphones limited, but can also be designed as structure-borne sound or airborne sound sensors. This can also include embodiments as piezo elements or as strain gauges which generate sufficient signals in the frequency ranges of the acoustic signals. Thus, inexpensive components can be used as a receiving means.

In some embodiments, the acoustic signals may be placed in the ultrasound range (16 KHz to about 1 GHz), which in one embodiment may optionally be used above the human hearing threshold of 20,000 Hz. Due to the proliferation of ultrasound applications can thus be used advantageously on a variety of existing products, for example, on the above-mentioned inexpensive receiving means. Furthermore, the acoustic signal can be composed differently. So single tones are conceivable, but also multiple tones and tone sequences. In addition, mixed forms of these types of signals are conceivable as long as they can be sufficiently distinguished from each other with the microphones used. Accordingly, a multiplicity of distinguishable acoustic signals can be generated, which can also take account of the respective sound propagation paths and their specific attenuation.

In some embodiments, there may be various types of tone generation. For example, e.g. the sound generation by flow acoustics possible. For this purpose, the button generates an air flow when actuated, which is swirled on a sharp edge and thus - as with a whistle - generates a sound. Advantageous here are few components for the key, since a pipe element is e.g. can be molded with the button body.

Optionally, the tone generation can be done even with a small key stroke of, for example, 2 to 5 mm, with a large key area of eg 5 cm ² ensuring sufficient air volume for this case. Small key stroke is perceived as comfortable for the operator and is often advantageous for a desired low depth of the keys.

In some embodiments, the pipe member may also be arranged transversely to the pressing direction of the key. Also, this is advantageous to achieve a reduced depth of the key. The whistle can also be designed as a Galton whistle, which is particularly far into the ultrasonic range and in a very small design executable.

In addition, the tone generation can optionally also be purely mechanical. In this case, the key advantageously does not have to be listed as being approximately airtight in order to guide the required volume of air through the pipe element when actuated. Rather, an open design is sufficient.

Further, in some embodiments, the mechanical tone generation may be by excitation of sound elements that may be coupled to or disposed within buttons. This excitation may e.g. by snap-springs, colloquially called also Knackfrosch, done by an impulse to the sound element. The advantage here is the undamped swinging movement of the Klegrenzements because the snap spring quickly removed from the sound element. Furthermore, the sound generation can also be done by scribing sound tiles. Such sound tiles may be formed of metal and / or plastic. Moreover, they can be arranged in the key body, wherein the plastic platelets can be inexpensively generated equal to the key base, e.g. in an injection process. Metal flakes can advantageously produce larger amplitudes compared to the plastic flakes and also cover other frequencies. The tearing of the sound elements can be advantageously made by appropriate Anformung to the key guide, which is de facto without additional effort in the production possible.

Further optionally, the assignment of the acoustic signals to the associated elements, for example to the keys, by distinguishable tones possible, which can also be configured as single tones, multiple tones or tone sequences. Also mixed forms of these keys can occur. Advantageously, the propagation conditions of the acoustic signals are less essential here and only one microphone is required in embodiments.

Optionally, alternatively or in addition to the different tones, transit time measurements of the tones for determining the associated key are also possible. In this case, the deviating transit times can be detected by spatially separated microphones. Furthermore, it is also possible to dispense with the ability to discriminate between the tones themselves, so that advantageously a further standardization of the key body can be achieved.

In some embodiments, a method for detecting moving input elements may also be used. In this case, an input means with at least one movable part, e.g. designed as a key top, operated by the operator. When actuated, the element generates an acoustic signal outside the hearing range of the operator. This acoustic signal or noise or sound is received, e.g. through a microphone, and converted, e.g. in an electrical signal. Further, the converted signal is assigned to the associated movable element. Thus, advantages can be obtained as performed to the recognizer.

Optionally, the localization of the acoustic signals can be carried out by microphones whose number corresponds at least to the dimensionality of the basic geometry of the arrangement of the movable elements +1. The time of arrival of the acoustic signals at the microphones ( 4 ), from which then the position of the input element can be determined. For example, if the movable elements are arranged in a line with the dimensionality 1, at least 1 + 1 = 2 microphones are required. For example, if the movable elements are arranged on a surface having the dimensionality 2, at least 2 + 1 = 3 microphones are required. The advantage here is the minimization of the required microphones as a function of the dimensionality of the arrangement of the input elements.

In some embodiments, the determination of the tones, in particular the mutually different tones, may be performed by a bank of matched filters. In this case, each filter of the filter bank can be assigned to a single tone. If the filter response exceeds a threshold, the movable element is detected. Advantageously, standard functions can be used in the implementation of the function in hardware and / or software.

Optionally, the position and / or the number of movable elements can be determined by the operator. For this purpose, after the arrangement of the elements to go through an exercise program in which the detection device learns the arrangement. Advantageously, such an individualization can e.g. a keypad are made without any effect for variants or storage.

In some embodiments, a computer program for performing at least one step of the above method is possible when the computer program runs on a programmable hardware component. The advantage here is the easier changeability compared to hardware implementations.

In some embodiments, a device for generating input signals may be formed with an input component, wherein the input component comprises at least one microphone, wherein the microphone is configured to generate an input signal in response to an acoustic signal. This advantageously makes it possible to use a plurality of surfaces with a plurality of signals for generating input signals, in particular without special input means, e.g. Keys.

Further optionally, the arbitrary acoustic signal may be caused by a scratching motion with the fingernail of an operator on a surface in the interior of a motor vehicle or by rubbing with the finger of an operator on the window glass of a motor-driven disk of a motor vehicle. Advantageously, thereby actions can be triggered by the user at the location of the desired change, e.g. Open or close the car window.

Further optionally, the described devices and methods can be arranged or carried out in a motor vehicle.

In embodiments, a system of combining the embodiments with operator movable input means and the embodiments by scratching and / or grinding movements with the fingernail of the operator or by rubbing with the finger of an operator on the window glass of a motorized movable disc of a motor vehicle arise , Optionally, such systems can be arranged in motor vehicles to operate equipment and vehicle components. Such systems advantageously allow the user to memorize the large number of functions to be operated in a motor vehicle by different operating principles.

Some exemplary embodiments are explained below with reference to the accompanying figures.

1 shows a recognition device for detecting the movement and assignment of movable elements, in which acoustic signals are generated, received, converted and assigned;

2 shows the section through a key with sound generation based on the flow acoustics;

3 shows the section through a key with mechanical tone generation according to a first embodiment;

4 shows the section through a key with mechanical tone generation according to a second embodiment;

5 shows the top view of a key according to another embodiment;

6 shows the assignment of tones to input means according to a further embodiment;

7 schematically shows the method for detecting movable input means;

8th shows a filter bank for the classification of sounds; and

9 shows a device for input of input signals according to another embodiment.

Various embodiments will now be described in more detail with reference to the accompanying drawings, in which some embodiments are illustrated. In the figures, the thickness dimensions of lines, layers and / or regions may be exaggerated for the sake of clarity.

In the following description of the attached figures, which show only some exemplary embodiments, like reference characters may designate the same or similar components. Further, summary reference numerals may be used for components and objects that occur multiple times in one embodiment or in a drawing but are described together in terms of one or more features. Components or objects which are described by the same or by the same reference numerals may be the same, but possibly also different, in terms of individual, several or all features, for example their dimensions, unless otherwise explicitly or implicitly stated in the description.

Although embodiments may be modified and changed in various ways, exemplary embodiments are illustrated in the figures as examples and will be described in detail herein. It should be understood, however, that it is not intended to limit embodiments to the particular forms disclosed, but that embodiments should cover all functional and / or structural modifications, equivalents, and alternatives. Like reference numerals designate like or similar elements throughout the description of the figures.

Note that an element referred to as being "connected" or "coupled" to another element may be directly connected or coupled to the other element, or intervening elements may be present. Conversely, when an element is referred to as being "directly connected" or "directly coupled" to another element, there are no intervening elements. Other terms used to describe the relationship between elements should be interpreted in a similar manner (e.g., "between" versus "directly in between," "adjacent" versus "directly adjacent," etc.).

The terminology used herein is for the purpose of describing particular embodiments only and is not intended to limit the embodiments. As used herein, the singular forms "a," "a," "an," and "the" are also meant to include the plural forms unless the context clearly indicates otherwise. Furthermore, it should be understood that the terms such as e.g. "Including," "including," "having," and / or "having," as used herein, indicates the presence of said features, integers, steps, operations, elements, and / or components, but the presence or addition of a resp one or more features, integers, steps, operations, elements, components, and / or groups thereof.

Unless defined otherwise, all terms (including technical and scientific terms) used herein have the same meaning as commonly assigned to one of ordinary skill in the art to which the embodiments pertain. Further, it should be understood that terms, e.g. those that are defined in commonly used dictionaries are to be interpreted as having the meaning consistent with their meaning in the context of the relevant art, and not to be interpreted in an idealized or overly formal sense, unless this is so is explicitly defined.

1 shows a recognition device 1 for detecting key presses. Here is a keypad 2 shown for operation in which a single keys 3 are held. The keypad 2 can be designed as a compact keypad, in which also a plurality of keys can be immediately adjacent (not shown). However, it may also include keys that are far from each other (not shown) For example, can be arranged in the left and right spoke of a steering wheel or a mixed form of adjacent and / or farther apart keys. Ultimately, an entire vehicle interior can be used as a keypad 2 be understood.

When the button is pressed 3 will be an acoustic signal 6 generated, which propagates from the key as a signal source. The acoustic signal is located in the ultrasound range to avoid irritation of the operator and the rest of the vehicle occupants. This acoustic signal propagates through the air or through structure-borne sound or through both media. It comes from at least one microphone 4 recorded and converted into an electrical signal in a known manner. Subsequently, the electrical signal in an assignment circuit 5 evaluated with the aim of identifying the actuated key. This identification is then continued for further processing, for example for the operation of a device that may be installed in a motor vehicle or even an element of the motor vehicle, such as the turn signal. In an embodiment which is not shown, it is also possible to use a plurality of microphones which are spaced apart from one another, for example 4 be arranged to improve the key recognition 3 ,

To generate the acoustic signal is dispensed according to some embodiments on the use of electricity. Instead, in one embodiment, the sounds are generated based on the flow acoustics, as in FIG 2 shown. Here the key generates 7 when operated with the help of the largely airtight keyboard lower body 8th an air flow at an outlet opening of the key lower body 8th that is on a sharp edge 9 is swirled and thus represents a whistle, with which a sound is produced. In this case, different sizes of the pipe allow different pitches, for example by changing the distance of the sharp edge to the air outlet hole. The height of the button can be limited by a larger button surface, so that a required volume of air is available on actuation. In addition, the whistle in the ultrasonic range, for example, be designed as a Galton whistle, which also allows very small designs. In addition, the whistle may be arranged transversely to the printing direction, to further limit the height.

Alternatively, the tone generation may also be mechanical, such as 3 shows. At the same time, the sound is amplified by a sound element that is stimulated to vibrate 11 generated. Such sound elements 11 may be metal or plastic plates or include both materials, one end of which is fixed to the keyhole substructure 8th is connected and the other end can swing freely. Different lengths of the freely oscillating part of the plate 11 produce different pitches, which are spread by the air and / or by structure-borne noise, as already mentioned. The platelets are stimulated by suitable characteristics of the key guidance 12 , which presses the tile when you press the button 11 first deflect and then swing freely. 4 shows the excitation of multiple platelets and the multiple excitation of a platelet in the course of the key press. Both types of excitation can occur both individually and in combination. Further shows 5 the simultaneous excitation of multiple platelets, which can be arranged concentrically around the key guide. These and similar constructions provide a variety of possible tones for safely distinguishing a variety of key presses.

Alternatively, the mechanical tone excitation of the platelets or sound elements by snap springs (colloquially described as crackpot frog) done (not shown), in which the key guide deforms the snap spring to the envelope.

Also, tone generation based on the flow acoustics of mechanical tone generation can be combined.

In addition to conventional microphones, e.g. Membrane microphones, other transducers can be used, e.g. Structure-borne sound and / or airborne sound sensors, e.g. can be designed as piezo elements or strain gauges.

6 shows the location of the sound sources through three microphones. Calculation basis here is the circular sound propagation in the plane: || x _i - x ₀ || = cΔt _i = c (t _i -t ₀ ), i = 1 ... N

Here, the vector is x _i (for the position of the i-th microphone with the vector components x _i and y _i, x ₀ represents the position to be determined of the sound source with the vector components x ₀ and y _0, c is the sound velocity of the medium eg air or plastic), Δt _i for the ith signal propagation time between sound source and microphone, t _i for the time of signal reception at the i th microphone, and t ₀ for the time of transmission of the acoustic signal by the sound source.

kann z.B. durch Gradientenabstieg oder durch Lookup-Tables gelöst werden. Hierbei steht e2 für das Quadrat des Fehlers, den es zu minimieren gilt, und ∂ für den partiellen Differentialoperator. The optimization problem

can be solved eg by gradient descent or by lookup tables. Where e2 is the square of the error to be minimized and ∂ the partial differential operator.

Given is the position of the minimum required 3 microphones x ₁ to x _N , N> = 3. The time of arrival of the sound event is measured at the microphones 1 - N. Looking for the position x _{0 of} the sound source and the time t ₀ of sound production.

7 explains the method for detecting moving input means. Here, the step indicated at 14 designates the receipt of an acoustic signal due to the movement of an input means, eg a key, eg by an operator, whereby the acoustic signal, eg as a sound or other sound event, is generated outside the hearing range of the operator. The process designated 15 comprises and its conversion, for example into an electrical signal, as it is known for example by microphones. Operation 16 now describes the assignment of the converted signal to the moving element, eg the button. Thus, the actuated key is caused to be recognized purely on the basis of its acoustic signal and subsequently serve the device control.

8th explains the method of determining the acoustic signals in the form of, for example, sounds or sounds. This is based on the assumption that each acoustic signal i to be recognized can be written by a time signal f _i (t) of finite length at the position of the microphone. This signal can also be trained, eg by the corresponding key operation. The detection of the respective key operation is performed by a bank of N matched filters, each filter being responsible for a sound i. The impulse response of the filters is: h _i (t) = f _i (-t) where h _i (t) is the impulse response of the filter and f _i (-t) is the time signal of a finite length sound (eg, a key) at the position of the microphone. If the filter response exceeds a threshold, the key is recognizable. This is also a simultaneous triggering of several keys recognizable. The microphone 24 converts the acoustic signal into an electrical signal through the amplifier 25 is reinforced. The following analog / digital converter 21 Forms a digital signal to the filters 22 h ₁ (t) to h _N (t) is supplied. The filter outputs are from the threshold logic 23 is evaluated, and a recognized key code is provided for further processing.

9 shows a device 30 for generating input signals 33 with an input component 31 , where the input component 31 at least one microphone 32 includes, the microphone 32 for generating an input signal 33 is configured in response to any acoustic signal. In this case, the arbitrary acoustic signal caused by a scratching or grinding movement with the fingernail of an operator on a surface in the interior of a motor vehicle or by rubbing with the finger of an operator on the window glass of a motor-driven disk of a motor vehicle. Furthermore, microphones can be arranged in the window frame, for example above and below the window.

• – Am Rande des Tastenfeldes wird mindestens ein Mikrofon platziert, welches das Tastenfeld in dessen Grundebene (x- und y-Richtung) akustisch abtastet.
• – Die Tasten sind derart ausgeführt, dass bei deren Betätigung ein akustisches Signal erzeugt wird. Dies kann ein einfacher Klickton (z.B. durch Schnappfedern, umgangssprachlich auch als Knackfrosch bezeichnet) oder eine Ton-/ bzw. Klickfolge (z.B. mehrere Klicks durch entsprechende Ausformungen der Tastenführung entlang des Drückwegs) sein.

In the automotive environment, a variety of control instructions for the operation of motor vehicles and their devices are necessary. In particular, keys are widely used as input sensors. For example, in the steering wheel, a large number of buttons, buttons, switches and paddles are located, which can be summarized in keypads and are designed for example for the operation of indicators, lights, but also for controlling infotainment systems. Since the number of variants of these keys or keypads is very large, the infrastructure (harnesses, wires, connectors, space, etc.) must be just as diverse. This leads to a large number of component variants (eg steering wheels of a vehicle model), which increases costs and effort. More generally, the idea disclosed here is to no longer perform each keypad individually in keypads, but to provide electronics that control the position of a key detects acoustically during the pressing process and sends the corresponding switching command to the associated control system via the bus system. The acoustic detection of the key position can be done as follows:

• - At least one microphone is placed at the edge of the keypad, which acoustically scans the keypad in its basic plane (x and y direction).
• - The buttons are designed so that when they are actuated, an acoustic signal is generated. This can be a simple click sound (for example, by snap springs, colloquially also referred to as a crackpot frog) or a sound / click sequence (eg several clicks by corresponding formations of the key guide along the pressing path).

• – Erzeugt die Taste einen einzelnen Klick, werden die Laufzeitdifferenzen des Schallsignals zwischen den Mikrofonen ausgewertet und auf die Position zurückgeschlossen. Die Funktion einer Taste ist somit an ihre Position gebunden und kann bei der Konfiguration des Systems trainiert werden.
• – Erzeugt die Taste eine Klickfolge oder einen charakteristischen Ton, sollte diese/dieser für jede einzelne Taste im Tastenfeld spezifisch sein. Entsprechend kann die jeweilige Taste an der Klangfolge bzw. dem charakteristischen Ton erkannt werden. In diesem Fall ist die Funktion der Taste durch die Klickfolge bzw. den Ton determiniert und die Taste kann an beliebigen Positionen erkannt werden.

The detection of the keys can be done in two ways:

• - If the button generates a single click, the transit time differences of the sound signal between the microphones are evaluated and closed back to the position. The function of a key is thus tied to its position and can be trained in the configuration of the system.
• - If the key produces a click sequence or a distinctive tone, this should be specific to each key on the keypad. Accordingly, the respective key on the sound sequence or the characteristic sound can be detected. In this case, the function of the button is determined by the click sequence or the tone and the button can be recognized at any position.

In order to meet the design specifications (e.g., corporate design) for the feel and acoustics of the button press process, the mechanisms for generating sound are designed so that the click sequence or the characteristic sound is outside the listening area.

In order to avoid misdetection by background noise, the method (sound generation and analysis) can also be carried out in the ultrasonic range.

The advantages thus achieved are, in particular, to achieve the decoupling of the keys from the electronic evaluation. Keys can be applied at any point from which a sound signal perceptible to the transducer can propagate. An acoustic touch function is created by the sequence of sound generation, propagation of the sound through the air and / or structure-borne sound, as well as by the localization or detection of the specific sound.

The essential procedural difference consists in the acoustic evaluation of the acoustic signals resulting from the key operation. This achieves a very great flexibility in the number and arrangement of the switches in the keypad. Any new combination can be quickly adapted with the existing infrastructure. The number of lines leading to the keys is reduced to a minimum. The transducers can hereby be classical microphones, but also structure-borne noise and airborne sound sensors (for example piezo elements, strain gauges, etc.). The transducers can potentially inspect a large surface area for keystrokes without having to prepare these surfaces (except for the mounting of the transducers). The number and position of the keys can be trained and personalized by the user.

By selecting the acoustic signals outside the human hearing, so largely outside the frequency band of 20 to 20,000 Hz, a disturbance or irritation of the occupants is avoided by the operation of the keys.

In comparison to the alternative methods described in the prior art, embodiments require far less electrical infrastructure. Only the microphones must be operated electrically, the input medium (keys, etc.) not. As a result, costs and weight are saved and flexibility is gained.

Embodiments essentially enable the determination of an input location. This conceptually stipulates that the assignment of location and associated function to be carried out on higher processing levels is done by electronics or software. By nature, this approach is much more flexible than the use of electrical infrastructure at the point of entry and can be cost-effective even at later stages of a development process.

With the implementation of the infrastructure of the illustrated embodiments (sensors and electronics), the structure of a keypad per se is not yet predetermined. This allows a great deal of freedom for the designer of the keypad. For example, more or fewer keys and / or a larger or smaller keypad can be operated with the same infrastructure. On the other hand, they are limited possible variants on the keypad itself and the associated software. Variations of the environment (eg steering wheel) can be minimized.

The possible interaction surface is not limited to real keypads, but can also be applied to large surfaces without explicit excitation mechanisms (virtual keys).

The "classic" touch technologies are characterized in particular by the fact that they require electrically conductive structures. Thus, the infrastructure is spatially relatively rigid and only with considerable effort to change. The same applies to the Surface Acoustic Wave Touch technology. Here, special structures are required at the edge of the possible input area, which guide the structure-borne sound waves from the excitation transducer into the input area and from there to the reception sensor. As a result, a flexible application on large and especially curved surfaces is difficult to achieve.

Significantly more flexible are methods that use ultrasonic pens. Here, to some extent, even the height of the pin above the input area can be estimated. A disadvantage of these methods is that an input medium must be used that uses electrically driven vibrators. So you need cables or batteries. Another disadvantage is that these methods use the airborne sound as a transmission path. Ultrasonic sources generally radiate sound very directionally. Especially with curved surfaces, shading easily arises here, which can extremely deteriorate the signal-to-noise ratio. This can be circumvented by additional microphones, but brings a corresponding increase in costs.

The application of the illustrated embodiments is not limited to real keypads. In possible variants, the generation of the click or the characteristic tone sequence is performed by a mechanism other than a key, e.g. through a pen or an ultrasonic generator. Particularly simple input possibilities are e.g. the tapping of a finger or the scratching of a fingernail on a surface. In the latter case, a "mechanism" in the conventional sense is completely dispensed with, giving you a purely virtual keypad.

As a result, an arbitrary signal for reading out a function can be defined at an arbitrary point of almost any desired surface. Limiting affects only the need for registration by the Schallaufnehmer. This represents a particularly great freedom, which even offers the possibility with the help of (selectable) signal and (selectable) input location to take over the function of a password.

The input area (and thus also a keypad) can be flat or linear. Reducing the spatial dimension of a surface to a line also reduces the number of microphones required (at least) by one per dimension.

In principle, the detection method is also suitable for detecting gestures. For this purpose, the input signal must be maintained only over the period in which the gesture is executed. As an example, here may be mentioned a sequence of knocking a moving finger or moving the finger on a suitable textured (sound generating) surface.

Among the embodiments shown are a number of alternatives. In principle, all "classic" touch solutions are included, such as capacitive, resistive and inductive touch, which have a relatively wide distribution.

In the field of acoustics, methods are known in which the position of pens, which are provided with ultrasound transmitters, are detected with the aid of microphones and downstream signal processing.

In another acoustic bypass solution, a spatially limited area (generally a glass substrate) is excited by means of piezo transducers in the ultrasonic range. This results in a spatially constant wave field. The changes in the vibrations that occur when touched, can be registered by the receiving piezoelectric elements and thereby be deduced in the subsequent signal processing on the location of the fault. This technique is also called "Surface Acoustic Wave Touch".

The features disclosed in the foregoing description, the appended claims and the appended figures may be taken to be and effect both individually and in any combination for the realization of an embodiment in its various forms.

Although some aspects have been described in the context of a device, it will be understood that these aspects also constitute a description of the corresponding method, so that a block or a component of a device is also to be understood as a corresponding method step or as a feature of a method step. Similarly, aspects described in connection with or as a method step also represent a description of a corresponding block or detail or feature of a corresponding device.

Depending on particular implementation requirements, embodiments of the embodiments may be implemented in hardware or in software. The implementation may be performed using a digital storage medium, such as a floppy disk, a DVD, a Blu-Ray Disc, a CD, a ROM, a PROM, an EPROM, an EEPROM or FLASH memory, a hard disk, or other magnetic disk or optical memory are stored on the electronically readable control signals, which can cooperate with a programmable hardware component or cooperate such that the respective method is performed.

A programmable hardware component may be integrated by a processor, a central processing unit (CPU), a graphics processing unit (GPU), a computer, a computer system, an application-specific integrated circuit (ASIC) Circuit (IC = Integrated Circuit), a system on chip (SOC) system, a programmable logic element or a field programmable gate array with a microprocessor (FPGA = Field Programmable Gate Array) may be formed.

The digital storage medium may therefore be machine or computer readable. Thus, some embodiments include a data carrier having electronically readable control signals capable of interacting with a programmable computer system or programmable hardware component such that one of the methods described herein is performed.

One embodiment is thus a data carrier (or a digital storage medium or a computer readable medium) on which the program is recorded for performing any of the methods described herein.

In general, embodiments of the present embodiments may be implemented as a program, firmware, computer program, or computer program product with program code or data, the program code or data operative to perform one of the methods when the program resides on a processor or a processor programmable hardware component expires. The program code or the data can also be stored, for example, on a machine-readable carrier or data carrier. The program code or the data may be present, inter alia, as source code, machine code or bytecode as well as other intermediate code.

Another embodiment is further a data stream, a signal sequence, or a sequence of signals that represents the program for performing any of the methods described herein. The data stream, the signal sequence or the sequence of signals can be configured, for example, to be transferred via a data communication connection, for example via the Internet or another network. Embodiments are also data representing signal sequences that are suitable for transmission over a network or a data communication connection, the data representing the program.

For example, a program according to one embodiment may implement one of the methods during its execution by, for example, reading or writing one or more data into memory locations, optionally switching operations or other operations in transistor structures, amplifier structures, or other electrical, optical, magnetic or caused by another operating principle working components. Accordingly, by reading a memory location, data, values, sensor values or other information can be detected, determined or measured by a program. A program can therefore acquire, determine or measure quantities, values, measured variables and other information by reading from one or more storage locations, as well as effect, initiate or execute an action by writing to one or more storage locations and control other devices, machines and components ,

The embodiments described above are merely illustrative of the principles of the present disclosure. It should be understood that modifications and variations are provided herein described arrangements and details will be apparent to others skilled in the art. Therefore, it is intended that the disclosure be limited only by the scope of the appended claims, rather than by the specific details presented in the description and explanation of the embodiments herein.

QUOTES INCLUDE IN THE DESCRIPTION

This list of the documents listed by the applicant has been generated automatically and is included solely for the better information of the reader. The list is not part of the German patent or utility model application. The DPMA assumes no liability for any errors or omissions.

Cited patent literature

• DE 60316259 T2 [0003]
• WO 2011/138071 A1 [0004]
• DE 112006001225 T5 [0005]

Claims (15)

Detection device ( 1 ) comprising: input means movable by an operator ( 2 ) with at least one movable element ( 3 ), where the element ( 3 ) generates an audible signal outside the audible range of the operator as it moves; Receiving means ( 4 ) for receiving and converting the acoustic signal; and assignment means ( 5 ) for associating the converted acoustic signal with the associated movable element. Detection device ( 1 ) according to claim 1, wherein the receiving means ( 4 ) is designed as a microphone and the microphone ( 4 ) is designed as a membrane microphone and / or as a structure-borne sound microphone and / or as an airborne sound sensor. Detection device ( 1 ) according to one of the preceding claims, wherein the acoustic signal is formed as a sound in the ultrasonic range in the form of single tone or multiple tone and / or tone sequence. Detection device ( 1 ) according to one of the preceding claims, wherein a tone generation is based on the flow acoustics. Detection device ( 1 ) according to claim 4, wherein the sound generation by means of a whistle ( 8th / 9 ) he follows. Detection device ( 1 ) according to one of claims 1 to 3, wherein a tone generation takes place mechanically. Detection device ( 1 ) according to claim 6, wherein a mechanical tone generation by excitation of sound elements ( 11 ) is carried out by an element emitting a mechanical impulse and / or by tearing off metal and / or plastic flakes which are located in a key sub-body ( 8th ) are arranged. Detection device ( 1 ) according to claim 7, wherein Tonausformung by a length of the metal and / or plastic platelets ( 11 ) and / or their arrangement in the key base ( 8th ) and / or the arrangement of the corresponding to the metal and / or plastic plates Anreißlementen along a key guide ( 12 ). Detection device ( 1 ) according to one of the preceding claims, wherein the assignment of the converted acoustic signal to the associated movable element is effected by different tones. Detection device ( 1 ) according to one of claims 1 to 8, wherein the assignment of the converted acoustic signal to the associated movable element takes place by transit time measurement of the tones. A method of detecting moving input means, comprising the steps of: receiving ( 14 ) an acoustic signal due to movement of an input means with at least one movable element, the element generating an audible signal outside the audible range of the operator as it moves; Conversion ( 15 ) of the acoustic signal; and assign ( 16 ) of the converted acoustic signal to the associated movable element. Method according to claim 11, wherein a localization of the acoustic signal by microphones ( 4 ), the number of which corresponds at least to the dimensionality of the basic geometry of the arrangement of the movable elements +1, wherein the time of arrival of the acoustic signals to the microphones ( 4 ) is measured and from this the position of the acoustic signal generating element is determined. The method of claim 11 or 12, wherein the determination of tones of the acoustic signal is performed by a bank of matched filters ( 20 ), where each filter ( 22 ) is responsible for a single tone and wherein when a threshold value of the filter response is exceeded, the movable element is detected.  Computer program for performing at least one step of the above method according to claims 11 to 13, wherein the computer program runs on a programmable hardware component. Contraption ( 30 ) for generating input signals ( 33 ) with an input component ( 31 ), whereby the input component ( 31 ) at least one microphone ( 32 ), wherein the microphone ( 32 ) for generating an input signal ( 33 ) is configured in response to an acoustic signal; wherein the acoustic signal is produced by a scratching movement and / or grinding movement with the fingernail of an operator on a surface in the interior of a motor vehicle or by rubbing with the finger of an operator on the window glass of a motor-driven disk of a motor vehicle.

Images