DE102015015245A1 - Simple gesture recognition device - Google Patents

Simple gesture recognition device

Info

Publication number
DE102015015245A1
DE102015015245A1 DE102015015245.9A DE102015015245A DE102015015245A1 DE 102015015245 A1 DE102015015245 A1 DE 102015015245A1 DE 102015015245 A DE102015015245 A DE 102015015245A DE 102015015245 A1 DE102015015245 A1 DE 102015015245A1
Authority
DE
Germany
Prior art keywords
signal
gesture recognition
infrared
compensation
transmission signal
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
DE102015015245.9A
Other languages
German (de)
Inventor
Tycho Lorenz Roland Raab
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Elmos Semiconductor AG
Original Assignee
Elmos Semiconductor AG
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Elmos Semiconductor AG filed Critical Elmos Semiconductor AG
Priority to DE102015015245.9A priority Critical patent/DE102015015245A1/en
Publication of DE102015015245A1 publication Critical patent/DE102015015245A1/en
Application status is Pending legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/042Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means
    • G06F3/0425Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017Gesture based interaction, e.g. based on a set of recognized hand gestures
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/0416Control or interface arrangements specially adapted for digitisers

Abstract

Method for distinguishing proximity and two-finger gestures in the recognition of gestures by means of a gesture recognition device (GV) in the operation of human-machine interfaces in conjunction with at least one screen (DS) in a motor vehicle with a gesture recognition object (O), with the Steps, a. Detecting at least one relevant measured value (RM) for a distance of the gesture recognition object (O) from the screen (DS) and / or the reflection amplitude and / or transmission amplitude of the gesture recognition object (O) outside of the gesture recognition device (GV) by means of at least one proximity sensor (H, D, K), wherein said detection comprises the sub-steps: i. Generating at least one amplitude-modulated transmitter supply signal (S5i); ii. Generating at least one amplitude-modulated compensation-sample signal (S3j); iii. Generating an optical transmission signal (I1i) which depends on the transmitter supply signal (S5i); iv. Generating an optical compensation transmission signal (I2j) which depends on the compensation supply signal (S3j); v. Reflection of the optical transmission signal (I1i) on the object (O) to produce a reflected optical transmission signal (I3j) vi. linearly superimposing the reflected optical transmission signal (I3j) and the optical compensation transmission signal (I2j) in at least one photodiode (Dj) to generate a reception signal (S0j) associated with the photodiode (Dj); vii. wherein the generation of the transmission signal (S5i) and the compensation supply signal (S3j) so by means of a control value (S4i, j), 1. the receive signal (S0j) contains no signal components of the compensation supply signal (S3j) and the transmission signal (S5i) and 2. that the mean amplitude and / or the phase of the transmitter supply signal (S5i) and / or compensation supply signal (S3j) depends proportionally on a control value (S4i, j); viii. Using the control value (S4i, j) as the relevant measured value (RM) and / or calculating a relevant measured value (RM) as a function of the control value (S4i, j); b. Projecting an infrared image of the gesture recognition object (O) onto an infrared sensor array (PIRA) by means of at least one optical projection device (1); c. Generating at least two infrared measurement signals (IM1 to IMk) by means of at least one one-dimensional and / or two-dimensional infrared sensor array (PIRA) with at least two infrared sensors (PIR1 to PIRk) within the infrared sensor array (PIRA), each sensitive to the thermal radiation of the human Are body and each provide at least one infrared measurement signal (IMl) of the infrared measurement signals (IM1 to IMk) of the infrared sensors (PIR1 to PIRk); d. Comparison of the relevant measured value (RM) with a first threshold value (SW1) by an evaluation device (AV); e. Performing the method for gesture recognition on the basis of at least two infrared measurement signals, the infrared sensor array (PIRA) provides, and additionally simultaneously based on at least the relevant measured value (RM), if either determined by the preceding step d of the comparison that the relevant Measured value (RM) is below the first threshold (SW1), or it is determined that the relevant measured value (RM) is above the first threshold (SW1); f. Evaluation of the gesture recognition result by i. Output of the recognition result by signaling and / or ii. Operating an actuator un / or iii. Change in the system state of the gesture recognition device that performs this method and / or ...

Description

  • introduction
  • The invention relates to a gesture recognition device for the detection of gestures in the room in front of a screen in a motor vehicle. The invention relates in particular to non-contact gestures.
  • Such gesture recognition devices with this purpose are known in the art. First, the problems with currently available solutions will be discussed briefly.
  • 1 shows an important usage situation. By spreading the fingers in front of the screen, the system, whose output is on the screen (DS), is made to change a virtual object on the screen. Here it should be enlarged. For this, not only a position of an object, but its structure must be recognized. From the HALIOS GESTURE RECOGNITION such Halios system is known. Such a Halios system has several LEDs as transmitter (H). For the improved resolution several transmitters are necessary. LEDs are currently relatively expensive electronic components, which is why the system becomes more expensive with increasing resolution. Alternatively, 3D TOF cameras or stereo camera systems may be considered that provide an image, with each pixel being assigned depth information. These systems are even more expensive and require significant computing power.
  • PIR sensor arrays are known from the prior art which are suitable for detecting the movement of a thermally radiating object, for example a user's hand, against a colder background. But you can not distinguish between near and far objects.
  • Object of the invention
  • It is the object of the invention to provide a cost-effective method and a cost-effective device which overcome the disadvantages of the prior art.
  • This object is achieved by a device according to claim 1.
  • Description of the invention
  • The description of the invention is based on the figures. If the figures reflect the state of the art, this is mentioned in the text and marked on the relevant figure with the abbreviation SdT.
  • 1 shows, as mentioned, a screen (DS), as it is used in today's car. Typically, it is housed in a housing (GH). In the housing (GH) of the screen (DS) is a proximity sensor array (PIRA). At the same time in the housing (GH) is a distance measuring system in the form of a proximity sensor, here a Halios system with a transmitter (H), a receiver (D) and a compensation transmitter (K), which is associated with the receiver (K). This combined proximity sensor system is now able to solve the task of the invention at a much lower cost than solutions from the prior art. In particular, the use of a Halios system achieves good ambient light robustness, for example against sunlight.
  • 2 shows a conventional Halios system of the prior art, as it finds use in the device according to the invention. The Halios system schematically sketched here has N transmitters (H 1 to H N ), of which only the ith transmitter (H i ) is drawn, as well as M receivers (D 1 to D M ), of which only the j -th receiver (D j ) is drawn. Each receiver is assigned a compensation transmitter of M compensation transmitters (K 1 to K M ). Only the jth compensation transmitter ( Kj ) matching the jth receiver ( Dj ) is drawn in the figure. The jth receiver (D j ) is thus assigned the j th compensation transmitter (K j ). In the following, the control will be described with reference to the exemplary control circuit concerning the i-th transmitter (H i ) and the j-th receiver (D j ). Further control loops for further pairings between transmitters (H i ) on the one hand and receivers (D j ) and associated compensation transmitters (K j ) on the other hand are generally provided, but are not absolutely necessary. The following can be transferred to the other, not drawn control loops. A generator (G i ) generates a transmission signal (S5 i ). With this signal, the luminosity, ie the amplitude of the transmitter (H i ) is modulated. As a result, the i-th transmitter (H i ) emits an ith optical transmission signal (I1 i ). This optical transmission signal (I1 i ) irradiates the object to be detected (O). The object (O) to be detected reflects and / or transmits the optical transmission signals (I1 1 to I1 N ) irradiating the object (O) also in the direction of the jth receiver (D j ) - and thus also the ith optical transmission signal (I1 i ) - as a reflected optical transmission signal (I3 j ). The reflected optical transmission signal (I3 j) is the j-th receiver (D j) and received (S0 j) in the j-th reception signal converted. This is amplified in the jth preamplifier (V j ) to the amplified received signal (S1j) and typically highpass or bandpass filtered. This is followed by each evaluating pairing of transmitter (H i ) and receiver (D j ) in the signal path depending on a synchronous demodulator. This multiplies, by means of an i, j-th multiplier (M i, j ), the i-th transmission signal (S5 i ) with the amplified j-th reception signal (S1 j ) to the i, j-th multiplied reception signal (S9 i, j ) , This is then low-pass filtered in the i, j-th filter (F1 i, j ) to the i, j-th filter output (S10 i, j ). Due to the multiplication and the subsequent filtering, a scalar product is mathematically formed between the i-th transmission signal (S5 i ) and the j-th amplified reception signal (S1 j ). Thus, the i, j-th filter output signal (S10 i, j ) is quasi the Fourier coefficient associated with the transmission signal (S5 i ). The j-th amplified received signal (S1 j ) is thereby mathematically projected onto the i-th transmission signal (S5 i ). The i, j-th filter output (S10 i, j ) is amplified to the i, j-th amplified filter output (S4 i, j ) by the i, j-th post-amplifier (VN i, j ). In this case, the sign and the frequency and phase response of the amplification is selected so that the result in the later resulting control loop stability. The i, j-th amplified filter output signal (S4 i, j ) is now multiplied by the i-th transmit signal (S5 i ) in another i, j-th multiplier (M2 i, j ) to the i, j th compensation feed bias signal (S6 i, j ) from the transmission signal space of the transmission signals (S5 1 to S5 N ) transformed back into the time domain. The i, j-th compensation feed advance signals (S6 i, j ) associated with the respective transmit signals (S5 i ) are combined by N summers (A i, j ) to the j th compensation feed advance signal (S6 j ) which is only the jth receiver (D j ) is assigned. A j-th positive offset (B j ) is typically added to this j th compensation feed advance signal (S 6 j ) by another adder since an LED can not transmit negative light. The jth compensation feed signal (S3 j ) is produced. With this jth compensation supply signal (S3 j ), the jth compensation transmitter (K j ) associated with the jth receiver (D j ) is controlled. This emits a j-th optical compensation transmission signal (I2 j ) and this now also in the jth receiver (D j ). The superimposition of the jth reflected optical transmission signal (I3 j ) and the j-th optical compensation transmission signal (I2 j ) is preferably linearly summing in the jth receiver. With the correct sign selection of the i, j th post- amplifiers (VN 1j to V Nj ), the control loop is stable. In that case, the i, j-th amplified filter output signals (S4 i, j ) represent a matrix of measured values with which the object (O) and / or the transmission path from the transmitter (H l ) to the object (O) and back to the receiver (D j ) can be evaluated. Analogous methods and devices are known from the prior art, in addition to the amplitude seeks the phase of the compensation transmission signal (S3 j ) to control. It is also possible instead of the compensation transmitter (D j ) by means of a regulated compensation transmission signal (S3 j ) to control the transmitter (H i ) by means of the transmission signal (H i ). Mixtures in the form of a two-dimensional control by means of a one-dimensional Relgelkennlinie in the resulting two-dimensional control space are also known.
  • It is obvious to the person skilled in the art that, instead of the space multiplex described here in N × M units, time division in parts of the signal path is also possible and that parts can be carried out by a data processing system.
  • 3 schematically shows a known from the prior art system of a passive infrared sensor array. It consists of a housing (GHP). The housing is typically filled with an inert gas (SG) or vacuum. An optical window (F) preferably only allows radiation in the inter-exciting infrared range in the interior of the sensor. The actual infrared sensor array (PIRA) is preferably constructed monolithically and comprises a plurality of surface-mounted infrared sensors (PIR 1 , PIR 2 , ... PIR K ). A lens (L), which is transparent to the radiation of interest, images radiating objects (O) onto the infrared sensor array (PIRA). This lens (L) may be in front of the window (F) or between the window (F) and the infrared sensor array (PIRA).
  • 4 shows the exemplary arrangement of several Halios transmitter (H1, H2, H3) and receiver (D1, D2, D3) and the associated compensation transmitter (K1, K2, K3) and two infrared sensor arrays PIRA1, PIRA2) in the vicinity of one Screen (DS) in the supervision ( 4a ) and in the side view ( 4b ). According to the present invention, the distance and / or reflection amplitude information provided by the Halios system in the form of the 9 amplified filter output signals (S4 11 to S4 33 ) is used to reliably detect an approach of an object (O), whether live or not, to the system can. In the example of 4 the space is divided vertically into the screen surface in example three distance ranges (I, II, III). At the same time, the sensitivity range of the sensors is typically limited to a range below an upper limit (GO) and above a lower limit (GU). This division creates three sensor areas (SB1, SB2, SB3). If the distance of an object (O) from the screen (DS) is such that a gesture recognition object (O) with which a gesture is executed is in the first sensor area (SB1), for example, a first set of gestures is recognized. If the object (O), ie typically the gesture recognition object (O), is located in the second sensor area (SB2), then a second set of gestures, which may differ from the first set of gestures to be recognized, is detected. The gestures, individual gestures and gesture vocabularies and grammars to be recognized can therefore differ depending on the sensor area. In the third sensor area (SB3) typically no gestures are detected. However, the gesture recognition itself is not necessarily carried out by means of the Halios system but preferably by evaluation of the infrared measurement signals (IM 1 to IM k ) of the infrared sensors (PIR 1 to PIR k ) of the respective infrared sensor arrays (PIRA 1 , PIRA 2 ). , In particular, it is possible with the help of these passive infrared sensors (PIRA 1 , PIRA 2 ) to distinguish between live and inanimate objects (O). Thus, a false trip is unlikely.
  • It is a feature of the gesture recognition device (GV) according to the invention that, in addition to the proximity sensor, which is capable of determining at least one distance of an object (O) from the proximity sensor and / or a screen (DS), it has at least one further sensor which can distinguish between animated and inanimate objects (O). In this case, it is advantageous if the device has an evaluation device (AV) which combines the data of the proximity sensor and the further sensor in such a way that it can recognize only gestures that are executed by animated gesture recognition objects and those that are executed by inanimate gesture recognition objects , basically rated as unrecognized. In this case, for example, the exceeding of an infrared radiation level threshold value by one or more infrared measurement signals (IM 1 ) and / or one or more signals derived therefrom or a similar process can be evaluated as a criterion for the evaluation.
  • By way of example, we can assume, for example, that the two exemplary infrared sensor arrays (PIRA 1 , PIRA 2 ) each contain 10 infrared sensors (PIR1 to PIR10). This results in 10 * 2 infrared measurement signals (IM 1.1 to IM 2.10 ), which corresponds to a 20-dimensional vector signal. Of course, this can be done with the 9 measured value signals of the Halios sensors in the form of the nine amplified filter output signals (s4 11 to S4 33 ) to a 29-dimensional measured value vector. From the DE 10 2012 024 778 A1 For example, a method and apparatus for pure Halios systems is known, such as such a measured value vector (reference numeral 24 of the DE 10 2012 024 778 A1 ) can be assigned to a gesture or a non-gesture and the gesture recognition result in the form of a recognized gesture (reference numeral 22 of the DE 10 2012 024 778 A1 ) or gesture hypothesis list can be output. There are more sensor signals (reference numerals 37 of the DE 10 2012 024 778 A1 ) mentioned. In this case, these are the first measurements of the infrared sensor arrays (PIRA 1 , PIRA 2 ).
  • 5 shows a typical detection case: When approaching the hand as a gesture recognition object (O) to the screen (DS) closer than a predetermined and / or set and / or programmed threshold distance (d), the gesture recognition is activated. In this example, the gesture recognition system divides the space in front of the screen into only two sensor areas (SB1 and SB2).
  • 6 shows the inventive method for gesture recognition. In a first step (AM), a distance measurement by means of the Halios sensor system (see description 2 ) is performed to obtain a first measured value (S4) for the distance between the screen (DS) and the gesture recognition object (O) in front of the screen (DS). This usually does not resolve the fingers and typically determines one or at least only a few first measured values (S4 11 to S4 N, M ). Although at the same time a measurement is also carried out by at least one one-dimensional and / or two-dimensional infrared sensor array (PIRA). The k infrared sensors (PIR 1 to PIR K ) of the infrared sensor array deliver at least k infrared measurement signals (IM 1 to IM k ). However, these are not yet evaluated in this process step of the distance measurement (AM). An evaluation device (AV) determines with the aid of the N × M first measured values (S4 1,1 to S4 N, M ) at least one distance of at least one object. In order to keep costs low, it has proved to be particularly advantageous to choose N = 1 and M = 1. Possibly. is selected on the basis of predetermined criteria of one of the measured values (S4 1,1 to S4 N, M ) as a relevant measured value and / or calculated from the N × M first measured values (S4 1,1 to S4 N, M ). Such a calculation can be, for example, an averaging. Typically, the evaluation device (AV) has a processing unit with program and data memory, which performs this calculation. The evaluation device (AV) now compares this relevant measured value with a threshold value in a first test step (OJI). If the relevant measured value is on the value side of the threshold value for which a gesture recognition is provided, ie if the statement "object in area I" is correct, the evaluation device (AV) performs the next step (GE) on gesture recognition by means of a gesture recognition method Basis of a feature vector (reference numeral 24 or 37 of the DE 10 2012 024 778 A1 ) consisting of the first measured values (S4 i, j ) (reference numeral 24 of the DE 10 2012 024 778 A1 ) and the infrared measurement signals (IM 1 to IM k ) (reference numeral 37 of the DE 10 2012 024 778 A1 ) by. Such a method is, as already mentioned, from the DE 10 2012 024 778 A1 known. In this step (BG), the evaluation device (AV) determines a gesture recognition result in the form of a known gesture and / or a gesture hypothesis list (reference symbol 22 of the DE 10 2012 024 778 A1 ). A gesture hypothesis list is a list of recognized gestures, typically identified as an indexed list of gesture numbers, in which gesture hypothesis list of each thus recognized and indexed gesture is ranked by its index associated with a gesture recognition probability. A recognized gesture is typically represented by a gesture number. For the non-recognition of gestures, a dummy gesture number is typically also determined which is associated with this case of an unrecognized gesture or an empty gesture hypothesis list. In this last case of non-recognition of a gesture, the evaluation device (AV) typically continues with the determination of the distance (AM). In the other case of a recognized gesture as a gesture recognition result or a non-empty gesture hypothesis list of recognized gestures as a gesture recognition result, this gesture or the gesture hypothesis list is evaluated in the next step (AG) and if necessary actuates an actor in response to the gesture recognition result and / or signaling in dependence on this gesture recognition result in the form of the detected gesture and / or the gesture hypothesis list made. Only after this step (AG) is completed does the apparatus return to the first step (AM), the distance measurement.
  • 7 largely corresponds to the 6 , Now, however, after the distance measurement (AM) step, not only is a check made as to whether the gesture recognition object (O) is in region I (OJI) but also, if this is not the case, if the gesture recognition object (O) is present in Area II is located (OJII). If the gesture recognition object (O) is in area I, ie the test step (OJI) has given a positive result, then In this example, a gesture recognition (GE_I) for area I is performed.
  • If the gesture recognition object (O) is located in area II, d. H. the test step (OJI) has given a negative result and the second test step (OJII) has given a positive result, so in this example a gesture recognition (GE_II) is performed for the area II. In this case, the identifiable by the evaluation device (AV) gestures, so for example the gestures vocabulary, the individual gestures and gesture grammar, in the area I and area II and independently of the methods of detection (eg., Detection using an HMM method vs Detection using a neural network) in the area I and area II.
  • The method of gesture recognition thus ultimately depends in one embodiment of the invention on one or more of the determined measured values (S4 i, j ) of the proximity sensor (H, D, K) derived relevant measured value or relevant measured values or the measured values (S4) itself.
  • In another embodiment, the recognizable gestures, that is to say the gesture vocabulary, are dependent on one or more relevant measured values or relevant measured values derived from the determined measured values (S4 i, j ) of the proximity sensor (H, D, K) or the measured values (S4 i, j ) yourself.
  • The invention thus relates to a gesture recognition device for the simplified recognition of multi-finger gestures in the operation of human-machine interfaces in interaction with at least one screen (DS) in a motor vehicle. It is characterized in that it comprises at least one proximity sensor (H, D, K) which measures at least one first measured value (S4 i, j ). A Nähungssensorsteuerung (NC) determines or calculates a relevant measurement (RM), a distance value and / or a reflection value and / or transmission value of an object (O), preferably of the gesture recognition object ( 0 ), outside the gesture recognition device (GV), from the first measured value (S4) or the possibly several first measured values (S4 i, j ). Furthermore, it comprises at least one one-dimensional and / or two-dimensional infrared sensor array (PIRA) with at least two infrared sensors (PIR 1 , PIR 2 ,... PIR k ) within the infrared sensor array (PIRA), each sensitive to the heat radiation of a human body and each provide an infrared measurement signal (IM 1 to IM k ). In addition, it comprises at least one optical projection device (L). This is inventively provided and arranged, at least temporarily, an infrared image of an infrared beam, which is preferably identical to the gesture recognition object (O) outside the gesture recognition device (GV) on said infrared sensor array (PIRA) and thus on the infrared sensors (PIR 1 to PIR k ) to project. An evaluation device (AV) compares the first measured value (S4 i, j ) or a relevant measured value (RM) calculated from the measured values (S4) or otherwise determined with a first threshold. The evaluation device (AV) typically performs a gesture recognition method based on said k, but at least two infrared measurement signals (IM 1 to IM k ) provided by the infrared sensor array (PIRA). However, this only happens if the relevant measured value (RM) is either a) below or b) above the first threshold (SW1). In one realization, the evaluation device (AV) outputs the gesture recognition result by a signal only in exactly one predetermined, set or programmed case of the two aforementioned cases a and b (FIG. 32 ) or operates an actuator depending on the gesture recognition result, or otherwise changes the system state of the gesture recognition device or the system state of a device whose part is the gesture recognition device. Alternatively, the evaluation device (AV) may also change the system state of a device system of which the gesture recognition device is part, depending on the gesture recognition result.
  • In a further embodiment of the invention, this is characterized in that the evaluation device (AV) a method for gesture recognition not only on the basis of at least two infrared measurement signals (IM 1 to IM k ), which performs the infrared sensor array (PIRA), but at the same time also uses at least a first measured value (S4 i, j ) of the at least one proximity sensor (H, D, K) or a relevant measured value (RM) derived therefrom for this gesture recognition in order to obtain a gesture recognition result and then via its output ( 32 ) to signal).
  • In a further embodiment of the invention, this is characterized in that the proximity sensor (H, D, K) is a Halios sensor system. In this case, it comprises at least one transmitter (H i ) in the form of at least one LED, which sends an optical transmission signal ( I 1 i ) into the space in front of the screen (DS) in response to a transmitter feed signal (S 5 i ), and a photodiode ( D j ) which supplies a received signal (S0 j ) in response to the optical transmission signal (I3j) reflected or transmitted through a gesture recognition object (O) or other object (O). The gesture recognition object (O) or other object (O) is located in front of the screen (DS). A proximity sensor control (NC) generates the transmitter supply signal (S5 i ) and at least one output signal (S4) or a measured value as a function of the received signal (S0 j ). The output signal (S4 i, j ) supplies the proximity sensor control (NC) to said evaluation device (AV), whereby the evaluation device (AV) and the proximity sensor control (NC) can form a common device.
  • In a further embodiment of the invention, the invention is further characterized in that the proximity sensor (H, D, K) at least one compensation transmitter (K j ) in the form of at least one LED, the optical compensating transmission signal (I 2 j ) in response to a Compensation feed signal (S3 j ) supplies. The proximity sensor control (NC) generates compensation feed signal (S3 j ), wherein the regulatory generation of the transmit signal (S5 i ) and the compensation feed signal (S3 j ) takes place so that the receive signal (S0 j ) no signal components of the compensation feed signal (S3 j ) and the Transmission signal (S5 i ) contains more.
  • In a further embodiment of the invention, the se is characterized in that the infrared sensor array is a one or two-dimensional array of k passive infrared sensors. Here and in the following, k is a positive number greater than or equal to two. A passive infrared sensor (PIR 1 ) of these passive infrared sensors (PIR 1 to PIR k ) is characterized in the sense of this disclosure in that it contains at least one pyroelectric element and that the associated infrared measurement signal (IM 1 ) of the relevant passive infrared sensor Infrared sensor (PIR l ) on infrared irradiation of the pyroelectric element of the relevant passive infrared sensor (PIR l ) changes.
  • In a further alternative embodiment of the invention, this is characterized in that the infrared sensor array is a thermopile sensor array (TPA) with a one- or two-dimensional arrangement of thermopile sensors (TP 1 to TP k ). In this case, a thermopile sensor (TP 1 ) of these thermopile sensors (TP 1 to TP k ) in the sense of this disclosure is characterized in that it contains at least one sensor element as a sub-device of itself, which is provided and set up for this, an electrical voltage as Infrared measurement signal (IM l ) to produce, the voltage value of which depends on the temperature of the sensor element. Irradiation of the sensor element of the thermopile sensor (TP 1 ) with infrared radiation changes the temperature of the sensor element of the thermopile sensor (TP 1 ) in such a way that the voltage generated by the thermopile sensor (TP 1 ) and thus the associated infrared measurement signal (IM l ) of the relevant thermopile sensor (TP l ) changes.
  • In a further embodiment of the invention, the invention is characterized in that the infrared sensor array is a bolometer array (BA) in the form of a one- or two-dimensional arrangement of bolometers (B 1 to B k ). In this case, a bolometer (B l ) of these bolometers (B 1 to B k ) in the sense of this disclosure is characterized in that it contains at least one sensor element which is provided and arranged to have an electrical resistance dependent on its temperature, its resistance value depends on the temperature of the sensor element. Irradiation of the sensor element with infrared radiation changes the temperature of the sensor element of the relevant bolometer (B l ) in such a way that the electrical resistance of the sensor element changes. Such a sensor element is typically designed to be electrically measured for resistance value in order to generate said infrared measurement signal (IM l ) of the relevant bolometer (B l ).
  • The invention thus also relates to a method for distinguishing proximity and two-finger gestures in the recognition of gestures by means of a gesture recognition device in the operation of human-machine interfaces in interaction with at least one screen (DS) in a motor vehicle by means of a gesture recognition object (O). , The method according to the invention comprises the steps:
    • a. Detecting at least one relevant measured value for (RM) a distance and / or the reflection amplitude and / or a transmission amplitude of a gesture recognition object (O) outside the gesture recognition device (GV) by means of at least one proximity sensor (H, D, K);
    • b. Projecting an infrared image of an infrared ray, which is preferably identical to the gesture recognition object (O) outside the gesture recognition device (GV) in front of the screen (DS), to an infrared sensor array (PIRA) by means of at least one optical projection device (L);
    • c. Generating at least two infrared measurement signals (IM 1 to IM k ) by means of at least one one-dimensional and / or two-dimensional infrared sensor array (PIRA) with at least two infrared sensors (PIR 1 to PIR k ) within the infrared sensor array (PIRA), each sensitive to the heat radiation of a human body, better of the gesture recognition object (O), are and each provide at least one infrared measurement signal (IM l ) of the infrared measurement signals (IM 1 to IM k );
    • d. Comparison of the relevant measured value (RM) with a first threshold value (SW1) by an evaluation device (AV);
    • e. Carrying out a gesture recognition method for determining a gesture recognition result on the basis of the at least two infrared measurement signals (IM 1 to IM k ) which supplies the at least one infrared sensor array (PIRA) if the relevant measured value (RM) is either below or above the first threshold ( SW1) is located; (Of course, it makes sense only if only one of these two possible comparison results is used in the method used.)
    • f. Evaluation of the gesture recognition result by the evaluation device (AV) by means of
    • i. Output of the determination of a gesture recognition result by signaling via an output signal ( 32 ) and or
    • ii. Operation of an actuator as a function of the gesture recognition result and / or
    • iii. Change the system state of the gesture recognition device that performs this method, depending on the gesture recognition result and / or
    • iv. Changing the system state of the device, part of which is the gesture recognition device that performs this method, depending on the gesture recognition result and / or
    • v. Changing the system state of a device system, part of which is the gesture recognition device that performs this method, in response to the gesture recognition result.
  • In a further embodiment of the method, this method for determining a gesture recognition result additionally comprises carrying out a sub-procedure for gesture recognition on the basis of the at least two infrared measurement signals (IM 1 to IM k ) that supplies the infrared sensor array (PIRA), taking into account at least the relevant one Measured value (RM) for this gesture recognition.
  • In a further embodiment of the invention, a method is used which additionally comprises the following steps:
    • a. Generating at least one amplitude N, modulated transmitter feed signal (S5 i );
    • b. Generating at least one amplitude N, modulated compensation feed signal (S3 j );
    • c. Generating an optical transmission signal (I1 i ) which depends on the transmitter supply signal (S5 i );
    • d. Generating an optical compensation transmission signal (I2 j ) which depends on the compensation supply signal (S3 j );
    • e. Reflection of the optical transmission signal (I1 i ) on the object (O) for generating a reflected optical transmission signal (I3 j )
    • f. linear overlying receiving the reflected optical transmission signal (I3 j) and the optical compensation transmission signal (I2 j) in at least one photodiode (D j) for generating a photodiode (D j) associated with the received signal (S0 j);
    • G. wherein the generation of the transmission signal (S5 i ) and the compensation supply signal (S3 j ) is effected by means of a control value,
    • i. that the received signal (S0 j ) contains no signal components of the compensation supply signal (S3 j ) and of the transmission signal (S5 i ) and
    • ii. that the mean amplitude and / or the phase of the transmitter supply signal (S5 i ) and / or compensation supply signal (S3 j ) depends proportionally on a control value (S4);
    • H. Using the control value (S4 i, j ) as a first measured value or generating a relevant measured value (RM) as a function of the control value (S4 i, j );
  • Another possible variant of the method is characterized in that the infrared sensor array (PIRA) is a one- or two-dimensional array of passive infrared sensors (PIR 1 to PIR k ). A passive infrared sensor (PIR 1 ) of these passive infrared sensors (PIR 1 to PIR k ) is characterized in that it contains at least one pyroelectric element and that the associated infrared measurement signal (IM 1 ) of the relevant passive infrared sensor (PIR 1 ) when infrared radiation of the pyroelectric element changes.
  • A further variant of the method according to the invention is characterized in that the infrared sensor array is a thermopile array (TPA) of a one- or two-dimensional arrangement of thermopile sensors (TP 1 to TP k ). A thermopile sensor (TP 1 ) is characterized in that it contains at least one sensor element which is provided and arranged to generate an electrical voltage as an infrared measurement signal (IM 1 ) whose voltage value depends on the temperature of the sensor element. Irradiation of the sensor element with infrared radiation changes the temperature of the sensor element in such a way that the electrical voltage generated by the thermopile sensor element and thus the infrared measurement signal (IM 1 ) of the relevant thermopile sensor (TP 1 ) changes.
  • A further variant of the method is characterized in that the infrared sensor array is a bolometer array (BA) in the form of a one- or two-dimensional arrangement of bolometers (B 1 to B k ). For the purposes of this disclosure, a bolometer ( B1 ) is characterized in that it contains at least one sensor element which is provided and arranged to have an electrical resistance dependent on its temperature, the resistance value of which depends on the temperature of the sensor element. Irradiation of the sensor element with infrared radiation changes the temperature of the sensor element so that the electrical resistance of the sensor element changes. The sensor element is in this case that is, to be electrically measured with respect to the resistance value to produce said respective infrared measurement signal (IM 1 ).
  • Advantages of the invention
  • The invention makes it possible to construct, with the aid of less inexpensive components, a gesture recognition system capable of recognizing a two-finger gesture. The cost is below that of a comparable system according to the DE 10 2012 024 778 A1 , Also, the system is less expensive than a true 3D TOF camera or system based on a stereo camera.
  • LIST OF REFERENCE NUMBERS
  • 32
    Output signal of the evaluation device (AV). It may be a digital or analog single signal, but also a bus of such signals. With this signal, the evaluation device signals the gesture recognition result to subsequent devices. This can also be a screen display or another representation by means of another output unit.
    A i, j
    i, j-th adder (1≤i≤N) (1≤j≤M)
    AG
    Execution of the gesture. For example, actuation of an actuator and / or signaling to the outside, etc.
    AT THE
    distance measurement
    AV
    evaluation
    B 1
    first partial bolometer of the bolometer array BA
    B l
    l-th partial bolometer of the bolometer array BA
    B j
    j-th partial bolometer of the bolometer array BA
    B k
    k-th partial bolometer of the bolometer array BA
    BA
    Bolometer array. This is an embodiment of the infrared sensor array.
    B
    jth offset (1≤j≤M)
    BG
    Test step on a known gesture
    d
    Threshold distance separating area I from area II.
    DS
    screen
    F
    optical window
    F1 i, j
    i, j-th filter (with 1 ≤ i ≤ N and 1 ≤ j ≤ M)
    GE
    Gesture recognition step
    GH
    Housing of the screen
    GHP
    Housing of the Infratot sensor array
    G i
    i-ter of N signal generators. It may also be just a signal generator that generates N different transmit signal (S5 i ). For the nature of the signals reference is made to the literature mentioned in the text. (1≤i≤N)
    GV
    Gesture recognition device
    H 1
    first transmitter, typically an infrared LED
    H i
    i-th transmitter, typically an infrared LED (1 ≤ i ≤ N)
    H N
    Nth transmitter, typically an infrared LED
    I1 1
    first optical transmission signal emitted by the first transmitter (H 1 ).
    I1 i
    i-tes optical transmission signal, which is emitted by the i-th transmitter (H i ). (1≤i≤N)
    I1 N
    Nth optical transmission signal radiated by the Nth transmitter (H N ).
    I2 1
    first optical compensation transmission signal
    I2 j
    j-th optical compensation transmission signal (1≤j≤M)
    I2 M
    M-th optical compensation transmission signal
    I3 1
    first reflected optical transmission signal which is the superimposition of the optical transmission signals (S1 1 to S1 N ) modified by the object (O) by reflection and / or transmission incident on the first receiver (D 1 ).
    I3 j
    j-th reflected optical transmission signal, which is the superposition of the optical transmission signals (S1 1 to S1 N ) modified by the object (O) by reflection and / or transmission incident on the jth receiver (D j ). (1≤j≤M)
    I3 M
    M-th reflected optical transmission signal, which is the superposition of the optical transmission signals (S1 1 to S1 N ) modified by the object (O) by reflection and / or transmission incident on the Mth receiver (D M ).
    IN 1
    first infrared measurement signal
    IM j
    j-th infrared measurement signal (1 ≤ j ≤ k)
    IM l
    l-th infrared measurement signal (1 ≤ l ≤ k)
    IM k
    k-tes infrared measurement signal
    K 1
    first compensation transmitter
    K y
    j-th compensation transmitter
    K M
    M-th compensation transmitter
    M1 i, j
    i, j-th multiplier
    M2 i, j
    another i, j-th multiplier
    NC
    Proximity sensor control
    O
    object to be detected
    OJI
    Object in area I
    Ojii
    Object in area II
    PIR 1
    first infrared sensor of an infrared sensor array (PIRA)
    PIR 2
    second infrared sensor of an infrared sensor array (PIRA)
    PIR j
    j-th Infrared Sensor of an Infrared Sensor Array (PIRA) (1 ≤ j ≤ k)
    PIR l
    l-th infrared sensor of an infrared sensor array (PIRA) (1 ≤ l ≤ k)
    PIR K
    k-th infrared sensor of an infrared sensor array (PIRA)
    PIRA
    Infrared sensor array
    PIRA 1
    first infrared sensor array
    PIRA 2
    second infrared sensor array
    RM
    Relevant measured value. The relevant measured value is determined by the proximity sensor control (NC) by selection and / or calculation from the typically N × M measured values (S4 i, j ) of the proximity sensor (H i , D j , K j ) (where 1 ≦ i ≦ N and 1 ≤ j ≤ M).
    SdT
    State of the art
    S0 1
    first received signal
    S0 i
    j-th receive signal (1 ≤ j ≤ M)
    S0 M
    M-th reception signal
    S1 1
    first amplified received signal
    S1 j
    j-th receive signal (1 ≤ j ≤ M)
    S1 M
    M-tes amplified received signal
    S3 1
    first compensation feed signal
    S3 j
    j-th compensation compensation signal (1 ≤ j ≤ M)
    S3 M
    M-tes compensation feed signal
    S4 i, j
    i, j-tes amplified filter output (1 ≤ i ≤ N) (1 ≤ j ≤ M)
    S5 M
    Mth transmission signal
    S5 i
    ith send signal (1 ≤ i ≤ N
    S5 N
    Nth transmission signal
    S6 i, j
    i, j-tes compensation feed advance signal (1≤i≤N) (1≤j≤M)
    S6 j
    j-th compensation feed advance signal (1≤i≤N) (1≤j≤M)
    S9 i, j
    i, j-th multiply received signal (1≤i≤N) (1≤j≤M)
    S10 i, j
    i, j-th filter output signal (1≤i≤N) (1≤j≤M)
    SG
    Inert gas or vacuum
    SW 1
    first threshold, which may be predetermined and / or adjusted and / or programmed
    TPA
    Thermopile array as a special form of the infrared sensor array
    TP 1
    first thermopile as part of the Thermopile Array (TPA)
    TP l
    l-th Thermopile as part of the Thermopile Array (TPA) (1 ≤ l ≤ k)
    TP k
    k-tes Thermopile as part of the Thermopile Array (TPA)
    V 1
    first preamp
    V j
    j-th preamplifier (1 ≤ j ≤ M)
    V M
    M-th preamp
    VN i, j
    i, j-th post-amplifier (1 ≤ i ≤ N) (1 ≤ j ≤ M)
  • QUOTES INCLUDE IN THE DESCRIPTION
  • This list of the documents listed by the applicant has been generated automatically and is included solely for the better information of the reader. The list is not part of the German patent or utility model application. The DPMA assumes no liability for any errors or omissions.
  • Cited patent literature
    • EP 1913420 B1 [0003]
    • DE 102007005187 B4 [0003]
    • DE 102005045993 B4 [0003, 0003]
    • DE 102005045993 A1 [0003]
    • DE 102012024597 B4 [0003]
    • DE 102013013664 B3 [0003]
    • EP 2631674 [0003]
    • EP 2924466 [0003]
    • EP 2924459 [0003]
    • EP 2924460 [0003]
    • EP 1979764 B8 [0003]
    • EP 1979764 B1 [0003]
    • WO 2008092611 A1 [0003]
    • EP 2679982 A1 [0003, 0003]
    • EP 2016480 B1 [0003, 0004]
    • EP 2598908 A1 [0003]
    • WO 2013113456 A1 [0003]
    • EP 2653885 A1 [0003]
    • EP 2405283 B1 [0003]
    • EP 2602635 B1 [0003]
    • EP 1671160 B1 [0003]
    • WO 2013037465 A1 [0003]
    • EP 1901947 B1 [0003]
    • EP 1747484 B1 [0003]
    • EP 2107550 A3 [0003]
    • EP 1723446 B1 [0003]
    • EP 1435509 B1 [0003, 0004]
    • EP 801726 B1 [0003, 0003]
    • EP 1269629 B1 [0003]
    • EP 1480015 A1 [0003]
    • EP 1410507 B1 [0003, 0004]
    • DE 4339574 C2 [0003]
    • DE 4411770 C1 [0003]
    • DE 4411773 C2 [0003]
    • WO 2013083346 A1 [0003]
    • WO 2013076079 A1 [0003]
    • WO 2013156557 A1 [0003]
    • EP 2594023 A1 [0004]
    • US 20120326958 A1 [0004]
    • EP 1258084 B1 [0004]
    • DE 102006020570 A1 [0004]
    • DE 10133823 A1 [0004]
    • DE 102012010627 A1 [0004]
    • DE 102012024778 A1 [0004, 0016, 0016, 0016, 0016, 0018, 0018, 0018, 0018, 0018, 0036]
    • DE 102012025564 A1 [0004]
    • DE 102013019660 A1 [0004]

Claims (1)

  1. Method for distinguishing proximity and two-finger gestures in the recognition of gestures by means of a gesture recognition device (GV) in the operation of human-machine interfaces in conjunction with at least one screen (DS) in a motor vehicle with a gesture recognition object (O), with the Steps, a. Detecting at least one relevant measured value (RM) for a distance of the gesture recognition object (O) from the screen (DS) and / or the reflection amplitude and / or transmission amplitude of the gesture recognition object (O) outside the gesture recognition device (GV) by means of at least one proximity sensor (H, D, K), wherein said detection comprises the sub-steps: i. Generating at least one amplitude modulated transmitter feed signal (S5 i ); ii. Generating at least one amplitude-modulated compensation-sample signal (S3 j ); iii. Generating an optical transmission signal (I1 i ) which depends on the transmitter supply signal (S5 i ); iv. Generating an optical compensation transmission signal (I2 j ) which depends on the compensation supply signal (S3 j ); v. Reflection of the optical transmission signal (I1 i ) on the object (O) for generating a reflected optical transmission signal (I3 j ) vi. linearly superimposed receive the reflected optical transmission signal (I3 j) and the optical compensation transmission signal (I2 j) in at least one photodiode (D j) for generating a photodiode (D j) associated with the received signal (S0 j); vii. wherein the generation of the transmission signal (S5i) and the compensation supply signal (S3 j ) so by means of a control value (S4 i, j ) takes place, 1. the receive signal (S0 j ) no signal components of the compensation supply signal (S3 j ) and the transmission signal (S5 i) contains more and 2 that the average amplitude and / or phase of the transmitter supply signal (S5 i) and / or compensation supply signal (S3 j) proportional (by a control value S4 i, j) is dependent; viii. Using the control value (S4 i, j ) as the relevant measured value (RM) and / or calculating a relevant measured value (RM) as a function of the control value (S4 i, j ); b. Projecting an infrared image of the gesture recognition object (O) onto an infrared sensor array (PIRA) by means of at least one optical projection device ( 1 ); c. Generating at least two infrared measurement signals (IM 1 to IM k ) by means of at least one one-dimensional and / or two-dimensional infrared sensor array (PIRA) with at least two infrared sensors (PIR 1 to PIR k ) within the infrared sensor array (PIRA), each sensitive to are the heat radiation of the human body and each provide at least one infrared measurement signal (IM l ) of the infrared measurement signals (IM 1 to IM k ) of the infrared sensors (PIR 1 to PIR k ); d. Comparison of the relevant measured value (RM) with a first threshold value (SW1) by an evaluation device (AV); e. Performing the method for gesture recognition on the basis of at least two infrared measurement signals, the infrared sensor array (PIRA) provides, and additionally simultaneously based on at least the relevant measured value (RM), if either determined by the preceding step d of the comparison that the relevant Measured value (RM) is below the first threshold (SW1), or it is determined that the relevant measured value (RM) is above the first threshold (SW1); f. Evaluation of the gesture recognition result by i. Output of the recognition result by signaling and / or ii. Operating an actuator un / or iii. Change the system state of the gesture recognition device that performs this method and / or iv. Changing the system state of the device, part of which is the gesture recognition device performing this method, and / or v. Changing the system state of a device system, part of which is the gesture recognition device that performs this method; G. and wherein the infrared sensor array (PIRA) is a one or two-dimensional array of passive infrared sensors (PIR 1 to PIR k ), wherein a passive infrared sensor (PIR l ) of these passive infrared sensors (PIR 1 to PIR k ) characterized in that it contains at least one pyroelectric element and that the associated infrared measurement signal (IM l ) of the relevant infrared sensor (PIR l ) changes with infrared irradiation of the pyroelectric element.
DE102015015245.9A 2015-11-18 2015-11-18 Simple gesture recognition device Pending DE102015015245A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
DE102015015245.9A DE102015015245A1 (en) 2015-11-18 2015-11-18 Simple gesture recognition device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
DE102015015245.9A DE102015015245A1 (en) 2015-11-18 2015-11-18 Simple gesture recognition device

Publications (1)

Publication Number Publication Date
DE102015015245A1 true DE102015015245A1 (en) 2017-05-18

Family

ID=58640515

Family Applications (1)

Application Number Title Priority Date Filing Date
DE102015015245.9A Pending DE102015015245A1 (en) 2015-11-18 2015-11-18 Simple gesture recognition device

Country Status (1)

Country Link
DE (1) DE102015015245A1 (en)

Citations (37)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE4411773C2 (en) 1993-07-02 1997-08-07 Gerd Reime Means for controlling a windscreen wiper system
DE4339574C2 (en) 1993-11-19 1999-07-15 Gerd Reime Evaluation device for signals which have been determined by a measuring arrangement for measuring or detecting a wetting of a surface
EP0801726B1 (en) 1994-09-01 2001-07-25 Gerd Reime Circuit for setting the operating point of an opto-electronic component
DE10133823A1 (en) 2001-07-16 2003-02-27 Gerd Reime Optoelectronic device for detecting position and motion and associated method
EP1269629B1 (en) 2000-01-18 2003-10-08 Gerd Reime Opto-electronic switch which evaluates changes in motion
EP1480015A1 (en) 2003-05-20 2004-11-24 Gerd Reime Method and device for measuring a modulated light signal
EP1258084B1 (en) 2000-01-18 2005-05-25 Gerd Reime Device and method for evaluating a useful signal originating from a proximity sensor
DE102005045993A1 (en) 2005-07-29 2007-02-01 Gerd Reime A method for light propagation time measurement
EP1671160B1 (en) 2003-10-08 2007-05-02 Mechaless Systems GmbH Method for determining and/or evaluating a differential optical signal
DE102006020570A1 (en) 2006-05-01 2007-11-08 Mechaless Systems Gmbh Optoelectronic device for detecting the position and / or movement of an object and associated method
EP1435509B1 (en) 2003-01-03 2008-01-16 Gerd Reime Optoelectronic measuring method and device
EP1723446B1 (en) 2004-03-09 2008-07-30 Gerd Reime Access control device
WO2008092611A1 (en) 2007-01-29 2008-08-07 Gerd Reime Method and device for determining the distance to a retroreflective object
EP2107550A2 (en) 2008-04-01 2009-10-07 ELMOS Semiconductor AG Device for monitoring a monitor control
EP1747484B1 (en) 2004-05-19 2012-01-25 Mechaless Systems GmbH Device and method for identifying an object in or on a closable opening
EP1979764B1 (en) 2006-01-24 2012-04-25 Mechaless Systems GmbH Method for measuring the transit time of light
US20120326958A1 (en) 2006-12-08 2012-12-27 Johnson Controls Technology Company Display and user interface
EP1901947B1 (en) 2005-07-12 2013-01-09 Mechaless Systems GmbH Method and device for detecting an approaching person or object
WO2013037465A1 (en) 2011-09-12 2013-03-21 Reime Gerd Optical measuring device for a vehicle and corresponding vehicle
EP2594023A1 (en) 2010-07-16 2013-05-22 Mechaless Systems GmbH Optical operating element, more particularly pushbutton or switch
WO2013076079A1 (en) 2011-11-22 2013-05-30 Elmos Semiconductor Ag Method and measuring system for measuring distance based on the transit time of compensated pulses
EP2598908A1 (en) 2010-07-30 2013-06-05 Mechaless Systems GmbH Opto-electronic measuring arrangement with electro-optical basic coupling
WO2013083346A1 (en) 2011-12-06 2013-06-13 Elmos Semiconductor Ag Method for measuring a transmission path by means of compensating amplitude measurement and the delta-sigma method and device for carrying out the method
WO2013113456A1 (en) 2012-02-03 2013-08-08 Mechaless Systems Gmbh Compensation of an optical sensor via printed circuit board
EP2631674A1 (en) 2012-02-23 2013-08-28 ELMOS Semiconductor AG Method and sensor system for measuring the properties of a transfer segment of a measuring system between transmitter and recipient
EP2653885A1 (en) 2012-04-18 2013-10-23 ELMOS Semiconductor AG Method and sensor system for measuring the transfer properties of a transfer segment of a measuring system between transmitter and recipient
DE102012025564A1 (en) 2012-05-23 2013-11-28 Elmos Semiconductor Ag Device for recognizing three-dimensional gestures to control e.g. smart phone, has Hidden Markov model (HMM) which executes elementary object positions or movements to identify positioning motion sequences
DE102012010627A1 (en) 2012-05-23 2013-11-28 Elmos Semiconductor Ag Object detecting and measuring system i.e. gesture detecting system, for detecting gesture parameters of man machine interface during control of e.g. computer, has unit executing steps of feature-extraction and emission computation
DE102012024778A1 (en) 2012-05-23 2013-11-28 Elmos Semiconductor Ag Recognition system for contactless detection of human-machine interface three dimensional object- or gesture parameters, has controller, where signal generated from light emitted from transmitter is compared with signal received by receiver
EP2679982A1 (en) 2012-06-28 2014-01-01 ELMOS Semiconductor AG Method and sensor system for measuring the transmission properties of a transmission path of a measuring system between transmitter and recipient
EP2405283B1 (en) 2010-07-06 2014-03-05 Mechaless Systems GmbH Optoelectronic measuring assembly with a compensation light source
DE102012024597B4 (en) 2012-12-13 2014-07-24 Elmos Semiconductor Ag Time-resolved delay measurement system
DE102013013664B3 (en) 2013-08-17 2014-08-14 Elmos Semiconductor Ag Time resolution delay measurement system has controller whose control characteristic is selected, such that amplitude of receiver output signal and parasitic elements of system caused control error are considered as constant
DE102013019660A1 (en) 2013-02-12 2014-08-14 Elmos Semiconductor Ag Sensor system for optical measurement of biometric parameters of animal or plant or human, has first transmitter, second transmitter and receiver, where first transmitter is operated with first feed signal of signal generator
EP2924460A1 (en) 2014-03-25 2015-09-30 ELMOS Semiconductor AG Sensor system for identifying at least one object in a transmission line by means of a diode
EP2924459A1 (en) 2014-03-25 2015-09-30 ELMOS Semiconductor AG Sensor system for identifying at least one object in a transmission line
EP2924466A1 (en) 2014-03-25 2015-09-30 ELMOS Semiconductor AG Sensor system for identifying at least one object of a transmission line

Patent Citations (45)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE4411770C2 (en) 1993-07-02 2001-03-08 Gerd Reime Means for controlling a windscreen wiper system
DE4411773C2 (en) 1993-07-02 1997-08-07 Gerd Reime Means for controlling a windscreen wiper system
DE4339574C2 (en) 1993-11-19 1999-07-15 Gerd Reime Evaluation device for signals which have been determined by a measuring arrangement for measuring or detecting a wetting of a surface
EP0801726B1 (en) 1994-09-01 2001-07-25 Gerd Reime Circuit for setting the operating point of an opto-electronic component
EP1269629B1 (en) 2000-01-18 2003-10-08 Gerd Reime Opto-electronic switch which evaluates changes in motion
EP1258084B1 (en) 2000-01-18 2005-05-25 Gerd Reime Device and method for evaluating a useful signal originating from a proximity sensor
DE10133823A1 (en) 2001-07-16 2003-02-27 Gerd Reime Optoelectronic device for detecting position and motion and associated method
EP1410507B1 (en) 2001-07-16 2004-11-24 Gerd Reime Optoelectronic device for detecting position and movement and method associated therewith
EP1435509B1 (en) 2003-01-03 2008-01-16 Gerd Reime Optoelectronic measuring method and device
EP1480015A1 (en) 2003-05-20 2004-11-24 Gerd Reime Method and device for measuring a modulated light signal
EP1671160B1 (en) 2003-10-08 2007-05-02 Mechaless Systems GmbH Method for determining and/or evaluating a differential optical signal
EP1723446B1 (en) 2004-03-09 2008-07-30 Gerd Reime Access control device
EP1747484B1 (en) 2004-05-19 2012-01-25 Mechaless Systems GmbH Device and method for identifying an object in or on a closable opening
EP1901947B1 (en) 2005-07-12 2013-01-09 Mechaless Systems GmbH Method and device for detecting an approaching person or object
DE102005045993A1 (en) 2005-07-29 2007-02-01 Gerd Reime A method for light propagation time measurement
DE102005045993B4 (en) 2005-07-29 2008-11-13 Gerd Reime A method for light propagation time measurement
EP1913420B1 (en) 2005-07-29 2011-05-25 Gerd Reime Method for light propagation time measurement
EP1979764B1 (en) 2006-01-24 2012-04-25 Mechaless Systems GmbH Method for measuring the transit time of light
DE102006020570A1 (en) 2006-05-01 2007-11-08 Mechaless Systems Gmbh Optoelectronic device for detecting the position and / or movement of an object and associated method
EP2016480B1 (en) 2006-05-01 2013-10-23 Mechaless Systems GmbH Optoelectronic device for the detection of the position and/or movement of an object, and associated method
US20120326958A1 (en) 2006-12-08 2012-12-27 Johnson Controls Technology Company Display and user interface
DE102007005187B4 (en) 2007-01-29 2008-11-20 Gerd Reime Method and apparatus for determining a distance to a retroreflective object
WO2008092611A1 (en) 2007-01-29 2008-08-07 Gerd Reime Method and device for determining the distance to a retroreflective object
EP2107550A2 (en) 2008-04-01 2009-10-07 ELMOS Semiconductor AG Device for monitoring a monitor control
EP2405283B1 (en) 2010-07-06 2014-03-05 Mechaless Systems GmbH Optoelectronic measuring assembly with a compensation light source
EP2594023A1 (en) 2010-07-16 2013-05-22 Mechaless Systems GmbH Optical operating element, more particularly pushbutton or switch
EP2598908A1 (en) 2010-07-30 2013-06-05 Mechaless Systems GmbH Opto-electronic measuring arrangement with electro-optical basic coupling
WO2013037465A1 (en) 2011-09-12 2013-03-21 Reime Gerd Optical measuring device for a vehicle and corresponding vehicle
WO2013076079A1 (en) 2011-11-22 2013-05-30 Elmos Semiconductor Ag Method and measuring system for measuring distance based on the transit time of compensated pulses
WO2013083346A1 (en) 2011-12-06 2013-06-13 Elmos Semiconductor Ag Method for measuring a transmission path by means of compensating amplitude measurement and the delta-sigma method and device for carrying out the method
EP2602635B1 (en) 2011-12-06 2014-02-19 ELMOS Semiconductor AG Method for measuring a transfer route by means of compensating amplitude measurement and delta-sigma method and device for performing the method
WO2013113456A1 (en) 2012-02-03 2013-08-08 Mechaless Systems Gmbh Compensation of an optical sensor via printed circuit board
EP2631674A1 (en) 2012-02-23 2013-08-28 ELMOS Semiconductor AG Method and sensor system for measuring the properties of a transfer segment of a measuring system between transmitter and recipient
EP2653885A1 (en) 2012-04-18 2013-10-23 ELMOS Semiconductor AG Method and sensor system for measuring the transfer properties of a transfer segment of a measuring system between transmitter and recipient
WO2013156557A1 (en) 2012-04-18 2013-10-24 Elmos Semiconductor Ag Sensor system and method for measuring the transmission properties of a transmission path of a measuring system between a transmitter and a receiver
DE102012025564A1 (en) 2012-05-23 2013-11-28 Elmos Semiconductor Ag Device for recognizing three-dimensional gestures to control e.g. smart phone, has Hidden Markov model (HMM) which executes elementary object positions or movements to identify positioning motion sequences
DE102012024778A1 (en) 2012-05-23 2013-11-28 Elmos Semiconductor Ag Recognition system for contactless detection of human-machine interface three dimensional object- or gesture parameters, has controller, where signal generated from light emitted from transmitter is compared with signal received by receiver
DE102012010627A1 (en) 2012-05-23 2013-11-28 Elmos Semiconductor Ag Object detecting and measuring system i.e. gesture detecting system, for detecting gesture parameters of man machine interface during control of e.g. computer, has unit executing steps of feature-extraction and emission computation
EP2679982A1 (en) 2012-06-28 2014-01-01 ELMOS Semiconductor AG Method and sensor system for measuring the transmission properties of a transmission path of a measuring system between transmitter and recipient
DE102012024597B4 (en) 2012-12-13 2014-07-24 Elmos Semiconductor Ag Time-resolved delay measurement system
DE102013019660A1 (en) 2013-02-12 2014-08-14 Elmos Semiconductor Ag Sensor system for optical measurement of biometric parameters of animal or plant or human, has first transmitter, second transmitter and receiver, where first transmitter is operated with first feed signal of signal generator
DE102013013664B3 (en) 2013-08-17 2014-08-14 Elmos Semiconductor Ag Time resolution delay measurement system has controller whose control characteristic is selected, such that amplitude of receiver output signal and parasitic elements of system caused control error are considered as constant
EP2924460A1 (en) 2014-03-25 2015-09-30 ELMOS Semiconductor AG Sensor system for identifying at least one object in a transmission line by means of a diode
EP2924459A1 (en) 2014-03-25 2015-09-30 ELMOS Semiconductor AG Sensor system for identifying at least one object in a transmission line
EP2924466A1 (en) 2014-03-25 2015-09-30 ELMOS Semiconductor AG Sensor system for identifying at least one object of a transmission line

Similar Documents

Publication Publication Date Title
EP0624857B1 (en) Passive type moving object detection system
US5196688A (en) Apparatus for recognizing and following a target
US20180025196A1 (en) Depth sensor based auto-focus system for an indicia scanner
US4949074A (en) Method of intrusion detection
US10249030B2 (en) Image transformation for indicia reading
JP2016529474A (en) Detector for optically detecting at least one object
US4903009A (en) Intrusion detection device
US7674052B2 (en) Object detection apparatus
JP4161910B2 (en) Range image data generating apparatus and method generating a program
US9927522B2 (en) Determining positional information of an object in space
US8542348B2 (en) Color sensor insensitive to distance variations
WO2011094366A1 (en) Gesture recognition with principal component anaysis
EP1167127A2 (en) Optimized human presence detection through elimination of background interference
US20050077469A1 (en) Head position sensor
CA2657677C (en) Optical distance measuring method and corresponding optical distance measurement device
US8102261B2 (en) Microwave ranging sensor
JP2009100256A (en) Object detecting device
US20110298753A1 (en) Optical touch panel and touch display panel and touch input method thereof
CN104898125B (en) The small-sized LIDAR of low cost for automobile
WO1998040762A1 (en) Image-directed active range finding system
US5465080A (en) Infrared intrusion sensor
EP1167126B1 (en) Human presence detection, identification and tracking using a facial feature image sensing system for airbag deployment
US8077034B2 (en) Sensor for presence detection
US20020148983A1 (en) Displacement sensor
WO2014024284A1 (en) Collision prediction device

Legal Events

Date Code Title Description
R082 Change of representative