CN105718064A - Gesture recognition system and method based on ultrasonic waves - Google Patents
Gesture recognition system and method based on ultrasonic waves Download PDFInfo
- Publication number
- CN105718064A CN105718064A CN201610045717.7A CN201610045717A CN105718064A CN 105718064 A CN105718064 A CN 105718064A CN 201610045717 A CN201610045717 A CN 201610045717A CN 105718064 A CN105718064 A CN 105718064A
- Authority
- CN
- China
- Prior art keywords
- signal
- gesture
- sound wave
- acoustic
- measurement
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 26
- 238000005259 measurement Methods 0.000 claims abstract description 50
- 230000008859 change Effects 0.000 claims description 27
- 238000006073 displacement reaction Methods 0.000 claims description 22
- 230000000875 corresponding effect Effects 0.000 claims description 14
- 238000000605 extraction Methods 0.000 claims description 5
- 238000005070 sampling Methods 0.000 claims description 5
- 238000004364 calculation method Methods 0.000 claims description 2
- 230000002596 correlated effect Effects 0.000 claims description 2
- 238000013139 quantization Methods 0.000 claims description 2
- 238000002310 reflectometry Methods 0.000 claims description 2
- 238000002604 ultrasonography Methods 0.000 description 10
- 230000033001 locomotion Effects 0.000 description 8
- 230000008569 process Effects 0.000 description 6
- 230000000694 effects Effects 0.000 description 5
- 230000011514 reflex Effects 0.000 description 5
- 230000036962 time dependent Effects 0.000 description 4
- 230000009471 action Effects 0.000 description 3
- 238000010586 diagram Methods 0.000 description 3
- 238000004458 analytical method Methods 0.000 description 2
- 230000008901 benefit Effects 0.000 description 2
- 230000007547 defect Effects 0.000 description 2
- 238000001514 detection method Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 230000010354 integration Effects 0.000 description 2
- 230000004807 localization Effects 0.000 description 2
- 238000010801 machine learning Methods 0.000 description 2
- 230000009467 reduction Effects 0.000 description 2
- 230000011664 signaling Effects 0.000 description 2
- 238000001228 spectrum Methods 0.000 description 2
- 238000012706 support-vector machine Methods 0.000 description 2
- 230000009466 transformation Effects 0.000 description 2
- 238000012935 Averaging Methods 0.000 description 1
- 239000000654 additive Substances 0.000 description 1
- 230000000996 additive effect Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000012937 correction Methods 0.000 description 1
- 230000008878 coupling Effects 0.000 description 1
- 238000010168 coupling process Methods 0.000 description 1
- 238000005859 coupling reaction Methods 0.000 description 1
- 230000007423 decrease Effects 0.000 description 1
- 238000005562 fading Methods 0.000 description 1
- 238000001914 filtration Methods 0.000 description 1
- 230000004927 fusion Effects 0.000 description 1
- 238000012905 input function Methods 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000000691 measurement method Methods 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 230000000717 retained effect Effects 0.000 description 1
- 230000005236 sound signal Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S15/00—Systems using the reflection or reradiation of acoustic waves, e.g. sonar systems
- G01S15/02—Systems using the reflection or reradiation of acoustic waves, e.g. sonar systems using reflection of acoustic waves
- G01S15/50—Systems of measurement, based on relative movement of the target
- G01S15/58—Velocity or trajectory determination systems; Sense-of-movement determination systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
- G06F3/043—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means using propagating acoustic waves
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Acoustics & Sound (AREA)
- Radar, Positioning & Navigation (AREA)
- Remote Sensing (AREA)
- Computer Networks & Wireless Communication (AREA)
- Measurement Of Velocity Or Position Using Acoustic Or Ultrasonic Waves (AREA)
Abstract
The invention discloses a gesture recognition system based on ultrasonic waves.The gesture recognition system comprises an electronic device capable of transmitting acoustic waves and recording acoustic wave signals at the same time, and the electronic device comprises an acoustic wave transmitter, an acoustic wave receiver and a measurement and recognition module.The electronic device controls the acoustic wave transmitter to transmit the acoustic waves, and the transmitted acoustic waves irradiate a target to generate reflected waves; the acoustic wave receiver receives the acoustic wave signals to send the acoustic wave signals to the measurement and recognition module, the acoustic waves are measured, and the gesture parameters are obtained to recognize gestures; the electronic device controls the acoustic wave receiver to receive the acoustic waves, the acoustic wave signals reflected by the target are obtained, the acoustic wave signals received by the acoustic wave receiver are mixed signals, the mixed signals comprise direct signals from acoustic sources, signals reflected by nearby objects and signals reflected by the target at the same time.The invention further discloses a gesture recognition method based on the ultrasonic waves.
Description
Technical field
The present invention relates to signal processing and field of human-computer interaction, particularly relate to a kind of based on hyperacoustic gesture recognition system.
Background technology
Universal along with smart mobile phone and all kinds of intelligence wearable device (such as intelligent watch, Intelligent bracelet etc.), the input function of smart machine is proposed higher demand by people.Existing smart machine depends on touch screen input, has a disadvantage in that: one, touch screen is only applicable to large volume of equipment, and on the mini-plants such as intelligent watch, the area of touch screen is very little, it is impossible to meet complicated input demand；Two, during touch-screen input, finger can stop portions show, and easily triggers maloperation；Three, touch screen is relatively costly.
For solving these problems of touch screen, Recent study person proposes the input utilizing non-contact gesture identification to carry out auxiliary touch-screen.Non-contact gesture identification utilizes smart machine to launch ultrasound wave or radio signal, is analyzed to realize the purpose of gesture identification by the signal that staff is reflected.According to the gesture identified, it is possible to complete the basic operations such as page turning, roll screen.It is little that Non-contact gesture identification has sensor bulk, and price is low, and working range is big, not by the advantage of the impact of the accessories such as glove.
The main implementation of existing Non-contact gesture identification has two kinds.A kind of Soundwave system with Microsoft, for representative, realizes mainly through ultrasound wave.Specific implementation is to launch ultrasound wave by mobile phone speaker, utilizes mobile microphone to gather staff reflectance ultrasound ripple signal, the Doppler frequency of detection reflectance ultrasound ripple, utilizes the change of frequency to judge the direction of motion and the speed of hands.It is calculated machine operation according to the direction of motion and speed.Existing ultrasound wave gesture identification has the disadvantage that: doppler frequency measurement requires over Time-Frequency Analysis, and granularity is relatively thick, can only realize rough moving direction and translational speed is measured.And based on the technology of ultrasonic ranging it is generally required to special acoustic wave transducer, smart machine realizes have any problem.The second implementation, with the ProjectSoli system of Google company for representative, realizes mainly through 60GHz radio wave.Specific implementation is to send millimeter wave, the millimeter-wave signal of detection staff reflection by the 60GHz transceiver of miniaturization, realizes the identification to gesture by waveform analysis.The advantage of the 60GHz millimeter wave scheme that Google adopts is in that millimetre wavelength is very short, is typically in less than 5 millimeters.Such Microwave emission and reception equipment can be made smaller, and the radio wave of short wavelength simultaneously can improve the precision that gesture is measured further.But, the system based on millimeter wave needs to add special gesture identification chip and antenna on smart machine, brings fringe cost.
Summary of the invention
The present invention is directed to the defect of prior art, propose to utilize the speaker of commercial intelligent electronic device and mike to realize high-precision measuring based on hyperacoustic gesture, improve the precision of ultrasonic measurement, make use of again the hardware of existing equipment, it does not have additional firmware cost simultaneously.The ultimate principle of the present invention is to measure the interference waveform of staff reflected signal, measures the move distance of staff according to interference waveform.This mode can realize the direct measurement adjusted the distance, it is possible to reaches the range measurement accuracy within 5 millimeters, it is achieved high-precision gesture identification.
The present invention proposes a kind of based on hyperacoustic gesture recognition system.Technical scheme, for the weakness of existing gesture recognition system, solves and realizes high accuracy gesture measurement problem by ultrasound wave.
The present invention is by the following technical solutions:
Based on hyperacoustic gesture identification method, sound wave launched by electronic equipment, records acoustic signals simultaneously.The acoustic signals received is carried out Digital Down Convert, obtains baseband signal.The phase place of baseband signal is measured, the displacement according to the change calculations target of phase place, carry out gesture identification according to moving characteristic and perform respective operations.
Further, described acoustic signals is ultrasonic signal.
Further, described Digital Down Convert operation is to be mixed with launching signal by reception signal, obtains orthogonal baseband vector signal.
Further, described acoustic signals is unifrequency acoustic signals or multiple unifrequency acoustic signals superposition.
Further, described phase measurement refers to after baseband signal is deducted direct signal vector, measures the phase place change of residual reflectivity signal phasor.
Further, described gesture identification refers to by extracting mobile correlated characteristic, contrasts gesture library template, identifies gesture and carries out respective operations.
Further, the change that the measurement of described displacement is increased by phase place or reduces judges moving direction.
Further, described gesture identification is according to moving direction, by the corresponding numerical parameter of the proportional increase of displacement or reduction.
Further, described electronic equipment includes computer, notebook, smart mobile phone, Intelligent worn device etc..
Further, described displacement is measured and is multiplied by phase place change by signal wavelength and obtains.
Further, described phase measurement carries out on the sound wave of multiple frequencies simultaneously, according to reflected signal quality, measurement result is merged.
Further, described electronic equipment can pass through multiple mikes and obtain reflected signal, determines the position of target according to reflection path length.
Beneficial effect
The present invention is directed to the defect of the existing gesture recognition system based on Doppler effect, it is proposed to the method that directly interference waveform of measurement reflected signal obtains the displacement of staff.Existing Doppler measurement technique obtains the reflection wave frequency change in the short time by fast Fourier transform, have a disadvantage in that, Fourier transformation needs substantial amounts of data point to reach higher frequency spectrum precision, so there is restricting relation in its time precision and frequency spectrum precision, it is impossible to measures frequency accurately in the short period of time.After measuring frequency, integration obtains distance change, and the error brought is bigger.And directly measure the interference waveform method of reflected signal, it is possible to directly measure the phase place of interference waveform, it is to avoid Fourier transformation process, directly measure displacement.Utilize the measuring method that the present invention proposes, it is possible to reach the range measurement accuracy within 5 millimeters with ventional loudspeakers and mike.Meanwhile, the computation complexity of the present invention is relatively low, it is possible to be directly realized by existing smart machine.
Accompanying drawing explanation
Fig. 1 is the system architecture diagram of the present invention.
Fig. 2 is the measurement implementing procedure figure with identification module of the present invention.
Fig. 3 is a kind of implementing procedure figure of Digital Down Converter Module of the present invention.
Fig. 4 is real part and the imaginary part curve of baseband vector signal.
Fig. 5 is the two-dimentional complex plane curve of baseband vector signal.
Fig. 6 is a kind of gesture identification schematic diagram that the present invention is corresponding.
Detailed description of the invention
Below in conjunction with the drawings and specific embodiments, the present invention is described in further detail.
The present invention utilizes staff to hyperacoustic reflection, measures the displacement of staff, and then gesture is identified.The present invention is mainly technically characterized ny one, utilizes sound wave to measure；Two, Digital Down Convert；Three, the phase place of baseband signal is measured acquisition displacement.
Fig. 1 is the system structure of the present invention.The equipment such as wherein 101 electronic equipments can be computer, notebook, smart mobile phone, intelligence wearable device.Existing most of electronic equipment has been equipped with 102 pingers and 103 acoustic receivers.Specifically, 102 pingers refer to speaker.The speaker that electronic equipment carries can be included, the speaker/earphone accessed by wired speaker interface or the speaker passing through the access of the wave point such as bluetooth, WiFi etc..103 acoustic receivers refer to mike.The mike that electronic equipment carries can be included, the mike accessed by wire microphone interface or the mike passing through the access of the wave point such as bluetooth, WiFi etc..Speaker and mike may each be one or more, and particular hardware form can be general broadcasting/sound pick-up outfit (namely can be used for the hardware of broadcasting, recording voice and music), it is also possible to be special ultrasonic transducer.
101 electronic equipments control 102 pingers and send sound wave, and the sound wave of transmitting can produce echo after being irradiated to 105 targets.101 electronic equipments control 103 acoustic receivers and receive sound wave, obtain the acoustic signals of target reflection.Here 105 targets are primarily referred to as staff, including single/multiple finger or whole palm.The acoustic signals that 103 acoustic receivers receive is usually a mixed signal, includes the signal gone directly from sound source simultaneously, through the signal that neighbouring object reflects, and the signal through 105 target reflections.After 103 acoustic receivers receive acoustic signals, it is sent to 104 measurements and identification module, sound wave is measured, after obtaining gesture parameter, gesture is identified.104 measure with identification module can physically with 101 electronic equipments in same entity, it is also possible in externally-located server.
The sound wave that 101 electronic equipments are launched can be ultrasound wave, i.e. the sound wave of more than the 17KHz that human ear cannot be discovered, it is also possible to be less than the sound wave of 17KHz.The present invention mainly utilizes single-frequency sound wave, i.e. the time-independent sound wave of acoustical signal frequency.Concrete frequency is depending on the sample frequency of equipment.Existing electronic equipment generally individually support fsThe sample frequency of=44.1KHz, therefore can send highest frequency is fsThe sound wave of/2=22.05KHz.When equipment supports high sample frequency, during such as 48KHz, 96KHz or higher frequency, system can send the sound wave of higher frequency.Except single-frequency sound wave, system can send multiple single-frequency sound wave to reach better measurement effect simultaneously.Such as, system can launch the sound wave of 17KHz, 18KHz, 19KHz simultaneously, measures reflection sound wave situation of change on these frequencies respectively.
Fig. 2 describes a kind of implementation process of 104 measurements and identification module.First, after 103 acoustic receivers collect sound wave, undertaken sampling by 201 sonic data acquisition modules and quantization becomes digital signal.Sample frequency needs consistent with the sample frequency adopted when launching sound wave.After digital sample, it is mixed by the sound wave of 202 Digital Down Converter Module Yu transmitting, obtains baseband vector signal.Subsequently, in 203 phase measurement modules, baseband vector signal is carried out phase measurement.Obtained the displacement of 105 targets by phase measurement, extract the gesture parameter based on displacement and translational speed.Finally, in 205 gesture recognition module, identify concrete gesture and perform corresponding operation according to gesture.
Fig. 3 describes a kind of implementation of 202 Digital Down Converter Module.First, 301 sound waves collected are obtained after the signal digitized that 103 acoustic receivers are collected.The sound wave that Digital Down Converter Module collects 301 is divided into two-way, and the sound wave that a road is launched with system is multiplied, the cosine cos real number signal referring here to launching sound wave same frequency；Another road and system are launched acoustic phase and are differed from the signal multiplication of 90 degree, the sinusoidal sin real number signal that this refers to launch sound wave same frequency.After completing multiplication, two-way result is filtered operation respectively through two same low pass filters 304 and 305.Low frequency signal is retained and removes high-frequency signal by low pass filter, and main reserve frequency is at cut-off frequency f herevFollowing information.Cut-off frequency depends on movement velocity and the wave length of sound of hands.Subsequently, two-way low frequency baseband signal can reduce sample rate by lower sampling.Finally obtain two paths of signals: 306 baseband inphase components (Inphase) and 307 base band quadrature components (Quadrature).Base band quadrature vector signal refers to the complex signal being made up of in-phase component (real part) and quadrature component (imaginary part).In realizing process, low-pass filtering and down-sampling can also be realized by a pair pectination integration filter (CIC), process complexity with reduction.When launching sound wave and comprising multiple single-frequency sound wave component, it is necessary to each single-frequency sound wave is carried out Digital Down Convert.So each frequency all can a corresponding base band quadrature vector signal.Certain down conversion module can also pass through analog circuit or dedicated devices realizes, and when without departing substantially from down coversion essence, other down coversion modes belong to protection scope of the present invention.
Baseband vector signal is the superposition of direct signal and reflected signal, and its form is time dependent complex signal.Fig. 4 describes the baseband vector signal pushing away and regaining under action before palm.Real part and imaginary part are depicted by respectively with solid line and dotted line.From fig. 4, it can be seen that real part and imaginary part comprise a basic direct current offset (such as, the meansigma methods of real part is about 1800) and time dependent waveform.Wherein direct current offset correspond to from speaker directly to mike, and the signal through fixing object reflections such as surrounding wall.This component of signal is time-independent.And be time dependent by the signal of palmar reflex.Fig. 5 depicts the vector signal curvilinear path in two dimension complex plane of correspondence.Owing to the real part in Fig. 4 and imaginary part curve are close to sine wave curve, so its two dimension complex plane curve is close to round.Under this action, the change of the amplitude of reflected signal is less and phase place is periodically variable.
The time dependent rule of palm depends on the principle of interference of physical signalling.Owing to the path of reflected signal can change along with palm moves, the phase place of corresponding vector signal also can change according to the change of path.When palm is close, path reduces, so the phase place of corresponding vector signal can increase, namely can rotate counterclockwise in two dimension complex plane.When palm increases away from, path, the phase place of corresponding vector signal can reduce, and namely can turn clockwise in two dimension complex plane.So, we can judge the moving direction of palm according to the direction of rotation of baseband vector signal.Propagation property according to physical signalling, when propagation path changes a whole wavelength, phase place changes 2 π.Therefore, we can obtain, by the phase place of measurement baseband vector signal, the relative distance that palm moves.Such as, when audio signal is 17KHz, it is assumed that the velocity of sound is 340 meter per seconds, the wavelength of sound wave is λ=340/17k=2cm.So when palm moves 1cm, from pinger to palmar reflex, then 2cm (consideration trip path) can be changed to the length of propagation path of acoustic receiver.In this case, baseband vector signal can change 2 π.Therefore, we have only to calculate two-dimensional vector signal and changes in the phase place of complex plane, it is possible to the accurately displacement of measurement palm.Owing to namely palm displacement be palm translational speed divided by the time, therefore the change frequency of vector signal correspond to palm translational speed.When palm rate travel is less than v meter per second, actual waveform rate of change is less than 2*v/ λ.Such as, when v=1 meter per second, during λ=2cm, waveform rate of change, less than 100Hz, therefore can be correspondingly arranged the cut-off frequency f of aforementioned 304/305 low pass filtervFor 100Hz.
Being implemented as follows of the 203 phase measurement modules of the present invention: first, takes one section of baseband vector signal.Such as, the signal of corresponding 10ms duration.We need first to remove direct current offset, and concrete grammar is by long vector signal meansigma methods, for instance, the signal averaging in 1 second, estimate the concrete numerical value of direct current offset.In the diagram, we can be about 1800-800i by the real part of first 1 second and the meansigma methods of imaginary part waveform estimated vector signal, and wherein i is imaginary unit.After so deducting the direct current offset of 1800-800i in a segment signal, remaining signal is exactly mainly the reflecting component of palm.We can calculate the phase place change that the argument change of reflecting component judges within the corresponding time.When the argument in special time period varies more than 2 π, it is necessary to obtain the change of real phase place by unwinding operation.The phase changing capacity assumed in preset time section is θ, and we can utilize formulaCalculate the path change length in preset time section.In above formula, λ is wave length of sound, it is possible to pass through formulaObtaining, the c in formula is sonic propagation speed, and f is the corresponding frequency launching sound wave.Measuring through reality, profit can reach the range measurement accuracy within 5mm in this way.Meanwhile, the measurement response time is extremely short, depending on distinct device, just can complete one-shot measurement within generally having only to 50ms.Certainly, the phase measurement for vector signal also has many additive methods, including numeral or analog phase-locked look, time differential phase height measurement amount, zero crossing counting etc., only lists one of which here.All it is possible without departing substantially from the ultimate principle of phase measurement when.
The above phase measurement is for single frequency signal.Due to the multipath effect of sonic propagation, can there is signal fadeout in the signal of single frequency when palm is in some position.Now, owing to palmar reflex signal also vector superposed is formed by multiple, the change of its phase place will not realize in the sinusoidal signal mode of rule.At this moment, it is easy to bring bigger error by phase measurement, it is therefore desirable to alleviated the impact of multipath effect by the sound wave of multiple different frequencies.Concrete mode is the ultrasound wave that emitter sends multiple different frequencies, and the ultrasound wave of different frequency is carried out Digital Down Convert and obtains baseband signal by receptor respectively, and carries out displacement measurement.Owing to ultrasonic signal frequency is different, the distance of its generation multipath fading is also different.So, unlike signal will not decline simultaneously, always has some good frequencies can provide range measurement accurately.Therefore, we can utilize the mode of data fusion to integrate range measurements on a different frequency.For example, the range measurements on different frequency can be averaged by we, to reduce the error effects that single frequency brings.Another way is to carry out maximum-ratio combing (MaximumRatioCombining) according to the reflected signal strength on different frequency, namely according to the signal to noise ratio of reflected signal in each frequency, result is weighted on average.Certainly, the mode also having a lot of measurement results to merge, just do not enumerate here.
The gesture identification process of the present invention is carried out two modules by 204 gesture parameter extractions and 205 gesture identification and is realized.In gesture parameter extraction process, the present invention is according to phase measurement, and displacement, moving direction, translational speed and reflex strength that extraction gesture moves are used as characteristic parameter.In gesture identification process, the gesture motion feature extracted is utilized to identify concrete action and perform associative operation.
The implementation of gesture parameter extraction and gesture identification has a variety of, only enumerates several embodiment here.Similar embodiment is all within protection scope of the present invention.
Gesture identification embodiment 1: adjust numerical parameter according to displacement and direction.Due to phase measurement module can accurately measure staff near and away from the distance of equipment, the present invention can directly utilize the distance parameter to electronic equipment and be controlled.Such as, we can utilize the movement of hands or finger to adjust the volume of player, near representing that volume increases, away from representing that volume reduces.The concrete value increased and reduce is directly proportional to the distance of movement.Such as, represent that volume improves 10% near 1cm, represent volume raising 20% etc. near 2cm.The similar numerical parameter that can utilize the present embodiment adjustment includes: screen intensity, ticker position, clock Hour Minute Second etc., does not just enumerate here.
Gesture identification embodiment 2: realize two-dimensional localization and the tracking of hands or finger.Fig. 6 illustrates the present invention and realizes the embodiment of two dimension finger locating and tracking.Two-dimensional localization and tracking can complete the function of similar handwriting pad, it is achieved the application that hands or finger aloft write.Fig. 6 illustrates the system layout of common a kind of smart mobile phone 601.This smart mobile phone is equipped with 604 speakers, is positioned at mobile phone top.And it is equipped with two mikes: 602 mike A and 603 mike B, lay respectively at the upper and lower of mobile phone.601 smart mobile phones can be recorded from mike A and mike B by stereo double channel recording simultaneously.At this moment, the present invention can measure the distance of two paths simultaneously: 606 reflection path A:604 speakers are to 605 palms to 602 mike A, and 607 reflection path B:604 speakers are to 605 palms to 603 mike B.By initial range correction, the present invention can obtain the absolute distance of two paths.Owing to the equidistant curve of every paths is an ellipse under two-dimensional condition, so we can utilize two oval intersection points to calculate the particular location of palm, and palm position is tracked.We can realize simple handwriting input or the function of similar mouse control by the palm curve movement that two-dimensional tracking obtains.
Gesture identification embodiment 3: realize the identification of certain gestures.The present embodiment utilizes the feature of staff certain gestures to identify gesture.Such as, wave under palm smart mobile phone apply in can be mapped to downward scrolling operations.Utilizing above-mentioned phase measurement, the present invention can carry out brandishing work under palm according to palm movement velocity and walking direction user, thus performing downward scrolling operations.Specific embodiment can be pre-defined a series of gesture template, waves as follows, Back stroke, turns over the palm, finger rotation etc..Gathering the mobile data parameters of corresponding gesture, for instance displacement, moving direction, translational speed and reflex strength etc., storage is in gesture template base.Adopt machine learning algorithm, for instance k nearest neighbor algorithm, actual gesture data and template data are mated, export result using the result of the best coupling as gesture and perform operation.Certainly, also having other machine learning algorithm, such as support vector machine (SVM) grader etc., can realize the identification to gesture, these just do not describe one by one.
Certainly; the present invention also can have other various embodiments; when without departing substantially from present invention spirit and essence thereof; those of ordinary skill in the art are when can make various corresponding change and deformation according to the present invention, but these change accordingly and deformation all should belong to the scope of the claims appended by the present invention.
Claims (10)
1. one kind based on hyperacoustic gesture recognition system, it is characterized in that: it includes launching sound wave and records the electronic equipment of acoustic signals simultaneously, described electronic equipment has pinger, acoustic receiver, measurement and identification module, described electronic equipment controls described pinger and sends sound wave, the sound wave launched can produce echo after being irradiated to target, after described acoustic receiver receives acoustic signals, it is sent to described measurement and identification module, sound wave is measured, after obtaining gesture quantitative parameter, gesture is identified；Described electronic equipment controls described acoustic receiver and receives sound wave, obtaining the acoustic signals of target reflection, the acoustic signals that described acoustic receiver receives is a mixed signal, includes the signal gone directly from sound source simultaneously, through the signal that neighbouring object reflects, and the signal through target reflection.
2. gesture recognition system according to claim 1, it is characterised in that:
Described measurement and identification module include sonic data acquisition module, Digital Down Converter Module, phase measurement module, gesture parameter extraction module, gesture recognition module, after described acoustic receiver collects sound wave, undertaken sampling by described sonic data acquisition module and quantization becomes digital signal, sample frequency needs consistent with the sample frequency adopted when launching sound wave, after digital sample, it is mixed by described Digital Down Converter Module and the same frequency signal launching sound wave, obtain baseband vector signal, baseband vector signal is carried out phase measurement by described phase measurement module, the displacement of target is obtained by phase measurement, extract the gesture parameter based on displacement and translational speed, described gesture recognition module identifies concrete gesture and performs corresponding operation according to gesture.
3. gesture recognition system according to claim 2, it is characterised in that described Digital Down Converter Module implementation is: the sound wave collected is divided into two-way, a road is be multiplied with the cosine cos real number signal launching sound wave same frequency；Another Lu Weiyu launches the sinusoidal sin real number signal of sound wave same frequency and is multiplied, two-way is filtered operation respectively through two low pass filters, two-way low frequency baseband signal reduces sample rate by lower sampling, obtain baseband inphase component (Inphase) and base band quadrature component (Quadrature), finally giving base band quadrature vector signal, described base band quadrature vector signal refers to the complex signal being made up of baseband inphase component (real part) and base band quadrature component (imaginary part).
4. one kind based on hyperacoustic gesture identification method, it is characterised in that:
Sound wave launched by electronic equipment, records acoustic signals simultaneously；The acoustic signals received is carried out Digital Down Convert, obtains baseband signal；Baseband signal carried out phase measurement, the displacement according to the change calculations target of phase place, carry out gesture identification according to moving characteristic and perform respective operations.
5. gesture identification method according to claim 4, it is characterised in that:
Described acoustic signals is ultrasonic signal；
Described Digital Down Convert operation is to be mixed with launching signal by reception signal, obtains orthogonal baseband vector signal；
Described phase measurement refers to after baseband signal is deducted direct signal vector, measures the phase place change of residual reflectivity signal phasor.
6. gesture identification method according to claim 5, it is characterised in that:
Described acoustic signals is unifrequency acoustic signals or multiple unifrequency acoustic signals superposition.
7. gesture identification method according to claim 5, it is characterised in that:
Described phase measurement carries out on the sound wave of multiple frequencies simultaneously, according to reflected signal quality, measurement result is merged.
8. according to the gesture identification method one of claim 4 to 7 Suo Shu, it is characterised in that:
Described displacement is measured the change being increased by phase place or reducing and is judged moving direction；
Described gesture identification is according to moving direction, by the proportional operation performing to increase or reduce corresponding numerical parameter of displacement.
9. according to the gesture identification method one of claim 4 to 7 Suo Shu, it is characterised in that:
Described displacement is measured and is multiplied by phase place change by signal wavelength and obtains；
Described gesture identification refers to by extracting mobile correlated characteristic, contrasts gesture library template, identifies gesture and carries out respective operations.
10. according to the gesture identification method one of claim 4 to 7 Suo Shu, it is characterised in that:
Described electronic equipment includes computer, notebook, smart mobile phone, Intelligent worn device；
Described electronic equipment obtains reflected signal by multiple mikes, determines the position of target according to reflection path length.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610045717.7A CN105718064A (en) | 2016-01-22 | 2016-01-22 | Gesture recognition system and method based on ultrasonic waves |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610045717.7A CN105718064A (en) | 2016-01-22 | 2016-01-22 | Gesture recognition system and method based on ultrasonic waves |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN105718064A true CN105718064A (en) | 2016-06-29 |
Family
ID=56153997
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610045717.7A Pending CN105718064A (en) | 2016-01-22 | 2016-01-22 | Gesture recognition system and method based on ultrasonic waves |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105718064A (en) |
Cited By (38)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106325497A (en) * | 2016-07-28 | 2017-01-11 | 广东技术师范学院 | Virtual electronic wall clock based on acoustic wave gesture recognition |
| CN106406524A (en) * | 2016-09-05 | 2017-02-15 | 珠海格力电器股份有限公司 | Equipment control method and device |
| CN106446801A (en) * | 2016-09-06 | 2017-02-22 | 清华大学 | Micro-gesture identification method and system based on ultrasonic active detection |
| CN106484359A (en) * | 2016-10-31 | 2017-03-08 | 维沃移动通信有限公司 | A kind of method of gesture control and mobile terminal |
| CN106527828A (en) * | 2016-12-16 | 2017-03-22 | 上海交通大学 | Notebook computer handwriting recognition method and handwriting input system |
| CN106774825A (en) * | 2016-11-15 | 2017-05-31 | 康佳集团股份有限公司 | A kind of contactless gesture identification method and system |
| CN106843457A (en) * | 2016-12-09 | 2017-06-13 | 瑞声声学科技(深圳)有限公司 | Gesture recognition system and the gesture identification method using the system |
| CN106873895A (en) * | 2016-12-30 | 2017-06-20 | 努比亚技术有限公司 | The implementation method and device of a kind of edge gesture operation |
| CN107291308A (en) * | 2017-07-26 | 2017-10-24 | 上海科世达-华阳汽车电器有限公司 | A kind of gesture identifying device and its recognition methods |
| CN107330462A (en) * | 2017-06-30 | 2017-11-07 | 大连理工大学 | Gesture identification method and its device based on time frequency analysis |
| CN107608571A (en) * | 2017-09-05 | 2018-01-19 | 捷开通讯(深圳)有限公司 | A kind of sound wave touch control device and terminal |
| CN107943300A (en) * | 2017-12-07 | 2018-04-20 | 深圳大学 | A kind of gesture identification method and system based on ultrasonic wave |
| CN107965264A (en) * | 2016-10-19 | 2018-04-27 | 南京暖洋光电科技有限公司 | Electric rolling control method based on ultrasonic ranging |
| CN108107435A (en) * | 2017-12-07 | 2018-06-01 | 深圳大学 | A kind of virtual reality tracking and system based on ultrasonic wave |
| CN108139798A (en) * | 2016-09-26 | 2018-06-08 | 华为技术有限公司 | Exchange method and wearable device |
| CN108845324A (en) * | 2018-06-26 | 2018-11-20 | 北京小米移动软件有限公司 | obstacle recognition method, device, equipment and storage medium |
| CN109031315A (en) * | 2018-06-26 | 2018-12-18 | 北京小米移动软件有限公司 | Distance measurement method, device, equipment and storage medium |
| CN109212534A (en) * | 2018-09-21 | 2019-01-15 | 北京小米移动软件有限公司 | Gripping gesture detection method, device, equipment and the storage medium of mobile terminal |
| CN109842808A (en) * | 2017-11-29 | 2019-06-04 | 深圳光峰科技股份有限公司 | Control method, projection arrangement and the storage device of projection arrangement |
| WO2019105376A1 (en) * | 2017-11-30 | 2019-06-06 | 腾讯科技（深圳）有限公司 | Gesture recognition method, terminal and storage medium |
| CN110275616A (en) * | 2019-06-14 | 2019-09-24 | Oppo广东移动通信有限公司 | Gesture identification mould group, control method and electronic device |
| CN110781764A (en) * | 2019-09-30 | 2020-02-11 | 北京大学 | Intelligent microwave sign language identification method |
| CN110780741A (en) * | 2019-10-28 | 2020-02-11 | Oppo广东移动通信有限公司 | Model training method, application running method, device, medium and electronic equipment |
| CN110796767A (en) * | 2019-10-31 | 2020-02-14 | 的卢技术有限公司 | Method and system for realizing key-free automobile key control based on gesture recognition |
| CN110799927A (en) * | 2018-08-30 | 2020-02-14 | Oppo广东移动通信有限公司 | Gesture recognition method, terminal and storage medium |
| WO2020103265A1 (en) * | 2018-11-23 | 2020-05-28 | 中科传启（苏州）科技有限公司 | Method and apparatus for detecting living body |
| WO2020147099A1 (en) * | 2019-01-18 | 2020-07-23 | 深圳大学 | Underwater manipulation system for intelligent electronic device, and manipulation method therefor |
| CN111443254A (en) * | 2020-04-20 | 2020-07-24 | 维沃移动通信有限公司 | Ultrasonic reflection performance detection system and method |
| CN111796792A (en) * | 2020-06-12 | 2020-10-20 | 瑞声科技(新加坡)有限公司 | Gesture action judgment method and device, electronic equipment and storage medium |
| CN112180377A (en) * | 2020-09-22 | 2021-01-05 | 湖南大学 | Non-contact human-computer interaction positioning method, tracking method, terminal and readable storage medium |
| CN112327252A (en) * | 2020-10-12 | 2021-02-05 | 中国海洋大学 | Multi-loudspeaker and multi-microphone based sound wave multi-target tracking method |
| CN112860070A (en) * | 2021-03-03 | 2021-05-28 | 北京小米移动软件有限公司 | Device interaction method, device interaction apparatus, storage medium and terminal |
| CN113030947A (en) * | 2021-02-26 | 2021-06-25 | 北京京东方技术开发有限公司 | Non-contact control device and electronic apparatus |
| CN113359139A (en) * | 2020-03-03 | 2021-09-07 | 阿里巴巴集团控股有限公司 | Intelligent device, switch device, electronic device and interaction device |
| CN113655881A (en) * | 2021-08-16 | 2021-11-16 | 苏州触达信息技术有限公司 | Shortcut activation system and method based on sound wave control |
| CN115201829A (en) * | 2021-04-13 | 2022-10-18 | 广东晟矽微电子有限公司 | Distance measuring device, receiver, terminal and distance measuring system |
| WO2022262359A1 (en) * | 2021-06-18 | 2022-12-22 | 华为技术有限公司 | Gesture recognition method, electronic device, and storage medium |
| WO2023061054A1 (en) * | 2021-10-13 | 2023-04-20 | 华为技术有限公司 | Non-contact gesture control method and electronic device |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102130700A (en) * | 2010-01-15 | 2011-07-20 | 北京国都时代科技有限公司 | Received signal processing method and implementation device thereof |
| CN103038725A (en) * | 2010-06-29 | 2013-04-10 | 高通股份有限公司 | Touchless sensing and gesture recognition using continuous wave ultrasound signals |
| CN103926577A (en) * | 2014-03-31 | 2014-07-16 | 桂林电子科技大学 | Ultrasonic transmitting and receiving system |
| CN104994045A (en) * | 2015-06-26 | 2015-10-21 | 北京航空航天大学 | Platform and method for automatically identifying digital modulation mode based on USRP platform |
-
2016
- 2016-01-22 CN CN201610045717.7A patent/CN105718064A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102130700A (en) * | 2010-01-15 | 2011-07-20 | 北京国都时代科技有限公司 | Received signal processing method and implementation device thereof |
| CN103038725A (en) * | 2010-06-29 | 2013-04-10 | 高通股份有限公司 | Touchless sensing and gesture recognition using continuous wave ultrasound signals |
| CN103926577A (en) * | 2014-03-31 | 2014-07-16 | 桂林电子科技大学 | Ultrasonic transmitting and receiving system |
| CN104994045A (en) * | 2015-06-26 | 2015-10-21 | 北京航空航天大学 | Platform and method for automatically identifying digital modulation mode based on USRP platform |
Non-Patent Citations (1)
| Title |
|---|
| 丁鹭飞、耿富录、陈建春: "《雷达原理》", 31 March 2009, 电子工业出版社 * |
Cited By (53)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106325497A (en) * | 2016-07-28 | 2017-01-11 | 广东技术师范学院 | Virtual electronic wall clock based on acoustic wave gesture recognition |
| CN106406524A (en) * | 2016-09-05 | 2017-02-15 | 珠海格力电器股份有限公司 | Equipment control method and device |
| CN106446801A (en) * | 2016-09-06 | 2017-02-22 | 清华大学 | Micro-gesture identification method and system based on ultrasonic active detection |
| CN106446801B (en) * | 2016-09-06 | 2020-01-07 | 清华大学 | Micro-gesture recognition method and system based on ultrasonic active detection |
| CN108139798A (en) * | 2016-09-26 | 2018-06-08 | 华为技术有限公司 | Exchange method and wearable device |
| CN107965264A (en) * | 2016-10-19 | 2018-04-27 | 南京暖洋光电科技有限公司 | Electric rolling control method based on ultrasonic ranging |
| CN106484359A (en) * | 2016-10-31 | 2017-03-08 | 维沃移动通信有限公司 | A kind of method of gesture control and mobile terminal |
| CN106484359B (en) * | 2016-10-31 | 2019-12-27 | 维沃移动通信有限公司 | Gesture control method and mobile terminal |
| CN106774825B (en) * | 2016-11-15 | 2019-07-09 | 康佳集团股份有限公司 | A kind of contactless gesture identification method and system |
| CN106774825A (en) * | 2016-11-15 | 2017-05-31 | 康佳集团股份有限公司 | A kind of contactless gesture identification method and system |
| CN106843457A (en) * | 2016-12-09 | 2017-06-13 | 瑞声声学科技(深圳)有限公司 | Gesture recognition system and the gesture identification method using the system |
| CN106843457B (en) * | 2016-12-09 | 2020-06-09 | 瑞声声学科技(深圳)有限公司 | Gesture recognition system and gesture recognition method adopting same |
| CN106527828A (en) * | 2016-12-16 | 2017-03-22 | 上海交通大学 | Notebook computer handwriting recognition method and handwriting input system |
| CN106527828B (en) * | 2016-12-16 | 2018-05-08 | 上海交通大学 | Notebook hand-written recognition method and its hand-written input system |
| CN106873895A (en) * | 2016-12-30 | 2017-06-20 | 努比亚技术有限公司 | The implementation method and device of a kind of edge gesture operation |
| CN107330462A (en) * | 2017-06-30 | 2017-11-07 | 大连理工大学 | Gesture identification method and its device based on time frequency analysis |
| CN107330462B (en) * | 2017-06-30 | 2020-08-14 | 大连理工大学 | Gesture recognition method and device based on time-frequency analysis |
| CN107291308A (en) * | 2017-07-26 | 2017-10-24 | 上海科世达-华阳汽车电器有限公司 | A kind of gesture identifying device and its recognition methods |
| CN107608571A (en) * | 2017-09-05 | 2018-01-19 | 捷开通讯(深圳)有限公司 | A kind of sound wave touch control device and terminal |
| CN109842808A (en) * | 2017-11-29 | 2019-06-04 | 深圳光峰科技股份有限公司 | Control method, projection arrangement and the storage device of projection arrangement |
| WO2019105376A1 (en) * | 2017-11-30 | 2019-06-06 | 腾讯科技（深圳）有限公司 | Gesture recognition method, terminal and storage medium |
| CN109857245A (en) * | 2017-11-30 | 2019-06-07 | 腾讯科技（深圳）有限公司 | A kind of gesture identification method and terminal |
| CN109857245B (en) * | 2017-11-30 | 2021-06-15 | 腾讯科技（深圳）有限公司 | Gesture recognition method and terminal |
| CN108107435A (en) * | 2017-12-07 | 2018-06-01 | 深圳大学 | A kind of virtual reality tracking and system based on ultrasonic wave |
| CN107943300A (en) * | 2017-12-07 | 2018-04-20 | 深圳大学 | A kind of gesture identification method and system based on ultrasonic wave |
| CN108845324A (en) * | 2018-06-26 | 2018-11-20 | 北京小米移动软件有限公司 | obstacle recognition method, device, equipment and storage medium |
| CN109031315A (en) * | 2018-06-26 | 2018-12-18 | 北京小米移动软件有限公司 | Distance measurement method, device, equipment and storage medium |
| CN110799927A (en) * | 2018-08-30 | 2020-02-14 | Oppo广东移动通信有限公司 | Gesture recognition method, terminal and storage medium |
| CN109212534A (en) * | 2018-09-21 | 2019-01-15 | 北京小米移动软件有限公司 | Gripping gesture detection method, device, equipment and the storage medium of mobile terminal |
| CN109212534B (en) * | 2018-09-21 | 2023-06-30 | 北京小米移动软件有限公司 | Method, device, equipment and storage medium for detecting holding gesture of mobile terminal |
| WO2020103265A1 (en) * | 2018-11-23 | 2020-05-28 | 中科传启（苏州）科技有限公司 | Method and apparatus for detecting living body |
| WO2020147099A1 (en) * | 2019-01-18 | 2020-07-23 | 深圳大学 | Underwater manipulation system for intelligent electronic device, and manipulation method therefor |
| CN110275616A (en) * | 2019-06-14 | 2019-09-24 | Oppo广东移动通信有限公司 | Gesture identification mould group, control method and electronic device |
| CN110781764A (en) * | 2019-09-30 | 2020-02-11 | 北京大学 | Intelligent microwave sign language identification method |
| CN110780741A (en) * | 2019-10-28 | 2020-02-11 | Oppo广东移动通信有限公司 | Model training method, application running method, device, medium and electronic equipment |
| CN110780741B (en) * | 2019-10-28 | 2022-03-01 | Oppo广东移动通信有限公司 | Model training method, application running method, device, medium and electronic equipment |
| CN110796767A (en) * | 2019-10-31 | 2020-02-14 | 的卢技术有限公司 | Method and system for realizing key-free automobile key control based on gesture recognition |
| CN113359139A (en) * | 2020-03-03 | 2021-09-07 | 阿里巴巴集团控股有限公司 | Intelligent device, switch device, electronic device and interaction device |
| CN111443254B (en) * | 2020-04-20 | 2022-05-24 | 维沃移动通信有限公司 | Ultrasonic reflection performance detection system and method |
| CN111443254A (en) * | 2020-04-20 | 2020-07-24 | 维沃移动通信有限公司 | Ultrasonic reflection performance detection system and method |
| CN111796792A (en) * | 2020-06-12 | 2020-10-20 | 瑞声科技(新加坡)有限公司 | Gesture action judgment method and device, electronic equipment and storage medium |
| CN111796792B (en) * | 2020-06-12 | 2024-04-02 | 瑞声科技(新加坡)有限公司 | Gesture motion judging method and device, electronic equipment and storage medium |
| WO2021248535A1 (en) * | 2020-06-12 | 2021-12-16 | 瑞声声学科技(深圳)有限公司 | Gesture motion determination method and apparatus, electronic device, and storage medium |
| CN112180377A (en) * | 2020-09-22 | 2021-01-05 | 湖南大学 | Non-contact human-computer interaction positioning method, tracking method, terminal and readable storage medium |
| CN112180377B (en) * | 2020-09-22 | 2023-07-14 | 湖南大学 | Non-contact type man-machine interaction positioning method, tracking method, terminal and readable storage medium |
| CN112327252A (en) * | 2020-10-12 | 2021-02-05 | 中国海洋大学 | Multi-loudspeaker and multi-microphone based sound wave multi-target tracking method |
| CN113030947A (en) * | 2021-02-26 | 2021-06-25 | 北京京东方技术开发有限公司 | Non-contact control device and electronic apparatus |
| CN112860070B (en) * | 2021-03-03 | 2024-10-18 | 北京小米移动软件有限公司 | Equipment interaction method, equipment interaction device, storage medium and terminal |
| CN112860070A (en) * | 2021-03-03 | 2021-05-28 | 北京小米移动软件有限公司 | Device interaction method, device interaction apparatus, storage medium and terminal |
| CN115201829A (en) * | 2021-04-13 | 2022-10-18 | 广东晟矽微电子有限公司 | Distance measuring device, receiver, terminal and distance measuring system |
| WO2022262359A1 (en) * | 2021-06-18 | 2022-12-22 | 华为技术有限公司 | Gesture recognition method, electronic device, and storage medium |
| CN113655881A (en) * | 2021-08-16 | 2021-11-16 | 苏州触达信息技术有限公司 | Shortcut activation system and method based on sound wave control |
| WO2023061054A1 (en) * | 2021-10-13 | 2023-04-20 | 华为技术有限公司 | Non-contact gesture control method and electronic device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105718064A (en) | Gesture recognition system and method based on ultrasonic waves | |
| Chen et al. | EchoTrack: Acoustic device-free hand tracking on smart phones | |
| KR101520554B1 (en) | Touchless sensing and gesture recognition using continuous wave ultrasound signals | |
| CN103443649B (en) | Systems, methods, apparatus, and computer-readable media for source localization using audible sound and ultrasound | |
| US9360546B2 (en) | Systems, methods, and apparatus for indicating direction of arrival | |
| JP5331097B2 (en) | System and method for positioning | |
| Wang et al. | UWHear: Through-wall extraction and separation of audio vibrations using wireless signals | |
| Wang et al. | {MAVL}: Multiresolution analysis of voice localization | |
| US11009998B2 (en) | Systems and methods for ultrasonic, millimeter wave and hybrid sensing | |
| Zhang et al. | Vernier: Accurate and fast acoustic motion tracking using mobile devices | |
| KR20130137005A (en) | System and method for object position estimation based on ultrasonic reflected signals | |
| CN110069134B (en) | Method for restoring aerial moving track of hand by using radio frequency signal | |
| WO2013079782A1 (en) | An audio driver user interface | |
| US20170075425A1 (en) | Finger gesture sensing device | |
| Cheng et al. | Push the limit of device-free acoustic sensing on commercial mobile devices | |
| Zhuang et al. | ReflecTrack: Enabling 3D acoustic position tracking using commodity dual-microphone smartphones | |
| CN103257338B (en) | Indoor positioning method and system | |
| Cheng et al. | Acouradar: Towards single source based acoustic localization | |
| Liu et al. | Acoustic-based 2-D target tracking with constrained intelligent edge device | |
| CN112180377A (en) | Non-contact human-computer interaction positioning method, tracking method, terminal and readable storage medium | |
| Han et al. | V-Pen: An Acoustic-Based Fine-Grained Virtual Pen Input System Using Hand Tracking | |
| EP3650987B1 (en) | Apparatus and method for tracking movement of an object | |
| Zhang et al. | Device-Free and Training-Free Hand Gesture Recognition with Acoustic Signal | |
| Li | Intelligent ultrasound hand gesture recognition system | |
| Jeong et al. | A comparative assessment of Wi-Fi and acoustic signal-based HCI methods on the practicality |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20160629 |
|
| RJ01 | Rejection of invention patent application after publication |