CN106055089A - Control system for gesture recognition based on man-machine interaction equipment and control method for same - Google Patents

Control system for gesture recognition based on man-machine interaction equipment and control method for same Download PDF

Info

Publication number
CN106055089A
CN106055089A CN201610270278.XA CN201610270278A CN106055089A CN 106055089 A CN106055089 A CN 106055089A CN 201610270278 A CN201610270278 A CN 201610270278A CN 106055089 A CN106055089 A CN 106055089A
Authority
CN
China
Prior art keywords
module
signal
human
main control
computer interaction
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201610270278.XA
Other languages
Chinese (zh)
Inventor
向学科
李栋
张建国
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Qianhai Wanxiang Smart Technology Co Ltd
Original Assignee
Shenzhen Qianhai Wanxiang Smart Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Qianhai Wanxiang Smart Technology Co Ltd filed Critical Shenzhen Qianhai Wanxiang Smart Technology Co Ltd
Priority to CN201610270278.XA priority Critical patent/CN106055089A/en
Publication of CN106055089A publication Critical patent/CN106055089A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017Gesture based interaction, e.g. based on a set of recognized hand gestures
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S13/00Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
    • G01S13/88Radar or analogous systems specially adapted for specific applications

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Electromagnetism (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Human Computer Interaction (AREA)
  • Radar Systems Or Details Thereof (AREA)

Abstract

The embodiment of the invention provides a control system for gesture recognition based on man-machine interaction equipment and a control method for the same. The system comprises an ultra-bandwidth module, a main control module, an antenna module and a communication level conversion module, wherein the main control module controls the ultra-bandwidth module to send a pulse radar signal to a human hand and generate an echo signal; the antenna module receives the echo signal and then sends the echo signal to the main control module for processing, so that gesture characteristics can be judged according to the echo signal; and then, the communication level conversion module converts the signal into a control signal of the man-machine interaction equipment according to the gesture characteristics, so that man-machine interaction is implemented. The control system is characterized in that the ultra-bandwidth module is used to send the pulse radar signal which can penetrate an obstacle and can avoid interference to the system, so that the gesture recognition becomes more accurate; and problems in the prior art that human body gestures cannot be detected and recognized accurately and thus the human interaction cannot be implemented can be solved.

Description

The control system of gesture identification based on human-computer interaction device and control method thereof
Technical field
The present invention relates to automatically control Smart Home field, particularly relate to a kind of gesture identification based on human-computer interaction device Control system and control method.
Background technology
Along with the development of man-machine interaction demand, the research identified about human posture gets more and more, and human posture controls Including gesture control, excellent man-machine interaction experience can be brought to user.Use the gesture identification that computer vision technique is carried out Technology is the main direction of studying of Gesture Recognition, but the requirement that vision technique is to environmental condition: include light is wanted Sue for peace harsher to the requirement of shelter, often make to have an impact the result of gesture identification even in man-machine interaction Inefficiency, generation deviation in journey.
But, prior art exists and exactly by human body gesture is detected and cannot identify, thus reach The problem of the effect of man-machine interaction.
Summary of the invention
Present invention aim at providing control system and the controlling party thereof of a kind of gesture identification based on human-computer interaction device Method, it is intended to exist in solution technology and exactly by human body gesture is detected and cannot identify, thus reach man-machine friendship The problem of mutual effect.
The invention provides the control system of a kind of gesture identification based on human-computer interaction device, described control system bag Include:
Send the ultra-wide band module of the pulsed radar signal penetrating barrier;
It is connected with described ultra-wide band module, controls described ultra-wide band module and send pulsed radar signal arrival human hands And produce the main control module of echo-signal;
It is connected with described main control module, receives described echo-signal and described echo-signal is sent to described master control Module processes so that judge the Anneta module of gesture feature according to described echo-signal;
It is connected with described main control module, according to described gesture feature, is converted into the control signal to human-computer interaction device Communication level modular converter.
Present invention also offers the control method of a kind of gesture identification based on human-computer interaction device, described control method bag Include:
Ultra-wide band module sends the pulsed radar signal penetrating barrier;
Ultra-wide band module described in master control module controls sends pulsed radar signal and arrives human hands and produce echo-signal;
Anneta module receives described echo-signal and described echo-signal is sent to described main control module processes, Make to judge gesture feature according to described echo-signal;
Communication level modular converter, according to described gesture feature, is converted into the control signal to human-computer interaction device.
In sum, the embodiment of the present invention provide a kind of based on human-computer interaction device gesture identification control system and Its control method, including ultra-wide band module, main control module, Anneta module and communication level modular converter, described main control module control Making described ultra-wide band module send pulsed radar signal arrival human hands and produce echo-signal, Anneta module receives described After echo-signal, described echo-signal is sent to described main control module and processes so that judge according to described echo-signal Going out gesture feature, then communication level modular converter is according to described gesture feature, is converted into the letter of the control to human-computer interaction device Number, thus reach the effect of man-machine interaction.Wherein, due to super-broadband tech, there is higher message transmission rate, multi-path resolved Ability is strong, penetration capacity is strong, low-power consumption, the contactless and feature of good concealment, described control system pass through ultra-wide band module Transmission pulsed radar signal can penetrate barrier and avoid it to be disturbed, such that the most accurate to gesture identification, simultaneously Solve and prior art exists and exactly by human body gesture is detected and cannot identify, thus reach man-machine interaction The problem of effect.
Accompanying drawing explanation
The mould of the control system of a kind of based on human-computer interaction device gesture identification that Fig. 1 provides for one embodiment of the invention Block structure schematic diagram.
The control system of a kind of based on human-computer interaction device gesture identification that Fig. 2 provides for one embodiment of the invention Electrical block diagram.
The reality of the control system of a kind of based on human-computer interaction device gesture identification that Fig. 3 provides for one embodiment of the invention Thing operation chart.
The knot of the control system of a kind of based on human-computer interaction device gesture identification that Fig. 4 provides for one embodiment of the invention Structure schematic diagram.
The mould of the control system of a kind of based on human-computer interaction device gesture identification that Fig. 5 provides for one embodiment of the invention Block effect schematic diagram.
The hands of the control system of a kind of based on human-computer interaction device gesture identification that Fig. 6 provides for one embodiment of the invention Gesture coupling schematic diagram.
The hands of the control system of a kind of based on human-computer interaction device gesture identification that Fig. 7 provides for one embodiment of the invention Gesture identification curve chart.
The work of the control system of a kind of based on human-computer interaction device gesture identification that Fig. 8 provides for one embodiment of the invention Make principle flow chart.
The control method of a kind of based on human-computer interaction device gesture identification that Fig. 9 provides for another embodiment of the present invention Flow chart of steps.
Detailed description of the invention
In order to make the technical problem to be solved in the present invention, technical scheme and beneficial effect clearer, below in conjunction with Drawings and Examples, are further elaborated to the present invention.Should be appreciated that specific embodiment described herein is only used To explain the present invention, it is not intended to limit the present invention.
The control system of a kind of based on human-computer interaction device gesture identification that the embodiment of the present invention provides, is mainly used in leading to Cross gesture and control human-computer interaction device.
Fig. 1 shows the control system of a kind of based on human-computer interaction device gesture identification that one embodiment of the invention proposes Modular structure, for convenience of explanation, illustrate only the part relevant to the embodiment of the present invention.
A kind of control system 10 of gesture identification based on human-computer interaction device, described control system 10 includes:
Send the ultra-wide band module 102 of the pulsed radar signal penetrating barrier;
It is connected with described ultra-wide band module 102, controls described ultra-wide band module 102 and send pulsed radar signal arrival Human hands also produces the main control module 101 of echo-signal;
It is connected with described main control module 101, receives described echo-signal and described echo-signal is sent to described master Control module processes so that judge the Anneta module 103 of gesture feature according to described echo-signal;
It is connected with described main control module 101, according to described gesture feature, is converted into the letter of the control to human-computer interaction device Number communication level modular converter 105.
As one embodiment of the invention, described gesture feature include fist shape forward, fist shape backward with fist slip to the right Posture.
As one embodiment of the invention, in communication level modular converter 105, when described gesture feature be fist shape forward, The volume being then converted into human-computer interaction device tunes up;When described gesture feature be fist shape backward, then be converted into human-computer interaction device Volume turn down;When described gesture feature is fist slip posture to the right, then it is converted into the deletion action of human-computer interaction device.
As one embodiment of the invention, described control system also includes:
It is connected with described main control module 101 and Anneta module 103, the echo letter that described Anneta module 103 is received simultaneously Number it is filtered, and is sent to the high-pass filtering module 104 of described main control module 101.
As one embodiment of the invention, described control system also includes:
It is connected with described main control module 101, the memory module 106 that described echo-signal is preserved.
As one embodiment of the invention, described control system also includes:
It is connected with described main control module 101, the power module 107 that described control system 10 is powered.
Fig. 2 shows the control system of a kind of based on human-computer interaction device gesture identification that one embodiment of the invention proposes Circuit structure, for convenience of explanation, illustrate only the part relevant to the embodiment of the present invention.
As one embodiment of the invention, described main control module 101 includes a main control chip U1, described main control chip U1 bag Include:
Main control end CTRL, receiving terminal RXD, power end Bat-VCC, storage end MEM and transmission ends FTP;
Described main control end CTRL connects described ultra-wide band module 102, and described receiving terminal RXD connects described high-pass filtering module 104, Described power end Bat-VCC connects described power module 107, and described storage end MEM connects described memory module 106, described transmission ends FTP connects described communication level modular converter 105.In the present embodiment, main control chip U1 have employed model is ATSAM4E16E's Microprocessor chip, certainly, the model of microprocessor chip does not limits, as long as can reach and the present embodiment main control chip U1 institute The function stated also may be used.
As one embodiment of the invention, described ultra-wide band module 102 includes a ultra-wide band transceiving chip U2, described ultra-wide band Transceiving chip U2 includes:
Control end ctrl;
Described control end ctrl connects main control end CTRL of described main control chip U1.In the present embodiment, ultra-wide band transmitting-receiving core Sheet U2 have employed the ultra-wide band transceiving chip that model is CC2400, and certainly, the model of ultra-wide band transceiving chip does not limits, as long as Can reach also may be used with the function described in the present embodiment ultra-wide band transceiving chip U2.
As one embodiment of the invention, described high-pass filtering module 104 includes a filtering chip U4, described filtering chip U4 Including:
Transmitting terminal Send and filtering end Filt;
Described transmitting terminal Send meets the receiving terminal RXD of described main control chip U1, described filtering end Filt and connects described antenna mould Block.In the present embodiment, filtering chip U4 have employed the filtering chip that model is HF3800, and certainly, the model of filtering chip is not Limit, as long as can reach also may be used with the function described in the present embodiment filtering chip U4.
As one embodiment of the invention, described Anneta module 103 includes antenna chip U3, described antenna chip U3 bag Include:
Transmitting terminal TXD;
Described transmitting terminal TXD meets the filtering end Filt of described filtering chip U4.In the present embodiment, antenna chip U3 uses Model is the antenna chip of PT2272, and certainly, the model of antenna chip does not limits, as long as can reach and the present embodiment antenna Function described in chip U3 also may be used.
As one embodiment of the invention, described communication level modular converter 105 includes a communication chip U5, described communication core Sheet U5 includes:
Transmission end RTP and communication terminal PLC;
Described transmission end RTP connects transmission ends FTP of described main control chip U1, and described communication terminal PLC connects described man-machine interaction Equipment.In the present embodiment, communication chip U5 have employed the communication chip that model is TMS320C6203, certainly, communication chip Model does not limits, as long as can reach also may be used with the function described in the present embodiment communication chip U5.
As one embodiment of the invention, described memory module 106 includes a storage chip U6, described storage chip U6 bag Include:
Store end mem;
Described storage end mem meets the storage end MEM of described main control chip U1.In the present embodiment, storage chip U6 uses Model is the storage chip of PC5300, and certainly, the model of storage chip does not limits, as long as can reach and the present embodiment storage Function described in chip U6 also may be used.
As one embodiment of the invention, described power module 107 includes:
Alternating current power supply VCC;
Described alternating current power supply VCC meets the power end Bat-vcc of described main control chip U1.
Fig. 3 shows the control system of a kind of based on human-computer interaction device gesture identification that one embodiment of the invention proposes Object operation schematic diagram, for convenience of explanation, illustrate only the part relevant to the embodiment of the present invention.
One embodiment of the invention provides the control system of a kind of gesture identification based on human-computer interaction device, described control system Radar transmit-receive unit 12 is had, including surpassing on system 10 (aspects such as robot, smart mobile phone, computer, intelligent appliance can be expanded to) Bandwidth module and Anneta module, can detect the appearance of body part by launching and receiving ultra-wide band (UWB) pulsed radar signal Gesture and motion, including gesture and gesture motion 14.The ultra-wide band module of described control system can launch a series of pulse thunder Reaching, pulse radar can penetrate some barriers 16, such as in glove, clothes, pocket, bag bag etc. life that may be present one A little interference.Simultaneously also without conditions such as light, it is possible to normally working in dark environment, pulse radar is at hand 14 Received by radar transmit-receive module 12 after reflecting, with some the most fixed gestures relative to detection equipment (such as relative to institute State control system fist and the palm up and down before and after etc. gesture) make comparisons, determine whether user is made that the gesture of setting.Ratio As, it is detected relative to the fist type gesture motion forward or backward of described control system 10, and then is converted into man-machine interaction The volume of equipment tunes up the operations such as the punch in (or turning down), game or emission bullet;The palm relative to described control system 10 Slip posture to the right is detected, and then is converted into the operation of slip or deletion etc. to the right of human-computer interaction device.
Fig. 4 shows the control system of a kind of based on human-computer interaction device gesture identification that one embodiment of the invention proposes Structure, for convenience of explanation, illustrate only the part relevant to the embodiment of the present invention.
In described control system 10 side has the ultra-wide band module of a diversification angular regions can be detected Gesture.The R-T unit of described radar transmit-receive unit 12 is arranged on two edges of described gestures detection equipment to ensure inspection Survey the effective angle scope of gesture more than 180 °.With a camera module 22 for contrast, photographic head is arranged on control system 10 On be only able to detect the information in a smaller range, use a pair photographic head to be the most relatively difficult to ensure that card detects and pulse thunder the most at last Reach suitable scope.And it is non-to reduce equally to delimit the scope of " R " as depicted for pulse radar detection scheme It is intended to the interference of gesture.
Fig. 5 shows the control system of a kind of based on human-computer interaction device gesture identification that one embodiment of the invention proposes Module effect schematic diagram, for convenience of explanation, illustrate only the part relevant to the embodiment of the present invention.
Microcontroller 24 is write order and ultra-wide band transmitting-receiving control chip 26 is configured and controlled.Microprocessor module is excellent Selecting the chip of the ARM-Smart structure of altera corp, model is ATSAM4E16E, and it is high that this module has arithmetic speed, in real time The advantage that property controlling is strong.The communication mode of configuration control command uses SPI communication.Chip has 128KB on-chip SRAM, 16KB ROM, 1024KB internal Flash, 1 road USB 2.0 FS Device, (1 road and the choosing of SPI sheet are multiple for 4 16, tunnel PWM, 2 road UART With), 2 road USART, 2 road TWI (1 road and JTAG multiplexing), 1 road SD/SDIO/MMC, 1 road SPI, 1 road NAND controller, 1 tunnel EMAC controller, supports 16 AFEC, 1 tunnel 2 Channel 12-Bit DAC, the highest can run under the frequency of 120M, can realize quickly Process data, and support multiple kinds.The written in code of microcontroller chip U1 uses polyglot, including C++, C, The programming languages such as compilation.Ultra-wide band is received and dispatched the X2 pulse radar transceiver of the preferred XETHUR company of control chip 26 and is controlled core Sheet, configuration and control command according to microcontroller chip 24 are operated, and produce the continuous or ultra-wide band pulse of segmentation and drive Launch antenna 28 and launch pulsed radar signal.Launch the preferred material of antenna be copper, it is also possible to be other material such as aluminum and Plastics etc..Described reception antenna 30 receives pulsed radar signal, and pulsed radar signal is probably through body part as hands The reflection in portion and have passed through some barriers such as glove, bag bag etc..The material of described reception antenna 30 and described transmitting sky Line is preferably by identical material.
The pulsed radar signal that described reception antenna 30 receives passes to described ultra-wide band transmitting-receiving control chip 26, institute The ultra-wide band transmitting-receiving control chip 26 stated is sent to microcontroller chip 24 after sampling the pulsed radar signal received and enters Row time-frequency conversion, feature extraction etc. processes, and obtains a plurality of Time-Frequency Information.Short time Fourier transformation (STFT) is moving window Fourier transformation, analyzes the frequency component of signal by traveling time window, obtains one and contains signal at different time The two-dimentional time frequency distribution map of frequency information.(1), then the STFT of signal s (t) is defined as follows given window function w:
STFT (t, ω)=∫ s (t ') ω*(t′-t)exp{-jωt′}dt′
STFT is and primary signal segmentation is carried out Fourier transformation, and the existence just because of window function w (t) makes STFT have Had Local Characteristic, be the function of time be also the function of frequency.Or say STFT be function s (t') at one group by ω (t '-t) Exp{-j ω t ' } projection on the basic function that formed.Being no longer endless due to time domain, it can be used for monitoring signal spectrum How function as the time changes.The two-dimentional joint time-frequency table of original time signal is obtained with time t for function moving window It is shown as STFT (t, ω).Shu STFT (t, ω) Shu is referred to as the spectrogram of signal, obtains how frequency spectrum becomes with the function of horizontal time axis The information changed.
Empirical mode decomposition (EMD) is a kind of for non-linear, the control and analysis of nonstationary time series signal, The ultimate principle of EMD is according to local time's feature, the trend component of different scale or fluctuation in decomposed signal step by step, produces one Series IMF mode function (Intrinsic Mode Function, IMF), each IMF has completeness and orthogonal, this process Substantially non-stationary signal is carried out tranquilization process.Each IMF component represents the form of a vibration performance in signal respectively, Its generation needs to meet following condition: the data analyzed exist maximum and minimum point, and extreme point is individual with zero crossing Within number difference one, if signal only having flex point and without extreme point, extreme value need to being obtained by single order or higher differentiation;In data The envelope up and down that local maximum and minimum point are constituted, its average line be one level off to zero straight line.EMD decomposition obtains The process of each IMF component is referred to as hoof choosing, during calculating, needs constantly to be eliminated from original signal by oneself the IMF component through obtaining, Until the IMF hoof made new advances cannot be decomposed again select process particularly as follows: first, detect all very big, the minimum in original signal X Point, matching is made the upper lower enveloping curve of signal, is obtained their average line signal M1, deduct this average line and obtain one in X New sequence H1, i.e. H1=X-M1, judge whether H1 meets the condition of IMF component, if not meeting, continues to replace originally with H1 X do and same process to obtain H11, i.e. H11=H1-M11, this process iteration n time, until meeting the condition of IMF component, obtains IMF Component C1, i.e.
H1n=H1(n-1)-M1n
C1=H1n
Then, removing first IMF component from primary signal X, data left sequence R1=X-C1, by R1 as former X And the processing procedure before repeating, i.e. R2=R1-C2,...,Rk=RK-1-CKK IMF component of final acquisition.EMD control method is sieved The stop condition of choosing is data sequence RkCan not decompose again and obtain suitable IMF component, i.e. with dull Long-term change trend, or only have One extreme point, or be a steady state value.Now EMD processing procedure terminates.At present, EMD control method is non-linear, non-because processing The advantage of stationary signal and be able to fast development, be similarly subjected to many attention, biological thunder in processing of biomedical signals field Reaching signal self is exactly a kind of non-stationary signal, meets three preconditions needed for EMD control method, thus can utilize EMD control method processes, and extracts signal characteristic, obtains a plurality of Time-Frequency Information.
Fig. 6 shows the control system of a kind of based on human-computer interaction device gesture identification that one embodiment of the invention proposes Gesture coupling schematic diagram, for convenience of explanation, illustrate only the part relevant to the embodiment of the present invention.
For realizing the Effec-tive Function of gestures detection function, need first to be acquired gesture feature setting up gesture model storehouse. Pulsed radar signal is launched and received to the control system 10 of gesture identification by radar transmit-receive unit 12, and pulsed radar signal passes through Specific gesture 36-1 (hand relative to described control system 10 for just slapping), (hand is relative to described control system 10 for 36-2 For positive fist), quilt after 36-3 (hand is the flat palm (finger tip is just to described control system 10) relative to described control system 10) reflection Described control system 10 receives sampling, sampled signal is filtered by described control system 10, amplitude-frequency analysis, after feature extraction To the model signals of classification, setting up the disaggregated model storehouse of certain gestures and store, storage device uses SRAM or FLASH, for hands Gesture detection creates data basis.
Fig. 7 shows the control system of a kind of based on human-computer interaction device gesture identification that one embodiment of the invention proposes Gesture identification curve, for convenience of explanation, illustrate only the part relevant to the embodiment of the present invention.
The signal that microprocessor samples obtains is as it can be seen, it contains gesture feature, movement velocity of hand, backward energy Etc. information;ATSAM4E16E chip sends commands to ultra-wide band sensor by four line full duplex SPI communication interfaces, and ultra-wide band passes Sensor sends ultra-wide band signal, when ultra-wide band signal touching human body, while sending, proceeds by clock count, when super After bandwidth signal is propagated in air dielectric, feed back to ultra-wide band signal receiving antenna, then calculate it by equation below Distance:
d = C T 2
Wherein d represents the distance of ultra-wide band antenna and hand, and owing to ultra-wide band signal is light velocity propagation, C represents the light velocity, T Represent the transition time, the distance of reality can be calculated by this formula.Reflect when radiofrequency signal arrives a target, due to Target travel can produce frequency modulation(PFM).If target is moved with the speed of v (t) m/s, the frequency of reflected signal is according to Doppler's frequency Shifting can occur a skew:Wherein fdIt is Doppler frequency shift, unit Hz, f is tranmitting frequency, unit Hz, C is signal velocity, unit m/s, and t is elapsed time, unit S, and λ is the wavelength launching signal, unit m.Assume hand Movement representation is x (t), and the Doppler frequency shift of reflected signal can be described as a phase-modulation:When When radar signal is reflected by hand positions motion, the motion of hand will produce ratio modulation to radar carrier phase.? Ideally will obtain the time-varying phase information proportional to hand exercise incident displacement by phase demodulating, thus obtain in one's hands The velocity information of portion's motion;Ignoring the amplitude of variation launching signal, the CW radar emission signal of a single-frequency can be expressed as T (t) =cos (2 π ft+ φ (t)), f is frequency of oscillation, and φ (t) is the phase noise of agitator, here it is regarded as signal phase Random fluctuation.Assume that target, in distance do, has the displacement x (t) of time-varying, then the distance between transceiver and object is d (t)=do+X (t).The propagation time delay that generation be can not ignore by the distance between transceiver and target, equal to d (t) divided by Spread speed C of signal.Owing to while hand exercise, signal is transmitting, the distance of antenna to thoracic wall is d in the moment of reflection (t-(d(t))/c).So, t time delay of round tripdCan be expressed as:
t d = 2 d ( t - d ( t ) c ) c + 2 ( d 0 + x ( t - d ( t ) c ) ) c
Signal R (t) that receiver obtains is the delay signal of transmitter signal, and amplitude fading is Ar, then
R (t)=Arcos[2πf(t-td)+φ(t-td)+θ0)
Wherein θ0Offseting for constant phase, it is affected by some questions, the phase place that the reflecting surface of such as target is formed Skew (close to 180 °), and the time delay etc. from transmitter to antenna and between antenna to frequency mixer.Substitute into the expression of td Formula, obtains receiving signal
R ( t ) = A r c o s [ 2 π f t - 4 πd 0 λ - 4 π x ( t - d ( t ) c ) λ + φ ( t - 2 d 0 c - 2 x ( t - d ( t ) c ) c ) + θ 0 ]
Its medium wavelength is people=c/f.Assume that (d (t))/c item in x (t-(d (t))/c) is due to the cycle of hand exercise T》 d0/ C and can ignore, due to identical, so 2x (t-d (t)/c)/c item deformable simplifies, and therefore receives letter Number can approximate and to be written as:
R ( t ) ≈ A r c o s [ 2 π f t - 4 πd 0 λ - 4 π x ( t ) λ + φ ( t - 2 d 0 c - 2 x ( t ) c ) + θ 0 ]
From above formula, receive signal amplitude compared with launching signal and become Ar, many one by target range d.Impact Time delay item, and phase place receives the modulation of displacement function x (t) of hand exercise.
In direct transformational structure, if signal is to get with the L0 signal multiplication launching signal homology with one, this The target information of individual periodic movement can be easy to demodulated out.Relevant to L0 owing to receiving the phase noise of signal, ignore The conversion of amplitude, L0 signal can be expressed as:
L (t)=cos (2 π ft+ φ (t))
When receiving signal and the mixing of LO signal and exporting through low pass filter, the baseband signal of output is:
B ( t ) = A b = c o s [ θ + 4 π x ( t ) λ + Δ φ ( t ) ]
WhereinIt is the amplitude of baseband signal, GRIt is the gain of receiver, GCIt it is the conversion of frequency mixer Gain, is excess phase noise,
θ = 4 πd 0 λ - θ 0
It is constant phase skew, it and the relating to parameters of receiver own, and along with mesh Mark distance do between radar and become.4 π x (t)/λ is the time-varying phase offset being directly proportional to signal x (t), by it Demodulation extraction can obtain target travel information.For single-path architecture receiver, eliminate the impact of constant phase shift, and covert when ensureing Shifting amount meets little angle approximate condition, then demodulated signal can directly be approximated by baseband signal:
B ( t ) ≈ A b ( 4 π x ( t ) λ + Δ φ ( t ) )
For orthohormbic structure receiver, after using phase demodulation algorithm, the whole of baseband signal can be recovered in theory Phase information:
P ( t ) = θ + 4 π x ( t ) λ + Δ φ ( t )
The useful phase place finally given all can be affected by residual noise.By theory analysis, we are known when residue phase Position noise is when playing leading position, signal to noise ratio and distance square be approximated to inverse ratio, and excess phase noise exists when time close together Overall noise rising leading position, so being operated time close together, and being filtered by hardware filtering and wavelet transformation scheduling algorithm After ripple, we can successfully extract the movable information of target.
Power P r (mW) receiving signal is to launch power P t (mW), and dual-mode antenna gain is Gt and Gr, the radar of target Target scattering sections σ (m2), attenuation constant a in atmosphere, the wavelength X (m) of radiofrequency signal, and the function of target range R (m)
P r = P t G t G r σλ 2 e - 2 α R ( 4 π ) 3 R 4
For the application scenario of detections of radar sign, target scattering sections σ (m in this radar equation2) it is unique Uncertain parameter.But Radar Target Scatter cross section σ (m2) affected by many factors, including the electrical property of target material, The geometric shape of target, the orientation that target is irradiated by radar wave, the wavelength of incidence wave, incident field polarization form and reception antenna Polarization etc..When detecting target and being human body, the calculating irradiating effective target sectional area needs residing for whole human body and human body The information of background.But, static health itself creates stronger clutter, and the effective area involved by Human Physiology motion Varying with each individual, the individual variation between different user is the biggest and along with factor changes such as aerial radiation angle, the positions of human body Very big, thus be difficult to estimate.It is thus desirable to combine the gesture that user characteristics storehouse is set up, believed by the different gestures gathering user Breath, uses different echo-signals Wavelet Packet Transform scheduling algorithm to extract signal characteristic, then uses SVM scheduling algorithm Carry out model training to obtain different gesture motion models and jointly realize the identification of gesture.
Fig. 8 shows the control system of a kind of based on human-computer interaction device gesture identification that one embodiment of the invention proposes Operation principle flow process, for convenience of explanation, illustrate only the part relevant to the embodiment of the present invention.
When control system powers on, supply voltage is+3.3V, and ATSAM4E16E chip proceeds by self-check program, and Resetting peripheral hardware accordingly and initialization operation, ATSAM4E16E chip is sent out by four line full duplex SPI communication interfaces Order of losing one's life receives and dispatches control chip to super band, and ultra-wide band sensor sends ultra-wide band signal, carries out signal after receiving echo-signal Process, it is judged that whether echo-signal is the gesture echo-signal in target area, if not then ignoring, it is to avoid target detection The interference of echo-signal outside district, improves the Accuracy and high efficiency of detection;If the gesture echo-signal in target area is then Proceeding next step gesture identification, the contrast by the feature analysis of signal and with gesture model storehouse carries out gesture knowledge Not, identify and the most then preserve use, if unidentified success, directly carry out the gesture identification of next flow process.
Fig. 9 shows the control of a kind of based on human-computer interaction device gesture identification that another embodiment of the present invention proposes The steps flow chart of method, for convenience of explanation, illustrate only the part relevant to the embodiment of the present invention.
A kind of control method of gesture identification based on human-computer interaction device based on above-mentioned control system, described controlling party Method includes:
S11, ultra-wide band module sends the pulsed radar signal penetrating barrier;
S12, ultra-wide band module described in master control module controls sends pulsed radar signal and arrives human hands and produce echo Signal;
S13, Anneta module receives described echo-signal and described echo-signal is sent at described main control module Reason so that judge gesture feature according to described echo-signal;
S14, communication level modular converter, according to described gesture feature, is converted into the control signal to human-computer interaction device.
As another embodiment of the present invention, described gesture feature include fist shape forward, fist shape backward with fist cunning to the right Dynamic posture.
As another embodiment of the present invention, when described gesture feature be fist shape forward, then be converted into human-computer interaction device's Volume tunes up;When described gesture feature be fist shape backward, then the volume being converted into human-computer interaction device is turned down;When described gesture is special Levy as fist slip posture to the right, be then converted into the deletion action of human-computer interaction device.
The control system of gesture identification based on human-computer interaction device that the embodiment of the present invention provides and control method thereof Operation principle is:
First, power module is started so that alternating current power supply VCC is that described control system is powered, secondly, master control module controls Ultra-wide band module sends pulsed radar signal and arrives human hands and produce echo-signal, and then Anneta module receives described returning After ripple signal, through high-pass filtering module, described echo-signal is filtered, then filtered echo-signal is sent to Described main control module processes and identifies, judges gesture feature according to described echo-signal, identifies that the most then preservation makes With, last communication level modular converter according to described gesture feature, be converted into the control signal to human-computer interaction device, such as when Described gesture feature be fist shape forward, then the volume being converted into human-computer interaction device tunes up;When described gesture feature be fist shape to After, then the volume being converted into human-computer interaction device is turned down;When described gesture feature is fist slip posture to the right, then it is converted into The deletion action of human-computer interaction device, thus reach the effect of man-machine interaction.
In sum, the embodiment of the present invention provide a kind of based on human-computer interaction device gesture identification control system and Its control method, including ultra-wide band module, main control module, Anneta module and communication level modular converter, described main control module control Making described ultra-wide band module send pulsed radar signal arrival human hands and produce echo-signal, Anneta module receives described After echo-signal, described echo-signal is sent to described main control module and processes so that judge according to described echo-signal Going out gesture feature, then communication level modular converter is according to described gesture feature, is converted into the letter of the control to human-computer interaction device Number, thus reach the effect of man-machine interaction.Wherein, due to super-broadband tech, there is higher message transmission rate, multi-path resolved Ability is strong, penetration capacity is strong, low-power consumption, the contactless and feature of good concealment, described control system pass through ultra-wide band module Transmission pulsed radar signal can penetrate barrier and avoid it to be disturbed, such that the most accurate to gesture identification, simultaneously Solve and prior art exists and exactly by human body gesture is detected and cannot identify, thus reach man-machine interaction The problem of effect.The embodiment of the present invention realizes simple, it is not necessary to increases extra hardware, can effectively reduce cost, have relatively Strong usability and practicality.
One of ordinary skill in the art will appreciate that: the step or the part steps that realize said method embodiment can be passed through The hardware that programmed instruction is relevant completes, and aforesaid program can be stored in computer read/write memory medium, and this program exists During execution, perform to include the step of said method embodiment, and aforesaid storage medium includes: ROM, RAM, magnetic disc or CD Etc. the various media that can store program code.
Embodiment described above only in order to technical scheme to be described, is not intended to limit;Although with reference to aforementioned reality Execute example the present invention has been described in detail, it will be understood by those within the art that: its still can to aforementioned respectively Technical scheme described in embodiment is modified, or wherein portion of techniques feature is carried out equivalent;And these amendments Or replace, do not make the essence of appropriate technical solution depart from spirit and the model of the embodiment of the present invention each embodiment technical scheme Enclose.
The foregoing is only presently preferred embodiments of the present invention, not in order to limit the present invention, all essences in the present invention Any amendment, equivalent and the improvement etc. made within god and principle, should be included within the scope of the present invention.

Claims (10)

1. the control system of a gesture identification based on human-computer interaction device, it is characterised in that described control system includes:
Send the ultra-wide band module of the pulsed radar signal penetrating barrier;
It is connected with described ultra-wide band module, controls described ultra-wide band module and send pulsed radar signal arrival human hands and produce The main control module of raw echo-signal;
It is connected with described main control module, receives described echo-signal and described echo-signal is sent to described main control module Process so that judge the Anneta module of gesture feature according to described echo-signal;
It is connected with described main control module, according to described gesture feature, is converted into the logical of the control signal to human-computer interaction device Letter level switch module.
2. the control system of gesture identification based on human-computer interaction device as claimed in claim 1, it is characterised in that described hands Gesture feature include fist shape forward, fist shape backward with fist slip posture to the right.
3. the control system of gesture identification based on human-computer interaction device as claimed in claim 2, it is characterised in that in communication In level switch module, when described gesture feature be fist shape forward, then the volume being converted into human-computer interaction device tunes up;When described Gesture feature be fist shape backward, then the volume being converted into human-computer interaction device is turned down;When described gesture feature be fist to the right Slip posture, then be converted into the deletion action of human-computer interaction device.
4. the control system of gesture identification based on human-computer interaction device as claimed in claim 3, it is characterised in that described control System processed also includes:
It is connected with described main control module and Anneta module simultaneously, the echo-signal that described Anneta module receives is filtered, and It is sent to the high-pass filtering module of described main control module.
5. the control system of gesture identification based on human-computer interaction device as claimed in claim 4, it is characterised in that described control System processed also includes:
It is connected with described main control module, the memory module that described echo-signal is preserved.
6. the control system of gesture identification based on human-computer interaction device as claimed in claim 5, it is characterised in that described master Control module includes that a main control chip U1, described main control chip U1 include:
Main control end CTRL, receiving terminal RXD, storage end MEM and transmission ends FTP;
Described main control end CTRL connects described ultra-wide band module, and described receiving terminal RXD connects described high-pass filtering module, described storage end MEM connects described memory module, and described transmission ends FTP connects described communication level modular converter.
7. the control system of gesture identification based on human-computer interaction device as claimed in claim 6, it is characterised in that described super Bandwidth module includes that a ultra-wide band transceiving chip U2, described ultra-wide band transceiving chip U2 include:
Control end ctrl;
Described control end ctrl connects main control end CTRL of described main control chip U1.
8. the control system of gesture identification based on human-computer interaction device as claimed in claim 7, it is characterised in that described height Pass filtering module includes that a filtering chip U4, described filtering chip U4 include:
Transmitting terminal Send and filtering end Filt;
Described transmitting terminal Send meets the receiving terminal RXD of described main control chip U1, described filtering end Filt and connects described Anneta module.
9. the control system of gesture identification based on human-computer interaction device as claimed in claim 8, it is characterised in that described logical Letter level switch module includes that a communication chip U5, described communication chip U5 include:
Transmission end RTP and communication terminal PLC;
Described transmission end RTP connects transmission ends FTP of described main control chip U1, and described communication terminal PLC meets described human-computer interaction device.
10. a control method based on control system as claimed in claim 1, it is characterised in that described control method bag Include:
Ultra-wide band module sends the pulsed radar signal penetrating barrier;
Ultra-wide band module described in master control module controls sends pulsed radar signal and arrives human hands and produce echo-signal;
Anneta module receives described echo-signal and described echo-signal is sent to described main control module processes so that Gesture feature is judged according to described echo-signal;
Communication level modular converter, according to described gesture feature, is converted into the control signal to human-computer interaction device.
CN201610270278.XA 2016-04-27 2016-04-27 Control system for gesture recognition based on man-machine interaction equipment and control method for same Pending CN106055089A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201610270278.XA CN106055089A (en) 2016-04-27 2016-04-27 Control system for gesture recognition based on man-machine interaction equipment and control method for same

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610270278.XA CN106055089A (en) 2016-04-27 2016-04-27 Control system for gesture recognition based on man-machine interaction equipment and control method for same

Publications (1)

Publication Number Publication Date
CN106055089A true CN106055089A (en) 2016-10-26

Family

ID=57176277

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610270278.XA Pending CN106055089A (en) 2016-04-27 2016-04-27 Control system for gesture recognition based on man-machine interaction equipment and control method for same

Country Status (1)

Country Link
CN (1) CN106055089A (en)

Cited By (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107087219A (en) * 2017-02-22 2017-08-22 李海英 Smart home TV
CN108344996A (en) * 2018-01-25 2018-07-31 隔空(上海)智能科技有限公司 A kind of panel-switch and its control method based on microwave radar Gesture Recognition
CN108873715A (en) * 2018-07-04 2018-11-23 深圳众厉电力科技有限公司 Intelligent home control system based on gesture identification
CN109407833A (en) * 2018-09-30 2019-03-01 Oppo广东移动通信有限公司 Manipulate method, apparatus, electronic equipment and the storage medium of electronic equipment
CN109975769A (en) * 2019-03-13 2019-07-05 谭伟 It is a kind of for showing interactive radar module and its display exchange method
CN110058727A (en) * 2019-03-13 2019-07-26 谭伟 A kind of interactive system and its method of integrated radar
CN110348288A (en) * 2019-05-27 2019-10-18 哈尔滨工业大学(威海) A kind of gesture identification method based on 77GHz MMW RADAR SIGNAL USING
CN111094643A (en) * 2017-09-20 2020-05-01 Bsh家用电器有限公司 Household appliance with sensor
CN112656599A (en) * 2020-12-23 2021-04-16 中科芯未来微电子科技成都有限公司 Gesture rotation wheelchair based on radar detection
CN113138557A (en) * 2020-01-17 2021-07-20 北京小米移动软件有限公司 Household equipment control method and device and storage medium
CN113489831A (en) * 2021-06-29 2021-10-08 青岛海尔科技有限公司 Equipment control method and device
CN113918015A (en) * 2021-10-08 2022-01-11 三星电子(中国)研发中心 Augmented reality interaction method and device
CN114120770A (en) * 2021-03-24 2022-03-01 张银合 Barrier-free communication method for hearing-impaired people
CN115412104A (en) * 2021-05-28 2022-11-29 北京小米移动软件有限公司 Gesture recognition method and device, mobile terminal and computer readable storage medium

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102508549A (en) * 2011-11-08 2012-06-20 北京新岸线网络技术有限公司 Three-dimensional-movement-based non-contact operation method and system
CN104094194A (en) * 2011-12-09 2014-10-08 诺基亚公司 Method and apparatus for identifying a gesture based upon fusion of multiple sensor signals
US20150277569A1 (en) * 2014-03-28 2015-10-01 Mark E. Sprenger Radar-based gesture recognition
CN205750723U (en) * 2016-04-27 2016-11-30 深圳市前海万象智慧科技有限公司 The control system of gesture identification based on human-computer interaction device

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102508549A (en) * 2011-11-08 2012-06-20 北京新岸线网络技术有限公司 Three-dimensional-movement-based non-contact operation method and system
CN104094194A (en) * 2011-12-09 2014-10-08 诺基亚公司 Method and apparatus for identifying a gesture based upon fusion of multiple sensor signals
US20150277569A1 (en) * 2014-03-28 2015-10-01 Mark E. Sprenger Radar-based gesture recognition
CN205750723U (en) * 2016-04-27 2016-11-30 深圳市前海万象智慧科技有限公司 The control system of gesture identification based on human-computer interaction device

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
胡巍: "《基于多普勒雷达的非接触式生命体征检测技术研究》", 《中国优秀博士学位论文全文数据库信息科技辑》 *

Cited By (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107087219A (en) * 2017-02-22 2017-08-22 李海英 Smart home TV
CN107087219B (en) * 2017-02-22 2018-04-10 罗普特(厦门)科技集团有限公司 Human posture's identification device
CN111094643A (en) * 2017-09-20 2020-05-01 Bsh家用电器有限公司 Household appliance with sensor
CN108344996A (en) * 2018-01-25 2018-07-31 隔空(上海)智能科技有限公司 A kind of panel-switch and its control method based on microwave radar Gesture Recognition
CN108873715A (en) * 2018-07-04 2018-11-23 深圳众厉电力科技有限公司 Intelligent home control system based on gesture identification
CN109407833A (en) * 2018-09-30 2019-03-01 Oppo广东移动通信有限公司 Manipulate method, apparatus, electronic equipment and the storage medium of electronic equipment
CN109975769A (en) * 2019-03-13 2019-07-05 谭伟 It is a kind of for showing interactive radar module and its display exchange method
CN110058727A (en) * 2019-03-13 2019-07-26 谭伟 A kind of interactive system and its method of integrated radar
CN110348288A (en) * 2019-05-27 2019-10-18 哈尔滨工业大学(威海) A kind of gesture identification method based on 77GHz MMW RADAR SIGNAL USING
CN110348288B (en) * 2019-05-27 2023-04-07 哈尔滨工业大学(威海) Gesture recognition method based on 77GHz millimeter wave radar signal
CN113138557A (en) * 2020-01-17 2021-07-20 北京小米移动软件有限公司 Household equipment control method and device and storage medium
US11831459B2 (en) 2020-01-17 2023-11-28 Beijing Xiaomi Mobile Software Co., Ltd. Control method and device for home device and storage medium
CN113138557B (en) * 2020-01-17 2023-11-28 北京小米移动软件有限公司 Household equipment control method and device and storage medium
CN112656599A (en) * 2020-12-23 2021-04-16 中科芯未来微电子科技成都有限公司 Gesture rotation wheelchair based on radar detection
CN114120770A (en) * 2021-03-24 2022-03-01 张银合 Barrier-free communication method for hearing-impaired people
CN115412104A (en) * 2021-05-28 2022-11-29 北京小米移动软件有限公司 Gesture recognition method and device, mobile terminal and computer readable storage medium
CN113489831A (en) * 2021-06-29 2021-10-08 青岛海尔科技有限公司 Equipment control method and device
CN113489831B (en) * 2021-06-29 2023-02-03 青岛海尔科技有限公司 Equipment control method, device and storage medium
CN113918015A (en) * 2021-10-08 2022-01-11 三星电子(中国)研发中心 Augmented reality interaction method and device
CN113918015B (en) * 2021-10-08 2024-04-19 三星电子(中国)研发中心 Interaction method and device for augmented reality

Similar Documents

Publication Publication Date Title
CN106055089A (en) Control system for gesture recognition based on man-machine interaction equipment and control method for same
CN205750723U (en) The control system of gesture identification based on human-computer interaction device
EP4131064A1 (en) Gesture recognition method and related apparatus
Wan et al. Gesture recognition for smart home applications using portable radar sensors
Adib et al. See through walls with WiFi!
EP4066008B1 (en) Detecting a frame-of-reference change in a smart-device-based radar system
CN109829509B (en) Radar gesture recognition method based on fusion neural network
CN106446801A (en) Micro-gesture identification method and system based on ultrasonic active detection
Kizhakkel Pulsed radar target recognition based on micro-Doppler signatures using wavelet analysis
CN102565762B (en) Waveform optimization method based on target cognition and transmitted power distribution
CN110309690A (en) The gesture identification detection method composed based on time-frequency spectrum and range Doppler
Goswami et al. Real-time multi-gesture recognition using 77 GHz FMCW MIMO single chip radar
US20220326367A1 (en) Smart-Device-Based Radar System Performing Gesture Recognition Using a Space Time Neural Network
Wu et al. Dynamic hand gesture recognition using FMCW radar sensor for driving assistance
CN106127110A (en) A kind of human body fine granularity motion recognition method based on UWB radar with optimum SVM
Jiang et al. Recognition of dynamic hand gesture based on mm-wave FMCW radar micro-Doppler signatures
KR20210089144A (en) Radar for tracking or generating radar images of passive objects
CN113064483A (en) Gesture recognition method and related device
Fairchild et al. Micro-doppler radar classification of human motions under various training scenarios
CN115343704A (en) Gesture recognition method of FMCW millimeter wave radar based on multi-task learning
Arsalan et al. Spiking neural network-based radar gesture recognition system using raw adc data
CN105445705A (en) Cognitive MTD radar waveform design method
Fairchild et al. Through-the-wall micro-Doppler signatures
Vishwakarma et al. Dictionary learning for classification of indoor micro-Doppler signatures across multiple carriers
Kashyap et al. Micro-Doppler signatures of underwater vehicles using acoustic radar

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20161026

RJ01 Rejection of invention patent application after publication