CN107132913A - A kind of multi-user's man-machine interaction method based on millimeter wave - Google Patents
A kind of multi-user's man-machine interaction method based on millimeter wave Download PDFInfo
- Publication number
- CN107132913A CN107132913A CN201710204400.8A CN201710204400A CN107132913A CN 107132913 A CN107132913 A CN 107132913A CN 201710204400 A CN201710204400 A CN 201710204400A CN 107132913 A CN107132913 A CN 107132913A
- Authority
- CN
- China
- Prior art keywords
- user
- man
- distance
- machine interaction
- millimeter wave
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
Abstract
The present invention uses a kind of multi-user's man-machine interaction method based on millimeter wave, millimetre-wave radar chip, single miniature transmitting antenna and many miniature reception antennas are embedded at computer screen end, transmitting antenna can launch millimeter-wave signal into the particular range in front of screen, and meeting reflected signal is to reception antenna when the signal runs into barrier.By calculating transmission signal and receiving the time difference between signal and difference on the frequency, the distance between hand and computer screen of active user and speed of related movement can be obtained.By the phase difference between relatively every reception antenna, the angle of arrival of each user is calculated, with reference to user distance, the locus of user can be obtained.According to the locus of user, different user is distinguished.Finally the distance and velocity information of each user and their respective gestures are corresponded, multi-user's man-machine interaction based on millimeter wave just can be realized.Compared with the technology being imaged based on optical stereo, this method complexity is low, low in energy consumption.
Description
Technical field
The present invention relates to millimetre-wave radar technical field, Gesture Recognition and human-computer interaction technique field.
Background technology
The development of millimetre-wave radar is since the forties.Occur in that the fifties for airport traffic control and peculiar to vessel lead
The millimetre-wave radar (operation wavelength is about 8 millimeters) of boat, shows the superiority such as high resolution, high accuracy, miniature antenna bore.But
It is that, due to technical difficulty, the development of millimetre-wave radar was once restricted.These technical difficulties are mainly：With
The raising of working frequency, power source power output and efficiency reduction, receiver mixer and transmission line loss increase.In the seventies
After phase, millimeter-wave technology has very big progress, succeeds in developing some preferable power sources:Solid-state devices such as snowslide pipe and Geng
Family name's oscillator；Thermionic device for example magnetron, travelling-wave tubes, klystron, extension interaction oscillator, carcinotron oscillator and
Gyrotron etc..Using snowslide pipe, its peak power is up to 5~15 watts (95 gigahertz (GHZ)s) more in the solid state power source of pulsed operation.Magnetic control
Pipe can be used as high-power pulse power supply, and peak power is up to 1~6 kilowatt (95 gigahertz (GHZ)) or 1 kilowatt (140 gigahertz (GHZ)), efficiency
About 10%.Gyrotron is a kind of novel microwave and millimetre-wave generator or amplifier, and MW class can be provided in millimeter wave band
Peak power.In terms of low-noise mixer, Schottky diode (see crystal diode, schottky junction) frequency mixer is in millimeter
Wave band has been applied, and in 100 ghz ranges, low-noise mixer noise temperature can as little as 500K (non-refrigeration) or 100K (causes
It is cold).In addition, the technology in terms of high-gain aerial, integrated circuit and fin line waveguide has also developed.The later stage seventies with
Come, millimetre-wave radar is applied in many important civil and military systems, such as short range high resolution air defence system, guided missile
Guidance system, Object measuring system etc..
Millimetre-wave radar frequency band is extremely wide, using bandwidth point in 35G, the 94G utilized at present the two atmospheric windows
Wei 16G and 23G, it is adaptable to various the Wideband Signal Processings.It can obtain narrow beam under small antenna aperature, good directionality,
There is high spatial resolution, tracking accuracy is high.Have a higher doppler bandwidth, Doppler effect substantially, with good many
General Le resolving power, rate accuracy is higher.Millimeter wave scattering properties is sensitive to the details of target shape, thus can improve multiple target point
Distinguish and and to the recognition capability and image quality of target.Millimetre-wave radar Anti-amyloid-β antibody performance is good, with certain anti-stealthy
Function.In addition, millimeter wave has the ability for penetrating cigarette, dust and mist, can all weather operations.
Gesture Recognition mainly divides three major types at present：Based on template matching technique, based on probability statistics technology and it is based on
Data Classification Technology.Template matching method is that image sequence first is converted into one group of static in shape pattern, then in identification process
In be compared with the behaviour template that prestores, finally therefrom select the immediate known template generic conduct of similarity
The recognition result of tested action.For example, Bobick et al. by the movable information of target be converted into MEI (kinergety image) and
Two two dimension pattern plates of MHI (motion history image), the similarity between test sample and template is measured using mahalanobis distance.It is based on
The technology of template mainly has template matching method, dynamic time warping and dynamic programming method.Gesture based on probability statistics
Recognition methods is that the method for probability statistics is applied in motion sequence, is a state by the action definition undergone in the middle of it,
Between be that specific order arranges according to certain, the transfer between state and state is represented with probability.Based on probability statistics
Technology have the methods such as HMM, dynamic bayesian network and condition random field.The technology classified based on data
There are neutral net, SVMs etc..
Human-computer interaction technology (Human-Computer Interaction Techniques) refers to by inputting and exporting
Equipment, realizes the technology that user exchanges with system information in an efficient way.Ideally, man-machine interaction will no longer be required to according to
Rely machine language, in the case of the intermediate equipments such as no keyboard, mouse and touch-screen, realize and man-machine freely hand over whenever and wherever possible
Stream, so as to realize the material world of user and the final fusion of virtual network.
The pattern of man-machine interaction mainly experienced 5 important developing periods, and there is corresponding milestone in each period, point
It is not keyboard, mouse, touch technology, multimedia technology and virtual reality technology.American's Valentin Etistov is drawn within 1868
Sen Xiaoersi obtains typewriter model patent and obtains power of management operation, designs " QWERTY " keyboard used till today.Calculate
The appearance of switch disk, computer has been brought into the epoch of character user interface, and keyboard can be referred to as to first generation human-computer interaction technology
Milestone.Nineteen sixty American Doug Engelbart has invented mouse, and Apple Inc. releases Macintosh within 1984,
User can be arbitrarily clicked on from anywhere in screen, and effectively the efficiency of lifting experience impression and data processing, can claim mouse
For the milestone of second generation human-computer interaction technology.The interactive mode of keyboard and mouse, when continuing up to internet from the PC epoch
In generation, be that field of human-computer interaction brings new round change until the appearance of smart mobile phone and multipoint-touch-technology, touch technology
Development enables people directly to manipulate user interface, efficiently aids in carrying out information interchange between people and machine, can be by touch technology
The referred to as milestone of third generation man-machine interaction.Forth generation interaction technique, the instrument of man-machine interaction is also wrapped in addition to keyboard and mouse
Include the multimedia input-output equipment such as microphone, video camera and loudspeaker, interactive content also becomes comparison and enriched, user can with sound,
The media information such as picture, figure, text and computer carry out information interchange, and interaction is more flexible.5th generation man-machine interaction skill
Art, virtual reality technology (Virtual Reality, VR) be it is a kind of can create the computer system with the experiencing virtual world,
It generates true to nature a, virtual environment with a variety of perception such as vision, hearing, touch using computer technology, user by using
Various interactive devices, with the entity interaction in virtual environment, so as to produce the Interactive inspection emulation of sensation on the spot in person
And information interchange, it is a kind of advanced digital human machine interface technology.
The content of the invention
In order to realize that multiple users operate same computer by the method for gesture identification simultaneously, and then lift user's body
Test, the present invention proposes a kind of multi-user's man-machine interaction method based on millimeter wave.
Millimetre-wave radar chip is embedded at computer screen end, and equipped with the single miniature miniature reception day of transmitting antenna and Duo Gen
Line.When computer normally starts, radar chip is started working, and transmitting antenna is specific to computer screen front with certain frequency
In the range of launch millimeter-wave signal, multiple users can make specific gesture within this range, such as respectively tap forefinger, in
Refer to, during percussion, the signal of transmitting can run into human hand, and reflected signal gives many reception antennas, utilizes transmission signal
And the time difference between signal and Doppler frequency shift are received, the distance between user and computer screen and relative fortune can be calculated
Dynamic speed, the receiving phase using many reception antennas is poor, the angle of arrival of user can be calculated, in conjunction with the distance of user
Just the locus of user is can obtain, so as to distinguish different user.The clock signal of each user is handled, turned
Change on frequency domain, then carry out feature extraction, finally realize gesture identification from the feature of extraction, reach multi-user's man-machine interaction
Purpose.
Brief description of the drawings
Multi-user man-machine interaction schematic diagrams of the Fig. 1 based on millimeter wave
Fig. 2 clock signals processing figure
Embodiment
Technical scheme is described further below in conjunction with the accompanying drawings.Such as accompanying drawing 1, embedded at the screen end of computer
One piece of millimetre-wave radar chip, the Antenna Design penetrated using single-shot, received more.When computer normally starts, radar chip starts
Work.Transmitting antenna launches millimeter-wave signal into the particular range in front of screen at a certain time interval, before antenna
Barrier (hand of user) can reflection wave return to radar antenna, and the delay of reflected signal and Doppler effect are then corresponded to
The various features of user, include the distance and speed of user.When the signal of radar emission is generated after being reflected back from user
Between and frequency on difference.The delay τ of wherein time is that the change fd in electric wave round time, frequency is then that user movement is led
The Doppler effect of cause.
Such as accompanying drawing 2, the signal received is multiplied with original signal, then LPF is carried out in analog signal field, this
Sample can just produce obvious beat signals, and the clock signal of two dimension is each then done FFT, the static constant back of the body is subtracted
Scape environment, it is possible to the Range Doppler Map (RDM) needed for obtaining.RDM each lattice all correspond to the current of target
Distance and movement velocity.Because different users can be in different distance or in similar distance but each own different speed
Degree, RDM is just realized while following the trail of the effect of multiple users.By the phase difference of RDM between relatively more each antenna, it can calculate
Go out the arrival rate of each user, with the distance that calculates before is closed, the space orientation to user is so achieved that, so that area
Separate different users.Behind the locus for obtaining different user, feature extraction is carried out to the frequency-region signal of each user, most
Gesture identification is realized from the feature of extraction eventually, so as to realize the man-machine interaction of multi-user.
Claims (3)
1. a kind of multi-user's man-machine interaction method based on millimeter wave, it is characterised in that：
S1：Millimetre-wave radar chip is embedded at computer screen end, is believed by miniature transmitting antenna to transmitting millimeter wave in front of screen
Number, signal generation time difference frequency difference and receiving phase after human hand reflects is poor.
S2：According to time difference difference on the frequency, the distance and relative velocity between user and computer screen are calculated.According to out of phase
Difference, calculates the angle of arrival of user, with reference to the user distance calculated, can obtain the locus of user.
S3：Different user is distinguished in locus according to residing for each user, according to the distance and velocity information of each user
Their gesture is determined, man-machine interaction is realized.
2. multi-user's man-machine interaction method as claimed in claim 1 based on millimeter wave, the step S2 further comprises：By
Transmission signal and the time delayses τ and known millimeter wave propagation speed for receiving signal, are calculated between user and computer screen
Distance.The Doppler frequency shift produced by human hand and screen relative motion and known transmission signal centre frequency, are calculated
The movement velocity of human hand.By the phase difference of reflected signal to every reception antenna, the angle of arrival of user is calculated.
3. multi-user's man-machine interaction method as claimed in claim 1 based on millimeter wave, the step S3 further comprises：Will
The angle of arrival of each user and they be combined with the distance of screen and obtain the locus of user, so as to distinguish different use
Family.Further according to the distance and speed of each user calculated in real time, specific user gesture is corresponded to, then computer performs phase
The operation answered, completes the man-machine interaction of multi-user.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710204400.8A CN107132913A (en) | 2017-03-31 | 2017-03-31 | A kind of multi-user's man-machine interaction method based on millimeter wave |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710204400.8A CN107132913A (en) | 2017-03-31 | 2017-03-31 | A kind of multi-user's man-machine interaction method based on millimeter wave |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107132913A true CN107132913A (en) | 2017-09-05 |
Family
ID=59716278
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710204400.8A Pending CN107132913A (en) | 2017-03-31 | 2017-03-31 | A kind of multi-user's man-machine interaction method based on millimeter wave |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107132913A (en) |
Cited By (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107961035A (en) * | 2017-12-29 | 2018-04-27 | 深圳开立生物医疗科技股份有限公司 | A kind of ultrasonic probe and the method and apparatus for controlling diasonograph |
| CN108693532A (en) * | 2018-03-29 | 2018-10-23 | 浙江大学 | Wearable barrier-avoiding method and device based on enhanced binocular camera Yu 3D millimetre-wave radars |
| CN110119242A (en) * | 2019-05-06 | 2019-08-13 | 维沃移动通信有限公司 | A kind of touch control method, terminal and computer readable storage medium |
| CN110286744A (en) * | 2018-03-19 | 2019-09-27 | 广东欧珀移动通信有限公司 | Information processing method and device, electronic equipment, computer readable storage medium |
| WO2020001490A1 (en) * | 2018-06-26 | 2020-01-02 | 苏州宝时得电动工具有限公司 | Electric device which applies radar |
| CN110799927A (en) * | 2018-08-30 | 2020-02-14 | Oppo广东移动通信有限公司 | Gesture recognition method, terminal and storage medium |
| CN110908499A (en) * | 2018-09-18 | 2020-03-24 | 西安中兴新软件有限责任公司 | 3D image display method and device and terminal |
| WO2020119473A1 (en) * | 2018-12-11 | 2020-06-18 | 中兴通讯股份有限公司 | Speed measurement and positioning method, and terminal |
| CN112379363A (en) * | 2020-11-03 | 2021-02-19 | 维沃移动通信有限公司 | Measuring method, device and electronic equipment |
| CN113407028A (en) * | 2021-06-24 | 2021-09-17 | 上海科技大学 | Multi-user motion gesture control method and device, intelligent sound box and medium |
| CN113467444A (en) * | 2021-06-17 | 2021-10-01 | 中铁第四勘察设计院集团有限公司 | Underground space intelligent guiding method |
| US11797098B2 (en) | 2020-05-26 | 2023-10-24 | Boe Technology Group Co., Ltd. | Methods for recognizing human hand and hand gesture from human, and display apparatus |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102819315A (en) * | 2012-07-23 | 2012-12-12 | 中兴通讯股份有限公司 | 3D (three-dimension) man-machine interaction method and system |
| WO2015200710A2 (en) * | 2014-06-25 | 2015-12-30 | University Of Washington | Devices, systems, and methods for detecting gestures using multiple antennas and/or reflections of signals transmitted by the detecting device |
| CN105677019A (en) * | 2015-12-29 | 2016-06-15 | 大连楼兰科技股份有限公司 | Gesture recognition sensor and operating method thereof |
| CN105786185A (en) * | 2016-03-12 | 2016-07-20 | 浙江大学 | Non-contact type gesture recognition system and method based on continuous-wave micro-Doppler radar |
| CN106527670A (en) * | 2015-09-09 | 2017-03-22 | 广州杰赛科技股份有限公司 | Hand gesture interaction device |
-
2017
- 2017-03-31 CN CN201710204400.8A patent/CN107132913A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102819315A (en) * | 2012-07-23 | 2012-12-12 | 中兴通讯股份有限公司 | 3D (three-dimension) man-machine interaction method and system |
| WO2015200710A2 (en) * | 2014-06-25 | 2015-12-30 | University Of Washington | Devices, systems, and methods for detecting gestures using multiple antennas and/or reflections of signals transmitted by the detecting device |
| CN106527670A (en) * | 2015-09-09 | 2017-03-22 | 广州杰赛科技股份有限公司 | Hand gesture interaction device |
| CN105677019A (en) * | 2015-12-29 | 2016-06-15 | 大连楼兰科技股份有限公司 | Gesture recognition sensor and operating method thereof |
| CN105786185A (en) * | 2016-03-12 | 2016-07-20 | 浙江大学 | Non-contact type gesture recognition system and method based on continuous-wave micro-Doppler radar |
Cited By (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2019128794A1 (en) * | 2017-12-29 | 2019-07-04 | 深圳开立生物医疗科技股份有限公司 | Ultrasonic probe, and method and apparatus for controlling ultrasonic diagnosis equipment |
| CN107961035A (en) * | 2017-12-29 | 2018-04-27 | 深圳开立生物医疗科技股份有限公司 | A kind of ultrasonic probe and the method and apparatus for controlling diasonograph |
| CN110286744A (en) * | 2018-03-19 | 2019-09-27 | 广东欧珀移动通信有限公司 | Information processing method and device, electronic equipment, computer readable storage medium |
| CN108693532A (en) * | 2018-03-29 | 2018-10-23 | 浙江大学 | Wearable barrier-avoiding method and device based on enhanced binocular camera Yu 3D millimetre-wave radars |
| WO2020001490A1 (en) * | 2018-06-26 | 2020-01-02 | 苏州宝时得电动工具有限公司 | Electric device which applies radar |
| CN110799927B (en) * | 2018-08-30 | 2022-02-15 | Oppo广东移动通信有限公司 | Gesture recognition method, terminal and storage medium |
| CN110799927A (en) * | 2018-08-30 | 2020-02-14 | Oppo广东移动通信有限公司 | Gesture recognition method, terminal and storage medium |
| CN110908499A (en) * | 2018-09-18 | 2020-03-24 | 西安中兴新软件有限责任公司 | 3D image display method and device and terminal |
| WO2020119473A1 (en) * | 2018-12-11 | 2020-06-18 | 中兴通讯股份有限公司 | Speed measurement and positioning method, and terminal |
| CN110119242A (en) * | 2019-05-06 | 2019-08-13 | 维沃移动通信有限公司 | A kind of touch control method, terminal and computer readable storage medium |
| US11797098B2 (en) | 2020-05-26 | 2023-10-24 | Boe Technology Group Co., Ltd. | Methods for recognizing human hand and hand gesture from human, and display apparatus |
| CN112379363A (en) * | 2020-11-03 | 2021-02-19 | 维沃移动通信有限公司 | Measuring method, device and electronic equipment |
| CN113467444A (en) * | 2021-06-17 | 2021-10-01 | 中铁第四勘察设计院集团有限公司 | Underground space intelligent guiding method |
| CN113407028A (en) * | 2021-06-24 | 2021-09-17 | 上海科技大学 | Multi-user motion gesture control method and device, intelligent sound box and medium |
| CN113407028B (en) * | 2021-06-24 | 2023-07-18 | 上海科技大学 | Multi-user motion gesture control method and device, intelligent sound box and medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107132913A (en) | A kind of multi-user's man-machine interaction method based on millimeter wave | |
| US20220404914A1 (en) | Methods for gesture recognition and control | |
| Wang et al. | Push the limit of acoustic gesture recognition | |
| CN110799927B (en) | Gesture recognition method, terminal and storage medium | |
| Hayashi et al. | RadarNet: Efficient gesture recognition technique utilizing a miniature radar sensor | |
| Lien et al. | Soli: Ubiquitous gesture sensing with millimeter wave radar | |
| Gu et al. | Motion sensing using radar: Gesture interaction and beyond | |
| Tan et al. | A real-time high resolution passive WiFi Doppler-radar and its applications | |
| Li et al. | Towards domain-independent and real-time gesture recognition using mmwave signal | |
| Wang et al. | A gesture air-writing tracking method that uses 24 GHz SIMO radar SoC | |
| CN109634300A (en) | Based on the multiple no-manned plane control system and method every empty-handed gesture and ultrasonic wave touch feedback | |
| Ren et al. | Hand gesture recognition using 802.11 ad mmWave sensor in the mobile device | |
| EP2959363B1 (en) | Advanced in-cell touch optical pen | |
| Zhang et al. | A survey of mmWave-based human sensing: Technology, platforms and applications | |
| Chen et al. | Air writing via receiver array-based ultrasonic source localization | |
| WO2017067465A1 (en) | Gesture recognition method and device | |
| CN104244055A (en) | Real-time interaction method of multimedia devices within effective space range | |
| Hendy et al. | Deep learning approaches for air-writing using single UWB radar | |
| Smith et al. | An FCNN-based super-resolution mmWave radar framework for contactless musical instrument interface | |
| Wan et al. | Time differences of arrival estimation of mixed interference signals using blind source separation based on wireless sensor networks | |
| Kong et al. | Gesture recognition system based on ultrasonic FMCW and ConvLSTM model | |
| Li et al. | Digital gesture recognition based on millimeter wave radar | |
| Zhou et al. | Efficiently user-independent ultrasonic-based gesture recognition algorithm | |
| Zhang et al. | Towards ubiquitous sensing and localization with reconfigurable intelligent surfaces | |
| Long et al. | Low power millimeter wave radar system for the visually impaired |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20170905 |
|
| WD01 | Invention patent application deemed withdrawn after publication |