CN110850968A - Man-machine interaction system based on gesture control - Google Patents
Man-machine interaction system based on gesture control Download PDFInfo
- Publication number
- CN110850968A CN110850968A CN201911013104.5A CN201911013104A CN110850968A CN 110850968 A CN110850968 A CN 110850968A CN 201911013104 A CN201911013104 A CN 201911013104A CN 110850968 A CN110850968 A CN 110850968A
- Authority
- CN
- China
- Prior art keywords
- module
- signal
- gesture
- system based
- signal receiving
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000003993 interaction Effects 0.000 title claims abstract description 25
- 238000012545 processing Methods 0.000 claims abstract description 31
- 210000003811 finger Anatomy 0.000 claims abstract description 17
- 210000003813 thumb Anatomy 0.000 claims abstract description 5
- 210000005224 forefinger Anatomy 0.000 claims abstract 2
- 230000000875 corresponding effect Effects 0.000 claims description 34
- 210000000707 wrist Anatomy 0.000 claims description 25
- 210000003205 muscle Anatomy 0.000 claims description 12
- 239000013598 vector Substances 0.000 claims description 12
- 230000001133 acceleration Effects 0.000 claims description 9
- 230000005540 biological transmission Effects 0.000 claims description 5
- 238000003909 pattern recognition Methods 0.000 claims description 4
- 230000003139 buffering effect Effects 0.000 claims description 3
- 230000000694 effects Effects 0.000 claims description 3
- 238000000605 extraction Methods 0.000 claims description 3
- 238000001914 filtration Methods 0.000 claims description 3
- 230000006698 induction Effects 0.000 claims description 3
- 230000001960 triggered effect Effects 0.000 claims description 3
- 230000009466 transformation Effects 0.000 claims description 2
- 230000009471 action Effects 0.000 abstract description 7
- 238000004519 manufacturing process Methods 0.000 abstract description 3
- 241000203475 Neopanax arboreus Species 0.000 abstract description 2
- 230000009286 beneficial effect Effects 0.000 abstract description 2
- 238000010586 diagram Methods 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 210000003414 extremity Anatomy 0.000 description 3
- 238000011160 research Methods 0.000 description 3
- 206010011878 Deafness Diseases 0.000 description 2
- 241000282414 Homo sapiens Species 0.000 description 2
- 238000004891 communication Methods 0.000 description 2
- 230000007246 mechanism Effects 0.000 description 2
- 238000000034 method Methods 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 241000282412 Homo Species 0.000 description 1
- 230000004075 alteration Effects 0.000 description 1
- 238000013473 artificial intelligence Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000007774 longterm Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003183 myoelectrical effect Effects 0.000 description 1
- 230000008054 signal transmission Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 238000012795 verification Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/107—Static hand or arm
- G06V40/113—Recognition of static hand signs
Abstract
The invention discloses a man-machine interaction system based on gesture control, which comprises a signal transmitting device and a signal receiving and executing device, wherein the signal transmitting device is connected with the signal receiving and executing device; the signal transmitting device comprises a signal transmitting module, a signal receiving module, a signal processing module, a signal classifying module and a wireless signal transmitting module; the signal receiving and executing device comprises a wireless signal receiving module, a chip main control module and a driving and executing module; the beneficial effects are that: the signal transmitting device is an intelligent bracelet and the like, is convenient to wear and low in cost, is convenient to operate and use by a user, is free from restricting gesture actions, can transmit the electromyographic signals by performing simple actions such as finger tightening, forefinger and thumb tightening, other finger stretching, five-finger stretching and the like, and is easy to put into practical production and use in large quantity.
Description
Technical Field
The invention belongs to the technical field of human-computer interaction, and particularly relates to a human-computer interaction system based on gesture control.
Background
With the development of interdisciplinary research, surface electromyographic signal gesture recognition is widely applied to the aspects of biomedicine, rehabilitation engineering, artificial intelligence and the like, and the research is developed into a popular research subject in the fields of biological signal processing and pattern recognition. The gesture recognition can enable the limb disabled patient to effectively complete limb actions through the artificial limb, and hopefully return to the life state of normal people; the gesture communication between the deaf-dumb person and the healthy person can be simplified, and the communication intentions of the deaf-dumb person and the healthy person can be more easily understood; the intelligent motion sensing device can also be used in motion sensing games and intelligent equipment, so that the life of people is more convenient and intelligent, and the life quality is improved. The surface electromyogram gesture signal has the characteristics of nonlinearity, non-stability, strong randomness, weak signal and the like, and background noise is added in the acquisition process.
The surface electromyogram signal gesture recognition is currently applied in the technical field of human-computer interaction, and mainly comprises interaction between a human and an execution mechanism (such as a robot) and interaction between the execution mechanism and the environment. The former has the significance that planning and decision making by an actuator in unknown or uncertain environments can be realized by people; the latter meaning that tasks can be performed by the robot in harsh or remote environments not accessible to humans. At present, a commonly used human-computer interaction technology is a gesture interaction technology based on a sensor, and the application of the technology requires a user to wear hardware equipment such as a position sensor and the like, and information such as finger states, motion tracks and the like is acquired by using the sensor, so that operation processing is performed to enable a computer to recognize gesture actions, and various interaction controls are realized. But the shortcoming is that equipment is worn complicacy, with high costs, user operation is inconvenient to use and the gesture action is restricted by certain constraint, consequently is difficult to put into practical production and use in a large number, and this is the problem that awaits solution at present.
Disclosure of Invention
The invention aims to provide a human-computer interaction system based on gesture control, which is simple in wearing equipment, low in cost and simple in operation of a user through the wearing equipment.
In order to solve the technical problems, the technical scheme of the invention is as follows: a man-machine interaction system based on gesture control comprises a signal transmitting device and a signal receiving executing device; the signal transmitting device comprises a signal transmitting module, a signal receiving module, a signal processing module, a signal classifying module and a wireless signal transmitting module; the signal receiving and executing device comprises a wireless signal receiving module, a chip main control module and a driving and executing module;
the signal emission module is used for a user to send out a marking signal, the signal receiving module is used for receiving and acquiring the marking signal, the signal processing module is used for processing the marking signal in a buffering mode, a filtering mode and an amplifying mode so as to extract characteristic vectors, the signal classification module is used for classifying, sorting and analyzing the characteristic vectors to form control instructions, the wireless signal sending module is used for sending the control instructions to the signal receiving and executing device, the wireless signal receiving module of the signal receiving and executing device is used for receiving the control instructions and sending the control instructions to the chip main control module, the chip main control module is used for receiving the control instructions and sending the control instructions to the driving and executing module, and the driving and executing module is used for executing corresponding actions so as to achieve the effect of man.
As a preferred scheme of the present invention, the signal transmitting device is an intelligent bracelet, and the signal receiving executing device is an intelligent luggage van.
As a preferred scheme of the invention, the signal transmitting module is an electrode patch arranged on the inner side wall of the intelligent bracelet, and when a gesture occurs, the muscle of the wrist is in full contact with the electrode patch to send out the marking signal; and after the processing of the signal processing module, a corresponding shape is formed on a two-dimensional coordinate through a first algorithm, and a sent gesture command is judged according to the shape.
As a preferred scheme of the invention, the electrode patch generates micro-current after contacting with wrist muscle, the signal processing module amplifies, filters, reduces noise and performs Fourier transformation on the micro-current signal, and the posterior probability of the gesture is calculated through a second algorithm; and improving the accuracy of gesture recognition through the corresponding shape and the calculated posterior probability.
As a preferred scheme of the invention, the signal transmitting module is a plurality of microwave transmitters arranged on the smart band, and the plurality of microwave transmitters are uniformly distributed on the periphery of the smart band; when the gesture is made, the microwave emitted by the triggered microwave emitter is interfered by other microwave emitters and received by the signal processing module, and finally, a corresponding shape is formed on the two-dimensional coordinate, so that the specific gesture is judged.
As a preferable scheme of the present invention, a nine-axis sensor is further disposed in the intelligent bracelet, and the nine-axis sensor includes a three-axis gyroscope, an acceleration sensor, and a geomagnetic sensor. The three-axis gyroscope is used for detecting the rotation of the intelligent bracelet, the acceleration sensor is used for detecting the vector acceleration direction and the speed of the intelligent bracelet, and the geomagnetic sensor is used for correcting the accumulated deviation of the intelligent bracelet.
As a preferred scheme of the present invention, the signal receiving module obtains the signal through an MP160 multi-lead physiological recorder.
As a preferred scheme of the present invention, the signal processing module calculates the average accuracy of the classification result of the signal data, and determines the gesture to which the surface signal belongs, using a combination of a feature vector extraction algorithm and a pattern recognition classifier corresponding to the maximum value in the average accuracy of the classification result as an optimal combination.
As a preferable scheme of the invention, the gestures comprise that the fingers are closed, the index finger and the thumb are closed, other fingers are extended, and the five fingers are opened.
As a preferred scheme of the present invention, the wireless signal transmitting module is connected to the wireless signal receiving module through one of infrared ray induction, bluetooth transmission, ZigBee, and WiFi.
The beneficial effect of adopting above-mentioned technical scheme is: the signal transmitting device is small equipment such as an intelligent bracelet and the like, is convenient to wear and low in cost, is convenient to operate and use by a user, is free from restricting gesture actions, can transmit the electromyographic signals by performing simple actions such as finger tightening, finger tightening and thumb tightening and other finger stretching, five-finger stretching and the like, and is easy to put into practical production and use in large quantity.
Drawings
FIG. 1 is a schematic diagram of the principles of the present invention;
FIG. 2 is a connection block diagram of the present invention;
fig. 3 is a schematic diagram of an embodiment of a signal transmitting module according to the present invention.
Detailed Description
The following further describes embodiments of the present invention with reference to the drawings. It should be noted that the description of the embodiments is provided to help understanding of the present invention, but the present invention is not limited thereto. In addition, the technical features involved in the embodiments of the present invention described below may be combined with each other as long as they do not conflict with each other.
As shown in fig. 1, the embodiment provides a human-computer interaction system based on gesture manipulation, which includes a signal transmitting device and a signal receiving executing device; the signal transmitting device and the receiving executing device are two independent devices connected through wireless. A circuit control board is arranged in the signal transmitting device, and a signal transmitting module, a signal receiving module, a signal processing module, a signal classification module and a wireless signal transmitting module are arranged on the circuit control board. A circuit board is arranged in the signal receiving execution device, and a wireless signal receiving module, a chip main control module and a driving execution module are arranged on the circuit board.
The signal emission module is a part for a user to send a marking signal, the signal receiving module is used for receiving and acquiring the marking signal, the signal processing module is used for buffering, filtering and amplifying the marking signal to extract a characteristic vector, the signal classification module classifies, arranges and analyzes the characteristic vector to form a control instruction, the wireless signal sending module is used for sending the control instruction to the signal receiving and executing device, the wireless signal receiving module of the signal receiving and executing device is used for receiving the control instruction and sending the control instruction to the chip main control module, the chip main control module is used for receiving the control instruction and sending the control instruction to the driving and executing module, and the driving and executing module is used for executing corresponding actions to achieve the effect of man-machine interaction.
As shown in fig. 2, there are many embodiments of the signal transmitting device and the signal receiving executing device applying the invention, and the signal transmitting device is preferably an intelligent bracelet, and the signal receiving executing device is an intelligent curtain; the intelligent bracelet is also an embodiment which is more applied at present, and the main reason is that the intelligent bracelet is convenient to wear and is suitable for being used in cooperation with gestures; the intelligent curtain is connected with a controller through a circuit board, the circuit board is arranged in the controller, the wireless signal receiving module on the circuit board and the wireless signal sending module on the circuit board enable the intelligent bracelet to be in wireless connection with the intelligent curtain, a user can wear the intelligent bracelet on the wrist, and corresponding instructions are formed on the intelligent curtain by making gestures, so that the intelligent curtain can make corresponding actions; for example, the palm upwards swings, the muscle on the upper portion of the wrist contacts with the signal emitting module of the intelligent bracelet, the signal emitting module generates corresponding marking signals, and the marking signals are transmitted to the intelligent curtain in the above mode, so that the intelligent curtain makes corresponding actions, for example, the intelligent curtain automatically moves upwards to be packed up, the palm downwards swings, and the intelligent curtain moves downwards to stretch out.
In some feasible embodiments, the signal transmitting device is an intelligent bracelet, the signal receiving and executing device is an electric lamp, the existing electric lamp switch is usually a manual button, and after long-term use, the button is easy to damage and inconvenient to maintain, and if the electric lamp is far away from the switch, the operation is troublesome; the invention solves the problem well. The circuit board is arranged in the electric lamp, the wireless signal receiving module on the circuit board and the wireless signal sending module on the circuit control board enable the intelligent bracelet to be wirelessly connected with the electric lamp, a user can wear the intelligent bracelet on a wrist, and corresponding instructions are formed on the electric lamp by gestures so that the electric lamp can make corresponding actions; for example, the wrist rotates rightwards, muscles around the wrist are in friction contact with the signal emitting module of the smart bracelet, the signal emitting module generates corresponding marking signals, and the marking signals are transmitted to the electric lamp in the above mode, so that the electric lamp makes corresponding actions, such as the light emitting of the electric lamp; the wrist is turned to the left and the lamp is extinguished.
In some possible embodiments, the signal transmitting device is an intelligent bracelet, and the signal receiving executing device is a projector; the existing projector usually adjusts parameters such as a switch, a page turning and a focal length manually, is inconvenient to use, and is inconvenient to maintain when a remote controller is broken sometimes; the invention solves the problem well. The circuit board is arranged in the projector, the wireless signal receiving module on the circuit board and the wireless signal sending module on the circuit control board enable the intelligent bracelet to be wirelessly connected with the projector, a user can wear the intelligent bracelet on the wrist, and corresponding instructions are formed on the projector by making gestures, so that the projector makes corresponding actions; for example, the palm swings rightwards, the muscle on the right part of the wrist is contacted with the signal transmitting module of the intelligent bracelet, the signal transmitting module generates a corresponding marking signal, and the marking signal is transmitted to the projector in the above mode, so that the projector makes corresponding actions, for example, a picture displayed by the projector turns pages rightwards, the palm swings leftwards, and the picture displayed by the projector turns pages leftwards; the palm swings upwards, the projector is powered off, the palm swings downwards, the projector is powered on and the like.
In some possible embodiments, the signal transmitting device is a smart band, and the signal receiving and executing device is a camera or other electronic devices equipped with a camera, such as a smart phone. When a large group photo needs to be shot, a single shot person is needed, and the shot person cannot participate in the large group photo; the intelligent bracelet disclosed by the invention can be used for well solving the problem, and people wearing the intelligent bracelet can take corresponding actions to control the shutter of the camera to take pictures through wireless signals without taking pictures by independent people. For example, if the wrist swings upward, the camera will start photographing immediately, and the person making the gesture will be photographed.
In some possible embodiments, the signal transmitting device is a smart band, and the signal receiving and executing device is an air conditioner. The air conditioner is usually adjusted by using a remote controller or directly adjusted on a host, but the condition that the remote controller is lost or an adjusting interface of the air conditioner fails is often met, so that the air conditioner is inconvenient to adjust or cannot be adjusted; for example, the palm swings rightwards, the muscle on the right part of the wrist is contacted with the signal transmitting module of the intelligent bracelet, the signal transmitting module generates a corresponding marking signal, the marking signal is wirelessly transmitted to a circuit board arranged in the air conditioner, and the temperature adjusting function is realized, for example, the palm swings rightwards, the temperature of the air conditioner rises, and the palm swings leftwards; the temperature of the air conditioner is reduced, the palm swings upwards, and the air conditioner is started; the palm swings downwards and the air conditioner is closed.
In some possible embodiments, the signal transmitting device is an intelligent bracelet, the signal receiving executing device is an emergency device, and the circuit board is installed in the emergency device; the emergency treatment device is usually connected with a plurality of alarms, and after the emergency treatment device is started, all the alarms can give out alarm sounds at the same time, but the alarms are usually controlled by a switch which is manually controlled; however, if the switch of the emergency device fails, the emergency situation occurs again, which is very troublesome; the switch has long service time and is easy to cause problems; the intelligent bracelet solves the problem well, and a person wearing the intelligent bracelet can control the emergency device to respond to an alarm connected with the emergency device through a wireless signal when doing corresponding actions; for example, the wrist swings to the right three times continuously, and the emergency device responds to all the alarms to give out alarm sounds; the wrist swings to the left three times continuously, and the first-aid device is stopped from working on all the alarms.
The signal transmitting module has a plurality of embodiments, the signal transmitting module is preferably an electrode patch arranged on the inner side wall of the intelligent bracelet, the electrode patch is uniformly distributed on the inner side wall of the intelligent bracelet, when a gesture is performed, the muscle of the wrist is fully contacted with the electrode patch, and the electrode patch is touched to transmit the marking signal; the plurality of electrode patches are connected with a circuit board arranged in the intelligent bracelet, generated marking signals are transmitted to a signal processing module arranged on the circuit board, a corresponding shape is formed on a two-dimensional coordinate through a first algorithm after the processing of the signal processing module, and a sent gesture command is judged according to the shape; because the marking signals generated by the electrode patches by making different gestures are different, the shape signals formed on the two-dimensional coordinates after being processed by the signal processing module are different, and finally the shape signals are sent to the intelligent luggage van to execute corresponding actions; for example, when a user lifts the wrist upwards, the electrode patches in the upper half area of the smart bracelet are contacted to send out marking signals to the signal processing module; the marking signals are processed by the signal processing module to form corresponding shape information on a two-dimensional coordinate, the shape information is transmitted to the intelligent luggage van through the wireless signal transmitting module and the wireless signal receiving module, and the chip main control module of the intelligent luggage van processes the shape information into machine executable signals so that the driving execution module drives corresponding parts to execute corresponding actions.
The motor patch and wrist muscles touch to generate a marking signal and micro-current, and a signal processing module in the intelligent bracelet amplifies, filters, reduces noise and performs Fourier transform on the micro-current signal and calculates a posterior result rule of the gesture through a second algorithm; the accuracy of gesture recognition is improved through the corresponding shape and the calculated posterior result rule.
As shown in fig. 3, in some possible embodiments, the signal transmitting module may also be a plurality of microwave transmitters disposed on the smart band, and the plurality of microwave transmitters are uniformly distributed on the periphery of the smart band; when the gesture is made, the microwave emitter emits microwave signals according to the microwave emitter touched by the wrist muscles, and when different gestures are made, the positions of the wrist muscles touching the microwave emitter are different, so that the angles of the microwave emitter emitting microwaves are different. For example, the wrist moves vertically downwards, the left end and the right end of the wrist symmetrically touch microwave emitters on two symmetrical sides of the lower part of the smart bracelet, so that the two microwave emitters emit microwave signals vertically upwards; and if the wrist moves to the lower left to make a gesture, the microwave emitter on the lower left side of the intelligent bracelet touches the wrist, and under the interference of the microwave emitter on the lower right side, a microwave signal is emitted to the upper left corner. The microwave emitted by the triggered microwave emitter is interfered with each other by other microwave emitters and received by the signal processing module, and the microwave signals interfered with each other finally form a corresponding shape on a two-dimensional coordinate, so that a specific gesture is judged. Through the continuous verification of the first algorithm and the second algorithm, the signal processing module can judge what the specific gesture made by the user is with higher probability.
And a nine-axis sensor is further arranged in the intelligent bracelet, and comprises a three-axis gyroscope, an acceleration sensor and a geomagnetic sensor. The three-axis gyroscope is used for detecting the rotation of the intelligent bracelet, the acceleration sensor is used for detecting the vector acceleration direction and the speed of the intelligent bracelet, and the geomagnetic sensor is used for correcting the accumulated deviation of the intelligent bracelet.
The signal receiving module has various embodiments, and in order to more stably receive the signal transmitted by the intelligent bracelet, the MP160 multi-lead physiological recorder is preferably used for acquiring the signal; myoelectric signals and marking signals are synchronously acquired through the MP160 multi-lead physiological recorder, and a software part of the MP160 multi-lead physiological recorder is installed on the intelligent luggage van.
And the signal processing module calculates the average accuracy of the classification result of the signal data, and determines the gesture to which the surface signal belongs by taking the combination of a feature vector extraction algorithm corresponding to the maximum value in the average accuracy of the classification result and the pattern recognition classifier as an optimal combination.
The commonly used gestures of the invention comprise that the fingers are closed, the index finger and the thumb are closed, other fingers are extended, and the five fingers are opened; since the gestures described above are gestures that make the signal emitting device easier to recognize and can emit a complete marking signal, some other more subtle gestures are generally implemented based on the gestures described above.
The wireless signal sending module is connected with the wireless signal receiving module through one of infrared ray induction, Bluetooth transmission, ZigBee or WiFi. The intelligent hand ring and the intelligent luggage van are all common wireless connection modes in the field, in order to enable signal transmission to be more stable and farther, a ZigBee transmission mode is preferably selected to be used generally, the ZigBee transmission mode not only enables the intelligent hand ring to control the intelligent luggage van one to one, but also enables the intelligent luggage van to be controlled many to one, and therefore the intelligent luggage van is more intelligent.
The embodiments of the present invention have been described in detail with reference to the accompanying drawings, but the present invention is not limited to the described embodiments. It will be apparent to those skilled in the art that various changes, modifications, substitutions and alterations can be made in these embodiments without departing from the principles and spirit of the invention, and the scope of protection is still within the scope of the invention.
Claims (10)
1. A man-machine interaction system based on gesture control is characterized by comprising a signal transmitting device and a signal receiving executing device; the signal transmitting device comprises a signal transmitting module, a signal receiving module, a signal processing module, a signal classifying module and a wireless signal transmitting module; the signal receiving and executing device comprises a wireless signal receiving module, a chip main control module and a driving and executing module;
the signal emission module is used for a user to send out a marking signal, the signal receiving module is used for receiving and acquiring the marking signal, the signal processing module is used for processing the marking signal in a buffering mode, a filtering mode and an amplifying mode so as to extract characteristic vectors, the signal classification module is used for classifying, sorting and analyzing the characteristic vectors to form control instructions, the wireless signal sending module is used for sending the control instructions to the signal receiving and executing device, the wireless signal receiving module of the signal receiving and executing device is used for receiving the control instructions and sending the control instructions to the chip main control module, the chip main control module is used for receiving the control instructions and sending the control instructions to the driving and executing module, and the driving and executing module is used for executing corresponding actions so as to achieve the effect of man.
2. The human-computer interaction system based on gesture control according to claim 1, wherein the signal transmitting device is an intelligent bracelet, and the signal receiving executing device is an intelligent luggage van.
3. The human-computer interaction system based on gesture control according to claim 2, wherein the signal transmitting module is an electrode patch arranged on the inner side wall of the smart bracelet, and when a gesture occurs, the muscle of the wrist is in full contact with the electrode patch to send out the marking signal; and after the processing of the signal processing module, a corresponding shape is formed on a two-dimensional coordinate through a first algorithm, and a sent gesture command is judged according to the shape.
4. The human-computer interaction system based on gesture control according to claim 3, wherein micro-current is generated after the electrode patch is in contact with wrist muscles, the signal processing module amplifies, filters, reduces noise and performs Fourier transformation on signals of the micro-current, and the posterior probability of the gesture is calculated through a second algorithm; and improving the accuracy of gesture recognition through the corresponding shape and the calculated posterior probability.
5. The human-computer interaction system based on gesture control according to claim 2, wherein the signal transmitting module is a plurality of microwave transmitters arranged on the smart band, and the plurality of microwave transmitters are uniformly distributed on the periphery of the smart band; when the gesture is made, the microwave emitted by the triggered microwave emitter is interfered by other microwave emitters and received by the signal processing module, and finally, a corresponding shape is formed on the two-dimensional coordinate, so that the specific gesture is judged.
6. The human-computer interaction system based on gesture control according to claim 2, wherein a nine-axis sensor is further arranged in the smart bracelet, and the nine-axis sensor comprises a three-axis gyroscope, an acceleration sensor and a geomagnetic sensor. The three-axis gyroscope is used for detecting the rotation of the intelligent bracelet, the acceleration sensor is used for detecting the vector acceleration direction and the speed of the intelligent bracelet, and the geomagnetic sensor is used for correcting the accumulated deviation of the intelligent bracelet.
7. The human-computer interaction system based on gesture control according to claim 1, wherein the signal receiving module obtains signals through an MP160 multi-lead physiological recorder.
8. The human-computer interaction system based on gesture manipulation according to claim 1, wherein the signal processing module calculates the average accuracy of the classification results of the signal data, and determines the gesture to which the surface signal belongs by taking the combination of a feature vector extraction algorithm and a pattern recognition classifier corresponding to the maximum value in the average accuracy of the classification results as an optimal combination.
9. The human-computer interaction system based on gesture manipulation according to claim 8, wherein the gesture comprises finger tight, forefinger and thumb tight, other fingers extending out, and five fingers extending out.
10. The human-computer interaction system based on gesture control of claim 1, wherein the wireless signal sending module is connected with the wireless signal receiving module through one of infrared ray induction, Bluetooth transmission, ZigBee or WiFi.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911013104.5A CN110850968A (en) | 2019-10-23 | 2019-10-23 | Man-machine interaction system based on gesture control |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911013104.5A CN110850968A (en) | 2019-10-23 | 2019-10-23 | Man-machine interaction system based on gesture control |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110850968A true CN110850968A (en) | 2020-02-28 |
Family
ID=69597831
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911013104.5A Pending CN110850968A (en) | 2019-10-23 | 2019-10-23 | Man-machine interaction system based on gesture control |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110850968A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112306242A (en) * | 2020-11-09 | 2021-02-02 | 幻境虚拟现实(广州)智能科技研究院有限公司 | Interaction method and system based on book-space gestures |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104199546A (en) * | 2014-08-31 | 2014-12-10 | 上海威璞电子科技有限公司 | Method for achieving control on basis of wrist strap and bracelet products by means of four gestures |
| CN105094301A (en) * | 2014-05-16 | 2015-11-25 | 中兴通讯股份有限公司 | Control method and device, and electronic equipment |
| CN105817037A (en) * | 2016-05-19 | 2016-08-03 | 深圳大学 | Toy air vehicle based on myoelectric control and control method thereof |
| US20180120420A1 (en) * | 2015-04-20 | 2018-05-03 | Resmed Sensor Technologies Limited | Gesture recognition with sensors |
| CN109491504A (en) * | 2018-11-08 | 2019-03-19 | 郑州大学 | A kind of projection interactive system based on gesture electromyography signal |
-
2019
- 2019-10-23 CN CN201911013104.5A patent/CN110850968A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105094301A (en) * | 2014-05-16 | 2015-11-25 | 中兴通讯股份有限公司 | Control method and device, and electronic equipment |
| CN104199546A (en) * | 2014-08-31 | 2014-12-10 | 上海威璞电子科技有限公司 | Method for achieving control on basis of wrist strap and bracelet products by means of four gestures |
| US20180120420A1 (en) * | 2015-04-20 | 2018-05-03 | Resmed Sensor Technologies Limited | Gesture recognition with sensors |
| CN105817037A (en) * | 2016-05-19 | 2016-08-03 | 深圳大学 | Toy air vehicle based on myoelectric control and control method thereof |
| CN109491504A (en) * | 2018-11-08 | 2019-03-19 | 郑州大学 | A kind of projection interactive system based on gesture electromyography signal |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112306242A (en) * | 2020-11-09 | 2021-02-02 | 幻境虚拟现实(广州)智能科技研究院有限公司 | Interaction method and system based on book-space gestures |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11543887B2 (en) | User interface control of responsive devices | |
| US11474604B2 (en) | User interface control of responsive devices | |
| US11150081B2 (en) | Thermal sensor position detecting device | |
| JP6669069B2 (en) | Detection device, detection method, control device, and control method | |
| Dementyev et al. | WristFlex: low-power gesture input with wrist-worn pressure sensors | |
| US20180356890A1 (en) | Wearable device | |
| CN102915111B (en) | A kind of wrist gesture control system and method | |
| US20170119553A1 (en) | A haptic feedback device | |
| CN108268141B (en) | Electronic device and information processing method | |
| US20230113991A1 (en) | Biopotential-Based Gesture Interpretation With Machine Labeling | |
| US11461991B2 (en) | Method of developing a database of controllable objects in an environment | |
| JP2017068572A (en) | Wearable device | |
| CN110850968A (en) | Man-machine interaction system based on gesture control | |
| KR20160039589A (en) | Wireless space control device using finger sensing method | |
| CN111563459A (en) | Finger motion acquisition method and finger motion acquisition equipment | |
| US20230280835A1 (en) | System including a device for personalized hand gesture monitoring | |
| CN206671687U (en) | A kind of intelligent display for wear-type | |
| CN111522429A (en) | Interaction method and device based on human body posture and computer equipment | |
| Bai et al. | Design of a breath detection system with multiple remotely enhanced hand-computer interaction devices | |
| CN215833870U (en) | Intelligent glasses interaction equipment and intelligent glasses | |
| CN116774816A (en) | Detecting user input from a multi-modal hand biometric | |
| CN114661168A (en) | Intelligent glasses interaction device, intelligent glasses and intelligent glasses interaction method | |
| CN115857660A (en) | Image-based gesture recognition intelligent ring | |
| Paradiso | WristFlex: Low-Power Gesture Input with Wrist-Worn Pressure Sensors | |
| TW201640278A (en) | Action recognizing system and method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20200228 |