CN102799270B - Human-computer interaction method based on electrostatic detection and myoelectric detection - Google Patents

Human-computer interaction method based on electrostatic detection and myoelectric detection Download PDF

Info

Publication number
CN102799270B
CN102799270B CN201210229985.6A CN201210229985A CN102799270B CN 102799270 B CN102799270 B CN 102799270B CN 201210229985 A CN201210229985 A CN 201210229985A CN 102799270 B CN102799270 B CN 102799270B
Authority
CN
China
Prior art keywords
pole plate
electrostatic
detection
signal
electrode
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN201210229985.6A
Other languages
Chinese (zh)
Other versions
CN102799270A (en
Inventor
唐凯
李鹏斐
陈曦
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Institute of Technology BIT
Original Assignee
Beijing Institute of Technology BIT
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Institute of Technology BIT filed Critical Beijing Institute of Technology BIT
Priority to CN201210229985.6A priority Critical patent/CN102799270B/en
Publication of CN102799270A publication Critical patent/CN102799270A/en
Application granted granted Critical
Publication of CN102799270B publication Critical patent/CN102799270B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Landscapes

  • User Interface Of Digital Computer (AREA)

Abstract

The invention discloses a human-computer interaction method based on electrostatic detection and myoelectric detection, and further discloses a human-computer interaction system based on electrostatic detection and myoelectric detection, and used for realizing the human-computer interaction method based on electrostatic detection and myoelectric detection, belonging to the field of human-computer interaction. According to the invention, the movement speeds and the movement directions of the hands of a human body are measured via a non-contact type electrostatic detection method, so as to determine the real-time positions of the hands, the detailed action information of fingers is obtained via a contact type myoelectric signal, so as to control the operation of a mouse of a computer with high accuracy, and finish complex human-computer interaction, and the whole interaction process is not influenced by the light ray of an outside environment. The invention provides a novel realization method for human-computer interaction. The human-computer interaction method based on electrostatic detection and myoelectric detection disclosed by the invention has the advantage of small working dead angle areas by virtue of the advantage of the little obstruction of obstacles to an electrostatic induction signal during a transmission process. The myoelectric signal extraction circuit designed according to the invention has the advantages of being small in volume, high in signal-to-noise ratio, accurate in power frequency filter, good in stability, etc.

Description

A kind of man-machine interaction method detected based on electrostatic and myoelectricity
Technical field
The present invention relates to a kind of man-machine interaction method, particularly relate to a kind of man-machine interaction method detected based on electrostatic and myoelectricity, belong to field of human-computer interaction.
Background technology
Along with the fast development of computer technology, computing machine has become the indispensable part of people's daily life.Human-computer interaction technology, as the important component part of computer user interface, is the focus of research always.In decades, people use keyboard always widely, mouse carrys out operating computer, these traditional interactive modes be difficult to meet user whenever and wherever possible, interbehavior demand efficiently naturally.Under traditional interactive mode, people can only go to exchange with computing machine with " thinking of computing machine ", " saying " computing machine " listen understand words ".An important goal of man-machine interaction research, exactly the binding site of human thinking and computer mind is moved to the direction of human thinking, computing machine is allowed to understand the behavior of the mankind as much as possible, link up with interpersonal exchange way and user, and always do not allow user to adapt to computing machine, allow man-machine interaction become nature, harmony.Spoken language, written language, body language, expression etc. are the interpersonal natural languages exchanging often use, the cognition custom of these mankind's self-assembling formations and form, the developing direction of necessarily man-machine interaction.In order to reach the high level goal of man-machine interaction natural harmony, also in order to overcome the deficiency of current existing interaction technique, the interactive mode based on natural language receives the attention of a lot of researchist.Based on mutual such as phonetic entry, the phonetic synthesis of spoken language, based on the dynamic input of mutual such as eye of expression, the interactive mode that the such as gesture input etc. based on body language is advanced is all the focus of current man-machine interaction research field.
With traditional interactive mode as compared with keyboard, mouse, direct hand is as input nature, succinct, directly and express the meaning abundant.Directly use hand as input, need to measure hand position and motion state, " Anadaptive Kalman-based Bayes estimation technique to classify locomotor activitiesin young and elderly adults through accelerometers " R.Muscillo, M.Schmid, S.Conforto and T.D'Alessio, Med.Eng.Phys.32, 849-859 (2010), " Detection of pedestrians in far-infraredautomotive night vision using region-growing and clothing distortion compensation " R.O'Malley, E.Jonesa, and M.Glavin, Infrared.Phys.Techn.53, 439-449 (2010), " Human detection using amobile platform and novel features derived from a visual saliency mechanism " S.Montabone, and A.Soto, Image.Vision.Comput.28, respectively by human hands sensor installation in 391-402 (2010), infrared detection technique and image pattern recognition realize testing the speed to human hands.But launch the equipment of infrared signal due to indoor existence heating, illumination etc., in outdoor environment, there is the infrared origin such as illumination simultaneously, make the error rate of the infrared detection technique being applied to human hands motion measurement higher.The most frequently used is at present the gesture interaction of view-based access control model, and utilizing camera to carry out contactless catching to gesture, is a kind of naturally interactive mode.But the method for view-based access control model is easily subject to the impact such as change of background, ambient lighting change, the image background that camera obtains is complicated, gesture is apparent also can be had a strong impact on by it, very complicated to the analysis of images of gestures, be difficult to the real-time ensureing interactive system, cannot play a role at the video dead angle area of camera, therefore, the man-machine interaction mode of view-based access control model has data processing complex, poor real and have the shortcoming of angle limitations.
And electrostatic detection technology be utilize object in motion with electrostatic realize detection and identify to target.The method of the insect in creeping being carried out to electrostatic detection is proposed in " Triboelectrification of houseflies (Musca domestic L.) walking on syntheticdielectric surfaces " Mcgonigle D F, Jackson C W and Davidson J L2002 J.Electrostat.54167-177 first.Inspire by this, " Electrification of human body by walking " Ficker T 2006 J.Electrostat.6410-16 is studied the change of people's bulk potential in motion by the electrometer be arranged on the person.Because the object of all motions all can bring electrostatic, and electrostatic field has unique boundary condition, therefore by the change of electrostatic field, measurement can be positioned to the charged human body hand of motion, therefore electrostatic detection method is applied to and measures human body and human limb motion, and it is feasible for carrying out man-machine interaction, at home and abroad there is no application electrostatic detection method being applied to man-machine interaction.
Human-computer interaction technology based on bioelectrical signals is one of the study frontier and focus of teleoperation robot and human-computer interaction technology in recent years.Abroad in some laboratory, electromyographic signal EMG signal is the studied control signal being used as disability patient artifucial limb.But in great majority research, due to comparatively complicated to electromyographic signal pattern recognition process, but can identify finger movement.
The man-machine interaction of at present not yet handlebar electrostatic detection and the man-machine interaction mode obtaining man-machine interaction based on electromyographic signal and merge mutually, this man-machine interaction mode has the advantage of the man-machine interaction mode based on electrostatic detection and the man-machine interaction mode based on electromyographic signal concurrently, namely there is more mutual angle and interactive region, do not rely on ambient light, there is again higher human body gesture identification precision, the action of finger can be distinguished, complete comparatively complicated human-computer interaction function.
Summary of the invention
The technical problem to be solved in the present invention utilizes Non-contact electrostatic detection mode and contact electromyographic signal to obtain to realize man-machine interactive operation, human hands movement velocity and direction is measured by Non-contact electrostatic detection method, determine hand real time position, by judging hand exercise state, finger minutiae action message is obtained by contact electromyographic signal, the operation of high-precision computer for controlling mouse, complete complicated man-machine interaction, whole reciprocal process does not affect by external environment light.The invention discloses a kind of man-machine interaction method detected based on electrostatic and myoelectricity, the working angle district of human hands speed and orientation measurement technology can be reduced, reduce the design complexity of human hands motion detection system, realize the measurement to hand real time position and motion state, by judging hand exercise state, realize the operation to computer mouse.
The object of the invention is to be achieved through the following technical solutions:
A kind of man-machine interaction method specific implementation step based on electrostatic and myoelectricity detection disclosed by the invention is as follows:
Step one: lay the multi-electrode detection array that human hands motion electrostatic signal can be detected, described detection array comprises at least one group of multi-electrode probe unit; Multi-electrode probe unit is made up of five pole plates, and wherein four pole plates are divided into two right, and the line between two pairs of pole plates is orthogonal, and often pair of polar plate spacing is from being d, d≤200cm, and four polar plate positions are arranged in square; 5th pole plate is arranged on the direction perpendicular to four pole plate place planes, and distance four pole plates are apart from identical, and distance four pole plate place plan ranges are d, and five pole plates form a space four rib centrum.Polar plate spacing from for d less relative to human hands move distance, the time that the move distance d of analysis is used is less relative to human hands run duration, and the speed therefore recorded is human body real time kinematics speed;
Step 2: gather the electrostatic signal in monitoring of environmental, described electrostatic signal is the electrostatic induction signal potential value that each moment detection system obtains;
Step 3: the electrostatic induction signal potential value this collected and preset contrast, if this electrostatic induction signal is identical with this preset, then think detect human hands motion existence;
Step 4: the human hands detected in recording step two moves the crest value of the electrostatic induction signal produced on each pole plate, reads the zero crossing moment each pole plate following crest value closely; First the pole plate detecting electrostatic induction signal in definition pole plate composition pole plate is corresponding thereto to one, and pole plate is pole plate 1 to the pole plate first detecting electrostatic induction signal in, and another pole plate is pole plate 2; Another to pole plate be pole plate to two, pole plate is pole plate 4 to the pole plate first detecting electrostatic induction signal in two, and another pole plate is pole plate 3, and the pole plate of the 5th described in step one is pole plate 5; Read pole plate 1 in multi-electrode probe unit respectively, pole plate 2, pole plate 3, pole plate 4, the zero crossing moment t of what pole plate 5 collected follow closely crest value 1, t 2, t 3, t 4, t 5; Human hands is at pole plate 1, and on 2,3,4 surface levels formed, direction of motion α and human hands movement velocity V meets formula (1) and (2):
α = arccos V ( t 1 - t 2 ) d - - - ( 1 )
α = arcsin V ( t 3 - t 4 ) d - - - ( 2 )
Step 5: simultaneous formula (1) and (2) can obtain human hands at pole plate 1, on 2,3,4 surface levels formed, direction of motion α is:
α = arctg ( t 3 - t 4 t 1 - t 2 ) - - - ( 3 )
Human hands is at pole plate 1, and on 2,3,4 surface levels formed, movement velocity V is:
V = d ( t 3 - t 1 ) 2 + ( t 4 - t 2 ) 2 - - - ( 4 )
Step 6: human hands is at pole plate 1, and 2,3, the 4 horizontal plane direction movement velocity V ' formed are:
V ′ = d ( t 3 - t 1 ) 2 + ( t 4 - t 2 ) 2 2 - t 5 - - - ( 5 )
Step 7: quantity and the mode of structuring the formation of multi-electrode probe unit need according to actual detection target area and determine, in multi-electrode detection array, many group multi-electrode probe units can detect the human hands of the human hands at diverse location place at pole plate 1, 2, 3, real time kinematics direction α in 4 planes and human hands real time kinematics speed V, and at vertical plate 1, 2, 3, speed V ' in 4 planes, after obtaining human hands real time kinematics direction α and human hands real time kinematics speed V and V ', namely human hands real time kinematics track has been traced into, determine hand real time position and motion state.
Step 8: according to hand real time position and motion state, handle portion action is divided into movement, single knocks and knocks three kinds continuously, the mobile drag action being defined as corresponding mouse, single knock be defined as mouse choose operation, knock the opening operation being defined as mouse continuously, according to above-mentioned definition, computer mouse operation is mated, thus complete according to hand electrostatic detection signal and choose, the human-computer interaction function dragging and open.
Step 9: obtain hand muscle electric signal by electromyographic electrode and muscle electrical signal process circuit, recovers finger and opens and bending details movable information.
Step 10: opened and bending information by finger, complete image zooming, the interactive functions such as rotation.
The described man-machine interactive system detected based on electrostatic and myoelectricity comprises electrostatic detection system and myoelectricity detection system.Described electrostatic detection system comprises detection pole plate, current-voltage conversion circuit, amplifier, low-pass filter and data acquisition processing circuit and wireless receiving module.Detection pole plate obtains electrostatic induction electric charge amount, and the change of the quantity of electric charge produces static induced current, and the electric current of generation becomes magnitude of voltage through current-voltage conversion circuit, is then amplified through amplifier amplitude, removes noise subsequently through low-pass filter circuit.Filtered electrostatic induction voltage signal carries out gathering and calculation process by data acquisition processing circuit, and merges the electromyographic signal data received by wireless receiving module, and final data treatment circuit passes to computing machine mouse action information.
Described muscle electrical signal process circuit comprises electromyographic electrode, electromyographic signal modulate circuit, electromyographic signal amplifying circuit, muscle electrical signal process circuit, wireless transmitter module.Electromyographic electrode is placed on user's wrist position, obtain user's surface electromyography signal, impedance transformation is carried out by electromyographic signal modulate circuit, Signal Pretreatment, then voltage amplification is carried out by electromyographic signal amplifying circuit, carry out Acquire and process by muscle electrical signal process circuit, identify opening and flexure operation of finger, this information passes to electrostatic detection system by wireless transmitter module and carries out information fusion.
Preset described in step 3 is: the amplitude of the electrostatic induction signal collected first is changed from small to big, again from large to small subsequently; The electrostatic induction signal collected has cycle continuity, and two crests all appear in the electrostatic induction signal in each cycle, and wherein the amplitude of a rear crest is less than the half of the amplitude of previous crest.
In step 3, multi-electrode detection array comprises multiple multi-electrode probe unit, quantity and the mode of structuring the formation of multi-electrode probe unit need according to actual detection target area and determine, multi-electrode detection array can provide the real-time status of the human hands at diverse location place, improves regional extent and the precision of man-machine interaction.
Because shelter thoroughly cannot hinder the transmission of electrostatic field, therefore utilizing electrostatic detection technology to carry out man-machine interaction affects little by shelter, so electrostatic detection technology carries out man-machine interaction have the little advantage in working angle district, and by the acquisition to electromyographic signal, finger movement details can be identified, complete complicated human-computer interaction function.
Beneficial effect:
1, of the present inventionly man-machine interaction method is detected based on electrostatic and myoelectricity, human hands movement velocity and direction can be measured by Non-contact electrostatic detection method, determine hand real time position, by judging hand exercise state, the operation of computer for controlling mouse, obtain finger movement detailed information by electromyographic signal simultaneously, complete complicated man-machine interaction.
2, the Non-contact man-machine interaction method based on electrostatic detection of the present invention, hinders little owing to make use of in electrostatic induction signal communication process by shelter, has the advantages that working angle district is little.
3, the man-machine interaction method based on electromyographic signal of the present invention, finger movement details can be identified, complete more complicated human-computer interaction function, electromyographic signal EMG is obtained by the electromyographic electrode of wrist portion, obtain finger movement detailed information by carrying out process to EMG, realize the man-machine interaction of high-precision mouse action and sophisticated functions.For the complicated feature of electromyographic signal (EMG) under strong noise background, by the ingenious utilization to multiple Anti-Jamming Techniques such as forward drive, isolation amplification, digital filterings, devise electromyographic signal and extract circuit, there is the features such as volume is little, signal to noise ratio (S/N ratio) is high, power frequency filtering accurate, good stability.
Accompanying drawing explanation
Fig. 1 is human hands and one group of multi-electrode probe unit relative position relation schematic diagram of motion;
Fig. 2 is the non-contact type human-machine interaction system principle diagram based on electrostatic detection of the present invention;
Fig. 3 is the man-machine interactive system theory diagram based on electromyographic signal of the present invention
Embodiment
The specific embodiment of the present invention is described in detail below in conjunction with accompanying drawing.
A kind of Non-contact man-machine interaction method specific implementation step based on electrostatic detection of the present embodiment is as follows:
Step one: lay the multi-electrode detection array that human hands motion electrostatic signal can be detected, described detection array comprises at least one group of multi-electrode probe unit; Multi-electrode probe unit is made up of five pole plates, and wherein four pole plates are divided into two right, and the line between two pairs of pole plates is orthogonal, and often pair of polar plate spacing is from being d, d≤200cm, and four polar plate positions are arranged in square; 5th pole plate is arranged on the direction perpendicular to four pole plate place planes, and distance four pole plates are apart from identical, and distance four pole plate place plan ranges are d, and five pole plates form a space four rib centrum.Polar plate spacing from for d less relative to human hands move distance, the time that the move distance d of analysis is used is less relative to human hands run duration, and the speed therefore recorded is human body real time kinematics speed;
Step 2: gather the electrostatic signal in monitoring of environmental, described electrostatic signal is the electrostatic induction signal potential value that each moment detection system obtains;
Step 3: the electrostatic induction signal potential value this collected and preset contrast, if this electrostatic induction signal is identical with this preset, then think detect human hands motion existence;
Step 4: the human hands detected in recording step two moves the crest value of the electrostatic induction signal produced on each pole plate, reads the zero crossing moment each pole plate following crest value closely; First the pole plate detecting electrostatic induction signal in definition pole plate composition pole plate is corresponding thereto to one, and pole plate is pole plate 1 to the pole plate first detecting electrostatic induction signal in, and another pole plate is pole plate 2; Another to pole plate be pole plate to two, pole plate is pole plate 4 to the pole plate first detecting electrostatic induction signal in two, and another pole plate is pole plate 3, and the pole plate of the 5th described in step one is pole plate 5; Read pole plate 1 in multi-electrode probe unit respectively, pole plate 2, pole plate 3, pole plate 4, the zero crossing moment t of what pole plate 5 collected follow closely crest value 1, t 2, t 3, t 4, t 5; Human hands is at pole plate 1, and on 2,3,4 surface levels formed, direction of motion α and human hands movement velocity V meets formula (1) and (2):
α = arccos V ( t 1 - t 2 ) d - - - ( 1 )
α = arcsin V ( t 3 - t 4 ) d - - - ( 2 )
Step 5: simultaneous formula (1) and (2) can obtain human hands at pole plate 1, on 2,3,4 surface levels formed, direction of motion α is:
α = arctg ( t 3 - t 4 t 1 - t 2 ) - - - ( 3 )
Human hands is at pole plate 1, and on 2,3,4 surface levels formed, movement velocity V is:
V = d ( t 3 - t 1 ) 2 + ( t 4 - t 2 ) 2 - - - ( 4 )
Step 6: human hands is at pole plate 1, and 2,3, the 4 horizontal plane direction movement velocity V ' formed are:
V ′ = d ( t 3 - t 1 ) 2 + ( t 4 - t 2 ) 2 2 - t 5 - - - ( 5 )
Step 7: quantity and the mode of structuring the formation of multi-electrode probe unit need according to actual detection target area and determine, in multi-electrode detection array, many group multi-electrode probe units can detect the human hands of the human hands at diverse location place at pole plate 1, 2, 3, real time kinematics direction α in 4 planes and human hands real time kinematics speed V, and at vertical plate 1, 2, 3, speed V ' in 4 planes, after obtaining human hands real time kinematics direction α and human hands real time kinematics speed V and V ', namely human hands real time kinematics track has been traced into, determine hand real time position and motion state.
Step 8: according to hand real time position and motion state, handle portion action is divided into movement, single knocks and knocks three kinds continuously, the mobile drag action being defined as corresponding mouse, single knock be defined as mouse choose operation, knock the opening operation being defined as mouse continuously, according to above-mentioned definition, computer mouse operation is mated, thus complete according to hand electrostatic detection signal and choose, the human-computer interaction function dragging and open.
Step 9: obtain hand muscle electric signal by electromyographic electrode and muscle electrical signal process circuit, recovers finger and opens and bending details movable information.
Step 10: opened and bending information by finger, complete image zooming, the interactive functions such as rotation.
The described man-machine interactive system detected based on electrostatic and myoelectricity comprises electrostatic detection system and myoelectricity detection system.Described electrostatic detection system comprises detection pole plate, current-voltage conversion circuit, amplifier, low-pass filter and data acquisition processing circuit and wireless receiving module.Detection pole plate obtains electrostatic induction electric charge amount, and the change of the quantity of electric charge produces static induced current, and the electric current of generation becomes magnitude of voltage through current-voltage conversion circuit, is then amplified through amplifier amplitude, removes noise subsequently through low-pass filter circuit.Filtered electrostatic induction voltage signal carries out gathering and calculation process by data acquisition processing circuit, and merges the electromyographic signal data received by wireless receiving module, and final data treatment circuit passes to computing machine mouse action information.
Described muscle electrical signal process circuit comprises electromyographic electrode, electromyographic signal modulate circuit, electromyographic signal amplifying circuit, muscle electrical signal process circuit, wireless transmitter module.Electromyographic electrode is placed on user's wrist position, obtain user's surface electromyography signal, impedance transformation is carried out by electromyographic signal modulate circuit, Signal Pretreatment, then voltage amplification is carried out by electromyographic signal amplifying circuit, carry out Acquire and process by muscle electrical signal process circuit, identify opening and flexure operation of finger, this information passes to electrostatic detection system by wireless transmitter module and carries out information fusion.
Preset described in step 3 is: the amplitude of the electrostatic induction signal collected first is changed from small to big, again from large to small subsequently; The electrostatic induction signal collected has cycle continuity, and two crests all appear in the electrostatic induction signal in each cycle, and wherein the amplitude of a rear crest is less than the half of the amplitude of previous crest.
In step 3, multi-electrode detection array comprises multiple multi-electrode probe unit, quantity and the mode of structuring the formation of multi-electrode probe unit need according to actual detection target area and determine, multi-electrode detection array can provide the real-time status of the human hands at diverse location place, improves regional extent and the precision of man-machine interaction.
Because shelter thoroughly cannot hinder the transmission of electrostatic field, therefore utilizing electrostatic detection technology to carry out man-machine interaction affects little by shelter, so electrostatic detection technology carries out man-machine interaction have the little advantage in working angle district, and by the acquisition to electromyographic signal, finger movement details can be identified, complete complicated human-computer interaction function.
Scope is not only confined to the present embodiment, the present embodiment for explaining the present invention, all changes with the present invention under same principle and design condition or revise all within protection domain disclosed by the invention.

Claims (8)

1., based on the man-machine interaction method that electrostatic and myoelectricity detect, it is characterized in that, comprise the steps:
Step one: lay the multi-electrode detection array that human hands motion electrostatic signal can be detected, described detection array comprises at least one group of multi-electrode probe unit; Multi-electrode probe unit is made up of five pole plates, and wherein four pole plates are divided into two right, and the line between two pairs of pole plates is orthogonal, and often pair of polar plate spacing is from being d, d≤200cm, and four polar plate positions are arranged in square; 5th pole plate is arranged on the direction perpendicular to four pole plate place planes, and distance four pole plates are apart from identical, and distance four pole plate place plan ranges are d, and five pole plates form a space four rib centrum; Polar plate spacing from for d less relative to human hands move distance, the time that the move distance d of analysis is used is less relative to human hands run duration, and the speed therefore recorded is human body real time kinematics speed;
Step 2: gather the electrostatic signal in monitoring of environmental, described electrostatic signal is the electrostatic induction signal potential value that each moment detection system obtains;
Step 3: the electrostatic induction signal potential value this collected and preset contrast, if this electrostatic induction signal potential value is identical with this preset, then think detect human hands motion existence;
Step 4: the human hands detected in recording step two moves the crest value of the electrostatic induction signal produced on each pole plate, reads the zero crossing moment each pole plate following crest value closely; The pole plate that first definition detects electrostatic induction signal pole plate composition pole plate is corresponding thereto to one, and pole plate is the first pole plate to the pole plate first detecting electrostatic induction signal in, and another pole plate is the second pole plate; Another to pole plate be pole plate to two, pole plate is quadripolar plate to the pole plate first detecting electrostatic induction signal in two, and another pole plate is tri-electrode, and the pole plate of the 5th described in step one is the 5th pole plate; Read the first pole plate in multi-electrode probe unit respectively, the second pole plate, tri-electrode, quadripolar plate, the zero crossing moment t of what the 5th pole plate collected follow closely crest value 1, t 2, t 3, t 4, t 5; Human hands direction of motion α and human hands movement velocity V on the surface level of the first pole plate, the second pole plate, tri-electrode, quadripolar plate formation meets formula (1) and (2):
α = arccos V ( t 1 - t 2 ) d - - - ( 1 )
α = arcsin V ( t 3 - t 4 ) d - - - ( 2 )
Step 5: simultaneous formula (1) and (2) can obtain human hands direction of motion α on the surface level of the first pole plate, the second pole plate, tri-electrode, quadripolar plate formation and be:
α = arctg ( t 3 - t 4 ) t 1 - t 2 - - - ( 3 )
Human hands movement velocity V on the surface level of the first pole plate, the second pole plate, tri-electrode, quadripolar plate formation is:
V = d ( t 3 - t 1 ) 2 ( t 4 - t 2 ) 2 - - - ( 4 )
Step 6: the horizontal plane direction movement velocity V' that human hands is formed at the first pole plate, the second pole plate, tri-electrode, quadripolar plate is:
V ′ = d ( t 3 - t 1 ) 2 + ( t 4 - t 2 ) 2 2 - t 5 - - - ( 5 )
Step 7: quantity and the mode of structuring the formation of multi-electrode probe unit need according to actual detection target area and determine, in multi-electrode detection array, many group multi-electrode probe units can detect the human hands of the human hands at diverse location place at the first pole plate, second pole plate, tri-electrode, real time kinematics direction α in quadripolar plate plane and human hands real time kinematics speed V, and at vertical first pole plate, second pole plate, tri-electrode, speed V' in quadripolar plate plane, after obtaining human hands real time kinematics direction α and human hands real time kinematics speed V and V', namely human hands real time kinematics track has been traced into, determine hand real time position and motion state,
Step 8: according to hand real time position and motion state, handle portion action is divided into movement, single knocks and knocks three kinds continuously, the mobile drag action being defined as corresponding mouse, single knock be defined as mouse choose operation, knock the opening operation being defined as mouse continuously, according to above-mentioned definition, computer mouse operation is mated, thus complete according to hand electrostatic detection signal the human-computer interaction function chosen, drag and open;
Step 9: obtain hand muscle electric signal by electromyographic electrode and muscle electrical signal process circuit, recovers finger and opens and bending details movable information;
Step 10: opened and bending information by finger, complete image zooming, rotate interactive function.
2. a kind of man-machine interaction method detected based on electrostatic and myoelectricity according to claim 1, is characterized in that: the preset described in step 3 is: the amplitude of the electrostatic induction signal potential value collected first is changed from small to big, again from large to small subsequently; The electrostatic induction signal potential value collected has cycle continuity, and two crests all appear in the electrostatic induction signal potential value in each cycle, and wherein the amplitude of a rear crest is less than the half of the amplitude of previous crest.
3. a kind of man-machine interaction method detected based on electrostatic and myoelectricity according to claim 1 and 2, is characterized in that: often pair of polar plate spacing described in step one is from d≤200cm.
4. a kind of man-machine interaction method detected based on electrostatic and myoelectricity according to claim 1 and 2, it is characterized in that: in step 3, multi-electrode detection array comprises multiple multi-electrode probe unit, quantity and the mode of structuring the formation of multi-electrode probe unit need according to actual detection target area and determine; Often pair of polar plate spacing described in step one is from d≤200cm.
5. realize a kind of man-machine interactive system detected based on electrostatic and myoelectricity of man-machine interaction method based on electrostatic and myoelectricity detection described in claim 1 or 2, it is characterized in that: the described man-machine interactive system detected based on electrostatic and myoelectricity comprises electrostatic detection system and myoelectricity detection system, described electrostatic detection system realizes electrostatic signal detection, and described myoelectricity detection system realizes electrostatic signal detection.
6. the man-machine interactive system detected based on electrostatic and myoelectricity according to claim 5, is characterized in that: described electrostatic detection system comprises detection pole plate, current-voltage conversion circuit, amplifier, low-pass filter and data acquisition processing circuit and wireless receiving module; Detection pole plate obtains electrostatic induction electric charge amount, and the change of the quantity of electric charge produces static induced current, and the electric current of generation becomes magnitude of voltage through current-voltage conversion circuit, is then amplified through amplifier amplitude, removes noise subsequently through low-pass filter; Filtered electrostatic induction voltage signal carries out gathering and calculation process by data acquisition processing circuit, and merges the electromyographic signal data received by wireless receiving module, and final data treatment circuit passes to computing machine mouse action information.
7. the man-machine interactive system detected based on electrostatic and myoelectricity according to claim 5, it is characterized in that: described myoelectricity detection system is realized by muscle electrical signal process circuit, described muscle electrical signal process circuit comprises electromyographic electrode, electromyographic signal modulate circuit, electromyographic signal amplifying circuit, muscle electrical signal process circuit, wireless transmitter module; Electromyographic electrode is placed on user's wrist position, obtain user's surface electromyography signal, impedance transformation is carried out by electromyographic signal modulate circuit, Signal Pretreatment, then voltage amplification is carried out by electromyographic signal amplifying circuit, carry out Acquire and process by muscle electrical signal process circuit, identify opening and flexure operation of finger, this information passes to electrostatic detection system by wireless transmitter module and carries out information fusion.
8. the man-machine interactive system detected based on electrostatic and myoelectricity according to claim 5, is characterized in that: often pair of described polar plate spacing is from d≤200cm.
CN201210229985.6A 2012-07-04 2012-07-04 Human-computer interaction method based on electrostatic detection and myoelectric detection Expired - Fee Related CN102799270B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201210229985.6A CN102799270B (en) 2012-07-04 2012-07-04 Human-computer interaction method based on electrostatic detection and myoelectric detection

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201210229985.6A CN102799270B (en) 2012-07-04 2012-07-04 Human-computer interaction method based on electrostatic detection and myoelectric detection

Publications (2)

Publication Number Publication Date
CN102799270A CN102799270A (en) 2012-11-28
CN102799270B true CN102799270B (en) 2015-03-11

Family

ID=47198394

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201210229985.6A Expired - Fee Related CN102799270B (en) 2012-07-04 2012-07-04 Human-computer interaction method based on electrostatic detection and myoelectric detection

Country Status (1)

Country Link
CN (1) CN102799270B (en)

Families Citing this family (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9092664B2 (en) * 2013-01-14 2015-07-28 Qualcomm Incorporated Use of EMG for subtle gesture recognition on surfaces
CN103750836A (en) * 2014-01-14 2014-04-30 优尔美有限公司 Wearable myoelectricity instrument
RU2016136366A (en) * 2014-02-12 2018-03-15 Конинклейке Филипс Н.В. MOVEMENT DETECTION DEVICE DETECTING HAND MOVEMENT
CN104571517A (en) * 2014-12-31 2015-04-29 杨皓 Body movement based input and control method for electronic device
CN106054256B (en) * 2016-07-04 2018-09-04 北京理工大学 A kind of detection method of dislocation charge source movement speed and direction
CN106125146B (en) * 2016-07-04 2018-09-04 北京理工大学 A kind of dislocation charge source real time position detection method
CN108245168A (en) * 2017-01-21 2018-07-06 北京理工大学 A kind of paces periodic measurement methods based on electrostatic detection
CN108181985A (en) * 2017-03-02 2018-06-19 北京理工大学 A kind of vehicle mounted multimedia gesture identifying device based on electrostatic detection
CN107340855A (en) * 2017-03-02 2017-11-10 北京理工大学 A kind of vehicle mounted multimedia gestural control method based on electrostatic detection
US11397468B2 (en) 2020-03-31 2022-07-26 Apple Inc. Skin-to-skin contact detection
US11397466B2 (en) * 2020-03-31 2022-07-26 Apple Inc. Skin-to-skin contact detection

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101579238A (en) * 2009-06-15 2009-11-18 吴健康 Human motion capture three dimensional playback system and method thereof
CN102426477A (en) * 2011-08-09 2012-04-25 广东科学中心 Gesture detecting method and detecting device

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
MD3614G2 (en) * 2006-12-21 2009-11-30 Еуджен МОРАРУ Device and process for determining the human motion activity

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101579238A (en) * 2009-06-15 2009-11-18 吴健康 Human motion capture three dimensional playback system and method thereof
CN102426477A (en) * 2011-08-09 2012-04-25 广东科学中心 Gesture detecting method and detecting device

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
基于有向性探测阵列的静电体目标检测;陈曦等;《北京理工大学学报》;20061231;第26卷(第12期);全文 *
静电成像检测控制系统设计;陈曦等;《仪器仪表学报》;20080430;第29卷(第4期);全文 *

Also Published As

Publication number Publication date
CN102799270A (en) 2012-11-28

Similar Documents

Publication Publication Date Title
CN102799270B (en) Human-computer interaction method based on electrostatic detection and myoelectric detection
CN102789326B (en) Non-contact man-machine interaction method based on electrostatic detection
Guo et al. Human-machine interaction sensing technology based on hand gesture recognition: A review
CN102778581B (en) Non-contact electrostatic detection method for tracking human hand motion trajectory
CN101598973B (en) Human-computer interaction system based on electro-ocular signal
CN104808788B (en) A kind of method that non-contact gesture manipulates user interface
CN102764130B (en) Non-contact electrostatic detection method for measuring movement velocity of hand
CN103389841B (en) The method for sensing of suppression low frequency noises and device
CN102024151B (en) Training method of gesture motion recognition model and gesture motion recognition method
CN111553307A (en) Gesture recognition system fusing bioelectrical impedance information and myoelectric information
CN113849068B (en) Understanding and interaction method and system for multi-modal information fusion of gestures
CN103324284A (en) Mouse control method based on face and eye detection
CN103557862A (en) Detection method for movement track of mobile terminal
CN102125495A (en) Multifunctional robot with slippage sensor for helping aged people to walk
CN107193374A (en) A kind of detection means and detection method of the intentional gesture motion of active
CN106125146B (en) A kind of dislocation charge source real time position detection method
CN107390867A (en) A kind of man-machine interactive system based on Android wrist-watch
CN106054256A (en) Method for detecting moving speed and moving direction of mobile charge source
He et al. A smart pen based on triboelectric effects for handwriting pattern tracking and biometric identification
CN107336233B (en) Inertial-kinetic-capture-based human-robot virtual-real interaction control system
CN202015325U (en) Multifunctional elderly-aid and walking-aid robot with tactile and slip sensor
CN101819476A (en) Alternating current pointing light pen, multi-light-pen identification device and method of multi-light-pen identification
CN103631470B (en) Based on infrared reflection photodetection dot matrix every empty input system and input method
CN116048262A (en) Myoelectric bracelet gesture recognition method capable of achieving robust electrode deflection
CN111679325A (en) Charge source motion height identification method based on planar electrostatic induction electrode array

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20150311

Termination date: 20160704