CN102799270A - Human-computer interaction method based on electrostatic detection and myoelectric detection - Google Patents

Human-computer interaction method based on electrostatic detection and myoelectric detection Download PDF

Info

Publication number
CN102799270A
CN102799270A CN2012102299856A CN201210229985A CN102799270A CN 102799270 A CN102799270 A CN 102799270A CN 2012102299856 A CN2012102299856 A CN 2012102299856A CN 201210229985 A CN201210229985 A CN 201210229985A CN 102799270 A CN102799270 A CN 102799270A
Authority
CN
China
Prior art keywords
pole plate
detection
signal
electrostatic
plate
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN2012102299856A
Other languages
Chinese (zh)
Other versions
CN102799270B (en
Inventor
唐凯
李鹏斐
陈曦
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Institute of Technology BIT
Original Assignee
Beijing Institute of Technology BIT
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Institute of Technology BIT filed Critical Beijing Institute of Technology BIT
Priority to CN201210229985.6A priority Critical patent/CN102799270B/en
Publication of CN102799270A publication Critical patent/CN102799270A/en
Application granted granted Critical
Publication of CN102799270B publication Critical patent/CN102799270B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • User Interface Of Digital Computer (AREA)

Abstract

The invention discloses a human-computer interaction method based on electrostatic detection and myoelectric detection, and further discloses a human-computer interaction system based on electrostatic detection and myoelectric detection, and used for realizing the human-computer interaction method based on electrostatic detection and myoelectric detection, belonging to the field of human-computer interaction. According to the invention, the movement speeds and the movement directions of the hands of a human body are measured via a non-contact type electrostatic detection method, so as to determine the real-time positions of the hands, the detailed action information of fingers is obtained via a contact type myoelectric signal, so as to control the operation of a mouse of a computer with high accuracy, and finish complex human-computer interaction, and the whole interaction process is not influenced by the light ray of an outside environment. The invention provides a novel realization method for human-computer interaction. The human-computer interaction method based on electrostatic detection and myoelectric detection disclosed by the invention has the advantage of small working dead angle areas by virtue of the advantage of the little obstruction of obstacles to an electrostatic induction signal during a transmission process. The myoelectric signal extraction circuit designed according to the invention has the advantages of being small in volume, high in signal-to-noise ratio, accurate in power frequency filter, good in stability, etc.

Description

A kind of man-machine interaction method based on static and myoelectricity detection
Technical field
The present invention relates to a kind of man-machine interaction method, relate in particular to a kind of man-machine interaction method, belong to field of human-computer interaction based on static and myoelectricity detection.
Background technology
The fast development of Along with computer technology, computing machine have become the indispensable part of people's daily life.Human-computer interaction technology is the focus of research as the important component part of computer user interface always.In decades, people use keyboard, mouse to come operating computer always widely, these traditional interactive modes be difficult to satisfy the user whenever and wherever possible, interbehavior demand efficiently naturally.Under traditional interactive mode, people can only use " thinking of computing machine " to go to exchange with computing machine, " saying " computing machine " listen understand words ".An important goal of man-machine interaction research; Move the direction of the binding site of human thinking and computer mind exactly to the human thinking; Let computing machine understand human behavior as much as possible; Link up with interpersonal exchange way and user, and always do not let the user adapt to computing machine, let man-machine interaction become nature, harmony.Spoken language, written language, body language, expression etc. are the interpersonal natural languages that often uses that exchanges, and these human cognition custom and forms that form naturally must be the developing direction of man-machine interaction.In order to reach the high level goal of man-machine interaction natural harmony, also, received a lot of researchists' attention based on the interactive mode of natural language in order to overcome the deficiency of current existing interaction technique.Based on spoken language alternately such as phonetic entry, phonetic synthesis, based on expression alternately such as eye movement input, based on body language such as advanced interactive modes such as gesture inputs, all be the focus of current man-machine interaction research field.
Compare with traditional interactive mode such as keyboard, mouse, directly with hand as input nature, succinct, directly and express the meaning abundant.Directly with hand as input; Need measure hand position and motion state; " An adaptive Kalman-based Bayes estimation technique to classify locomotor activities in young and elderly adults through accelerometers " R.Muscillo; M.Schmid; S.Conforto and T.D'Alessio; Med.Eng.Phys.32,849-859 (2010), " Detection of pedestrians in far-infrared automotive night vision using region-growing and clothing distortion compensation " R.O'Malley, E.Jonesa; And M.Glavin; Infrared.Phys.Techn.53,439-449 (2010), " Human detection using a mobile platform and novel features derived from a visual saliency mechanism " S.Montabone, and A.Soto; Image.Vision.Comput.28, among the 391-402 (2010) respectively through realizing testing the speed to human hands at human hands sensor installation, infrared detection technique and image model recognition technology.Yet, make that the error rate of the infrared detection technique that is applied to the human hands motion measurement is higher because there are infrared origin such as illumination simultaneously in the equipment of emission infrared signals such as indoor existence heating, illumination in outdoor environment.The most frequently used gesture interaction that is based on vision utilizes camera that gesture is carried out contactless catching at present, is a kind of natural interactive mode.But the method that is based on vision receives influences such as change of background, ambient lighting variation easily, and the image background that camera obtains is complicated, and gesture is apparent had a strong impact on by it; Analysis to images of gestures is very complicated; Be difficult to guarantee the real-time of interactive system, can't play a role at the video dead angle area of camera, therefore; Man-machine interaction mode based on vision has data processing complex, real-time difference and the shortcoming of angle limitations is arranged.
And the electrostatic detection technology be utilize object in the motion with static realize detection identification to target." Triboelectrification of houseflies (Musca domestic L.) walking on synthetic dielectric surfaces " Mcgonigle D F proposes the insect in creeping is carried out the method for electrostatic detection first among the Jackson C W and Davidson J L2002 J.Electrostat.54167-177.Inspired by this, " Electrification of human body by walking " Ficker T 2006 J.Electrostat.6410-16 study the variation of people's bulk potential in the motion through the electrometer that is installed on the person.Because the object of all motions all can be with static; And electrostatic field has unique boundary condition; Therefore through the variation of electrostatic field, measurement be can position, therefore the electrostatic detection method human body and human limb motion are applied to measure the charged human hands that moves; And it is feasible carrying out man-machine interaction, and the application that the electrostatic detection method is applied to man-machine interaction is not arranged both at home and abroad as yet.
Based on the human-computer interaction technology of bioelectrical signals one of research forward position and focus of teleoperation robot and human-computer interaction technology in recent years.In some laboratory, electromyographic signal EMG signal has been studied the control signal as disability patient artifucial limb abroad.But in the great majority research, because comparatively complicated to the electromyographic signal pattern recognition process, but can discern finger movement.
At present as yet not the man-machine interaction of handlebar electrostatic detection with get the man-machine interaction mode that man-machine interaction is merged mutually based on electromyographic signal; This man-machine interaction mode has concurrently based on the man-machine interaction mode of electrostatic detection with based on the advantage of the man-machine interaction mode of electromyographic signal; Promptly have more mutual angle and mutual scope, do not rely on ambient light, have higher human body gesture identification precision again; Can distinguish the action of finger, accomplish comparatively complicated human-computer interaction function.
Summary of the invention
The technical matters that the present invention will solve is to utilize contactless electrostatic detection mode and contact electromyographic signal to obtain the realization man-machine interactive operation; Measure human hands movement velocity and direction through contactless electrostatic detection method, confirm the hand real time position, through judging the hand exercise state; Obtain finger details action message through the contact electromyographic signal; Complicated man-machine interaction is accomplished in the operation of high-precision control computer mouse, and whole reciprocal process is not influenced by external environment light.The invention discloses a kind of man-machine interaction method based on static and myoelectricity detection; Can reduce the working angle district of human hands speed and orientation measurement technology; Reduce the complex design degree of human hands motion detection system; Realization through judging the hand exercise state, realizes the operation to computer mouse to the measurement of hand real time position and motion state.
The objective of the invention is to realize through following technical proposals:
A kind of concrete performing step of man-machine interaction method based on static and myoelectricity detection disclosed by the invention is following:
Step 1: laying can detect the multipole plate detection array of human hands motion electrostatic signal, and said detection array comprises at least one group of multipole plate probe unit; Multipole plate probe unit is made up of five pole plates, and wherein four pole plates are divided into two pairs, and the line between the two pairs of pole plates is orthogonal, and the every pair of polar plate spacing is from being d, d≤200cm, and four pole plate location arrangements are square; The 5th pole plate is arranged on the direction perpendicular to plane, four pole plate places, and four pole plate distances of distance are identical, and four pole plate places of distance plan range is d, and five pole plates constitute space four rib centrums.Polar plate spacing is from less with respect to the human hands move distance for d, and used time of the move distance d of analysis is less with respect to the human hands run duration, and the speed that therefore records is human body real time kinematics speed;
Step 2: gather the electrostatic signal in the monitoring of environmental, described electrostatic signal is the electrostatic induction signal potential value that each moment detection system is obtained;
Step 3:,, then think to have detected the existence that human hands moves if this electrostatic induction signal is identical with this preset criterion with this electrostatic induction signal potential value that collects and the contrast of preset criterion;
Step 4: the crest value of the electrostatic induction signal that detected human hands motion is produced on each pole plate in the recording step two, read the zero crossing moment that follows crest value on each pole plate closely; At first detect the pole plate of the electrostatic induction signal pole plate relative with it in the definition and form pole plate to one, pole plate is a pole plate 1 to the pole plate that at first detects the electrostatic induction signal in, and another pole plate is a pole plate 2; Another to pole plate be pole plate to two, pole plate is a pole plate 4 to the pole plate that at first detects the electrostatic induction signal in two, another pole plate is a pole plate 3, the 5th pole plate described in the step 1 is pole plate 5; Read pole plate 1 in the multipole plate probe unit respectively, pole plate 2, pole plate 3, pole plate 4, the zero crossing that follows crest value closely that pole plate 5 collects is t constantly 1, t 2, t 3, t 4, t 5Human hands is at pole plate 1,2, and direction of motion α and human hands movement velocity V satisfy formula (1) and (2) on the surface level of 3,4 formations:
α = arccos V ( t 1 - t 2 ) d - - - ( 1 )
α = arcsin V ( t 3 - t 4 ) d - - - ( 2 )
Step 5: simultaneous formula (1) and (2) can obtain human hands at pole plate 1,2, and direction of motion α is on the surface level of 3,4 formations:
α = arctg ( t 3 - t 4 t 1 - t 2 ) - - - ( 3 )
Human hands is at pole plate 1,2, and movement velocity V is on the surface level of 3,4 formations:
V = d ( t 3 - t 1 ) 2 + ( t 4 - t 2 ) 2 - - - ( 4 )
Step 6: human hands is at pole plate 1,2, and the surface level movement in vertical direction speed V ' of 3,4 formations is:
V ′ = d ( t 3 - t 1 ) 2 + ( t 4 - t 2 ) 2 2 - t 5 - - - ( 5 )
Step 7: the quantity of multipole plate probe unit and the mode of structuring the formation are decided according to actual detection target area needs, and the human hands of human hands that the multipole plate probe unit of many groups can detect the diverse location place in the multipole plate detection array is at pole plate 1,2; Real time kinematics direction α in 3,4 planes and human hands real time kinematics speed V, and at vertical plate 1; 2; Speed V ' on 3,4 planes is after obtaining human hands real time kinematics direction α and human hands real time kinematics speed V and V '; Promptly trace into human hands real time kinematics track, confirmed hand real time position and motion state.
Step 8: according to hand real time position and motion state; That handle portion action is divided into is mobile, single knocks and knock three kinds continuously, moves the action that drags that is defined as corresponding mouse, and single knocks the operation of choosing that is defined as mouse; Knock the opening operation that is defined as mouse continuously; According to above-mentioned definition computer mouse operation is mated, choose the human-computer interaction function that drags and open thereby accomplish according to hand electrostatic detection signal.
Step 9: obtain the hand electromyographic signal through electromyographic electrode and muscle electrical signal process circuit, recover finger and open and crooked details movable information.
Step 10: open and crooked information through finger, accomplish image zooming, interactive functions such as rotation.
Described man-machine interactive system based on static and myoelectricity detection comprises electrostatic detection system and myoelectricity detection system.Described electrostatic detection system comprises and surveys pole plate, current-voltage conversion circuit, amplifier, low-pass filter and data acquisition processing circuit and wireless receiving module.Survey pole plate and obtain the electrostatic induction electric charge amount, the variation of the quantity of electric charge produces static induced current, and the electric current of generation becomes magnitude of voltage through current-voltage conversion circuit, obtains amplifying through the amplifier amplitude then, removes noise through low-pass filter circuit subsequently.Data acquisition processing circuit is gathered filtered electrostatic induction voltage signal and calculation process, and merges the electromyographic signal data that receive through wireless receiving module, and the final data treatment circuit passes to computing machine to mouse action information.
Described muscle electrical signal process circuit comprises electromyographic electrode, electromyographic signal modulate circuit, electromyographic signal amplifying circuit, muscle electrical signal process circuit, wireless transmitter module.Electromyographic electrode is placed on user's wrist position; Obtain user's surface electromyography signal, carry out impedance conversion, Signal Pretreatment by the electromyographic signal modulate circuit; Carry out voltage amplification by the electromyographic signal amplifying circuit then; Gathered and handled by muscle electrical signal process circuit, identify opening and flexure operation of finger, this information passes to the electrostatic detection system by wireless transmitter module and carries out information fusion.
Preset criterion described in the step 3 is: the amplitude of the electrostatic induction signal that collects is changed from small to big earlier, again from large to small subsequently; The electrostatic induction signal that collects has the cycle continuity, and two crests all appear in the electrostatic induction signal in each cycle, and the amplitude of a wherein back crest is half the less than the amplitude of previous crest.
Multipole plate detection array comprises a plurality of multipole plate probe units in the step 3; The quantity of multipole plate probe unit and the mode of structuring the formation are decided according to actual detection target area needs; Multipole plate detection array can provide the real-time status of the human hands at diverse location place, improves the regional extent and the precision of man-machine interaction.
Because shelter can't thoroughly hinder the transmission of electrostatic field; Therefore utilizing the electrostatic detection technology to carry out man-machine interaction, influenced by shelter little; So carrying out man-machine interaction, the electrostatic detection technology has the little advantage in working angle district; And, can discern the finger movement details through to the obtaining of electromyographic signal, accomplish complicated human-computer interaction function.
Beneficial effect:
1, of the present invention based on static and myoelectricity detection man-machine interaction method; Can measure human hands movement velocity and direction through contactless electrostatic detection method; Confirm the hand real time position, through judging hand exercise state, the operation of control computer mouse; Obtain the finger movement detailed information through electromyographic signal simultaneously, accomplish complicated man-machine interaction.
2, the non-contact type human-machine interaction method based on electrostatic detection of the present invention receives the shelter obstruction little owing to utilized in the electrostatic induction signal communication process, have the little characteristics in working angle district.
3, the man-machine interaction method based on electromyographic signal of the present invention; Can discern the finger movement details; Accomplish more complicated human-computer interaction function; Electromyographic electrode through wrist portion obtains electromyographic signal EMG, obtains the finger movement detailed information through EMG is handled, and realizes the man-machine interaction of high-precision mouse action and sophisticated functions.To the complicated characteristics of electromyographic signal (EMG) under strong noise background; Through forward being driven, isolates the ingenious utilization of multiple Anti-Jamming Techniques such as amplification, digital filtering; Design electromyographic signal and extracted circuit, had characteristics such as volume is little, signal to noise ratio (S/N ratio) is high, power frequency filtering accurate, good stability.
Description of drawings
Fig. 1 is human hands and one group of multipole plate probe unit relative position relation synoptic diagram of motion;
Fig. 2 is the non-contact type human-machine interaction system principle diagram based on electrostatic detection of the present invention;
Fig. 3 is the man-machine interactive system theory diagram based on electromyographic signal of the present invention
Embodiment
Describe embodiment of the present invention in detail below in conjunction with accompanying drawing.
A kind of concrete performing step of non-contact type human-machine interaction method based on electrostatic detection of present embodiment is following:
Step 1: laying can detect the multipole plate detection array of human hands motion electrostatic signal, and said detection array comprises at least one group of multipole plate probe unit; Multipole plate probe unit is made up of five pole plates, and wherein four pole plates are divided into two pairs, and the line between the two pairs of pole plates is orthogonal, and the every pair of polar plate spacing is from being d, d≤200cm, and four pole plate location arrangements are square; The 5th pole plate is arranged on the direction perpendicular to plane, four pole plate places, and four pole plate distances of distance are identical, and four pole plate places of distance plan range is d, and five pole plates constitute space four rib centrums.Polar plate spacing is from less with respect to the human hands move distance for d, and used time of the move distance d of analysis is less with respect to the human hands run duration, and the speed that therefore records is human body real time kinematics speed;
Step 2: gather the electrostatic signal in the monitoring of environmental, described electrostatic signal is the electrostatic induction signal potential value that each moment detection system is obtained;
Step 3:,, then think to have detected the existence that human hands moves if this electrostatic induction signal is identical with this preset criterion with this electrostatic induction signal potential value that collects and the contrast of preset criterion;
Step 4: the crest value of the electrostatic induction signal that detected human hands motion is produced on each pole plate in the recording step two, read the zero crossing moment that follows crest value on each pole plate closely; At first detect the pole plate of the electrostatic induction signal pole plate relative with it in the definition and form pole plate to one, pole plate is a pole plate 1 to the pole plate that at first detects the electrostatic induction signal in, and another pole plate is a pole plate 2; Another to pole plate be pole plate to two, pole plate is a pole plate 4 to the pole plate that at first detects the electrostatic induction signal in two, another pole plate is a pole plate 3, the 5th pole plate described in the step 1 is pole plate 5; Read pole plate 1 in the multipole plate probe unit respectively, pole plate 2, pole plate 3, pole plate 4, the zero crossing that follows crest value closely that pole plate 5 collects is t constantly 1, t 2, t 3, t 4, t 5Human hands is at pole plate 1,2, and direction of motion α and human hands movement velocity V satisfy formula (1) and (2) on the surface level of 3,4 formations:
α = arccos V ( t 1 - t 2 ) d - - - ( 1 )
α = arcsin V ( t 3 - t 4 ) d - - - ( 2 )
Step 5: simultaneous formula (1) and (2) can obtain human hands at pole plate 1,2, and direction of motion α is on the surface level of 3,4 formations:
α = arctg ( t 3 - t 4 t 1 - t 2 ) - - - ( 3 )
Human hands is at pole plate 1,2, and movement velocity V is on the surface level of 3,4 formations:
V = d ( t 3 - t 1 ) 2 + ( t 4 - t 2 ) 2 - - - ( 4 )
Step 6: human hands is at pole plate 1,2, and the surface level movement in vertical direction speed V ' of 3,4 formations is:
V ′ = d ( t 3 - t 1 ) 2 + ( t 4 - t 2 ) 2 2 - t 5 - - - ( 5 )
Step 7: the quantity of multipole plate probe unit and the mode of structuring the formation are decided according to actual detection target area needs, and the human hands of human hands that the multipole plate probe unit of many groups can detect the diverse location place in the multipole plate detection array is at pole plate 1,2; Real time kinematics direction α in 3,4 planes and human hands real time kinematics speed V, and at vertical plate 1; 2; Speed V ' on 3,4 planes is after obtaining human hands real time kinematics direction α and human hands real time kinematics speed V and V '; Promptly trace into human hands real time kinematics track, confirmed hand real time position and motion state.
Step 8: according to hand real time position and motion state; That handle portion action is divided into is mobile, single knocks and knock three kinds continuously, moves the action that drags that is defined as corresponding mouse, and single knocks the operation of choosing that is defined as mouse; Knock the opening operation that is defined as mouse continuously; According to above-mentioned definition computer mouse operation is mated, choose the human-computer interaction function that drags and open thereby accomplish according to hand electrostatic detection signal.
Step 9: obtain the hand electromyographic signal through electromyographic electrode and muscle electrical signal process circuit, recover finger and open and crooked details movable information.
Step 10: open and crooked information through finger, accomplish image zooming, interactive functions such as rotation.
Described man-machine interactive system based on static and myoelectricity detection comprises electrostatic detection system and myoelectricity detection system.Described electrostatic detection system comprises and surveys pole plate, current-voltage conversion circuit, amplifier, low-pass filter and data acquisition processing circuit and wireless receiving module.Survey pole plate and obtain the electrostatic induction electric charge amount, the variation of the quantity of electric charge produces static induced current, and the electric current of generation becomes magnitude of voltage through current-voltage conversion circuit, obtains amplifying through the amplifier amplitude then, removes noise through low-pass filter circuit subsequently.Data acquisition processing circuit is gathered filtered electrostatic induction voltage signal and calculation process, and merges the electromyographic signal data that receive through wireless receiving module, and the final data treatment circuit passes to computing machine to mouse action information.
Described muscle electrical signal process circuit comprises electromyographic electrode, electromyographic signal modulate circuit, electromyographic signal amplifying circuit, muscle electrical signal process circuit, wireless transmitter module.Electromyographic electrode is placed on user's wrist position; Obtain user's surface electromyography signal, carry out impedance conversion, Signal Pretreatment by the electromyographic signal modulate circuit; Carry out voltage amplification by the electromyographic signal amplifying circuit then; Gathered and handled by muscle electrical signal process circuit, identify opening and flexure operation of finger, this information passes to the electrostatic detection system by wireless transmitter module and carries out information fusion.
Preset criterion described in the step 3 is: the amplitude of the electrostatic induction signal that collects is changed from small to big earlier, again from large to small subsequently; The electrostatic induction signal that collects has the cycle continuity, and two crests all appear in the electrostatic induction signal in each cycle, and the amplitude of a wherein back crest is half the less than the amplitude of previous crest.
Multipole plate detection array comprises a plurality of multipole plate probe units in the step 3; The quantity of multipole plate probe unit and the mode of structuring the formation are decided according to actual detection target area needs; Multipole plate detection array can provide the real-time status of the human hands at diverse location place, improves the regional extent and the precision of man-machine interaction.
Because shelter can't thoroughly hinder the transmission of electrostatic field; Therefore utilizing the electrostatic detection technology to carry out man-machine interaction, influenced by shelter little; So carrying out man-machine interaction, the electrostatic detection technology has the little advantage in working angle district; And, can discern the finger movement details through to the obtaining of electromyographic signal, accomplish complicated human-computer interaction function.
Protection domain of the present invention not only is confined to present embodiment, and present embodiment is used to explain the present invention, and all and the present invention change or modification under same principle and design condition is all within protection domain disclosed by the invention.

Claims (8)

1. the man-machine interaction method based on static and myoelectricity detection is characterized in that, comprises the steps:
Step 1: laying can detect the multipole plate detection array of human hands motion electrostatic signal, and said detection array comprises at least one group of multipole plate probe unit; Multipole plate probe unit is made up of five pole plates, and wherein four pole plates are divided into two pairs, and the line between the two pairs of pole plates is orthogonal, and the every pair of polar plate spacing is from being d, d≤200cm, and four pole plate location arrangements are square; The 5th pole plate is arranged on the direction perpendicular to plane, four pole plate places, and four pole plate distances of distance are identical, and four pole plate places of distance plan range is d, and five pole plates constitute space four rib centrums; Polar plate spacing is from less with respect to the human hands move distance for d, and used time of the move distance d of analysis is less with respect to the human hands run duration, and the speed that therefore records is human body real time kinematics speed;
Step 2: gather the electrostatic signal in the monitoring of environmental, described electrostatic signal is the electrostatic induction signal potential value that each moment detection system is obtained;
Step 3:,, then think to have detected the existence that human hands moves if this electrostatic induction signal is identical with this preset criterion with this electrostatic induction signal potential value that collects and the contrast of preset criterion;
Step 4: the crest value of the electrostatic induction signal that detected human hands motion is produced on each pole plate in the recording step two, read the zero crossing moment that follows crest value on each pole plate closely; At first detect the pole plate of the electrostatic induction signal pole plate relative with it in the definition and form pole plate to one, pole plate is a pole plate 1 to the pole plate that at first detects the electrostatic induction signal in, and another pole plate is a pole plate 2; Another to pole plate be pole plate to two, pole plate is a pole plate 4 to the pole plate that at first detects the electrostatic induction signal in two, another pole plate is a pole plate 3, the 5th pole plate described in the step 1 is pole plate 5; Read pole plate 1 in the multipole plate probe unit respectively, pole plate 2, pole plate 3, pole plate 4, the zero crossing that follows crest value closely that pole plate 5 collects is t constantly 1, t 2, t 3, t 4, t 5Human hands is at pole plate 1,2, and direction of motion α and human hands movement velocity V satisfy formula (1) and (2) on the surface level of 3,4 formations:
α = arccos V ( t 1 - t 2 ) d - - - ( 1 )
α = arcsin V ( t 3 - t 4 ) d - - - ( 2 )
Step 5: simultaneous formula (1) and (2) can obtain human hands at pole plate 1,2, and direction of motion α is on the surface level of 3,4 formations:
α = arctg ( t 3 - t 4 t 1 - t 2 ) - - - ( 3 )
Human hands is at pole plate 1,2, and movement velocity V is on the surface level of 3,4 formations:
V = d ( t 3 - t 1 ) 2 + ( t 4 - t 2 ) 2 - - - ( 4 )
Step 6: human hands is at pole plate 1,2, and the surface level movement in vertical direction speed V ' of 3,4 formations is:
V ′ = d ( t 3 - t 1 ) 2 + ( t 4 - t 2 ) 2 2 - t 5 - - - ( 5 )
Step 7: the quantity of multipole plate probe unit and the mode of structuring the formation are decided according to actual detection target area needs, and the human hands of human hands that the multipole plate probe unit of many groups can detect the diverse location place in the multipole plate detection array is at pole plate 1,2; Real time kinematics direction α in 3,4 planes and human hands real time kinematics speed V, and at vertical plate 1; 2; Speed V ' on 3,4 planes is after obtaining human hands real time kinematics direction α and human hands real time kinematics speed V and V '; Promptly trace into human hands real time kinematics track, confirmed hand real time position and motion state;
Step 8: according to hand real time position and motion state; That handle portion action is divided into is mobile, single knocks and knock three kinds continuously; Move the action that drags that is defined as corresponding mouse, single knocks the operation of choosing that is defined as mouse, knocks the opening operation that is defined as mouse continuously; According to above-mentioned definition computer mouse operation is mated, thereby accomplish the human-computer interaction function of choosing, dragging and open according to hand electrostatic detection signal;
Step 9: obtain the hand electromyographic signal through electromyographic electrode and muscle electrical signal process circuit, recover finger and open and crooked details movable information;
Step 10: open and crooked information through finger, accomplish image zooming, interactive functions such as rotation.
2. a kind of man-machine interaction method according to claim 1 based on static and myoelectricity detection, it is characterized in that: the preset criterion described in the step 3 is: the amplitude of the electrostatic induction signal that collects is changed from small to big earlier, again from large to small subsequently; The electrostatic induction signal that collects has the cycle continuity, and two crests all appear in the electrostatic induction signal in each cycle, and the amplitude of a wherein back crest is half the less than the amplitude of previous crest.
3. a kind of man-machine interaction method based on static and myoelectricity detection according to claim 1 and 2, it is characterized in that: every pair of polar plate spacing described in the step 1 is from d≤200cm.
4. a kind of man-machine interaction method according to claim 1 and 2 based on static and myoelectricity detection; It is characterized in that: multipole plate detection array comprises a plurality of multipole plate probe units in the step 3, and the quantity of multipole plate probe unit and the mode of structuring the formation are decided according to actual detection target area needs; Every pair of polar plate spacing described in the step 1 is from d≤200cm.
5. realize the man-machine interactive system based on static and myoelectricity detection of claim 1 or 2 described a kind of man-machine interaction methods of surveying based on static and myoelectricity; It is characterized in that: described man-machine interactive system based on static and myoelectricity detection comprises electrostatic detection system and myoelectricity detection system; Said electrostatic detection system realizes that electrostatic signal surveys, and described myoelectricity detection system realizes that electrostatic signal surveys.
6. the man-machine interactive system of surveying based on static and myoelectricity according to claim 5 is characterized in that: described electrostatic detection system comprises and surveys pole plate, current-voltage conversion circuit, amplifier, low-pass filter and data acquisition processing circuit and wireless receiving module; Survey pole plate and obtain the electrostatic induction electric charge amount, the variation of the quantity of electric charge produces static induced current, and the electric current of generation becomes magnitude of voltage through current-voltage conversion circuit, obtains amplifying through the amplifier amplitude then, removes noise through low-pass filter circuit subsequently; Data acquisition processing circuit is gathered filtered electrostatic induction voltage signal and calculation process, and merges the electromyographic signal data that receive through wireless receiving module, and the final data treatment circuit passes to computing machine to mouse action information.
7. the man-machine interactive system based on static and myoelectricity detection according to claim 5; It is characterized in that: described myoelectricity detection system is realized that by muscle electrical signal process circuit described muscle electrical signal process circuit comprises electromyographic electrode, electromyographic signal modulate circuit, electromyographic signal amplifying circuit, muscle electrical signal process circuit, wireless transmitter module; Electromyographic electrode is placed on user's wrist position; Obtain user's surface electromyography signal, carry out impedance conversion, Signal Pretreatment by the electromyographic signal modulate circuit; Carry out voltage amplification by the electromyographic signal amplifying circuit then; Gathered and handled by muscle electrical signal process circuit, identify opening and flexure operation of finger, this information passes to the electrostatic detection system by wireless transmitter module and carries out information fusion.
8. the man-machine interactive system based on static and myoelectricity detection according to claim 5, it is characterized in that: described every pair of polar plate spacing is from d≤200cm.
CN201210229985.6A 2012-07-04 2012-07-04 Human-computer interaction method based on electrostatic detection and myoelectric detection Expired - Fee Related CN102799270B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201210229985.6A CN102799270B (en) 2012-07-04 2012-07-04 Human-computer interaction method based on electrostatic detection and myoelectric detection

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201210229985.6A CN102799270B (en) 2012-07-04 2012-07-04 Human-computer interaction method based on electrostatic detection and myoelectric detection

Publications (2)

Publication Number Publication Date
CN102799270A true CN102799270A (en) 2012-11-28
CN102799270B CN102799270B (en) 2015-03-11

Family

ID=47198394

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201210229985.6A Expired - Fee Related CN102799270B (en) 2012-07-04 2012-07-04 Human-computer interaction method based on electrostatic detection and myoelectric detection

Country Status (1)

Country Link
CN (1) CN102799270B (en)

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103750836A (en) * 2014-01-14 2014-04-30 优尔美有限公司 Wearable myoelectricity instrument
CN104571517A (en) * 2014-12-31 2015-04-29 杨皓 Body movement based input and control method for electronic device
CN104919397A (en) * 2013-01-14 2015-09-16 高通股份有限公司 Use of emg for gesture recognition on surfaces
CN105980964A (en) * 2014-02-12 2016-09-28 皇家飞利浦有限公司 Movement detection apparatus for detecting a hand movement
CN106054256A (en) * 2016-07-04 2016-10-26 北京理工大学 Method for detecting moving speed and moving direction of mobile charge source
CN106125146A (en) * 2016-07-04 2016-11-16 北京理工大学 A kind of dislocation charge source real time position detection method
CN107340855A (en) * 2017-03-02 2017-11-10 北京理工大学 A kind of vehicle mounted multimedia gestural control method based on electrostatic detection
CN108181985A (en) * 2017-03-02 2018-06-19 北京理工大学 A kind of vehicle mounted multimedia gesture identifying device based on electrostatic detection
CN108245168A (en) * 2017-01-21 2018-07-06 北京理工大学 A kind of paces periodic measurement methods based on electrostatic detection
CN113467647A (en) * 2020-03-31 2021-10-01 苹果公司 Skin-to-skin contact detection
US11941175B2 (en) 2020-03-31 2024-03-26 Apple Inc. Skin-to-skin contact detection

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2008075927A1 (en) * 2006-12-21 2008-06-26 Eugen Moraru Method for determining the motor activity of a person (sportsman) and a device for carrying out said method
CN101579238A (en) * 2009-06-15 2009-11-18 吴健康 Human motion capture three dimensional playback system and method thereof
CN102426477A (en) * 2011-08-09 2012-04-25 广东科学中心 Gesture detecting method and detecting device

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2008075927A1 (en) * 2006-12-21 2008-06-26 Eugen Moraru Method for determining the motor activity of a person (sportsman) and a device for carrying out said method
CN101579238A (en) * 2009-06-15 2009-11-18 吴健康 Human motion capture three dimensional playback system and method thereof
CN102426477A (en) * 2011-08-09 2012-04-25 广东科学中心 Gesture detecting method and detecting device

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
陈曦等: "基于有向性探测阵列的静电体目标检测", 《北京理工大学学报》, vol. 26, no. 12, 31 December 2006 (2006-12-31) *
陈曦等: "静电成像检测控制系统设计", 《仪器仪表学报》, vol. 29, no. 4, 30 April 2008 (2008-04-30) *

Cited By (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104919397A (en) * 2013-01-14 2015-09-16 高通股份有限公司 Use of emg for gesture recognition on surfaces
CN104919397B (en) * 2013-01-14 2019-03-15 高通股份有限公司 For the use of the EMG of the gesture recognition on surface
CN103750836A (en) * 2014-01-14 2014-04-30 优尔美有限公司 Wearable myoelectricity instrument
CN105980964A (en) * 2014-02-12 2016-09-28 皇家飞利浦有限公司 Movement detection apparatus for detecting a hand movement
CN104571517A (en) * 2014-12-31 2015-04-29 杨皓 Body movement based input and control method for electronic device
CN106054256B (en) * 2016-07-04 2018-09-04 北京理工大学 A kind of detection method of dislocation charge source movement speed and direction
CN106125146A (en) * 2016-07-04 2016-11-16 北京理工大学 A kind of dislocation charge source real time position detection method
CN106054256A (en) * 2016-07-04 2016-10-26 北京理工大学 Method for detecting moving speed and moving direction of mobile charge source
CN108245168A (en) * 2017-01-21 2018-07-06 北京理工大学 A kind of paces periodic measurement methods based on electrostatic detection
CN107340855A (en) * 2017-03-02 2017-11-10 北京理工大学 A kind of vehicle mounted multimedia gestural control method based on electrostatic detection
CN108181985A (en) * 2017-03-02 2018-06-19 北京理工大学 A kind of vehicle mounted multimedia gesture identifying device based on electrostatic detection
CN113467647A (en) * 2020-03-31 2021-10-01 苹果公司 Skin-to-skin contact detection
US11941175B2 (en) 2020-03-31 2024-03-26 Apple Inc. Skin-to-skin contact detection
CN113467647B (en) * 2020-03-31 2024-06-25 苹果公司 Skin-to-skin contact detection

Also Published As

Publication number Publication date
CN102799270B (en) 2015-03-11

Similar Documents

Publication Publication Date Title
CN102799270B (en) Human-computer interaction method based on electrostatic detection and myoelectric detection
CN102789326B (en) Non-contact man-machine interaction method based on electrostatic detection
CN102778581B (en) Non-contact electrostatic detection method for tracking human hand motion trajectory
Guo et al. Human-machine interaction sensing technology based on hand gesture recognition: A review
Ye et al. A review on applications of capacitive displacement sensing for capacitive proximity sensor
Huang et al. A universal and arbitrary tactile interactive system based on self-powered optical communication
CN102764130B (en) Non-contact electrostatic detection method for measuring movement velocity of hand
CN102024151B (en) Training method of gesture motion recognition model and gesture motion recognition method
CN103389841B (en) The method for sensing of suppression low frequency noises and device
CN106125087A (en) Dancing Robot indoor based on laser radar pedestrian tracting method
CN111553307A (en) Gesture recognition system fusing bioelectrical impedance information and myoelectric information
CN107193374A (en) A kind of detection means and detection method of the intentional gesture motion of active
CN102125495A (en) Multifunctional robot with slippage sensor for helping aged people to walk
CN104460992A (en) Finger movement detection device and method adopting infrared rays for irradiating intercarpal ligament
CN106125146B (en) A kind of dislocation charge source real time position detection method
CN102521574A (en) Human action identification method based on pyroelectric infrared information
CN106054256B (en) A kind of detection method of dislocation charge source movement speed and direction
CN107390867A (en) A kind of man-machine interactive system based on Android wrist-watch
CN113849068A (en) Gesture multi-mode information fusion understanding and interacting method and system
He et al. A smart pen based on triboelectric effects for handwriting pattern tracking and biometric identification
CN204765638U (en) Surface electromyography signal data acquisition system
CN101819476A (en) Alternating current pointing light pen, multi-light-pen identification device and method of multi-light-pen identification
CN202015325U (en) Multifunctional elderly-aid and walking-aid robot with tactile and slip sensor
CN109283998A (en) Three-dimensional capacitive wearable human-computer interaction device and method
CN103631470B (en) Based on infrared reflection photodetection dot matrix every empty input system and input method

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20150311

Termination date: 20160704

CF01 Termination of patent right due to non-payment of annual fee