CN103019378B - A kind of mobile electronic device gesture control interaction method, device and mobile terminal - Google Patents
A kind of mobile electronic device gesture control interaction method, device and mobile terminal Download PDFInfo
- Publication number
- CN103019378B CN103019378B CN201210520849.2A CN201210520849A CN103019378B CN 103019378 B CN103019378 B CN 103019378B CN 201210520849 A CN201210520849 A CN 201210520849A CN 103019378 B CN103019378 B CN 103019378B
- Authority
- CN
- China
- Prior art keywords
- gesture
- acceleration
- sequence
- sensor
- identification
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
- 238000000034 method Methods 0.000 title claims abstract description 23
- 230000003993 interaction Effects 0.000 title claims abstract description 14
- 230000008447 perception Effects 0.000 claims abstract description 82
- 230000001133 acceleration Effects 0.000 claims description 82
- 230000005484 gravity Effects 0.000 claims description 11
- 230000002452 interceptive effect Effects 0.000 claims description 10
- 230000009471 action Effects 0.000 claims description 8
- 230000008859 change Effects 0.000 claims description 7
- 230000006978 adaptation Effects 0.000 claims description 6
- 230000004044 response Effects 0.000 abstract description 5
- 230000003247 decreasing effect Effects 0.000 abstract description 3
- 238000012544 monitoring process Methods 0.000 abstract description 2
- 238000005516 engineering process Methods 0.000 description 7
- 230000006870 function Effects 0.000 description 4
- 230000008569 process Effects 0.000 description 4
- 230000003044 adaptive effect Effects 0.000 description 2
- 238000005265 energy consumption Methods 0.000 description 2
- 241001269238 Data Species 0.000 description 1
- 239000000725 suspension Substances 0.000 description 1
Classifications
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D30/00—Reducing energy consumption in communication networks
- Y02D30/70—Reducing energy consumption in communication networks in wireless communication networks
Landscapes
- Telephone Function (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The present invention relates to moving communicating field, it is provided that a kind of mobile electronic device gesture control interaction method, device and mobile terminal, said method comprising the steps of: set up the gesture command coded sequence of gesture result and control command corresponding relation;Increase described sensor when described sensor currently captures perception events and perform the probability of sense operation next time, reducing described sensor when described sensor does not currently capture perception events and perform the probability of sense operation next time, described sensor passes through sense operation perception data;Data to perception carry out the identification of gesture result, find out the control command corresponding to described gesture identification result and perform this control command from described gesture command coded sequence.The present invention, by judging the most whether sensor captures perception events and sensor is increased or decreased performs the probability of sense operation next time, can save monitoring power consumption, and by gesture result identification performs control command, resolution is high and fast response time.
Description
Technical field
The present invention relates to moving communicating field, particularly relate to a kind of mobile electronic device gesture control interaction method, device
And mobile terminal.
Background technology
The topmost input mode of Current electronic mobile device such as smart mobile phone is touch-screen input, i.e. by user's finger with
The contact action of mobile electronic device touch-screen realizes input, including to the operation of mobile electronic device, word input etc..Main flow
That mobile intelligent electronic equipment uses is all capacitive touch screen (Capacity Touch Panel).Due to capacitive touch screen
Human body is used by principle as an electrode of capacitance component, therefore its actually used too busy to get away human body and capacitance plate
Contact.Therefore, if be respectively arranged with other media such as gloves, clothing between finger and touch-screen, touch screen None-identified and
Response touch action.
Phonetic entry is the another kind of input mode of Present day mobile electronic equipment such as smart mobile phone.But, owing to voice is known
The high energy consumption that other degree of accuracy and audio monitoring bring, phonetic entry is difficult to the independent free control realized mobile electronic device
System；On the other hand, owing to phonetic entry needs mobile electronic device user to lift up one's voice, use not side in many instances
Just.
Summary of the invention
For above-mentioned technical problem, it is an object of the invention to provide a kind of resolution for mobile intelligent electronic equipment
High, timely respond to, mobile electronic device gesture control interaction method, device and mobile terminal that energy consumption is low.
The present invention provides a kind of mobile electronic device gesture control interaction method, said method comprising the steps of:
Set up the gesture command coded sequence of gesture result and control command corresponding relation;
Increase described sensor when described sensor currently captures perception events and perform the general of sense operation next time
Rate, reduces described sensor and performs the probability of sense operation next time when described sensor does not currently capture perception events,
Described sensor passes through sense operation perception data;And
Data to perception carry out the identification of gesture result, find out described gesture from described gesture command coded sequence
Control command corresponding to recognition result also performs this control command.
The present invention also provides for a kind of mobile electronic device gesture and controls interactive device, and described device includes:
Coded sequence sets up unit, for setting up the gesture command code sequence of gesture result and control command corresponding relation
Row;
Data perception unit, for increasing when described sensor currently captures perception events under the execution of described sensor
The probability of sense operation, reduces described sensor and performs next time when described sensor does not currently capture perception events
The probability of sense operation, described sensor passes through sense operation perception data;And
Identify performance element, for the data of perception being carried out the identification of gesture result, from described gesture command code sequence
Row find out the control command corresponding to described gesture identification result and performs this control command.
The present invention also provides for a kind of mobile terminal, and it is mutual that described mobile terminal includes that above-mentioned mobile electronic device gesture controls
Device.
The present invention uses self adaptation perceived frequency technology based on probability, by judging the most whether sensor captures sense
County magistrate's part is increased or decreased sensor and performs the probability of sense operation next time, effectively save can monitor power consumption, pass through opponent
The identification of gesture result performs control command, resolution height and fast response time.
Accompanying drawing explanation
In order to be illustrated more clearly that the embodiment of the present invention or technical scheme of the prior art, below will be to embodiment or existing
In having technology to describe, the required accompanying drawing used is briefly described, it should be apparent that, the accompanying drawing in describing below is only this
Some embodiments of invention, for those of ordinary skill in the art, on the premise of not paying creative work, also may be used
To obtain other accompanying drawing according to these accompanying drawings.
Fig. 1 is the flow chart of mobile electronic device gesture control interaction method of the present invention；
Fig. 2 is the flow chart of mobile electronic device gesture control interaction method of the present invention；
Fig. 3 is the structure chart that mobile electronic device gesture of the present invention controls interactive device.
Detailed description of the invention
Below in conjunction with accompanying drawing, the technical scheme in the embodiment of the present invention is clearly and completely described, it is clear that institute
The embodiment described is only a part of embodiment of the present invention rather than whole embodiments.Based on the embodiment in the present invention,
The every other embodiment that those of ordinary skill in the art are obtained under not making creative work premise, broadly falls into this
The scope of bright protection.
The present invention uses self adaptation perceived frequency technology based on probability, effectively save can monitor power consumption, by gesture
The identification of result performs control command, resolution height and fast response time.
Fig. 1 shows the flow process of the mobile electronic device gesture control interaction method that the embodiment of the present invention provides, and describes in detail such as
Under:
In step S101, set up the gesture command coded sequence of gesture result and control command corresponding relation;
In embodiments of the present invention, this gesture command coded sequence comprises three partial contents and moves, i.e. mobile electronic device
The smart mobile phone interactive controlling life that this gesture that attitude, user's gesture are made with user under this mobile electronic device attitude is corresponding
Order.Different gesture motion can corresponding different function choosing-item, this can be set by the user when actually used.In conjunction with actual
Demand, present embodiment considers gesture motion and combination, the gesture command of its correspondence that several actions are clear, easy to carry out below
Coded sequence is as follows:
<screen level upward, { brandishing to the left, brandish to the right }, screen locking/unblock>
<screen level upward, { brandish to the left, brandish to the right, brandish to the left }, receiving/hang-up phone>
<screen level upward, is brandished to the left, slides to the left>
<screen level upward, is brandished to the right, slides to the right>
<screen the most upward, is upwards brandished, upward sliding>
<screen the most upward, is brandished downwards, slide downward>
< screen level upward, { brandishing downwards, upwards brandish }, select/confirm
<screen is horizontal, { brandishing downwards, upwards brandish }, cancels/returns>
Additionally, also have many to plant different gesture combinations, can be used to realize different functions, such as call, look into
See note, open program, application is set etc..In view of 6 kinds of basic mobile phone attitudes, every kind of attitude correspondence up and down 4 kinds former
Sub-gesture, only considers 3 and the gesture sequence of following atom gesture, and the most total gesture command can up to 6*43=384 kind.Even if
Remove the most unnatural, inconvenient gesture motion, the most still have enough abundant gesture control command to complete basic hand
Machine is mutual.
In step s 102, increase sensor when sensor currently captures perception events and perform sense operation next time
Probability, reduce sensor when sensor does not currently capture perception events and perform the probability of sense operation next time, sensing
Device passes through sense operation perception data;
In embodiments of the present invention, as a kind of mobile phone interaction technology, need persistently to monitor and perception, monitor energy for reducing
Consumption present embodiment uses self adaptation perceived frequency technology based on probability.Specifically, if sensor performs current sense operation
Probability be p, then the probability performing perception at next cycle sensor judges according to the result of currently this time perception:
If current sensing results captures perception events, then improve the probability of perception next time；If current sensing results is not caught
Grasp any event, then reduce the probability of perception next time.Specifically, setting an adaptive factor α, perception probability is by such as
Lower formula calculates:Wherein 0 α 1, Pi are that sensor is held
The probability of sense operation before the trade, Pi+1 is the probability that sensor performs sense operation next time.
Simultaneously in order to ensure not reduce resolution because perception probability is too low, present embodiment sets the value of perception probability
Scope is [0.1,1], i.e. no longer rises when perception probability reaches 1, reaches no longer to reduce when 0.1.
In step S103, the data of perception are carried out the identification of gesture result, finds out from gesture command coded sequence
Control command corresponding to gesture identification result also performs this control command.
Fig. 2 shows the flow process of the mobile electronic device gesture control interaction method that the embodiment of the present invention provides, and describes in detail such as
Under:
In step s 201, the gesture command coded sequence of gesture result and control command corresponding relation is set up;
In step S202, increase sensor when sensor currently captures perception events and perform sense operation next time
Probability, reduce sensor when sensor does not currently capture perception events and perform the probability of sense operation next time, sensing
Device passes through sense operation perception data;
In step S203, the perception data of sensor is moved the identification of electronic equipment attitude；
In embodiments of the present invention, the perception data of sensor is moved the identification of electronic equipment attitude, specifically leads to
Cross acceleration sequence A and the error tolerance threshold preset moves the identification of electronic equipment attitude；
The perception data of sensor includes acceleration sequence A=<ax, ay, az>, and wherein, ax represents the acceleration of x-axis, ay
Representing the acceleration of y-axis, az represents the acceleration of z-axis.
Present embodiment carries out following gesture identification step:
First, it is determined that mobile phone attitude.According to the reading on tri-axles of 3-axis acceleration sensor X, Y, Z, it is determined that mobile phone
Attitude towards.Generally mobile phone face up top forward time, X-axis is (to the right for positive direction) parallel with screen minor face, and Y-axis is
Limit long with screen parallel (being positive direction forward), Z axis is and screen vertical (upwards for positive direction).Mainly judge mobile phone screen court
Upper, screen is down or the screen attitude such as vertically.Specifically, note acceleration of gravity is g, and each mobile phone attitude can be by X-axis, Y
The perception data A=<ax, ay, az of the acceleration transducer on axle, Z axis>judge.Ideal situation is as follows:
Mobile phone screen level upward time, A=<0,0 ,-g>；Mobile phone screen level down time, A=<0,0, g>；
Mobile phone screen vertically the most upward time, A=<0 ,-g, 0>；Mobile phone screen vertically the most upward time, A=<0, g, 0>；
Mobile phone laterally towards time upper, A=<-g, 0,0>；Mobile phone laterally towards under time, A=<g, 0,0>；
Under actual conditions, when mobile phone is in above attitude, the acceleration readings on three axles can be the most inclined with ideal situation
Difference, therefore can set an error tolerance threshold t to process mobile electronic device acceleration bias on X-axis, Y-axis, Z axis,
Particularly as follows: as A=<t, t ,-g+t>, it is determined that device screen level is upward；As A=<t, t, g+t>, it is determined that device screen level court
Under；As A=<t ,-g+t, t>, it is determined that device screen is the most upward；As A=<t, g+t, t>, it is determined that device screen is the most upward；Work as A
=<-g+t, t, t>, it is determined that equipment is laterally towards upper；As A=<g+t, t, t>, it is determined that equipment laterally towards under.
In step S204, the perception data of sensor is carried out the identification of gesture sequence；
In embodiments of the present invention, gesture sequence comprises several atom gestures, and atom gesture represents the most unidirectional
Brandish action, the perception data of sensor is carried out the identification of gesture sequence, carries out atom gesture especially by perception data
Identifying, atom gesture identification step is specific as follows:
To the acceleration transducer sequence B removed in the perception data after gravity=b1, b2 ... bi, bi+1 ..., bn}
(including from all acceleration perception datas starting perception moment to perception finish time), rise from the beginning of time and sliding window is set
Mouth w, takes the acceleration sequence B that the subsequence in sliding window w is pretreatment '=b1, b2 ... and bk}(acceleration sequence B ' bag
All of acceleration perception data in including start time to w moment), judge that the B ' acceleration on x, tri-axles of y, z becomes respectively
Change trend.Set acceleration rate threshold ξ, if B ' occurs that on a certain axle absolute value is more than the acceleration sequence of threshold xi and is somebody's turn to do continuously
Sequence time duration more than ω, then judges that mobile phone produces one atom gesture on this axle, acceleration be timing be this axle pros
To, it is this axle negative direction when acceleration is for bearing.Mobile phone this axle relative to the earth absolute towards determination methods and mobile phone appearance
State determination methods is consistent.
Then, slide this sliding window w, and the acceleration sequence B of the perception data after removing gravity is taken next slip
Subsequence B in window w "=bk+1, bk+2 ... bj} (B ' with B " in the number of perception data may identical be likely to not
With), if the subsequence B in described next sliding window w " be not empty set, then continue the son in the next sliding window w of identification
Sequence B " atom gesture, particularly as follows: judge B respectively " acceleration change trend on x, tri-axles of y, z, if B " a certain
Occur on axle that absolute value is more than the acceleration sequence of threshold xi and this sequence time duration more than ω continuously, then judge that mobile phone is at this
An atom gesture is produced on axle.Successively the acceleration transducer sequence B in the perception data after removing gravity is processed,
Slide a sliding window w every time, successively the atom gesture of the subsequence in the next sliding window w of identification, and recognition methods is such as
Described in before, during until the subsequence in next sliding window w is empty set, terminate described atom gesture identification.Generally sliding window
Mouth and time threshold are unsuitable excessive, and w can be with value for 300 ± 200ms in practice, and ω can be with value 150 ± 50ms.And accelerate
The value of degree threshold xi is then unsuitable too small, desirable 7 ± 2m/s2 in reality.
In step S205, in described gesture command coded sequence, search the control life of correspondence according to described recognition result
Order；
In embodiments of the present invention, equipment attitude and the knot of gesture sequence identification are moved according to the data of perception
Really, from gesture command coded sequence, the control command corresponding to gesture identification result is found out.
In step S206, perform control command.
Fig. 3 shows that the mobile electronic device gesture that the embodiment of the present invention provides controls the structure of interactive device, in order to just
In explanation, illustrate only the part relevant to the embodiment of the present invention.
It is various mobile whole that this mobile electronic device gesture control interactive device can be widely applied to mobile phone, panel computer etc.
In end, can be the unit that combines of the software unit in mobile terminal, hardware cell or software and hardware, it is also possible to as independence
Suspension member be integrated in the application system of mobile terminal.
Coded sequence is set up unit 31 and is set up the gesture command coded sequence of gesture result and control command corresponding relation.
In embodiments of the present invention, this gesture command coded sequence comprises three partial contents and moves, i.e. mobile electronic device
The smart mobile phone interactive controlling life that this gesture that attitude, user's gesture are made with user under this mobile electronic device attitude is corresponding
Order.Different gesture motion can corresponding different function choosing-item, this can be set by the user when actually used.In conjunction with actual
Demand, present embodiment considers gesture motion and combination, the gesture command of its correspondence that several actions are clear, easy to carry out below
Coded sequence is as follows:
<screen level upward, { brandishing to the left, brandish to the right }, screen locking/unblock>
<screen level upward, { brandish to the left, brandish to the right, brandish to the left }, receiving/hang-up phone>
<screen level upward, is brandished to the left, slides to the left>
<screen level upward, is brandished to the right, slides to the right>
<screen the most upward, is upwards brandished, upward sliding>
<screen the most upward, is brandished downwards, slide downward>
< screen level upward, { brandishing downwards, upwards brandish }, select/confirm
<screen is horizontal, { brandishing downwards, upwards brandish }, cancels/returns>
Additionally, also have many to plant different gesture combinations, can be used to realize different functions, such as call, look into
See note, open program, application is set etc..In view of 6 kinds of basic mobile phone attitudes, every kind of attitude correspondence up and down 4 kinds former
Sub-gesture, only considers 3 and the gesture sequence of following atom gesture, and the most total gesture command can up to 6*43=384 kind.Even if
Remove the most unnatural, inconvenient gesture motion, the most still have enough abundant gesture control command to complete basic hand
Machine is mutual.
Data perception unit 32 increases sensor and performs the behaviour of perception next time when sensor currently captures perception events
The probability made, reduces sensor and performs the probability of sense operation next time, pass when sensor does not currently capture perception events
Sensor passes through sense operation perception data.
In the present invention is example, probability is calculated by below equation:Wherein α is default adaptive factor, and 0 α 1,
Pi be sensor perform current sense operation probability, Pi+1 is the probability that sensor performs sense operation next time, and Pi and
Pi+1 is more than or equal to 0.1 and less than or equal to 1.
Identify that performance element 33 carries out the identification of gesture result to the data of perception, search from gesture command coded sequence
Go out the control command corresponding to gesture recognition result and perform this control command.
Equipment gesture recognition module 331 moves the identification of electronic equipment attitude to the perception data of sensor.
In the present invention is example, equipment gesture recognition module is by acceleration sequence A and default error tolerance threshold
Move the identification of electronic equipment attitude；
The perception data of sensor includes acceleration sequence A=<ax, ay, az>, and wherein, ax represents the acceleration of x-axis, ay
Representing the acceleration of y-axis, az represents the acceleration of z-axis；
First, it is determined that mobile phone attitude.According to the reading on tri-axles of 3-axis acceleration sensor X, Y, Z, it is determined that mobile phone
Attitude towards.Generally mobile phone face up top forward time, X-axis is (to the right for positive direction) parallel with screen minor face, and Y-axis is
Limit long with screen parallel (being positive direction forward), Z axis is and screen vertical (upwards for positive direction).Mainly judge mobile phone screen court
Upper, screen is down or the screen attitude such as vertically.Specifically, note acceleration of gravity is g, and each mobile phone attitude can be by X-axis, Y
The perception data A=<ax, ay, az of the acceleration transducer on axle, Z axis>judge.Ideal situation is as follows:
Mobile phone screen level upward time, A=<0,0 ,-g>；Mobile phone screen level down time, A=<0,0, g>；
Mobile phone screen vertically the most upward time, A=<0 ,-g, 0>；Mobile phone screen vertically the most upward time, A=<0, g, 0>；
Mobile phone laterally towards time upper, A=<-g, 0,0>；Mobile phone laterally towards under time, A=<g, 0,0>；
Under actual conditions, when mobile phone is in above attitude, the acceleration readings on three axles can be the most inclined with ideal situation
Difference, therefore can set an error tolerance threshold t to process mobile electronic device acceleration bias on X-axis, Y-axis, Z axis,
Particularly as follows: as A=<t, t ,-g+t>, it is determined that device screen level is upward；As A=<t, t, g+t>, it is determined that device screen level court
Under；As A=<t ,-g+t, t>, it is determined that device screen is the most upward；As A=<t, g+t, t>, it is determined that device screen is the most upward；Work as A
=<-g+t, t, t>, it is determined that equipment is laterally towards upper；As A=<g+t, t, t>, it is determined that equipment laterally towards under.
Gesture sequence identification module 332 carries out the identification of gesture sequence to the perception data of sensor.
Sliding window arranges module 3321 and arranges sliding window w, the acceleration sequence B to the perception data after removal gravity
=b1, b2 ... bi, bi+1 ..., the subsequence that bn} starts to take in sliding window w from b1 is the acceleration sequence B pre-processed '
={b1,b2,...bk}。
Atom gesture determination module 3322 judges the acceleration sequence B of pretreatment ' acceleration on x, tri-axles of y, z becomes
Change trend；If the acceleration sequence B of pretreatment ' on a certain axle, occur that absolute value is more than the acceleration sequence of ξ and this adds continuously
The velocity series duration more than ω, then judges that mobile electronic device produces an atom gesture on this axle, and ξ is default adding
Threshold speed;Slide described sliding window w, and the acceleration sequence B of the perception data after removing gravity is taken next sliding window
Subsequence B in mouth w ", if the subsequence B in next sliding window w " be not empty set, then by this next one sliding window w
Subsequence B " be set to pretreatment acceleration subsequence B ', it is judged that the acceleration sequence B of pretreatment ' on x, tri-axles of y, z
Acceleration change trend；If the acceleration sequence B of pretreatment ' on a certain axle, occur that absolute value is more than the acceleration of ξ continuously
Sequence and this acceleration sequence time duration more than ω, then judge that mobile electronic device produces an atom gesture on this axle,;
If the subsequence B in this next one sliding window w " be empty set, then terminate atom gesture identification；
In the present invention is example, gesture sequence comprises several atom gestures, and atom gesture represents the most unidirectional
Brandish action；
W value is 300 ± 200ms, ω value 150 ± 50ms, and ξ value is 7 ± 2m/s2.
Control command enquiry module 333 searches the control life of correspondence according to recognition result in gesture command coded sequence
Order.
Control command performs module 334 and performs control command.
The present invention uses self adaptation perceived frequency technology based on probability, by judging the most whether sensor captures sense
County magistrate's part is increased or decreased sensor and performs the probability of sense operation next time, effectively save can monitor power consumption, pass through opponent
The identification of gesture result performs control command, resolution height and fast response time.
The above disclosed presently preferred embodiments of the present invention that is only, can not limit the right of the present invention with this certainly
Scope, the equivalent variations therefore made according to the claims in the present invention, still belong to the scope that the present invention is contained.
Claims (7)
1. a mobile electronic device gesture control interaction method, it is characterised in that, said method comprising the steps of:
Set up the gesture command coded sequence of gesture result and control command corresponding relation；
Increase described sensor when sensor currently captures perception events and perform the probability of sense operation next time, when described
Sensor reduces described sensor and performs the probability of sense operation next time, described sensor when currently not capturing perception events
By sense operation perception data；And
Data to perception carry out the identification of gesture result, find out described gesture identification from described gesture command coded sequence
Control command corresponding to result also performs this control command；
The described data to perception carry out the identification of gesture result, find out gesture identification from described gesture command coded sequence
Control command corresponding to result also performs this control command, specifically includes following steps:
Perception data to sensor moves the identification of electronic equipment attitude；
Perception data to sensor carries out the identification of gesture sequence；
In described gesture command coded sequence, the control command of correspondence is searched according to described gesture identification result；And
Perform described control command；
The described perception data to sensor moves the identification of electronic equipment attitude, particularly as follows: by acceleration sequence A and
The error tolerance threshold preset moves the identification of electronic equipment attitude；
The perception data of described sensor includes acceleration sequence A=<ax, ay, az>, and wherein, ax represents the acceleration of x-axis, ay
Representing the acceleration of y-axis, az represents the acceleration of z-axis.
2. mobile electronic device gesture control interaction method as claimed in claim 1, it is characterised in that, described probability is by following
Formula calculates:Wherein α be default self adaptation because of
Son, and 0 α 1, PiThe probability of current sense operation, P is performed for sensori+1The general of sense operation next time is performed for sensor
Rate, and PiAnd Pi+1More than or equal to 0.1 and less than or equal to 1.
3. mobile electronic device gesture control interaction method as claimed in claim 1, it is characterised in that, described to sensor
Perception data carries out the identification of gesture sequence, specifically includes following steps:
Step 1: sliding window w is set, to remove the acceleration sequence B of the perception data after gravity=b1, b2 ... bi, bi+
1 ..., the subsequence that bn} starts to take in sliding window w from b1 is the acceleration sequence B pre-processed '=b1, b2 ... bk}；
Step 2: judge the acceleration sequence B of pretreatment ' acceleration change trend on x, tri-axles of y, z；If pretreatment
Acceleration sequence B ' on a certain axle, occur that absolute value is more than the acceleration sequence of ξ and this acceleration sequence time duration surpasses continuously
Crossing ω, then judge that mobile electronic device produces an atom gesture on this axle, described ξ is default acceleration rate threshold；
Step 3: slide described sliding window w, takes next sliding window to the acceleration sequence B of the perception data after removing gravity
Subsequence B in mouth w ", if the subsequence B in described next sliding window w " be not empty set, then by this next one sliding window
Subsequence B in mouthful w " it is set to the acceleration subsequence B ' of pretreatment, return step 2；If the son in this next one sliding window w
Sequence B " be empty set, then terminate described atom gesture identification；
Described gesture sequence comprises several atom gestures, and described atom gesture represents the most unidirectional and brandishes action；
Described w value is 300 ± 200ms, described ω value 150 ± 50ms, and described ξ value is 7 ± 2m/s2.
4. a mobile electronic device gesture controls interactive device, it is characterised in that, described device includes:
Gesture coding sets up unit, for setting up the gesture command coded sequence of gesture result and control command corresponding relation；
Data perception unit, performs perception next time for increasing described sensor when sensor currently captures perception events
The probability of operation, reduces described sensor and performs sense operation next time when described sensor does not currently capture perception events
Probability, described sensor pass through sense operation perception data；And
Identify performance element, for the data of perception being carried out the identification of gesture result, from described gesture command coded sequence
Find out the control command corresponding to gesture identification result and perform this control command；
Described identification performance element specifically includes:
Equipment gesture recognition module, for moving the identification of electronic equipment attitude to the perception data of sensor；
Gesture sequence identification module, for carrying out the identification of gesture sequence to the perception data of sensor；
Control command enquiry module, for searching correspondence according to described gesture identification result in described gesture command coded sequence
Control command；And
Control command performs module, is used for performing described control command；
Described equipment gesture recognition module moves electronic equipment appearance by acceleration sequence A and the error tolerance threshold preset
The identification of state；
The perception data of described sensor includes acceleration sequence A=<ax, ay, az>, and wherein, ax represents the acceleration of x-axis, ay
Representing the acceleration of y-axis, az represents the acceleration of z-axis.
5. mobile electronic device gesture as claimed in claim 4 controls interactive device, it is characterised in that, described probability is by following
Formula calculates:Wherein α be default self adaptation because of
Son, and 0 α 1, PiThe probability of current sense operation, P is performed for sensori+1The general of sense operation next time is performed for sensor
Rate, and PiAnd Pi+1More than or equal to 0.1 and less than or equal to 1.
6. mobile electronic device gesture as claimed in claim 4 controls interactive device, it is characterised in that,
Described gesture sequence identification module, specifically includes:
Sliding window arranges module, is used for arranging sliding window w, to remove the acceleration sequence B of the perception data after gravity=
B1, b2 ... bi, bi+1 ..., the subsequence that bn} starts to take in sliding window w from b1 is the acceleration sequence B pre-processed '
=b1, b2 ... bk}；
Atom gesture determination module, for judging the acceleration sequence B of pretreatment ' acceleration change on x, tri-axles of y, z
Trend；If the acceleration sequence B of pretreatment ' on a certain axle, occur that absolute value is more than acceleration sequence and this acceleration of ξ continuously
The degree series duration more than ω, then judges that mobile electronic device produces an atom gesture on this axle, and described ξ is default
Acceleration rate threshold；Slide described sliding window w, and the acceleration sequence B of the perception data after removing gravity is taken next slip
Subsequence B in window w ", if the subsequence B in described next sliding window w " be not empty set, then this next one is slided
Subsequence B in window w " be set to pretreatment acceleration subsequence B "；Judge the acceleration sequence B of pretreatment ' at x, y, z tri-
Acceleration change trend on individual axle；If the acceleration sequence B of pretreatment ' on a certain axle, occur that absolute value is more than ξ's continuously
Acceleration sequence and this acceleration sequence time duration more than ω, then judge that mobile electronic device produces an atom on this axle
Gesture, if the subsequence B in this next one sliding window w " be empty set, then terminate described atom gesture identification；
Described gesture sequence comprises several atom gestures, and described atom gesture represents the most unidirectional and brandishes action；
Described w value is 300 ± 200ms, described ω value 150 ± 50ms, and described ξ value is 7 ± 2m/s2.
7. a mobile terminal, it is characterised in that described mobile terminal includes described in claim 5 to 6 any claim
Mobile electronic device gesture controls interactive device.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210520849.2A CN103019378B (en) | 2012-12-07 | 2012-12-07 | A kind of mobile electronic device gesture control interaction method, device and mobile terminal |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210520849.2A CN103019378B (en) | 2012-12-07 | 2012-12-07 | A kind of mobile electronic device gesture control interaction method, device and mobile terminal |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103019378A CN103019378A (en) | 2013-04-03 |
| CN103019378B true CN103019378B (en) | 2016-09-07 |
Family
ID=47968062
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201210520849.2A Expired - Fee Related CN103019378B (en) | 2012-12-07 | 2012-12-07 | A kind of mobile electronic device gesture control interaction method, device and mobile terminal |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103019378B (en) |
Families Citing this family (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103345627B (en) * | 2013-07-23 | 2016-03-30 | 清华大学 | Action identification method and device |
| CN104751034A (en) * | 2015-03-16 | 2015-07-01 | 联想(北京)有限公司 | Data processing method and electronic device |
| CN105721701A (en) * | 2016-02-24 | 2016-06-29 | 河南理工大学 | Voice and gesture auxiliary operation system convenient for the old to operate smart phone |
| CN106714163B (en) * | 2016-12-05 | 2020-07-14 | 同济大学 | Gesture behavior authentication mode construction method and system based on posture change |
| CN108989553A (en) * | 2018-06-29 | 2018-12-11 | 北京微播视界科技有限公司 | The method, apparatus and electronic equipment of scene manipulation |
| CN110377159B (en) * | 2019-07-24 | 2023-06-09 | 张洋 | Action recognition method and device |
| CN114995628B (en) * | 2021-10-13 | 2023-08-11 | 荣耀终端有限公司 | Space gesture recognition method and related equipment thereof |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1497434A (en) * | 2002-10-09 | 2004-05-19 | ���µ�����ҵ��ʽ���� | Information terminal equipment, operation support method and operation support program |
| CN1522431A (en) * | 2001-12-12 | 2004-08-18 | �Ҵ���˾ | Method and system for non-intrusive speaker verification using behavior model |
| CN101636711A (en) * | 2007-01-30 | 2010-01-27 | 苹果公司 | Gesturing with a multipoint sensing device |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9619035B2 (en) * | 2011-03-04 | 2017-04-11 | Microsoft Technology Licensing, Llc | Gesture detection and recognition |
-
2012
- 2012-12-07 CN CN201210520849.2A patent/CN103019378B/en not_active Expired - Fee Related
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1522431A (en) * | 2001-12-12 | 2004-08-18 | �Ҵ���˾ | Method and system for non-intrusive speaker verification using behavior model |
| CN1497434A (en) * | 2002-10-09 | 2004-05-19 | ���µ�����ҵ��ʽ���� | Information terminal equipment, operation support method and operation support program |
| CN101636711A (en) * | 2007-01-30 | 2010-01-27 | 苹果公司 | Gesturing with a multipoint sensing device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103019378A (en) | 2013-04-03 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103019378B (en) | A kind of mobile electronic device gesture control interaction method, device and mobile terminal | |
| US8270670B2 (en) | Method for recognizing and tracing gesture | |
| CN105912142B (en) | A kind of note step and Activity recognition method based on acceleration sensor | |
| CN108027643B (en) | Method, device and apparatus for micro-motion based input gesture control of wearable computing device | |
| CN107085367B (en) | Method for lightening screen of smart watch by raising hand | |
| CN104731307B (en) | A kind of body-sensing action identification method and human-computer interaction device | |
| CN102867190B (en) | A kind of method utilizing mobile device built-in sensors to carry out Activity recognition | |
| CN206584114U (en) | A kind of low power-consumption intelligent AR devices and intelligence AR glasses | |
| CN114897025A (en) | Human body posture recognition model establishing method and human body posture recognition method | |
| CN106406516A (en) | Local real-time movement trajectory characteristic extraction and identification method for smartphone | |
| CN112428308A (en) | Robot touch action recognition system and recognition method | |
| CN113642432A (en) | Method for identifying human body posture by convolutional neural network based on covariance matrix transformation | |
| CN107277032A (en) | A kind of switching method of video definition, device, storage medium and terminal | |
| CN111265841A (en) | Swimming lap number determining method, device, equipment and storage medium | |
| CN107477970B (en) | Refrigerator door opening control method and refrigerator adopting same | |
| CN108279846A (en) | A kind of gesture model establishes, the method and device of gesture authentication | |
| WO2018014432A1 (en) | Voice application triggering control method, device and terminal | |
| CN209170425U (en) | Electronic equipment | |
| CN112426709B (en) | Forearm movement posture recognition method, interface interaction control method and device | |
| CN107272877A (en) | A kind of recognition methods of intelligent glasses and intelligent glasses | |
| WO2022042526A1 (en) | Method for triggering pre-loading function of electronic device, electronic apparatus, and storage medium | |
| CN109567814A (en) | The classifying identification method of brushing action calculates equipment, system and storage medium | |
| CN105511643B (en) | A kind of gesture identification method based on 3-axis acceleration sensor | |
| CN111444771B (en) | Gesture preposing real-time identification method based on recurrent neural network | |
| CN103019389B (en) | Gesture identification system and gesture identification |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20160907 |