CN103019378A - Gesture control interaction method and device for mobile electronic equipment and mobile terminal - Google Patents
Gesture control interaction method and device for mobile electronic equipment and mobile terminal Download PDFInfo
- Publication number
- CN103019378A CN103019378A CN2012105208492A CN201210520849A CN103019378A CN 103019378 A CN103019378 A CN 103019378A CN 2012105208492 A CN2012105208492 A CN 2012105208492A CN 201210520849 A CN201210520849 A CN 201210520849A CN 103019378 A CN103019378 A CN 103019378A
- Authority
- CN
- China
- Prior art keywords
- gesture
- acceleration
- sequence
- sensor
- identification
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D30/00—Reducing energy consumption in communication networks
- Y02D30/70—Reducing energy consumption in communication networks in wireless communication networks
Landscapes
- Telephone Function (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention relates to the field of mobile communication, and provides a gesture control interaction method and a gesture control interaction device for mobile electronic equipment, and a mobile terminal. The method comprises the following steps of: establishing a gesture command encoding sequence of a corresponding relation of a gesture result and a control command; increasing probability of the performance of next sensing operation by a sensor when a sensing event is captured by using the sensor at present, decreasing the probability of the performance of next sensing operation by the sensor when a sensing event is not sensed by using the sensor at present, and making the sensor sense data through sensing operation; and identifying a gesture result specific to sensed data, looking up a control command which corresponds to a gesture identification result from the gesture command encoding sequence, and executing the control command. According to the method, the probability of the performance of next sensing operation by the sensor is increased or reduced by judging whether a sensing event is captured by using the sensor at present, so that the monitoring energy consumption can be reduced; and the control command is executed by identifying a gesture result, so that high identification degree and high response speed are achieved.
Description
Technical field
The present invention relates to moving communicating field, relate in particular to a kind of control of mobile electronic device gesture exchange method, device and portable terminal.
Background technology
Current electronics mobile device such as the topmost input mode of smart mobile phone are touch-screen inputs, namely realize input by user finger and the contact action of mobile electronic device touch-screen, comprise operation to mobile electronic device, literal input etc.That main flow mobile intelligent electronic equipment adopts all is capacitive touch screen (Capacity Touch Panel).Because capacitive touch screen uses the electrode of human body as capacitance component on principle, so it actually uses contacting of too busy to get away human body and capacitance plate.Therefore, if when between finger and the touch-screen other media such as gloves, clothing being arranged respectively, touch screen None-identified and response touch action.
Phonetic entry is the another kind of input mode of current mobile electronic device such as smart mobile phone.Yet because the accuracy of speech recognition and the high energy consumption that audio monitoring brings, phonetic entry is difficult to independent freely the controlling mobile electronic device of realizing; On the other hand, because phonetic entry needs the mobile electronic device user to lift up one's voice, use in many instances and inconvenience.
Summary of the invention
For above-mentioned technical matters, the control of mobile electronic device gesture exchange method, device and the portable terminal that the object of the present invention is to provide a kind of resolution height for mobile intelligent electronic equipment, in time respond, energy consumption are low.
The invention provides a kind of mobile electronic device gesture control exchange method, said method comprising the steps of:
Set up the gesture command coded sequence of gesture result and control command corresponding relation;
Increase described sensor when capturing perception events and carry out the next time probability of sense operation when described sensor is current, reduce described sensor when not capturing perception events and carry out the next time probability of sense operation when described sensor is current, described sensor is by the sense operation perception data; And
The data of perception are carried out gesture result's identification, from described gesture command coded sequence, find out the corresponding control command of described gesture identification result and carry out this control command.
The present invention also provides a kind of mobile electronic device gesture control interactive device, and described device comprises:
Coded sequence is set up the unit, is used for setting up the gesture command coded sequence of gesture result and control command corresponding relation;
The data perception unit, be used for increasing described sensor when capturing perception events and carrying out the next time probability of sense operation when described sensor is current, reduce described sensor when not capturing perception events and carry out the next time probability of sense operation when described sensor is current, described sensor is by the sense operation perception data; And
The identification performance element is used for the data of perception are carried out gesture result's identification, finds out the corresponding control command of described gesture identification result and carry out this control command from described gesture command coded sequence.
The present invention also provides a kind of portable terminal, and described portable terminal comprises above-mentioned mobile electronic device gesture control interactive device.
The present invention adopts the self-adaptation perceived frequency technology of Based on Probability, by judge that the current perception events that whether captures of sensor increases or reduce the probability that sensor is carried out sense operation next time, can effectively save and monitor power consumption, by control command being carried out in gesture result's identification, resolution height and fast response time.
Description of drawings
In order to be illustrated more clearly in the embodiment of the invention or technical scheme of the prior art, the below will do to introduce simply to the accompanying drawing of required use in embodiment or the description of the Prior Art, apparently, accompanying drawing in the following describes only is some embodiments of the present invention, for those of ordinary skills, under the prerequisite of not paying creative work, can also obtain according to these accompanying drawings other accompanying drawing.
Fig. 1 is the process flow diagram of mobile electronic device gesture control exchange method of the present invention;
Fig. 2 is the process flow diagram of mobile electronic device gesture control exchange method of the present invention;
Fig. 3 is the structural drawing of mobile electronic device gesture control interactive device of the present invention.
Embodiment
Below in conjunction with accompanying drawing, the technical scheme in the embodiment of the invention is clearly and completely described, obviously, described embodiment only is the present invention's part embodiment, rather than whole embodiment.Based on the embodiment among the present invention, those of ordinary skills belong to the scope of protection of the invention not making the every other embodiment that obtains under the creative work prerequisite.
The present invention adopts the self-adaptation perceived frequency technology of Based on Probability, can effectively save and monitor power consumption, by control command being carried out in gesture result's identification, resolution height and fast response time.
The mobile electronic device gesture that Fig. 1 shows the embodiment of the invention to be provided is controlled the flow process of exchange method, and details are as follows:
In step S101, set up the gesture command coded sequence of gesture result and control command corresponding relation;
In embodiments of the present invention, this gesture command coded sequence comprises three partial contents and moves, the mutual control command of smart mobile phone corresponding to this gesture that namely user makes under mobile electronic device attitude, user's gesture and this mobile electronic device attitude.Different gesture motion can corresponding different function choosing-item, and this can be set by the user when reality is used.In conjunction with actual demand, present embodiment is considered gesture motion and the combination that following several actions are clear, be easy to carry out, and its corresponding gesture command coded sequence is as follows:
＜screen level up, { brandish left, brandish to the right }, screen locking/release 〉
＜screen level up, { brandish left, brandish to the right, brandish left }, receiving/hang-up phone 〉
＜screen level is brandished left up, slides left 〉
＜screen level is brandished to the right up, slides to the right 〉
＜screen is upwards brandished vertically up, upward sliding 〉
＜screen is brandished downwards vertically up, down sliding 〉
＜screen level up, { brandish downwards, upwards brandish } selected/confirm 〉
＜screen is horizontal, and { brandish downwards, upwards brandish } cancels/return 〉
In addition, also have the combination of the different gesture of many kinds, can be used for realizing different functions, such as calling, check note, open program, application being set etc.Consider 6 kinds of basic mobile phone attitudes, every kind of attitude correspondence is 4 kinds of atom gestures up and down, only consider the gesture sequence of 3 and following atom gesture, and then total gesture command can reach the 6*43=384 kind.Even remove wherein unnatural, inconvenient gesture motion, also still there is enough abundant gesture control command to finish basic mobile phone interaction.
In step S102, increase sensor when capturing perception events and carry out the next time probability of sense operation when sensor is current, reduce sensor when not capturing perception events and carry out the next time probability of sense operation when sensor is current, sensor is by the sense operation perception data;
In embodiments of the present invention, as a kind of mobile phone interaction technology, need to continue to monitor and perception, for reducing the self-adaptation perceived frequency technology that the energy consumption present embodiment adopts Based on Probability of monitoring.Particularly, if it is p that sensor is carried out the probability of current sense operation, the probability of then carrying out perception at the next cycle sensor is judged according to the result of current this time perception: if current sensing results captures perception events, then improve the probability of next time perception; If current sensing results does not capture any event, then reduce the probability of next time perception.Particularly, set an adaptive factor α, perception probability is calculated by following formula:
0 ﹤ α ﹤ 1 wherein, Pi is the probability that sensor is carried out current sense operation, Pi+1 is that sensor is carried out the next time probability of sense operation.
Simultaneously do not cross the low resolution that reduces because of perception probability in order to guarantee, the span that present embodiment is set perception probability is [0.1,1], namely no longer rises when perception probability reaches 1, reaches at 0.1 o'clock and no longer reduces.
Among the step S103, the data of perception are carried out gesture result's identification, from the gesture command coded sequence, find out the corresponding control command of gesture identification result and carry out this control command.
The mobile electronic device gesture that Fig. 2 shows the embodiment of the invention to be provided is controlled the flow process of exchange method, and details are as follows:
In step S201, set up the gesture command coded sequence of gesture result and control command corresponding relation;
In step S202, increase sensor when capturing perception events and carry out the next time probability of sense operation when sensor is current, reduce sensor when not capturing perception events and carry out the next time probability of sense operation when sensor is current, sensor is by the sense operation perception data;
In step S203, the perception data of sensor is carried out the identification of mobile electronic device attitude;
In embodiments of the present invention, the perception data of sensor is carried out the identification of mobile electronic device attitude, specifically carry out the identification of mobile electronic device attitude by acceleration sequence A and default error tolerance threshold value;
The perception data of sensor comprise the acceleration sequence A=＜ax, ay, az 〉, wherein, ax represents the acceleration of x axle, ay represents the acceleration of y axle, az represents the acceleration of z axle.
Present embodiment is carried out following gesture identification step:
At first, judge the mobile phone attitude.According to the reading on 3-axis acceleration sensor X, Y, three axles of Z, the attitude of judging mobile phone towards.Usually face up the top forward the time at mobile phone, X-axis is (being positive dirction to the right) parallel with the screen minor face, and Y-axis be parallel with the long limit of screen (being positive dirction forward), and Z axis be (making progress is positive dirction) vertical with screen.Main judge mobile phone screen up, screen down or the attitude such as screen is vertical.Particularly, note acceleration of gravity is g, and each mobile phone attitude can be passed through the perception data A=＜ax of the acceleration transducer on X-axis, Y-axis, Z axis, ay, az〉judge.Ideal situation is as follows:
The mobile phone screen level is up the time, A=＜0,0 ,-g 〉; The mobile phone screen level is down the time, A=＜0,0, g 〉;
Mobile phone screen is vertically up the time, A=＜0 ,-g, 0 〉; Mobile phone screen is vertically up the time, A=＜0, g, 0 〉;
Mobile phone is laterally up the time, A=＜-g, 0,0 〉; Mobile phone is laterally down the time, A=＜g, 0,0 〉;
Under the actual conditions, when mobile phone is in above attitude, acceleration readings on three axles and ideal situation be deviation to some extent, therefore can set an error tolerance threshold value t and process the acceleration bias of mobile electronic device on X-axis, Y-axis, Z axis, be specially: as A=＜t, t ,-g+t 〉, the determining apparatus screen level is up; As A=＜t, t, g+t 〉, the determining apparatus screen level is down; As A=＜t ,-g+t, t 〉, the determining apparatus screen is vertically up; As A=＜t, g+t, t 〉, the determining apparatus screen is vertically up; When A=＜-g+t, t, t 〉, determining apparatus laterally up; As A=＜g+t, t, t 〉, determining apparatus is laterally down.
In step S204, the perception data of sensor is carried out the identification of gesture sequence;
In embodiments of the present invention, the gesture sequence comprises several atom gestures, and the atom gesture represents once unidirectional action of brandishing, and the perception data of sensor is carried out the identification of gesture sequence, specifically by perception data is carried out the atom gesture identification, atom gesture identification step is specific as follows:
To the acceleration transducer sequence B in the perception data behind the removal gravity={ b1, b2, ... bi, bi+1, ..., bn}(comprises from the beginning perception constantly to perception all acceleration perception datas of the finish time), carved from the outset moving window w has been set, the subsequence of getting in the moving window w is pretreated acceleration sequence B '={ b1, b2 ... bk}(acceleration sequence B ' comprise that the zero hour is to the constantly interior all acceleration perception datas of w), judge that respectively B ' is at x, y, the acceleration change trend on three axles of z.Set acceleration rate threshold ξ, if B ' absolute value occurs continuously and surpasses ω greater than the acceleration sequence of threshold xi and this sequence duration on a certain axle, judge that then mobile phone produces an atom gesture at this axle, acceleration is that timing is this axle positive dirction, and acceleration is this axle negative direction when being negative.Mobile phone this axle with respect to the earth definitely towards determination methods consistent with mobile phone attitude determination methods.
Then, this moving window w slides, the acceleration sequence B of removing the perception data behind the gravity is got subsequence B in the next moving window w "=bk+1; bk+2; ... bj} (B ' with B " in the number of perception data may be identical also may be different), if the subsequence B in the described next moving window w " be empty set; then continue the interior subsequence B of the next moving window w of identification " the atom gesture, be specially: judge respectively B " at x; y; the acceleration change trend on three axles of z; if B " absolute value on a certain axle, occurs continuously and surpass ω greater than the acceleration sequence of threshold xi and this sequence duration, judge that then mobile phone produces an atom gesture at this axle.Successively the acceleration transducer sequence B in the perception data behind the removal gravity is processed, each moving window w that slides, identify successively the atom gesture of the subsequence in the next moving window w, recognition methods as previously mentioned, until the subsequence in the next moving window w is finished described atom gesture identification when being empty set.Usually moving window and time threshold are unsuitable excessive, and w can value be 300 ± 200ms in practice, and ω can value 150 ± 50ms.The value of acceleration rate threshold ξ is then unsuitable too small, desirable 7 ± 2m/s2 in the reality.
In step S205, in described gesture command coded sequence, search corresponding control command according to described recognition result;
In embodiments of the present invention, the result according to the data of perception being carried out mobile device attitude and gesture recognition sequence finds out the corresponding control command of gesture identification result from the gesture command coded sequence.
In step S206, carry out control command.
The mobile electronic device gesture that Fig. 3 shows the embodiment of the invention to be provided is controlled the structure of interactive device, for convenience of explanation, only shows the part relevant with the embodiment of the invention.
This mobile electronic device gesture control interactive device can be widely used in the various portable terminals such as mobile phone, panel computer, can be the unit that software unit, hardware cell or software and hardware in the portable terminal combine, also can be used as independently, suspension member be integrated in the application system of portable terminal.
Coded sequence is set up the gesture command coded sequence that gesture result and control command corresponding relation are set up in unit 31.
In embodiments of the present invention, this gesture command coded sequence comprises three partial contents and moves, the mutual control command of smart mobile phone corresponding to this gesture that namely user makes under mobile electronic device attitude, user's gesture and this mobile electronic device attitude.Different gesture motion can corresponding different function choosing-item, and this can be set by the user when reality is used.In conjunction with actual demand, present embodiment is considered gesture motion and the combination that following several actions are clear, be easy to carry out, and its corresponding gesture command coded sequence is as follows:
＜screen level up, { brandish left, brandish to the right }, screen locking/release 〉
＜screen level up, { brandish left, brandish to the right, brandish left }, receiving/hang-up phone 〉
＜screen level is brandished left up, slides left 〉
＜screen level is brandished to the right up, slides to the right 〉
＜screen is upwards brandished vertically up, upward sliding 〉
＜screen is brandished downwards vertically up, down sliding 〉
＜screen level up, { brandish downwards, upwards brandish } selected/confirm 〉
＜screen is horizontal, and { brandish downwards, upwards brandish } cancels/return 〉
In addition, also have the combination of the different gesture of many kinds, can be used for realizing different functions, such as calling, check note, open program, application being set etc.Consider 6 kinds of basic mobile phone attitudes, every kind of attitude correspondence is 4 kinds of atom gestures up and down, only consider the gesture sequence of 3 and following atom gesture, and then total gesture command can reach the 6*43=384 kind.Even remove wherein unnatural, inconvenient gesture motion, also still there is enough abundant gesture control command to finish basic mobile phone interaction.
Be in the example in the present invention, probability is calculated by following formula:
Wherein α is default adaptive factor, and 0 ﹤ α ﹤ 1, and Pi is the probability that sensor is carried out current sense operation, and Pi+1 is that sensor is carried out the next time probability of sense operation, and Pi and Pi+1 are more than or equal to 0.1 and less than or equal to 1.
The data of 33 pairs of perception of identification performance element are carried out gesture result's identification, find out the corresponding control command of gesture identification result and carry out this control command from the gesture command coded sequence.
The perception data of 331 pairs of sensors of equipment gesture recognition module carries out the identification of mobile electronic device attitude.
Be in the example in the present invention, equipment gesture recognition module is carried out the identification of mobile electronic device attitude by acceleration sequence A and default error tolerance threshold value;
The perception data of sensor comprise the acceleration sequence A=＜ax, ay, az 〉, wherein, ax represents the acceleration of x axle, ay represents the acceleration of y axle, az represents the acceleration of z axle;
At first, judge the mobile phone attitude.According to the reading on 3-axis acceleration sensor X, Y, three axles of Z, the attitude of judging mobile phone towards.Usually face up the top forward the time at mobile phone, X-axis is (being positive dirction to the right) parallel with the screen minor face, and Y-axis be parallel with the long limit of screen (being positive dirction forward), and Z axis be (making progress is positive dirction) vertical with screen.Main judge mobile phone screen up, screen down or the attitude such as screen is vertical.Particularly, note acceleration of gravity is g, and each mobile phone attitude can be passed through the perception data A=＜ax of the acceleration transducer on X-axis, Y-axis, Z axis, ay, az〉judge.Ideal situation is as follows:
The mobile phone screen level is up the time, A=＜0,0 ,-g 〉; The mobile phone screen level is down the time, A=＜0,0, g 〉;
Mobile phone screen is vertically up the time, A=＜0 ,-g, 0 〉; Mobile phone screen is vertically up the time, A=＜0, g, 0 〉;
Mobile phone is laterally up the time, A=＜-g, 0,0 〉; Mobile phone is laterally down the time, A=＜g, 0,0 〉;
Under the actual conditions, when mobile phone is in above attitude, acceleration readings on three axles and ideal situation be deviation to some extent, therefore can set an error tolerance threshold value t and process the acceleration bias of mobile electronic device on X-axis, Y-axis, Z axis, be specially: as A=＜t, t ,-g+t 〉, the determining apparatus screen level is up; As A=＜t, t, g+t 〉, the determining apparatus screen level is down; As A=＜t ,-g+t, t 〉, the determining apparatus screen is vertically up; As A=＜t, g+t, t 〉, the determining apparatus screen is vertically up; When A=＜-g+t, t, t 〉, determining apparatus laterally up; As A=＜g+t, t, t 〉, determining apparatus is laterally down.
The perception data of 332 pairs of sensors of gesture recognition sequence module carries out the identification of gesture sequence.
Moving window arranges module 3321 moving window w is set, to the acceleration sequence B of removing the perception data behind the gravity={ b1, b2, ... bi, bi+1 ..., bn} is pretreated acceleration sequence B from the subsequence that b1 begins to get in the moving window w '=b1, b2 ... bk}.
Atom gesture determination module 3322 is judged pretreated acceleration sequence B ' at x, y, the acceleration change trend on three axles of z; If pretreated acceleration sequence B ' absolute value on a certain axle, occurs continuously and surpass ω greater than the acceleration sequence of ξ and this acceleration sequence duration, judge that then mobile electronic device produces an atom gesture at this axle, ξ is default acceleration rate threshold; Described moving window w slides, the acceleration sequence B of removing the perception data behind the gravity is got subsequence B in the next moving window w "; if the subsequence B in the next moving window w " be not empty set, subsequence B in then should next one moving window w " be made as pretreated acceleration subsequence B '; judge pretreated acceleration sequence B ' at x; y, the acceleration change trend on three axles of z; If pretreated acceleration sequence B ' absolute value on a certain axle, occurs continuously and surpass ω greater than the acceleration sequence of ξ and this acceleration sequence duration, judge that then mobile electronic device produces an atom gesture at this axle; If the subsequence B in should next one moving window w " be empty set, then finish the atom gesture identification;
Be in the example in the present invention, the gesture sequence comprises several atom gestures, and the atom gesture represents once unidirectional action of brandishing;
The w value is 300 ± 200ms, ω value 150 ± 50ms, and the ξ value is 7 ± 2m/s2.
Control command enquiry module 333 is searched corresponding control command according to recognition result in the gesture command coded sequence.
Control command execution module 334 is carried out control command.
The present invention adopts the self-adaptation perceived frequency technology of Based on Probability, by judge that the current perception events that whether captures of sensor increases or reduce the probability that sensor is carried out sense operation next time, can effectively save and monitor power consumption, by control command being carried out in gesture result's identification, resolution height and fast response time.
Above disclosed only is preferred embodiment of the present invention, certainly can not limit with this interest field of the present invention, and the equivalent variations of therefore doing according to claim of the present invention still belongs to the scope that the present invention is contained.
Claims (10)
1. a mobile electronic device gesture control exchange method is characterized in that, said method comprising the steps of:
Set up the gesture command coded sequence of gesture result and control command corresponding relation;
Increase described sensor when capturing perception events and carry out the next time probability of sense operation when described sensor is current, reduce described sensor when not capturing perception events and carry out the next time probability of sense operation when described sensor is current, described sensor is by the sense operation perception data; And
The data of perception are carried out gesture result's identification, from described gesture command coded sequence, find out the corresponding control command of described gesture identification result and carry out this control command.
2. mobile electronic device gesture as claimed in claim 1 is controlled exchange method, it is characterized in that described probability is calculated by following formula:
Wherein α is default adaptive factor, and 0 ﹤ α ﹤ 1, and Pi is the probability that sensor is carried out current sense operation, and Pi+1 is that sensor is carried out the next time probability of sense operation, and Pi and Pi+1 are more than or equal to 0.1 and less than or equal to 1.
3. mobile electronic device gesture as claimed in claim 1 is controlled exchange method, it is characterized in that, the described identification of the data of perception being carried out the gesture result, from described gesture command coded sequence, find out the corresponding control command of described gesture identification result and carry out this control command, specifically may further comprise the steps:
The perception data of sensor is carried out the identification of mobile electronic device attitude;
The perception data of sensor is carried out the identification of gesture sequence;
Result according to described identification searches corresponding control command in described gesture command coded sequence; And
Carry out described control command.
4. mobile electronic device gesture as claimed in claim 3 is controlled exchange method, it is characterized in that, described the perception data of sensor is carried out the identification of mobile electronic device attitude, be specially: carry out the identification of mobile electronic device attitude by acceleration sequence A and default error tolerance threshold value;
The perception data of described sensor comprise the acceleration sequence A=＜ax, ay, az 〉, wherein, ax represents the acceleration of x axle, ay represents the acceleration of y axle, az represents the acceleration of z axle.
5. mobile electronic device gesture as claimed in claim 3 control exchange method is characterized in that, described the perception data of sensor is carried out the identification of gesture sequence, specifically may further comprise the steps:
Step 1: moving window w is set, to the acceleration sequence B of removing the perception data behind the gravity=b1, b2 ... bi, bi+1 ..., bn} is pretreated acceleration sequence B from the subsequence that b1 begins to get in the moving window w '=b1, b2 ... bk};
Step 2: judge pretreated acceleration sequence B ' at x, y, the acceleration change trend on three axles of z; If pretreated acceleration sequence B ' absolute value on a certain axle, occurs continuously and surpass ω greater than the acceleration sequence of ξ and this acceleration sequence duration, judge that then mobile electronic device produces an atom gesture at this axle, described ξ is default acceleration rate threshold;
Step 3: the described moving window w that slides, the acceleration sequence B of removing the perception data behind the gravity is got subsequence B in the next moving window w ", if the subsequence B in the described next moving window w "
Be not empty set, then should be made as pretreated acceleration subsequence B ' by the interior subsequence B ' ' of next one moving window w, return step 2; If should the interior subsequence B ' ' of next one moving window w be empty set, then finish described atom gesture identification;
Described gesture sequence comprises several atom gestures, and described atom gesture represents once unidirectional action of brandishing;
Described w value is 300 ± 200ms, described ω value 150 ± 50ms, and described ξ value is 7 ± 2m/s2.
6. a mobile electronic device gesture is controlled interactive device, it is characterized in that described device comprises:
The gesture coding is set up the unit, is used for setting up the gesture command coded sequence of gesture result and control command corresponding relation;
The data perception unit, be used for increasing described sensor when capturing perception events and carrying out the next time probability of sense operation when described sensor is current, reduce described sensor when not capturing perception events and carry out the next time probability of sense operation when described sensor is current, described sensor is by the sense operation perception data; And
The identification performance element is used for the data of perception are carried out gesture result's identification, finds out the corresponding control command of described gesture identification result and carry out this control command from described gesture command coded sequence.
7. mobile electronic device gesture as claimed in claim 6 is controlled interactive device, it is characterized in that described probability is calculated by following formula:
Wherein α is default adaptive factor, and 0 ﹤ α ﹤ 1, and Pi is the probability that sensor is carried out current sense operation, and Pi+1 is that sensor is carried out the next time probability of sense operation, and Pi and Pi+1 are more than or equal to 0.1 and less than or equal to 1.
8. mobile electronic device gesture as claimed in claim 6 is controlled interactive device, it is characterized in that described identification performance element specifically comprises:
Equipment gesture recognition module is used for the perception data of sensor is carried out the identification of mobile electronic device attitude;
Gesture recognition sequence module is used for the perception data of sensor is carried out the identification of gesture sequence;
The control command enquiry module is used for searching corresponding control command according to the other result of described knowledge at described gesture command coded sequence; And
The control command execution module is used for carrying out described control command.
9. mobile electronic device gesture control interactive device as claimed in claim 8 is characterized in that, described equipment gesture recognition module is carried out the identification of mobile electronic device attitude by acceleration sequence A and default error tolerance threshold value;
The perception data of described sensor comprise the acceleration sequence A=＜ax, ay, az 〉, wherein, ax represents the acceleration of x axle, ay represents the acceleration of y axle, az represents the acceleration of z axle;
Described gesture recognition sequence module specifically comprises:
Moving window arranges module, is used for arranging moving window w, to the acceleration sequence B of removing the perception data behind the gravity={ b1, b2, ... bi, bi+1 ..., bn} is pretreated acceleration sequence B from the subsequence that b1 begins to get in the moving window w '=b1, b2 ... bk};
Atom gesture determination module is used for judging pretreated acceleration sequence B ' at x, y, the acceleration change trend on three axles of z; If pretreated acceleration sequence B ' absolute value on a certain axle, occurs continuously and surpass ω greater than the acceleration sequence of ξ and this acceleration sequence duration, judge that then mobile electronic device produces an atom gesture at this axle, described ξ is default acceleration rate threshold; Described moving window w slides, the acceleration sequence B of removing the perception data behind the gravity is got subsequence B in the next moving window w "; if the subsequence B ' ' in the described next moving window w be empty set, then should be made as pretreated acceleration subsequence B ' by the interior subsequence B ' ' of next one moving window w; Judge pretreated acceleration sequence B ' at x, y, the acceleration change trend on three axles of z; If pretreated acceleration sequence B ' absolute value on a certain axle, occurs continuously and surpass ω greater than the acceleration sequence of ξ and this acceleration sequence duration, judge that then mobile electronic device produces an atom gesture at this axle; If should the interior subsequence B ' ' of next one moving window w be empty set, then finish described atom gesture identification;
Described gesture sequence comprises several atom gestures, and described atom gesture represents once unidirectional action of brandishing;
Described w value is 300 ± 200ms, described ω value 150 ± 50ms, and described ξ value is 7 ± 2m/s2.
10. a portable terminal is characterized in that, described portable terminal comprises the described mobile electronic device gesture control of the arbitrary claim of claim 6 to 9 interactive device.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210520849.2A CN103019378B (en) | 2012-12-07 | 2012-12-07 | A kind of mobile electronic device gesture control interaction method, device and mobile terminal |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210520849.2A CN103019378B (en) | 2012-12-07 | 2012-12-07 | A kind of mobile electronic device gesture control interaction method, device and mobile terminal |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103019378A true CN103019378A (en) | 2013-04-03 |
| CN103019378B CN103019378B (en) | 2016-09-07 |
Family
ID=47968062
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201210520849.2A Active CN103019378B (en) | 2012-12-07 | 2012-12-07 | A kind of mobile electronic device gesture control interaction method, device and mobile terminal |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103019378B (en) |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103345627A (en) * | 2013-07-23 | 2013-10-09 | 清华大学 | Action recognition method and device |
| CN104751034A (en) * | 2015-03-16 | 2015-07-01 | 联想(北京)有限公司 | Data processing method and electronic device |
| CN105721701A (en) * | 2016-02-24 | 2016-06-29 | 河南理工大学 | Voice and gesture auxiliary operation system convenient for the old to operate smart phone |
| CN106714163A (en) * | 2016-12-05 | 2017-05-24 | 同济大学 | Gesture behavior authentication model constructing method and system based on posture change |
| CN108989553A (en) * | 2018-06-29 | 2018-12-11 | 北京微播视界科技有限公司 | The method, apparatus and electronic equipment of scene manipulation |
| CN110377159A (en) * | 2019-07-24 | 2019-10-25 | 张洋 | Action identification method and device |
| CN114995628A (en) * | 2021-10-13 | 2022-09-02 | 荣耀终端有限公司 | Method for recognizing air gesture and related equipment thereof |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1497434A (en) * | 2002-10-09 | 2004-05-19 | ���µ�����ҵ��ʽ���� | Information terminal equipment, operation support method and operation support program |
| CN1522431A (en) * | 2001-12-12 | 2004-08-18 | �Ҵ���˾ | Method and system for non-intrusive speaker verification using behavior model |
| CN101636711A (en) * | 2007-01-30 | 2010-01-27 | 苹果公司 | Gesturing with a multipoint sensing device |
| US20120225719A1 (en) * | 2011-03-04 | 2012-09-06 | Mirosoft Corporation | Gesture Detection and Recognition |
-
2012
- 2012-12-07 CN CN201210520849.2A patent/CN103019378B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1522431A (en) * | 2001-12-12 | 2004-08-18 | �Ҵ���˾ | Method and system for non-intrusive speaker verification using behavior model |
| CN1497434A (en) * | 2002-10-09 | 2004-05-19 | ���µ�����ҵ��ʽ���� | Information terminal equipment, operation support method and operation support program |
| CN101636711A (en) * | 2007-01-30 | 2010-01-27 | 苹果公司 | Gesturing with a multipoint sensing device |
| US20120225719A1 (en) * | 2011-03-04 | 2012-09-06 | Mirosoft Corporation | Gesture Detection and Recognition |
Cited By (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103345627B (en) * | 2013-07-23 | 2016-03-30 | 清华大学 | Action identification method and device |
| CN103345627A (en) * | 2013-07-23 | 2013-10-09 | 清华大学 | Action recognition method and device |
| CN104751034A (en) * | 2015-03-16 | 2015-07-01 | 联想(北京)有限公司 | Data processing method and electronic device |
| CN105721701A (en) * | 2016-02-24 | 2016-06-29 | 河南理工大学 | Voice and gesture auxiliary operation system convenient for the old to operate smart phone |
| CN106714163A (en) * | 2016-12-05 | 2017-05-24 | 同济大学 | Gesture behavior authentication model constructing method and system based on posture change |
| GB2590207B (en) * | 2018-06-29 | 2023-02-08 | Beijing Microlive Vision Tech Co Ltd | Scene controlling method, device and electronic equipment |
| CN108989553A (en) * | 2018-06-29 | 2018-12-11 | 北京微播视界科技有限公司 | The method, apparatus and electronic equipment of scene manipulation |
| WO2020001015A1 (en) * | 2018-06-29 | 2020-01-02 | 北京微播视界科技有限公司 | Scenario control method and device, and electronic device |
| GB2590207A (en) * | 2018-06-29 | 2021-06-23 | Beijing Microlive Vision Tech Co Ltd | Scenario control method and device, and electronic device |
| US11755119B2 (en) | 2018-06-29 | 2023-09-12 | Beijing Microlive Vision Technology Co., Ltd | Scene controlling method, device and electronic equipment |
| CN110377159A (en) * | 2019-07-24 | 2019-10-25 | 张洋 | Action identification method and device |
| CN110377159B (en) * | 2019-07-24 | 2023-06-09 | 张洋 | Action recognition method and device |
| CN114995628B (en) * | 2021-10-13 | 2023-08-11 | 荣耀终端有限公司 | Space gesture recognition method and related equipment thereof |
| CN114995628A (en) * | 2021-10-13 | 2022-09-02 | 荣耀终端有限公司 | Method for recognizing air gesture and related equipment thereof |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103019378B (en) | 2016-09-07 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103019378A (en) | Gesture control interaction method and device for mobile electronic equipment and mobile terminal | |
| KR102492724B1 (en) | Techniques for Micromotion Based Input Gesture Control of Wearable Computing Devices | |
| CN108983979B (en) | Gesture tracking recognition method and device and intelligent equipment | |
| CN101625607A (en) | Finger mouse | |
| CN102867190B (en) | A kind of method utilizing mobile device built-in sensors to carry out Activity recognition | |
| CN105550559A (en) | Gesture unlocking method and apparatus and mobile terminal | |
| CN108111689A (en) | Dynamic regulating method, device and the mobile terminal of pressure touch | |
| CN104885051A (en) | Multi-touch symbol recognition | |
| CN104919406B (en) | Touch input unit | |
| CN104077041A (en) | Page turning method, device and terminal | |
| CN104978132A (en) | Application control method and mobile terminal | |
| CN103472915A (en) | Reading control method and reading control device on basis of pupil tracking and display equipment | |
| CN105353906B (en) | Trajectory predictions system and trajectory predictions method | |
| CN106598231B (en) | gesture recognition method and device | |
| CN105005443A (en) | Application startup method and mobile terminal | |
| CN108279846A (en) | A kind of gesture model establishes, the method and device of gesture authentication | |
| CN105718775A (en) | Application control method and mobile terminal | |
| CN105867787A (en) | Method and device for detecting mode of holding terminal by user and terminal | |
| WO2018014432A1 (en) | Voice application triggering control method, device and terminal | |
| CN103425406A (en) | Inputting method and inputting device of mobile terminal | |
| CN207020639U (en) | Smart pen with fingerprint | |
| CN106293034A (en) | The method of a kind of information output and terminal | |
| CN110058723A (en) | A kind of Writing method, apparatus and system | |
| CN106598232B (en) | Gesture recognition method and device | |
| KR100953861B1 (en) | End point detection method, mouse device applying the end point detection method and operating method using the mouse device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant |