CN103941860A - Gesture recognition system of wrist strap type portable terminal and method of gesture recognition system - Google Patents
Gesture recognition system of wrist strap type portable terminal and method of gesture recognition system Download PDFInfo
- Publication number
- CN103941860A CN103941860A CN201410127693.0A CN201410127693A CN103941860A CN 103941860 A CN103941860 A CN 103941860A CN 201410127693 A CN201410127693 A CN 201410127693A CN 103941860 A CN103941860 A CN 103941860A
- Authority
- CN
- China
- Prior art keywords
- gesture
- force value
- user
- value
- wrist strap
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Abstract
The invention discloses a gesture recognition system of a wrist strap type portable terminal and a method of the gesture recognition system. The gesture recognition system comprises a plurality pressure sensors, an acceleration sensor, an angular velocity sensor and a control unit. The pressure sensors are arranged on the preset positions on a wrist strap and used for detecting values of pressure borne by the wrist strap when a user makes a gesture; the acceleration sensor is arranged in a body of the portable terminal and used for detecting coordinate values of the portable terminal; the angular velocity sensor is arranged in the body and used for detecting the rotation angle of the portable terminal; the control unit is arranged in the body, so that the gesture made by the user is judged according to the detection values of at least one of the acceleration sensor and the angular velocity sensor and the detection values of the pressure sensors, and the portable terminal is controlled to conduct operation corresponding to the gesture.
Description
Technical field
The present invention relates to a kind of wristband type portable terminal, relate in particular to and a kind ofly can identify the gesture that user makes and carry out gesture recognition system and the method thereof of the wristband type portable terminal of corresponding operation.
Background technology
Recently, along with the development of intellectualized operation system, given wristband type portable terminal more function.Therefore, most wristband type portable terminal is called except having, and sends outside the basic function of note, also has multimedia, network browsing, functions such as shooting and medical examination of taking pictures.
For the input mode of wristband type portable terminal, except physical button in the past, by the use of flexible touching display screen etc., can also directly input user instruction by display screen.
But, due to the finite volume of wristband type portable terminal, no matter be therefore physical button or virtual key, it is very large that size all can not be done, and the difficulty of use increases, very inconvenient.
To this, also there is in the market the gesture control armlet of MYO wrist strap and so on, the electrical activity producing by the muscle of detecting user also converts thereof into operational order, sends electronic equipment by software in the mode of wireless network.
But, when current MYO wrist strap is only worn on upper arm, just can ensure Operational Figure Of Merit, but also need staff to there is obviously violent action, therefore also such MYO wrist strap cannot be applied to wristband type portable terminal.
Summary of the invention
The present invention proposes in view of the above problems, and its object is to provide a kind of and can identifies the gesture that user makes and carry out gesture recognition system and the method thereof of the wristband type portable terminal of corresponding operation
For the attainment of one's purpose, according to an aspect of the present invention, provide a kind of gesture recognition system of wristband type portable terminal, comprising: multiple pressure transducers, be arranged on the precalculated position on wrist strap, for detect user while making gesture described in the suffered force value of wrist strap; Acceleration transducer, is arranged in the main body of described portable terminal, for detecting the coordinate figure of described portable terminal; Angular-rate sensor, is arranged in described main body, for detecting the angle of rotation of described portable terminal; Control module, be arranged in described main body, according at least one and the detected value of described multiple pressure transducers in described acceleration transducer, described angular-rate sensor, judge the gesture that user makes, and control described portable terminal and carry out with gesture and operate accordingly.
Preferably, described control module can utilize following mathematical expression to be converted to pressure reduction relative quantity the described force value detecting,
P
K=△N
K/W
K
Wherein, P
kfor described pressure reduction relative quantity, △ N
kbe the pressure difference value of the predetermined time interval of K pressure transducer, W
kbe the sensing range of K pressure transducer, and K is more than or equal to 1 integer.
Preferably, the present invention can also comprise adaptive unit, in order to adjust the relative position relationship between described wrist strap and user's wrist.
Preferably, described adaptive unit can comprise: the air pump that is arranged on a side of described main body; Be arranged at the air bag on described wrist strap; Be arranged on multiple pressure transducers in the precalculated position on described wrist strap.
Preferably, the present invention can also comprise storage unit, in order to store gesture mapping table, this gesture mapping table comprises the corresponding relation between at least one and described pressure reduction relative quantity and user's gesture and the operational order of described portable terminal in coordinate relative value, angle of rotation.
Preferably, the present invention can also comprise reminding unit, and the state that arranges of the gesture of making for user and described portable terminal gives user various promptings.
Preferably, described control module can also comprise similar degree judging unit, meets the shared ratio of force value differential pressure relative quantity of the reference value of corresponding gesture for judging detected force value differential pressure relative quantity.
Preferably, described control module can also comprise self-defined unit, in order to set the gesture corresponding with operational order according to user's custom.
For the attainment of one's purpose, according to a further aspect in the invention, provide a kind of gesture identification method of wristband type portable terminal, comprise the steps: a, detect the force value at multiple positions of wrist strap and the coordinate figure of wrist strap terminal, in angle of rotation more than one; B, according in detected described force value and coordinate figure, angle of rotation more than one, judge the gesture that user makes.
Preferably, can also comprise step: utilize following mathematical expression to be converted to pressure reduction relative quantity the described force value detecting,
P
K=△N
K/W
K
Wherein, P
kfor described pressure reduction relative quantity, △ N
kbe the pressure difference value in schedule time of K pressure transducer, W
kfor the sensing range of this K pressure transducer, and K is more than or equal to 1 integer.
Preferably, before described a step, can also comprise the self-adaptation step for adjusting the relative position between wrist strap terminal and user's wrist.
Preferably, described self-adaptation step can also comprise the steps: to utilize air pump to inflate the air bag on wrist strap; Detect the force value of the predetermined position on wrist strap; The force value detecting and standard value are compared; According to comparative result, in the time that force value is different from standard value, adjust the gas flow of air bag by air pump, so that described force value is identical with standard value.
Preferably, in the step of the described gas flow of adjusting air bag by air pump, in the time that force value is greater than standard value, can from air bag, extract by air pump portion gas out, until the force value on predetermined position is identical with standard value; In the time that force value is less than standard value, can continue to airbag aeration by air pump, until the force value on predetermined position is identical with standard value.
Preferably, after the step of the force value of the predetermined position on described detection wrist strap, can also comprise step: judge in detected described force value whether have abnormal force value; If there is abnormal force value, reminding user is adjusted the wearing position of terminal.
Preferably, in described b step, can judge the gesture that user makes based on gesture mapping table, this gesture mapping table comprises the corresponding relation between at least one and described pressure reduction relative quantity and user's gesture and the operational order of described portable terminal in coordinate relative value, angle of rotation.
Preferably, in the time of the gesture of utilizing described force value differential pressure relative quantity to judge that user makes, more than the shared ratio of force value differential pressure relative quantity of the reference value of corresponding gesture reaches predetermined value if meet in the force value differential pressure relative quantity detecting, can be judged as user and make corresponding gesture.
According to the gesture recognition system of wristband type portable terminal provided by the invention and method thereof, user can the singlehanded various operations of controlling portable terminal, can improve thus the handling of wristband type portable terminal.
Brief description of the drawings
Fig. 1 is according to the simplified diagram of wristband type portable terminal of the present invention.
Fig. 2 is according to the module map of wristband type portable terminal of the present invention.
Fig. 3 is the simplified diagram illustrating according to the layout example of the pressure transducer of wristband type portable terminal of the present invention.
Fig. 4 is according to the process flow diagram of the gesture identification method of wristband type portable terminal of the present invention.
Embodiment
Below, be described in detail for the wristband type portable terminal of the preferred embodiments of the present invention with reference to accompanying drawing.
Fig. 1 is according to the simplified diagram of wristband type portable terminal of the present invention.Fig. 2 is according to the module map of wristband type portable terminal of the present invention.
As seen from the figure, outward appearance, the wrist strap 110 that comprises haply main body 100 and be connected with this main body 100 by connecting portion 112 according to wristband type portable terminal of the present invention (following, referred to as wrist strap terminal).
Main body 100 can comprise display unit 102, communication unit (not shown) and be arranged on multiple physical buttons (not shown) in precalculated position.And the precalculated position of main body 100 can also be provided with camera and loudspeaker etc.
Preferably, described display unit 102 can adopt flexible display screen, to increase the compactedness between wrist strap terminal and user's wrist.This display unit 102 can show various user interfaces, for example, and system time, short message, web page contents etc.User can or utilize physical button to input user instruction by touch manner, so that the shown content of display unit 102 is operated.
Communication unit (not shown) can comprise radio antenna, bluetooth module etc., thus can with external unit receiving and transmitting signal.
In order to improve the efficiency of user input instruction, convenient operation, can comprise sensing cell and control module 200 according to the gesture recognition system of wrist strap terminal of the present invention.Wherein, sensing cell can comprise the multiple pressure transducers 120 on the predetermined position that is arranged on main body 100 and wrist strap 110, the acceleration transducer 130 that is arranged on main body 100 inside and angular-rate sensor 140.Wherein, angular-rate sensor 140 can be gyroscope.
And, described multiple pressure transducers 120 the are arranged on user the fiercest position of muscular movement while making various gesture.For example, when each root finger motion of user, can cause that the muscle of the diverse location in wrist (, wearing the part of wrist strap terminal) produces motion.By pressure transducer 120 is arranged on to these positions, can roughly judge according to force value is which finger has been made action.
Fig. 3 is the simplified diagram illustrating according to the layout example of the pressure transducer of wristband type portable terminal of the present invention.
As shown in Figure 3, multiple pressure transducer (M
1, M
2, M
n) be arranged in each precalculated position on wrist strap 110, the suffered force value of described wrist strap 110 causing for detecting user's muscular movement.
Particularly, in the time that user's finger or wrist are carried out comings and goings, will there is corresponding motion in the muscle of wrist and little arm segment, and this muscular movement causes each pressure transducer (M on wrist strap 110 or main body 100 back sides
1, M
2, M
n) force value change, and pressure transducer (M on each position
1, M
2, M
n) force value that detects is difference., each pressure transducer (M
1, M
2, M
n) variation of the force value that detects is the muscle activity of the finger corresponding to user or wrist, i.e. gesture.
Suppose that each establishes pressure transducer (M
1, M
2, M
n) detected pressure vector is respectively (N
1, N
2, N
n), in the time of user's finger or Wrist-sport, multiple pressure transducer (M
1, M
2, M
n) in the force value that detects of a part of pressure transducer will change.
At this, the pressure variety that any one pressure transducer Mn detects is △ N
n=N
n2-N
n1.
The detected value of each pressure transducer when finger that can obtain by experiment user is made exercises as listed in table 1.
[table 1] (N of unit)
| Action | M 1 | M 2 | M 3 | M 4 | … | … | M n-2 | M n-1 | M n |
| Forefinger slides up and down | 0.3466 | 0.3512 | 0.002 | 0.003 | … | … | 0.2645 | 0.3599 | 0.2664 |
| Forefinger horizontally slips | 0.3222 | 0.3265 | 0.002 | 0.001 | … | … | 0.002 | 0.2532 | 0.2495 |
| Middle finger slides up and down | 0.3644 | 0.4595 | 0.3587 | 0.002 | … | … | 0.004 | 0.2767 | 0.2866 |
| Thumb horizontally slips | 0.001 | 0.003 | 0.003 | 0.2322 | … | … | 0.003 | 0.002 | 0.002 |
| … | … | … | … | … | … | … | … | … | … |
Known by above-mentioned experiment, user's a gesture changes the force value that causes multiple pressure transducers to detect.Correspondingly, the force value that each pressure transducer detects, can be used for judging that user has made any gesture.
Further, the gesture that user can be made and the operational order of portable terminal are mapped, to reach the object of manipulation portable terminal.What for example, " thumb horizontally slips " in above-mentioned table 1 can be corresponding to terminal picture corresponding to the page turn over operation of terminal picture, " forefinger slides up and down " slides up and down operation etc.
But, consider that the force value that some pressure transducer detects is very little, and between different user and each pressure transducer all there is measuring error, therefore only rely on and be difficult to judge accurately as the concrete force value of table 1, therefore can redefine above-mentioned data by pressure reduction relative quantity.
The pressure limit of supposing pressure transducer Mn is that Wn(n is more than or equal to 1 integer), pressure reduction relative quantity can be expressed as mathematical expression 1.
[mathematical expression 1]
P
n=△N
n/W
n
Wherein, P
nthe pressure reduction relative quantity detecting for n pressure transducer, and 0≤P
n≤ 1, △ N
nit is the pressure difference value in schedule time of n pressure transducer.Wherein, n is more than or equal to 1 integer.
For the result of calculating by above-mentioned mathematical expression 1, can get 2 significant digits or latter one by rounding-off method, and by pressure reduction relative quantity P
nbe arranged as shown in the table.
[table 2]
| Action | P 1 | P 2 | P 3 | P 4 | P 5 | P 6 | … | … | P n-2 | P n-1 | P n |
| The upper and lower small amplitude slip of forefinger | 0.2 | 0.1 | 0 | 0 | 0 | 0 | … | … | 0.2 | 0.3 | 0.2 |
| Forefinger significantly slides up and down | 0.3 | 0.1 | 0 | 0 | 0 | 0 | … | … | 0.3 | 0.4 | 0.3 |
| Forefinger bending | 0.3 | 0.1 | 0 | 0 | 0 | 0 | … | … | 0.3 | 0.5 | 0.4 |
| Forefinger left and right small amplitude slip | 0.1 | 0.1 | 0 | 0 | 0 | 0 | … | … | 0.1 | 0.1 | 0.1 |
| … | … | … | … | … | … | … | … | … | … | … | … |
By above-mentioned mathematical expression 1, the force value detecting is re-started definition and processed, even if the detected pressure value between different user exists deviation, it is identical that its pressure reduction relative quantity also can be tending towards, and can produce accordingly the tables of data of the judgment standard that can serve as gesture.By this tables of data, can improve the accuracy rate of gesture judgement.
In addition, except above-mentioned mathematical expression 1, those skilled in the art can also utilize other mathematical method to process force value, improve accordingly the degree of accuracy of gesture identification.Meanwhile, the pressure reduction relative quantity P of above-mentioned table 2
ncan be used for determining the action of user finger, and principle based on same, the tables of data that can make by experiment the action for judging other positions such as user's wrist.
In addition, except the pressure reduction relative quantity of above-mentioned process mathematics manipulation, can also provide the numerical range corresponding to the force value of gesture, using the benchmark as judging gesture, in the time that the force value that has several pressure transducers is all within the reference range in a certain gesture, can judges user and make corresponding gesture thus.
In addition, the control module 200 of embodiments of the invention can also comprise a similar degree judging unit 210, meets the shared ratio of force value differential pressure relative quantity of the reference value of corresponding gesture for judging detected force value differential pressure relative quantity.
At this, the fundamental purpose that similar degree judging unit 210 is set is to improve gesture and judges degree of accuracy.,, although made correct action, due to the amplitude of action or the error of pressure transducer itself, can cause partial pressure value differential pressure relative quantity and corresponding reference value not to be inconsistent (or departing from reference range).Now, can judge by similar degree judging unit 210 force value differential pressure relative quantity shared ratio in whole force value differential pressure relative quantities of the reference value that meets corresponding gesture, for example, when this ratio (reaches predetermined value, 90%), when above, control module 200 just can be judged as user and make corresponding gesture.
Meanwhile, in order to improve the degree of accuracy of gesture judgement, control module 200 also can be using other parameters as the foundation that judges gesture or initiation gesture recognition function.
That is, in order further to increase the degree of accuracy of gestures detection, can also be using the coordinate figure relative quantity of main body 100 as the parameter that judges user's gesture in the present embodiment.As an example, acceleration transducer 130 is arranged on body interior, for detection of current two dimension or the D coordinates value of main body 100.When user's initiation gesture recognition function and while making gesture, the coordinate figure of main body 100 (two dimension or three-dimensional) can change, and when wrist moves to different positions, has corresponding coordinate figure corresponding with it.For example, when user makes each gesture, described main body 100 all can spatially produce movement, causes coordinate figure to change, and therefore between user's gesture and coordinate figure now, can set up corresponding relation.
So, the relative changing value of the coordinate figure of main body 100 can be detected by acceleration transducer 130, and this changing value can be with described force value differential pressure relative quantity combination as the parameter that judges user's gesture.
And, in order further to increase the degree of accuracy of gestures detection, can also be using the angle of rotation of main body 100 as the parameter that judges user's gesture in the present embodiment.As an example, angular-rate sensor 140 is arranged on the inside of main body, for detection of the rotational angular velocity of main body 100.That is, in the time that user's hand is made gesture, the position of main body 100 will change, and can correspondingly produce angular velocity omega, by this rotational angular velocity is carried out to Integral Processing, can obtain angle of rotation θ.Thus, between user's gesture and angle of rotation, also can set up corresponding relation.Therefore, this angle of rotation θ also can be with described force value differential pressure relative quantity combination as the parameter that judges user's gesture.
Preferably, described angular-rate sensor can be gyroscope.
So, control module 200 can, by the reference value comparison of the force value detecting, coordinate figure, angle of rotation and corresponding gesture, in the time that force value, coordinate figure, angle of rotation conform to the reference value of corresponding gesture, can be judged as user and make corresponding gesture.
In addition, in described pressure reduction relative quantity and coordinate figure difference, angle of rotation can be combined to gesture that can initiation gesture recognition function above., automatic initiation gesture recognition function can make in described pressure reduction relative quantity and coordinate figure difference, angle of rotation one reach predetermined value above time, to be user-friendly to.
In addition, the startup of gesture identification function can also rely on and be arranged on main body 100 physical button and the input of particular sound signal etc. around.
Thus, among the gesture judgement system of the present embodiment, can judge the gesture that user makes by the one or more parts in multiple pressure transducers and acceleration transducer, angular-rate sensor.
; after hand gesture recognition mode starts; by utilizing multiple pressure transducers, acceleration transducer, angular-rate sensor to detect the relative quantity in the schedule time; as change value of pressure, coordinate figure difference, angle of rotation etc., can utilize these relative values and combination thereof to judge the gesture that user makes.
Now, at least one and predetermined gesture in described change value of pressure (or pressure reduction relative quantity) and coordinate figure difference, angle of rotation can be set up to corresponding relation, and setting is corresponding to the operational order of the wrist strap terminal of each gesture, make thus gesture mapping table, operate accordingly thereby can manipulate wrist strap terminal and carry out the gesture made from user based on gesture mapping table.
Within described gesture mapping table can be stored in the storage unit 300 of main body 100 inside.
In addition, in order to improve the accuracy of detection of described multiple pressure transducer, acceleration transducer, angular-rate sensor, should reduce as far as possible wrist strap terminal and the relative motion between arm of wearing.Meanwhile, in order to reduce the measured deviation between different users, should before initiation gesture recognition function, make wrist strap terminal among roughly the same operating environment.
Adaptive unit 400 can also be equipped with accordingly, according to gesture recognition system of the present invention, in order to adjust the relative position relationship between wrist strap and user's wrist.For example,, by the elasticity between adaptive unit 400 capable of regulating wrist strap terminals and user's arm.In addition, can reduce the relative motion between wrist strap terminal and arm by this adaptive unit 400, improve the accuracy of identification of gesture recognition system.Meanwhile, can farthest reduce the deviation of the operating environment between different user by adaptive unit 400.
As row, adaptive unit 400 can comprise a side that is arranged on main body 100, in order to the air pump 410 inflated or bleed, be arranged on wrist strap 110 predetermined position on air bag 420 and be arranged on multiple pressure transducers 430 of the predetermined position of wrist strap 110.
Preferably, described air pump 410 is arranged on described connecting portion 112.
The course of work of described adaptive unit 400 is as follows.
In the time roughly adjusting the position of main body 100 on arm and start adaptive unit 400, air pump 410 is inflated so that air bag 420 expands air bag 420.And multiple pressure transducers 430 detect current detected force value and send control module 200 to.
Control module 200 compares the detected pressure value from multiple pressure transducers 430 and standard value, with the current location that judges wrist strap terminal whether appropriately and whether in optimum operation environment.
; in the time that detected pressure value is greater than standard value; control module 200 is controlled air pump 410 and extract portion gas out from air bag 420; until the detected pressure value that multiple pressure transducers 430 detect meets standard value; and in the time that detected pressure value is less than standard value; control module control air pump 410 continues to inflate to air bag 420, until the detected pressure value that multiple pressure transducer 430 detects meets standard value.
Meanwhile, based on the corresponding relation being arranged between multiple pressure transducers 430 of different parts, control module 200 can be judged user and whether wrist strap terminal is worn to correct position.For example, when the wrist strap terminal of wearing as user has departed from tram, after air bag 420 inflations, if indivedual detected force value of pressure transducer 430 are abnormal (, comparison with standard value (force value detecting in tram) is obviously bigger than normal or less than normal), can think that user is not worn to correct position by wrist strap terminal.
Preferably, wrist strap terminal of the present invention also comprises a reminding unit 600, and this reminding unit 600 can comprise loudspeaker, vibrating motor, light emitting diode (LED) etc., in order to send various prompting messages to user.For example, when starting after adaptive unit 400, wrist strap terminal is not worn to correct position if control module 200 is judged as user, reminding unit 600 sound that can give the alarm under the control of control module 200, adjusts with reminding user.
In addition, in the time identifying or do not identify user's gesture, the light that also can send corresponding voice signal or send respective color carrys out reminding user.
Accordingly, can make wrist strap terminal between different users all in identical operating environment, thereby can improve the degree of accuracy of gesture identification.
Meanwhile, in order to make user, according to the custom of itself, the operational order relevant to gesture identification is set, wrist strap terminal according to the present invention can also be equipped with self-defined unit 500.For example, if user's forefinger (wearing the arm of wrist strap terminal) significantly slides at first up and down corresponding to the sliding up and down of wrist strap terminal interface, user can significantly be slided user's forefinger left and right to be set as sliding up and down corresponding to wrist strap terminal interface by self-defined unit 500.
Fig. 4 is according to the process flow diagram of the gesture identification method of wristband type portable terminal of the present invention.
First, at step S100, detect in the force value at multiple positions of wrist strap and the coordinate figure of wrist strap terminal, angle of rotation more than one.
Preferably, the force value, coordinate figure and the angle of rotation that detect are relative value.,, after gesture identification function on, the initial value of the described pressure transducer 120 of wrist strap terminal, acceleration transducer 130, angular-rate sensor 140 is set to 0, and can detect with predetermined time interval.Preferably, this predetermined time interval can be made the time of complete gesture corresponding to user.This predetermined time interval can be continued to use Default Value, also can be by user's self-defining.For example, in the time that be about 0.25 second the averaging time that user completes a gesture, user can make pressure transducer 120, acceleration transducer 130, angular-rate sensor 140 every through within 0.25 second, just carrying out one-shot measurement.In addition, also can make pressure transducer 120, acceleration transducer 130, angular-rate sensor 140 detect continuously.
Then, enter step S200, according in detected described force value and coordinate figure, angle of rotation more than one, judge the gesture that user makes.Now, can, by the reference value comparison of the force value detecting, coordinate figure, angle of rotation and corresponding gesture, in the time that force value, coordinate figure, angle of rotation conform to the reference value of corresponding gesture, can be judged as user and make corresponding gesture.
And step S200 can also comprise the steps: described force value to utilize following mathematical expression to be converted to pressure reduction relative quantity, to determine the action of finger,
P
K=△N
K/W
K
Wherein, P
kfor pressure reduction relative quantity, △ N
kbe the pressure difference value of the predetermined time interval of K pressure transducer, W
kfor the sensing range of this K pressure transducer, K is more than or equal to 1.
And, in order to improve the degree of accuracy of gesture identification, before step S100, can also optionally comprise the self-adaptation step (S10) for adjusting the relative position between wrist strap terminal and user's wrist.
Particularly, self-adaptation step (S10) can comprise the steps: the air bag on wrist strap to inflate (S12); Detect the force value (S14) of the predetermined position on wrist strap; The force value detecting and standard value are compared to (S16); Based on the comparative result of step S16, if force value is different from standard value, adjust the pressure of air bag by air pump, so that force value equates (S18) with standard value.That is, in the time that force value is greater than standard value, from air bag, extract portion gas out, until the force value on predetermined position meets standard value; And in the time that force value is less than standard value, continue to airbag aeration, until the force value on predetermined position meets standard value.
Preferably, after described step S14, also comprise the steps: to judge the force value (S141) that whether has abnormal (comparison with standard value is obviously bigger than normal or less than normal) in detected force value, if there is abnormal force value, reminding user is adjusted the position (S142) of wrist strap terminal.
In addition, in step S200, can make any gesture to user according to gesture mapping table judges.In described gesture mapping table, comprise the corresponding relation between force value (differential pressure relative quantity) scope, coordinate figure scope, angle of rotation scope and user's gesture.
Preferably, in step S200, in the time utilizing force value (differential pressure relative quantity) to judge that user makes any gesture, (for example reach predetermined value if meet the shared ratio of force value differential pressure relative quantity of the reference value of corresponding gesture in the force value differential pressure relative quantity detecting, 90%), more than, be judged as user and made corresponding gesture.
When identify the gesture that user makes by step S200, enter into step S300, carry out the operation corresponding to identified user's gesture.
The invention is not restricted to above-described embodiment, without departing from the present invention, can carry out various changes and modifications.
Claims (16)
1. a gesture recognition system for wristband type portable terminal, is characterized in that, comprising:
Multiple pressure transducers, are arranged on the precalculated position on wrist strap, for detect user while making gesture described in the suffered force value of wrist strap;
Acceleration transducer, is arranged in the main body of described portable terminal, for detecting the coordinate figure of described portable terminal;
Angular-rate sensor, is arranged in described main body, for detecting the angle of rotation of described portable terminal;
Control module, be arranged in described main body, according at least one and the detected value of described multiple pressure transducers in described acceleration transducer, described angular-rate sensor, judge the gesture that user makes, and control described portable terminal and carry out with gesture and operate accordingly.
2. gesture recognition system according to claim 1, is characterized in that, described control module utilizes following mathematical expression to be converted to pressure reduction relative quantity the described force value detecting,
P
K=△N
K/W
K
Wherein, P
kfor described pressure reduction relative quantity, △ N
kbe the pressure difference value of the predetermined time interval of K pressure transducer, W
kbe the sensing range of K pressure transducer, and K is more than or equal to 1 integer.
3. gesture recognition system according to claim 1, is characterized in that, also comprises adaptive unit, in order to adjust the relative position relationship between described wrist strap and user's wrist.
4. gesture recognition system according to claim 3, is characterized in that, described adaptive unit comprises:
Be arranged on the air pump of a side of described main body;
Be arranged at the air bag on described wrist strap;
Be arranged on multiple pressure transducers in the precalculated position on described wrist strap.
5. gesture recognition system according to claim 2, it is characterized in that, also comprise storage unit, in order to store gesture mapping table, this gesture mapping table comprises the corresponding relation between at least one and described pressure reduction relative quantity and user's gesture and the operational order of described portable terminal in coordinate relative value, angle of rotation.
6. according to the gesture recognition system described in any one in claim 1 to 4, it is characterized in that, also comprise reminding unit, the state that arranges of the gesture of making for user and described portable terminal gives user various promptings.
7. gesture recognition system according to claim 2, it is characterized in that, described control module also comprises similar degree judging unit, meets the shared ratio of force value differential pressure relative quantity of the reference value of corresponding gesture for judging detected force value differential pressure relative quantity.
8. gesture recognition system according to claim 1, is characterized in that, described control module also comprises self-defined unit, in order to set the gesture corresponding with operational order according to user's custom.
9. a gesture identification method for wristband type portable terminal, is characterized in that, comprises the steps:
A, detect in the force value at multiple positions of wrist strap and the coordinate figure of wrist strap terminal, angle of rotation more than one;
B, according in detected described force value and coordinate figure, angle of rotation more than one, judge the gesture that user makes.
10. method according to claim 9, is characterized in that, also comprises step: utilize following mathematical expression to be converted to pressure reduction relative quantity the described force value detecting,
P
K=△N
K/W
K
Wherein, P
kfor described pressure reduction relative quantity, △ N
kbe the pressure difference value in schedule time of K pressure transducer, W
kfor the sensing range of this K pressure transducer, and K is more than or equal to 1 integer.
11. methods according to claim 9, is characterized in that, also comprise the self-adaptation step for adjusting the relative position between wrist strap terminal and user's wrist before described a step.
12. methods according to claim 11, is characterized in that, described self-adaptation step also comprises the steps:
Utilize air pump to inflate the air bag on wrist strap;
Detect the force value of the predetermined position on wrist strap;
The force value detecting and standard value are compared;
According to comparative result, in the time that force value is different from standard value, adjust the gas flow of air bag by air pump, so that described force value is identical with standard value.
13. methods according to claim 12, is characterized in that, in the step of the described gas flow of adjusting air bag by air pump,
In the time that force value is greater than standard value, from air bag, extract portion gas out by air pump, until the force value on predetermined position is identical with standard value;
In the time that force value is less than standard value, continue to airbag aeration by air pump, until the force value on predetermined position is identical with standard value.
14. methods according to claim 12, is characterized in that, also comprise step after the step of the force value of the predetermined position on described detection wrist strap:
Judge in detected described force value and whether have abnormal force value;
If there is abnormal force value, reminding user is adjusted the wearing position of terminal.
15. methods according to claim 10, it is characterized in that, in described b step, judge based on gesture mapping table the gesture that user makes, this gesture mapping table comprises the corresponding relation between at least one and described pressure reduction relative quantity and user's gesture and the operational order of described portable terminal in coordinate relative value, angle of rotation.
16. according to the method described in claim 9 or 10, it is characterized in that, in the time of the gesture of utilizing described force value differential pressure relative quantity to judge that user makes, more than the shared ratio of force value differential pressure relative quantity of the reference value of corresponding gesture reaches predetermined value if meet in the force value differential pressure relative quantity detecting, be judged as user and made corresponding gesture.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410127693.0A CN103941860B (en) | 2014-03-31 | 2014-03-31 | The gesture recognition system and its method of wristband type portable terminal |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410127693.0A CN103941860B (en) | 2014-03-31 | 2014-03-31 | The gesture recognition system and its method of wristband type portable terminal |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103941860A true CN103941860A (en) | 2014-07-23 |
| CN103941860B CN103941860B (en) | 2017-05-31 |
Family
ID=51189556
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410127693.0A Withdrawn - After Issue CN103941860B (en) | 2014-03-31 | 2014-03-31 | The gesture recognition system and its method of wristband type portable terminal |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103941860B (en) |
Cited By (26)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104216519A (en) * | 2014-09-04 | 2014-12-17 | 北京智谷技术服务有限公司 | Dominant limb cognition method and equipment |
| CN104317394A (en) * | 2014-09-26 | 2015-01-28 | 广东欧珀移动通信有限公司 | Method and device for controlling wrist type wearable equipment and wrist belt type wearable equipment |
| CN104407695A (en) * | 2014-10-31 | 2015-03-11 | 广东欧珀移动通信有限公司 | Equipment input method and device |
| CN104699239A (en) * | 2014-12-29 | 2015-06-10 | 北京智谷睿拓技术服务有限公司 | Interaction method based on wearable equipment, interaction device based on wearable equipment as well as wearable equipment |
| CN104731331A (en) * | 2015-03-24 | 2015-06-24 | 联想(北京)有限公司 | Startup control method and electronic device |
| CN104932695A (en) * | 2015-06-29 | 2015-09-23 | 联想(北京)有限公司 | Information input device and information input method |
| CN105068664A (en) * | 2015-09-23 | 2015-11-18 | 谢小强 | Interactive system and interaction control method |
| CN105094338A (en) * | 2015-08-19 | 2015-11-25 | 联想(北京)有限公司 | Control method, controller and electronic equipment |
| CN105147275A (en) * | 2015-09-09 | 2015-12-16 | 成都创想智造科技有限公司 | Intelligent sports bracelet capable of measuring heart rate |
| CN105204639A (en) * | 2015-09-21 | 2015-12-30 | 杭州攻壳科技有限公司 | Control method of wrist equipment and wrist equipment |
| CN105357367A (en) * | 2015-09-30 | 2016-02-24 | 努比亚技术有限公司 | Keystroke identification device and method based on pressure sensor |
| CN105488314A (en) * | 2014-09-15 | 2016-04-13 | 联想(北京)有限公司 | Information processing method and device |
| CN105652652A (en) * | 2014-11-14 | 2016-06-08 | 深圳君正时代集成电路有限公司 | Control method and control device for intelligent watch, and intelligent watch |
| CN106155277A (en) * | 2015-03-26 | 2016-11-23 | 联想(北京)有限公司 | Electronic equipment and information processing method |
| CN106333670A (en) * | 2016-10-10 | 2017-01-18 | 广东小天才科技有限公司 | Method and device for measuring heart rate |
| CN106377243A (en) * | 2016-10-12 | 2017-02-08 | 广东小天才科技有限公司 | Heart rate detection method and device |
| CN106527598A (en) * | 2016-12-15 | 2017-03-22 | 公安部第三研究所 | Police wrist type wearing device for public security law enforcement and application system |
| CN106821321A (en) * | 2017-02-16 | 2017-06-13 | 广东工业大学 | A kind of muscle deformation detecting device |
| WO2017147927A1 (en) * | 2016-03-04 | 2017-09-08 | 茹旷 | Motion capturing device for feeding pet |
| CN107533371A (en) * | 2015-04-29 | 2018-01-02 | 三星电子株式会社 | Controlled using the user interface for influenceing gesture |
| CN107885312A (en) * | 2016-09-29 | 2018-04-06 | 青岛海尔智能技术研发有限公司 | A kind of gestural control method and device |
| WO2018113135A1 (en) * | 2016-12-22 | 2018-06-28 | 广东乐源数字技术有限公司 | Method for adjusting wearing of smart wearable device |
| CN108742568A (en) * | 2018-05-30 | 2018-11-06 | 广东知识城运营服务有限公司 | A kind of Internal Medicine-Cardiovascular Dept. nursing blood pressure monitor |
| CN109859452A (en) * | 2019-03-11 | 2019-06-07 | 汕头大学 | A kind of wearable controller and the method using the controller |
| CN112269471A (en) * | 2020-11-06 | 2021-01-26 | 郭书蕾 | Intelligent wrist strap equipment and single-hand control method, device, system and storage medium thereof |
| CN112286341A (en) * | 2020-06-02 | 2021-01-29 | 深圳市杰理微电子科技有限公司 | Wearable device, audio control method and audio control system |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP3630712B2 (en) * | 1994-02-03 | 2005-03-23 | キヤノン株式会社 | Gesture input method and apparatus |
| CN102915111B (en) * | 2012-04-06 | 2017-05-31 | 寇传阳 | A kind of wrist gesture control system and method |
| CN103631369B (en) * | 2012-08-27 | 2016-12-21 | 联想(北京)有限公司 | Electronic equipment and control method |
-
2014
- 2014-03-31 CN CN201410127693.0A patent/CN103941860B/en not_active Withdrawn - After Issue
Cited By (35)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104216519B (en) * | 2014-09-04 | 2018-02-02 | 北京智谷技术服务有限公司 | Leading limbs recognition methods and equipment |
| CN104216519A (en) * | 2014-09-04 | 2014-12-17 | 北京智谷技术服务有限公司 | Dominant limb cognition method and equipment |
| CN105488314A (en) * | 2014-09-15 | 2016-04-13 | 联想(北京)有限公司 | Information processing method and device |
| CN104317394B (en) * | 2014-09-26 | 2017-11-07 | 广东欧珀移动通信有限公司 | Control method, device and the wrist belt-type wearable device of wrist belt-type wearable device |
| CN104317394A (en) * | 2014-09-26 | 2015-01-28 | 广东欧珀移动通信有限公司 | Method and device for controlling wrist type wearable equipment and wrist belt type wearable equipment |
| CN104407695A (en) * | 2014-10-31 | 2015-03-11 | 广东欧珀移动通信有限公司 | Equipment input method and device |
| CN104407695B (en) * | 2014-10-31 | 2017-11-14 | 广东欧珀移动通信有限公司 | A kind of equipment input method and device |
| CN105652652A (en) * | 2014-11-14 | 2016-06-08 | 深圳君正时代集成电路有限公司 | Control method and control device for intelligent watch, and intelligent watch |
| CN104699239A (en) * | 2014-12-29 | 2015-06-10 | 北京智谷睿拓技术服务有限公司 | Interaction method based on wearable equipment, interaction device based on wearable equipment as well as wearable equipment |
| CN104699239B (en) * | 2014-12-29 | 2018-06-05 | 北京智谷睿拓技术服务有限公司 | Exchange method and interactive device, wearable device based on wearable device |
| CN104731331A (en) * | 2015-03-24 | 2015-06-24 | 联想(北京)有限公司 | Startup control method and electronic device |
| CN104731331B (en) * | 2015-03-24 | 2018-08-31 | 联想(北京)有限公司 | Control open method and electronic equipment |
| CN106155277A (en) * | 2015-03-26 | 2016-11-23 | 联想(北京)有限公司 | Electronic equipment and information processing method |
| CN106155277B (en) * | 2015-03-26 | 2019-03-08 | 联想(北京)有限公司 | Electronic equipment and information processing method |
| CN107533371A (en) * | 2015-04-29 | 2018-01-02 | 三星电子株式会社 | Controlled using the user interface for influenceing gesture |
| CN104932695B (en) * | 2015-06-29 | 2018-06-01 | 联想(北京)有限公司 | Message input device and data inputting method |
| CN104932695A (en) * | 2015-06-29 | 2015-09-23 | 联想(北京)有限公司 | Information input device and information input method |
| CN105094338A (en) * | 2015-08-19 | 2015-11-25 | 联想(北京)有限公司 | Control method, controller and electronic equipment |
| CN105147275A (en) * | 2015-09-09 | 2015-12-16 | 成都创想智造科技有限公司 | Intelligent sports bracelet capable of measuring heart rate |
| WO2017049768A1 (en) * | 2015-09-21 | 2017-03-30 | 杭州攻壳科技有限公司 | Control method for wrist device, and wrist device |
| CN105204639A (en) * | 2015-09-21 | 2015-12-30 | 杭州攻壳科技有限公司 | Control method of wrist equipment and wrist equipment |
| CN105068664A (en) * | 2015-09-23 | 2015-11-18 | 谢小强 | Interactive system and interaction control method |
| CN105357367A (en) * | 2015-09-30 | 2016-02-24 | 努比亚技术有限公司 | Keystroke identification device and method based on pressure sensor |
| WO2017147927A1 (en) * | 2016-03-04 | 2017-09-08 | 茹旷 | Motion capturing device for feeding pet |
| CN107885312A (en) * | 2016-09-29 | 2018-04-06 | 青岛海尔智能技术研发有限公司 | A kind of gestural control method and device |
| CN106333670A (en) * | 2016-10-10 | 2017-01-18 | 广东小天才科技有限公司 | Method and device for measuring heart rate |
| CN106377243A (en) * | 2016-10-12 | 2017-02-08 | 广东小天才科技有限公司 | Heart rate detection method and device |
| CN106527598A (en) * | 2016-12-15 | 2017-03-22 | 公安部第三研究所 | Police wrist type wearing device for public security law enforcement and application system |
| WO2018113135A1 (en) * | 2016-12-22 | 2018-06-28 | 广东乐源数字技术有限公司 | Method for adjusting wearing of smart wearable device |
| CN106821321A (en) * | 2017-02-16 | 2017-06-13 | 广东工业大学 | A kind of muscle deformation detecting device |
| CN108742568A (en) * | 2018-05-30 | 2018-11-06 | 广东知识城运营服务有限公司 | A kind of Internal Medicine-Cardiovascular Dept. nursing blood pressure monitor |
| CN109859452A (en) * | 2019-03-11 | 2019-06-07 | 汕头大学 | A kind of wearable controller and the method using the controller |
| CN112286341A (en) * | 2020-06-02 | 2021-01-29 | 深圳市杰理微电子科技有限公司 | Wearable device, audio control method and audio control system |
| CN112269471A (en) * | 2020-11-06 | 2021-01-26 | 郭书蕾 | Intelligent wrist strap equipment and single-hand control method, device, system and storage medium thereof |
| CN112269471B (en) * | 2020-11-06 | 2022-05-13 | 朴淳技术(深圳)有限公司 | Intelligent wrist strap equipment and single-hand control method, device, system and storage medium thereof |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103941860B (en) | 2017-05-31 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103941860A (en) | Gesture recognition system of wrist strap type portable terminal and method of gesture recognition system | |
| US11045117B2 (en) | Systems and methods for determining axial orientation and location of a user's wrist | |
| US9152236B2 (en) | Apparatus for remotely controlling another apparatus and having self-orientating capability | |
| US8150162B2 (en) | Method and system for three-dimensional handwriting recognition | |
| US9772684B2 (en) | Electronic system with wearable interface mechanism and method of operation thereof | |
| CN105765489A (en) | Techniques for detecting sensor inputs on wearable wireless device | |
| US7616186B2 (en) | Acceleration reference devices, cellular communication terminal systems, and methods that sense terminal movement for cursor control | |
| CN105487689A (en) | Ring mouse and method for operating mobile terminal through same | |
| US20200376337A1 (en) | Electronic device providing workout information according to workout environment and method of operating the same | |
| CN111078088B (en) | Interface control method, electronic device, and computer-readable storage medium | |
| JP6483556B2 (en) | Operation recognition device, operation recognition method and program | |
| CN104898827A (en) | Somatosensory interaction method applying somatosensory interaction system | |
| CN103941846A (en) | Electronic device and input method | |
| CN111028494B (en) | Virtual remote control method of electrical equipment, computer readable storage medium and intelligent household appliance | |
| CN110069146B (en) | Screen space parameter acquisition method and terminal equipment | |
| JP6270557B2 (en) | Information input / output device and information input / output method | |
| CN103984407A (en) | Method and apparatus for performing motion recognition using motion sensor fusion | |
| CN108958603B (en) | Operation mode control method and mobile terminal | |
| CN106527717A (en) | Information input recognition method and device | |
| CN108635805B (en) | Motion reminding method and terminal equipment | |
| CN111142760A (en) | Password determination method and electronic equipment | |
| KR20150123022A (en) | Apparatus and method for inputting and outputting braille | |
| KR102659301B1 (en) | Smart ring and method for smart ring control | |
| CN110083226B (en) | Virtual space positioning method and device | |
| TWI707155B (en) | Intelligent positioning system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| AV01 | Patent right actively abandoned | ||
| AV01 | Patent right actively abandoned |
Granted publication date: 20170531 Effective date of abandoning: 20190723 |