CN105138136A - Hand gesture recognition device, hand gesture recognition method and hand gesture recognition system - Google Patents

Hand gesture recognition device, hand gesture recognition method and hand gesture recognition system Download PDF

Info

Publication number
CN105138136A
CN105138136A CN201510587921.7A CN201510587921A CN105138136A CN 105138136 A CN105138136 A CN 105138136A CN 201510587921 A CN201510587921 A CN 201510587921A CN 105138136 A CN105138136 A CN 105138136A
Authority
CN
China
Prior art keywords
input
finger
sensor
information
angle change
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201510587921.7A
Other languages
Chinese (zh)
Inventor
詹姆斯·刘
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Makesense Sensor Technology Institute Co Ltd
Original Assignee
Beijing Makesense Sensor Technology Institute Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Makesense Sensor Technology Institute Co Ltd filed Critical Beijing Makesense Sensor Technology Institute Co Ltd
Publication of CN105138136A publication Critical patent/CN105138136A/en
Pending legal-status Critical Current

Links

Abstract

The present invention provides a hand gesture recognition device, a hand gesture recognition method and a hand gesture recognition system. The hand gesture recognition device includes: at least one sensor corresponding to finger positions, wherein, the sensor is used to recognize the moving information of a moving finger relative to other fingers; an input mode judging unit, which judges the input mode required by the recognition device according to the hand posture moving information and angle change information detected by the at least one sensor, wherein, the input mode includes at least one of an analog keyboard input method, an analog function key, and an analog mouse; an input content generating unit, wherein, the input content generating unit generates corresponding one of the keyboard input position, functional key switching and mouse moving direction according to the hand gesture moving information and angle change information detected by the at least one sensor when the input mode judging unit confirms the required input mode. According to the invention, the virtual man-machine interaction can be realized and rapid and accurate analog input content is acquired.

Description

Gesture identifying device, gesture identification method and gesture recognition system
Technical field
The present invention relates to the sensing device of a kind of hand positions and position, particularly relate to and a kind ofly realize the gesture identifying device of man-machine interaction, gesture identification method and gesture recognition system by gesture.
Background technology
In recent years, along with the universal of multimedia technology and development, people are carrying out unremitting exploration to novel human-machine interaction technology.The convenience realized by various high-tech means, advanced person, reliably man-machine interactive system are met sword and give birth to, and a lot of electronic product salable is also produce huge economic benefit due to outstanding man-machine interaction means.The WII game machine of such as Nintendo, its man-machine interaction means take the interactive mode of acceleration (inclination angle) sensor intervener by game machine telepilot inside and game, thus defeat other technologies, highlight the advanced person of Nintendo's technology; IPHONE, IPAD of the PLAYSTATIONIII of Sony Corporation, the X-BOX of Microsoft and APPLE company of the U.S., its success is also the advanced person of the man-machine interaction means due to its product to a great extent, the acceleration transducer (inclination angle) etc. that the capacitive transducer at such as its contact screen interface and picture switch anyhow.
Above-mentioned human-computer interaction technology of the prior art is all generally based on switch or sensor element, such as keyboard, mouse, touch-screen, game controls distant bar, and telepilot and game flat board, input mode of the prior art is still difficult to the demand meeting computing machine fast development.Some years recently, the technology of gesture identification is constantly developed, be such as in the patented claim of US20100199228A1 (publication date is on August 5th, 2010) at the publication number of Microsoft, disclose and a kind ofly utilize depth camera to catch and analyze the body posture of user, and be interpreted as the scheme of computer command; Similar gesture identification scheme can also have been come by equipment such as camera, laser radar, laser scanners.
But the technical scheme identification gesture being completed gesture identification by optical device needed for 10 seconds usually, and this speed is difficult to the man-machine interaction met between electronic equipment and computing machine.Be in the patented claim of CN201110384461.X (publication date is on November 28th, 2011) in Chinese Patent Application No., disclose a kind of gesture identifying device and do not need the auxiliary of optical device, but adopt various dimensions magnetic field sensor and various dimensions acceleration transducer to carry out gesture identification, existing human-computer interaction device can be substituted and realize man-machine interaction by gesture, simplify the complicacy of man-machine interactive system to a certain extent, and there is the features such as the fast and certain dirigibility of recognition speed.
But inventor is realizing finding in process of the present invention, the interaction content that publication number realizes input fast for technical scheme disclosed in the patented claim of CN201110384461.X is abundant not enough, can not meet the demand of user.
Summary of the invention
In order to solve the technical matters that in prior art, man-machine interaction content is enriched not, the invention provides a kind of can according to the gesture identifying device of mutual project corresponding to Pre-defined gesture input, gesture identification method and gesture recognition system.
To achieve these goals, technical scheme provided by the invention comprises:
On the one hand, provide a kind of gesture identifying device, on the finger that this gesture identifying device is removably worn on user and/or bracelet, it is characterized in that, described gesture identifying device comprises:
Be arranged at least one sensor corresponding with finger position, described sensor is for identifying that motion finger is relative to other movable information pointed and angle change information;
Input mode identifying unit, for detecting that gesture motion information and angle change information judge the input mode that described recognition device needs according at least one sensor described, wherein said input mode comprises at least one in the input method of simulating keyboard, analog functuion key, analog mouse and simulates the input mode of corresponding hardware operation;
Input content generation unit, when described input mode identifying unit determines the input mode needed, described input mode generation unit detects gesture motion information and angle change information according at least one sensor described, respectively the corresponding one input information generated in corresponding input position on keyboard, the switching of function key, mouse moving direction.
Preferably, five fingers on user right-hand man are respectively arranged with described sensor, and the bracelet of user are also provided with information transmission unit and described sensor; Wherein, described information transmission unit, the electronic equipment that the input information transmission for being generated by described input content generation unit is extremely outside; Sensor on sensor on described finger and described bracelet can be connected to described information transmission unit by wired or wireless network.
Preferably, the sensor on described bracelet for identifying the angle of user's finger tilt, and calculates the degree of fatigue of user according to described angle of inclination.
Preferably, when user right-hand man there being respectively finger recognized movable information and angle change information by respective sensor, described input mode identifying unit is defined as the input method of simulating keyboard.
Preferably, five input areas on the movable information of five of described user's left hand finger respective sensor identification and the corresponding keyboard of angle change information, each letter respectively in corresponding each region of the movable information of five of described user's right hand finger respective sensor identification and angle change information or stroke, described input content generation unit is according to the assembled state input of left-hand finger and right finger.
Preferably, when the sensor of two on user's left hand or the right hand recognize respective finger flexibility be greater than other three finger time, described input mode identifying unit is defined as the switching of function key, and be greater than the array mode of two fingers of other three fingers according to differently curved degree, switch different function keys.
Preferably, when the sensor of five on user's left hand or the right hand recognize at least three sensors recognize respective finger flexibility identical time, or when finger moves around pre-determined number, described input mode identifying unit is defined as analog mouse, and the mobile vector of moving direction determination mouse according to single finger.
Preferably, described device is provided with two sensors corresponding respectively with two finger positions, point in input through keyboard region corresponding to different moving range when one of them sensor detects, another sensor input in each region each letter or stroke, described input content generation unit is according to the assembled state input of left-hand finger and right finger.
Adopt technique scheme provided by the invention, at least can obtain the one in following beneficial effect:
1, according to the information of input mode identifying unit identification, at least one the input mode of corresponding hardware operation can be simulated from the input method of simulating keyboard, analog functuion key, analog mouse, namely can complete by gesture analogue means the function that in prior art, multiple hardware unit just can complete, and generate concrete content of operation according to input content generation unit, such gesture identifying device can greatly enrich gesture input mode by the basis that do not increase hardware cost, and can input content quickly and accurately, improve user friendly.
2, further, five input areas on the movable information of five of left hand finger respective sensor identification and the corresponding keyboard of angle change information, each letter respectively in corresponding each region of the movable information of five of user's right hand finger respective sensor identification and angle change information or stroke, like this can by which better gesture identifying device in conjunction with existing input through keyboard custom and language generation pattern; Similar all right analog functuion key and mouse; Gesture identification not only can be allowed to be combined with specific computing machine, mobile terminal, game console, can also to allow the invention provides gesture identifying device and be combined with existing electronic equipment better.
3, further, only also can also can be realized the input of keyboard by two fingers according to predetermined action, so greatly save the hardware cost of gesture identifying device.
On the other hand, the present invention also provides a kind of gesture identification method, it is characterized in that: described method comprises:
Detect and be worn on the finger of user and/or the movable information of bracelet upper sensor and angle change information;
The movable information detected according to sensor and angle change information, from Simulation of keyboard input, analog functuion key, analog mouse, determine a kind of simulated operation mode needing to input;
According to the simulated operation mode after determining, continue to detect and be worn on the finger of user and/or the movable information of bracelet upper sensor and angle change information;
The further movable information detected according to sensor and angle change information, generate corresponding input position on keyboard or the switching of function key or the input information of mouse moving direction.
Preferably, when user right-hand man there being respectively finger recognized movable information and angle change information by respective sensor, described input mode identifying unit is defined as the input method of simulating keyboard; And five input areas on the movable information of five of described user's left hand fingers respective sensor identification and the corresponding keyboard of angle change information, each letter respectively in corresponding each region of the movable information of five of described user's right hand finger respective sensor identification and angle change information or stroke, described input content generation unit is according to the assembled state input of left-hand finger and right finger.
Preferably, when the sensor of two on user's left hand or the right hand recognize respective finger flexibility be greater than other three finger time, described input mode identifying unit is defined as the switching of function key, and be greater than the array mode of two fingers of other three fingers according to differently curved degree, switch different function keys.
Preferably, when the sensor of five on user's left hand or the right hand recognize at least three sensors recognize respective finger flexibility identical time, or when finger moves around pre-determined number, described input mode identifying unit is defined as analog mouse, and the mobile vector of moving direction determination mouse according to single finger.
Adopt the technical scheme of gesture identification method provided by the invention, the interactive information that the hardware devices such as keyboard, function key, mouse just can complete can be simulated rapidly, and only need finger according to predetermined rule, and just can complete the content of input, easy to operate, quick.
The third aspect, the present invention also provides a kind of gesture recognition system, it is characterized in that, described system comprises:
Be arranged at least one sensor corresponding with finger position, described sensor is for identifying that motion finger is relative to other movable information pointed and angle change information;
The electronic installation be connected with described sensor, and described electronic installation can obtain finger motion information and angle change information that described sensor detects;
Wherein, described electronic installation is still provided with input mode identifying unit and input content generation unit;
Described input mode identifying unit is used for detecting that gesture motion information and angle change information judge the input mode that described recognition device needs according at least one sensor described, and wherein said input mode comprises at least one in the input method of simulating keyboard, analog functuion key, analog mouse and simulates the input mode of corresponding hardware operation;
When described input mode identifying unit determines the input mode needed, described input mode generation unit detects gesture motion information and angle change information according at least one sensor described, respectively the corresponding one input information generated in corresponding input position on keyboard, the switching of function key, mouse moving direction.
Adopt gesture recognition system provided by the invention, be worn on user's sensor on hand and only can need the movable information and angle change information that can identify and point relative to other fingers, and by this information feed back to electronic installation, electronic installation completes the parsing to input content by built-in input mode identifying unit and input content generation unit, so the functional requirement of wearing user's detection part on hand can be simplified, and electronic installation can configure larger volume, the powerful processor of calculation function completes the work of input mode identifying unit and input content generation unit, make gesture recognition system cost low, and recognition accuracy is high.
Further feature and the advantage of invention will be set forth in the following description, and, partly become apparent from instructions, or understand by implementing technical scheme of the present invention.Object of the present invention and other advantages realize by structure specifically noted in instructions, claims and accompanying drawing and/or flow process and obtain.
Accompanying drawing explanation
Fig. 1 is with the structural representation at user's gesture identifying device on hand in the embodiment of the present invention one;
Fig. 2 be in the embodiment of the present invention one gesture identifying device as the schematic diagram of English simulating keyboard;
Fig. 3 be in the embodiment of the present invention one gesture identifying device as the schematic diagram of five simulating keyboards;
Fig. 4 and Fig. 5 be in the embodiment of the present invention one gesture identifying device as the schematic diagram of function key;
Fig. 6 and Fig. 7 be in the embodiment of the present invention one gesture identifying device as the schematic diagram of mouse;
Fig. 8 is the structured flowchart of gesture identifying device in the embodiment of the present invention one;
Fig. 9 is the process flow diagram of gesture identification method in the embodiment of the present invention one;
Figure 10 is the structured flowchart of gesture recognition system in the embodiment of the present invention two.
Embodiment
Describe embodiments of the present invention in detail below with reference to drawings and Examples, to the present invention, how application technology means solve technical matters whereby, and the implementation procedure reaching technique effect can fully understand and implement according to this.It should be noted that, these specific descriptions just allow those of ordinary skill in the art be more prone to, clearly understand the present invention, but not limitation of the invention is explained; And only however form conflict, each embodiment in the present invention and each feature in each embodiment can be combined with each other, and the technical scheme formed is all within protection scope of the present invention.
In addition, can perform in the control system of a such as group controller executable instruction in the step shown in the process flow diagram of accompanying drawing, and, although show logical order in flow charts, but in some cases, can be different from the step shown or described by order execution herein.
Below by the drawings and specific embodiments, technical scheme of the present invention is described in detail:
Embodiment one
As illustrated in figures 1 and 8, embodiment one provides a kind of gesture identifying device 100, and on the finger that this gesture identifying device is removably worn on user and/or bracelet, and gesture identifying device 100 comprises:
Identify gesture motion induction installation 120, induction installation 120 comprises and is arranged at least one sensor corresponding with finger position, and sensor is for identifying that motion finger is relative to the movable information of other fingers and angle change information, wherein, the present embodiment preferably, induction installation 120 comprises and is worn on user on hand, according to thumb, forefinger, middle finger, nameless, little finger all wears the sensor 101 identical with in background technology CN201110384461.X successively, 102, 103, 104, 105, and the wrist-watch on bracelet, wrist-watch comprises sensor 106 and the control module 107 of the angle for identifying user's finger tilt, sensor 107 calculates the degree of fatigue of user according to angle of inclination, control module 107 is provided with the input judging unit 130 carrying out gesture to be converted to input signal, input content generation unit 140, and the left hand of user also wears the induction installation 120 identical with the right hand.And the movement of a finger obviously different relative to other 4 fingers time, a signal is just launched away, is received by the receiving trap in wrist-watch.Particularly, when the angle of bend of a finger is obviously greater than the angle of bend of other 4 fingers, the signal that the sensor on this finger sends is received by the receiving trap of wrist-watch; When finger (left, to the right, forward, a backward) motion, the acceleration information grasping motion flutterred by the sensor on this finger, and this sensor sends signal to the receiving trap of wrist-watch.Wherein:
Input mode identifying unit 130, for detecting that according at least one sensor gesture motion information and angle change information judge the input mode that recognition device needs, wherein input mode comprises at least one in the input method of simulating keyboard, analog functuion key, analog mouse and simulates the input mode of corresponding hardware operation;
Input content generation unit 140, when input mode identifying unit determines the input mode needed, input mode generation unit detects gesture motion information and angle change information according at least one sensor, respectively the corresponding one input information generated in corresponding input position on keyboard, the switching of function key, mouse moving direction.
Preferably, the bracelet of user is also provided with information transmission unit, the input information transmission that information transmission unit is used for input content generation unit 140 to generate is to outside electronic equipment; Sensor 101,102,103,104,105 on finger and the sensor 106 on bracelet can be connected to information transmission unit by wired or wireless network, such as Wi-Fi (registered trademark), bluetooth (registered trademark) etc.
Preferably, as shown in Figures 2 and 3, when user right-hand man there being respectively finger recognized movable information and angle change information by respective sensor, input mode identifying unit 130 is defined as the input method of simulating keyboard.
Preferably, five input areas on the movable information of five of user's left hand finger respective sensor identification and the corresponding keyboard of angle change information, each letter respectively in corresponding each region of the movable information of five of user's right hand finger respective sensor identification and angle change information or stroke, input content generation unit 140 is according to the assembled state input of left-hand finger and right finger.Particularly, the input mode of simulating keyboard can be set to five keyboards, the left hand of user is according to thumb, forefinger, middle finger, nameless, little finger is formulated as the region of five on keyboard 201 successively, 202, 203, 204, 205, after left hand selects an input area, the right hand just can select 5 concrete strokes in this input area, namely 5 fingers of the right hand can according to the stroke in predetermined order successively selected zone, as shown in Figure 2, when the mobile message of the sensor 105 that the sensor 108 that induction installation senses in left hand captures on middle finger and right hand little finger reaches predetermined mobile message simultaneously, just corresponding simulation five input through keyboard regions 203, and select the button of the rightmost side in this region, five simulating keyboard regions 203.
As shown in Figure 3, the input method mode of five simulating keyboards is similar, can also simulate English simulating keyboard, English simulating keyboard is provided with equally five regions 301,302,303,304,305; Difference is that in QWERTY keyboard, there are 6 letters in region 305, when left hand selects this region, the mobile nothing letter represented respectively from left to right of five fingers of the right hand, when the thumb continuous moving twice of the right hand, represents the 6th letter selected from left to right.
Need to illustrate time, above-mentioned finger selects input mode just to understand technical scheme in the present embodiment in order to convenient those skilled in the art, can't limit technical scheme in the present embodiment; Such as, selected zone can also be set to the right hand, left hand is as the input selection of stroke concrete in region or letter; Above-mentioned citing is also not limited to for the corresponding concrete input area of selection gesture or letter/stroke.
Preferably, when the sensor of two on user's left hand or the right hand recognize respective finger flexibility be greater than other three finger time, input mode identifying unit is defined as the switching of function key, and be greater than the array mode of two fingers of other three fingers according to differently curved degree, switch different function keys.Particularly, as shown in Figure 4 and Figure 5, when the middle finger of left hand and thumb winding angle are greater than other three fingers, represent SHIFT key, when the forefinger of left hand and the flexibility of thumb are greater than other three fingers, be expressed as CONTROL key, when can also be greater than other three fingers with regard to the curved region of little finger and thumb, be expressed as CAP key.Certainly, concrete array mode is not limited to these three kinds, can carry out self-defined according to demand.
Preferably, when the sensor of five on user's left hand or the right hand recognize at least three sensors recognize respective finger flexibility identical time, input mode identifying unit 130 is defined as analog mouse, and the mobile vector of moving direction determination mouse according to single finger; Particularly, as shown in Figure 6, when the sensor on thumb, forefinger, middle finger detect these three digital flexion degree roughly the same or become to close up state time, input mode identifying unit 130 determines that gesture identifying device 100 is for analog mouse; Next, as shown in Figure 7, input content generation unit 140 carrys out the moving direction of analog mouse according to the movement of a finger.
The technique scheme adopting the present embodiment to provide, at least can obtain the one in following beneficial effect:
1, according to the information of input mode identifying unit identification, at least one the input mode of corresponding hardware operation can be simulated from the input method of simulating keyboard, analog functuion key, analog mouse, namely can complete by gesture analogue means the function that in prior art, multiple hardware unit just can complete, and generate concrete content of operation according to input content generation unit, such gesture identifying device can input content quickly and accurately by the basis that do not increase hardware cost greatly enriching gesture input mode, improves user friendly.
2, further, five input areas on the movable information of five of left hand finger respective sensor identification and the corresponding keyboard of angle change information, each letter respectively in corresponding each region of the movable information of five of user's right hand finger respective sensor identification and angle change information or stroke, like this can by which better gesture identifying device in conjunction with existing input through keyboard custom and language generation pattern; Similar all right analog functuion key and mouse; Gesture identification not only can be allowed to be combined with specific computing machine, mobile terminal, game console, can also to allow the invention provides gesture identifying device and be combined with existing electronic equipment better.
3, further, only also can also can be realized the input of keyboard by two fingers according to predetermined action, so greatly save the hardware cost of gesture identifying device.
On the other hand, as shown in Figure 9, the present embodiment also provides a kind of gesture identification method, and the method comprises:
The result that S101, acquisition sensor detect:
Detect and be worn on the finger of user and/or the movable information of bracelet upper sensor and angle change information.
S102, determine simulated operation mode:
The movable information detected according to sensor and angle change information, from Simulation of keyboard input, analog functuion key, analog mouse, determine a kind of simulated operation mode needing to input.
S103, continuation obtain the result that sensor detects:
According to the simulated operation mode after determining, continue to detect and be worn on the finger of user and/or the movable information of bracelet upper sensor and angle change information.
S104, generation input information:
The further movable information detected according to sensor and angle change information, generate corresponding input position on keyboard or the switching of function key or the input information of mouse moving direction; And by input information transmission to outside electronic installation, and will be applied in concrete application program.
Preferably, in step S102, when user right-hand man there being respectively finger recognized movable information and angle change information by respective sensor, input mode identifying unit is defined as the input method of simulating keyboard; And five input areas on the movable information of five of user's left hand fingers respective sensor identification and the corresponding keyboard of angle change information, each letter respectively in corresponding each region of the movable information of five of user's right hand finger respective sensor identification and angle change information or stroke, input content generation unit is according to the assembled state input of left-hand finger and right finger.
Preferably, in step S102, when the sensor of two on user's left hand or the right hand recognize respective finger flexibility be greater than other three finger time, input mode identifying unit is defined as the switching of function key, and be greater than the array mode of two fingers of other three fingers according to differently curved degree, switch different function keys.
Preferably, in step S102, when the sensor of five on user's left hand or the right hand recognize at least three sensors recognize respective finger flexibility identical time, or when finger moves around pre-determined number, input mode identifying unit is defined as analog mouse, and the mobile vector of moving direction determination mouse according to single finger.
Adopt the above-mentioned gesture identification method that the present embodiment provides, the interactive information that the hardware devices such as keyboard, function key, mouse just can complete can be simulated rapidly, and only need finger according to predetermined rule, and just can complete the content of input, easy to operate, quick.
The third aspect, the present invention also provides a kind of gesture recognition system, comprising:
Gesture identifying device described above, and with gesture identifying device by electronic installation that is wireless or wired connection, this electronic installation can be computing machine, mobile phone, panel computer, household electrical appliance, office appliances, vehicle interior device, game console, moves and one in amusement equipment; But be not limited to these electronic installations.
Embodiment two
The present embodiment provides gesture identifying device, gesture identification mode, gesture recognition system equally; And be provided with the assembly identical with embodiment one or parts in these devices, system, such as identical with embodiment one induction installation, input mode judging unit, input content generation unit.But the present embodiment and embodiment one difference are, input mode judging unit, input content generation unit are not be arranged in gesture identifying device, but arrange in an electronic.Particularly, as shown in Figure 10, the present embodiment provides a kind of gesture recognition system 200, and this system comprises:
Gesture identifying device, gesture identifying device comprises the induction installation 210 for responding to user's gesture motion, induction installation 210 comprises and is arranged at least one sensor corresponding with finger position, and sensor is for identifying that motion finger is relative to the movable information of other fingers and angle change information;
With sensor by electronic installation 220 that is wireless or wired connection, and electronic installation 220 can obtain finger motion information and angle change information that sensor detects;
Wherein, electronic installation is still provided with input mode identifying unit 221 and input content generation unit 222;
Input mode identifying unit 221 is for detecting that according at least one sensor gesture motion information and angle change information judge the input mode that recognition device needs, and wherein input mode comprises at least one in the input method of simulating keyboard, analog functuion key, analog mouse and simulates the input mode of corresponding hardware operation;
When input mode identifying unit determines the input mode needed, input mode generation unit 222 detects gesture motion information and angle change information according at least one sensor, respectively the corresponding one input information generated in corresponding input position on keyboard, the switching of function key, mouse moving direction.
Adopt the gesture recognition system that the present embodiment provides, be worn on user's sensor on hand and only can need the movable information and angle change information that can identify and point relative to other fingers, and by this information feed back to electronic installation, electronic installation completes the parsing to input content by built-in input mode identifying unit and input content generation unit, so the functional requirement of wearing user's detection part on hand can be simplified, and electronic installation can configure larger volume, the powerful processor of calculation function completes the work of input mode identifying unit and input content generation unit, make gesture recognition system cost low, and recognition accuracy is high.
Embodiment three
Embodiment three is reduced the number of sensors that finger is worn on the basis of embodiment one or embodiment two.
Preferably, gesture identifying device is provided with two sensors corresponding respectively with two finger positions, point in input through keyboard region corresponding to different moving range when one of them sensor detects, another sensor input in each region each letter or stroke, input content generation unit is according to the assembled state input of left-hand finger and right finger.Particularly, selected zone can be carried out at the move angle of specific direction or carry out selected zone at mobile specific range by a finger, another finger selects letter/stroke by the move angle of specific direction, or mobile specific range selects letter/stroke.
Preferably, can also by finger move around pre-determined number time, analog input mode is set to mouse mode.
Adopt the technique scheme in the present embodiment, except can obtaining the analog input effect in embodiment one or embodiment two, number of sensors can also be reduced further, thus reduce customer using cost.
Finally it should be noted that, above-mentioned explanation is only most preferred embodiment of the present invention, not does any pro forma restriction to the present invention.Any those of ordinary skill in the art; do not departing within the scope of technical solution of the present invention; the way of above-mentioned announcement and technology contents all can be utilized to make many possible variations and simple replacement etc. to technical solution of the present invention, and these all belong to the scope of technical solution of the present invention protection.

Claims (13)

1. a gesture identifying device, on the finger that this gesture identifying device is removably worn on user and/or bracelet, it is characterized in that, described gesture identifying device comprises:
Be arranged at least one sensor corresponding with finger position, described sensor is for identifying that motion finger is relative to other movable information pointed and angle change information;
Input mode identifying unit, for detecting that gesture motion information and angle change information judge the input mode that described recognition device needs according at least one sensor described, wherein said input mode comprises at least one in the input method of simulating keyboard, analog functuion key, analog mouse and simulates the input mode of corresponding hardware operation;
Input content generation unit, when described input mode identifying unit determines the input mode needed, described input content generation unit detects gesture motion information and angle change information according at least one sensor described, respectively the corresponding one input information generated in corresponding input position on keyboard, the switching of function key, mouse moving direction.
2. device according to claim 1, is characterized in that, five fingers on user right-hand man are respectively arranged with described sensor, and the bracelet of user are also provided with information transmission unit and described sensor; Wherein, described information transmission unit, the electronic equipment that the input information transmission for being generated by described input content generation unit is extremely outside; Sensor on sensor on described finger and described bracelet can be connected to described information transmission unit by wired or wireless network.
3. device according to claim 2, is characterized in that, the sensor on described bracelet for identifying the angle of user's finger tilt, and calculates the degree of fatigue of user according to described angle of inclination.
4. device according to claim 2, is characterized in that, when user right-hand man there being respectively finger recognized movable information and angle change information by respective sensor, described input mode identifying unit is defined as the input method of simulating keyboard.
5. device according to claim 4, it is characterized in that, five input areas on the movable information of five of described user's left hand finger respective sensor identification and the corresponding keyboard of angle change information, each letter respectively in corresponding each region of the movable information of five of described user's right hand finger respective sensor identification and angle change information or stroke, described input content generation unit is according to the assembled state input of left-hand finger and right finger.
6. device according to claim 2, it is characterized in that, when the sensor of two on user's left hand or the right hand recognize respective finger flexibility be greater than other three finger time, described input mode identifying unit is defined as the switching of function key, and be greater than the array mode of two fingers of other three fingers according to differently curved degree, switch different function keys.
7. device according to claim 2, it is characterized in that, when the sensor of five on user's left hand or the right hand recognize at least three sensors recognize respective finger flexibility identical time, or when finger moves around pre-determined number, described input mode identifying unit is defined as analog mouse, and the mobile vector of moving direction determination mouse according to single finger.
8. device according to claim 1, it is characterized in that, described device is provided with two sensors corresponding respectively with two finger positions, point in input through keyboard region corresponding to different moving range when one of them sensor detects, another sensor input in each region each letter or stroke, described input content generation unit is according to the assembled state input of left-hand finger and right finger.
9. a gesture identification method, is characterized in that: described method comprises:
Detect and be worn on the finger of user and/or the movable information of bracelet upper sensor and angle change information;
The movable information detected according to sensor and angle change information, from Simulation of keyboard input, analog functuion key, analog mouse, determine a kind of simulated operation mode needing to input;
According to the simulated operation mode after determining, continue to detect and be worn on the finger of user and/or the movable information of bracelet upper sensor and angle change information;
The further movable information detected according to sensor and angle change information, generate corresponding input position on keyboard or the switching of function key or the input information of mouse moving direction.
10. method according to claim 9, is characterized in that,
When user right-hand man there being respectively finger recognized movable information and angle change information by respective sensor, described input mode identifying unit is defined as the input method of simulating keyboard; And five input areas on the movable information of five of described user's left hand fingers respective sensor identification and the corresponding keyboard of angle change information, each letter respectively in corresponding each region of the movable information of five of described user's right hand finger respective sensor identification and angle change information or stroke, described input content generation unit is according to the assembled state input of left-hand finger and right finger.
11. methods according to claim 9, is characterized in that,
When the sensor of two on user's left hand or the right hand recognize respective finger flexibility be greater than other three finger time, described input mode identifying unit is defined as the switching of function key, and be greater than the array mode of two fingers of other three fingers according to differently curved degree, switch different function keys.
12. methods according to claim 9, is characterized in that,
When the sensor of five on user's left hand or the right hand recognize at least three sensors recognize respective finger flexibility identical time, or when finger moves around pre-determined number, described input mode identifying unit is defined as analog mouse, and the mobile vector of moving direction determination mouse according to single finger.
13. 1 kinds of gesture recognition systems, is characterized in that, described system comprises:
Be arranged at least one sensor corresponding with finger position, described sensor is for identifying that motion finger is relative to other movable information pointed and angle change information;
The electronic installation be connected with described sensor, and described electronic installation can obtain finger motion information and angle change information that described sensor detects;
Wherein, described electronic installation is still provided with input mode identifying unit and input content generation unit;
Described input mode identifying unit is used for detecting that gesture motion information and angle change information judge the input mode that described recognition device needs according at least one sensor described, and wherein said input mode comprises at least one in the input method of simulating keyboard, analog functuion key, analog mouse and simulates the input mode of corresponding hardware operation;
When described input mode identifying unit determines the input mode needed, described input mode generation unit detects gesture motion information and angle change information according at least one sensor described, respectively the corresponding one input information generated in corresponding input position on keyboard, the switching of function key, mouse moving direction.
CN201510587921.7A 2014-09-15 2015-09-15 Hand gesture recognition device, hand gesture recognition method and hand gesture recognition system Pending CN105138136A (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US201462071076P 2014-09-15 2014-09-15
US62/071,076 2014-09-15

Publications (1)

Publication Number Publication Date
CN105138136A true CN105138136A (en) 2015-12-09

Family

ID=54723507

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510587921.7A Pending CN105138136A (en) 2014-09-15 2015-09-15 Hand gesture recognition device, hand gesture recognition method and hand gesture recognition system

Country Status (1)

Country Link
CN (1) CN105138136A (en)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107885337A (en) * 2017-12-20 2018-04-06 陈瑞环 A kind of data inputting method and its device based on fingering identification
CN107886686A (en) * 2016-09-30 2018-04-06 中兴通讯股份有限公司 A kind of work fatigue based reminding method, device and system
CN108196696A (en) * 2018-01-02 2018-06-22 京东方科技集团股份有限公司 A kind of wearable input unit, host, input method and electronic system
CN109032395A (en) * 2018-09-07 2018-12-18 成都意取新然餐饮管理有限公司 A kind of various dimensions Intelligent control device and method
CN112328156A (en) * 2020-11-12 2021-02-05 维沃移动通信有限公司 Input device control method and device and electronic device
CN112328100A (en) * 2019-07-31 2021-02-05 意法半导体股份有限公司 Digital pen-like device and gesture recognition system and method for corresponding digital pen-like device

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102622083A (en) * 2012-02-24 2012-08-01 北京盈胜泰科技术有限公司 Hand gesture recognition method and hand gesture recognition device
CN103793057A (en) * 2014-01-26 2014-05-14 华为终端有限公司 Information processing method, device and equipment
US20150242118A1 (en) * 2014-02-22 2015-08-27 Xiaomi Inc. Method and device for inputting

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102622083A (en) * 2012-02-24 2012-08-01 北京盈胜泰科技术有限公司 Hand gesture recognition method and hand gesture recognition device
CN103793057A (en) * 2014-01-26 2014-05-14 华为终端有限公司 Information processing method, device and equipment
US20150242118A1 (en) * 2014-02-22 2015-08-27 Xiaomi Inc. Method and device for inputting

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107886686A (en) * 2016-09-30 2018-04-06 中兴通讯股份有限公司 A kind of work fatigue based reminding method, device and system
CN107886686B (en) * 2016-09-30 2021-04-20 中兴通讯股份有限公司 Work fatigue reminding method, device and system
CN107885337A (en) * 2017-12-20 2018-04-06 陈瑞环 A kind of data inputting method and its device based on fingering identification
CN107885337B (en) * 2017-12-20 2024-03-08 陈瑞环 Information input method and device based on fingering identification
CN108196696A (en) * 2018-01-02 2018-06-22 京东方科技集团股份有限公司 A kind of wearable input unit, host, input method and electronic system
CN109032395A (en) * 2018-09-07 2018-12-18 成都意取新然餐饮管理有限公司 A kind of various dimensions Intelligent control device and method
CN109032395B (en) * 2018-09-07 2023-07-04 成都意取新然餐饮管理有限公司 Multi-dimensional intelligent control device and method
CN112328100A (en) * 2019-07-31 2021-02-05 意法半导体股份有限公司 Digital pen-like device and gesture recognition system and method for corresponding digital pen-like device
CN112328100B (en) * 2019-07-31 2024-04-09 意法半导体股份有限公司 Digital pen-like device and gesture recognition system and method of corresponding digital pen-like device
CN112328156A (en) * 2020-11-12 2021-02-05 维沃移动通信有限公司 Input device control method and device and electronic device

Similar Documents

Publication Publication Date Title
CN105138136A (en) Hand gesture recognition device, hand gesture recognition method and hand gesture recognition system
JP5784003B2 (en) Multi-telepointer, virtual object display device, and virtual object control method
US10705619B2 (en) System and method for gesture based data and command input via a wearable device
CN105005376B (en) Haptic device incorporating stretch properties
KR101877823B1 (en) Method, apparatus, and device for information processing
WO2012070682A1 (en) Input device and control method of input device
JP7150108B2 (en) Game program, information processing device, information processing system, and game processing method
CN106104421A (en) A kind of finger ring type wireless finger sense controller, control method and control system
JP2009048600A (en) Inertia detection input controller, receiver, and interactive system thereof
CN103823548B (en) Electronic equipment, wearable device, control system and method
EP3096206A1 (en) Haptic effects based on predicted contact
CN105278699A (en) Easy-wearable gesture identification device
KR101328385B1 (en) Tactile finger tip mouse and operating method of the same
US20140218315A1 (en) Gesture input distinguishing method and apparatus in touch input device
CN105518588B (en) A kind of touch operation method, touch control operation component and electronic equipment
CN105204645A (en) Easy-wearing gesture identification device
CN104460307A (en) Input unit of integrated display area, wearable intelligent device and input method
KR20160097410A (en) Method of providing touchless input interface based on gesture recognition and the apparatus applied thereto
KR20130051722A (en) Apparatus and method for inputting
WO2012111227A1 (en) Touch input device, electronic apparatus, and input method
CN110780732A (en) Input system based on space positioning and finger clicking
US10338692B1 (en) Dual touchpad system
CN105117026A (en) Gesture recognition device with self-checking function and self-checking method of gesture recognition device
CN103777783B (en) Contact control mouse and use method in contact control mouse
CN103809846A (en) Function calling method and electronic equipment

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
AD01 Patent right deemed abandoned
AD01 Patent right deemed abandoned

Effective date of abandoning: 20181023