CN105739902B - Gesture recognition system and method - Google Patents
Gesture recognition system and method Download PDFInfo
- Publication number
- CN105739902B CN105739902B CN201610080002.5A CN201610080002A CN105739902B CN 105739902 B CN105739902 B CN 105739902B CN 201610080002 A CN201610080002 A CN 201610080002A CN 105739902 B CN105739902 B CN 105739902B
- Authority
- CN
- China
- Prior art keywords
- gesture
- operating
- default
- operating gesture
- user
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 30
- 230000033001 locomotion Effects 0.000 claims description 15
- 230000005540 biological transmission Effects 0.000 claims description 9
- 230000036410 touch Effects 0.000 description 5
- 230000006870 function Effects 0.000 description 3
- 230000009286 beneficial effect Effects 0.000 description 2
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention discloses a gesture recognition system and a method, wherein the method comprises the following steps: receiving a user input instruction and sending a broadcast notification for entering a gesture recognition mode in response to the condition that the user input instruction is matched with a first preset instruction; drawing a transparent signal receiving window on the top layer of the system; capturing an operation gesture of a user through a signal receiving window; matching the operation gesture of the user with the associated prestored operation gesture, and then obtaining and executing an operation instruction corresponding to the prestored operation gesture matched with the operation gesture; receiving a user input instruction and sending a broadcast notification for exiting the gesture recognition mode in response to the condition that the user input instruction is matched with a second preset instruction; the signal reception window is deleted. The method can well judge and obtain the operation instruction corresponding to the operation gesture of the user and execute the operation instruction, does not cause misoperation, has high identification accuracy and high user friendliness, and can be widely applied to the control industry of intelligent equipment.
Description
Technical field
The present invention relates to the touch-control fields of smart machine, more particularly to a kind of gesture recognition system and method.
Background technique
The gesture identification function of the intelligent touchs equipment such as mobile phone, large scale tablet computer on the market is all very coarse at present
, for example set the gesture that the five fingers grab in ipad and be used to close current application program, this design can be answered according at current
The gesture of the five fingers crawl can not be utilized with program.For another example certain tablet computer, set by two refer to horizontal oarsman's gesture can with screenshotss,
If it is operation for executing F.F. that application program being currently running itself, which sets horizontal stroke of two fingers, then when user makes this
When gesture, be unable to judge accurately user is intended that screenshotss operation or forwarding operation.Generally speaking, current gesture identification system
The disadvantage of system is, since the operating system of intelligent touch equipment and various application programs are directed to same gesture and may set
Different operational orders, when user being caused to execute gesture, system can not judge the real intention of user well, it is difficult to accurate
Ground obtains relevant operational order, easily causes maloperation, user friendly is poor.
Summary of the invention
In order to solve the above technical problems, the object of the present invention is to provide a kind of gesture recognition systems, and of the invention is another
One purpose is to provide a kind of gesture identification method.
The technical solution adopted by the present invention to solve the technical problems is:
A kind of gesture recognition system, comprising:
First parsing module, for receiving user input instruction and in response to user input instruction and the first preset instructions
With the case where, be transmitted into hand gesture recognition mode broadcast notice；
First broadcast process module is drawn for notifying in response to the broadcast for entering hand gesture recognition mode in the top layer of system
It makes a transparent signal and receives window；
Gesture-capture module, for receiving the operating gesture that window captures user by signal；
Signal processing module is obtained for prestoring after operating gesture matches the operating gesture of user with associated
It obtains and prestores operational order corresponding to operating gesture and execution with what the operating gesture matched；
Second parsing module, for receiving user input instruction and in response to user input instruction and the second preset instructions
With the case where, send exit hand gesture recognition mode broadcast notice；
Second broadcast process module deletes signal reception for notifying in response to the broadcast for exiting hand gesture recognition mode
Window.
Further, first preset instructions include that the first default gesture, the first default voice or the first default shake are moved
Make, second preset instructions include the second default gesture, the second default voice or the second default shaking motion.
Further, to be two fingers turn left horizontal stroke of gesture the described first default gesture from the right side, and the second default gesture is more
Point at the gesture of circle.
Further, the associated operating gesture that prestores is the application program being currently executing according to system and is associated with
's.
Further, the signal processing module is specifically used for:
The operating gesture of user is prestored after operating gesture matches with associated, is obtained and the operating gesture phase
It is corresponding to execute after that matches prestores operating gesture, and then what is matched described in acquisition prestores the corresponding operational order of operating gesture
Screenshotss increase volume, reduce volume, play next track, play last track, open camera or close the behaviour of current application program
It instructs.
Another technical solution adopted by the present invention to solve the technical problem thereof is that:
A kind of gesture identification method, comprising:
S1, user input instruction is received and the case where match in response to user input instruction with the first preset instructions, transmission
Broadcast into hand gesture recognition mode notifies；
S2, it is notified in response to the broadcast for entering hand gesture recognition mode, draws a transparent signal in the top layer of system and receive
Window；
S3, the operating gesture that window captures user is received by signal；
S4, the operating gesture of user is prestored after operating gesture matches with associated, is obtained and the operating gesture
What is matched prestores operational order corresponding to operating gesture and execution；
S5, user input instruction is received and the case where match in response to user input instruction with the second preset instructions, transmission
Exit the broadcast notice of hand gesture recognition mode；
S6, it is notified in response to the broadcast for exiting hand gesture recognition mode, deletes the signal and receive window.
Further, the first preset instructions described in the step S1 include the first default gesture, the first default voice or the
One default shaking motion, the second preset instructions described in the step S5 include the second default gesture, the second default voice or the
Two default shaking motions.
Further, to be two fingers turn left horizontal stroke of gesture the described first default gesture from the right side, and the second default gesture is more
Point at the gesture of circle.
Further, the associated operating gesture that prestores described in the step S4 is answering of being currently executing according to system
It is associated with program.
Further, the step S4, specifically:
The operating gesture of user is prestored after operating gesture matches with associated, is obtained and the operating gesture phase
It is corresponding to execute after that matches prestores operating gesture, and then what is matched described in acquisition prestores the corresponding operational order of operating gesture
Screenshotss increase volume, reduce volume, play next track, play last track, open camera or close the behaviour of current application program
It instructs.
The beneficial effects of the present invention are: a kind of gesture recognition system of the invention, comprising: the first parsing module, for connecing
The case where receiving user input instruction and matching in response to user input instruction with the first preset instructions, is transmitted into gesture identification mould
The broadcast of formula notifies；First broadcast process module, for being notified in response to the broadcast for entering hand gesture recognition mode, on the top of system
Layer draws a transparent signal and receives window；Gesture-capture module, for receiving the manipulator that window captures user by signal
Gesture；Signal processing module obtains and should for prestoring after operating gesture matches the operating gesture of user with associated
What operating gesture matched prestores operational order corresponding to operating gesture and execution；Second parsing module, for receiving user
The wide of hand gesture recognition mode is exited in the case where input is instructed and matched in response to user input instruction with the second preset instructions, transmission
Broadcast notice；Second broadcast process module deletes the signal reception window for notifying in response to the broadcast for exiting hand gesture recognition mode
Mouthful.This gesture recognition system can judge well and obtain the corresponding operational order of operating gesture of user and execute, will not
Cause maloperation, recognition accuracy is high, and user friendly is high.
Another beneficial effect of the present invention is: a kind of gesture identification method of the invention, comprising: S1, receive user's input
The case where instructing and matching in response to user input instruction with the first preset instructions, the broadcast for being transmitted into hand gesture recognition mode are logical
Know；S2, it is notified in response to the broadcast for entering hand gesture recognition mode, draws a transparent signal in the top layer of system and receive window；
S3, the operating gesture that window captures user is received by signal；S4, the operating gesture of user is prestored into manipulator with associated
After gesture is matched, obtains and prestore operational order corresponding to operating gesture and execution with what the operating gesture matched；S5, it connects
The case where receiving user input instruction and matching in response to user input instruction with the second preset instructions, gesture identification mould is exited in transmission
The broadcast of formula notifies；S6, it is notified in response to the broadcast for exiting hand gesture recognition mode, deletes the signal and receive window.This gesture is known
Other method can judge well and obtain the corresponding operational order of operating gesture of user and execute, and will not cause maloperation,
Recognition accuracy is high, and user friendly is high.
Detailed description of the invention
Present invention will be further explained below with reference to the attached drawings and examples.
Fig. 1 is a kind of flow chart of gesture identification method of the invention.
Specific embodiment
The present invention provides a kind of gesture recognition systems, comprising:
First parsing module, for receiving user input instruction and in response to user input instruction and the first preset instructions
With the case where, be transmitted into hand gesture recognition mode broadcast notice；
First broadcast process module is drawn for notifying in response to the broadcast for entering hand gesture recognition mode in the top layer of system
It makes a transparent signal and receives window；
Gesture-capture module, for receiving the operating gesture that window captures user by signal；
Signal processing module is obtained for prestoring after operating gesture matches the operating gesture of user with associated
It obtains and prestores operational order corresponding to operating gesture and execution with what the operating gesture matched；
Second parsing module, for receiving user input instruction and in response to user input instruction and the second preset instructions
With the case where, send exit hand gesture recognition mode broadcast notice；
Second broadcast process module deletes signal reception for notifying in response to the broadcast for exiting hand gesture recognition mode
Window.
It is further used as preferred embodiment, first preset instructions include the first default gesture, the first default language
Sound or the first default shaking motion, second preset instructions include that the second default gesture, the second default voice or second are default
Shaking motion.
It is further used as preferred embodiment, the first default gesture is two fingers turns left horizontal stroke of gesture from the right side, institute
State the second default gesture is the gesture for pointing at circle more.
It is further used as preferred embodiment, the associated operating gesture that prestores currently is being held according to system
Capable application program and it is associated.
It is further used as preferred embodiment, the signal processing module is specifically used for:
The operating gesture of user is prestored after operating gesture matches with associated, is obtained and the operating gesture phase
It is corresponding to execute after that matches prestores operating gesture, and then what is matched described in acquisition prestores the corresponding operational order of operating gesture
Screenshotss increase volume, reduce volume, play next track, play last track, open camera or close the behaviour of current application program
It instructs.
Be further used as preferred embodiment, the signal processing module is specifically used for: by the operating gesture of user with
It is associated to prestore after operating gesture matched, it obtains and prestores operating gesture with what the operating gesture matched, when the phase
It is matched when to prestore operating gesture be horizontal from left to right stroke of two fingers of gesture, the operational order of screenshotss and execution are obtained, when described
When what is matched prestores the gesture that operating gesture is upward sliding, obtains increase volume operation and instruct and execute, when the phase
When that matches prestores the gesture that operating gesture is slide downward, obtains and reduce volume operation and instruct and execute, match when described
When to prestore operating gesture be the gesture slided to the left, the operational order for playing next track and execution are obtained, matched when described
When to prestore operating gesture be the gesture slided to the right, the operational order for playing last track and execution are obtained, matched when described
When to prestore operating gesture be the five fingers mobile gesture, the operational order for opening camera and execution are obtained, matched when described
When prestoring the gesture that operating gesture is the five fingers crawl, the operational order for closing current application program and execution are obtained.
Referring to Fig.1, the present invention also provides a kind of gesture identification methods, comprising:
S1, user input instruction is received and the case where match in response to user input instruction with the first preset instructions, transmission
Broadcast into hand gesture recognition mode notifies；
S2, it is notified in response to the broadcast for entering hand gesture recognition mode, draws a transparent signal in the top layer of system and receive
Window；
S3, the operating gesture that window captures user is received by signal；
S4, the operating gesture of user is prestored after operating gesture matches with associated, is obtained and the operating gesture
What is matched prestores operational order corresponding to operating gesture and execution；
S5, user input instruction is received and the case where match in response to user input instruction with the second preset instructions, transmission
Exit the broadcast notice of hand gesture recognition mode；
S6, it is notified in response to the broadcast for exiting hand gesture recognition mode, deletes the signal and receive window.
It is further used as preferred embodiment, the first preset instructions described in the step S1 include the first default hand
Gesture, the first default voice or the first default shaking motion, the second preset instructions described in the step S5 include the second default hand
Gesture, the second default voice or the second default shaking motion.
It is further used as preferred embodiment, the first default gesture is two fingers turns left horizontal stroke of gesture from the right side, institute
State the second default gesture is the gesture for pointing at circle more.
It is further used as preferred embodiment, the associated operating gesture that prestores is according to being described in the step S4
The application program that is currently executing of uniting and it is associated.
It is further used as preferred embodiment, the step S4, specifically:
The operating gesture of user is prestored after operating gesture matches with associated, is obtained and the operating gesture phase
It is corresponding to execute after that matches prestores operating gesture, and then what is matched described in acquisition prestores the corresponding operational order of operating gesture
Screenshotss increase volume, reduce volume, play next track, play last track, open camera or close the behaviour of current application program
It instructs.
Be further used as preferred embodiment, the step S4, specifically: by the operating gesture of user with it is associated
Prestore after operating gesture matched, obtain and prestore operating gesture with what the operating gesture matched, match when described
When prestoring the gesture that operating gesture is horizontal from left to right stroke of two fingers, the operational order of screenshotss and execution are obtained, is matched when described
Prestore operating gesture be upward sliding gesture when, obtain increase volume operation instruct and execute, when it is described match it is pre-
Deposit operating gesture be slide downward gesture when, obtain reduce volume operation instruct and execute, when it is described match prestore behaviour
Make a sign with the hand for slide to the left gesture when, obtain play next track operational order and execution, when it is described match prestore behaviour
Make a sign with the hand for slide to the right gesture when, obtain play last track operational order and execution, when it is described match prestore behaviour
When making a sign with the hand as the mobile gesture of the five fingers, obtain the operational order for opening camera and execution, when it is described match prestore behaviour
Make a sign with the hand for the five fingers crawl gesture when, obtain close current application program operational order and execution.
It elaborates below in conjunction with specific embodiment to the present invention.
Embodiment one
A kind of gesture recognition system, comprising:
First parsing module, for receiving user input instruction and in response to user input instruction and the first preset instructions
With the case where, be transmitted into hand gesture recognition mode broadcast notice；
First broadcast process module is drawn for notifying in response to the broadcast for entering hand gesture recognition mode in the top layer of system
It makes a transparent signal and receives window；
Gesture-capture module, for receiving the operating gesture that window captures user by signal；
Signal processing module is obtained for prestoring after operating gesture matches the operating gesture of user with associated
It obtains and prestores operational order corresponding to operating gesture and execution with what the operating gesture matched；
Second parsing module, for receiving user input instruction and in response to user input instruction and the second preset instructions
With the case where, send exit hand gesture recognition mode broadcast notice；
Second broadcast process module deletes signal reception for notifying in response to the broadcast for exiting hand gesture recognition mode
Window.
First preset instructions include the first default gesture, the first default voice or the first default shaking motion, and second is default
Instruction includes the second default gesture, the second default voice or the second default shaking motion.For example, first is default in the present embodiment
Gesture is two fingers turns left horizontal stroke of gesture from the right side, and the second default gesture is the gestures for pointing at circle more.First preset instructions are for touching
Hair enters hand gesture recognition mode, and the second preset instructions exit hand gesture recognition mode for triggering, may be set to be corresponding language
Message breath or specific shaking motion.
The associated operating gesture that prestores is the application program being currently executing according to system and associated, such as system
Backstage is playing music, then the associated operating gesture that prestores is in addition to other than the relevant gesture such as conventional screenshotss operation,
It must also include and play the instruction corresponding operation gesture of music, and so on.It is detailed, it is associated in the present embodiment
Operating gesture is prestored to include screenshotss, increase volume, reduce volume, play next track, play last track, open camera and closing
The corresponding operating gesture of the operational order of current application program.Signal processing module is specifically used for: by the operating gesture of user
It is prestored after operating gesture matched with associated, obtains and prestore operating gesture with what the operating gesture matched, and then obtain
Take it is described match prestore the corresponding operational order of operating gesture after, accordingly execute screenshotss, increase volume, reduce volume,
Next track is played, last track is played, open camera or closes the operational order of current application program.
More specifically, the present embodiment is corresponding with the operational order of screenshotss by horizontal from left to right stroke of two fingers of gesture, will be to
The gesture of upper sliding is corresponding with volume operation instruction is increased, and by the gesture of slide downward and reduces volume operation instruction relatively
It answers, the gesture slided to the left is corresponding with the operational order of next track is played, by the gesture slided to the right and play last track
Operational order it is corresponding, the mobile gesture of the five fingers is corresponding with the operational order of camera is opened, by the hand of the five fingers crawl
Gesture is corresponding with the operational order of current application program is closed.
In the present invention, the default gesture of first mentioned, the second default gesture and it is various prestore operating gesture, can be logical
Crossing software initialization is fixed gesture, is also possible to user according to any gesture of the customized setting of use habit.For example, this
In embodiment, the second default gesture is the gesture for pointing at circle more, closes the corresponding operation of operational order of current application program
Gesture is the gesture of the five fingers crawl, the two can also be exchanged, so that the second default gesture is the gesture of the five fingers crawl, is closed
The corresponding operating gesture of operational order for closing current application program is the gesture for pointing at circle more.
Correspondingly, signal processing module is specifically used for: by the operating gesture of user with it is associated prestore operating gesture into
After row matching, obtains and prestore operating gesture with what the operating gesture matched, when the operating gesture that prestores to match is double
When referring to horizontal from left to right stroke of gesture, the operational order of screenshotss and execution are obtained, when the operating gesture that prestores to match is
When the gesture of upward sliding, obtains increase volume operation and instruct and execute, when the operating gesture that prestores to match is downward
It when the gesture of sliding, obtains reduction volume operation and instructs and execute, when the operating gesture that prestores to match is to slide to the left
Gesture when, the operational order for playing next track and execution are obtained, when the operating gesture that prestores to match is to the right to slide
Gesture when, obtain play last track operational order and execution, when it is described match prestore operating gesture be the five fingers move
Gesture when, obtain open camera operational order and execution, when it is described match prestore operating gesture be the five fingers grab
Gesture when, obtain close current application program operational order and execution.
Using after this gesture recognition system, when receiving user input instruction and triggering into hand gesture recognition mode,
After receiving the operating gesture of window capture acquisition user by transparent signal and match, corresponding operation can be obtained
It instructs and executes.Due to it is increased be that transparent signal receives window, which receives the operating gesture that window only captures user,
The function that user normally checks the application program being currently running is not interfered with.And gesture knowledge is carried out by instruction triggers
After other mode, all operating gestures of window interception user are received using signal and parse the relevant operational order of acquisition, are not opened
It puts and is used to the application program being currently running, and exit hand gesture recognition mode receiving user input instruction and triggering
Afterwards, then the operating gesture that system receives is opened and is used to the application program being currently running.Therefore, using this gesture identification system
After system, can judge well and obtain operating gesture really be intended to and execute corresponding operational order, will not cause accidentally to grasp
Make, recognition accuracy is high, and user friendly is high.
And this gesture recognition system is carried out in the level of operating system, what is no matter be currently running is what is answered
With program, as long as receiving for triggering the input instruction for entering hand gesture recognition mode, i.e. triggering enters hand gesture recognition mode, most
Big facilitates user, especially when user is driving vehicle, can carry out blind operation, immediately enters gesture identification mould
Formula so that relevant operation instruction be performed quickly, such as adjusts volume of music size, adjusts air-conditioner temperature etc..
Embodiment two
Referring to Fig.1, a kind of gesture identification method, comprising:
S1, user input instruction is received and the case where match in response to user input instruction with the first preset instructions, transmission
Broadcast into hand gesture recognition mode notifies；
S2, it is notified in response to the broadcast for entering hand gesture recognition mode, draws a transparent signal in the top layer of system and receive
Window；Since the window management system of operating system is layering, closer to top layer, the priority for capturing touch event is got over
Height, therefore the present embodiment adds a transparent signal in the top of system and receives window, receives touch as first
The window of event no longer transmits to receive window reception touch event by the transparent signal and trigger corresponding operation
To next layer of window；
S3, the operating gesture that window captures user is received by signal；
S4, the operating gesture of user is prestored after operating gesture matches with associated, is obtained and the operating gesture
What is matched prestores operational order corresponding to operating gesture and execution；
S5, user input instruction is received and the case where match in response to user input instruction with the second preset instructions, transmission
Exit the broadcast notice of hand gesture recognition mode；
S6, it is notified in response to the broadcast for exiting hand gesture recognition mode, deletes the signal and receive window.
The first preset instructions include the first default gesture, the first default voice or the first default shaking motion in step S1,
The second preset instructions include the second default gesture, the second default voice or the second default shaking motion in step S5.For example, this reality
It applies in example, the first default gesture is two fingers turns left horizontal stroke of gesture from the right side, and the second default gesture is the gestures for pointing at circle more.First
Preset instructions enter hand gesture recognition mode for triggering, and the second preset instructions exit hand gesture recognition mode for triggering, can also be with
It is set as corresponding voice messaging or specific shaking motion.
The associated operating gesture that prestores is the application program being currently executing according to system and associated in step S4,
Such as system background is playing music, then it is associated prestore operating gesture in addition to the relevant hand such as conventional screenshotss operation
Except gesture, it is necessary to including with play music instruction corresponding operation gesture, and so on.It is detailed, in the present embodiment, phase
The associated operating gesture that prestores includes screenshotss, increases volume, reduce volume, play next track, play last track, open camera
Operating gesture corresponding with the operational order of current application program is closed.Signal processing module is specifically used for: by the behaviour of user
It makes a sign with the hand and is prestored after operating gesture matched with associated, obtain and prestore operating gesture with what the operating gesture matched,
And then after what is matched described in obtaining prestores the corresponding operational order of operating gesture, screenshotss are accordingly executed, increases volume, reduce
Volume plays next track, plays last track, opens camera or closes the operational order of current application program.
More specifically, the present embodiment the present embodiment is opposite with the operational order of screenshotss by horizontal from left to right stroke of two fingers of gesture
It answers, the gesture of upward sliding is corresponding with volume operation instruction is increased, the gesture of slide downward is referred to volume operation is reduced
Enable it is corresponding, by the gesture slided to the left with play the operational order of next track it is corresponding, by the gesture slided to the right and broadcasting
The operational order of last track is corresponding, and the mobile gesture of the five fingers is corresponding with the operational order of camera is opened, and the five fingers are grabbed
The gesture taken is corresponding with the operational order of current application program is closed.
Correspondingly, step S4, specifically:
The operating gesture of user is prestored after operating gesture matches with associated, is obtained and the operating gesture phase
That matches prestores operating gesture, when it is described match when to prestore operating gesture be horizontal from left to right stroke of two fingers of gesture, obtain and cut
The operational order of screen and execution, when it is described match when prestoring the gesture that operating gesture is upward sliding, obtain and increase volume
Operational order simultaneously executes, and when the gesture for prestoring operating gesture as slide downward to match, obtains and reduces volume operation
Instruct and execute, when it is described match when to prestore operating gesture be the gesture slided to the left, obtain the operation for playing next track
Instruct and execute, when it is described match when to prestore operating gesture be the gesture slided to the right, obtain the operation for playing last track
Instruct and execute, when it is described match when to prestore operating gesture be the five fingers mobile gesture, obtain the operation for opening camera
Instruct and execute, when it is described match prestore operating gesture be the five fingers crawl gesture when, obtain close current application program
Operational order and execution.
This gesture identification method, when receiving user input instruction and triggering into hand gesture recognition mode, by transparent
Signal receive window and capture the operating gesture for obtaining user and after matching, corresponding operational order can be obtained and held
Row.Due to it is increased be that transparent signal receives window, which receives the operating gesture that window only captures user, will not influence
The function for the application program being currently running normally is checked to user.And hand gesture recognition mode is carried out by instruction triggers
Afterwards, all operating gestures of window interception user are received and are parsed using signal and obtain relevant operational order, do not opened to working as
Before the application program that is currently running use, and after receiving user input instruction and triggering and exit hand gesture recognition mode, then will
The operating gesture that system receives is open to be used to the application program being currently running.Therefore, this gesture identification method can be fine
Ground judge and obtain operating gesture really be intended to and execute corresponding operational order, maloperation, recognition accuracy will not be caused
Height, and user friendly is high.
And this gesture identification method is carried out in the level of operating system, what is no matter be currently running is what is answered
With program, as long as receiving for triggering the input instruction for entering hand gesture recognition mode, i.e. triggering enters hand gesture recognition mode, most
Big facilitates user, especially when user is driving vehicle, can carry out blind operation, immediately enters gesture identification mould
Formula so that relevant operation instruction be performed quickly, such as adjusts volume of music size, adjusts air-conditioner temperature etc..
It is to be illustrated to preferable implementation of the invention, but the invention is not limited to the implementation above
Example, those skilled in the art can also make various equivalent variations on the premise of without prejudice to spirit of the invention or replace
It changes, these equivalent variation or replacement are all included in the scope defined by the claims of the present application.
Claims (6)
1. a kind of gesture recognition system characterized by comprising
First parsing module, for receive user input instruction and in response to user input instruction and the first preset instructions it is matched
Situation is transmitted into the broadcast notice of hand gesture recognition mode；
First broadcast process module draws one in the top layer of system for notifying in response to the broadcast for entering hand gesture recognition mode
Transparent signal receives window；
Gesture-capture module, for receiving the operating gesture that window captures user by signal；
Signal processing module, for the operating gesture of user to be prestored after operating gesture matches with associated, obtain with
What the operating gesture matched prestores operational order corresponding to operating gesture and execution, wherein described associated to prestore behaviour
It is the application program being currently executing according to system and associated for making a sign with the hand；
Second parsing module, for receive user input instruction and in response to user input instruction and the second preset instructions it is matched
Situation sends the broadcast notice for exiting hand gesture recognition mode；
Second broadcast process module deletes the signal and receives window for notifying in response to the broadcast for exiting hand gesture recognition mode；
First preset instructions include the first default gesture, the first default voice or the first default shaking motion, described second
Preset instructions include the second default gesture, the second default voice or the second default shaking motion.
2. a kind of gesture recognition system according to claim 1, which is characterized in that the first default gesture be two fingers from
The right side is turned left horizontal stroke of gesture, and the second default gesture is the gestures for pointing at circle more.
3. a kind of gesture recognition system according to claim 1, which is characterized in that the signal processing module is specifically used
In:
The operating gesture of user prestored after operating gesture matches with associated, obtains and matches with the operating gesture
Prestore operating gesture, and then after what is matched described in obtaining prestores the corresponding operational order of operating gesture, accordingly execute screenshotss,
Increase volume, the operation for reducing volume, broadcasting next track, broadcasting last track, opening camera or closing current application program refer to
It enables.
4. a kind of gesture identification method characterized by comprising
S1, it receives user input instruction and the case where match in response to user input instruction with the first preset instructions, is transmitted into
The broadcast of hand gesture recognition mode notifies；
S2, it is notified in response to the broadcast for entering hand gesture recognition mode, draws a transparent signal in the top layer of system and receive window；
S3, the operating gesture that window captures user is received by signal；
S4, the operating gesture of user is prestored after operating gesture matches with associated, is obtained and the operating gesture phase
That matches prestores operational order corresponding to operating gesture and execution；
S5, user input instruction is received and the case where match in response to user input instruction with the second preset instructions, transmission is exited
The broadcast of hand gesture recognition mode notifies；
S6, it is notified in response to the broadcast for exiting hand gesture recognition mode, deletes the signal and receive window；
The associated operating gesture that prestores described in the step S4 is the application program being currently executing according to system and closes
Connection；
First preset instructions described in the step S1 include that the first default gesture, the first default voice or the first default shake are moved
Make, the second preset instructions described in the step S5 include that the second default gesture, the second default voice or the second default shake are moved
Make.
5. a kind of gesture identification method according to claim 4, which is characterized in that the first default gesture be two fingers from
The right side is turned left horizontal stroke of gesture, and the second default gesture is the gestures for pointing at circle more.
6. a kind of gesture identification method according to claim 4, which is characterized in that the step S4, specifically:
The operating gesture of user prestored after operating gesture matches with associated, obtains and matches with the operating gesture
Prestore operating gesture, and then after what is matched described in obtaining prestores the corresponding operational order of operating gesture, accordingly execute screenshotss,
Increase volume, the operation for reducing volume, broadcasting next track, broadcasting last track, opening camera or closing current application program refer to
It enables.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610080002.5A CN105739902B (en) | 2016-02-04 | 2016-02-04 | Gesture recognition system and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610080002.5A CN105739902B (en) | 2016-02-04 | 2016-02-04 | Gesture recognition system and method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105739902A CN105739902A (en) | 2016-07-06 |
| CN105739902B true CN105739902B (en) | 2019-09-20 |
Family
ID=56245007
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610080002.5A Active CN105739902B (en) | 2016-02-04 | 2016-02-04 | Gesture recognition system and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105739902B (en) |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106527951A (en) * | 2016-11-16 | 2017-03-22 | 珠海格力电器股份有限公司 | Specified audio file playing method and apparatus, and electronic device |
| CN106843592A (en) * | 2017-02-17 | 2017-06-13 | 北京小米移动软件有限公司 | Touch control method and device and mobile terminal |
| CN107765853A (en) * | 2017-10-13 | 2018-03-06 | 广东欧珀移动通信有限公司 | Using method for closing, device, storage medium and electronic equipment |
| CN108958626A (en) * | 2018-06-29 | 2018-12-07 | 奇酷互联网络科技（深圳）有限公司 | Gesture identification method, device, readable storage medium storing program for executing and mobile terminal |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104081318A (en) * | 2011-11-30 | 2014-10-01 | 谷歌公司 | Turning on and off full screen mode on a touchscreen |
| CN105045458A (en) * | 2015-08-27 | 2015-11-11 | 宇龙计算机通信科技(深圳)有限公司 | Method, device and system for rapidly recording by mobile terminal |
| CN105278763A (en) * | 2015-05-28 | 2016-01-27 | 维沃移动通信有限公司 | Gesture recognition method and apparatus capable of preventing mistaken touch |
| CN105988691A (en) * | 2015-01-27 | 2016-10-05 | 阿里巴巴集团控股有限公司 | Gesture based service implementation method and device |
-
2016
- 2016-02-04 CN CN201610080002.5A patent/CN105739902B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104081318A (en) * | 2011-11-30 | 2014-10-01 | 谷歌公司 | Turning on and off full screen mode on a touchscreen |
| CN105988691A (en) * | 2015-01-27 | 2016-10-05 | 阿里巴巴集团控股有限公司 | Gesture based service implementation method and device |
| CN105278763A (en) * | 2015-05-28 | 2016-01-27 | 维沃移动通信有限公司 | Gesture recognition method and apparatus capable of preventing mistaken touch |
| CN105045458A (en) * | 2015-08-27 | 2015-11-11 | 宇龙计算机通信科技(深圳)有限公司 | Method, device and system for rapidly recording by mobile terminal |
Also Published As
| Publication number | Publication date |
|---|---|
| CN105739902A (en) | 2016-07-06 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11127398B2 (en) | Method for voice controlling, terminal device, cloud server and system | |
| CN105739902B (en) | Gesture recognition system and method | |
| CN105690385B (en) | Call method and device are applied based on intelligent robot | |
| CN111176960B (en) | User operation behavior tracking method, device, equipment and storage medium | |
| WO2018049812A1 (en) | Split-screen display method and device, and terminal | |
| CN103294347B (en) | Operation control method and device for video playing of mobile terminal browser and browser | |
| CN105760102B (en) | Terminal interaction control method and device and application program interaction control method | |
| CN109889885A (en) | A kind of throwing screen control method, terminal and computer readable storage medium | |
| CN104410883A (en) | Mobile wearable non-contact interaction system and method | |
| CN107102795A (en) | A kind of log recording method, mobile terminal and computer-readable recording medium | |
| KR102321562B1 (en) | Dynamic motion detection method, dynamic motion control method and apparatus | |
| CN108605165A (en) | The method and electronic equipment of video thumbnails are generated in the electronic device | |
| CN105396289A (en) | Method and device for achieving special effects in process of real-time games and multimedia sessions | |
| CN102591446A (en) | Gesture control display system and control method thereof | |
| CN109743504A (en) | A kind of auxiliary photo-taking method, mobile terminal and storage medium | |
| CN104750498A (en) | Method for controlling mouse module and electronic device | |
| US20170161011A1 (en) | Play control method and electronic client | |
| CN108491804A (en) | A kind of method, relevant apparatus and the system of chess game displaying | |
| CN106201265A (en) | A kind of mobile terminal control method based on WEB, Apparatus and system | |
| CN108536366A (en) | A kind of application window method of adjustment and terminal | |
| CN111158487A (en) | Man-machine interaction method for interacting with intelligent terminal by using wireless earphone | |
| US10088897B2 (en) | Method and electronic device for improving performance of non-contact type recognition function | |
| CN108845918A (en) | A kind of information collecting method, terminal and computer readable storage medium | |
| CN103955274A (en) | Application control method and device | |
| CN105446468A (en) | Manipulation mode switching method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20191209 Address after: Room 1601-252, No. 238, JIANGCHANG Third Road, Jing'an District, Shanghai 200040 Patentee after: Shanghai Xiaopeng Automobile Technology Co., Ltd Address before: 510006 Guangdong city of Guangzhou province Panyu District Xiaoguwei Street West outer ring road of Science Museum of Guangdong University of Technology No. 100 room 429431 Patentee before: GUANGZHOU CHENGXING ZHIDONG AUTOMOBILE SCIENCE & TECHNOLOGY CO., LTD. |