CN102200830A - Non-contact control system and control method based on static gesture recognition - Google Patents
Non-contact control system and control method based on static gesture recognition Download PDFInfo
- Publication number
- CN102200830A CN102200830A CN2010101345383A CN201010134538A CN102200830A CN 102200830 A CN102200830 A CN 102200830A CN 2010101345383 A CN2010101345383 A CN 2010101345383A CN 201010134538 A CN201010134538 A CN 201010134538A CN 102200830 A CN102200830 A CN 102200830A
- Authority
- CN
- China
- Prior art keywords
- gesture
- hand
- user
- identification
- video
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- User Interface Of Digital Computer (AREA)
Abstract
The invention provides a non-contact control system and a non-contact control method based on static gesture recognition. The non-contact control system based on the static gesture recognition comprises an image pickup unit, a processing unit and a target unit, wherein the image pickup unit shoots a video of a current user; the processing unit recognizes the gesture of the user from the video of the user shot by the image pickup unit, and converts the recognized gesture into a corresponding operation instruction; and the target unit performs operation according to the operation instruction of the processing unit. Thus, the simple and high-reliability real-time non-contact control system is realized.
Description
Technical field
The present invention relates to a kind of Touchless control system and control method based on static gesture identification.
Background technology
Yet gesture is a kind of from interpersonal communication model intuitively, and the control of carrying out based on gesture identification can be used to plurality of devices such as TV, computing machine, electronic whiteboard, electric advertisement screen.
In patent documentation 1, the apparatus control system of a kind of use based on gesture identification proposed, be used to replace the telepilot of existing televisor.Figure 12 is the synoptic diagram of this control system.When using this control system, the user can make to use gesture display is carried out straighforward operation across a segment distance.For example " triggering " gesture of user by system identification after, the icon on the display will followed moving of user's hand and moved, therefore, can be used for execution such as various operations and controls such as volume adjusting, channel switching, color adjustment, brightness regulation.
This apparatus control system comprises two parts: specific television camera and display.Specific television camera is used to take user's video, and this television camera also includes calculation element, is used to handle the video that photographs.In processing, this television camera at first removes the background in the video, discerns user's gesture then, produces corresponding instruction at last and allows display carry out.Display shows that then the result of identification also carries out the instruction from television camera.
Figure 13 is the process flow diagram of this apparatus control system.This apparatus control system is realized in the following manner: at first, taking original video, is image with this video decode.Afterwards, adopt background segment technology (background segmentation) that background is removed from image.In order to discern " triggering " gesture, adopt a kind of corresponding technology.In case " triggering " gesture is identified, then follows the tracks of it and move and control display.
But, in the above prior art shown in the patent documentation 1, exist the low problem of reliability.This is because in above technology, employing be that the background segment technology removes background from image, thus, system produces following problem sometimes.
(1) before system starts working, before the user can not rest on video camera.In fact, except background, any object all can not stop.Otherwise, big noise piece will appear.
(2) illumination should keep invariable.In case illumination changes, big noise can produce thereupon.Therefore, generally speaking, this system is unsuitable for Outdoor Scene.
(3) in the entire process process, video camera all must be fixing.And, all camera parameters, for example focal length, exposure and white balance etc. all must immobilize.
Patent documentation 1: U.S. Patent Application Publication US05594469A
Summary of the invention
The present invention finishes in view of reliability is low in the above-mentioned prior art problem, its purpose be to provide a kind of simple directly, Touchless control system and non-contact control method that reliability is high based on static gesture identification.
The present invention is a kind of Touchless control system based on static gesture identification, it is characterized in that having: image unit, shooting active user's video; Processing unit, identification user's gesture from the user's that taken by above-mentioned image unit video, and the gesture of being discerned is converted to corresponding operational order; Object element is according to the operational order executable operations of processing unit.
In addition, Touchless control system based on static gesture identification of the present invention, it is characterized in that: above-mentioned processing unit comprises gesture identification module and signal conversion module, above-mentioned gesture identification module identification user's from the user's that taken by above-mentioned image unit video gesture, above-mentioned signal conversion module is converted to the gesture of being discerned the corresponding operational order of carrying out for object element according to the corresponding relation of gesture with operational order.
In addition, Touchless control system based on static gesture identification of the present invention, it is characterized in that: above-mentioned processing unit also comprises hand detection module and hand tracking module, above-mentioned hand detection module detects user's hand from the user's that taken by above-mentioned image unit video, to comprise that information such as user's the position of hand and zone of living in send above-mentioned hand tracking module to, above-mentioned hand tracking module is according to information such as the position of the hand that comprises the user and zones of living in, to analyzing, obtain information about gesture from the video of image unit input.
In addition, Touchless control system based on static gesture identification of the present invention, it is characterized in that: above-mentioned hand tracking module is set up a tracker to each hand that is detected, above-mentioned tracker is according to information such as position that comprises hand and zones of living in, to analyzing, obtain information about the gesture of this hand from the video of image unit input.
In addition, Touchless control system based on static gesture identification of the present invention, it is characterized in that: above-mentioned gesture identification module is discerned user's gesture according to the information about gesture from above-mentioned hand tracking module, and the gesture result who is discerned is sent to above-mentioned signal conversion module.
In addition, the Touchless control system based on static gesture identification of the present invention, it is characterized in that: above-mentioned object element is any in televisor, computing machine, electronic whiteboard, the electric advertisement screen.
In addition, the Touchless control system based on static gesture identification of the present invention is characterized in that: above-mentioned gesture is the gesture of the numeral of expression 1～10.
In addition, the present invention still is a kind of non-contact control method based on static gesture identification, it is characterized in that, may further comprise the steps: the shooting step of taking active user's video; Identification user's gesture from the user's that above-mentioned shooting step, takes video, and the gesture of being discerned is converted to the treatment step of corresponding operational order; And, carry out the operation steps of corresponding operating according to the operational order of above-mentioned treatment step.
In addition, non-contact control method based on static gesture identification of the present invention, it is characterized in that: above-mentioned treatment step comprises gesture identification step and conversion of signals step, above-mentioned gesture identification step identification user's from the user's that above-mentioned shooting step, takes video gesture, above-mentioned conversion of signals step will be converted to corresponding operational order in the gesture of above-mentioned gesture identification step identification according to the corresponding relation of gesture with operational order.
In addition, non-contact control method based on static gesture identification of the present invention, it is characterized in that: above-mentioned treatment step comprises that also hand detects step and hand tracking step, above-mentioned hand detects step detects the user from the user's that takes video above-mentioned shooting step hand, obtain comprising user's the position of hand and the information in zone of living in, above-mentioned hand tracking step is according to the position of the hand that comprises the user that obtains in above-mentioned hand detection step and the information in zone of living in, analyze in the video to the user that in above-mentioned shooting step, takes, obtain information about gesture.
In addition, non-contact control method based on static gesture identification of the present invention, it is characterized in that: in above-mentioned hand tracking step, each hand that is detected is followed the tracks of respectively, information according to position that comprises hand and zone of living in, the video of taking in the shooting step is analyzed, obtained information about the gesture of this hand.
In addition, the non-contact control method based on static gesture identification of the present invention is characterized in that: in above-mentioned gesture identification step, and according to the information that in above-mentioned hand tracking step, obtains about gesture, identification user's gesture.
In addition, the non-contact control method based on static gesture identification of the present invention is characterized in that: the aforesaid operations instruction is the operational order of any execution in televisor, computing machine, electronic whiteboard, the electric advertisement screen.
In addition, the non-contact control method based on static gesture identification of the present invention is characterized in that: above-mentioned gesture is the gesture of the numeral of expression 1～10.
The invention effect
Above technical scheme of the present invention provides a kind of new solution reliably for the non-contact control based on static gesture identification.
The first, Touchless control system and method based on static gesture identification of the present invention are by image unit shooting user's live video, by analyzing this live video, automatic detection and tracking user's hand.In case a gesture comes across among the video, will be by Real time identification.Afterwards, the image that is identified is converted into operational order, carries out for object element.Therefore, the user can use a series of static gesture to come the controlled target unit and not need with object element any direct contact arranged.
Here, traditional background segment technology is replaced by new method of the present invention, therefore, and in the Touchless control system and method based on static gesture identification of the present invention, the user can move arbitrarily before video camera, and the parameter of video camera also can be provided with arbitrarily as required.And Touchless control system and the method based on static gesture identification of the present invention can either be used for the open air, also can be used in indoor.Therefore, reasonably solved such as the low problem of existing reliability in the such prior art of patent documentation 1.
The second, can design a series of recognition function for various users.Current, many gestures are widely used in real world.But they all are difficult to be discerned by current gesture identification system usually.Therefore, in the Touchless control system and method based on static gesture identification of the present invention, these common identification gestures have been designed the new recognition function of a cover.And then because each gesture that is identified is separate, therefore, they can be respectively defined as different operational orders.Therefore, if a gesture is identified, its corresponding operational order just can be carried out immediately, thus, has realized simple and effective and the high control method of reliability.
The 3rd, native system is handled in real time at live video.According to Touchless control system and the method based on static gesture identification of the present invention, owing at first use hand detection algorithm and hand track algorithm that user's hand is positioned, so, in gesture identification algorithm subsequently, can be only in the gesture of identification user among a small circle rather than in the big scope.Therefore, can save plenty of time and realize real-time system.
The 4th, because the hand that only depends on the user based on the Touchless control system and the method for static gesture identification of the present invention, therefore, the user is controlled target unit and do not need other extra equipment directly.
Description of drawings
Fig. 1 is the structured flowchart of the Touchless control system of expression static gesture identification of the present invention.
Fig. 2 is the schematic appearance of the Touchless control system of expression static gesture identification of the present invention.
Fig. 3 is the process flow diagram of the non-contact control method of expression static gesture identification of the present invention.
Fig. 4 is the process flow diagram of the processing carried out of the hand detection module of the Touchless control system of expression static gesture of the present invention identification.
Fig. 5 is the process flow diagram of the processing carried out of the hand tracking module of the Touchless control system of expression static gesture of the present invention identification.
Fig. 6 is the process flow diagram of the processing carried out of the gesture identification module of the Touchless control system of expression static gesture of the present invention identification.
Fig. 7 is the process flow diagram of the processing carried out of the signal conversion module of the Touchless control system of expression static gesture of the present invention identification.
Fig. 8 is a numeral gesture in expression one embodiment of the present invention.
Fig. 9 is the embodiment of expression the present invention with 4 numeral gesture control televisors.
Figure 10 is the embodiment of expression the present invention with a plurality of numeral gesture control televisors.
Figure 11 is the example of another serial gesture.
Figure 12 is the schematic appearance of the gesture control system of machine of expression prior art.
Figure 13 is the process flow diagram of gesture control method of the gesture control system of machine of prior art.
Embodiment
Below, use accompanying drawing to describe embodiments of the present invention in detail.
Fig. 1 is the structured flowchart of Touchless control system of the static gesture identification of present embodiment, and wherein arrow is represented the flow direction of information flow.Fig. 2 is the schematic appearance of Touchless control system of the static gesture identification of expression embodiments of the present invention.
As shown in Figure 1, the Touchless control system 1 of the static gesture of present embodiment identification mainly comprises three parts: image unit 2, processing unit 3 and object element 4.Image unit 2 is the device of shooting user's video, can be first-class for the shooting of television camera, computing machine.Processing unit 3 is used to handle the video that is taken, and for example discerns user's gesture and is converted into corresponding instruction etc.Processing unit 3 can be computer processor etc.Object element 4 is a device of carrying out various operations according to instruction, for example can be plurality of devices such as televisor, computing machine, display, electronic whiteboard, electric advertisement screen.
As shown in Figure 2, above image unit 2, processing unit 3 and object element 4 can be separated to be provided with (left figure), wherein, image unit 2 can place the position that is higher than display device, also can their threes be set to one (right figure), for example image unit 2 can be placed the device top, and processing unit 3 is built-in.
As processing unit 3, comprise four modules: hand detection module 5, hand tracking module 6, gesture identification module 7 and signal conversion module 8, its function separately will describe in detail in the back.
Fig. 3 is the process flow diagram of expression as the basic step of the non-contact control method of discerning based on static gesture in the Touchless control system of the static gesture identification of present embodiment.
At first, image unit 2 shooting users' video live telecast.This video signal transmission is to processing unit 3.In video, detect user's hand by the hand detection module 5 in the processing unit 3.After user's hand is detected, testing result is sent to hand tracking module 6.6 couples of these users' of hand tracking module hand is followed the tracks of.And then testing result and tracking results are analyzed in gesture identification module 7, and user's gesture is discerned.In case after a gesture was identified, signal conversion module 8 was converted to corresponding operational order with this gesture.At last, processing unit 3 exports this operational order to object element 4, and object element 4 comes executable operations based on this operational order.
Like this, take by the user being carried out live video, and the hand of user in the live video carried out automatic detection and tracking, in case a gesture come across in the video, will be by Real time identification.And the gesture that is identified is converted into corresponding operational order, and object element comes executable operations according to this operational order.Therefore, the user can use a series of static gesture, comes the controlled target unit across a segment distance, does not control and do not need directly to touch this object element.
Below, in conjunction with the structure of processing unit 3 included four modules, the non-contact control method based on static gesture identification in the Touchless control system of the static gesture of present embodiment identification is further detailed.
Fig. 4 is the schematic flow sheet of the processing that hand detection module 5 carries out in the processing unit 3.
After the current live video that image unit 2 is taken is transfused to hand detection module 5, in this hand detection module 5, detect according to the live video of housebroken fingerprint type to input.The image of this housebroken fingerprint type in advance user's hand being taken can design as required.For example, can or use the needs of restriction,, or user arbitrarily be designed in advance the model of various gestures only to the interior employee of company according to safety.In addition, above fingerprint type is set up database, be stored in the storer.
In testing process, hand detection module 5 is by Adaboost algorithm or other algorithm of target detection, and contrast fingerprint type comes whether to occur in the analysis video user's hand.In this algorithm, mainly utilize Harr feature (edge feature, linear feature, central feature and diagonal line feature), by integrogram, come the hand of search subscriber.If do not find user's hand, then hand detection module 5 continues to analyze new video.If find user's hand, hand detection module 5 for example represents that with the residing position of user's hand, residing zone and other relevant information the data (center, width, length) of the rectangular area of hand in image are recorded in the storer.And, the information that is write down is exported in the hand tracking module 6.
In addition, as required, the face, eyes, face, nose etc. that can also detect the user sometimes are to provide further information.
Fig. 5 is the treatment scheme synoptic diagram of hand tracking module 6 in the processing unit 3.
Information at the user's who is detected hand, after for example the information relevant with hand such as the residing position of hand, residing zone are input to hand tracking module 6, hand tracking module 6 carries out the initialization of tracker, promptly each hand that is detected is set up a tracker.This tracker is to analyzing from the live video one frame one frame ground of image unit 2 inputs.To each new frame, tracker is according to the residing position of hand, residing zone, and the respective regions in live video is searched for and the most similar zone of hand that is detected.In case realized stable tracking, then about all information of this user's hand, for example, the position of hand, zone, about information of gesture etc. all with obtained.More than the information of user's hand of Huo Deing be output to gesture identification module 7 to carry out gesture identification.
In the above processing that hand tracking module 6 carries out, can be according to the data (center, width, length) of the rectangular area of expression hand in image, by MeanShift algorithm or other target tracking algorisms, use color histogram to obtain representing the data (center, width, length, direction) of the elliptical region of hand in image, obtain gesture information thus about user's hand.
Fig. 6 is the treatment scheme synoptic diagram of gesture identification module 7 in the processing unit 3.
7 pairs of all information of gesture identification module about user's hand from 6 inputs of hand tracking module, utilize the HOG feature, analyze gesture by SVM (Support Vector Machine) algorithm or other algorithm of target detection, and result's (data or signal of the classification of expression gesture) of the gesture that is identified is exported in the signal conversion module 8 with the identification user.
Analyze gesture by SVM (Support Vector Machine) algorithm or other algorithm of target detection with the identification user, traditionally need be in the identification of entire image range searching user's hand with final realization gesture.But, in the present invention, owing to user's hand is located by hand detection module 5 and hand tracking module 6, therefore, in gesture recognition process the most consuming time, do not need the hand of search subscriber, thereby saved a large amount of time, made user's real-time control become possibility.
In the present invention, according to the fingerprint type that is recorded in advance in the storer, employing object detection method is come hand and the gesture in the identification video, therefore, compare with the background segment technology of prior art, because do not need to remove background, thereby the user can be mobile arbitrarily before video camera, the parameter of video camera also can be provided with arbitrarily as required.And Touchless control system and the method based on static gesture identification of the present invention can either be used for the open air, also can be used in indoor.Therefore, reasonably solved such as the low problem of existing reliability in the such prior art of patent documentation 1.
Fig. 7 is the treatment scheme synoptic diagram of signal conversion module 8 in the processing unit 3.
Because from result's (classification of gesture) of the gesture of gesture identification module 7 output is various data or signal corresponding to gesture, can not directly be understood execution by object module, therefore, in signal conversion module 8, the gesture that is identified is converted to corresponding operation instruction signal, and exports object element 4 to.
Here,,, set in advance, set up each gesture and operational order and concern one to one for each different gesture according to the difference of object element.Above corresponding relation can be recorded in the storer by gesture-instruction table of comparisons.
For example, as described later, at object element is in the example of televisor, to represent the numeral " 5 " gesture be appointed as operational order " start ", when the gesture from 7 outputs of gesture identification module is the gesture of expression numeral " 5 ", signal conversion module 8 should numeral " 5 " gesture be converted to corresponding operational order " start ", and with this operational order be sent to object element for example televisor make it carry out boot action.
When object element for example is computing machine, signal conversion module 8 is converted to the operation instruction signal that computing machine can be discerned and carry out with gesture, for example can be computer instructions such as " double-click ", " clicking ", constitute a Touchless control system that replaces traditional keyboard and mouse.
Like this, processing by the hand detection module 5 in the above processing unit 3, hand tracking module 6, gesture identification module 7 and signal conversion module 8, the user is based on a series of static gesture of prior setting and the corresponding relation of operational order, and the controlled target unit comes executable operations non-contactly.
Below specify the operating process of using static gesture to control televisor by be operating as example with televisor.
As the simple solution of gesture, numeral gesture as shown in Figure 8 is widely used.And each all is separate for these gestures, therefore, in the present embodiment, they is defined as different operational orders respectively, and, right-hand man's gesture is distinguished.A cover totally 20 different operational orders like this, have just been formed.
For example, setting the left hand gesture of representing " 5 " is " start " instruction; The left hand gesture of expression " 8 " is " next one " instruction; The left hand gesture of expression " 6 " is " last one " instruction; The left hand gesture of expression " 10 " is " closing " instruction; The left hand gesture of expression " 9 " is " calling " instruction.
Represent to use the synoptic diagram of the simple TV set controller that 4 kinds of gestures make during Fig. 9.
When subscriber station when televisor (object element 4) is preceding, as the television camera of image unit 2 it is carried out video verite, this user's live video is input to hand detection module 5 in the processing unit 3.When the user begins to start in televisor reach, when making the left hand gesture of expression " 5 ", this user's hand will be detected in real time by hand detection module 5.Then, in hand tracking module 6, this user's hand is tracked, obtains position, the zone about this user's hand, the information of gesture thus.Afterwards, in gesture identification module 7, the information of the hand of acquisition is analyzed, discerns the left hand gesture of this user's gesture for expression " 5 ".After this gesture was identified, in signal conversion module 8, the left hand gesture of this expression " 5 " was converted into corresponding operational order " start ", allowed televisor carry out the start operation.
Subsequently, when the user made the left hand gesture of expression " 8 ", according to above same processing procedure, the left hand gesture of this expression " 8 " was converted to command adapted thereto " next one ", and televisor is carried out the operation that switches to succeeding channel.After this, when the user made the left hand gesture of expression " 6 ", the left hand gesture of this expression " 6 " was converted to command adapted thereto " last ", and televisor is carried out the operation that switches to a channel.At last, when the user made the left hand gesture of expression " 10 ", the left hand gesture of this expression " 10 " was converted to command adapted thereto and " closes ", and televisor is carried out the operation of closing television.
More than use 4 kinds of gestures can make a simple TV set controller, in fact, can realize more complicated control by increasing other gestures.
Figure 10 represents to use the synoptic diagram of the TV set controller of the relative complex that 5 kinds of gestures make,
In Figure 10, the operational order that has increased the left hand gesture conduct " calling " of expression " 9 " calls the repertoire menu.Generally speaking, " directly " pattern is set to default mode.Under this pattern, the user can directly pass through right hand gesture switching channels.If the user wishes more complicated operations, the user can select " calling " instruction to access the repertoire menu.Like this, all functions can both freely be selected.
In Figure 10, use an one hand (left hand) to realize complicated control function.In fact, many other functions can also easily realize by two hands.
Above simple solution as gesture has been enumerated numeral gesture.But, be not limited to above-described 20 kinds of numeral gestures, can also enumerate the gesture of a series of representing with the right-hand man respectively as shown in Figure 11.In fact,, just they can be defined as different operational orders respectively, come to set according to controlling needs as long as each of these gestures is independence mutually and is easy to distinguish.Yet because above numeral gesture is widely used, therefore, preferred above numeral gesture is as operational order.
More than be operating as example with televisor the operating process of using static gesture to control televisor be described, yet, as object element, except that televisor, can also be plurality of devices such as computing machine, display, electronic whiteboard, electric advertisement screen.When different object elements was controlled, signal conversion module was converted to the instruction corresponding signal that this equipment can be discerned and carry out with hand signal.
More than shown in the equal illustration and be not restricted contents just of full content of embodiment.Scope of the present invention be can't help above-mentioned explanation but represented by claims, comprises and the meaning of the scope equalization of claims and the whole changes in the scope.
Claims (14)
1. Touchless control system based on static gesture identification is characterized in that having:
Image unit is taken the current video of user;
Processing unit, identification user's gesture from the user's that takes by described image unit video, and the gesture of being discerned is converted to corresponding operational order; And
Object element according to the operational order of described processing unit, is carried out operation accordingly.
2. the Touchless control system based on static gesture identification according to claim 1 is characterized in that:
Described processing unit comprises gesture identification module and signal conversion module,
Described gesture identification module identification user's from the user's that takes by described image unit video gesture,
Described signal conversion module is converted to the gesture of being discerned the corresponding operational order of carrying out for object element according to the corresponding relation of gesture and operational order.
3. the Touchless control system based on static gesture identification according to claim 2 is characterized in that:
Described processing unit also comprises hand detection module and hand tracking module,
Described hand detection module detects user's hand from the user's that taken by described image unit video, will comprise that user's the position of hand and the information in zone of living in send described hand tracking module to,
Described hand tracking module to analyzing from the video of described image unit input, obtains the information about gesture according to the position of the hand that comprises the user and the information in zone of living in.
4. the Touchless control system based on static gesture identification according to claim 3 is characterized in that:
Described hand tracking module is set up a tracker to each hand that is detected, and described tracker to analyzing from the video of described image unit input, obtains the information about the gesture of this hand according to the information that comprises the position and the zone of living in of this hand.
5. according to claim 3 or 4 described Touchless control systems, it is characterized in that based on static gesture identification:
Described gesture identification module is discerned user's gesture according to the information about gesture from described hand tracking module, and the gesture result who is discerned is sent to described signal conversion module.
6. the Touchless control system based on static gesture identification according to claim 1 is characterized in that:
Described object element is any in televisor, computing machine, electronic whiteboard, the electric advertisement screen.
7. the Touchless control system based on static gesture identification according to claim 1 is characterized in that:
Described gesture is the gesture of the numeral of expression 1～10.
8. the non-contact control method based on static gesture identification is characterized in that, may further comprise the steps:
Take the shooting step of the current video of user;
Identification user's gesture from the user's that described shooting step, takes video, and the gesture of being discerned is converted to the treatment step of corresponding operational order; And
According to the operational order of described treatment step, carry out the operation steps of corresponding operating.
9. the non-contact control method based on static gesture identification according to claim 8 is characterized in that:
The treating step comprises gesture identification step and conversion of signals step,
In described gesture identification step, identification user's gesture from the user's that described shooting step, takes video,
In described conversion of signals step,, will be converted to corresponding operational order in the gesture of described gesture identification step identification according to the corresponding relation of gesture and operational order.
10. the non-contact control method based on static gesture identification according to claim 9 is characterized in that:
Described treatment step comprises that also hand detects step and hand tracking step,
Detect in the step at described hand, from the user's that described shooting step, takes video, detect user's hand, obtain comprising user's the position of hand and the information in zone of living in,
In described hand tracking step, according to the position of detecting the hand that comprises the user that step obtains at described hand and the information in zone of living in, analyze in the video to the user that in described shooting step, takes, obtain information about gesture.
11. the non-contact control method based on static gesture identification according to claim 10 is characterized in that:
In described hand tracking step, each hand that is detected is followed the tracks of respectively, according to the information in position that comprises hand and zone of living in, the video of taking in the shooting step is analyzed, obtain information about the gesture of this hand.
12. the non-contact control method based on static gesture identification according to claim 10 is characterized in that:
In described gesture identification step, according to the information that in described hand tracking step, obtains about gesture, identification user's gesture.
13. the non-contact control method based on static gesture identification according to claim 8 is characterized in that:
Described operational order is the operational order of any execution in televisor, computing machine, electronic whiteboard, the electric advertisement screen.
14. the non-contact control method based on static gesture identification according to claim 7 is characterized in that:
Described gesture is the gesture of the numeral of expression 1～10.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2010101345383A CN102200830A (en) | 2010-03-25 | 2010-03-25 | Non-contact control system and control method based on static gesture recognition |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2010101345383A CN102200830A (en) | 2010-03-25 | 2010-03-25 | Non-contact control system and control method based on static gesture recognition |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN102200830A true CN102200830A (en) | 2011-09-28 |
Family
ID=44661558
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2010101345383A Pending CN102200830A (en) | 2010-03-25 | 2010-03-25 | Non-contact control system and control method based on static gesture recognition |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102200830A (en) |
Cited By (34)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102457688A (en) * | 2011-12-30 | 2012-05-16 | 四川长虹电器股份有限公司 | Intelligent regulation method for volume and channel of television |
| CN102621956A (en) * | 2012-03-28 | 2012-08-01 | 中山市澳信信息科技有限公司 | Intelligent household control system |
| CN102929388A (en) * | 2011-09-30 | 2013-02-13 | 微软公司 | Full space posture input |
| CN103002099A (en) * | 2012-11-06 | 2013-03-27 | 广东欧珀移动通信有限公司 | Method and device for operating 'yes or no' dialog box |
| CN103135746A (en) * | 2011-11-25 | 2013-06-05 | 夏普株式会社 | Non-touch control method and non-touch control system and non-touch control device based on static postures and dynamic postures |
| CN103136508A (en) * | 2011-12-05 | 2013-06-05 | 联想(北京)有限公司 | Gesture identification method and electronic equipment |
| CN103176603A (en) * | 2013-03-08 | 2013-06-26 | 广东工业大学 | Computer gesture input system |
| CN103186239A (en) * | 2011-12-27 | 2013-07-03 | 马克西姆综合产品公司 | Gesture detection and compact representation thereof |
| CN103338289A (en) * | 2013-06-21 | 2013-10-02 | 广东欧珀移动通信有限公司 | Backlight adjusting method, adjusting device and mobile terminal |
| CN103376890A (en) * | 2012-04-16 | 2013-10-30 | 富士通株式会社 | Gesture remote control system based on vision |
| CN103376891A (en) * | 2012-04-23 | 2013-10-30 | 凹凸电子（武汉）有限公司 | Multimedia system, control method for display device and controller |
| CN103513762A (en) * | 2012-06-15 | 2014-01-15 | 安泰科技有限公司 | Operating method using user gesture and digital device thereof |
| CN103543943A (en) * | 2012-07-16 | 2014-01-29 | 三星电子株式会社 | Touch and gesture input-based control method and terminal therefor |
| CN103631367A (en) * | 2012-08-24 | 2014-03-12 | 由田新技股份有限公司 | Interactive advertisement system |
| CN103809846A (en) * | 2012-11-13 | 2014-05-21 | 联想(北京)有限公司 | Function calling method and electronic equipment |
| CN104035547A (en) * | 2013-03-06 | 2014-09-10 | 联想(北京)有限公司 | Input method and electronic device |
| WO2014172815A1 (en) * | 2013-04-24 | 2014-10-30 | Li Min | Gesture television remote controller |
| CN104281265A (en) * | 2014-10-14 | 2015-01-14 | 京东方科技集团股份有限公司 | Application program control method, application program control device and electronic equipment |
| CN104460991A (en) * | 2014-11-19 | 2015-03-25 | 中山大学 | Gesture interaction control system based on digital household equipment |
| CN104571823A (en) * | 2015-01-12 | 2015-04-29 | 济南大学 | Non-contact virtual human-computer interaction method based on smart television set |
| CN104639733A (en) * | 2013-11-13 | 2015-05-20 | 青岛润鑫伟业科贸有限公司 | Remote turn-on method of cellphone |
| WO2015078020A1 (en) * | 2013-11-30 | 2015-06-04 | 华为技术有限公司 | Gesture operation conversion method and apparatus |
| CN104699233A (en) * | 2014-04-14 | 2015-06-10 | 杭州海康威视数字技术股份有限公司 | Screen operation control method and system |
| CN105138131A (en) * | 2015-09-01 | 2015-12-09 | 冯仕昌 | General gesture command transmitting and operating device and method |
| CN105320443A (en) * | 2014-07-23 | 2016-02-10 | 深圳Tcl新技术有限公司 | Method and device for switching channel through gesture |
| CN106095081A (en) * | 2016-05-30 | 2016-11-09 | 合肥联宝信息技术有限公司 | Man-machine interaction method and device |
| CN106406527A (en) * | 2016-09-07 | 2017-02-15 | 传线网络科技（上海）有限公司 | Input method and device based on virtual reality and virtual reality device |
| CN107104692A (en) * | 2017-05-08 | 2017-08-29 | 长沙金定信息技术有限公司 | A kind of intelligent vehicle-carried verbal system based on gesture control and image procossing |
| CN107493507A (en) * | 2017-08-08 | 2017-12-19 | 广东长虹电子有限公司 | A kind of television system and its control method of human body attitude detection controlling switch machine |
| CN108108707A (en) * | 2017-12-29 | 2018-06-01 | 北京奇虎科技有限公司 | Gesture processing method and processing device based on video data, computing device |
| CN109725722A (en) * | 2018-12-29 | 2019-05-07 | 百度在线网络技术（北京）有限公司 | There are the gestural control method and device of screen equipment |
| CN110209873A (en) * | 2019-06-04 | 2019-09-06 | 北京梦想加信息技术有限公司 | Whiteboard secretary recording method, equipment, system and storage medium |
| CN111258427A (en) * | 2020-01-17 | 2020-06-09 | 哈尔滨拓博科技有限公司 | Blackboard control method and control system based on binocular camera gesture interaction |
| CN113038216A (en) * | 2021-03-10 | 2021-06-25 | 深圳创维－Rgb电子有限公司 | Instruction obtaining method, television, server and storage medium |
-
2010
- 2010-03-25 CN CN2010101345383A patent/CN102200830A/en active Pending
Cited By (46)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9423876B2 (en) | 2011-09-30 | 2016-08-23 | Microsoft Technology Licensing, Llc | Omni-spatial gesture input |
| CN102929388A (en) * | 2011-09-30 | 2013-02-13 | 微软公司 | Full space posture input |
| CN102929388B (en) * | 2011-09-30 | 2017-12-26 | 微软技术许可有限责任公司 | Full space posture inputs |
| CN103135746B (en) * | 2011-11-25 | 2018-01-02 | 夏普株式会社 | Non-contact control method, system and equipment based on static posture and dynamic posture |
| CN103135746A (en) * | 2011-11-25 | 2013-06-05 | 夏普株式会社 | Non-touch control method and non-touch control system and non-touch control device based on static postures and dynamic postures |
| CN103136508A (en) * | 2011-12-05 | 2013-06-05 | 联想(北京)有限公司 | Gesture identification method and electronic equipment |
| CN103136508B (en) * | 2011-12-05 | 2018-03-13 | 联想(北京)有限公司 | Gesture identification method and electronic equipment |
| CN103186239A (en) * | 2011-12-27 | 2013-07-03 | 马克西姆综合产品公司 | Gesture detection and compact representation thereof |
| CN102457688A (en) * | 2011-12-30 | 2012-05-16 | 四川长虹电器股份有限公司 | Intelligent regulation method for volume and channel of television |
| CN102621956A (en) * | 2012-03-28 | 2012-08-01 | 中山市澳信信息科技有限公司 | Intelligent household control system |
| CN103376890A (en) * | 2012-04-16 | 2013-10-30 | 富士通株式会社 | Gesture remote control system based on vision |
| CN103376890B (en) * | 2012-04-16 | 2016-08-31 | 富士通株式会社 | The gesture remote control system of view-based access control model |
| CN103376891A (en) * | 2012-04-23 | 2013-10-30 | 凹凸电子（武汉）有限公司 | Multimedia system, control method for display device and controller |
| CN103513762A (en) * | 2012-06-15 | 2014-01-15 | 安泰科技有限公司 | Operating method using user gesture and digital device thereof |
| CN103513762B (en) * | 2012-06-15 | 2016-12-21 | 安泰科技有限公司 | Utilize operational approach and the digital device of user's gesture |
| CN103543943A (en) * | 2012-07-16 | 2014-01-29 | 三星电子株式会社 | Touch and gesture input-based control method and terminal therefor |
| CN103631367A (en) * | 2012-08-24 | 2014-03-12 | 由田新技股份有限公司 | Interactive advertisement system |
| CN103002099A (en) * | 2012-11-06 | 2013-03-27 | 广东欧珀移动通信有限公司 | Method and device for operating 'yes or no' dialog box |
| CN103809846B (en) * | 2012-11-13 | 2019-07-26 | 联想(北京)有限公司 | A kind of funcall method and electronic equipment |
| CN103809846A (en) * | 2012-11-13 | 2014-05-21 | 联想(北京)有限公司 | Function calling method and electronic equipment |
| CN104035547A (en) * | 2013-03-06 | 2014-09-10 | 联想(北京)有限公司 | Input method and electronic device |
| CN103176603A (en) * | 2013-03-08 | 2013-06-26 | 广东工业大学 | Computer gesture input system |
| WO2014172815A1 (en) * | 2013-04-24 | 2014-10-30 | Li Min | Gesture television remote controller |
| CN103338289A (en) * | 2013-06-21 | 2013-10-02 | 广东欧珀移动通信有限公司 | Backlight adjusting method, adjusting device and mobile terminal |
| CN103338289B (en) * | 2013-06-21 | 2016-01-20 | 广东欧珀移动通信有限公司 | backlight adjusting method, adjusting device and mobile terminal |
| CN104639733A (en) * | 2013-11-13 | 2015-05-20 | 青岛润鑫伟业科贸有限公司 | Remote turn-on method of cellphone |
| WO2015078020A1 (en) * | 2013-11-30 | 2015-06-04 | 华为技术有限公司 | Gesture operation conversion method and apparatus |
| CN104699233A (en) * | 2014-04-14 | 2015-06-10 | 杭州海康威视数字技术股份有限公司 | Screen operation control method and system |
| CN104699233B (en) * | 2014-04-14 | 2018-05-01 | 杭州海康威视数字技术股份有限公司 | A kind of method and system that operation control is carried out to screen |
| CN105320443B (en) * | 2014-07-23 | 2018-09-04 | 深圳Tcl新技术有限公司 | The method and device of gesture switching channels |
| CN105320443A (en) * | 2014-07-23 | 2016-02-10 | 深圳Tcl新技术有限公司 | Method and device for switching channel through gesture |
| CN104281265B (en) * | 2014-10-14 | 2017-06-16 | 京东方科技集团股份有限公司 | A kind of control method of application program, device and electronic equipment |
| WO2016058303A1 (en) * | 2014-10-14 | 2016-04-21 | 京东方科技集团股份有限公司 | Application control method and apparatus and electronic device |
| CN104281265A (en) * | 2014-10-14 | 2015-01-14 | 京东方科技集团股份有限公司 | Application program control method, application program control device and electronic equipment |
| CN104460991A (en) * | 2014-11-19 | 2015-03-25 | 中山大学 | Gesture interaction control system based on digital household equipment |
| CN104571823A (en) * | 2015-01-12 | 2015-04-29 | 济南大学 | Non-contact virtual human-computer interaction method based on smart television set |
| CN105138131A (en) * | 2015-09-01 | 2015-12-09 | 冯仕昌 | General gesture command transmitting and operating device and method |
| CN106095081A (en) * | 2016-05-30 | 2016-11-09 | 合肥联宝信息技术有限公司 | Man-machine interaction method and device |
| CN106406527A (en) * | 2016-09-07 | 2017-02-15 | 传线网络科技（上海）有限公司 | Input method and device based on virtual reality and virtual reality device |
| CN107104692A (en) * | 2017-05-08 | 2017-08-29 | 长沙金定信息技术有限公司 | A kind of intelligent vehicle-carried verbal system based on gesture control and image procossing |
| CN107493507A (en) * | 2017-08-08 | 2017-12-19 | 广东长虹电子有限公司 | A kind of television system and its control method of human body attitude detection controlling switch machine |
| CN108108707A (en) * | 2017-12-29 | 2018-06-01 | 北京奇虎科技有限公司 | Gesture processing method and processing device based on video data, computing device |
| CN109725722A (en) * | 2018-12-29 | 2019-05-07 | 百度在线网络技术（北京）有限公司 | There are the gestural control method and device of screen equipment |
| CN110209873A (en) * | 2019-06-04 | 2019-09-06 | 北京梦想加信息技术有限公司 | Whiteboard secretary recording method, equipment, system and storage medium |
| CN111258427A (en) * | 2020-01-17 | 2020-06-09 | 哈尔滨拓博科技有限公司 | Blackboard control method and control system based on binocular camera gesture interaction |
| CN113038216A (en) * | 2021-03-10 | 2021-06-25 | 深圳创维－Rgb电子有限公司 | Instruction obtaining method, television, server and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102200830A (en) | Non-contact control system and control method based on static gesture recognition | |
| CN103295028B (en) | gesture operation control method, device and intelligent display terminal | |
| EP2870523B1 (en) | Computer-implemented method and system for recognizing gestures | |
| KR102062310B1 (en) | Method and apparatus for prividing control service using head tracking in an electronic device | |
| CN109032358B (en) | Control method and device of AR interaction virtual model based on gesture recognition | |
| US8897490B2 (en) | Vision-based user interface and related method | |
| US10095033B2 (en) | Multimodal interaction with near-to-eye display | |
| CN106415472B (en) | Gesture control method and device, terminal equipment and storage medium | |
| US20130088422A1 (en) | Input apparatus and input recognition method | |
| CN105353634A (en) | Household appliance and method for controlling operation by gesture recognition | |
| US20110273551A1 (en) | Method to control media with face detection and hot spot motion | |
| KR101929077B1 (en) | Image identificaiton method and image identification device | |
| CN112954210B (en) | Photographing method and device, electronic equipment and medium | |
| CN105760102B (en) | Terminal interaction control method and device and application program interaction control method | |
| CN102236413A (en) | Interface apparatus and gesture recognition method | |
| JP2013164834A (en) | Image processing device, method thereof, and program | |
| US20210081029A1 (en) | Gesture control systems | |
| CN111656313A (en) | Screen display switching method, display device and movable platform | |
| CN112492201B (en) | Photographing method and device and electronic equipment | |
| CN103472915A (en) | Reading control method and reading control device on basis of pupil tracking and display equipment | |
| CN106031163A (en) | Method and apparatus for controlling projection display | |
| CN106774827B (en) | Projection interaction method, projection interaction device and intelligent terminal | |
| US10088897B2 (en) | Method and electronic device for improving performance of non-contact type recognition function | |
| CN105739902A (en) | Gesture identification system and method | |
| CN115421591B (en) | Gesture control device and image pickup apparatus |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C02 | Deemed withdrawal of patent application after publication (patent law 2001) | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20110928 |