CN103295028B - gesture operation control method, device and intelligent display terminal - Google Patents
gesture operation control method, device and intelligent display terminal Download PDFInfo
- Publication number
- CN103295028B CN103295028B CN201310191402.XA CN201310191402A CN103295028B CN 103295028 B CN103295028 B CN 103295028B CN 201310191402 A CN201310191402 A CN 201310191402A CN 103295028 B CN103295028 B CN 103295028B
- Authority
- CN
- China
- Prior art keywords
- operator
- image information
- gesture
- identity
- information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Abstract
The present invention discloses a kind of gesture operation control method, device and intelligent display terminal, method：Acquisition operations person's image information；The identity that operator is identified according to operator's image information, obtains the identity information of operator；Preset apart from matching list according to the lookup of the identity information of operator, the effective gesture operation distance for obtaining operator's relative termination simultaneously reminds operator.The invention enables the effective distances that gestural control system can be automatically reminded to the relatively intelligent display terminal of operator, not only improve the precision that gestural control system identifies operator's gesture motion, but also avoid operator that operation is caused to injure；It is additionally gone to search gesture identification menu according to operator's image information of acquisition, the adjustment corresponding function of terminal is corresponded to according to lookup result, realizes the purpose for controlling TV functions by operator's gesture operation.
Description
Technical field
The present invention relates to intelligent distant control technical field more particularly to a kind of gesture operation control method, device and intelligence are aobvious
Show terminal.
Background technology
It is increasingly promoted as global television is digitized, more and more electronic equipment for consumption occurs, such as Pad,
DVD, digital television, sound equipment and air-conditioning etc.；And various electronic equipments are directed to, also there are various intelligent distant control systems
System, such as television set intelligently remote controler, air-conditioning remote control, mobile phone is as remote controler, and IPAD is as remote control system etc..
Currently, the pattern for carrying out remote control to TV mainly has：The remote control of infrared television remote manipulator, similar mouse
Device inputs, using the remote controler handwriting input etc. of handwriting pad, but the above control model is required for user's operation external equipment
Realize the control to TV.In order to improve quality of the life and increase the hommization of intelligence system, the control that user is more convenient is allowed
, there is gesture control at present in intelligent terminal processed.
The characteristics of gesture control is the hand motion by operator（Such as it waves）It is set to control the terminals such as TV
It is standby, for example, switching TV channel, adjusting volume etc., to eliminate finding remote controller, the process of remote controller, by user
It is freed from the dependence to remote controler, the control that can be realized to TV of waving.
But current gesture control, when user carries out gesture motion, television terminal can not remind user and electricity
Effective distance is kept depending between.For example, the child or household of family, if the distance for the gesture control for not reminding him current
It is whether correct, then it is susceptible to excessively close apart from TV when user gesture operation, thereby results in following two problems：
The first, cause gesture recognition system identification incorrect, such as：User is too close from camera, and camera can not obtain
To the gesture picture of user, cause system that can not correctly identify the gesture of user；
The second, the hand of user can touch TV, cause hand injured；Such as：TV is placed on the cabinet in parlor, child
It sees that parents do gesture motion, oneself goes to imitate, can be patted since child is close from TV, when being brandished with hand on TV,
Cause hand injury etc..
Invention content
The main purpose of the present invention is to provide a kind of gesture operation control method, device and intelligent display terminals, it is intended to
Accuracy of identification of the gestural control system to gesture motion is promoted, avoids user that operation is caused to injure.
In order to achieve the above object, the present invention proposes a kind of gesture operation control method, including：
Acquisition operations person's image information；
The identity that operator is identified according to operator's image information, obtains the identity information of operator；
It is preset apart from matching list according to the lookup of the identity information of the operator, obtain the effective of operator's relative termination
Gesture operation distance simultaneously reminds operator.
Preferably, further include after the step of acquisition operations person's image information：
Size cut, color conversion and/or denoising are carried out to operator's image information.
Preferably, the step of identity information that operator is identified according to operator's image information includes：
The head image information of operator is obtained from operator's image information；
Preset image library is searched according to the head image information of the operator, obtains the identity information of operator.
Preferably, further include after the step of acquisition operations person's image information：
According to operator's image information judge operator's current gesture action whether be operator operational order；If
It is to then follow the steps the identity information that operator is identified according to operator's image information；Otherwise, it does not deal with.
Preferably, it is described according to operator's image information judge operator's current gesture action whether be operator operation
The step of instruction includes：
Manikin is built by the way of multiple target tracking；
Track differentiation and dynamic hand gesture recognition are carried out to operator's image information based on the manikin；
If current operator's image information is the gesture feature data of operator, judge current gesture action for operator
Operational order；Otherwise, it is the maloperation of operator.
Preferably, the effective gesture operation distance for obtaining operator's relative termination and the step of remind operator after
Further include：
Preset gesture identification menu is searched according to operator's image information, adjustment terminal phase is corresponded to according to lookup result
The function of answering.
Preferably, further include before the step of acquisition operations person's image information：
It configures described apart from matching list and gesture identification menu.
The present invention also proposes a kind of gesture operation control device, including：
Acquisition module is used for acquisition operations person's image information；
Identification module, the identity for identifying operator according to operator's image information, obtains the identity of operator
Information；
Reminding module is obtained, it is preset apart from matching list for being searched according to the identity information of the operator, obtain behaviour
Effective gesture operation distance of author's relative termination simultaneously reminds operator.
Preferably, which further includes：
Processing module, for carrying out size cut, color conversion and/or denoising to operator's image information.
Preferably, the identification module is additionally operable to obtain the head image information of operator from operator's image information；
Preset image library is searched according to the head image information of the operator, obtains the identity information of operator.
Preferably, which further includes：
Judgment module, for judging whether operator's current gesture action is operator according to operator's image information
Operational order；If so, the identity information of operator is identified according to operator's image information by the identification module；It is no
Then, it does not deal with.
Preferably, the judgment module is additionally operable to build manikin by the way of multiple target tracking；Based on the people
Body Model carries out track differentiation and dynamic hand gesture recognition to operator's image information；If current operator's image information is behaviour
The gesture feature data of author then judge current gesture action for the operational order of operator；Otherwise, it is the mistake behaviour of operator
Make.
Preferably, which further includes：
Execution module, for searching preset gesture identification menu according to operator's image information, according to lookup result
The corresponding adjustment corresponding function of terminal.
Preferably, which further includes：
Configuration module, it is described apart from matching list and gesture identification menu for configuring.
The present invention also proposes a kind of intelligent display terminal, including device as described above.
A kind of gesture operation control method, device and intelligent display terminal proposed by the present invention, are schemed by acquisition operations person
As information；Identify that the identity of operator obtains the identity information of operator according to operator's image information；According to the body of operator
Part information searching is preset apart from matching list, and the effective gesture operation distance for obtaining operator's relative termination simultaneously reminds operator,
So that gestural control system can be automatically reminded to the effective distance of the relatively intelligent display terminal of operator, gesture control is not only improved
The precision that system identifies operator's gesture motion, and avoid operator that operation is caused to injure.
Description of the drawings
Fig. 1 is the flow diagram of gesture operation control method first embodiment of the present invention；
Fig. 2 is the flow diagram of gesture operation control method second embodiment of the present invention；
Fig. 3 is the flow diagram of gesture operation control method 3rd embodiment of the present invention；
Fig. 4 is the flow diagram of gesture operation control method fourth embodiment of the present invention；
Fig. 5 is the flow diagram of the 5th embodiment of gesture operation control method of the present invention；
Fig. 6 is the structural schematic diagram of gesture operation control device first embodiment of the present invention；
Fig. 7 is the structural schematic diagram of gesture operation control device second embodiment of the present invention；
Fig. 8 is the structural schematic diagram of gesture operation control device 3rd embodiment of the present invention；
Fig. 9 is the structural schematic diagram of gesture operation control device fourth embodiment of the present invention；
Figure 10 is the structural schematic diagram of the 5th embodiment of gesture operation control device of the present invention.
In order to keep technical scheme of the present invention clearer, clear, it is described in further detail below in conjunction with attached drawing.
Specific implementation mode
As shown in Figure 1, first embodiment of the invention proposes a kind of gesture operation control method, including：
Step S101, acquisition operations person's image information；
The present embodiment method running environment is related to the gestural control system of intelligent display terminal, wherein the intelligent display
Terminal can be that smart television etc. shows that equipment, the present embodiment are illustrated with TV.
The runs software of above-mentioned gestural control system may be mounted on TV, for identifying the operator face of gesture operation
To the distance state of TV, and carry out corresponding analysis to remind the correct distance of the opposite TV of operator's adjustment, i.e. effective distance,
To realize the gesture control to TV correlation function.
Acquisition operations person's image information first.Operator can wave to carry out gesture operation before TV, to television system
Remote manipulation instruction is sent, corresponding function point analysis is carried out to control TV, for example, adjusting the size etc. of television sound volume.
TV gestural control system can be by installing the gesture operation of camera capture operator on TV, and obtains
The image information of extract operation person, operator's image information may include the image of the head of operator, shoulder and arm segment
Information, it is possible thereby to capture the gesture motion of user.
Step S102 identifies the identity of operator according to operator's image information, obtains the identity information of operator；
TV gestural control system therefrom obtains the head of operator after capturing operator's image information of operator
Information matches this header information with preset image library, to obtain the identity information of operator.The preset image library
It is middle that corresponding header information is stored with according to different operator's identity, for example, grandfather, grandmother, father and mother, child etc.
Header information, therefore searching above-mentioned preset image library according to the current header information of the operator captured can match cognization
To the identity information of operator.
Step S103, it is preset apart from matching list according to the lookup of the identity information of the operator, it is opposite to obtain operator
Effective gesture operation distance of terminal simultaneously reminds operator.
The present embodiment is effective operating distance that the operator of different identity is set with respectively opposite TV in advance, for example,
Grandfather needs to stand carries out gesture operation, etc. in 1-2 meters of distances, and will be between operator's identity information and respective effective distance
Correspondence is stored in one in matching list, as shown in table 1 below.
Table 1
When in use, operator can before carrying out gesture operation, according to default option, voluntarily configure accordingly away from
From value, the recommendation reference value of system default can also be used, completes to match to postpone to store data to above-mentioned in matching list.
After operator carries out gesture operation and recognizes the identity of operator, gone according to the identity information of the operator
It is preset apart from matching list to search this, therefrom matching obtains effective gesture operation distance of operator's relative termination, and should be away from
It is shown to operator from value, it is possible thereby to which correct gesture operation distance of the operator relative to TV, operator is reminded to see
After the distance value shown on video screen, if current distance does not meet display distance requirement, you can adjust oneself relative to TV
The effective distance of screen.Gesture operations are carried out in 1-2 meters of distances for example, setting grandfather and needing to stand, if grandfather stands except 2 meters,
After then seeing the effective distance of screen display, grandfather adjusts effective range of the distance at 1-2 meters, to improve gesture operation action
Recognition accuracy.For another example, the effective distance of son is set as 1 meter, and son, then can be according to electricity when carrying out gesture operation
Screen curtain prompting message keeps the effective distance between video screen, not only improves the recognition accuracy of gesture operation action,
And it avoids and closely hand is made to touch TV from TV excessively and cause hand injured.
The present embodiment through the above scheme, operator's image information of acquisition operations person；Known according to operator's image information
The identity of other operator, obtains the identity information of operator；Searched according to the identity information of operator it is preset apart from matching list,
It obtains effective gesture operation distance of operator's relative termination and is shown to operator so that gestural control system can be automatically reminded to
The effective distance of the relatively intelligent display terminal of operator not only improves what gestural control system identified operator's gesture motion
Precision, and avoid operator that operation is caused to injure.
As shown in Fig. 2, second embodiment of the invention proposes a kind of gesture operation control method, in above-mentioned first embodiment
On the basis of, further include after above-mentioned steps S101：
Step S104 carries out size cut, color conversion and/or denoising to operator's image information.
Difference lies in the present embodiment gestural control system is capturing operator to the present embodiment with above-mentioned first embodiment
After image information, also need to handle operator's image information accordingly.
Specifically, it after capturing the operation information of operator, needs to analyze the information, such as by operator's
Head and shoulder data are handled, and the size of setting operation person's image is the calculation size being suitble to；To operator's image into
Row color conversion, for example it is 8bit grayscale that RGB 24bit, which are handled,；Meanwhile denoising is carried out to the image data, to go
Except interference.Wherein, the method for denoising can select low-pass filter to realize.
The present embodiment through the above scheme, can improve the accuracy of operator's image information data, to be follow-up hand
Gesture operation identification provides more accurate data source, further improves the essence that gestural control system identifies operator's gesture motion
Degree.
As shown in figure 3, third embodiment of the invention proposes a kind of gesture operation control method, in above-mentioned second embodiment
On the basis of, further include after above-mentioned steps S104：
Step S105, according to operator's image information judge operator's current gesture action whether be operator behaviour
It instructs；If so, entering step S102, otherwise, does not deal with, exit flow.
Difference lies in the present embodiment gestural control system is collecting operator to the present embodiment with above-mentioned second embodiment
Operator's image information and after carrying out respective handling, it is also necessary to whether be that the gesture operation of operator is instructed and carried out to the information
Judge.
Specifically, when judging, following manner may be used：
Manikin is built by the way of multiple target tracking first；
Wherein, more mesh trackings can use joint probability data association filter (JPDAF), multiple hypotheis tracking
(MHT) algorithm and dynamic multidigit allocation algorithm etc., existing ripe scheme may be used in above-mentioned various algorithms, no longer superfluous herein
It states.
Using multi-object tracking method, respectively corresponding target is found for these gesture motion objects, and according to these
Track symbol is that the effective target of operator's human body hand feature establishes manikin.
In the manikin of multiple target, each effective target is corresponding with corresponding space-time track, and effective target is all
Have the characteristics that successional, and different target is respectively provided with the respectively different form of expression.Such as gesture target shows to move
Span.
It is then based on the manikin and track differentiation and dynamic hand gesture recognition is carried out to operator's image information；If
Current operator's image information is the gesture feature data of operator, then current gesture action is the operational order of operator；It is no
Then, it is the maloperation of operator.
The present embodiment through the above scheme, can accurately identify operator gesture operation whether be operator need into
Capable operational order further improves gestural control system to operator it is possible thereby to effectively exclude the maloperation of operator
The precision of gesture motion identification.
As shown in figure 4, fourth embodiment of the invention proposes a kind of gesture operation control method, in above-mentioned 3rd embodiment
On the basis of, further include after above-mentioned steps S103：
Step S106 searches preset gesture identification menu according to operator's image information, is corresponded to according to lookup result
Adjust the corresponding function of terminal.
Difference lies in the present embodiment further includes gesture of the system according to operator to the present embodiment with above-mentioned 3rd embodiment
The scheme of the corresponding function of operation adjustment.
Specifically, the present embodiment is matched with corresponding terminal regulatory function previously according to the different gesture operation of operator,
And have a gesture identification function table with the foundation of this correspondence, for example horizontal direction waves to indicate to adjust television sound volume size, together
When setting wave to indicate to increase volume to the left, wave to indicate to reduce volume to the right, such as after gesture moves 20cm from left to right,
Increase unit, etc. for volume adjustment.
TV gestural control system carries out corresponding work(when the gesture operation for identifying operator is normal operational order
The calling of energy, can go to search preset gesture identification menu according to operator's operator's image information of acquisition first, according to
Lookup result corresponds to the adjustment corresponding function of terminal.To realize the purpose for controlling TV functions by operator's gesture operation.
As shown in figure 5, fifth embodiment of the invention proposes a kind of gesture operation control method, in above-mentioned fourth embodiment
On the basis of, further include before above-mentioned steps S101：
Step S100, configuration are described apart from matching list and gesture identification menu.
The present embodiment and above-mentioned fourth embodiment difference lies in, the present embodiment further include configuration it is described apart from matching list and
The scheme of gesture identification menu.
Specifically, operator can configure according to default option apart from matching list and gesture identification menu, than
Menu is prompted as gesture operation can be arranged in TV gestural control system, operation is reminded in such a way that gesture operation prompts menu
The correct distance range of person and the corresponding function choosing-item of gesture.
The present embodiment through the above scheme, is configured apart from matching list and gesture identification menu, and acquisition operations person's image
Information；The identity that operator is identified according to operator's image information, obtains the identity information of operator；According to the identity of operator
Information searching obtains effective gesture operation distance of operator's relative termination and is shown to operator so that hand apart from matching list
Gesture control system can be automatically reminded to the effective distance of the relatively intelligent display terminal of operator, not only improve gestural control system pair
The precision of operator's gesture motion identification, and avoid operator that operation is caused to injure；Additionally grasped according to the operator of acquisition
Author's image information goes to search gesture identification menu, corresponds to the adjustment corresponding function of terminal according to lookup result, realization passes through
Operator's gesture operation controls the purpose of TV functions.
As shown in fig. 6, first embodiment of the invention proposes a kind of gesture operation control device, including：Acquisition module 201,
Identification module 202 and acquisition reminding module 203, wherein：
Acquisition module 201 is used for acquisition operations person's image information；
Identification module 202, the identity for identifying operator according to operator's image information, obtains the body of operator
Part information；
Display module 203 is obtained, it is preset apart from matching list for being searched according to the identity information of the operator, it obtains
Effective gesture operation distance of operator's relative termination simultaneously reminds operator.
The present embodiment gesture operation control device can be arranged on intelligent display terminal, as the intelligent display terminal
Gestural control system for identifying that the operator of gesture operation faces the distance state of TV, and carries out corresponding analysis to remind
The correct distance of the opposite TV of operator's adjustment, i.e. effective distance, to realize the gesture control to TV correlation function.
Wherein the intelligent display terminal can be that smart television etc. shows that equipment, the present embodiment are illustrated with TV
It is bright.
201 acquisition operations person's image information of acquisition module first.Operator can wave to carry out gesture operation before TV,
Remote manipulation instruction is sent to television system, corresponding function point analysis is carried out to control TV, for example, adjusting the big of television sound volume
It is small etc..
TV gestural control system can be by installing the gesture operation of camera capture operator on TV, and obtains
The image information of extract operation person, the image information may include the image information of the head of operator, shoulder and arm segment.
TV gestural control system therefrom obtains operation by identification module 202 after capturing operator's image information
The header information of person matches this header information with preset image library, to obtain the identity information of operator.This is default
Image library in corresponding header information is stored with according to different operator's identity, for example, grandfather, grandmother, father and mother,
The header information of child etc., therefore above-mentioned preset image library is searched according to the current header information of the operator captured
Identity information of the match cognization to operator.
The present embodiment is effective operating distance that the operator of different identity is set with respectively opposite TV in advance, for example,
Grandfather needs to stand carries out gesture operation, etc. in 1-2 meters of distances, and will be between operator's identity information and respective effective distance
Correspondence is stored in one in matching list, as shown in Table 1.
When in use, operator can before carrying out gesture operation, according to default option, voluntarily configure accordingly away from
From value, the recommendation reference value of system default can also be used, completes to match to postpone to store data to above-mentioned in matching list.
After operator carries out gesture operation and recognizes the identity of operator, reminding module 203 is obtained according to the behaviour
The identity information of author goes to search that this is preset apart from matching list, and therefrom matching obtains effective gesture behaviour of operator's relative termination
Make distance, and the distance value is shown to operator, it is possible thereby to remind correct gesture operation of the operator relative to TV
Distance, after operator sees the distance value shown on video screen, if current distance does not meet display distance requirement, you can adjustment
Oneself effective distance relative to video screen.For example, setting grandfather needs to stand carries out gesture operation in 1-2 meters of distances, if grandfather
Grandfather stands except 2 meters, then after seeing the effective distance of screen display, grandfather adjusts effective range of the distance at 1-2 meters, to carry
The recognition accuracy of high gesture operational motion.For another example, the effective distance of son is set as 1 meter, and son is carrying out gesture operation
When, then the effective distance between video screen can be kept according to video screen prompting message, and it is dynamic not only to improve gesture operation
The recognition accuracy of work, and avoid and closely hand is made to touch TV from TV excessively and cause hand injured.
The present embodiment through the above scheme, acquisition operations person's image information；Operator is identified according to operator's image information
Identity, obtain the identity information of operator；It is searched according to the identity information of operator preset apart from matching list, acquisition operation
Effective gesture operation distance of person's relative termination is simultaneously shown to operator so that gestural control system can be automatically reminded to operator's phase
To the effective distance of intelligent display terminal, the precision that gestural control system identifies operator's gesture motion is not only improved, and
And avoid operator that operation is caused to injure.
As shown in fig. 7, second embodiment of the invention proposes a kind of gesture operation control device, in above-mentioned first embodiment
On the basis of, further include：
Processing module 204, for being carried out at size cut, color conversion and/or denoising to operator's image information
Reason.
Difference lies in the present embodiment gestural control system is capturing operator to the present embodiment with above-mentioned first embodiment
After image information, also need to handle operator's image information accordingly.
Specifically, it after capturing operator's image information, needs to analyze the information, such as by the head of operator
Portion and shoulder data are handled, and the size of setting operation person's image is the calculation size being suitble to；Operator's image is carried out
Color conversion, for example it is 8bit grayscale that RGB 24bit, which are handled,；Meanwhile denoising is carried out to the image data, with removal
Interference.Wherein, the method for denoising can select low-pass filter to realize.
The present embodiment through the above scheme, can improve the accuracy of operator's image information data, to be follow-up hand
Gesture operation identification provides more accurate data source, further improves the essence that gestural control system identifies operator's gesture motion
Degree.
As shown in figure 8, third embodiment of the invention proposes a kind of gesture operation control device, in above-mentioned second embodiment
On the basis of, further include：
Judgment module 205, for judging whether operator's current gesture action is behaviour according to operator's image information
The operational order of author；If so, the identity of operator is identified according to operator's image information by the identification module 202
Information；Otherwise, it does not deal with.
Difference lies in the present embodiment gestural control system is collecting operator to the present embodiment with above-mentioned second embodiment
Image information and after carrying out respective handling, it is also necessary to whether be that the gesture operation instruction of operator judges to the information.
Specifically, when judging, following manner may be used：
Manikin is built by the way of multiple target tracking first；
Wherein, more mesh trackings can use joint probability data association filter (JPDAF), multiple hypotheis tracking
(MHT) algorithm and dynamic multidigit allocation algorithm etc., existing ripe scheme may be used in above-mentioned various algorithms, no longer superfluous herein
It states.
Using multi-object tracking method, respectively corresponding target is found for these gesture motion objects, and according to these
Track symbol is that the effective target of operator's human body hand feature establishes manikin.
In the manikin of multiple target, each effective target is corresponding with corresponding space-time track, and effective target is all
Have the characteristics that successional, and different target is respectively provided with the respectively different form of expression.Such as gesture target shows to move
Span.
It is then based on the manikin and track differentiation and dynamic hand gesture recognition is carried out to operator's image information；If
Current operator's image information is the gesture feature data of operator, then current gesture action is the operational order of operator；It is no
Then, it is the maloperation of operator.
The present embodiment through the above scheme, can accurately identify operator gesture operation whether be operator need into
Capable operational order further improves gestural control system to operator it is possible thereby to effectively exclude the maloperation of operator
The precision of gesture motion identification.
As shown in figure 9, fourth embodiment of the invention proposes a kind of gesture operation control device, in above-mentioned 3rd embodiment
On the basis of, further include：
Execution module 206 is tied for searching preset gesture identification menu according to operator's image information according to searching
Fruit corresponds to the adjustment corresponding function of terminal.
Difference lies in the present embodiment further includes gesture of the system according to operator to the present embodiment with above-mentioned 3rd embodiment
The scheme of the corresponding function of operation adjustment.
Specifically, the present embodiment is matched with corresponding terminal regulatory function previously according to the different gesture operation of operator,
And have a gesture identification function table with the foundation of this correspondence, for example horizontal direction waves to indicate to adjust television sound volume size, together
When setting wave to indicate to increase volume to the left, wave to indicate to reduce volume to the right, such as after gesture moves 20cm from left to right,
Increase unit, etc. for volume adjustment.
TV gestural control system carries out corresponding work(when the gesture operation for identifying operator is normal operational order
The calling of energy, can go to search preset gesture identification menu according to operator's operator's image information of acquisition first, according to
Lookup result corresponds to the adjustment corresponding function of terminal.To realize the purpose for controlling TV functions by operator's gesture operation.
As shown in Figure 10, fifth embodiment of the invention proposes a kind of gesture operation control device, in above-mentioned fourth embodiment
On the basis of, further include：
Configuration module 200, it is described apart from matching list and gesture identification menu for configuring.
The present embodiment and above-mentioned fourth embodiment difference lies in, the present embodiment further include configuration it is described apart from matching list and
The scheme of gesture identification menu.
Specifically, operator can configure according to default option apart from matching list and gesture identification menu, than
Menu is prompted as gesture operation can be arranged in TV gestural control system, operation is reminded in such a way that gesture operation prompts menu
The correct distance range of person and the corresponding function choosing-item of gesture.
The present embodiment through the above scheme, is configured apart from matching list and gesture identification menu, and acquisition operations person's image
Information；Identify that the identity of operator obtains the identity information of operator according to operator's image information；According to the identity of operator
Information searching obtains effective gesture operation distance of operator's relative termination and is shown to operator so that hand apart from matching list
Gesture control system can be automatically reminded to the effective distance of the relatively intelligent display terminal of operator, not only improve gestural control system pair
The precision of operator's gesture motion identification, and avoid operator that operation is caused to injure；Additionally schemed according to the operator of acquisition
As information go search gesture identification menu, according to lookup result correspond to adjustment the corresponding function of terminal, realization pass through operator
Gesture operation controls the purpose of TV functions.
It should be noted that above-mentioned each function module can be controlled by the CPU (microprocessor) of TV.
In addition, the present invention also proposes a kind of intelligent display terminal, which includes in above-mentioned any embodiment
The device, wherein the intelligent display terminal can be that smart television etc. shows equipment.
Gesture operation of embodiment of the present invention control method, device and intelligent display terminal are believed by acquisition operations person's image
Breath；Identify that the identity of operator obtains the identity information of operator according to operator's image information；Believed according to the identity of operator
Breath lookup is preset apart from matching list, and the effective gesture operation distance for obtaining operator's relative termination is simultaneously shown to operator, makes
The effective distance of the relatively intelligent display terminal of operator can be automatically reminded to by obtaining gestural control system, not only improve gesture control system
The precision that system identifies operator's gesture motion, and avoid operator that operation is caused to injure；Additionally according to the operation of acquisition
Person's image information goes to search gesture identification menu, corresponds to the adjustment corresponding function of terminal according to lookup result, realization passes through behaviour
Author's gesture operation controls the purpose of TV functions.
The foregoing is merely the preferred embodiment of the present invention, are not intended to limit the scope of the invention, every utilization
Equivalent structure made by description of the invention and accompanying drawing content or flow transformation, are applied directly or indirectly in other relevant skills
Art field, is included within the scope of the present invention.
Claims (15)
1. a kind of gesture operation control method, which is characterized in that including：
Acquisition operations person's image information；
According to operator's image information judge operator's current gesture action whether be operator operational order；
If so, identifying the identity of operator according to operator's image information, the identity information of operator is obtained；
It is searched according to the identity information of the operator preset apart from matching list, effective gesture of acquisition operator's relative termination
Operating distance simultaneously reminds operator；
Wherein, effective gesture operation distance is the correct distance that operator can carry out effective gesture control relative to TV,
The operator of different identity is set with respectively prevents operator from touching effective gesture that TV causes operation to injure with respect to TV
Operating distance；Effective gesture operation distance includes the recommendation reference distance of system default.
2. according to the method described in claim 1, it is characterized in that, also being wrapped after the step of acquisition operations person's image information
It includes：
Size cut, color conversion and/or denoising are carried out to operator's image information.
3. according to the method described in claim 1, it is characterized in that, the body for identifying operator according to operator's image information
The step of part information includes：
The head image information of operator is obtained from operator's image information；
Preset image library is searched according to the head image information of the operator, obtains the identity information of operator.
4. method according to any one of claim 1-3, which is characterized in that described according to operator's image information
Judge further include after the step of whether operator's current gesture action is the operational order of operator：
If it is not, not dealing with then.
5. according to the method described in claim 4, it is characterized in that, described judge that operator is current according to operator's image information
The step of whether gesture motion is the operational order of operator include：
Manikin is built by the way of multiple target tracking；
Track differentiation and dynamic hand gesture recognition are carried out to operator's image information based on the manikin；
If current operator's image information is the gesture feature data of operator, judge current gesture action for the behaviour of operator
It instructs；Otherwise, it is the maloperation of operator.
6. according to the method described in claim 5, it is characterized in that, the effective gesture operation for obtaining operator's relative termination
Distance and the step of remind operator after further include：
Preset gesture identification menu is searched according to operator's image information, it is corresponding to correspond to adjustment terminal according to lookup result
Function.
7. according to the method described in claim 6, it is characterized in that, also being wrapped before the step of acquisition operations person's image information
It includes：
It configures described apart from matching list and gesture identification menu.
8. a kind of gesture operation control device, which is characterized in that including：
Acquisition module is used for acquisition operations person's image information；
Judgment module, for according to operator's image information judge operator's current gesture action whether be operator behaviour
It instructs；If so, the identity of operator is identified according to operator's image information by identification module；
Identification module, the identity for identifying operator according to operator's image information, obtains the identity information of operator；
Reminding module is obtained, it is preset apart from matching list for being searched according to the identity information of the operator, obtain operator
Effective gesture operation distance of relative termination simultaneously reminds operator；
Wherein, effective gesture operation distance is the correct distance that operator can carry out effective gesture control relative to TV,
The operator of different identity is set with respectively prevents operator from touching effective gesture that TV causes operation to injure with respect to TV
Operating distance；Effective gesture operation distance includes the recommendation reference distance of system default.
9. device according to claim 8, which is characterized in that further include：
Processing module, for carrying out size cut, color conversion and/or denoising to operator's image information.
10. device according to claim 8, which is characterized in that the identification module is additionally operable to from operator's image
The head image information of operator is obtained in information；Preset image library is searched according to the head image information of the operator, obtains operation
The identity information of person.
11. according to the device described in any one of claim 8-10, which is characterized in that the judgment module is additionally operable to work as root
When according to operator's image information, to judge operator's current gesture action not be the operational order of operator, do not deal with.
12. according to the devices described in claim 11, which is characterized in that the judgment module is additionally operable to using multiple target tracking
Mode builds manikin；Track differentiation is carried out to operator's image information based on the manikin and dynamic gesture is known
Not；If current operator's image information is the gesture feature data of operator, judge current gesture action for the behaviour of operator
It instructs；Otherwise, it is the maloperation of operator.
13. according to the devices described in claim 11, which is characterized in that further include：
Execution module is corresponded to for searching preset gesture identification menu according to operator's image information according to lookup result
Adjust the corresponding function of terminal.
14. device according to claim 13, which is characterized in that further include：
Configuration module, it is described apart from matching list and gesture identification menu for configuring.
15. a kind of intelligent display terminal, which is characterized in that including the device described in any one of claim 8-14.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310191402.XA CN103295028B (en) | 2013-05-21 | 2013-05-21 | gesture operation control method, device and intelligent display terminal |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310191402.XA CN103295028B (en) | 2013-05-21 | 2013-05-21 | gesture operation control method, device and intelligent display terminal |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103295028A CN103295028A (en) | 2013-09-11 |
| CN103295028B true CN103295028B (en) | 2018-09-04 |
Family
ID=49095855
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201310191402.XA Active CN103295028B (en) | 2013-05-21 | 2013-05-21 | gesture operation control method, device and intelligent display terminal |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103295028B (en) |
Families Citing this family (18)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR102171817B1 (en) * | 2014-03-14 | 2020-10-29 | 삼성전자주식회사 | Display apparatus and method for controlling display apparatus thereof |
| CN106462681A (en) * | 2014-06-10 | 2017-02-22 | 联发科技股份有限公司 | Electronic device controlling and user registration method |
| TW201636784A (en) * | 2015-04-01 | 2016-10-16 | 全智慧科技股份有限公司 | Environment-oriented smart control apparatus, control system and control method |
| CN104856729B (en) * | 2015-05-25 | 2018-07-31 | 无锡海斯凯尔医学技术有限公司 | The method of controlling operation thereof and elastomeric check equipment of elastomeric check equipment |
| CN105045140B (en) * | 2015-05-26 | 2019-01-01 | 深圳创维－Rgb电子有限公司 | The method and apparatus of intelligent control controlled plant |
| JP6172765B2 (en) * | 2015-09-02 | 2017-08-02 | Ｎｅｃプラットフォームズ株式会社 | Notification control device, notification control method, and notification control program |
| CN106648040B (en) * | 2015-11-02 | 2019-12-13 | 重庆邮电大学 | Terminal control method and device |
| CN106886279A (en) * | 2015-12-16 | 2017-06-23 | 华为技术有限公司 | A kind of control method and device |
| CN105700683A (en) * | 2016-01-12 | 2016-06-22 | 厦门施米德智能科技有限公司 | Intelligent window and control method thereof |
| CN106369737A (en) * | 2016-08-19 | 2017-02-01 | 珠海格力电器股份有限公司 | Air conditioner control handling method and device |
| CN108536314A (en) * | 2017-03-06 | 2018-09-14 | 华为技术有限公司 | Method for identifying ID and device |
| CN107678287A (en) * | 2017-09-18 | 2018-02-09 | 广东美的制冷设备有限公司 | Apparatus control method, device and computer-readable recording medium |
| CN107908277B (en) * | 2017-09-30 | 2019-12-03 | 珠海格力电器股份有限公司 | A kind of control device, equipment and control method |
| CN108021880A (en) * | 2017-11-30 | 2018-05-11 | 宁波高新区锦众信息科技有限公司 | A kind of intelligent home control system based on gesture identification |
| CN108460354B (en) * | 2018-03-09 | 2020-12-29 | 深圳臻迪信息技术有限公司 | Unmanned aerial vehicle control method and device, unmanned aerial vehicle and system |
| CN111603072A (en) * | 2019-02-22 | 2020-09-01 | 合盈光电（深圳）有限公司 | Conditioning machine driven by gestures |
| CN111736693B (en) * | 2020-06-09 | 2024-03-22 | 海尔优家智能科技（北京）有限公司 | Gesture control method and device of intelligent equipment |
| CN112328087A (en) * | 2020-11-19 | 2021-02-05 | 成都金都超星天文设备有限公司 | Method for controlling planetarium by gestures and control system |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20010063788A (en) * | 1999-12-24 | 2001-07-09 | 오길록 | Method For Gesture Recognition Using Border-Centroid Distance Of Object |
| CN1917564A (en) * | 2006-08-24 | 2007-02-21 | 中山大学 | Device of controlling receiving destance and authority for digital TV set |
| CN101437124A (en) * | 2008-12-17 | 2009-05-20 | 三星电子（中国）研发中心 | Method for processing dynamic gesture identification signal facing (to)television set control |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR100776801B1 (en) * | 2006-07-19 | 2007-11-19 | 한국전자통신연구원 | Gesture recognition method and system in picture process system |
| CN102662460B (en) * | 2012-03-05 | 2015-04-15 | 清华大学 | Non-contact control device of mobile terminal and control method thereof |
-
2013
- 2013-05-21 CN CN201310191402.XA patent/CN103295028B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20010063788A (en) * | 1999-12-24 | 2001-07-09 | 오길록 | Method For Gesture Recognition Using Border-Centroid Distance Of Object |
| CN1917564A (en) * | 2006-08-24 | 2007-02-21 | 中山大学 | Device of controlling receiving destance and authority for digital TV set |
| CN101437124A (en) * | 2008-12-17 | 2009-05-20 | 三星电子（中国）研发中心 | Method for processing dynamic gesture identification signal facing (to)television set control |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103295028A (en) | 2013-09-11 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103295028B (en) | gesture operation control method, device and intelligent display terminal | |
| CN102193626B (en) | Gesture recognition apparatus, and method for controlling gesture recognition apparatus | |
| US20180048482A1 (en) | Control system and control processing method and apparatus | |
| CN110495819B (en) | Robot control method, robot, terminal, server and control system | |
| CN102200830A (en) | Non-contact control system and control method based on static gesture recognition | |
| CN109074819A (en) | Preferred control method based on operation-sound multi-mode command and the electronic equipment using it | |
| CN108052079A (en) | Apparatus control method, device, plant control unit and storage medium | |
| JP2015095164A (en) | Gesture recognition device and control method for gesture recognition device | |
| CN105042789B (en) | The control method and system of a kind of intelligent air condition | |
| CN106454071A (en) | Terminal and automatic shooting method based on gestures | |
| CN110426962A (en) | A kind of control method and system of smart home device | |
| US11816924B2 (en) | Method for behaviour recognition based on line-of-sight estimation, electronic equipment, and storage medium | |
| US11816266B2 (en) | Method of developing a database of controllable objects in an environment | |
| CN110604579A (en) | Data acquisition method, device, terminal and storage medium | |
| CN113934307B (en) | Method for starting electronic equipment according to gestures and scenes | |
| CN107452381B (en) | Multimedia voice recognition device and method | |
| CN103294195A (en) | Remote control device and remote control method both based on gesture recognition | |
| CN108415572B (en) | Module control method and device applied to mobile terminal and storage medium | |
| CN112655021A (en) | Image processing method, image processing device, electronic equipment and storage medium | |
| CN106997449A (en) | Robot and face identification method with face identification functions | |
| CN108513156A (en) | A kind of control method and device based on Intelligent Laser TV | |
| CN110162204A (en) | The method that the method, apparatus and control for triggering functions of the equipments carry out image capture | |
| WO2021170062A1 (en) | Method for adjusting air gesture and terminal | |
| CN107749942A (en) | Suspension image pickup method, mobile terminal and computer-readable recording medium | |
| CN111007806B (en) | Smart home control method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |