CN108594995A - Electronic equipment operation method based on gesture recognition and electronic equipment - Google Patents
Electronic equipment operation method based on gesture recognition and electronic equipment Download PDFInfo
- Publication number
- CN108594995A CN108594995A CN201810333928.XA CN201810333928A CN108594995A CN 108594995 A CN108594995 A CN 108594995A CN 201810333928 A CN201810333928 A CN 201810333928A CN 108594995 A CN108594995 A CN 108594995A
- Authority
- CN
- China
- Prior art keywords
- target
- electronic equipment
- gesture path
- hand
- target gesture
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 57
- 230000000007 visual effect Effects 0.000 claims description 25
- 238000001514 detection method Methods 0.000 claims description 18
- 230000001960 triggered effect Effects 0.000 claims description 5
- 108010001267 Protein Subunits Proteins 0.000 claims description 4
- 230000003993 interaction Effects 0.000 abstract description 12
- 238000005516 engineering process Methods 0.000 description 18
- 230000011218 segmentation Effects 0.000 description 13
- 238000003860 storage Methods 0.000 description 10
- 238000004590 computer program Methods 0.000 description 9
- 238000010586 diagram Methods 0.000 description 8
- 238000006073 displacement reaction Methods 0.000 description 7
- 230000006399 behavior Effects 0.000 description 6
- 238000000605 extraction Methods 0.000 description 4
- 238000003384 imaging method Methods 0.000 description 4
- 238000007781 pre-processing Methods 0.000 description 4
- 238000007619 statistical method Methods 0.000 description 4
- 210000003813 thumb Anatomy 0.000 description 4
- 238000004891 communication Methods 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 210000004247 hand Anatomy 0.000 description 3
- 238000013459 approach Methods 0.000 description 2
- 238000004422 calculation algorithm Methods 0.000 description 2
- 230000008859 change Effects 0.000 description 2
- 230000008878 coupling Effects 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 238000011017 operating method Methods 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- OKTJSMMVPCPJKN-UHFFFAOYSA-N Carbon Chemical compound [C] OKTJSMMVPCPJKN-UHFFFAOYSA-N 0.000 description 1
- 230000009471 action Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 229910052799 carbon Inorganic materials 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 230000003760 hair shine Effects 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 230000014759 maintenance of location Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 238000002360 preparation method Methods 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 230000003716 rejuvenation Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 239000011800 void material Substances 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
An electronic device operation method based on gesture recognition and an electronic device comprise: the electronic device can acquire a target gesture track (for example, slide downwards) and determine basic information such as a deviation direction of the target gesture track relative to a straight track; then, whether the target gesture track is drawn by the left hand or the right hand or is drawn by the left hand and the right hand or both is determined according to the basic information, so that the diversity of the scheme can be increased, and the gesture recognition accuracy is improved; furthermore, the electronic device determines the target gesture track as the target gesture track of the corresponding operating hand and executes a corresponding instruction (for example, if the left hand slides down, a menu is pulled down, and if the right hand slides down, a background application program list is called), so that the efficiency of the user operation task can be improved without increasing the complexity of the gesture. By implementing the embodiment of the invention, the diversity of gesture interaction modes can be improved.
Description
Technical field
The present invention relates to technical field of electronic equipment, and in particular to a kind of electronic device method based on gesture identification
And electronic equipment.
Background technology
In the various ways that the mankind carry out information exchange, gesture occupies considerable status.It is compared with spoken and written languages,
The versatility of gesture is wider, universality higher.With the emergence of mobile Internet, the multiple sensors that electronic equipment carries can
Hardware foundation is provided for gesture identification, to provide more friendly man-machine interaction mode.Also, the full frame operation phase of electronic equipment
For multi-window operation pattern, being more suitable for using gesture is operated, because in fixed area, gesture has sole operation
Characteristic.
From the point of view of angles of product, gesture has got through information level.Since information is mapped to electronic equipment void from real world
It will be limited by physical size in quasi- space, all information can not once be presented, so people are according to physical world
All around latitude establishes information level and module so that the screen of electronic equipment obtains bigger extension, is having convenient for user
The more information of input in the physical space of limit, for example, people can be by the page that horizontally slips to switch different in screen
And breathe out drop-down menu etc. with the mode of drop-down.With gradually increasing for electronic functionalities, how electronic equipment is enriched
Gesture interaction mode be particularly important.
Invention content
The embodiment of the invention discloses the operating method of a kind of electronic equipment and electronic equipments, can improve gesture interaction side
The diversity of formula.
First aspect of the embodiment of the present invention discloses a kind of electronic device method based on gesture identification, the method
Including：
The electronic equipment obtains target gesture path, and determines essential information corresponding with the target gesture path；
Wherein, the essential information includes at least offset direction of the target gesture path relative to straight path；
The electronic equipment identifies the manipulator for triggering the target gesture path according to the essential information；
The electronic equipment generates and the operation according to the manipulator and the target gesture path identified
The operational order that hand and the target gesture path match, and execute operation corresponding with the operational order, the behaviour
Include left hand, the right hand or right-hand man's combination as hand.
As an alternative embodiment, in first aspect of the embodiment of the present invention, the electronic equipment obtains target
Gesture path, including：
The electronic equipment detects whether the user's operation for the touch screen for having for the electronic equipment；
If detecting the user's operation, the electronic equipment identifies the user's operation touching in the electronic equipment
The two-dimentional track on screen is touched, as target gesture path；
If the user's operation is not detected, the electronic equipment judges regarding for the electronic equipment based on machine vision
Feel and whether there is target hand in range, the target hand matches with default hand model；
If there is the target hand, the electronic equipment identifies the dynamic 3 D gesture of the target hand, as target
Gesture path.
As an alternative embodiment, in first aspect of the embodiment of the present invention, the electronic equipment is according to
Before manipulator of the essential information identification for triggering the target gesture path, the method further includes：
When the target gesture path is the two-dimentional track, the electronic equipment acquires corresponding to the user's operation
Target fingerprint；
The electronic equipment judge the target fingerprint whether with default legal fingerprint matches；
It is identified according to the essential information for triggering the target gesture if so, the electronic equipment execution is described
The manipulator of track.
As an alternative embodiment, in first aspect of the embodiment of the present invention, the essential information further includes institute
State the initial position of target gesture path；
The electronic equipment identifies the manipulator for triggering the target gesture path, packet according to the essential information
It includes：
When the target gesture path is the two-dimentional track, the electronic equipment determines the number of the initial position
Amount；
If the quantity of the initial position is greater than or equal to two, the electronic equipment judge in value set whether
In the presence of the distance value more than pre-determined distance, the start bit described in any two in all initial positions apart from value set
The distance between set value composition；
If the distance value existed in value set more than the pre-determined distance, the electronic equipment determine triggering
The manipulator of the target gesture path combines for right-hand man；
If described, there is no the distance value for being more than the pre-determined distance or if the initial positions in value set
Quantity be equal to 1 when, the electronic equipment according to the target gesture path relative to straight path offset direction identify use
In the manipulator for triggering the target gesture path, wherein offset direction of the target gesture path relative to straight path
When being left, the manipulator be left hand, the target gesture path relative to straight path offset direction be it is right when, the behaviour
It is the right hand to make hand.
As an alternative embodiment, in first aspect of the embodiment of the present invention, the electronic equipment is according to
Essential information identifies the manipulator for triggering the target gesture path, including：
The electronic equipment is according to the target fingerprint and essential information identification for triggering the target gesture rail
The manipulator of mark.
Second aspect of the embodiment of the present invention discloses a kind of electronic equipment, and the electronic equipment includes：
Acquiring unit, for obtaining target gesture path；
Determination unit, for determining essential information corresponding with the target gesture path；Wherein, the essential information is extremely
Include offset direction of the target gesture path relative to straight path less；
Recognition unit, for identifying the manipulator for triggering the target gesture path according to the essential information；
Generation unit, for according to the manipulator and the target gesture path identified, generating and the behaviour
Make hand and operational order that the target gesture path matches, and executes operation corresponding with the operational order, it is described
Manipulator includes left hand, the right hand or right-hand man's combination.
As an alternative embodiment, in second aspect of the embodiment of the present invention, the acquiring unit includes：
Detection sub-unit, for detecting whether there is the user's operation of the touch screen for the electronic equipment；
Identify subelement, the use for detecting the presence of the touch screen for the electronic equipment in the detection sub-unit
After the operation of family, two-dimentional track of the user's operation on the touch screen of the electronic equipment is identified, as target gesture rail
Mark；
Judgment sub-unit, for being not detected in the presence of the touch screen for the electronic equipment in the detection sub-unit
After user's operation, judge to whether there is target hand, the target in the visual range of the electronic equipment based on machine vision
Hand matches with default hand model；
The identification subelement is additionally operable to after the judgment sub-unit is judged there are the target hand, identifies institute
The dynamic 3 D gesture for stating target hand, as target gesture path.
As an alternative embodiment, in second aspect of the embodiment of the present invention, the electronic equipment further includes：
Collecting unit, for being identified according to the essential information for triggering the target gesture rail in the recognition unit
Before the manipulator of mark, and when the target gesture path is the two-dimentional track, acquire corresponding to the user's operation
Target fingerprint；
Judging unit, for judge the target fingerprint whether with default legal fingerprint matches；
The recognition unit, specifically for judging the target fingerprint and default legal fingerprint phase in the judging unit
After matching, the manipulator for triggering the target gesture path is identified according to the essential information.
As an alternative embodiment, in second aspect of the embodiment of the present invention, the essential information further includes institute
State the initial position of target gesture path；
The recognition unit identifies the side of the manipulator for triggering the target gesture path according to the essential information
Formula is specially：
When the target gesture path is the two-dimentional track, the quantity of the initial position is determined；
After the quantity for determining the initial position is greater than or equal to two, judge to whether there is in value set
More than the distance value of pre-determined distance, the initial position described in any two in all initial positions apart from value set it
Between distance value composition；
Judge it is described in value set exist more than the pre-determined distance distance value after, determine triggering described in
The manipulator of target gesture path combines for right-hand man；
It is not deposited after the quantity for the initial position determined is equal to 1, or judging described in value set
After the distance value more than the pre-determined distance, the offset direction according to the target gesture path relative to straight path is known
The manipulator of the target gesture path Yong Yu not triggered, wherein deviation of the target gesture path relative to straight path
Direction be it is left when, the manipulator be left hand, the target gesture path relative to straight path offset direction be it is right when, institute
It is the right hand to state manipulator.
As an alternative embodiment, in second aspect of the embodiment of the present invention, the recognition unit is according to
Essential information identifies that the mode of the manipulator for triggering the target gesture path is specially：
The manipulator for triggering the target gesture path is identified according to the target fingerprint and the essential information.
The third aspect of the embodiment of the present invention discloses a kind of electronic equipment, including：
It is stored with the memory of executable program code；
The processor coupled with the memory；
The processor calls the executable program code stored in the memory, executes the embodiment of the present invention the
On the one hand the disclosed electronic device method based on gesture identification.
Fourth aspect of the embodiment of the present invention discloses a kind of computer readable storage medium, stores computer program,
In, the computer program makes computer execute the electronics based on gesture identification disclosed in first aspect of the embodiment of the present invention and set
Standby operating method.
The 5th aspect of the embodiment of the present invention discloses a kind of computer program product, when the computer program product is being counted
When being run on calculation machine so that the computer executes the electronic device method based on gesture identification disclosed in first aspect.
Compared with prior art, the embodiment of the present invention has the advantages that：
In the embodiment of the present invention, electronic equipment can obtain target gesture path (for example, slide downward), and determine mesh
Mark the essential information of the offset direction of gesture path relative to straight path etc.；The target gesture is determined further according to essential information
Track is that left hand is drawn or the right hand is drawn also or right-hand man draws jointly, can increase the diversity of scheme in this way while go back
Improve the recognition accuracy of gesture；In turn, target gesture path is determined as the target hand of corresponding manipulator by electronic equipment again
Gesture track and execute corresponding instruction (for example, if it is left hand slide downward, then drop-down menu；If it is right hand slide downward,
Then breathe out background application list), user's operation task can be improved in the case where not increasing gesture complexity in this way
Efficiency.In conclusion implementing the embodiment of the present invention, gesture can be improved in such a way that more gesture interaction schemes are provided
The diversity of interactive mode.
Description of the drawings
It to describe the technical solutions in the embodiments of the present invention more clearly, below will be to needed in the embodiment
Attached drawing is briefly described, it should be apparent that, drawings in the following description are only some embodiments of the invention, for ability
For the those of ordinary skill of domain, without creative efforts, it can also be obtained according to these attached drawings other attached
Figure.
Fig. 1 is a kind of flow signal of electronic device method based on gesture identification disclosed by the embodiments of the present invention
Figure；
Fig. 2 is the flow signal of another electronic device method based on gesture identification disclosed by the embodiments of the present invention
Figure；
Fig. 3 is the structural schematic diagram of a kind of electronic equipment disclosed by the embodiments of the present invention；
Fig. 4 is the structural schematic diagram of another electronic equipment disclosed by the embodiments of the present invention；
Fig. 5 is the structural schematic diagram of another electronic equipment disclosed by the embodiments of the present invention.
Specific implementation mode
Following will be combined with the drawings in the embodiments of the present invention, and technical solution in the embodiment of the present invention carries out clear, complete
Site preparation describes, it is clear that described embodiment is only a part of the embodiment of the present invention, instead of all the embodiments.Based on this
Embodiment in invention, every other reality obtained by those of ordinary skill in the art without making creative efforts
Example is applied, shall fall within the protection scope of the present invention.
It should be noted that the term " comprising " and " having " in the embodiment of the present invention and attached drawing and their any changes
Shape, it is intended that cover and non-exclusive include.Such as contain the process of series of steps or unit, method, system, product or
Equipment is not limited to the step of having listed or unit, but further includes the steps that optionally not listing or unit or optional
Ground further includes for the intrinsic other steps of these processes, method, product or equipment or unit.
The embodiment of the invention discloses a kind of electronic device method and electronic equipment based on gesture identification, Neng Gouti
The diversity of high gesture interaction mode.It is described in detail separately below.
Embodiment one
Referring to Fig. 1, Fig. 1 is a kind of electronic device method based on gesture identification disclosed by the embodiments of the present invention
Flow diagram.The electronic device method based on gesture identification is somebody's turn to do as shown in Figure 1 to may comprise steps of：
101, electronic equipment obtains target gesture path.
In the embodiment of the present invention, electronic equipment can pass through at least one of touch screen, camera and laser sensor
Target gesture path is obtained, the embodiment of the present invention is not construed as limiting.Target gesture path can be that two-dimentional track can also be three-dimensional
Track, the embodiment of the present invention are not construed as limiting.
102, electronic equipment determines essential information corresponding with target gesture path；Wherein, essential information includes at least mesh
Mark offset direction of the gesture path relative to straight path.
In the embodiment of the present invention, essential information can also include initial position, final position and the phase of target gesture path
For the departure degree of straight path.Wherein, human hand carries out being limited by physiological structure when quick gesture operation on the screen,
That is, if human hand holds the edge of electronic equipment and marks a track, this track on the screen by thumb
The camber line similar together for not being then straight line but being drawn on the screen as centre point using the artis between thumb and palm
Curve.Electronic equipment can determine manipulator's (example of target gesture path by determining the arc core similar to the curve of camber line
Such as, left hand), improve the recognition accuracy to target gesture path.
103, electronic equipment identifies the manipulator for triggering target gesture path according to essential information.
Optionally, electronic equipment identifies that the mode of the manipulator for triggering target gesture path is specific according to essential information
For：
Electronic equipment can be according to the initial position of target gesture path, final position and mark gesture rail in essential information
Offset direction of the mark relative to straight path judges the arc core of target gesture path on the left side of target gesture path or the right side
Side；
If in the left side of target gesture path, electronic equipment determines that manipulator is left hand；If in target gesture path
Right side, electronic equipment determine manipulator be the right hand.
As it can be seen that implementing the optional embodiment, can be further determined that by the determination to target gesture path arc core
The manipulator for going out to draw target gesture path improves the identification accuracy to target gesture path.
104, electronic equipment generates and manipulator and target gesture according to the manipulator and target gesture path identified
The operational order that track matches, and operation corresponding with operational order is executed, manipulator includes left hand, the right hand or right-hand man
Combination.
It is another optional, in step 104 according to the manipulator and target gesture path identified, generation and manipulator
Before the operational order to match with target gesture path, and step 103 according to essential information identify for triggering target
After the manipulator of gesture path, electronic equipment can obtain current interface.Wherein, electronic equipment is according to the manipulator identified
And target gesture path, the operational order to match with manipulator and target gesture path is generated, may include：
Electronic equipment generates and manipulator, target according to manipulator, target gesture path and the current interface identified
The operational order that gesture path and current interface match.
For example, if on current interface is video playing interface, manipulator is the right hand and target gesture path is
Sliding rail mark, the then operational order that electronic equipment generates are the out code for the broadcast interface for closing current video；
If current interface is video playing interface, manipulator is left hand and target gesture path is upper sliding rail mark,
The operational order that electronic equipment generates is the play instruction for playing next video；
If current interface is electronic equipment main interface, manipulator is the right hand and target gesture path is upper sliding rail mark,
The operational order that then electronic equipment generates instructs for elevated volume；
If current interface is electronic equipment main interface, manipulator is left hand and target gesture path is upper sliding rail mark,
The operational order that then electronic equipment generates is exhalation background application instruction.
As it can be seen that implementing the optional embodiment of the another kind, identical gesture path combination current interface can be directed to
Different and manipulator difference, generates different instructions, compared with the existing technology in only consider gesture path and current interface
Mode, which can enrich gesture interaction scheme in the case where not increasing gesture complexity, i.e., by
One gesture of different operation hand triggering corresponds to different instructions at identical interface.
As it can be seen that implementing method described in Fig. 1, electronic equipment can improve the identification accuracy to target gesture path；
It can also enrich gesture interaction scheme in the case where not increasing gesture complexity, i.e., triggered by different operation hand identical
Gesture corresponds to different instructions at identical interface.
Embodiment two
Referring to Fig. 2, Fig. 2 is another electronic device method based on gesture identification disclosed by the embodiments of the present invention
Flow diagram.The electronic device method based on gesture identification is somebody's turn to do as shown in Figure 2 to may comprise steps of：
201, electronic equipment detects whether the user's operation for the touch screen for having for electronic equipment, if it is, executing
Step 202, if not, thening follow the steps 203.
202, two-dimentional track of the electronic equipment identification user's operation on the touch screen of electronic equipment, as target gesture rail
Mark, and execute step 205.
In the embodiment of the present invention, when the judging result of step 201 is to be, and before executing step 202, this is based on
The electronic device method of gesture identification can also include following operation：
Electronic equipment judges whether the user's operation is a certain handle icon for the touch screen display of electronic equipment
Touch control operation, when judging result is to be, electronic equipment executes operation corresponding with a certain handle icon, such as opens immediately
The operation etc. of communication applications；When judging result is no, triggering executes step 202.The erroneous judgement of electronic equipment can be reduced in this way
Disconnected operation, improves the accuracy of identification target gesture path.
203, electronic equipment judges to whether there is target hand, target hand in the visual range of electronic equipment based on machine vision
Match with default hand model, if so, 204 are thened follow the steps, if not, thening follow the steps 203.
In the embodiment of the present invention, electronic equipment judges to whether there is mesh in the visual range of electronic equipment based on machine vision
The technology used may include at least one of template matching technique, statistical analysis technique and nerual network technique when marking hand,
The embodiment of the present invention is not construed as limiting.Wherein, template matching technique can be by the characteristic parameter of gesture to be identified and preset template
Characteristic parameter is compared, and gesture identification work is completed according to comparison result；Statistical analysis technique can pass through statistical sample spy
Vector is levied to determine the grader for gesture identification；Nerual network technique has the characteristics that distributivity and pattern Generalization Ability,
Effective antinoise and endless integral pattern can be handled in gesture identification.
Optionally, electronic equipment judges to whether there is the side of target hand in the visual range of electronic equipment based on machine vision
Formula is specially：
Electronic equipment carries out Image Acquisition by the camera of electronic equipment in visual range, obtains initial pictures；
Electronic equipment carries out image preprocessing to obtain target image to initial pictures；
Electronic equipment carries out hand feature extraction to target image, and according to extracting hand feature and preset standard hand it is special
Sign is compared, and judges to whether there is target hand in the visual range of electronic equipment further according to comparison result.
In the optional embodiment, the image preprocessing that electronic equipment carries out initial pictures includes, to initial graph
As carrying out Hand Gesture Segmentation.Wherein, electronic equipment may be used following three kinds of methods and carry out Hand Gesture Segmentation to initial pictures：First,
Electronic equipment can be based on the Hand Gesture Segmentation realized to the segmentation of histogram to initial pictures；Second, electronic equipment can be based on
The Hand Gesture Segmentation to initial pictures is realized in the segmentation of the information of localized region (for example, edge of initial pictures)；Third, electronics
Equipment can be based on Hand Gesture Segmentation of physical features (for example, colour of skin clustering procedure based on the color space) realization to initial pictures.
The embodiment of the present invention is not construed as limiting.
In the optional embodiment, electronic equipment carries out the hand feature that hand feature extraction obtains to target image to be wrapped
Include at least one of contour feature, edge feature, image moment characteristics, image feature vector and region histogram feature, this hair
Bright embodiment is not construed as limiting.
As it can be seen that implement the optional embodiment, it can be by handling the initial pictures got, to extract
The feature of hand in image, and then realize the identification to gesture, gesture identification scheme can be increased, and by two-dimentional gesture
With the identification of three-dimension gesture, expand identification range.
As another optional embodiment, electronic equipment can judge the vision model of electronic equipment based on machine vision
Enclosing the interior mode with the presence or absence of target hand is specially：
Electronic equipment can according to structured light technique, and judged based on machine vision be in the visual range of electronic equipment
It is no that there are target hands.
In the optional embodiment of the another kind, electronic equipment can utilize structured light technique to load a laser projection
Device, and by putting a grating for being carved with certain patterns outside laser projecting apparatus, so that laser is finally in manipulator
On drop point generate displacement.If there are target hands in the visual range of electronic equipment, and when target hand is apart from laser projecting apparatus
When closer, the displacement for reflecting and generating is just smaller；Target hand apart from laser projecting apparatus farther out when, refraction and generate position
Shifting will also become larger accordingly.At this moment the figure of target on hand can be projected to detect acquisition using the camera of electronic equipment
Sample, and the depth information of the position and the relative laser projector of target hand is calculated by the change in displacement of pattern, and then restore
Entire three dimensions where target hand.
As it can be seen that implementing the optional embodiment of the another kind, integrated structure light technology and realizing of Robot Vision can be passed through
Detection to target hand can not only judge to whether there is target hand in electronic equipment visual range in this approach, moreover it is possible to
The position for enough determining target hand, improves the accuracy of detection to target hand.
As another optional embodiment, electronic equipment can judge the vision model of electronic equipment based on machine vision
Enclosing the interior mode with the presence or absence of target hand is specially：
Electronic equipment can fly time technology according to light, and be judged in the visual range of electronic equipment based on machine vision
With the presence or absence of target hand.
At this in another optional embodiment, electronic equipment can fly time technology according to light and load the member that shines
Part, since the photon that light-emitting component is sent out can reflect after encountering target watch face, so, electronic equipment can use one
A special cmos sensor is sent out capturing these by light-emitting component and from the reflected photon of target watch face, energy
Obtain the flight time of photon.The distance that photon flight can be extrapolated in turn according to photon flight time, is also just regarded
Feel and whether there is target hand in range, and in the presence of target hand, obtains the depth information of target hand.
As it can be seen that implement another optional embodiment, flying time technology by light realizes detection to target hand
Work, the accuracy of identification that light can be utilized to fly time technology raising to target hand.
As another optional embodiment, electronic equipment can judge the vision model of electronic equipment based on machine vision
Enclosing the interior mode with the presence or absence of target hand is specially：
Electronic equipment can be judged according to polygonal imaging technique, and based on machine vision in the visual range of electronic equipment
With the presence or absence of target hand.
At this in another optional embodiment, electronic equipment can absorb figure simultaneously by least two cameras
Picture calculates depth information, to real by comparing the difference for the image that different cameras are obtained in synchronization using algorithm
Now when in visual range there are when target hand, the multi-angle three-dimensional imaging of target hand.
As it can be seen that implementing another optional embodiment, the image of target hand by multi-angled shooting, can be realized
It precisely quickly captures, improves the recognition efficiency to target hand.
204, the dynamic 3 D gesture of electronic equipment identification target hand, as target gesture path, and executes step 205.
For example, dynamic 3 D gesture can be that target hand is made from left to right in the case of not contacting electronic equipments
The action instigated, at this point, target gesture path can be by a left-to-right track (for example, camber line).
205, electronic equipment determines essential information corresponding with target gesture path；Wherein, essential information includes at least mesh
Mark offset direction of the gesture path relative to straight path.
In the embodiment of the present invention, after determining the corresponding essential information of target gesture path, if the target gesture rail
Mark is three-dimensional track, then can directly trigger and execute step 208；If the target gesture path is two-dimentional track, can be straight
Contact hair step 208, can also directly trigger and execute step 206 (as shown in Figure 2), the embodiment of the present invention does not limit.
206, the target fingerprint corresponding to electronic equipment acquisition user's operation.
In the embodiment of the present invention, after the target fingerprint corresponding to step 206 acquisition user's operation, step 207 is executed
Judge target fingerprint whether with preset legal fingerprint matches operation.
207, electronic equipment judge target fingerprint whether with default legal fingerprint matches, if so, thening follow the steps
208, if not, thening follow the steps 207.
In the embodiment of the present invention, electronic equipment can improve information in electronic equipment by the acquisition to target fingerprint
Safety, additionally it is possible to manipulator is determined by the essential information of combining target fingerprint and target gesture path, and then is improved
The identification accuracy of target gesture path.
Optionally, if electronic equipment judges that target fingerprint is mismatched with default legal fingerprint, electronic equipment can not
Execute any operation；Screen locking can also be carried out, to prevent disabled user from invading；It can also be judged by iris recognition technology current
Whether user is validated user, operates and detects whether wearable in the presence of being connect with electronic equipment if it is not, then executing screen locking
Equipment, if it is present the prompt message for prompting electronic equipment to be used by illegal user is sent to wearable device, this
Inventive embodiments are not construed as limiting.
As it can be seen that executing the optional embodiment, electronic equipment can be avoided to be used by disabled user, improve electronics and set
Standby safety.
In embodiments of the present invention, it further includes step 208- steps to be somebody's turn to do the electronic device method based on gesture identification
209, for the description of step 208- steps 209, the detailed description that step 103- steps 104 are directed in embodiment one is please referred to,
The embodiment of the present invention repeats no more.
As an alternative embodiment, in the electronic device method based on gesture identification, essential information
It further include the initial position of target gesture path；Electronic equipment identifies the behaviour for triggering target gesture path according to essential information
Make hand, may comprise steps of：
When target gesture path is two-dimentional track, electronic equipment determines the quantity of initial position；
If the quantity of initial position is greater than or equal to two, electronic equipment, which judges to whether there is in value set, to be more than
The distance value of pre-determined distance is made of apart from value set the distance between any two initial position in all initial positions value；
If there is the distance value more than pre-determined distance in value set, electronic equipment determines triggering target gesture path
Manipulator be right-hand man combination；
If the distance value more than pre-determined distance is not present in value set or if the quantity of initial position is equal to 1
When, offset direction of the electronic equipment according to target gesture path relative to straight path is identified for triggering target gesture path
Manipulator, wherein target gesture path relative to straight path offset direction be it is left when, manipulator is left hand, target gesture
Track relative to straight path offset direction be it is right when, manipulator is the right hand.
As it can be seen that implementing the optional embodiment, distance between the quantity and initial position to initial position can be passed through
Detection, manipulator is more accurately determined, to further increase the identification accuracy to target gesture path.
As another optional embodiment, at this in electronic device method based on gesture identification, electronics is set
It is standby to identify that the mode of the manipulator for triggering target gesture path is specially according to essential information：
Electronic equipment identifies the manipulator for triggering target gesture path according to target fingerprint and essential information.
As it can be seen that implement the optional embodiment of the another kind, combining target fingerprint and target gesture path can be passed through
Essential information determines manipulator, to improve the identification accuracy to target gesture path.
As it can be seen that implementing method described in Fig. 2, electronic equipment can improve the identification accuracy to target gesture path；
Gesture interaction scheme can also be enriched, i.e., a gesture is at different interfaces pair in the case where not increasing gesture complexity
Answer different instructions；The safety of information in electronic equipment can also be improved by the acquisition to target fingerprint, additionally it is possible to
Manipulator is determined by the essential information of combining target fingerprint and target gesture path, further improves target gesture path
Identify accuracy.
Embodiment three
Referring to Fig. 3, Fig. 3 is the structural schematic diagram of a kind of electronic equipment disclosed by the embodiments of the present invention.As shown in figure 3,
The electronic equipment may include：Acquiring unit 301, determination unit 302, recognition unit 303 and generation unit 304, wherein：
Acquiring unit 301, for obtaining target gesture path.
In the embodiment of the present invention, acquiring unit 301 can pass through in touch screen, camera and laser sensor at least one
Kind obtains target gesture path, and the embodiment of the present invention is not construed as limiting.Target gesture path can be that two-dimentional track can also be three
Track is tieed up, the embodiment of the present invention is not construed as limiting.
In the embodiment of the present invention, after acquiring unit 301 obtains target gesture path, target gesture path is supplied to
Determination unit 302 and generation unit 304.
Determination unit 302, for determining essential information corresponding with target gesture path；Wherein, essential information is at least wrapped
Include offset direction of the target gesture path relative to straight path.
In the embodiment of the present invention, essential information can also include initial position, final position and the phase of target gesture path
For the departure degree of straight path.Wherein, human hand carries out being limited by physiological structure when quick gesture operation on the screen,
That is, if human hand holds the edge of electronic equipment and marks a track, this track on the screen by thumb
The camber line similar together for not being then straight line but being drawn on the screen as centre point using the artis between thumb and palm
Curve.Determination unit 302 can determine the manipulator of target gesture path by determining the arc core similar to the curve of camber line
(for example, left hand) improves the recognition accuracy to target gesture path.
In the embodiment of the present invention, after determination unit 302 determines essential information corresponding with target gesture path, by base
This information is supplied to recognition unit 303.
Recognition unit 303, for identifying the manipulator for triggering target gesture path according to essential information.
Optionally, recognition unit 303 identifies the mode of the manipulator for triggering target gesture path according to essential information
Specially：
Recognition unit 303 can be according to the initial position of target gesture path, final position and mark hand in essential information
Offset direction of the gesture track relative to straight path, judge the arc core of target gesture path the left side of target gesture path still
Right side；
If in the left side of target gesture path, recognition unit 303 determines that manipulator is left hand；If in target gesture rail
The right side of mark, recognition unit 303 determine that manipulator is the right hand.
As it can be seen that implementing the optional embodiment, can be further determined that by the determination to target gesture path arc core
The manipulator for going out to draw target gesture path improves the identification accuracy to target gesture path.
In the embodiment of the present invention, the behaviour in recognition unit 303 according to essential information identification for triggering target gesture path
After making hand, the manipulator that will identify that is supplied to generation unit 304.
Generation unit 304, for according to the manipulator and target gesture path identified, generating and manipulator and target
The operational order that gesture path matches, and operation corresponding with operational order is executed, manipulator includes left hand, the right hand or a left side
The right hand combines.
It is another optional, in generation unit 304 according to the manipulator and target gesture path identified, generates and grasp
Before making hand and operational order that target gesture path matches, and it is used for according to essential information identification in recognition unit 303
After the manipulator for triggering target gesture path, generation unit 304 can obtain current interface.Wherein, 304 basis of generation unit
The manipulator identified and target gesture path generate the operational order to match with manipulator and target gesture path, can
To include：
Generation unit 304 according to manipulator, target gesture path and the current interface identified, generate with manipulator,
The operational order that target gesture path and current interface match.
As it can be seen that implementing the optional embodiment of the another kind, identical gesture path combination current interface can be directed to
Different and manipulator difference, generates different instructions, compared with the existing technology in only consider gesture path and current interface
Mode, which can enrich gesture interaction scheme in the case where not increasing gesture complexity, i.e., by
One gesture of different operation hand triggering corresponds to different instructions at identical interface.
As it can be seen that electronic equipment described in implementing Fig. 3 can improve the identification accuracy to target gesture path；It can also
In the case where not increasing gesture complexity, gesture interaction scheme is enriched, i.e., the same gesture triggered by different operation hand exists
Identical interface corresponds to different instructions.
Example IV
Referring to Fig. 4, Fig. 4 is the structural schematic diagram of another electronic equipment disclosed by the embodiments of the present invention.Wherein, Fig. 4
Shown in electronic equipment be that electronic equipment as shown in Figure 3 optimizes.Electronic equipment as shown in figure 3 compares,
Acquiring unit 301 may include detection sub-unit 3011, identification subelement 3012 and judgment sub-unit 3013.Wherein：
Detection sub-unit 3011, for detecting whether there is the user's operation of the touch screen for electronic equipment.
Identify subelement 3012, the use for detecting the presence of the touch screen for electronic equipment in detection sub-unit 3011
After the operation of family, two-dimentional track of the identification user's operation on the touch screen of electronic equipment, as target gesture path.
Judgment sub-unit 3013, for being not detected in the presence of the touch screen for electronic equipment in detection sub-unit 3011
After user's operation, judge to whether there is target hand in the visual range of electronic equipment based on machine vision, target hand with it is default
Hand model matches.
In the embodiment of the present invention, judgment sub-unit 3013 based on machine vision judge in the visual range of electronic equipment whether
There are the technology used when target hand may include in template matching technique, statistical analysis technique and nerual network technique at least
One kind, the embodiment of the present invention are not construed as limiting.Wherein, template matching technique can by the characteristic parameter of gesture to be identified with it is preset
Template characteristic parameter is compared, and gesture identification work is completed according to comparison result；Statistical analysis technique can be by counting sample
Eigen vector determines the grader for gesture identification；Nerual network technique has the characteristics that distributivity and pattern promote energy
Power effective antinoise and can handle endless integral pattern in gesture identification.
Optionally, judgment sub-unit 3013 judges to whether there is target in the visual range of electronic equipment based on machine vision
The mode of hand is specially：
Judgment sub-unit 3013 carries out Image Acquisition by the camera of electronic equipment in visual range, obtains initial graph
Picture；
Judgment sub-unit 3013 carries out image preprocessing to obtain target image to initial pictures；
Judgment sub-unit 3013 carries out hand feature extraction to target image, and is marked with pre- according to the hand feature to extracting
Quasi- hand feature is compared, and judges to whether there is target hand in the visual range of electronic equipment further according to comparison result.
In the optional embodiment, the image preprocessing that judgment sub-unit 3013 carries out initial pictures includes, right
Initial pictures carry out Hand Gesture Segmentation.Wherein, judgment sub-unit 3013 may be used following three kinds of methods and carry out hand to initial pictures
Gesture is divided：First, judgment sub-unit 3013 can be based on the Hand Gesture Segmentation realized to the segmentation of histogram to initial pictures；The
Two, the segmentation that judgment sub-unit 3013 can be based on the information of localized region (for example, edge of initial pictures) is realized to first
The Hand Gesture Segmentation of beginning image；Third, judgment sub-unit 3013 can be based on physical features (for example, the colour of skin based on color space
Clustering procedure) it realizes to the Hand Gesture Segmentations of initial pictures.The embodiment of the present invention is not construed as limiting.
In the optional embodiment, judgment sub-unit 3013 carries out target image the hand feature that hand feature extraction obtains
May include at least one in contour feature, edge feature, image moment characteristics, image feature vector and region histogram feature
Kind, the embodiment of the present invention is not construed as limiting.
As it can be seen that implement the optional embodiment, it can be by handling the initial pictures got, to extract
The feature of hand in image, and then realize the identification to gesture, gesture identification scheme can be increased, and by two-dimentional gesture
With the identification of three-dimension gesture, expand identification range.
As another optional embodiment, judgment sub-unit 3013 can judge electronic equipment based on machine vision
Mode in visual range with the presence or absence of target hand is specially：
Judgment sub-unit 3013 can be according to structured light technique, and judges based on machine vision the vision model of electronic equipment
It whether there is target hand in enclosing.
In the optional embodiment of the another kind, judgment sub-unit 3013 can utilize structured light technique load one to swash
Light projector, and by putting a grating for being carved with certain patterns outside laser projecting apparatus, so that laser finally exists
Drop point on manipulator generates displacement.If there are target hands in the visual range of electronic equipment, and when target hand is apart from laser
When the projector is closer, the displacement for reflecting and generating is just smaller；Target hand apart from laser projecting apparatus farther out when, refraction and produce
Raw displacement will also become larger accordingly.At this moment target can be projected on hand to detect acquisition using the camera of electronic equipment
Pattern, and calculate by the change in displacement of pattern the depth information of the position and the relative laser projector of target hand, in turn
Entire three dimensions where rejuvenation target hand.
As it can be seen that implementing the optional embodiment of the another kind, integrated structure light technology and realizing of Robot Vision can be passed through
Detection to target hand can not only judge to whether there is target hand in electronic equipment visual range in this approach, moreover it is possible to
The position for enough determining target hand, improves the accuracy of detection to target hand.
As another optional embodiment, judgment sub-unit 3013 can judge electronic equipment based on machine vision
Mode in visual range with the presence or absence of target hand is specially：
Judgment sub-unit 3013 can fly time technology according to light, and the vision of electronic equipment is judged based on machine vision
It whether there is target hand in range.
At this in another optional embodiment, judgment sub-unit 3013 can fly time technology according to light and load one
Light-emitting component, since the photon that light-emitting component is sent out can reflect after encountering target watch face, so, judgment sub-unit
3013 can be sent out capturing these by light-emitting component using a special cmos sensor and are reflected back from target watch face
The photon come, can obtain the flight time of photon.The distance of photon flight can be extrapolated in turn according to photon flight time,
Also it has just obtained whether there is target hand in visual range, and in the presence of target hand, has obtained the depth information of target hand.
As it can be seen that implement another optional embodiment, flying time technology by light realizes detection to target hand
Work, the accuracy of identification that light can be utilized to fly time technology raising to target hand.
As another optional embodiment, judgment sub-unit 3013 can judge electronic equipment based on machine vision
Mode in visual range with the presence or absence of target hand is specially：
Judgment sub-unit 3013 can be according to polygonal imaging technique, and judges based on machine vision the vision of electronic equipment
It whether there is target hand in range.
At this in another optional embodiment, judgment sub-unit 3013 can simultaneously be taken the photograph by least two cameras
Image is taken, by the difference for the image that the different cameras of comparison are obtained in synchronization, depth information is calculated using algorithm, from
And realize when in visual range there are when target hand, the multi-angle three-dimensional imaging of target hand.
As it can be seen that implementing another optional embodiment, the image of target hand by multi-angled shooting, can be realized
It precisely quickly captures, improves the recognition efficiency to target hand.
In the embodiment of the present invention, after judgment sub-unit 3013 is judged there are target hand, triggering identification subelement
3012 execute the dynamic 3 D gesture of identification target hand, the operation as target gesture path.
It identifies subelement 3012, is additionally operable to after judgment sub-unit 3013 is judged there are target hand, identify target hand
Dynamic 3 D gesture, as target gesture path.
Optionally, electronic equipment shown in Fig. 4 can also include：Collecting unit 305 and judging unit 306, wherein：
Collecting unit 305, for the behaviour in recognition unit 303 according to essential information identification for triggering target gesture path
Before making hand, and when the target gesture path that acquiring unit 301 is got is two-dimentional track, acquire corresponding to user's operation
Target fingerprint.
In the embodiment of the present invention, after the target fingerprint that collecting unit 305 acquires corresponding to user's operation, target is referred to
Line is supplied to judging unit 306.
Judging unit 306, for judge target fingerprint whether with default legal fingerprint matches.
In the embodiment of the present invention, the safety of information in electronic equipment can be improved by the acquisition to target fingerprint,
Manipulator can also be determined by the essential information of combining target fingerprint and target gesture path, and then improve target gesture rail
The identification accuracy of mark.
Optionally, if it is determined that unit 306 judges that target fingerprint is mismatched with default legal fingerprint, judging unit 306
Any operation can not be executed；Screen locking can also be carried out, to prevent disabled user from invading；It can also be sentenced by iris recognition technology
Whether disconnected active user be validated user, operate and detects whether in the presence of being connect with electronic equipment if it is not, then executing screen locking
Wearable device, if it is present sending the prompt for prompting electronic equipment to be used by illegal user to wearable device
Information, the embodiment of the present invention are not construed as limiting.
As it can be seen that executing the optional embodiment, electronic equipment can be avoided to be used by disabled user, improve electronics and set
Standby safety.
Recognition unit 303, specifically for judging unit 306 judge target fingerprint with preset legal fingerprint matches it
Afterwards, the manipulator for triggering target gesture path is identified according to essential information.
As an alternative embodiment, essential information further includes the initial position of target gesture path；
Wherein, recognition unit 303 identifies that the mode of the manipulator for triggering target gesture path has according to essential information
Body is：
When target gesture path is two-dimentional track, the quantity of initial position is determined；
The quantity for determining initial position be greater than or equal to two after, judge in value set whether there is be more than
The distance value of pre-determined distance is made of apart from value set the distance between any two initial position in all initial positions value；
After judging to there is the distance value more than pre-determined distance in value set, triggering target gesture path is determined
Manipulator be right-hand man combination；
After the quantity for the initial position determined is equal to 1, or judging that there is no be more than in advance in value set
If after the distance value of distance, the offset direction according to target gesture path relative to straight path is identified for triggering target hand
The manipulator of gesture track, wherein target gesture path relative to straight path offset direction be it is left when, manipulator is left hand,
Target gesture path relative to straight path offset direction be it is right when, manipulator is the right hand.
As it can be seen that executing the optional embodiment, distance between the quantity and initial position to initial position can be passed through
Detection, manipulator is more accurately determined, to further increase the identification accuracy to target gesture path.
As another optional embodiment, recognition unit 303 is identified according to essential information for triggering target gesture
The mode of the manipulator of track is specially：The operation for triggering target gesture path is identified according to target fingerprint and essential information
Hand.
As it can be seen that execute the optional embodiment of the another kind, combining target fingerprint and target gesture path can be passed through
Essential information determines manipulator, to improve the identification accuracy to target gesture path.
As it can be seen that the identification accuracy to target gesture path can be improved by implementing electronic equipment described in Fig. 4；It can also
In the case where not increasing gesture complexity, gesture interaction scheme is enriched, i.e. a gesture corresponds to not at different interfaces
Same instruction；The safety of information in electronic equipment can also be improved by the acquisition to target fingerprint, additionally it is possible to pass through knot
The essential information for closing target fingerprint and target gesture path determines manipulator, and the identification for further improving target gesture path is accurate
True property.
Embodiment five
Referring to Fig. 5, Fig. 5 is the structural schematic diagram of another electronic equipment disclosed by the embodiments of the present invention.Such as Fig. 5 institutes
Show, which may include：
It is stored with the memory 501 of executable program code；
The processor 502 coupled with memory 501；
Wherein, processor 502 calls the executable program code stored in memory 501, and it is any one to execute Fig. 1~Fig. 2
Electronic device method of the kind based on gesture identification.
The embodiment of the present invention discloses a kind of computer readable storage medium, stores computer program, wherein the computer
Program makes computer execute any one electronic device method based on gesture identification of Fig. 1~Fig. 2.
One of ordinary skill in the art will appreciate that all or part of step in the various methods of above-described embodiment is can
It is completed with instructing relevant hardware by program, which can be stored in a computer readable storage medium, storage
Medium include read-only memory (Read-Only Memory, ROM), random access memory (Random Access Memory,
RAM), programmable read only memory (Programmable Read-only Memory, PROM), erasable programmable is read-only deposits
Reservoir (Erasable Programmable Read Only Memory, EPROM), disposable programmable read-only memory (One-
Time Programmable Read-Only Memory, OTPROM), the electronics formula of erasing can make carbon copies read-only memory
(Electrically-Erasable Programmable Read-Only Memory, EEPROM), CD-ROM (Compact
Disc Read-Only Memory, CD-ROM) or other disk storages, magnetic disk storage, magnetic tape storage or can
Any other computer-readable medium for carrying or storing data.
In the above-described embodiments, it can be realized wholly or partly by software, hardware, firmware or its arbitrary combination.When
When using software realization, can entirely or partly it realize in the form of a computer program product.The computer program product packet
Include one or more computer instructions.When loading on computers and executing the computer program instructions, entirely or partly
It generates according to the flow or function described in the embodiment of the present application.The computer can be all-purpose computer, special purpose computer, calculating
Machine network or other programmable devices.The computer instruction can store in a computer-readable storage medium, Huo Zhecong
One computer readable storage medium is transmitted to another computer readable storage medium, for example, the computer instruction can be with
Pass through wired (such as coaxial cable, optical fiber, Digital Subscriber Line) from a web-site, computer, server or data center
Or wireless (such as infrared, wireless, microwave etc.) mode is transmitted to another web-site, computer, server or data center.
The computer-readable medium can be that any usable medium that computer can access either can be used comprising one or more
The data storage devices such as medium integrated server, data center.The usable medium can be magnetic medium (magnetic medium example
Such as can be floppy disk, hard disk, tape), optical medium (such as CD) or semiconductor medium (such as solid state disk).Above-mentioned
It in embodiment, all emphasizes particularly on different fields to the description of each embodiment, there is no the part being described in detail in some embodiment, may refer to other
The associated description of embodiment.
In several embodiments provided herein, it should be understood that disclosed device, it can be by others side
Formula is realized.For example, the apparatus embodiments described above are merely exemplary, for example, said units division, only
A kind of division of logic function, formula that in actual implementation, there may be another division manner, such as multiple units or component can combine or
Person is desirably integrated into another system, or some features can be ignored or not executed.Another point, shown or discussion phase
Coupling, direct-coupling or communication connection between mutually can be by some interfaces, the INDIRECT COUPLING or communication link of device or unit
It connects, can be electrical or other forms.
The above-mentioned unit illustrated as separating component may or may not be physically separated, aobvious as unit
The component shown may or may not be physical unit, you can is located at a place, or may be distributed over multiple nets
On network unit.Some or all of wherein unit can be selected according to the actual needs to achieve the purpose of the solution of this embodiment.
In addition, each functional unit in each embodiment of the application can be integrated in a processing unit, can also be
Each unit physically exists alone, can also be during two or more units are integrated in one unit.Above-mentioned integrated unit
Both the form that hardware may be used is realized, can also be realized in the form of SFU software functional unit.
If above-mentioned integrated unit is realized in the form of SFU software functional unit and when sold or used as an independent product,
A retrievable memory of computer can be stored in.Based on this understanding, the technical solution of the application substantially or
Say all or part of of the part that contributes to existing technology or the technical solution, it can body in the form of software products
Reveal and, which is stored in a memory, including several requests are used so that a computer equipment
(can be personal computer, server or network equipment etc., can be specifically the processor in computer equipment) executes sheet
The all or part of step of each embodiment above method of application.
The above, above example are only to illustrate the technical solution of the application rather than its limitations；Although with reference to before
Embodiment is stated the application is described in detail, however it will be understood by those of ordinary skill in the art that；It still can be with
Technical scheme described in the above embodiments is modified or equivalent replacement of some of the technical features；And
These modifications or replacements, the spirit and model of each embodiment technical solution of the application that it does not separate the essence of the corresponding technical solution
It encloses.
Claims (10)
1. a kind of electronic device method based on gesture identification, which is characterized in that the method includes：
The electronic equipment obtains target gesture path, and determines essential information corresponding with the target gesture path；Wherein,
The essential information includes at least offset direction of the target gesture path relative to straight path；
The electronic equipment identifies the manipulator for triggering the target gesture path according to the essential information；
The electronic equipment according to the manipulator and the target gesture path identified, generate with the manipulator and
The operational order that the target gesture path matches, and execute operation corresponding with the operational order, the manipulator
It is combined including left hand, the right hand or right-hand man.
2. according to the method described in claim 1, it is characterized in that, the electronic equipment obtain target gesture path, including：
The electronic equipment detects whether the user's operation for the touch screen for having for the electronic equipment；
If detecting the user's operation, the electronic equipment identify the user's operation the electronic equipment touch screen
On two-dimentional track, as target gesture path；
If the user's operation is not detected, the electronic equipment judges the vision model of the electronic equipment based on machine vision
It whether there is target hand in enclosing, the target hand matches with default hand model；
If there is the target hand, the electronic equipment identifies the dynamic 3 D gesture of the target hand, as target gesture
Track.
3. according to the method described in claim 2, it is characterized in that, the electronic equipment is used for according to essential information identification
Before the manipulator for triggering the target gesture path, the method further includes：
When the target gesture path is the two-dimentional track, the electronic equipment acquires the mesh corresponding to the user's operation
Mark fingerprint；
The electronic equipment judge the target fingerprint whether with default legal fingerprint matches；
It is identified according to the essential information for triggering the target gesture path if so, the electronic equipment execution is described
Manipulator.
4. according to the method in claim 2 or 3, which is characterized in that the essential information further includes the target gesture rail
The initial position of mark；
The electronic equipment identifies the manipulator for triggering the target gesture path according to the essential information, including：
When the target gesture path is the two-dimentional track, the electronic equipment determines the quantity of the initial position；
If the quantity of the initial position is greater than or equal to two, the electronic equipment judges to whether there is in value set
More than the distance value of pre-determined distance, the initial position described in any two in all initial positions apart from value set it
Between distance value composition；
If the distance value existed in value set more than the pre-determined distance, the electronic equipment determine described in triggering
The manipulator of target gesture path combines for right-hand man；
If it is described in value set there is no more than the pre-determined distance distance value or if the initial position number
When amount is equal to 1, offset direction of the electronic equipment according to the target gesture path relative to straight path is identified for touching
The manipulator for sending out target gesture path described, wherein the target gesture path is a left side relative to the offset direction of straight path
When, the manipulator be left hand, the target gesture path relative to straight path offset direction be it is right when, the manipulator
For the right hand.
5. according to the method described in claim 3, it is characterized in that, the electronic equipment is used for according to essential information identification
The manipulator of the target gesture path is triggered, including：
The electronic equipment is according to the target fingerprint and essential information identification for triggering the target gesture path
Manipulator.
6. a kind of electronic equipment, which is characterized in that the electronic equipment includes：
Acquiring unit, for obtaining target gesture path；
Determination unit, for determining essential information corresponding with the target gesture path；Wherein, the essential information is at least wrapped
Include offset direction of the target gesture path relative to straight path；
Recognition unit, for identifying the manipulator for triggering the target gesture path according to the essential information；
Generation unit, for according to the manipulator and the target gesture path identified, generating and the manipulator
The operational order to match with the target gesture path, and execute operation corresponding with the operational order, the operation
Hand includes left hand, the right hand or right-hand man's combination.
7. electronic equipment according to claim 6, which is characterized in that the acquiring unit includes：
Detection sub-unit, for detecting whether there is the user's operation of the touch screen for the electronic equipment；
Subelement is identified, for detecting the presence of the user behaviour for the touch screen of the electronic equipment in the detection sub-unit
After work, two-dimentional track of the user's operation on the touch screen of the electronic equipment is identified, as target gesture path；
Judgment sub-unit, for the user in the presence of the touch screen for the electronic equipment to be not detected in the detection sub-unit
After operation, judged based on machine vision in the visual range of the electronic equipment whether there is target hand, the target hand with
Default hand model matches；
The identification subelement is additionally operable to after the judgment sub-unit is judged there are the target hand, identifies the mesh
The dynamic 3 D gesture for marking hand, as target gesture path.
8. electronic equipment according to claim 7, which is characterized in that the electronic equipment further includes：
Collecting unit, for being identified according to the essential information for triggering the target gesture path in the recognition unit
Before manipulator, and when the target gesture path is the two-dimentional track, acquire the target corresponding to the user's operation
Fingerprint；
Judging unit, for judge the target fingerprint whether with default legal fingerprint matches；
The recognition unit, specifically for judging the target fingerprint in the judging unit and presetting legal fingerprint matches
Later, the manipulator for triggering the target gesture path is identified according to the essential information.
9. electronic equipment according to claim 7 or 8, which is characterized in that the essential information further includes the target hand
The initial position of gesture track；
The recognition unit identifies that the mode of the manipulator for triggering the target gesture path has according to the essential information
Body is：
When the target gesture path is the two-dimentional track, the quantity of the initial position is determined；
The quantity for determining the initial position be greater than or equal to two after, judge in value set whether there is be more than
The distance value of pre-determined distance, between the initial position described in any two in all initial positions apart from value set
Distance value forms；
Judge it is described there is the distance value more than the pre-determined distance in value set after, determine and trigger the target
The manipulator of gesture path combines for right-hand man；
There is no big after the quantity for the initial position determined is equal to 1, or judging described in value set
After the distance value of the pre-determined distance, is identified and used relative to the offset direction of straight path according to the target gesture path
In the manipulator for triggering the target gesture path, wherein offset direction of the target gesture path relative to straight path
When being left, the manipulator be left hand, the target gesture path relative to straight path offset direction be it is right when, the behaviour
It is the right hand to make hand.
10. electronic equipment according to claim 8, which is characterized in that the recognition unit is known according to the essential information
The mode that the manipulator of the target gesture path Yong Yu not triggered is specially：
The manipulator for triggering the target gesture path is identified according to the target fingerprint and the essential information.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810333928.XA CN108594995A (en) | 2018-04-13 | 2018-04-13 | Electronic equipment operation method based on gesture recognition and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810333928.XA CN108594995A (en) | 2018-04-13 | 2018-04-13 | Electronic equipment operation method based on gesture recognition and electronic equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108594995A true CN108594995A (en) | 2018-09-28 |
Family
ID=63622365
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810333928.XA Pending CN108594995A (en) | 2018-04-13 | 2018-04-13 | Electronic equipment operation method based on gesture recognition and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108594995A (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110532755A (en) * | 2019-08-09 | 2019-12-03 | 北京三快在线科技有限公司 | A kind of method and device of computer implemented risk identification |
| CN111177677A (en) * | 2018-11-09 | 2020-05-19 | 天梭股份有限公司 | Method for facial authentication of a watch wearer |
| CN111221406A (en) * | 2018-11-23 | 2020-06-02 | 杭州萤石软件有限公司 | Information interaction method and device |
| WO2021238866A1 (en) * | 2020-05-28 | 2021-12-02 | Oppo广东移动通信有限公司 | Application display method, terminal, and computer readable storage medium |
| CN114167980A (en) * | 2021-11-18 | 2022-03-11 | 深圳市鸿合创新信息技术有限责任公司 | Gesture processing method and device, electronic equipment and readable storage medium |
Citations (21)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1942853A (en) * | 2004-05-06 | 2007-04-04 | 苹果电脑有限公司 | Multipoint touchscreen |
| CN102147676A (en) * | 2009-12-28 | 2011-08-10 | 索尼公司 | Operation direction determination apparatus, remote operating system, operation direction determination method and program |
| CN102640102A (en) * | 2009-10-01 | 2012-08-15 | 索尼公司 | Information processing device, information processing method and program |
| WO2012126426A2 (en) * | 2012-05-21 | 2012-09-27 | 华为技术有限公司 | Method and device for contact-free control by hand gesture |
| CN102768595A (en) * | 2011-11-23 | 2012-11-07 | 联想(北京)有限公司 | Method and device for identifying touch operation instructions on touch screen |
| CN102880405A (en) * | 2011-06-29 | 2013-01-16 | 索尼公司 | Information processing apparatus, information processing method, program and remote control system |
| CN103324274A (en) * | 2012-03-22 | 2013-09-25 | 联想(北京)有限公司 | Method and device for man-machine interaction |
| CN103365599A (en) * | 2013-07-31 | 2013-10-23 | 广州市动景计算机科技有限公司 | Mobile terminal operation optimizing method and device based on screen sliding track |
| CN103576910A (en) * | 2012-08-06 | 2014-02-12 | 联想(北京)有限公司 | Information processing method and electronic device |
| CN103677438A (en) * | 2012-09-10 | 2014-03-26 | 联想(北京)有限公司 | Data processing method and electronic device |
| CN104133635A (en) * | 2014-07-23 | 2014-11-05 | 百度在线网络技术（北京）有限公司 | Method and device for judging handheld state of terminal |
| CN104781769A (en) * | 2013-03-11 | 2015-07-15 | 夏普株式会社 | Portable device |
| CN104932825A (en) * | 2015-06-15 | 2015-09-23 | 金陵科技学院 | Method for automatically sensing left hand/right hand to operate mobile phone and determining moving thermal region of thumb |
| CN105224085A (en) * | 2015-09-30 | 2016-01-06 | 宇龙计算机通信科技(深圳)有限公司 | A kind of handheld device mode of operation recognition methods and handheld device |
| CN105302303A (en) * | 2015-10-15 | 2016-02-03 | 广东欧珀移动通信有限公司 | Game control method and apparatus and mobile terminal |
| CN105607850A (en) * | 2015-12-17 | 2016-05-25 | 小米科技有限责任公司 | Gripping way determination method and device |
| CN105718186A (en) * | 2014-12-18 | 2016-06-29 | 苹果公司 | Electronic Devices with Hand Detection Circuitry |
| CN105930067A (en) * | 2016-04-19 | 2016-09-07 | 青岛海信移动通信技术股份有限公司 | Page control method and apparatus as well as terminal device |
| CN106062672A (en) * | 2014-02-26 | 2016-10-26 | 微软技术许可有限责任公司 | Device control |
| CN107741781A (en) * | 2017-09-01 | 2018-02-27 | 中国科学院深圳先进技术研究院 | Flight control method, device, unmanned plane and the storage medium of unmanned plane |
| CN107765848A (en) * | 2017-09-04 | 2018-03-06 | 中山大学 | A kind of control method and device of projected image |
-
2018
- 2018-04-13 CN CN201810333928.XA patent/CN108594995A/en active Pending
Patent Citations (21)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1942853A (en) * | 2004-05-06 | 2007-04-04 | 苹果电脑有限公司 | Multipoint touchscreen |
| CN102640102A (en) * | 2009-10-01 | 2012-08-15 | 索尼公司 | Information processing device, information processing method and program |
| CN102147676A (en) * | 2009-12-28 | 2011-08-10 | 索尼公司 | Operation direction determination apparatus, remote operating system, operation direction determination method and program |
| CN102880405A (en) * | 2011-06-29 | 2013-01-16 | 索尼公司 | Information processing apparatus, information processing method, program and remote control system |
| CN102768595A (en) * | 2011-11-23 | 2012-11-07 | 联想(北京)有限公司 | Method and device for identifying touch operation instructions on touch screen |
| CN103324274A (en) * | 2012-03-22 | 2013-09-25 | 联想(北京)有限公司 | Method and device for man-machine interaction |
| WO2012126426A2 (en) * | 2012-05-21 | 2012-09-27 | 华为技术有限公司 | Method and device for contact-free control by hand gesture |
| CN103576910A (en) * | 2012-08-06 | 2014-02-12 | 联想(北京)有限公司 | Information processing method and electronic device |
| CN103677438A (en) * | 2012-09-10 | 2014-03-26 | 联想(北京)有限公司 | Data processing method and electronic device |
| CN104781769A (en) * | 2013-03-11 | 2015-07-15 | 夏普株式会社 | Portable device |
| CN103365599A (en) * | 2013-07-31 | 2013-10-23 | 广州市动景计算机科技有限公司 | Mobile terminal operation optimizing method and device based on screen sliding track |
| CN106062672A (en) * | 2014-02-26 | 2016-10-26 | 微软技术许可有限责任公司 | Device control |
| CN104133635A (en) * | 2014-07-23 | 2014-11-05 | 百度在线网络技术（北京）有限公司 | Method and device for judging handheld state of terminal |
| CN105718186A (en) * | 2014-12-18 | 2016-06-29 | 苹果公司 | Electronic Devices with Hand Detection Circuitry |
| CN104932825A (en) * | 2015-06-15 | 2015-09-23 | 金陵科技学院 | Method for automatically sensing left hand/right hand to operate mobile phone and determining moving thermal region of thumb |
| CN105224085A (en) * | 2015-09-30 | 2016-01-06 | 宇龙计算机通信科技(深圳)有限公司 | A kind of handheld device mode of operation recognition methods and handheld device |
| CN105302303A (en) * | 2015-10-15 | 2016-02-03 | 广东欧珀移动通信有限公司 | Game control method and apparatus and mobile terminal |
| CN105607850A (en) * | 2015-12-17 | 2016-05-25 | 小米科技有限责任公司 | Gripping way determination method and device |
| CN105930067A (en) * | 2016-04-19 | 2016-09-07 | 青岛海信移动通信技术股份有限公司 | Page control method and apparatus as well as terminal device |
| CN107741781A (en) * | 2017-09-01 | 2018-02-27 | 中国科学院深圳先进技术研究院 | Flight control method, device, unmanned plane and the storage medium of unmanned plane |
| CN107765848A (en) * | 2017-09-04 | 2018-03-06 | 中山大学 | A kind of control method and device of projected image |
Non-Patent Citations (2)
| Title |
|---|
| 张毅: "《移动机器人技术基础与制作》", 31 January 2013 * |
| 张燕翔: "《舞台展演交互式空间增强现实技术》", 28 February 2018 * |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111177677A (en) * | 2018-11-09 | 2020-05-19 | 天梭股份有限公司 | Method for facial authentication of a watch wearer |
| US11977615B2 (en) | 2018-11-09 | 2024-05-07 | Tissot Sa | Method for facial authentication of a wearer of a watch |
| CN111221406A (en) * | 2018-11-23 | 2020-06-02 | 杭州萤石软件有限公司 | Information interaction method and device |
| CN111221406B (en) * | 2018-11-23 | 2023-10-13 | 杭州萤石软件有限公司 | Information interaction method and device |
| CN110532755A (en) * | 2019-08-09 | 2019-12-03 | 北京三快在线科技有限公司 | A kind of method and device of computer implemented risk identification |
| WO2021238866A1 (en) * | 2020-05-28 | 2021-12-02 | Oppo广东移动通信有限公司 | Application display method, terminal, and computer readable storage medium |
| CN114167980A (en) * | 2021-11-18 | 2022-03-11 | 深圳市鸿合创新信息技术有限责任公司 | Gesture processing method and device, electronic equipment and readable storage medium |
| CN114167980B (en) * | 2021-11-18 | 2024-05-07 | 深圳市鸿合创新信息技术有限责任公司 | Gesture processing method, gesture processing device, electronic equipment and readable storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11157725B2 (en) | Gesture-based casting and manipulation of virtual content in artificial-reality environments | |
| US11262840B2 (en) | Gaze detection in a 3D mapping environment | |
| CN108594995A (en) | Electronic equipment operation method based on gesture recognition and electronic equipment | |
| US10394334B2 (en) | Gesture-based control system | |
| EP2384464B1 (en) | Standard gestures | |
| US8856691B2 (en) | Gesture tool | |
| KR102335132B1 (en) | Multi-modal gesture based interactive system and method using one single sensing system | |
| WO2013180151A1 (en) | Position-of-interest detection device, position-of-interest detection method, and position-of-interest detection program | |
| JP2016520946A (en) | Human versus computer natural 3D hand gesture based navigation method | |
| CN102460373A (en) | Surface computer user interaction | |
| JP2010067062A (en) | Input system and method | |
| JP5964603B2 (en) | Data input device and display device | |
| CN107797748B (en) | Virtual keyboard input method and device and robot | |
| CN103543825B (en) | Camera cursor system | |
| JP6230666B2 (en) | Data input device, data input method, and data input program | |
| KR101374316B1 (en) | Apparatus for recognizing gesture by using see-through display and Method thereof | |
| US11893161B2 (en) | Gesture recognition based on user proximity to a camera | |
| WO2018150757A1 (en) | Information processing system, information processing method, and program | |
| US20230168746A1 (en) | User interface method system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20180928 |
|
| RJ01 | Rejection of invention patent application after publication |