CN109766776A - Operation executes method, apparatus, computer equipment and storage medium - Google Patents
Operation executes method, apparatus, computer equipment and storage medium Download PDFInfo
- Publication number
- CN109766776A CN109766776A CN201811553422.6A CN201811553422A CN109766776A CN 109766776 A CN109766776 A CN 109766776A CN 201811553422 A CN201811553422 A CN 201811553422A CN 109766776 A CN109766776 A CN 109766776A
- Authority
- CN
- China
- Prior art keywords
- micro
- expression
- preset
- similarity
- current face
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 41
- 230000014509 gene expression Effects 0.000 claims abstract description 313
- 238000010195 expression analysis Methods 0.000 claims abstract description 97
- 238000012800 visualization Methods 0.000 claims abstract description 11
- 230000036651 mood Effects 0.000 claims description 60
- 230000006870 function Effects 0.000 claims description 43
- 239000013598 vector Substances 0.000 claims description 40
- 238000004590 computer program Methods 0.000 claims description 28
- 238000004364 calculation method Methods 0.000 claims description 11
- 230000001960 triggered effect Effects 0.000 claims description 9
- 238000001514 detection method Methods 0.000 claims description 5
- 238000004458 analytical method Methods 0.000 claims description 4
- 230000006399 behavior Effects 0.000 claims description 4
- 238000010191 image analysis Methods 0.000 claims description 2
- 230000008569 process Effects 0.000 abstract description 7
- 238000013473 artificial intelligence Methods 0.000 abstract 1
- 230000004397 blinking Effects 0.000 description 9
- 238000010586 diagram Methods 0.000 description 8
- 238000000605 extraction Methods 0.000 description 6
- 238000012546 transfer Methods 0.000 description 6
- 239000000284 extract Substances 0.000 description 5
- 230000008859 change Effects 0.000 description 3
- 238000012545 processing Methods 0.000 description 3
- 230000008901 benefit Effects 0.000 description 2
- 230000007613 environmental effect Effects 0.000 description 2
- 238000005286 illumination Methods 0.000 description 2
- 238000011017 operating method Methods 0.000 description 2
- 238000005070 sampling Methods 0.000 description 2
- 238000013528 artificial neural network Methods 0.000 description 1
- 230000003542 behavioural effect Effects 0.000 description 1
- 210000004556 brain Anatomy 0.000 description 1
- 235000013399 edible fruits Nutrition 0.000 description 1
- 230000005611 electricity Effects 0.000 description 1
- 230000002996 emotional effect Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000002708 enhancing effect Effects 0.000 description 1
- 210000004709 eyebrow Anatomy 0.000 description 1
- 210000001061 forehead Anatomy 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 239000000203 mixture Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
- 230000009452 underexpressoin Effects 0.000 description 1
Landscapes
- Image Analysis (AREA)
Abstract
This application involves artificial intelligence fields, and in particular to a kind of operation executes method, apparatus, computer equipment and storage medium.Method includes: to obtain micro- Expression analysis triggering command, and trigger micro- Expression analysis function according to micro- Expression analysis triggering command；When determining that micro- Expression analysis function is opened, the current face image of user is acquired；Micro- Expression analysis is carried out to the current face image, obtains the current face image micro- expression similarity corresponding with micro- expression is preset；Micro- expression is associated with according to the micro- expression similarity setting and the current face images match；According to the micro- expression of the association and micro- expression similarity obtain it is corresponding preset it is operation associated；Operation associated generation operation selection option and visualization display are preset according to described；Execute the corresponding object run of the operation selection option.Family is able to use using this method to check and choose the whole process of object run simple, quick and accurate, improves the convenience of user's operation.
Description
Technical field
This application involves field of computer technology, more particularly to a kind of operation execute method, apparatus, computer equipment and
Storage medium.
Background technique
The setting of software is all different in current each smart machine, and there is also differences for the name of each function, in addition, selling
Producer is also no when each smart machine provides detailed operation instructions, so, user sets the various operations in smart machine
It sets and does not know about.User's with needing level-one grade searching menu, finds corresponding entry, and correctly understand its meaning,
It can complete a funcall or setting.
When user needs to carry out a certain object run but does not know the operating path of the object run, it is necessary to spend
Time and efforts finds object run, but sometimes because the level of terminal operation is excessive can not even to look for object run.It is whole
Human-computer interaction not smart enoughization during a searching, and the searching of object run not only frequently and takes time and effort.
Summary of the invention
Based on this, it is necessary in view of the above technical problems, provide a kind of behaviour that can quickly find object run for user
Make execution method, apparatus, computer equipment and storage medium.
A kind of operation execution method, which comprises
Micro- Expression analysis triggering command is obtained, and micro- Expression analysis function is triggered according to micro- Expression analysis triggering command
Energy；
When determining that micro- Expression analysis function is opened, the current face image of user is acquired；
Micro- Expression analysis is carried out to the current face image, it is corresponding with micro- expression is preset to obtain the current face image
Micro- expression similarity；
Micro- expression is associated with according to the micro- expression similarity setting and the current face images match；
According to the micro- expression of the association and micro- expression similarity obtain it is corresponding preset it is operation associated；
Operation associated generation operation selection option and visualization display are preset according to described；
It executes the operation selection option and corresponds to object run.
In one of the embodiments, after the current face image of the acquisition user, comprising:
Obtain default identity image；
Shooting face information is extracted from the current face image, and identity people is extracted from the default identity image
Face information；
Identity characteristic vector is extracted from the identity face information, and shooting feature is extracted from the shooting face information
Vector；
Calculate the similarity percentage of the shooting characteristic vector and the identity characteristic vector；
Obtain preset percentage threshold value；
When the similarity percentage is greater than the preset percentage, continues to execute and the current face image is carried out
Micro- Expression analysis.
It is described in one of the embodiments, to obtain and correspond to according to the micro- expression of the association and micro- expression similarity
Preset it is operation associated, comprising:
Obtain the defined attribute of each micro- expression of association；
Obtain it is corresponding with the defined attribute preset it is operation associated；
According to the numerical values recited of micro- expression similarity to it is described preset it is operation associated be ranked up, and according to sequence according to
It is secondary transfer it is described preset it is operation associated.
In one of the embodiments, after the corresponding object run of the execution operation selection option, further includes:
The corresponding micro- expression of target is obtained according to the object run；
When the micro- expression of the target and the inconsistent maximum micro- expression of association of micro- expression similarity, to the target
Micro- expression and the current face image are associated matching storage.
It is described in one of the embodiments, to obtain and correspond to according to the micro- expression of the association and micro- expression similarity
Preset it is operation associated, further includes:
Obtain expression coefficient of each micro- expression of association under each mood mode；
According under the expression coefficient of the micro- expression of association and each mood mode of micro- expression similarity calculation
The mood numerical value of the current face image；
The mood mode of user is determined according to each mood numerical value；
Obtain it is corresponding with the mood mode it is described preset it is operation associated.
It is described in one of the embodiments, that micro- Expression analysis is carried out to the current face image, it obtains described current
Face-image micro- expression similarity corresponding with micro- expression is preset, comprising:
Characteristics of image is extracted from the current face image；
Described image feature is compared to obtain feature comparison result with each default minutia；
When judging described image feature and the default minutia according to the feature comparison result for same feature,
Search the corresponding micro- expression classification of each described image feature extracted；
The quantity of the corresponding described image feature of each micro- expression classification is calculated in the described image feature extracted
Proportion in sum obtains each micro- expression similarity for presetting micro- expression.
In one of the embodiments, after the corresponding object run of the execution operation selection option, further includes:
Obtain the time of running at current time and the object run；
Calculate the time difference at the current time and the time of running；
Obtain preset time threshold；
When the time difference is greater than the preset time threshold, micro- Expression analysis function is closed.
A kind of operation executive device, described device include:
Instruction obtains detection module, triggers for obtaining micro- Expression analysis triggering command, and according to micro- Expression analysis
The micro- Expression analysis function of instruction triggers；
Face-image obtains module, for when determining that micro- Expression analysis function is opened, acquire user to work as front
Portion's image；
Micro- Expression analysis module obtains the current face for carrying out micro- Expression analysis to the current face image
Image micro- expression similarity corresponding with micro- expression is preset；
Micro- expression setting module, for the pass according to micro- expression the similarity setting and the current face images match
Join micro- expression；
Operation associated acquisition module, it is corresponding for being obtained according to the micro- expression of the association and micro- expression similarity
It presets operation associated；
Operation display module, for presetting operation associated generation operation selection option and visualization display according to described；
Operation executing module, for executing the corresponding object run of the operation selection option.
A kind of computer equipment, including memory and processor, the memory are stored with computer program, the processing
Device performs the steps of when executing the computer program
Micro- Expression analysis triggering command is obtained, and micro- Expression analysis function is triggered according to micro- Expression analysis triggering command
Energy；
When determining that micro- Expression analysis function is opened, the current face image of user is acquired；
Micro- Expression analysis is carried out to the current face image, it is corresponding with micro- expression is preset to obtain the current face image
Micro- expression similarity；
Micro- expression is associated with according to the micro- expression similarity setting and the current face images match；
According to the micro- expression of the association and micro- expression similarity obtain it is corresponding preset it is operation associated；
Operation associated generation operation selection option and visualization display are preset according to described；
Execute the corresponding object run of the operation selection option.
A kind of computer readable storage medium, is stored thereon with computer program, and the computer program is held by processor
It is performed the steps of when row
Micro- Expression analysis triggering command is obtained, and micro- Expression analysis function is triggered according to micro- Expression analysis triggering command
Energy；
When determining that micro- Expression analysis function is opened, the current face image of user is acquired；
Micro- Expression analysis is carried out to the current face image, it is corresponding with micro- expression is preset to obtain the current face image
Micro- expression similarity；
Micro- expression is associated with according to the micro- expression similarity setting and the current face images match；
According to the micro- expression of the association and micro- expression similarity obtain it is corresponding preset it is operation associated；
Operation associated generation operation selection option and visualization display are preset according to described；
Execute the corresponding object run of the operation selection option.
Aforesaid operations execute method, apparatus, computer equipment and storage medium, obtain micro- Expression analysis triggering command, and
Micro- Expression analysis function is triggered, when determining that micro- Expression analysis function is opened, is divided by the current face image to user
Analysis obtains being associated with micro- expression and micro- expression similarity, and then corresponding according to the micro- expression of association and the acquisition of micro- expression similarity
Preset it is operation associated, further display preset it is operation associated allow user to select so that user checks and chooses object run
Whole process it is simple, quick and accurate, allow user not need to spend extra time and efforts that can quickly find target
Operation, improves the convenience of user's operation.Moreover, entirely presetting operation associated acquisition process, it is only necessary to according to user's
Face-image operation, not only avoids cumbersome operating procedure and obscure technical term, and expanded the function of terminal,
Improve the intelligence of terminal.
Detailed description of the invention
Fig. 1 is the application scenario diagram that execution method is operated in one embodiment；
Fig. 2 is the flow diagram that execution method is operated in one embodiment；
Fig. 3 is the flow diagram that execution method is operated in another embodiment；
Fig. 4 is the flow diagram that operation executes step in another embodiment；
Fig. 5 is the flow diagram that operation executes step in one embodiment；
Fig. 6 is the flow diagram of micro- Expression analysis step in another embodiment；
Fig. 7 is the structural block diagram that executive device is operated in one embodiment；
Fig. 8 is the internal structure chart of computer equipment in one embodiment.
Specific embodiment
It is with reference to the accompanying drawings and embodiments, right in order to which the objects, technical solutions and advantages of the application are more clearly understood
The application is further elaborated.It should be appreciated that specific embodiment described herein is only used to explain the application, not
For limiting the application.
Operation execution method provided by the present application, can be applied in application environment as shown in Figure 1.Wherein, terminal 102
It is communicated by network with server 104.Wherein, terminal 102 can be, but not limited to be various personal computers, notebook electricity
Brain, smart phone, tablet computer and portable intelligent device.Terminal 102 can be straight by the way that internal front camera is arranged in
The current face image for taking family is obtained, the current face image of external camera indirect gain user can also be passed through.?
In one embodiment, terminal 102 includes the smart machines such as mobile phone, computer and surface computer.Terminal 102 obtains micro- Expression analysis triggering
Instruction, and according to the micro- Expression analysis function of the instruction triggers；When determining that micro- Expression analysis function is opened, the acquisition of terminal 102 is used
Current face image is simultaneously uploaded to server 104 by the current face image at family；Server 104 receives current face image, and
Micro- Expression analysis is carried out to current face image, obtains current face image micro- expression similarity corresponding with micro- expression is preset；
The corresponding micro- expression similarity of current face image is sent to terminal 102 by server；Terminal 102 receives micro- expression similarity simultaneously
It is determined according to the micro- expression similarity received and is associated with micro- expression, then according to the micro- expression of association and the acquisition pair of micro- expression similarity
Presetting for answering is operation associated；The display of terminal 102 preset it is operation associated obtain object run, and execute the object run.
Server 104 can be realized with the server cluster of the either multiple server compositions of independent server.
In one embodiment, as shown in Fig. 2, providing a kind of operation execution method, it is applied in Fig. 1 in this way
It is illustrated for terminal 102, comprising the following steps:
Step 202, micro- Expression analysis triggering command is obtained, and micro- expression is triggered according to micro- Expression analysis triggering command
Analytic function.
Micro- Expression analysis triggering command is for triggering micro- Expression analysis function.Micro- Expression analysis function is used for working as
Front face image carries out micro- Expression analysis.
Whether the touch screen that terminal 102 can detecte terminal receives the pressing operation of user or detects whether to receive
Micro- Expression analysis triggering command is generated to the voice etc. of user, and according to the positive result detected.Terminal 102 obtains micro- in turn
Expression analysis triggering command, and detect whether micro- Expression analysis function opens according to micro- Expression analysis triggering command.
Step 204, when determining that micro- Expression analysis function is opened, the current face image of user is acquired.
When terminal 102 determines that micro- Expression analysis function is opened, terminal 102 obtains the current face figure of current operation user
Picture.Current face image is the user's face image of terminal shooting of the user in operating handset, and user's face image can root
According to needing to be one to multiple.When user's face image is only one, which is exactly current face image；When with
When family face-image is multiple, can set wherein a certain user's face image can also set certain as current face image
Several user's face images are current face image.
Step 206, micro- Expression analysis is carried out to the current face image, obtain the current face image with preset it is micro-
The corresponding micro- expression similarity of expression.
Specifically, terminal 102 directly can carry out micro- Expression analysis to current face image, can also be by current face figure
As being uploaded to server 104, micro- Expression analysis is carried out by server 104.The neural network mould that terminal 102 can be completed by building
Type extracts characteristics of image from current face image, and characteristics of image and pre-set image feature are compared, and determines micro-
Expression similarity.For example, when the characteristics of image that terminal 102 is extracted from current face image presets micro- table with what is be previously stored
Feelings " narrowing one's eyes ", " corners of the mouth raises up ", " corners of the mouth drop-down ", " blinking " and " dew tooth " characteristics of image carry out similarity one by one
It is respectively 40%, 80%, 0%, 10% and 90% than logarithm when comparison.Therefore, current face image " is narrowed with micro- expression
Eyes ", " corners of the mouth raises up ", " corners of the mouth drop-down ", " blinking " and " dew tooth " micro- expression similarity be respectively 40%,
80%, 0%, 10% and 90%.
Step 208, micro- expression is associated with according to the micro- expression similarity setting and the current face images match.
In one embodiment, terminal 102 obtains default similarity threshold, and micro- expression similarity is greater than default similarity threshold
Value preset micro- expression be set as with the micro- expression of the matching of current face images match, preset similarity threshold value range can
It is 40%~99%.In another embodiment, terminal 102 obtains default selection quantity, then according to micro- expression similarity
Numerical value is ranked up from big to small to micro- expression is preset, and is chosen for the micro- expression of presetting stood out to match micro- expression, and mention
The quantity for the micro- expression of matching stood out taken out is consistent with default selection quantity.For example, current face image and micro- expression
" narrowing one's eyes ", " corners of the mouth raises up ", " corners of the mouth drop-down ", " blinking " and " dew tooth " micro- expression similarity be respectively 40%,
80%, 0%, 10% and 90%, presetting and choosing quantity is 4, and terminal 102 will preset micro- expression according to the big of micro- expression similarity
It is small to be ranked up, and preset micro- expression for micro- expression similarity numerical value maximum 4 and be set as and current face images match
Match micro- expression, i.e., with the micro- expression of the matching of current face images match be " narrowing one's eyes ", " corners of the mouth raises up ", " blinking " and
" dew tooth ".
Step 210, according to the micro- expression of the association and micro- expression similarity obtain it is corresponding preset it is operation associated.
Terminal 102 is based on the corresponding default association of default acquisition Rule according to the micro- expression of association and micro- expression similarity
Operation.It is default obtain rule and can be successively obtains that the micro- expression of association is corresponding to be preset according to the numerical values recited of micro- expression similarity
It is operation associated；It is also possible to determine user's current emotional mould based on the expression coefficient and micro- expression similarity that are associated with micro- expression
Formula, be then based on the mood pattern acquiring it is corresponding preset it is operation associated；It is maximum either to choose micro- expression similarity numerical value
Be associated with micro- expression it is corresponding preset it is operation associated.
Step 212, operation associated generation operation selection option and visualization display are preset according to described.
Terminal 102 according to preset it is operation associated can directly operation display interface on show generation operation select option,
Preset window can also be shown on operation display interface, operation selection option is shown in preset window.Operation selection option
It can either statically or dynamically be shown in the form of icon, thumbnail or picture etc. in operation display interface/preset window.Terminal 102
Detection touches the pressing operation of the operation selection option of screen display, and obtains object run.
Step 214, the corresponding object run of the operation selection option is executed.
Terminal 102 executes the corresponding object run of operation selection option selected, funcall needed for completing user
Or setting.For example, the acquisition of terminal 102 is preset and operation associated have " open QQ ", " opening wechat ", " opening music " and " beat
Open video ", operation selection option " QQ ", " wechat ", " music " and " video " are further displayed, when user is to operation selection choosing
When item " music " is selected, terminal 102 generates object run " opening music ", and controls the corresponding music software of starting.
In aforesaid operations execution method, by obtaining micro- Expression analysis triggering command, and micro- Expression analysis function is triggered,
When micro- Expression analysis function is opened, then is analyzed to obtain by the current face image to user and be associated with micro- expression and micro- table
Feelings similarity, so according to be associated with micro- expression and micro- expression similarity obtain it is corresponding preset operation associated, further display
Preset it is operation associated allow user to select so that user checks and chooses the whole process of object run simple, quick and quasi-
Really, it allows user not need to spend extra time and efforts that can quickly find object run, improves user's operation just
Benefit.Moreover, entirely presetting operation associated acquisition process it is only necessary to the face-image operation according to user, not only avoid
Cumbersome operating procedure and obscure technical term, and the function of terminal has been expanded, improve the intelligence of terminal.
In one embodiment, as shown in figure 3, after the current face image of acquisition user, specifically includes the following steps:
Step 302, default identity image is obtained.
Terminal 102 obtains default identity image according to micro- Expression analysis triggering command from the repository of terminal, can also be with
The default identity image of user is searched in server 104 according to micro- Expression analysis triggering command.Default identity image be by with
The pre-set photograph image in family presets the face-image of identity image preferred, users for the ease of subsequent comparison.
Step 304, shooting face information is extracted from the current face image, and is mentioned from the default identity image
Take identity face information.
Terminal carries out Face datection to current face image, determines position of the face in current face image, then root
Shooting face information is extracted from current face image according to determining picture position.Likewise, terminal is to default identity image
Face datection is carried out, determines position of the face in default identity image, then according to determining picture position from default identity
Identity face information is extracted in image.
Step 306, identity characteristic vector is extracted from the identity face information, is extracted from the shooting face information
Shoot characteristic vector.
Everyone eyebrow, face, forehead etc. dimension scale are unique, thus using the people to different people
When face information is analyzed, obtained characteristics of image vector is also impossible to completely the same, it is possible to use to determine whether being same
One people.In one embodiment, identity characteristic vector sum shooting characteristic vector is extracted by Gabor filter.Body
Part face information includes the identity face containing BMP format, and shooting face information includes the shooting face containing BMP format.
I (x, y) is the intensity profile of piece image, and Gabor characteristic indicates are as follows:
Oμ, ν(x, y)=I (x, y) * ψμ, ν(x, y) can also be expressed as Ok(z)=I (z) * ψ (k, z),
Wherein, ψμ, ν(x, y) is Gabor kernel function, Oμ, ν(x, y) is just corresponding to the Gabor wavelet volume of scale μ, direction ν
Product result.ψμ, ν(x, y) is expressed as following formula:
Wherein,It determines
The scale of Gabor kernel and direction, z=(x, y) are spatial position coordinate, kν=kmax/fνFor sampling scale, φμμ/8=π
For sample direction, kmaxFor maximum frequency, f is the kernel interval factor in frequency domain.
For recognition of face, the general Gabor wavelet convolution results for selecting 5 scales, 8 directions, i.e. ν ∈
{ 0 ..., 4 }, μ ∈ { 0 ..., 7 }, remaining parameter is set as kmax=pi/2,And the π of σ=2.Due to directly by all rulers
The Gabor wavelet convolution results transformation of degree, direction is expressed as a cascade characteristic vector, the dimension that will lead to image it is too high and
It is difficult to handle, thus down-sampling processing, decimation factor ρ, so the grade of piece image is carried out to each Gabor wavelet convolution results
The characteristic vector X of connection are as follows:
When terminal handles identity face, obtained characteristic vector X is exactly identity characteristic vector；To shooting face into
Row processing, obtained characteristic vector X ' is exactly to shoot characteristic vector.
Step 308, the similarity percentage of the shooting characteristic vector and the identity characteristic vector is calculated.
Ok(z) amplitude and phase is respectively AkAnd Фk, thenCombine the O of different scale and directionk
(z) characteristic vector X of the image at z location is constituted.
The similitude S of identity characteristic vector X and shooting characteristic vector X 'ACalculation formula is as follows:
The identity characteristic vector X being calculated in step 304 and shooting characteristic vector X ' are substituted into similitude S by terminalA
Calculation formula obtains similarity percentage.
Step 310, preset percentage threshold value is obtained.
In view of shooting environmental, capture apparatus and the variation of photographer, a preset percentage threshold value is set.In order to drop
Low False Rate, general preset percentage threshold value are arranged 60%~95%.
Step 312, it when the similarity percentage is greater than the preset percentage, continues to execute to the current face
Image carries out micro- Expression analysis.
The size between similarity percentage and preset percentage threshold value is judged, when similarity percentage is greater than default percentage
When than threshold value, terminal, which is continued to execute, carries out micro- Expression analysis to current face image；When similarity percentage is less than default percentage
When than threshold value, terminal generates warning information, and the warning information is dealt into the mailbox etc. of user preset.
In aforesaid operations execution method, by obtaining the current face image and default identity image of user, to two
Image is compared, and determines the identity of user, so as to avoid terminal from being stolen by others or misapply.And Gabor is small
Wave multiresolution, it is multi-direction reflect local image characteristic, so the reaction for illumination is insensitive, have to illumination better
Adaptability, it is also more acurrate to the extraction of characteristics of image, so that identity analysis result is more acurrate.
In one embodiment, as shown in figure 4, according to the micro- expression of the association and micro- expression similarity acquisition pair
Presetting for answering is operation associated, specifically includes the following steps:
Step 402, the defined attribute of each micro- expression of association is obtained.
Micro- expression is preset with multiple in micro- expression data library, in one embodiment, presets micro- expression and shares 54 kinds, Yong Huyi
As will not to set presetting for such multi-quantity operation associated, and environment locating for user may be sent out when calling same object run
Changing, actually detected micro- expression out may also can change.In order to reduce influence of the environmental change to user, realization pair
Operation associated accurate acquisition is preset, each micro- expression of association has been assigned corresponding defined attribute.For example, micro- expression " mouth
Angle raises up " " blinking " " dew tooth " etc. be defined as " optimistic expression ", and corresponding with " optimistic expression " operation associated is
" opening wechat ".At this point, " optimistic expression " is the defined attribute of micro- expression " corners of the mouth raises up " " blinking " " dew tooth " etc., close
Connection operation " opening wechat " is that presetting for micro- expression " corners of the mouth raises up " " blinking " " dew tooth " etc. is operation associated.
Step 404, obtain it is corresponding with the defined attribute preset it is operation associated.
Each defined attribute is corresponding to be preset operation associated by user setting, can be one or more.Terminal is according to each
Preset micro- expression defined attribute obtain it is corresponding it is all preset it is operation associated.For example, when user sets defined attribute " optimistic table
Feelings " only correspond to operation associated " open wechat ", and terminal is operation associated according to presetting of getting of defined attribute " optimistic expression " to be
" opening wechat "；Operation associated " opening video " and " opening music " are corresponded to when user sets defined attribute " sad expression ", eventually
End is operation associated for " opening video " and " opening music " according to presetting of getting of defined attribute " sad expression ".
Step 406, according to the numerical values recited of micro- expression similarity to it is described preset it is operation associated be ranked up, and root
According to sequence successively transfer it is described preset it is operation associated.
Terminal according to the numerical values recited of micro- expression similarity to preset it is operation associated be ranked up, and successively adjusted according to sequence
Take preset it is operation associated.When defined attribute correspond to it is multiple preset operation associated when, terminal according to it is multiple preset it is operation associated pre-
Setting priority is ranked up.When the corresponding defined attribute of the micro- expression of continuous two associations is identical in sequence, terminal can remove weight
Multiple presetting is operation associated.
In aforesaid operations execution method, default behaviour is associated with based on being associated with micro- expression with micro- expression similarity and successively transferring
Make, user is checked one by one according to micro- expression similarity and presets operation associated selection target operation, is avoided because of terminal pair
It makes mistakes caused by the erroneous judgement of micro- expression.
It in one embodiment, specifically further include following step after executing the corresponding object run of the operation selection option
It is rapid: the corresponding micro- expression of target is obtained according to the object run；When the micro- expression of the target and micro- expression similarity most
When the micro- expression of big association is inconsistent, matching storage is associated to the micro- expression of the target and the current face image.
In aforesaid operations execution method, terminal judges the micro- expression of target and the maximum micro- expression of association of micro- expression similarity
It is whether consistent, and the inconsistent micro- expression of target and current face image are associated the individual character that matching storage constructs user
Change database, is analyzed when to the current face image with the micro- expression of same or similar association and micro- expression similarity
When, terminal directly transfers the micro- expression of target of associated storage, improves terminal to the accuracy rate of micro- Expression Recognition.
In another embodiment, as figure 5 illustrates, it obtains and corresponds to according to the micro- expression of the association and micro- expression similarity
Preset it is operation associated, specifically includes the following steps:
Step 502, expression coefficient of each micro- expression of association under each mood mode is obtained.
Terminal searches the expression coefficient under corresponding each mood mode according to micro- expression is associated with respectively.In one embodiment,
Mood mode has 7 kinds, respectively glad, sad, fear, indignation, detest, surprised and contempt.But the different micro- expressions of association
Correlation between each mood mode is different, so expression coefficient is also different, for example, micro- expression " corners of the mouth raises up " and height
It is emerging, sad, fear, indignation, detest, the surprised and corresponding expression coefficient of contempt is respectively 9,0,0,5,3,1 and 2.
Step 504, according to the expression coefficient of the micro- expression of association and micro- each feelings of expression similarity calculation
The mood numerical value of the current face image under thread mode.
Terminal is first according to the mood value for being associated with micro- expression under expression coefficient and each mood mode of micro- expression similarity calculation, then
The corresponding mood value of micro- expression will be respectively associated under same mood mode to be added up to get the mood of user under each mood mode is arrived
Numerical value.For example, in the case where mood mode is glad, the micro- expression of the matching extracted is " narrowing one's eyes ", " corners of the mouth raises up ",
" blinking " and " dew tooth ", micro- expression similarity is respectively 40%, 80%, 10% and 90%, micro- expression " narrowing one's eyes "
It is 4 with glad expression coefficient, micro- expression " corners of the mouth raises up " and glad expression coefficient are 9, micro- expression " blinking " and happiness
Expression coefficient be 1, micro- expression " dew tooth " and glad expression coefficient are 10, at this point, safety check object under happy emoticon mode
Mood numerical value be 17.9 (=40%*4+80%*9+10%*1+90%*10).
Step 506, the mood mode of user is determined according to each mood numerical value.
Specifically, the maximum mood mode of mood numerical value is set as user according to the mood numerical value of each mood mode by terminal
Mood mode.
Step 508, obtain it is corresponding with the mood mode it is described preset it is operation associated.
Each mood mode is corresponding, which to be preset, operation associated can be also possible to system default setting by user setting.Eventually
End according to each mood pattern acquiring it is corresponding it is all preset it is operation associated.For example, user sets the default pass under " happiness " mode
Connection operation is " opening wechat ", and when terminal 102 judges the mood mode of current face image for " happiness ", terminal obtains default
Operation associated " opening wechat ".
In aforesaid operations execution method, it is corresponding with each mood mode of user to be associated with micro- expression, passes through and determines user
Mood pattern acquiring preset operation associated, not only reduce operation associated setting level, and obtained mood numerical value can
More accurately to embody the current state of user, the judgement fault of micro- expression is reduced.
In one embodiment, as shown in fig. 6, carrying out micro- Expression analysis to the current face image, described work as is obtained
Front face image micro- expression similarity corresponding with micro- expression is preset, specifically includes the following steps:
Step 602, characteristics of image is extracted from current face image.
There are more than 20 ten thousand minutias, same micro- expression is according to the behavioural habits meeting of different people in micro- expression data library
There is great variation, in order to realize that the accurate definition to micro- expression carries out anti-the micro- expression of same class using multiple minutias
It reflects, in one embodiment, presets micro- expression and share 54 kinds, every micro- expression of class has 1000~4000 default minutias, but
Each default minutia has unique characteristic parameter.Terminal is joined according to the feature for presetting minutia in micro- expression data library
Number extracts existing characteristics of image from current face image.
Step 604, described image feature is compared to obtain feature comparison result with each default minutia.
Each characteristics of image and default minutia all have unique characteristic parameter, terminal by characteristics of image with it is all pre-
If the characteristic parameter of minutia is compared one by one, and judges whether the characteristic parameter of the two is consistent, then generates aspect ratio
To result.For example, there is " the upward radian of the corners of the mouth is 3 degree " characteristics of image, the feature of the characteristics of image in current face image
Parameter is " radian is 3 degree ".The spy of the characteristic parameter of the characteristics of image and default minutia " the upward radian of the corners of the mouth is 3 degree "
Sign parameter is consistent, and the characteristic parameter with default minutia " the upward radian of the corners of the mouth is 5 degree " is inconsistent.
Step 606, it when judging characteristics of image and minutia according to feature comparison result for same feature, searches and extracts
The corresponding micro- expression classification of each characteristics of image out.
When judging characteristics of image and minutia according to feature comparison result for same feature, terminal is according to special with image
It levies identical each minutia and successively carries out micro- expression classification attribute lookup, and determine the corresponding micro- expression classification of characteristics of image.
In the present embodiment, it presets micro- expression and shares 54 kinds, there is also 54 kinds for micro- expression classification, for example, the details for presetting micro- expression is special
It is 3 degree that sign, which is the upward radian of the corners of the mouth, and micro- expression classification of the minutia is " corners of the mouth raises up ", thus, when characteristics of image
When for the upward radian of the corners of the mouth being 3 degree, the corresponding micro- expression classification of characteristics of image is exactly " corners of the mouth raises up ".
Step 608, the quantity of the corresponding described image feature of each micro- expression classification is calculated in the figure extracted
As feature sum in proportion, obtain micro- expression similarity under each micro- expression classification.
Terminal calculates the quantity of characteristics of image under each micro- expression classification, and calculates image characteristic under each micro- expression classification
The proportion in the characteristics of image sum extracted is measured, which is exactly micro- expression similarity of each micro- expression.
In one embodiment, it after executing the corresponding object run of the operation selection option, also has follow steps:
Obtain the time of running at current time and the object run；Calculate the time difference at the current time and the time of running
Value；Obtain preset time threshold；When the time difference is greater than the preset time threshold, micro- Expression analysis function is closed
Energy.
In aforesaid operations execution method, obtain current time and object run the time of running, according to two moment it
Between time difference judge whether to close micro- Expression analysis function, and then reduce the consistency operation of terminal, protect the privacy of user.
It should be understood that although each step in the flow chart of Fig. 2-6 is successively shown according to the instruction of arrow,
These steps are not that the inevitable sequence according to arrow instruction successively executes.Unless expressly stating otherwise herein, these steps
Execution there is no stringent sequences to limit, these steps can execute in other order.Moreover, at least one in Fig. 2-6
Part steps may include that perhaps these sub-steps of multiple stages or stage are not necessarily in synchronization to multiple sub-steps
Completion is executed, but can be executed at different times, the execution sequence in these sub-steps or stage is also not necessarily successively
It carries out, but can be at least part of the sub-step or stage of other steps or other steps in turn or alternately
It executes.
In one embodiment, as shown in fig. 7, providing a kind of operation executive device, comprising: instruction obtains detection module
702, face-image obtains module 704, micro- Expression analysis module 706, micro- expression setting module 708, operation associated acquisition module
710, Operation display module 712 and operation executing module 714, in which:
Instruction obtains detection module 702, touches for obtaining micro- Expression analysis triggering command, and according to micro- Expression analysis
Send instructions and triggers micro- Expression analysis function.
Face-image obtains module 704, for acquiring the current of user when determining that micro- Expression analysis function is opened
Face-image.
Micro- Expression analysis module 706 obtains described working as front for carrying out micro- Expression analysis to the current face image
Portion's image micro- expression similarity corresponding with micro- expression is preset.
Micro- expression setting module 708, for according to micro- expression similarity setting and the current face images match
The micro- expression of association.
Operation associated acquisition module 710, for according to the micro- expression of the association and micro- expression similarity acquisition pair
Presetting for answering is operation associated.
Operation display module 712, for presetting operation associated generation operation selection option and visualization display according to described.
Operation executing module 714, for executing the corresponding object run of the operation selection option.
In some embodiments, device further includes that identity image collection module, face information extraction module, characteristic vector mention
Modulus block, similarity calculation module, percentage threshold obtain module and comparison module, in which:
Identity image collection module, for obtaining default identity image.
Face information extraction module, for extracting shooting face information from the current face image, and from described pre-
If extracting identity face information in identity image.
Characteristic vector extraction module, for extracting identity characteristic vector from the identity face information, from the shooting
Shooting characteristic vector is extracted in face information.
Similarity calculation module, for calculating the similarity percentage of the shooting characteristic vector and the identity characteristic vector
Than.
Percentage threshold obtains module, for obtaining preset percentage threshold value.
Comparison module, for continuing to execute and working as to described when the similarity percentage is greater than the preset percentage
Front face image carries out micro- Expression analysis.
In some embodiments, operation associated acquisition module 710 includes defined attribute acquiring unit, operation associated acquisition list
Unit is transferred in first and operation associated sequence, in which:
Defined attribute acquiring unit, for obtaining the defined attribute of each micro- expression of association.
Operation associated acquiring unit, for obtain it is corresponding with the defined attribute preset it is operation associated.
Unit is transferred in operation associated sequence, for according to the numerical values recited of micro- expression similarity to the default association
Operation is ranked up, and according to sequence successively transfer it is described preset it is operation associated.
In some embodiments, device further includes that the micro- expression of target obtains module and memory module, in which:
The micro- expression of target obtains module, for obtaining the corresponding micro- expression of target according to the object run.
Memory module, it is inconsistent for working as the micro- expression of the target and the maximum micro- expression of association of micro- expression similarity
When, matching storage is associated to the micro- expression of the target and the current face image.
In some embodiments, operation associated acquisition module 710 includes expression coefficient acquiring unit, mood numerical value calculating list
Member, mood mode decision unit and operation associated acquiring unit, in which:
Expression coefficient acquiring unit, for obtaining expression coefficient of each micro- expression of association under each mood mode.
Mood numerical calculation unit, for according to the expression coefficient for being associated with micro- expression and micro- expression phase
The mood numerical value of the current face image under each mood mode is calculated like degree.
Mood mode decision unit, for determining the mood mode of user according to each mood numerical value.
Operation associated acquiring unit, for obtain it is corresponding with the mood mode it is described preset it is operation associated.
In one embodiment, micro- Expression analysis module 706 includes image characteristics extraction unit, feature comparing unit, class
Other searching unit and micro- expression similarity calculated, in which:
Image characteristics extraction unit, for extracting characteristics of image from the current face image.
Feature comparing unit, for being compared to obtain aspect ratio to knot with each default minutia for described image feature
Fruit.
Classification searching unit judges described image feature and the default details according to the feature comparison result for working as
When feature is same feature, the corresponding micro- expression classification of each described image feature extracted is searched.
Micro- expression similarity calculated, for calculating the quantity of the corresponding described image feature of each micro- expression classification
Proportion in the sum of the described image feature extracted obtains each micro- expression similarity for presetting micro- expression.
In one embodiment, device further includes obtaining module, time difference computing module, time threshold constantly to obtain mould
Block and function closedown module, in which:
Moment obtains module, for obtaining the time of running at current time and the object run；
Time difference computing module, for calculating the time difference at the current time and the time of running；
Time threshold obtains module, for obtaining preset time threshold；
Function closedown module, for closing micro- expression when the time difference is greater than the preset time threshold
Analytic function.
Specific about operation executive device limits the restriction that may refer to above for operation execution method, herein not
It repeats again.Modules in aforesaid operations executive device can be realized fully or partially through software, hardware and combinations thereof.On
Stating each module can be embedded in the form of hardware or independently of in the processor in computer equipment, can also store in a software form
In memory in computer equipment, the corresponding operation of the above modules is executed in order to which processor calls.
In one embodiment, a kind of computer equipment is provided, which can be terminal, internal structure
Figure can be as shown in Figure 8.The computer equipment includes processor, the memory, network interface, display connected by system bus
Screen and input unit.Wherein, the processor of the computer equipment is for providing calculating and control ability.The computer equipment is deposited
Reservoir includes non-volatile memory medium, built-in storage.The non-volatile memory medium is stored with operating system and computer journey
Sequence.The built-in storage provides environment for the operation of operating system and computer program in non-volatile memory medium.The calculating
The network interface of machine equipment is used to communicate with external terminal by network connection.When the computer program is executed by processor with
Realize a kind of operation execution method.The display screen of the computer equipment can be liquid crystal display or electric ink display screen,
The input unit of the computer equipment can be the touch layer covered on display screen, be also possible to be arranged on computer equipment shell
Key, trace ball or Trackpad, can also be external keyboard, Trackpad or mouse etc..
It will be understood by those skilled in the art that structure shown in Fig. 8, only part relevant to application scheme is tied
The block diagram of structure does not constitute the restriction for the computer equipment being applied thereon to application scheme, specific computer equipment
It may include perhaps combining certain components or with different component layouts than more or fewer components as shown in the figure.
In one embodiment, a kind of computer equipment, including memory and processor are provided, which is stored with
Computer program, the processor perform the steps of when executing computer program
Micro- Expression analysis triggering command is obtained, and micro- Expression analysis function is triggered according to micro- Expression analysis triggering command
Energy；
When determining that micro- Expression analysis function is opened, the current face image of user is acquired；
Micro- Expression analysis is carried out to the current face image, it is corresponding with micro- expression is preset to obtain the current face image
Micro- expression similarity；
Micro- expression is associated with according to the micro- expression similarity setting and the current face images match；
According to the micro- expression of the association and micro- expression similarity obtain it is corresponding preset it is operation associated；
Operation associated generation operation selection option and visualization display are preset according to described；
Execute the corresponding object run of the operation selection option.
In one embodiment, the step of realizing the current face image of acquisition user when processor executes computer program
It when later, is also used to: obtaining default identity image；Shooting face information is extracted from the current face image, and from described
Identity face information is extracted in default identity image；Identity characteristic vector is extracted from the identity face information, from the bat
It takes the photograph in face information and extracts shooting characteristic vector；Calculate the similarity hundred of the shooting characteristic vector and the identity characteristic vector
Divide ratio；Obtain preset percentage threshold value；When the similarity percentage is greater than the preset percentage, continue to execute to described
Current face image carries out micro- Expression analysis.
In one embodiment, it is realized when processor executes computer program according to the micro- expression of the association and described micro-
Expression similarity obtains corresponding when presetting operation associated step, is also used to: obtaining the definition category of each micro- expression of association
Property；Obtain it is corresponding with the defined attribute preset it is operation associated；According to the numerical values recited of micro- expression similarity to described
Preset it is operation associated be ranked up, and according to sequence successively transfer it is described preset it is operation associated.
In one embodiment, it is realized when processor executes computer program and executes the corresponding mesh of the operation selection option
It when after the step of mark operation, is also used to: the corresponding micro- expression of target is obtained according to the object run；When the micro- table of the target
When feelings and the inconsistent maximum micro- expression of association of micro- expression similarity, to the micro- expression of the target and the current face
Image is associated matching storage.
In one embodiment, it is realized when processor executes computer program according to the micro- expression of the association and described micro-
Expression similarity obtains corresponding when presetting operation associated step, is also used to: obtaining each micro- expression of association in each mood
Expression coefficient under mode；According to the expression coefficient of the micro- expression of association and micro- each feelings of expression similarity calculation
The mood numerical value of the current face image under thread mode；The mood mode of user is determined according to each mood numerical value；It obtains and is somebody's turn to do
Mood mode it is corresponding it is described preset it is operation associated.
In one embodiment, it is realized when processor executes computer program and micro- expression is carried out to the current face image
Analysis, when obtaining the step of the current face image micro- expression similarity corresponding with micro- expression is preset, is also used to: from described
Characteristics of image is extracted in current face image；Described image feature is compared to obtain aspect ratio pair with each default minutia
As a result；When judging described image feature and the default minutia according to the feature comparison result for same feature, look into
Look for the corresponding micro- expression classification of each described image feature extracted；It is special to calculate the corresponding described image of each micro- expression classification
Proportion of the quantity of sign in the sum of the described image feature extracted obtains each micro- expression for presetting micro- expression
Similarity.
In one embodiment, it is realized when processor executes computer program and executes the corresponding mesh of the operation selection option
It when after the step of mark operation, is also used to: obtaining the time of running at current time and the object run；When calculating described current
Carve the time difference with the time of running；Obtain preset time threshold；When the time difference is greater than the preset time threshold
When value, micro- Expression analysis function is closed.
In one embodiment, a kind of computer readable storage medium is provided, computer program is stored thereon with, is calculated
Machine program performs the steps of when being executed by processor
Micro- Expression analysis triggering command is obtained, and micro- Expression analysis function is triggered according to micro- Expression analysis triggering command
Energy；
When determining that micro- Expression analysis function is opened, the current face image of user is acquired；
Micro- Expression analysis is carried out to the current face image, it is corresponding with micro- expression is preset to obtain the current face image
Micro- expression similarity；
Micro- expression is associated with according to the micro- expression similarity setting and the current face images match；
According to the micro- expression of the association and micro- expression similarity obtain it is corresponding preset it is operation associated；
Operation associated generation operation selection option and visualization display are preset according to described；
Execute the corresponding object run of the operation selection option.
In one embodiment, the step of the current face image of acquisition user is realized when computer program is executed by processor
It is also used to after rapid: obtaining default identity image；Shooting face information is extracted from the current face image, and from described pre-
If extracting identity face information in identity image；Identity characteristic vector is extracted from the identity face information, from the shooting
Shooting characteristic vector is extracted in face information；Calculate the similarity percentage of the shooting characteristic vector and the identity characteristic vector
Than；Obtain preset percentage threshold value；When the similarity percentage is greater than the preset percentage, continues to execute and work as to described
Front face image carries out micro- Expression analysis.
In one embodiment, computer program is realized when being executed by processor according to the micro- expression of the association and described
Micro- expression similarity obtains corresponding to be also used to when presetting operation associated step: obtaining the definition category of each micro- expression of association
Property；Obtain it is corresponding with the defined attribute preset it is operation associated；According to the numerical values recited of micro- expression similarity to described
Preset it is operation associated be ranked up, and according to sequence successively transfer it is described preset it is operation associated.
In one embodiment, realize that executing the operation selects option corresponding when computer program is executed by processor
It is also used to after the step of object run: the corresponding micro- expression of target is obtained according to the object run；When the micro- table of the target
When feelings and the inconsistent maximum micro- expression of association of micro- expression similarity, to the micro- expression of the target and the current face
Image is associated matching storage.
In one embodiment, computer program is realized when being executed by processor according to the micro- expression of the association and described
Micro- expression similarity obtains corresponding to be also used to when presetting operation associated step: obtaining each micro- expression of association in each mood
Expression coefficient under mode；According to the expression coefficient of the micro- expression of association and micro- each feelings of expression similarity calculation
The mood numerical value of the current face image under thread mode；The mood mode of user is determined according to each mood numerical value；It obtains and is somebody's turn to do
Mood mode it is corresponding it is described preset it is operation associated.
In one embodiment, it is realized when computer program is executed by processor and micro- table is carried out to the current face image
Mutual affection analysis, obtains being also used to when the step of the current face image micro- expression similarity corresponding with micro- expression is preset: from institute
It states in current face image and extracts characteristics of image；Described image feature is compared to obtain aspect ratio with each default minutia
To result；When judging described image feature and the default minutia according to the feature comparison result for same feature,
Search the corresponding micro- expression classification of each described image feature extracted；Calculate the corresponding described image of each micro- expression classification
Proportion of the quantity of feature in the sum of the described image feature extracted obtains each micro- table for presetting micro- expression
Feelings similarity.
In one embodiment, realize that executing the operation selects option corresponding when computer program is executed by processor
It is also used to after the step of object run: obtaining the time of running at current time and the object run；When calculating described current
Carve the time difference with the time of running；Obtain preset time threshold；When the time difference is greater than the preset time threshold
When value, micro- Expression analysis function is closed.
Those of ordinary skill in the art will appreciate that realizing all or part of the process in above-described embodiment method, being can be with
Relevant hardware is instructed to complete by computer program, the computer program can be stored in a non-volatile computer
In read/write memory medium, the computer program is when being executed, it may include such as the process of the embodiment of above-mentioned each method.Wherein,
To any reference of memory, storage, database or other media used in each embodiment provided herein,
Including non-volatile and/or volatile memory.Nonvolatile memory may include read-only memory (ROM), programming ROM
(PROM), electrically programmable ROM (EPROM), electrically erasable ROM (EEPROM) or flash memory.Volatile memory may include
Random access memory (RAM) or external cache.By way of illustration and not limitation, RAM is available in many forms,
Such as static state RAM (SRAM), dynamic ram (DRAM), synchronous dram (SDRAM), double data rate sdram (DDRSDRAM), enhancing
Type SDRAM (ESDRAM), synchronization link (Synchlink) DRAM (SLDRAM), memory bus (Rambus) direct RAM
(RDRAM), direct memory bus dynamic ram (DRDRAM) and memory bus dynamic ram (RDRAM) etc..
Each technical characteristic of above embodiments can be combined arbitrarily, for simplicity of description, not to above-described embodiment
In each technical characteristic it is all possible combination be all described, as long as however, the combination of these technical characteristics be not present lance
Shield all should be considered as described in this specification.
The several embodiments of the application above described embodiment only expresses, the description thereof is more specific and detailed, but simultaneously
It cannot therefore be construed as limiting the scope of the patent.It should be pointed out that coming for those of ordinary skill in the art
It says, without departing from the concept of this application, various modifications and improvements can be made, these belong to the protection of the application
Range.Therefore, the scope of protection shall be subject to the appended claims for the application patent.
Claims (10)
1. a kind of operation execution method, which comprises
Micro- Expression analysis triggering command is obtained, and micro- Expression analysis function is triggered according to micro- Expression analysis triggering command；
When determining that micro- Expression analysis function is opened, the current face image of user is acquired；
Micro- Expression analysis is carried out to the current face image, it is corresponding with micro- expression is preset micro- to obtain the current face image
Expression similarity；
Micro- expression is associated with according to the micro- expression similarity setting and the current face images match；
According to the micro- expression of the association and micro- expression similarity obtain it is corresponding preset it is operation associated；
Operation associated generation operation selection option and visualization display are preset according to described；
Execute the corresponding object run of the operation selection option.
2. the method according to claim 1, wherein after the current face image of the acquisition user, comprising:
Obtain default identity image；
Shooting face information is extracted from the current face image, and identity face letter is extracted from the default identity image
Breath；
Identity characteristic vector is extracted from the identity face information, and shooting Characteristic Vectors are extracted from the shooting face information
Amount；
Calculate the similarity percentage of the shooting characteristic vector and the identity characteristic vector；
Obtain preset percentage threshold value；
When the similarity percentage is greater than the preset percentage, continues to execute and micro- table is carried out to the current face image
Mutual affection analysis.
3. the method according to claim 1, wherein described according to the micro- expression of the association and micro- expression
Similarity obtain it is corresponding preset it is operation associated, comprising:
Obtain the defined attribute of each micro- expression of association；
Obtain it is corresponding with the defined attribute preset it is operation associated；
According to the numerical values recited of micro- expression similarity to it is described preset it is operation associated be ranked up, and according to sequence successively adjust
Take it is described preset it is operation associated.
4. the method according to claim 1, wherein described execute the corresponding target behaviour of the operation selection option
After work, further includes:
The corresponding micro- expression of target is obtained according to the object run；
When the micro- expression of the target and the inconsistent maximum micro- expression of association of micro- expression similarity, to the micro- table of the target
Feelings and the current face image are associated matching storage.
5. the method according to claim 1, wherein described according to the micro- expression of the association and micro- expression
Similarity obtain it is corresponding preset it is operation associated, comprising:
Obtain expression coefficient of each micro- expression of association under each mood mode；
According to described under the expression coefficient of the micro- expression of association and each mood mode of micro- expression similarity calculation
The mood numerical value of current face image；
The mood mode of user is determined according to each mood numerical value；
Obtain it is corresponding with the mood mode it is described preset it is operation associated.
6. the method according to claim 1, wherein described carry out micro- expression point to the current face image
Analysis, obtains the current face image micro- expression similarity corresponding with micro- expression is preset, comprising:
Characteristics of image is extracted from the current face image；
Described image feature is compared to obtain feature comparison result with each default minutia；
When judging described image feature and the default minutia according to the feature comparison result for same feature, search
The corresponding micro- expression classification of each described image feature extracted；
Calculate sum of the quantity in the described image feature extracted of the corresponding described image feature of each micro- expression classification
In proportion, obtain each micro- expression similarity for presetting micro- expression.
7. the method according to claim 1, wherein described execute the corresponding target behaviour of the operation selection option
After work, further includes:
Obtain the time of running at current time and the object run；
Calculate the time difference at the current time and the time of running；
Obtain preset time threshold；
When the time difference is greater than the preset time threshold, micro- Expression analysis function is closed.
8. a kind of operation executive device, which is characterized in that described device includes:
Instruction obtains detection module, for obtaining micro- Expression analysis triggering command, and according to micro- Expression analysis triggering command
Trigger micro- Expression analysis function；
Face-image obtains module, for acquiring the current face figure of user when determining that micro- Expression analysis function is opened
Picture；
Micro- Expression analysis module obtains the current face image for carrying out micro- Expression analysis to the current face image
Micro- expression similarity corresponding with micro- expression is preset；
Micro- expression setting module, for micro- with being associated with for the current face images match according to micro- expression similarity setting
Expression；
Operation associated acquisition module, it is corresponding default for being obtained according to the micro- expression of the association and micro- expression similarity
It is operation associated；
Operation display module, for presetting operation associated generation operation selection option and visualization display according to described；
Operation executing module, for executing the corresponding object run of the operation selection option.
9. a kind of computer equipment, including memory and processor, the memory are stored with computer program, feature exists
In the step of processor realizes any one of claims 1 to 7 the method when executing the computer program.
10. a kind of computer readable storage medium, is stored thereon with computer program, which is characterized in that the computer program
The step of method described in any one of claims 1 to 7 is realized when being executed by processor.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811553422.6A CN109766776A (en) | 2018-12-18 | 2018-12-18 | Operation executes method, apparatus, computer equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811553422.6A CN109766776A (en) | 2018-12-18 | 2018-12-18 | Operation executes method, apparatus, computer equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109766776A true CN109766776A (en) | 2019-05-17 |
Family
ID=66451594
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811553422.6A Pending CN109766776A (en) | 2018-12-18 | 2018-12-18 | Operation executes method, apparatus, computer equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109766776A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110298724A (en) * | 2019-05-22 | 2019-10-01 | 深圳壹账通智能科技有限公司 | It orders recommended method, device, computer equipment and storage medium |
| CN110298242A (en) * | 2019-05-22 | 2019-10-01 | 深圳壹账通智能科技有限公司 | APP method for switching theme, device, equipment and storage medium based on research and development management |
| CN114291038A (en) * | 2021-11-25 | 2022-04-08 | 合众新能源汽车有限公司 | Automatic heating method and device for rearview mirror |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103425247A (en) * | 2013-06-04 | 2013-12-04 | 深圳市中兴移动通信有限公司 | User reaction based control terminal and information processing method thereof |
| CN108039988A (en) * | 2017-10-31 | 2018-05-15 | 珠海格力电器股份有限公司 | Equipment control processing method and device |
| CN108307037A (en) * | 2017-12-15 | 2018-07-20 | 努比亚技术有限公司 | Terminal control method, terminal and computer readable storage medium |
-
2018
- 2018-12-18 CN CN201811553422.6A patent/CN109766776A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103425247A (en) * | 2013-06-04 | 2013-12-04 | 深圳市中兴移动通信有限公司 | User reaction based control terminal and information processing method thereof |
| CN108039988A (en) * | 2017-10-31 | 2018-05-15 | 珠海格力电器股份有限公司 | Equipment control processing method and device |
| CN108307037A (en) * | 2017-12-15 | 2018-07-20 | 努比亚技术有限公司 | Terminal control method, terminal and computer readable storage medium |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110298724A (en) * | 2019-05-22 | 2019-10-01 | 深圳壹账通智能科技有限公司 | It orders recommended method, device, computer equipment and storage medium |
| CN110298242A (en) * | 2019-05-22 | 2019-10-01 | 深圳壹账通智能科技有限公司 | APP method for switching theme, device, equipment and storage medium based on research and development management |
| CN114291038A (en) * | 2021-11-25 | 2022-04-08 | 合众新能源汽车有限公司 | Automatic heating method and device for rearview mirror |
| CN114291038B (en) * | 2021-11-25 | 2024-01-02 | 合众新能源汽车股份有限公司 | Automatic heating method and device for rearview mirror |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106068520A (en) | Personalized machine learning model | |
| Xing et al. | Robust object tracking with online multi-lifespan dictionary learning | |
| CN109829362A (en) | Safety check aided analysis method, device, computer equipment and storage medium | |
| CN109766776A (en) | Operation executes method, apparatus, computer equipment and storage medium | |
| CN109766491A (en) | Product search method, device, computer equipment and storage medium | |
| Zhang et al. | Hand Gesture recognition in complex background based on convolutional pose machine and fuzzy Gaussian mixture models | |
| CN111126339A (en) | Gesture recognition method and device, computer equipment and storage medium | |
| Liao et al. | Visualization-based active learning for video annotation | |
| CN108469975A (en) | Control display methods, device, computer equipment and storage medium | |
| CN106919326A (en) | A kind of image searching method and device | |
| CN112052816B (en) | Human behavior prediction method and system based on adaptive graph convolution countermeasure network | |
| CN115223239B (en) | Gesture recognition method, gesture recognition system, computer equipment and readable storage medium | |
| Ni et al. | Pose adaptive motion feature pooling for human action analysis | |
| Sun et al. | An improved single shot multibox for video-rate head pose prediction | |
| AU2021100368A4 (en) | Odour analysis method and device | |
| CN109697421A (en) | Evaluation method, device, computer equipment and storage medium based on micro- expression | |
| JP7196058B2 (en) | OBJECT SEARCH DEVICE AND OBJECT SEARCH METHOD | |
| CN105913024A (en) | Android mobile terminal detecting method based on LAP operator for resisting replay attacks | |
| Shitole et al. | Dynamic hand gesture recognition using PCA, Pruning and ANN | |
| Hettiarachchi | Analysis of different face detection andrecognition models for Android | |
| CN111259685B (en) | Fingerprint reconstruction method and storage medium | |
| CN109766771A (en) | It can operation object control method, device, computer equipment and storage medium | |
| Bhattacharyya et al. | Deep Feature Selection Using Moth-Flame Optimization for Facial Expression Recognition from Thermal Images | |
| KS et al. | Facial Emotion Recognition System Using Deep CNN For Rehabilitation With Hardware Integration | |
| Shi et al. | Compact global association based adaptive routing framework for personnel behavior understanding |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |