CN104820495B - A kind of micro- Expression Recognition of exception and based reminding method and device - Google Patents
A kind of micro- Expression Recognition of exception and based reminding method and device Download PDFInfo
- Publication number
- CN104820495B CN104820495B CN201510211929.3A CN201510211929A CN104820495B CN 104820495 B CN104820495 B CN 104820495B CN 201510211929 A CN201510211929 A CN 201510211929A CN 104820495 B CN104820495 B CN 104820495B
- Authority
- CN
- China
- Prior art keywords
- expression
- micro
- processing unit
- line
- eyebrow
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Landscapes
- Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
Abstract
The present invention relates to a kind of micro- Expression Recognition of exception and based reminding method and device, the device that the method uses includes: wearable terminal equipment, cloud signal processing unit, processing result is counter send unit；Wherein, wearable terminal equipment is worn on tester's body, for capturing and transmitting the micro- expression data of tested people；Cloud signal processing unit is for calculating the micro- expression data of tested people；Processing result is counter to send unit to be responsible for assigning cloud signal processing unit into the micro- expression result of exception for needing to prompt in instruction and send back wearable terminal equipment by wireless network；Micro- expression data of tested people is carried out the processing of three phases: first stage by reception of wireless signals by cloud signal processing unit, calculates micro- expression base-line data of tested people；Second stage captures micro- expression data in test problem question and answer stage；Phase III, micro- expression data of second stage is compared into the base-line data of first stage and carries out opposite operation, filtering obtains abnormal micro- expression result.
Description
Technical field
The present invention relates to a kind of micro- Expression Recognitions of exception and based reminding method and device, belong to intelligent Expression Recognition field.
Background technique
Micro- expression is the very quick expression for a kind of duration being only 1/25 second to 1/5 second, expresses people and attempts to press
Suppression and hiding real emotion.Micro- expression is that the mankind attempt to constrain or that whens hiding real feelings reveals is very of short duration, cannot
The facial expression of autonomous control.As the effective clue of identification lie, micro- expression can be applied to the fields such as safety, the administration of justice, clinic.
Existing wearable (portable) Expression Recognition equipment is divided into two classes, and one kind is wearable or portable device, wears
It is in addition a kind of to be directed to tested personnel's shooting, non-portable but function and the first kind using fixing camera with tester
It is similar.
The equipment that the first kind is worn by tester side shoots and identifies tested personnel's other than tested body
Expression, this kind of equipment there are the shortcomings that clearly, lack two vital factors, first is that not establishing the algorithm of baseline
Process, second is that unobvious or have fraudulent when cannot analyse and carry out obvious result in tested personnel's expression.So this kind of set
The standby recognition reaction for being merely capable of playing " performance expression ", and cannot capture and analyze and represent the thin of the tested true phychology of personnel
Micro- expression and abnormal micro- expression.These disadvantages are made up, need to solve two problems, are to establish tested personnel individual's base first
The algorithm of line number evidence followed by allots the facial deceit of camouflage by small expression form and captures true emotional expression, and will
The expression attribute is associated with stimulation source problem, and then retrodicts tested personnel's phychology.
Second class is the non-wearable device of fixing camera (camera lens), and the shortcomings that this kind of equipment is equipment itself to tested
Examination personnel limitation is more, and is easy to interfere the natural expression of tested personnel.The ideal state of micro- expression test is to tested people
Otherwise member can not differentiate the small expression producing cause of tested personnel without the interference of any aspect, be difficult and its psychological shape
State variation carries out causalnexus, it is more likely that its expression shape change is that the reasons such as the wearing by equipment, the curiosity to equipment, concern are drawn
Hair, so the data obtained is contaminated data.
For micro- expression because of " mood expression " is generated by effective stimulus, it breaks through the control and puppet of " social expression "
Betray small form after dress, can not be controlled by tested personnel, therefore can be as according to the tested personnel psychology of interpretation
State.Even if tested personnel take the counterplots such as performance or silencing, still can be from small expression shape as long as problem is in place
Important psychological condition is analyzed in state.
Summary of the invention
To achieve the purpose that, according to micro- Expression analysis tested personnel psychological activity, the present invention relates to a kind of micro- expressions of exception to know
Not and based reminding method, the device that the method uses include: wearable terminal equipment, cloud signal processing unit, processing result
It is counter to send unit；Wherein, wearable terminal equipment is worn on tester's body, for capturing and transmitting the micro- expression number of tested people
According to；Cloud signal processing unit is for calculating the micro- expression data of tested people；Processing result is counter to send unit to be responsible for cloud signal
Processing unit assigns the micro- expression result of exception for needing to prompt in instruction and sends back wearable terminal equipment by wireless network；
Micro- expression data of tested people is carried out three phases by reception of wireless signals by cloud signal processing unit
Processing:
First stage calculates micro- expression base-line data of tested people；
Second stage captures micro- expression data in test problem question and answer stage；
Phase III, micro- expression data is compared into baseline and carries out opposite operation, filtering obtains abnormal micro- expression knot
Fruit.
In addition, described device includes independent mutually the present invention also provides a kind of device of exception micro- Expression Recognition and prompting
Following equipment: wearable terminal equipment, cloud signal processing unit, processing result is counter send unit；Wherein, wearable terminal is set
It is standby to be worn on tester's body, for capturing and transmitting the micro- expression data of tested people；Cloud signal processing unit is based on
Calculate the tested micro- expression data of people；Processing result is counter to send unit to be responsible for assigning cloud signal processing unit and need to prompt in instruction
Exception micro- expression result wearable terminal equipment is sent back by wireless network.
The invention has the advantages that
1) device end is wearable glasses and glasses (portable), and is worn on one side of tester, for tested
People will not generate any interference, will not cause concern, curiosity, sensitivity or the fear of tested people, gained test data be all by
Test problem causes, and will not generate contaminated data, greatly improve the accuracy of test.
2) at the rear of wearable device terminal, the cloud signal processing unit being made of high performance computing system is gathered around
Have unique algorithm routine and advanced processing capacity, can be divided into three sport indexs effectively analyze tested personnel exception it is micro-
Expression.Moreover, during the test, for the tested personnel's individual of difference, initially setting up base-line data, it is ensured that test data
Specific aim greatly improves test accuracy.
3) according to the calculated result of cloud signal processing unit, unit is sent to feed back in the form of audio or video counter
Tester, can allow tester to grasp the phychology and emotional state of tested personnel in real time, and subtest smoothly completes.
4) it can be avoided tested by the variation of association stimulus and subtle mood expression form by unique algorithm
The camouflage or performance of examination personnel is cheated, and is only captured the variation of micro- expression and then is derived, analysis result is more accurate.
Detailed description of the invention
The exemplary embodiment that the present invention will be described in more detail by referring to accompanying drawing, the above and other aspect of the invention and
Advantage will become more easily clear, in the accompanying drawings:
Fig. 1 is that the principle of a kind of micro- Expression Recognition of exception and alarm set of the invention is intended to
Fig. 2 is Glasses structure schematic diagram of the invention；
Fig. 3 is handset structure schematic diagram of the invention；
Fig. 4 is the flow chart of a kind of exception micro- Expression Recognition and based reminding method of the invention.
Specific embodiment
Hereinafter, now with reference to attached drawing, the present invention is more fully described, and various embodiments are shown in the attached drawings.So
And the present invention can be implemented in many different forms, and should not be construed as limited to embodiment set forth herein.Phase
Instead, it theses embodiments are provided so that the disclosure will be thorough and complete, and fully conveys the scope of the present invention to ability
Field technique personnel.
Hereinafter, the exemplary embodiment that the present invention will be described in more detail with reference to the accompanying drawings.
As shown in Figure 1, the present invention is made of three parts: wearable terminal equipment, cloud signal processing unit, processing knot
Fruit is counter to send unit.Wherein, wearable terminal equipment is worn on tester's body, for capturing and transmitting the micro- expression of tested people
Data；Cloud signal processing unit is for calculating the micro- expression data of tested people；Processing result is counter to send unit to be responsible for believing in cloud
Number processing unit assigns the micro- expression result of exception for needing to prompt in instruction and sends back wearable terminal equipment by wireless network.
Wearable terminal equipment may include glasses, earphone and glasses.Wherein eyeglasses-wearing is used in tester head
In the micro- expression data for capturing tested people.Glasses as shown in Figure 1, 2 are furnished with high-definition camera (1), have automatic tracing and right
Burnt function captures the facial movement of tested people always.Due to being combined with the active movement of wearer, the direction of tracking and model
It encloses more accurate compared with traditional Expression Recognition instrument (not movable).After video data capture arrives, communication module (2) passes through nothing
Line signal (technologies such as Wi-Fi or bluetooth or RFID) is transferred to cloud signal processing unit.
Micro- expression data of tested people is carried out three phases by reception of wireless signals by cloud signal processing unit
Processing.As shown in figure 4, being the flow chart of a kind of exception micro- Expression Recognition and based reminding method of the invention.
First stage calculates micro- expression base-line data of tested people.
The acquisition of base-line data needs to cooperate the question and answer of baseline topic.According to standard testing process, tester can be first
Put question to tested one group of baseline test problem of people, in the question answering process of this group of problem, cloud signal processing unit is to tested people
Eyebrow form, three indexs of line are calculated between eyelid fissura palpebrae and lip, obtain micro- expression base-line data.
Index one: eyebrow form can be divided into three sub- indexs, be respectively:
1) brows position.When referring to that tested personnel are poker-faced, bilateral brows are apart from the vertical corresponding points of hair line
Relative position.Because hair line hardly moves when mankind's face generates expression, it is possible to as line of reference,
Measure the change in location of key point.
2) brows are to eyebrow peak line angle.
3) distance matrix of eyebrow lower edge and upper eyelid edge.
During baseline Questions, the vision signal that wearable terminal equipment is passed back is calculated, by above three data
It counts and stores, as the baseline value for comparing eyebrow movement.
Index two: eyelid fissura palpebrae (diameter of iris expose portion).Only there are two the directions of motion for tested personnel's eyelid, i.e.,
It opens wide and fissura palpebrae is caused to increase, and close and small fissura palpebrae is caused to reduce.Fissura palpebrae just refers to that the distance between upper and lower eyelid (is single with millimeter
Position).The baseline value of eyelid fissura palpebrae index, when being exactly that tested personnel are poker-faced, fissura palpebrae value size.
Index three: line (corners of the mouth position, chin portion) between lip is divided into three sub- indexs, is respectively:
1) line morphology between lip, when referring to that tested personnel are poker-faced, the form (radian) of line between upperlip.
2) corners of the mouth position, when referring to that tested personnel are poker-faced, the bilateral corners of the mouth is apart from the vertical corresponding points of hair line
Relative position.Because hair line hardly moves when mankind's face generates expression, it is possible to as line of reference,
Measure the change in location of key point.During baseline Questions, the vision signal that wearable terminal equipment is passed back is calculated, it will
Above-mentioned two data statistics goes out and stores, as the baseline value for comparing corners of the mouth change in location.
3) the bright dim spot area comparison in chin portion.When referring to that tested personnel are poker-faced, the bright dim spot in chin portion
Area reduced value.
Second stage captures micro- expression data in test problem question and answer stage.
The acquisition of practical micro- expression data, needs to cooperate special test topic question and answer.According to standard testing process, test
Personnel can be after baseline test inscribes completion, the tested one group of actual test problem of people of enquirement, in the question answering process of this group of problem,
Cloud signal processing unit calculates three eyebrow of tested people, fissura palpebrae and mouth indexs, obtains practical micro- expression data.
Eyebrow part can have 6 kinds of possible motion morphologies:
1) bilateral brows move down, and brows eyebrow peak line angle increases, and expression is frowned by force；
2) bilateral brows move down, and brows eyebrow peak line angle is constant, indicate weak and frown；
3) bilateral brows move up, and brows eyebrow peak line angle is constant, indicate to raise one's eyebrows；
4) bilateral brows move up, and brows eyebrow peak line angle reduces, and indicate Embarrassing eyebrow；
5) eyebrow eyelid spacing reduces, and indicates indignation；
6) eyebrow eyelid spacing increases, and indicates that it doesn't matter；
During actual test Questions, micro- expression number in the vision signal of in real time passing wearable terminal equipment back
It is compared according to stored base-line data, being transferred to the phase III is calculated and analyzed.
Eyelid fissura palpebrae index (iris expose portion diameter index) is divided into increase and reduces two kinds of situations.In practical problem
In question answering process, calculate the vision signal passed back of wearable terminal equipment, above-mentioned two data statistics gone out and stored, as than
To the value of abnormal fissura palpebrae value variation, being transferred to the phase III is calculated and is analyzed.
Line index between lip is divided into bank degree, the bright dim spot area reduced value in corners of the mouth position and chin portion between lip, shares three
The valuable variation of kind:
1) bank degree increases upwards between lip, and corners of the mouth position moves up, and the bright dim spot reduced value in chin portion is unchanged, indicates to laugh at；
2) bank degree increases downwards between lip, and corners of the mouth position moves down, and the bright dim spot reduced value variation in chin portion is obvious, indicates no
It is fixed；
3) bank degree increases upwards between lip, and corners of the mouth position is almost unchanged, or the unilateral corners of the mouth raises up, the bright dim spot pair in chin portion
Ratio is unchanged, indicates contempt；
During actual test Questions, the vision signal that wearable terminal equipment is passed back is calculated, by above three
Data statistics goes out and stores, and as the changing value for comparing abnormal mouth form, being transferred to the phase III is calculated and analyzed.
Phase III compares baseline and carries out opposite operation, and filtering obtains abnormal micro- expression result.
1, if there is the increased independent sign of fissura palpebrae, then oppressive surprised expression is formed as a result, processing unit will pass through
It is counter that unit is sent to propose sound warning to wearer.
2, if there is the+increased combination of fissura palpebrae that raises one's eyebrows, then surprised expression is formed as a result, processing unit will send list by counter
Member proposes sound warning to wearer.
3, if there is frown+fissura palpebrae reduction+lip between the reclinate combination of line, then formed and strong detest expression as a result, place
Reason unit will send unit to propose sound warning to wearer by counter.
4, it if there is+the combination that above mentions of fissura palpebrae reduction+unilateral side corners of the mouth of frowning, is then formed and detests expression as a result, processing is single
Member will send unit to propose sound warning to wearer by counter.
5, the combination above mentioned if there is fissura palpebrae reduction+unilateral side corners of the mouth then forms contempt expression as a result, processing unit will lead to
Cross it is counter send unit to wearer propose sound warning.
6, form is above proposed if there is the unilateral corners of the mouth, is then formed and does not consider expression worth doing as a result, processing unit will send unit by counter
Sound warning is proposed to wearer.
7, if there is+fissura palpebrae increase combination of frowning, then angry facial expression is formed as a result, processing unit will send unit by counter
Sound warning is proposed to wearer.
8, increase combination if there is Embarrassing eyebrow+fissura palpebrae, then form frightened expression as a result, processing unit will send unit by counter
Sound warning is proposed to wearer.
9, if there is Embarrassing eyebrow+fissura palpebrae reduction combination, then sad expression is formed as a result, processing unit will send list by counter
Member proposes sound warning to wearer.
10, it is bent downwardly+bright increased the combination of dim spot area reduced value in chin portion if there is line between lip, is then formed no
Expression is determined as a result, processing unit will send unit to propose sound warning to wearer by counter.
11, the combination above mentioned if there is fissura palpebrae reduction+bilateral corners of the mouth, and fissura palpebrae variation compares the ratio of baseline value, with
The ratio that the variation that the bilateral corners of the mouth above proposes value compares baseline value is not identical, then forms phoney expression as a result, processing unit will pass through
It is counter that unit is sent to propose sound warning to wearer.
As shown in Fig. 2, the glasses are monolithic or biplate, the glasses are furnished with earphone (3) and signal transmission unit, described
Signal transmission unit has screen (4), can carry out visual information prompt.Glasses send list by the way that wireless receiver (5) reception is counter
The alarm signal that member issues reminds tester's expression result in the form of sound or image.Tester is to according to result
The true heart activity for judging tested personnel, achievees the effect that detect a lie.
The wearable terminal equipment as shown in Figure 3 can also use but be not limited to mobile phone.Mobile phone is furnished with high-definition camera
(1), have automatic tracing and focus function, capture the eye motion of tested people always.Due to being combined with the active of wearer
Movement, the direction of tracking and range are more accurate compared with conventional line-of-sight park instrument (not movable).Video data capture arrives it
Afterwards, communication module (2) is transferred to cloud signal processing unit by wireless signal (Wi-Fi).Mobile phone is connect by wireless receiver
The anti-alarm signal for sending unit to issue is received, is connected on screen (3) or through wireless or bluetooth or wired mode in the form of images
Lug machine reminds tester's expression result.Tester to judge the true heart activity of tested personnel according to result,
Achieve the effect that detect a lie.
The above description is only an embodiment of the present invention, is not intended to restrict the invention.The present invention can have various conjunctions
Suitable change and variation.Any modification, equivalent substitution, improvement and etc. done within the spirit and principles of the present invention, should all
It is included within protection scope of the present invention.
Claims (9)
1. a kind of micro- Expression Recognition of exception and based reminding method,
The device that the method uses includes: wearable terminal equipment, cloud signal processing unit, processing result is counter send unit；
Wherein, wearable terminal equipment is worn on tester's body, for capturing and transmitting the micro- expression data of tested people；Cloud
Signal processing unit, for calculating the micro- expression data of tested people；Processing result is counter to send unit, is responsible for cloud signal processing list
Member assigns the micro- expression result of exception for needing to prompt in instruction and sends back wearable terminal equipment by wireless network；
Wherein, micro- expression data of tested people is carried out three by reception of wireless signals by the cloud signal processing unit
The processing in stage:
First stage calculates micro- expression base-line data of tested people, and micro- expression base-line data includes eyebrow form, eyelid
Line between fissura palpebrae, lip；
Second stage captures micro- expression data in test problem question and answer stage；
Micro- expression data of second stage is compared the base-line data of first stage and carries out opposite operation by the phase III,
Filtering obtains abnormal micro- expression result；
It is characterized by:
In the first stage, the acquisition of base-line data needs to cooperate the question and answer of baseline topic；According to standard testing process,
Tester puts question to tested one group of baseline test problem of people, in the question answering process of this group of problem, cloud signal processing first
Unit calculates three indexs of line the eyebrow form of tested people, eyelid fissura palpebrae and lip, obtains micro- expression baseline number
According to；
Index one: eyebrow form is divided into three sub- indexs, is respectively:
1) brows position；When referring to that tested personnel are poker-faced, phase of the bilateral brows apart from the vertical corresponding points of hair line
To position；
2) brows are to eyebrow peak line angle；
3) distance matrix of eyebrow lower edge and upper eyelid edge；
During baseline Questions, the vision signal that wearable terminal equipment is passed back is calculated, by above-mentioned three sub- indexs
Data statistics simultaneously stores, as the baseline value for comparing eyebrow movement；
Index two: eyelid fissura palpebrae, the i.e. diameter of iris expose portion；Only there are two the directions of motion for tested personnel's eyelid, that is, open
It causes fissura palpebrae to increase greatly, and closes and small fissura palpebrae is caused to reduce；Fissura palpebrae just refers to the distance between upper and lower eyelid；Eyelid fissura palpebrae index
Baseline value, when being exactly that tested personnel are poker-faced, fissura palpebrae value size；
Index three: line between lip is divided into three sub- indexs, is respectively:
1) line morphology between lip, when referring to that tested personnel are poker-faced, the form of line between upperlip；
2) corners of the mouth position, when referring to that tested personnel are poker-faced, phase of the bilateral corners of the mouth apart from the vertical corresponding points of hair line
To position；During baseline Questions, the vision signal that wearable terminal equipment is passed back is calculated, by the above-mentioned bilateral corners of the mouth
Data statistics simultaneously stores, as the baseline value for comparing corners of the mouth change in location；
3) the bright dim spot area comparison in chin portion；When referring to that tested personnel are poker-faced, the face of the bright dim spot in chin portion
Product reduced value.
2. a kind of micro- Expression Recognition of exception and based reminding method as described in claim 1, it is characterised in that:
In the second stage, the acquisition of practical micro- expression data needs to cooperate special test topic question and answer；According to standard
Testing process, tester put question to tested one group of actual test problem of people after baseline test topic is completed, this group of problem
In question answering process, cloud signal processing unit calculates three eyebrow of tested people, fissura palpebrae and mouth indexs, obtains reality
Micro- expression data；
Eyebrow part can have 6 kinds of possible motion morphologies:
1) bilateral brows move down, and brows eyebrow peak line angle increases, and expression is frowned by force；
2) bilateral brows move down, and brows eyebrow peak line angle is constant, indicate weak and frown；
3) bilateral brows move up, and brows eyebrow peak line angle is constant, indicate to raise one's eyebrows；
4) bilateral brows move up, and brows eyebrow peak line angle reduces, and indicate Embarrassing eyebrow；
5) eyebrow eyelid spacing reduces, and indicates indignation；
6) eyebrow eyelid spacing increases, and indicates that it doesn't matter；
During actual test Questions, in the vision signal of in real time passing wearable terminal equipment back micro- expression data with
Stored base-line data is compared, and is transferred to the phase III and is calculated and analyzed；
Eyelid fissura palpebrae index is divided into increase and reduces two kinds of situations；In practical problem question answering process, calculates wearable terminal and set
The standby vision signal passed back, by above-mentioned increase and reduced data statistics and storage, as the value for comparing abnormal fissura palpebrae value variation,
Being transferred to the phase III is calculated and is analyzed；
Line index between lip is divided into bank degree, the bright dim spot area reduced value in corners of the mouth position and chin portion between lip, and there are three types of have altogether
The variation of value:
1) bank degree increases upwards between lip, and corners of the mouth position moves up, and the bright dim spot reduced value in chin portion is unchanged, indicates to laugh at；
2) bank degree increases downwards between lip, and corners of the mouth position moves down, and the bright dim spot reduced value variation in chin portion is obvious, indicates negative；
3) bank degree increases upwards between lip, and corners of the mouth position is constant, or the unilateral corners of the mouth raises up, and the bright dim spot reduced value in chin portion is without change
Change, indicates contempt；
During actual test Questions, the vision signal that wearable terminal equipment is passed back is calculated, above three is changed
Data statistics go out and store, as the changing value for comparing abnormal mouth form, being transferred to the phase III is calculated and is analyzed.
3. a kind of micro- Expression Recognition of exception and based reminding method as claimed in claim 2, it is characterised in that:
The phase III, the specific method is as follows:
1), if there is the increased independent sign of fissura palpebrae, then oppressive surprised expression is formed as a result, processing unit will be sent by counter
Unit proposes sound warning to wearer；
2), if there is the+increased combination of fissura palpebrae that raises one's eyebrows, then surprised expression is formed as a result, processing unit will send unit by counter
Sound warning is proposed to wearer；
3), if there is frown+fissura palpebrae reduction+lip between the reclinate combination of line, then formed and strong detest expression as a result, processing is single
Member will send unit to propose sound warning to wearer by counter；
4) it, if there is the+combination that above mentions of fissura palpebrae reduction+unilateral side corners of the mouth of frowning, is then formed and detests expression as a result, processing unit will
Unit is sent to propose sound warning to wearer by counter；
5), the combination above mentioned if there is fissura palpebrae reduction+unilateral side corners of the mouth then forms contempt expression as a result, processing unit will pass through
It is counter that unit is sent to propose sound warning to wearer；
6) form above, is proposed if there is the unilateral corners of the mouth, then is formed and does not consider expression worth doing as a result, processing unit will send unit to pendant by counter
Wearer proposes sound warning；
7), if there is+fissura palpebrae increase combination of frowning, then angry facial expression is formed as a result, processing unit will send unit pair by counter
Wearer proposes sound warning；
8), increase combination if there is Embarrassing eyebrow+fissura palpebrae, then form frightened expression as a result, processing unit will send unit pair by counter
Wearer proposes sound warning；
9), if there is Embarrassing eyebrow+fissura palpebrae reduction combination, then sad expression is formed as a result, processing unit will send unit by counter
Sound warning is proposed to wearer；
10) it, is bent downwardly the+bright increased combination of dim spot area reduced value in chin portion if there is line between lip, then forms negative
Expression will be as a result, processing unit will send unit to propose sound warning to wearer by counter；
11), the combination above mentioned if there is fissura palpebrae reduction+bilateral corners of the mouth, and fissura palpebrae variation compares the ratio of baseline value, with bilateral
The ratio that the variation comparison baseline value of value is mentioned on the corners of the mouth is not identical, then forms phoney expression as a result, processing unit will be sent by counter
Unit proposes sound warning to wearer.
4. a kind of micro- Expression Recognition of exception and based reminding method as claimed in claim 3, it is characterised in that:
The wearable terminal equipment includes glasses and earphone, and the glasses are furnished with high-definition camera (1) and communication module (2).
5. a kind of micro- Expression Recognition of exception and based reminding method as claimed in claim 4, it is characterised in that:
The glasses are monolithic or biplate, and the glasses are furnished with signal transmission unit, and the signal transmission unit has screen, can
To carry out visual information prompt.
6. a kind of micro- Expression Recognition of exception and alarm set,
Described device includes mutual independent following equipment: wearable terminal equipment, cloud signal processing unit, processing result are anti-
Send unit；Wherein, wearable terminal equipment is worn on tester's body, for capturing and transmitting the micro- expression number of tested people
According to；Cloud signal processing unit is for calculating the micro- expression data of tested people；Processing result is counter to send unit to be responsible for cloud signal
Processing unit assigns the micro- expression result of exception for needing to prompt in instruction and sends back wearable terminal equipment by wireless network；
Wherein, micro- expression data of tested people is carried out three by reception of wireless signals by the cloud signal processing unit
The processing in stage:
First stage calculates micro- expression base-line data of tested people；
Second stage captures micro- expression data in test problem question and answer stage；
Micro- expression data of second stage is compared the base-line data of first stage and carries out opposite operation by the phase III,
Filtering obtains abnormal micro- expression result；It is characterized by: in the first stage, the acquisition of base-line data needs to cooperate base
The question and answer of line topic；According to standard testing process, tester puts question to tested one group of baseline test problem of people first, in this group
In the question answering process of problem, cloud signal processing unit is between three, line the eyebrow form of tested people, eyelid fissura palpebrae and lip
Index is calculated, and micro- expression base-line data is obtained；
Index one: eyebrow form is divided into three sub- indexs, is respectively:
1) brows position；When referring to that tested personnel are poker-faced, phase of the bilateral brows apart from the vertical corresponding points of hair line
To position；
2) brows are to eyebrow peak line angle；
3) distance matrix of eyebrow lower edge and upper eyelid edge；
During baseline Questions, the vision signal that wearable terminal equipment is passed back is calculated, by above-mentioned three sub- indexs
Data statistics simultaneously stores, as the baseline value for comparing eyebrow movement；
Index two: eyelid fissura palpebrae, the i.e. diameter of iris expose portion；Only there are two the directions of motion for tested personnel's eyelid, that is, open
It causes fissura palpebrae to increase greatly, and closes and small fissura palpebrae is caused to reduce；Fissura palpebrae just refers to the distance between upper and lower eyelid；Eyelid fissura palpebrae index
Baseline value, when being exactly that tested personnel are poker-faced, fissura palpebrae value size；
Index three: line between lip is divided into three sub- indexs, is respectively:
1) line morphology between lip, when referring to that tested personnel are poker-faced, the form of line between upperlip；
2) corners of the mouth position, when referring to that tested personnel are poker-faced, phase of the bilateral corners of the mouth apart from the vertical corresponding points of hair line
To position；During baseline Questions, the vision signal that wearable terminal equipment is passed back is calculated, by the above-mentioned bilateral corners of the mouth
Data statistics simultaneously stores, as the baseline value for comparing corners of the mouth change in location；
3) the bright dim spot area comparison in chin portion；When referring to that tested personnel are poker-faced, the face of the bright dim spot in chin portion
Product reduced value.
7. a kind of micro- Expression Recognition of exception and alarm set as claimed in claim 6, it is characterised in that:
The wearable terminal equipment includes glasses and earphone, and the glasses are furnished with high-definition camera (1) and communication module (2).
8. a kind of micro- Expression Recognition of exception and alarm set as claimed in claim 7, it is characterised in that:
The glasses are monolithic or biplate, and the glasses are furnished with signal transmission unit, and the signal transmission unit has screen, can
To carry out visual information prompt.
9. a kind of micro- Expression Recognition of exception and alarm set as claimed in claim 6, it is characterised in that:
The wearable terminal equipment can also use mobile phone, and mobile phone is furnished with high-definition camera (1), has automatic tracing and focusing
Function captures the eye motion of tested people always, and after video data capture arrives, communication module (2) passes through wireless signal Wi-
Fi is transferred to cloud signal processing unit, and mobile phone receives the anti-alarm signal for sending unit to issue by wireless receiver, with image
Form on screen (3) or by wirelessly or non-wirelessly mode connect earphone remind tester's expression result.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510211929.3A CN104820495B (en) | 2015-04-29 | 2015-04-29 | A kind of micro- Expression Recognition of exception and based reminding method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510211929.3A CN104820495B (en) | 2015-04-29 | 2015-04-29 | A kind of micro- Expression Recognition of exception and based reminding method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104820495A CN104820495A (en) | 2015-08-05 |
| CN104820495B true CN104820495B (en) | 2019-06-21 |
Family
ID=53730809
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510211929.3A Active CN104820495B (en) | 2015-04-29 | 2015-04-29 | A kind of micro- Expression Recognition of exception and based reminding method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104820495B (en) |
Families Citing this family (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105183170B (en) | 2015-09-22 | 2018-09-25 | 京东方科技集团股份有限公司 | Wear-type wearable device and its information processing method, device |
| CN105913046A (en) * | 2016-05-06 | 2016-08-31 | 姜振宇 | Micro-expression identification device and method |
| CN107480577A (en) * | 2016-06-07 | 2017-12-15 | 深圳市珍爱网信息技术有限公司 | A kind of face sincerity recognition methods and device |
| US10043406B1 (en) | 2017-03-10 | 2018-08-07 | Intel Corporation | Augmented emotion display for austistic persons |
| CN107704834B (en) * | 2017-10-13 | 2021-03-30 | 深圳壹账通智能科技有限公司 | Micro-surface examination assisting method, device and storage medium |
| CN107862295B (en) * | 2017-11-21 | 2021-04-02 | 武汉大学 | Method for identifying facial expressions based on WiFi channel state information |
| CN108537160A (en) * | 2018-03-30 | 2018-09-14 | 平安科技（深圳）有限公司 | Risk Identification Method, device, equipment based on micro- expression and medium |
| CN108875660A (en) * | 2018-06-26 | 2018-11-23 | 肖哲睿 | A kind of interactive robot based on cloud computing |
| CN111292455B (en) * | 2020-03-05 | 2021-05-18 | 深圳市君利信达科技有限公司 | Customs gate detection system based on face and fingerprint identification |
| CN113709165A (en) * | 2021-08-31 | 2021-11-26 | 贵州东冠科技有限公司 | Information security filtering system and method for micro-expressions |
| CN114129165A (en) * | 2021-12-10 | 2022-03-04 | 北京邮电大学 | Psychological assessment method, system and storage medium based on credible assessment scale |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN202060785U (en) * | 2011-03-31 | 2011-12-07 | 上海天岸电子科技有限公司 | Human eye pupil lie detector |
| CN104142583A (en) * | 2014-07-18 | 2014-11-12 | 广州市香港科大霍英东研究院 | Intelligent glasses with blinking detection function and implementation method thereof |
| KR20140135460A (en) * | 2013-05-16 | 2014-11-26 | 엘에스산전 주식회사 | Apparatus and method for controlling of monitoring screen in SCADA system |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103258204B (en) * | 2012-02-21 | 2016-12-14 | 中国科学院心理研究所 | A kind of automatic micro-expression recognition method based on Gabor and EOH feature |
| JP6316023B2 (en) * | 2013-05-17 | 2018-04-25 | キヤノン株式会社 | Camera system and camera control device |
| CN104008391A (en) * | 2014-04-30 | 2014-08-27 | 首都医科大学 | Face micro-expression capturing and recognizing method based on nonlinear dimension reduction |
| CN104375650A (en) * | 2014-12-02 | 2015-02-25 | 上海恩凡物联网科技有限公司 | Social contact identification method and system based on intelligent wearable device |
| CN204790850U (en) * | 2015-04-29 | 2015-11-18 | 姜振宇 | Unusual little expression discernment and reminding device |
-
2015
- 2015-04-29 CN CN201510211929.3A patent/CN104820495B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN202060785U (en) * | 2011-03-31 | 2011-12-07 | 上海天岸电子科技有限公司 | Human eye pupil lie detector |
| KR20140135460A (en) * | 2013-05-16 | 2014-11-26 | 엘에스산전 주식회사 | Apparatus and method for controlling of monitoring screen in SCADA system |
| CN104142583A (en) * | 2014-07-18 | 2014-11-12 | 广州市香港科大霍英东研究院 | Intelligent glasses with blinking detection function and implementation method thereof |
Non-Patent Citations (3)
| Title |
|---|
| 微表情在侦查实践中的应用;邵磊;《江西警察学院学报》;20131130(第6期 总第170期);第33-38页 |
| 微表情研究及其应用;吴奇 等;《心理科学进展》;20100930;第18卷(第9期);第1359-1368页 |
| 微表情自动识别综述;贲晛烨 等;《计算机辅助设计与图形学学报》;20140930;第26卷(第9期);第1385-1395页 |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104820495A (en) | 2015-08-05 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104820495B (en) | A kind of micro- Expression Recognition of exception and based reminding method and device | |
| CN112034977B (en) | Method for MR intelligent glasses content interaction, information input and recommendation technology application | |
| US11032457B2 (en) | Bio-sensing and eye-tracking system | |
| CN108470169A (en) | Face identification system and method | |
| CN105183170B (en) | Wear-type wearable device and its information processing method, device | |
| CN109431452B (en) | Unmanned eye health screening instrument | |
| US20150378431A1 (en) | Eye-controlled user interface | |
| CN105913046A (en) | Micro-expression identification device and method | |
| US11328533B1 (en) | System, method and apparatus for detecting facial expression for motion capture | |
| JP2023508339A (en) | Ocular system for deception detection | |
| CN108401129A (en) | Video call method, device, terminal and storage medium based on wearable device | |
| CN105843395A (en) | Glasses capable of interacting with electronic equipment as well as interaction method | |
| CN104809440B (en) | It is a kind of exception sight park identification and based reminding method and device | |
| CN107480716A (en) | Method and system for identifying saccade signal by combining EOG and video | |
| CN104809371B (en) | Judge the device and method of the authentication information validity of head-wearing type intelligent equipment | |
| AU2014234955B2 (en) | Automatic detection of task transition | |
| CN204790850U (en) | Unusual little expression discernment and reminding device | |
| Bœkgaard et al. | In the twinkling of an eye: Synchronization of EEG and eye tracking based on blink signatures | |
| CN108898058A (en) | The recognition methods of psychological activity, intelligent necktie and storage medium | |
| CN104809439B (en) | It is a kind of exception blink movement identification and based reminding method and device | |
| CN104834904B (en) | It is a kind of exception Rotation of eyeball identification and based reminding method and device | |
| CN204759445U (en) | Unusual eyeball pivoted discernment and reminding device | |
| CN106557738A (en) | A kind of long-distance iris identification device | |
| CN208156903U (en) | Intelligent language interactive system based on posture perception | |
| CN112784655A (en) | Living body detection method and device based on gazing information and detection equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| EXSB | Decision made by sipo to initiate substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |