CN104809440A - Abnormal sight stop recognizing and reminding method and device - Google Patents

Abnormal sight stop recognizing and reminding method and device Download PDF

Info

Publication number
CN104809440A
CN104809440A CN201510213890.9A CN201510213890A CN104809440A CN 104809440 A CN104809440 A CN 104809440A CN 201510213890 A CN201510213890 A CN 201510213890A CN 104809440 A CN104809440 A CN 104809440A
Authority
CN
China
Prior art keywords
sight line
data
parks
abnormal
processing unit
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201510213890.9A
Other languages
Chinese (zh)
Other versions
CN104809440B (en
Inventor
姜振宇
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Individual
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Priority to CN201510213890.9A priority Critical patent/CN104809440B/en
Publication of CN104809440A publication Critical patent/CN104809440A/en
Application granted granted Critical
Publication of CN104809440B publication Critical patent/CN104809440B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Landscapes

  • Eye Examination Apparatus (AREA)
  • Alarm Systems (AREA)

Abstract

The invention relates to an abnormal sight stop recognizing and reminding method and device. The device applied to the method includes wearable terminal equipment, a cloud signal processing unit and a processing result reverse feeding unit. The wearable terminal equipment is wore on the body of a testing staff and is used for capturing and transmitting the sight stop data of a person to be tested; the cloud signal processing unit is used for calculating the sight stop data of the person to be tested; the processing result reverse feeding unit is used for feeding an abnormal sight stop result, for reminding according to the command transmitted by the cloud signal processing unit, to the wearable terminal equipment through a wireless network; the cloud signal processing unit processes the sight stop data of the person to be tested in three steps through wireless signal receiving; in the first step, the sight stop baseline data of the tested person are calculated; in the second step, the sight stop data in a testing question answer step are captured; in the third step, the sight stop data of the second step are compared with the sight stop baseline data of the first step, relevant calculation is performed, and the abnormal sight stop result can be acquired by filtering.

Description

The identification that a kind of abnormal sight line is parked and based reminding method and device
Technical field
The present invention relates to identification and based reminding method and device that a kind of abnormal sight line parks, belong to intelligent Expression Recognition field.
Background technology
Micro-expression is only 1/25 second to 1/5 second expressing one's feelings very fast at a kind of duration, have expressed people and attempt to constrain and the real emotion hidden.Micro-expression be the mankind attempt constrain or hiding real feelings time reveal very of short duration, can not from the facial expression of main control.As the effective clue identifying lie, micro-expression can be applicable to the fields such as safe, judicial, clinical.
Existing wearable (portable) Expression Recognition equipment is divided into two classes, one class is worn on the tested person, one class is worn on it tester, also has plenty of fixing camera on probation and takes for tested personnel, non-portable but function is similar to Equations of The Second Kind.
The first kind sight line be worn on the tested person parks identification equipment, and the shortcoming had is that the natural sight line of interference tested personnel is parked.The ideal state that sight line parks test is to the interference of tested personnel without any visual aspects, otherwise the sight line cannot differentiating tested personnel parks producing cause, be difficult to carry out causalnexus with the change of its psychological condition, it is by the wearing of equipment that its sight line very possible is parked, cause, so the data obtained is contaminated data the reason such as curiosity, concern of equipment.
The equipment that Equations of The Second Kind is worn by tester side or used, takes and identifies that the expression of tested personnel and sight line are parked beyond tested health, and the shortcoming that this kind equipment exists clearly.No matter be that expression catches and identification software, or sight line parks seizure and analytical equipment, all lacks two vital factors, one is have no idea to set up and associating between carried test problem, and two is the algorithmic procedures not setting up baseline.The recognition reaction of " performance expression " so this kind equipment only can play, and can not catch and analyze the slight expression that represents the true phychology of tested personnel and abnormal sight line is parked.Making up these shortcomings, need to solve two problems, is first in method of testing and the corresponding technology of test problem, is secondly the algorithm setting up tested personnel individual base-line data.
Summary of the invention
For reaching the object according to micro-Expression analysis tested personnel psychological activity, the present invention relates to identification and based reminding method that a kind of abnormal sight line parks, the device that described method uses comprises: wearable terminal equipment, high in the clouds signal processing unit, result is counter send unit; Wherein, wearable terminal equipment is worn on tester's health, parks data for catching and transmitting tested people's sight line; High in the clouds signal processing unit parks data for calculating tested people's sight line; The anti-abnormal sight line sending unit to be responsible for high in the clouds signal processing unit to assign the prompting of instruction needs of result is parked result and is sent it back wearable terminal equipment by wireless network.
High in the clouds signal processing unit, by reception of wireless signals, the sight line of tested people is parked the process that data carry out three phases:
First stage, the sight line calculating tested people parks base-line data;
Subordinate phase, the sight line catching the test problem question and answer stage parks data;
Phase III, the sight line of the described sight line of subordinate phase being parked the comparing first stage is parked base-line data and carries out relative computing, filters and show that abnormal sight line parks result.
In addition, the identification that the present invention also provides a kind of abnormal sight line to park and alarm set, described device comprises mutually independently following equipment: wearable terminal equipment, high in the clouds signal processing unit, result is counter send unit; Wherein, wearable terminal equipment is worn on tester's health, parks data for catching and transmitting tested people's sight line; High in the clouds signal processing unit parks data for calculating tested people's sight line; The anti-abnormal sight line sending unit to be responsible for high in the clouds signal processing unit to assign the prompting of instruction needs of result is parked result and is sent it back wearable terminal equipment by wireless network.
Further, described wearable terminal equipment comprises glasses and earphone, and described glasses are furnished with high-definition camera (1) and communication module (2).
Further, described glasses are monolithic or biplate, and described glasses are furnished with signal transmission unit, and described signal transmission unit has screen, can carry out visual information prompting.
Advantage of the present invention comprises:
1) device end wearable (portable), and be worn on tester one side, any interference can not be produced for tested people, the concern of tested people, curiosity, sensitivity or frightened can not be caused, gained test data is all caused by test problem, contaminated data can not be produced, significantly improve the accuracy of test.
2) at the rear of wearable device terminal, the high in the clouds signal processing unit be made up of high performance computing system, have unique algorithm routine and advanced processing power, the abnormal sight line that three sport indexs can be divided into effectively to analyze tested personnel is parked.And in test process, for difference, tested personnel are individual, first set up base-line data, guarantee the specific aim of test data, significantly improve test accuracy.
3) according to the result of calculation of high in the clouds signal processing unit, feed back to tester by the anti-unit that send with the form of audio frequency, tester can be allowed in real time to grasp phychology and the emotional state of tested personnel, completing smoothly of subtest.
Accompanying drawing explanation
Describe exemplary embodiment of the present invention in more detail by referring to accompanying drawing, above and other aspect of the present invention and advantage will become and more be readily clear of, in the accompanying drawings:
Fig. 1 is that the principle of a kind of sight line of the present invention identification of parking and alarm set is intended to;
Fig. 2 is handset structure schematic diagram used in the present invention;
Fig. 3 is Glasses structure schematic diagram of the present invention;
Fig. 4 is that the present invention is according to the method flow diagram of parking focusing;
Fig. 5 is that the present invention is according to the method flow diagram of parking duration.
Embodiment
Hereinafter, more fully the present invention is described now with reference to accompanying drawing, various embodiment shown in the drawings.But the present invention can implement in many different forms, and should not be interpreted as being confined to embodiment set forth herein.On the contrary, provide these embodiments to make the disclosure will be thoroughly with completely, and scope of the present invention is conveyed to those skilled in the art fully.
Hereinafter, with reference to the accompanying drawings exemplary embodiment of the present invention is described in more detail.
The present invention is the wearable device possessing " Expression Recognition that abnormal sight line is parked and prompting " function.
The present invention is made up of three parts: wearable terminal equipment, high in the clouds signal processing unit, result is counter send unit.Wherein, wearable terminal equipment is worn on tester's health, parks data for catching and transmitting tested people's sight line; High in the clouds signal processing unit parks data for calculating tested people's sight line; The anti-abnormal sight line sending unit to be responsible for high in the clouds signal processing unit to assign the prompting of instruction needs of result is parked result and is sent it back wearable terminal equipment by wireless network.
As shown in Figure 1, wearable terminal equipment, is worn on tester's head, parks data for the sight line catching tested people.In a particular embodiment of the present invention, described wearable terminal equipment can comprise glasses, earphone, and described glasses are furnished with high-definition camera (1) and communication module (2).Further, described glasses are monolithic or biplate, and described glasses are furnished with signal transmission unit, and described signal transmission unit has screen, can carry out visual information prompting.Described wearable terminal equipment can also adopt but be not limited to mobile phone as shown in Figure 2.Mobile phone is furnished with high-definition camera (1), possesses automatic tracing and focus function, catches the eye motion of tested people all the time.Owing to being combined with the active movement of wearer, it is more accurate that its direction of following the trail of and scope park instrument (not movable) than conventional line-of-sight.
Video data capture is to afterwards, and communication module (2) is transferred to high in the clouds signal processing unit by wireless signal (Wi-Fi).Mobile phone receives the anti-alarm signal sending unit to send by wireless receiver, reminds tester to express one's feelings result screen (3) is upper in the form of images.Tester thus judge the true heart activity of tested personnel according to result, reaches the effect of detecting a lie.
High in the clouds signal processing unit, by reception of wireless signals, parks the sight line of tested people the process that data carry out three phases.
First stage, the sight line calculating tested people parks base-line data.
The acquisition of base-line data, needs the question and answer coordinating baseline exercise question.According to standard testing flow process, first tester can put question to tested people's basket, and in the question answering process of this group problem, the sight line of high in the clouds signal processing unit to tested people is parked index and calculated, and obtains sight line and parks base-line data.
Sight line parks index, is divided into two sub-indexs, respectively:
1) park focusing, refer to whether eyeball is anchored in focusing on a certain object.
2) park duration, refer to that eyeball parks time span on the object, time span index is got [the shortest, the longest] interval value.In baseline Questions process, calculate the vision signal of wearable terminal device back, the data statistics of above-mentioned two sub-indexs is gone out and stores, as the baseline value that the abnormal sight line of comparison is parked.
Subordinate phase, the sight line catching the test problem question and answer stage parks data.
Actual sight line parks the acquisition of data, needs to coordinate special test exercise question question and answer.According to standard testing flow process, tester after baseline test question completes, can put question to tested people one group of actual test problem, in the question answering process of this group problem, the sight line of high in the clouds signal processing unit to tested people is parked index and is calculated, and obtains actual sight line and parks data.
Sight line parks index, is divided into and parks focusing and park duration, refers to whether eyeball is anchored in focusing on a certain object, and parks time span on the object; Time span index is got [the shortest, the longest] interval value, in practical problems question answering process, in real time sight line in the vision signal of wearable terminal device back is parked data and compare with the base-line data to have stored, proceeding to the phase III carries out computation and analysis.
Phase III, comparison baseline also carries out relative computing, filters and show that abnormal sight line parks result.
As shown in Figure 4,5, if eyeball is parked duration and parked focusing exceed baseline value 2 times, form abnormal eyeball fixes result, processing unit will propose sound warning by the anti-unit that send to wearer.
After occurring that abnormal sight line parks result, high in the clouds signal processing unit assigns instruction, by the anti-processing unit that send, result speech form is sent it back wearable terminal equipment, prompting wearer.
If there is abnormal Rotation of eyeball hint instructions, processing unit will propose sound warning by the anti-unit that send to wearer, and caution sound is " buzzer; note that the property paid close attention to watches appearance attentively, direction is tested people n o'clock direction ", wherein, n value is imaginary vertical dial direction in test person visual field, tested this dial center of circle artificial, and top is 12 points, below is 6 points, left front is 9 points, and right front is 3 points, and the rest may be inferred.
As shown in Figure 3, described glasses are monolithic or biplate, and described glasses are furnished with earphone (3) and signal transmission unit, and described signal transmission unit has screen (4), can carry out visual information prompting.Glasses receive the anti-alarm signal sending unit to send by wireless receiver, remind tester to express one's feelings result with the form of sound or image.Tester thus judge the true heart activity of tested personnel according to result, reaches the effect of detecting a lie.
The foregoing is only embodiments of the invention, be not limited to the present invention.The present invention can have various suitable change and change.All any amendments done within the spirit and principles in the present invention, equivalent replacement, improvement etc., all should be included within protection scope of the present invention.

Claims (10)

1. the identification of parking of abnormal sight line and a based reminding method, is characterized in that:
The device that described method uses comprises: wearable terminal equipment, high in the clouds signal processing unit, result is counter send unit; Wherein, wearable terminal equipment is worn on tester's health, parks data for catching and transmitting tested people's sight line; High in the clouds signal processing unit parks data for calculating tested people's sight line; The anti-abnormal sight line sending unit to be responsible for high in the clouds signal processing unit to assign the prompting of instruction needs of result is parked result and is sent it back wearable terminal equipment by wireless network;
High in the clouds signal processing unit, by reception of wireless signals, the sight line of tested people is parked the process that data carry out three phases:
First stage, the sight line calculating tested people parks base-line data;
Subordinate phase, the sight line catching the test problem question and answer stage parks data;
Phase III, the sight line of the described sight line of subordinate phase being parked the comparing first stage is parked base-line data and carries out relative computing, filters and show that abnormal sight line parks result.
2. a kind of abnormal sight line as claimed in claim 1 identification of parking and based reminding method, is characterized in that:
In the described first stage, the acquisition of base-line data, needs the question and answer coordinating baseline exercise question; According to standard testing flow process, first tester puts question to tested people's basket, and in the question answering process of this group problem, the sight line of high in the clouds signal processing unit to tested people is parked index and calculated, and obtains sight line and parks base-line data;
Sight line parks index, is divided into two sub-indexs, respectively:
1) park focusing, refer to whether eyeball is anchored in focusing on a certain object;
2) park duration, refer to that eyeball parks time span on the object, time span index is got [the shortest, the longest] interval value; In baseline Questions process, calculate the vision signal of wearable terminal device back, the data statistics of above-mentioned two sub-indexs is gone out and stores, as the baseline value that the abnormal sight line of comparison is parked.
3. a kind of abnormal sight line as claimed in claim 1 or 2 identification of parking and based reminding method, is characterized in that:
In described subordinate phase, actual sight line parks the acquisition of data, needs to coordinate special test exercise question question and answer; According to standard testing flow process, tester after baseline test question completes, can put question to tested people one group of actual test problem, in the question answering process of this group problem, the sight line of high in the clouds signal processing unit to tested people is parked index and is calculated, and obtains actual sight line and parks data;
Sight line parks index, is divided into and parks focusing and park duration, refers to whether eyeball is anchored in focusing on a certain object, and parks time span on the object; Time span index is got [the shortest, the longest] interval value, in practical problems question answering process, in real time sight line in the vision signal of wearable terminal device back is parked data and compare with the base-line data to have stored, proceeding to the phase III carries out computation and analysis.
4. a kind of abnormal sight line as claimed in claim 3 identification of parking and based reminding method, is characterized in that:
The concrete grammar of described phase III is as follows:
If eyeball is parked duration and parked focusing exceed baseline value 2 times, form abnormal eyeball fixes result, high in the clouds signal processing unit assigns instruction, by the anti-processing unit that send, result speech form is sent it back wearable terminal equipment, prompting wearer;
If there is abnormal Rotation of eyeball hint instructions, processing unit will propose sound warning by the anti-unit that send to wearer, and caution sound is " buzzer; note that the property paid close attention to watches appearance attentively, direction is tested people n o'clock direction ", wherein, n value is imaginary vertical dial direction in test person visual field, tested this dial center of circle artificial, and top is 12 points, below is 6 points, left front is 9 points, and right front is 3 points, and the rest may be inferred.
5. a kind of abnormal sight line as claimed in claim 4 identification of parking and based reminding method, is characterized in that:
Described wearable terminal equipment comprises glasses and earphone, and described glasses are furnished with high-definition camera (1) and communication module (2).
6. the identification that a kind of abnormal sight line as described in claim 4 or 5 is parked and based reminding method, is characterized in that:
Described glasses are monolithic or biplate, and described glasses are furnished with signal transmission unit, and described signal transmission unit has screen, can carry out visual information prompting.
7. a device for the identification of parking of abnormal sight line and prompting, is characterized in that:
Described device comprises mutually independently following equipment: wearable terminal equipment, high in the clouds signal processing unit, result is counter send unit; Wherein, wearable terminal equipment is worn on tester's health, parks data for catching and transmitting tested people's sight line; High in the clouds signal processing unit parks data for calculating tested people's sight line; The anti-abnormal sight line sending unit to be responsible for high in the clouds signal processing unit to assign the prompting of instruction needs of result is parked result and is sent it back wearable terminal equipment by wireless network.
8. a kind of abnormal sight line as claimed in claim 7 identification of parking and alarm set, is characterized in that:
Described wearable terminal equipment comprises glasses and earphone, and described glasses are furnished with high-definition camera (1) and communication module (2).
9. a kind of abnormal sight line as claimed in claim 8 identification of parking and alarm set, is characterized in that:
Described glasses are monolithic or biplate, and described glasses are furnished with signal transmission unit, and described signal transmission unit has screen, can carry out visual information prompting.
10. a kind of abnormal sight line as claimed in claim 8 identification of parking and alarm set, is characterized in that:
Described wearable terminal equipment adopts mobile phone, and described mobile phone is furnished with high-definition camera (1), communication module (2) and screen (3); Video data capture is to afterwards, communication module (2) is transferred to high in the clouds signal processing unit by wireless signal (Wi-Fi), mobile phone receives the anti-alarm signal sending unit to send by wireless receiver, reminds tester to express one's feelings result screen (3) is upper in the form of images.
CN201510213890.9A 2015-04-29 2015-04-29 It is a kind of exception sight park identification and based reminding method and device Active CN104809440B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201510213890.9A CN104809440B (en) 2015-04-29 2015-04-29 It is a kind of exception sight park identification and based reminding method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510213890.9A CN104809440B (en) 2015-04-29 2015-04-29 It is a kind of exception sight park identification and based reminding method and device

Publications (2)

Publication Number Publication Date
CN104809440A true CN104809440A (en) 2015-07-29
CN104809440B CN104809440B (en) 2019-01-25

Family

ID=53694251

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510213890.9A Active CN104809440B (en) 2015-04-29 2015-04-29 It is a kind of exception sight park identification and based reminding method and device

Country Status (1)

Country Link
CN (1) CN104809440B (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105551206A (en) * 2015-09-30 2016-05-04 宇龙计算机通信科技(深圳)有限公司 Emotion-based prompting method and related device and prompting system
CN105654803A (en) * 2016-02-16 2016-06-08 北京励普教育科技有限公司 Head-mounted online examination machine
CN105913046A (en) * 2016-05-06 2016-08-31 姜振宇 Micro-expression identification device and method
CN114129165A (en) * 2021-12-10 2022-03-04 北京邮电大学 Psychological assessment method, system and storage medium based on credible assessment scale

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN202060785U (en) * 2011-03-31 2011-12-07 上海天岸电子科技有限公司 Human eye pupil lie detector
CN203379122U (en) * 2013-07-26 2014-01-08 蔺彬涛 Wireless electroencephalogram and eye movement polygraph
CN103985224A (en) * 2014-04-09 2014-08-13 惠州Tcl移动通信有限公司 Method and system for detecting user fatigue and carrying out reminding based on intelligent equipment
US20140341427A1 (en) * 2013-05-17 2014-11-20 Canon Kabushiki Kaisha Surveillance camera system and surveillance camera control apparatus
CN204028500U (en) * 2014-07-01 2014-12-17 马天驰 Fatigue driving alarm glasses with function
CN104375650A (en) * 2014-12-02 2015-02-25 上海恩凡物联网科技有限公司 Social contact identification method and system based on intelligent wearable device
CN204759444U (en) * 2015-04-29 2015-11-11 姜振宇 Discernment and reminding device that unusual sight is parked

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN202060785U (en) * 2011-03-31 2011-12-07 上海天岸电子科技有限公司 Human eye pupil lie detector
US20140341427A1 (en) * 2013-05-17 2014-11-20 Canon Kabushiki Kaisha Surveillance camera system and surveillance camera control apparatus
CN203379122U (en) * 2013-07-26 2014-01-08 蔺彬涛 Wireless electroencephalogram and eye movement polygraph
CN103985224A (en) * 2014-04-09 2014-08-13 惠州Tcl移动通信有限公司 Method and system for detecting user fatigue and carrying out reminding based on intelligent equipment
CN204028500U (en) * 2014-07-01 2014-12-17 马天驰 Fatigue driving alarm glasses with function
CN104375650A (en) * 2014-12-02 2015-02-25 上海恩凡物联网科技有限公司 Social contact identification method and system based on intelligent wearable device
CN204759444U (en) * 2015-04-29 2015-11-11 姜振宇 Discernment and reminding device that unusual sight is parked

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105551206A (en) * 2015-09-30 2016-05-04 宇龙计算机通信科技(深圳)有限公司 Emotion-based prompting method and related device and prompting system
CN105654803A (en) * 2016-02-16 2016-06-08 北京励普教育科技有限公司 Head-mounted online examination machine
CN105913046A (en) * 2016-05-06 2016-08-31 姜振宇 Micro-expression identification device and method
CN114129165A (en) * 2021-12-10 2022-03-04 北京邮电大学 Psychological assessment method, system and storage medium based on credible assessment scale

Also Published As

Publication number Publication date
CN104809440B (en) 2019-01-25

Similar Documents

Publication Publication Date Title
CN104820495B (en) A kind of micro- Expression Recognition of exception and based reminding method and device
WO2020034902A1 (en) Smart desk having status monitoring function, monitoring system server, and monitoring method
CN110001652B (en) Driver state monitoring method and device and terminal equipment
CN106454277B (en) A kind of image analysis method and device for video monitoring
CN109431452B (en) Unmanned eye health screening instrument
CN104008664B (en) Road condition information acquisition method and relevant apparatus
CN104809440A (en) Abnormal sight stop recognizing and reminding method and device
CN106214436A (en) A kind of intelligent blind guiding system based on mobile phone terminal and blind-guiding method thereof
CN107590953B (en) Alarm method and system of intelligent wearable device and terminal device
CN205121478U (en) Prevent near -sighted smart machine and system
CN105183170A (en) Head-wearing-type wearable equipment and information processing method and device thereof
CN108958482A (en) A kind of similitude action recognition device and method based on convolutional neural networks
CN114469024A (en) Construction worker safety early warning method and system based on smart band
CN109480816A (en) Rhythm of the heart monitoring method, device, electronic equipment and computer readable storage medium
CN106681509A (en) Interface operating method and system
Zhou et al. Applying deep learning and wearable devices for educational data analytics
CN204790850U (en) Unusual little expression discernment and reminding device
CN107480635A (en) Glance signal identification method and system based on bimodal classification model fusion
CN204759445U (en) Unusual eyeball pivoted discernment and reminding device
CN204759444U (en) Discernment and reminding device that unusual sight is parked
CN109547706A (en) Glasses device and system
CN104809439A (en) Abnormal nictation recognizing and reminding method and device
CN201114421Y (en) A digital TV receiver
CN109199397A (en) A kind of more people's motion monitoring methods
CN104834904A (en) Identification and prompting method and device for abnormal eyeball rotation

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
EXSB Decision made by sipo to initiate substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant