CN112606022A - Use method of facial expression acquisition mask - Google Patents

Use method of facial expression acquisition mask Download PDF

Info

Publication number
CN112606022A
CN112606022A CN202011574198.6A CN202011574198A CN112606022A CN 112606022 A CN112606022 A CN 112606022A CN 202011574198 A CN202011574198 A CN 202011574198A CN 112606022 A CN112606022 A CN 112606022A
Authority
CN
China
Prior art keywords
tension
expression
mask
multidirectional
face
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202011574198.6A
Other languages
Chinese (zh)
Other versions
CN112606022B (en
Inventor
马丙全
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Yancheng Zenith Vision Technology Co ltd
Original Assignee
Suzhou Yuanruini Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Suzhou Yuanruini Technology Co ltd filed Critical Suzhou Yuanruini Technology Co ltd
Priority to CN202011574198.6A priority Critical patent/CN112606022B/en
Publication of CN112606022A publication Critical patent/CN112606022A/en
Application granted granted Critical
Publication of CN112606022B publication Critical patent/CN112606022B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B25HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25JMANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J11/00Manipulators not otherwise provided for
    • B25J11/0005Manipulators having means for high-level communication with users, e.g. speech generator, face recognition means
    • B25J11/0015Face robots, animated artificial faces for imitating human expressions
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B25HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25JMANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J13/00Controls for manipulators
    • B25J13/08Controls for manipulators by means of sensing devices, e.g. viewing or touching devices
    • B25J13/085Force or torque sensors

Abstract

The invention discloses a using method of an expression acquisition mask, which comprises the following steps: the use method comprises the following steps: a1, adhesion: the multidirectional tension sensors are symmetrically adhered to two sides of the face along the central axis, the adhered part is a muscle position with large expression and activity amplitude, and the mask is adhered to the face; a2, expression collection: when the expression is made, the movement of facial muscles applies different tension to the tension fibers in different directions of the multi-direction tension sensor, and the multi-direction tension sensor at each position senses a corresponding numerical value; a3, numerical analysis: and extracting the range of the induction value of each position and the whole multi-direction tension sensor. And constructing the range of the induction value of each position of the expression of each emotion, and providing convenience for the special effects of later movies and televisions.

Description

Use method of facial expression acquisition mask
Technical Field
The invention relates to the technical field of expression acquisition, in particular to a using method of an expression acquisition mask.
Background
Facial expression is a means to express human cognition, emotion and state, and contains a lot of personal behavior information. Therefore, by collecting and identifying the facial expressions, the cost of processing the special effect images in the later period can be reduced in the later period of movie and television special effects, character facial animation and the like, and the technological progress is promoted. Facial expressions typically include happiness, sadness, anger, fear, surprise, and disgust, and different facial expressions can be represented by the characteristics of facial muscle movements.
The traditional facial expression collection and recognition is mainly realized by extracting local features or overall features of a facial image, and the collection mode only considers the surface contour information of the face and cannot describe the tiny change of muscle movement of the face when the face makes an expression, so the accuracy of facial expression collection and recognition is not high.
Disclosure of Invention
The invention overcomes the defects of the prior art and provides a using method of the facial expression collecting mask.
In order to achieve the purpose, the first technical scheme adopted by the invention is as follows: a use method of a facial expression acquisition mask is characterized in that multidirectional tension sensors are symmetrically adhered to the inner surface of the mask along the central axis according to the outline, fixed fibers are arranged at the inner side of the mask in the circumferential direction and the central axis, and each multidirectional tension sensor is provided with at least three tension fibers which are connected with the fixed fibers and adjacent multidirectional tension sensors, and the use method comprises the following steps:
a1, adhesion: the multidirectional tension sensors are symmetrically adhered to two sides of the face along the central axis, the adhered part is a muscle position with large expression and activity amplitude, and the mask is adhered to the face;
a2, expression collection: when the face makes expression, the movement of facial muscles can apply different tension to the tension fibers in different directions connected with each multidirectional tension sensor, adjacent multidirectional tension sensors are connected through the tension fibers, the movement of muscles at one part can drive all the tension fibers to move, and the multidirectional tension sensors at each position sense corresponding numerical values;
a3, numerical analysis: and carrying out data analysis on the values sensed by the multidirectional tension sensors at each position of each expression, and extracting the range of the values sensed by the multidirectional tension sensors at each position of each emotion of each expression and the range of the values sensed by the whole multidirectional tension sensors.
The other technical scheme adopted by the invention is as follows: a use method of a facial expression acquisition mask is characterized in that multidirectional tension sensors are adhered to the inner surface of the mask along the central axis only on one side according to the outline, fixed fibers are arranged on the inner side of the mask in the circumferential direction and the central axis, and each multidirectional tension sensor is provided with at least three tension fibers which are connected with the fixed fibers and adjacent multidirectional tension sensors, and the use method comprises the following steps:
b1, adhesion: adhering a multidirectional tension sensor, namely a left face or a right face, to one side of the face, wherein the adhered part is a muscle position with large expression and activity amplitude, and adhering the mask to the face;
b2, expression collection: when the face makes expression, the movement of facial muscles can apply different tension to the tension fibers in different directions connected with each multidirectional tension sensor, adjacent multidirectional tension sensors are connected through the tension fibers, the movement of muscles at one part can drive all the tension fibers to move, and the multidirectional tension sensors at each position sense corresponding numerical values;
b3, numerical analysis: the induction values of two sides of the face are acquiescent to be consistent, the induction values obtained by the corresponding position of one side of the face are symmetrical to the other side of the face to form a muscle movement induction value of the whole face, data analysis is carried out on the induction value of the multi-direction tension sensor at each position of each expression, the range of the induction value of the multi-direction tension sensor at each position of each emotion is extracted, and the range of the induction value of the whole multi-direction tension sensor is extracted.
In a preferred embodiment of the present invention, the muscle positions with large facial expression activity amplitude comprise: at the auditorium, at the eyebrows, at the eye sockets, at the cheeks, at the corners of the mouth and at the chin.
In a preferred embodiment of the present invention, at least one of the brow head, the brow peak and the brow tail of the eyebrow is provided with one of the multi-directional tension sensors; at least four of the multi-directional tension sensors are each disposed at the cheek and at the orbit.
In a preferred embodiment of the present invention, the muscle activity of the same expression varies, and the value sensed by the multi-directional tension sensor corresponding to each position varies within a certain range.
In a preferred embodiment of the invention, expressions of different emotions are made and collected repeatedly, and the expression of each emotion is collected N times.
In a preferred embodiment of the present invention, N is an integer of at least 2000.
In a preferred embodiment of the invention, the expressions include at least joy, smile, sadness, anger, seriousness, depression, sales, disgust, urgency, frustration, embarrassment, surprise, fear, and blankness.
In a preferred embodiment of the present invention, the face is restored to a non-expressive state each time expression collection is completed.
In a preferred embodiment of the invention, the expression acquisition mask is modeled and manufactured according to the facial contour and muscles of a specific person, the expression acquisition mask is completely attached to the facial contour, and the expression acquisition mask can only be used by the specific person.
The invention solves the defects in the background technology, and has the following beneficial effects:
(1) the expression acquisition mask provided by the invention can capture expressions of various emotions, obtains the motion amplitude of specific facial muscle positions in different expressions through data statistics, and specifically expresses the motion amplitude through the multi-directional tension sensor induction value of each position, so that the range of the induction value of each position of each emotion expression is established, convenience is provided for later stage movie and television special effects and role facial animation, and the cost of later stage image processing is reduced.
(2) The invention provides an expression acquisition mask, wherein multidirectional tension sensors are symmetrically adhered to the inner surface of the mask along a central axis according to the contour or only adhered to one side of the mask along the central axis, the induction values of the multidirectional tension sensors are respectively the whole face muscle movement and the half face muscle movement, and the default values of the half face muscle movement are consistent on two sides when expression data are acquired.
(3) The expression acquisition mask provided by the invention is respectively provided with the multidirectional tension sensors at the position of an inkhole, the position of eyebrows, the position of eye sockets, cheeks, mouth corners and the position of a lower jaw, and is even provided with at least four multidirectional tension sensors at the muscle position with large expression activity amplitude so as to accurately sense the muscle motion change.
(4) The muscle activity degrees of the same expression are different, the induction value of the multi-direction tension sensor corresponding to each position changes within a certain range, and the range of the induction value of the multi-direction tension sensor of each position of the expression of each emotion is extracted through at least 2000 times of data acquisition of the same expression.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below, it is obvious that the drawings in the following description are only some embodiments described in the present invention, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts;
FIG. 1 is a schematic view of an expression collection mask and an adhesion part of a multi-directional tension sensor thereof according to the present invention;
FIG. 2 is a schematic view of an expression collection mask and an adhesion site of another multi-directional tension sensor thereof according to the present invention;
FIG. 3 is a schematic view of a securing fiber of a preferred embodiment of the present invention;
in the figure: 1. the facial expression acquisition mask; 11. a seal house; 12. at the eyebrow; 13. at the orbit; 14. cheek area; 15. a mouth corner; 16. at the lower jaw; 2. and (4) fixing the fibers.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present invention, but the present invention may be practiced in other ways than those specifically described herein, and therefore the scope of the present invention is not limited by the specific embodiments disclosed below.
In the description of the present application, it is to be understood that the terms "center," "longitudinal," "lateral," "upper," "lower," "front," "rear," "left," "right," "vertical," "horizontal," "top," "bottom," "inner," "outer," and the like are used in the orientation or positional relationship indicated in the drawings for convenience in describing the present application and for simplicity in description, and are not intended to indicate or imply that the referenced devices or elements must have a particular orientation, be constructed in a particular orientation, and be operated in a particular manner, and are not to be considered limiting of the scope of the present application. Furthermore, the terms "first," "second," and the like are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first," "second," etc. may explicitly or implicitly include one or more of that feature. In the description of the invention, the meaning of "a plurality" is two or more unless otherwise specified.
In the description of the present application, it is to be noted that, unless otherwise explicitly specified or limited, the terms "mounted," "connected," and "connected" are to be construed broadly, e.g., as meaning either a fixed connection, a removable connection, or an integral connection; can be mechanically or electrically connected; they may be connected directly or indirectly through intervening media, or they may be interconnected between two elements. The specific meaning of the above terms in the present application can be understood by those of ordinary skill in the art through specific situations.
As shown in fig. 1 and 3, the expression collecting mask 1 is shown, and the small sun in the dotted line frame and the dotted line frame in fig. 1 only indicates the adhesion part of the specific multidirectional tension sensor. The expression acquisition mask 1 is formed by constructing a model according to the facial contour and muscles of a specific person and manufacturing, the expression acquisition mask 1 is completely attached to the facial contour, and the expression acquisition mask 1 can only be used by the specific person. The inner surface of the mask is symmetrically adhered with multidirectional tension sensors along the central axis according to the contour, the fixing fibers 2 are arranged on the inner side of the mask in the circumferential direction and the central axis, and the fixing fibers 2 are adhered to the mask according to the contour shape of the face. At least three tension fibers of each multi-direction tension sensor are connected with the fixed fiber 2 and the adjacent multi-direction tension sensors.
The use method of the mask comprises the following steps:
a1, adhesion: the multidirectional tension sensors are symmetrically adhered to two sides of the face along the central axis, the adhered part is a muscle position with large expression and activity amplitude, and the mask is adhered to the face;
a2, expression collection: when the face makes expression, the movement of facial muscles can apply different tension to the tension fibers in different directions connected with each multidirectional tension sensor, adjacent multidirectional tension sensors are connected through the tension fibers, the movement of muscles at one part can drive all the tension fibers to move, and the multidirectional tension sensors at each position sense corresponding numerical values;
a3, numerical analysis: and carrying out data analysis on the values sensed by the multidirectional tension sensors at each position of each expression, and extracting the range of the values sensed by the multidirectional tension sensors at each position of each emotion of each expression and the range of the values sensed by the whole multidirectional tension sensors.
As shown in fig. 2 and 3, the expression collecting mask 1 is shown, and the small sun in the dotted line frame and the dotted line frame in fig. 2 indicates the adhesion portion of another multidirectional tension sensor. The mask is characterized in that the use method comprises the following steps:
b1, adhesion: adhering a multidirectional tension sensor, namely a left face or a right face, to one side of the face, wherein the adhered part is a muscle position with large expression and activity amplitude, and adhering the mask to the face;
b2, expression collection: when the face makes expression, the movement of facial muscles can apply different tension to the tension fibers in different directions connected with each multidirectional tension sensor, adjacent multidirectional tension sensors are connected through the tension fibers, the movement of muscles at one part can drive all the tension fibers to move, and the multidirectional tension sensors at each position sense corresponding numerical values;
b3, numerical analysis: the induction values of two sides of the face are acquiescent to be consistent, the induction values obtained by the corresponding position of one side of the face are symmetrical to the other side of the face to form a muscle movement induction value of the whole face, data analysis is carried out on the induction value of the multi-direction tension sensor at each position of each expression, the range of the induction value of the multi-direction tension sensor at each position of each emotion is extracted, and the range of the induction value of the whole multi-direction tension sensor is extracted.
According to the expression acquisition mask 1, the multidirectional tension sensors are symmetrically adhered to the inner surface of the mask along the central axis according to the contour or only adhered to one side of the mask along the central axis, the induction values of the multidirectional tension sensors are respectively the whole face muscle movement and the half face muscle movement, and the default values of the half face muscle movement are consistent on two sides when expression data are acquired.
The muscle position with large facial expression activity amplitude comprises the following components: the auditorium 11, the eyebrows 12, the eye sockets 13, the cheeks 14, the corners 15 and the chin 16. And at least the eyebrow, the eyebrow peak and the eyebrow tail of the eyebrow part 12 are respectively provided with a multi-directional tension sensor; at least four multi-directional tension sensors are provided at the cheek 14 and the orbit 13, respectively, to accurately sense the muscle movement changes.
The muscle activity degrees of the same expression are different, the induction value of the multi-direction tension sensor corresponding to each position changes within a certain range, and the range of the induction value of the multi-direction tension sensor of each position of the expression of each emotion is extracted through at least 2000 times of data acquisition of the same expression.
The expression collected by the invention at least comprises joy, smile, sadness, anger, seriousness, depression, selling, disgust, urgency, disappearing, embarrassment, surprise, fear and no expression, each expression is collected at least 2000 times, and the expression packet database of a specific person is perfected.
After the expression acquisition is completed each time, the face is restored to the non-expression state, so that the multi-directional sensor is restored to the reference state after the expression acquisition is completed once, and the expression acquisition at each time can be more accurate.
In summary, the expression collecting mask 1 provided by the invention can capture expressions of various emotions, obtains the movement amplitude of specific facial muscle positions in different expressions through data statistics, and particularly expresses the movement amplitude through the multi-directional tension sensor induction value of each position, so that the range of the induction value of each position of each emotion expression is established, convenience is provided for later stage movie and television special effects and character facial animation, and the cost of later stage image processing is reduced.
In light of the foregoing description of the preferred embodiment of the present invention, it is to be understood that various changes and modifications may be made by one skilled in the art without departing from the spirit and scope of the invention. The technical scope of the present invention is not limited to the content of the specification, and must be determined according to the scope of the claims.

Claims (10)

1. A use method of a facial expression acquisition mask is characterized in that multidirectional tension sensors are symmetrically adhered to the inner surface of the mask along the central axis according to the outline, fixed fibers are arranged at the inner side of the mask in the circumferential direction and the central axis, and each multidirectional tension sensor is provided with at least three tension fibers which are connected with the fixed fibers and adjacent multidirectional tension sensors, and the use method comprises the following steps:
a1, adhesion: the multidirectional tension sensors are symmetrically adhered to two sides of the face along the central axis, the adhered part is a muscle position with large expression and activity amplitude, and the mask is adhered to the face;
a2, expression collection: when the face makes expression, the movement of facial muscles can apply different tension to the tension fibers in different directions connected with each multidirectional tension sensor, adjacent multidirectional tension sensors are connected through the tension fibers, the movement of muscles at one part can drive all the tension fibers to move, and the multidirectional tension sensors at each position sense corresponding numerical values;
a3, numerical analysis: and carrying out data analysis on the values sensed by the multidirectional tension sensors at each position of each expression, and extracting the range of the values sensed by the multidirectional tension sensors at each position of each emotion of each expression and the range of the values sensed by the whole multidirectional tension sensors.
2. A use method of a facial expression acquisition mask is characterized in that multidirectional tension sensors are adhered to the inner surface of the mask along the central axis only on one side according to the outline, fixed fibers are arranged on the inner side of the mask in the circumferential direction and the central axis, and each multidirectional tension sensor is provided with at least three tension fibers which are connected with the fixed fibers and adjacent multidirectional tension sensors, and the use method comprises the following steps:
b1, adhesion: adhering a multidirectional tension sensor, namely a left face or a right face, to one side of the face, wherein the adhered part is a muscle position with large expression and activity amplitude, and adhering the mask to the face;
b2, expression collection: when the face makes expression, the movement of facial muscles can apply different tension to the tension fibers in different directions connected with each multidirectional tension sensor, adjacent multidirectional tension sensors are connected through the tension fibers, the movement of muscles at one part can drive all the tension fibers to move, and the multidirectional tension sensors at each position sense corresponding numerical values;
b3, numerical analysis: the induction values of two sides of the face are acquiescent to be consistent, the induction values obtained by the corresponding position of one side of the face are symmetrical to the other side of the face to form a muscle movement induction value of the whole face, data analysis is carried out on the induction value of the multi-direction tension sensor at each position of each expression, the range of the induction value of the multi-direction tension sensor at each position of each emotion is extracted, and the range of the induction value of the whole multi-direction tension sensor is extracted.
3. The use method of the facial expression collection mask according to claim 1 or 2, wherein the facial expression collection mask comprises: the muscle positions with large facial expression activity amplitude comprise: at the auditorium, at the eyebrows, at the eye sockets, at the cheeks, at the corners of the mouth and at the chin.
4. The use method of the facial expression collection mask according to claim 3, wherein the facial expression collection mask comprises: the multi-directional tension sensors are respectively arranged at the eyebrow, the eyebrow peak and the eyebrow tail at least at the eyebrow position; at least four of the multi-directional tension sensors are each disposed at the cheek and at the orbit.
5. The use method of the facial expression collection mask according to claim 1 or 2, wherein the facial expression collection mask comprises: the muscle activity degree of the same expression is different, and the value of the induction of the multi-direction tension sensor corresponding to each position can be changed within a certain range.
6. The use method of the facial expression collection mask according to claim 1 or 2, wherein the facial expression collection mask comprises: expressions of different emotions are made and collected repeatedly, and the expression of each emotion is collected N times.
7. The use method of the facial expression acquisition mask according to claim 6, wherein the facial expression acquisition mask comprises the following steps: said N is an integer of at least 2000.
8. The use method of the facial expression collection mask according to claim 1 or 2, wherein the facial expression collection mask comprises: expressions include at least joy, smile, sadness, anger, seriousness, depression, sell-on, disgust, urgency, disappointment, embarrassment, surprise, fear, and blankness.
9. The use method of the facial expression collection mask according to claim 1 or 2, wherein: after each expression collection is completed, the face returns to the non-expression state.
10. The facial expression collection mask according to claim 1 or 2, wherein: the facial expression acquisition mask is constructed and modeled according to the facial contour and muscles of specific personnel and is manufactured, the facial expression acquisition mask is completely attached to the facial contour, and the facial expression acquisition mask can only be used by the specific personnel.
CN202011574198.6A 2020-12-28 2020-12-28 Use method of facial expression acquisition mask Active CN112606022B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202011574198.6A CN112606022B (en) 2020-12-28 2020-12-28 Use method of facial expression acquisition mask

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202011574198.6A CN112606022B (en) 2020-12-28 2020-12-28 Use method of facial expression acquisition mask

Publications (2)

Publication Number Publication Date
CN112606022A true CN112606022A (en) 2021-04-06
CN112606022B CN112606022B (en) 2022-05-24

Family

ID=75249264

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011574198.6A Active CN112606022B (en) 2020-12-28 2020-12-28 Use method of facial expression acquisition mask

Country Status (1)

Country Link
CN (1) CN112606022B (en)

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8493286B1 (en) * 2009-04-21 2013-07-23 Mark T. Agrama Facial movement measurement and stimulation apparatus and method
CN108309692A (en) * 2018-02-28 2018-07-24 裴文平 A kind of hand finger injuries postoperative rehabilitation instrument
CN109389074A (en) * 2018-09-29 2019-02-26 东北大学 A kind of expression recognition method extracted based on human face characteristic point
CN110263671A (en) * 2019-05-30 2019-09-20 量子动力(深圳)计算机科技有限公司 It is a kind of can Fast Calibration muscular features mask and its processing method
US20190343457A1 (en) * 2018-05-08 2019-11-14 The Regents Of The University Of California Pain assessment method and apparatus for patients unable to self-report pain
CN110705656A (en) * 2019-11-11 2020-01-17 中国电子科技集团公司第十四研究所 Facial action recognition method based on EEG sensor
CN112183314A (en) * 2020-09-27 2021-01-05 哈尔滨工业大学(深圳) Expression information acquisition device and expression identification method and system

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8493286B1 (en) * 2009-04-21 2013-07-23 Mark T. Agrama Facial movement measurement and stimulation apparatus and method
CN108309692A (en) * 2018-02-28 2018-07-24 裴文平 A kind of hand finger injuries postoperative rehabilitation instrument
US20190343457A1 (en) * 2018-05-08 2019-11-14 The Regents Of The University Of California Pain assessment method and apparatus for patients unable to self-report pain
CN109389074A (en) * 2018-09-29 2019-02-26 东北大学 A kind of expression recognition method extracted based on human face characteristic point
CN110263671A (en) * 2019-05-30 2019-09-20 量子动力(深圳)计算机科技有限公司 It is a kind of can Fast Calibration muscular features mask and its processing method
CN110705656A (en) * 2019-11-11 2020-01-17 中国电子科技集团公司第十四研究所 Facial action recognition method based on EEG sensor
CN112183314A (en) * 2020-09-27 2021-01-05 哈尔滨工业大学(深圳) Expression information acquisition device and expression identification method and system

Also Published As

Publication number Publication date
CN112606022B (en) 2022-05-24

Similar Documents

Publication Publication Date Title
Yin et al. A 3D facial expression database for facial behavior research
CN110287790B (en) Learning state hybrid analysis method oriented to static multi-user scene
Terzopoulos et al. Analysis and synthesis of facial image sequences using physical and anatomical models
Gunes et al. A bimodal face and body gesture database for automatic analysis of human nonverbal affective behavior
Vinola et al. A survey on human emotion recognition approaches, databases and applications
CN107169455B (en) Face attribute recognition method based on depth local features
Aran et al. Signtutor: An interactive system for sign language tutoring
CN110929553A (en) Method and device for generating facial expressions through data fusion and head-mounted display
CN111292765B (en) Bimodal emotion recognition method integrating multiple deep learning models
WO2007043712A1 (en) Emotion evaluating method and emotion indicating method, and program, recording medium, and system for the methods
CN107767335A (en) A kind of image interfusion method and system based on face recognition features' point location
CN113837153B (en) Real-time emotion recognition method and system integrating pupil data and facial expressions
CN107025678A (en) A kind of driving method and device of 3D dummy models
WO2021004510A1 (en) Sensor-based separately deployed human body behavior recognition health management system
Huang et al. Robust symbolic dual-view facial expression recognition with skin wrinkles: local versus global approach
KR100988323B1 (en) Method and apparatus of recognizing detailed facial expression using facial expression information amplification
CN113920568A (en) Face and human body posture emotion recognition method based on video image
David et al. A comprehensive survey of emotion recognition system in facial expression
Chetty et al. A multilevel fusion approach for audiovisual emotion recognition
Zhou et al. Expressure: detect expressions related to emotional and cognitive activities using forehead textile pressure mechanomyography
Bianco et al. A smart mirror for emotion monitoring in home environments
CN112606022B (en) Use method of facial expression acquisition mask
CN114067185A (en) Film evaluation system based on facial expression recognition
TWI471807B (en) Face classification method, face classification device, classification chart, face classification program and recorded the program of the recording media
CN112579815A (en) Real-time training method for expression database and feedback mechanism for expression database

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
TA01 Transfer of patent application right
TA01 Transfer of patent application right

Effective date of registration: 20220507

Address after: 224000 floor 7, building 13, Xinlong Plaza, No. 38, Renmin South Road, Yannan high tech Zone, Yancheng City, Jiangsu Province (CNK)

Applicant after: Yancheng zenith Vision Technology Co.,Ltd.

Address before: 215000 room 2101, building 2, No.21, intercity Road, Hushuguan Town, Suzhou high tech Zone, Jiangsu Province

Applicant before: Suzhou yuanruini Technology Co.,Ltd.

GR01 Patent grant
GR01 Patent grant