TWI777126B - Method of facial characteristic angle measurement and device thereof - Google Patents

Abstract

A method of facial characteristic angle measurement includes a facial image providing step, a position identifying step, and a characteristic angle calculating step. The facial image providing step is procuring a facial image of a subject. The position identifying step is identifying at least one predetermined position group. The position group includes a vertex, a first end point and a second end point. The characteristic angle calculating step is calculating to obtain a characteristic angle between a first line and a second line. The first line is connected between the vertex and the first end point, and the second line is connected between the vertex and the second end point. Accordingly, the desired facial characteristics can be effectively and quantitatively evaluated.

Description

Facial feature angle measurement method and device

The present invention relates to a facial feature measurement method and device, and more particularly, to a facial feature angle measurement method and device.

Under the trend of technological progress and media popularization, the medical aesthetics market is also booming. However, the current medical cosmetic effect evaluation is only performed by professional physicians and general photography, and it is difficult to effectively and accurately evaluate the improvement of each patient or the difference between before and after treatment.

Based on the above, there is an urgent need in the medical cosmetic market to develop methods and devices that can effectively and accurately evaluate improvement or treatment effects.

The present invention provides a facial feature angle measurement method and device. By identifying at least one preset position group in the facial image and calculating the corresponding feature angle, the facial features can be effectively and quantitatively evaluated, and further It can make facial improvement or efficacy assessment more credible and scientifically proven.

According to an embodiment of the present invention, a method for measuring a facial feature angle is provided, which includes a step of providing a face image, a step of identifying a position group, and a step of calculating a feature angle. The face image providing step is to provide the user's face image. The step of identifying the position group is to identify at least one preset position group in the face image, and the position group includes a vertex, a first end point and a second end point. The characteristic angle calculation step is to calculate the characteristic angle between the first connection line and the second connection line. The first connection line is formed by connecting the vertex and the first end point, and the second connection line is connected by the vertex and the second end point. made. Thereby, facial features can be effectively and quantitatively evaluated.

The facial feature angle measurement method according to the foregoing embodiment, wherein in the position group identification step, at least one position group can be at least one of the eyebrow peak position group and the eyebrow tail position group, the apex of the eyebrow peak position group is the brow, and the eyebrow peak position The first end point of the group is the horizontal reference position of the eyebrow head, the second end point of the eyebrow peak position group is the eyebrow peak, the vertex of the eyebrow tail position group is the eyebrow head, the first end point of the eyebrow tail position group is the eyebrow head horizontal reference position, and the eyebrow tail position The second endpoint of the group is the eyebrow tail. In the characteristic angle calculation step, the characteristic angle calculated through the eyebrow peak position group is the eyebrow peak characteristic angle, and the characteristic angle calculated through the eyebrow tail position group is the eyebrow tail characteristic angle.

The facial feature angle measurement method according to the foregoing embodiment, wherein in the position group identification step, at least one position group can be at least one of a relative nose alar position group and a relative mouth corner position group, and the vertex of the relative nose alar position group is the nose alar, The first endpoint of the relative nose wing position group is the position on the pupil, the second endpoint of the relative nose wing position group is between the eyebrow peak and the eyebrow tail, the vertex of the relative mouth corner position group is the corner of the mouth, and the first endpoint of the relative mouth corner position group is nose Wing, the second end point of the position group relative to the corners of the mouth is between the eye head and the lateral canthus. In the characteristic angle calculation step, the characteristic angle calculated through the relative nose alar position group is the relative nose alar characteristic angle, and the characteristic angle calculated through the relative mouth corner position group is the relative mouth corner characteristic angle.

The facial feature angle measurement method according to the foregoing embodiment, wherein the apex of the relative alar position group is the nose, the first end point of the relative nose alar position group is the outside of the pupil, the second end point of the relative nose alar position group is the eyebrow peak, and the relative mouth corner The vertex of the position group is the mouth corner, the first end point of the relative mouth corner position group is the nose wing, and the second end point of the relative mouth corner position group is the lateral canthus.

The facial feature angle measurement method according to the foregoing embodiment may further include a previous feature angle providing step of providing a previous feature angle, and the previous feature angle is calculated by the user using the facial feature angle measurement method before a time interval characteristic angle.

The facial feature angle measurement method according to the foregoing embodiment may further include a reference index generation step based on at least two of the feature angle, the previous feature angle, the age of the user, and the implementation parameters accepted by the user in the time interval Generate a reference index.

The facial feature angle measurement method of the foregoing embodiments facilitates the development and application flexibility of the facial feature angle measurement method.

According to another embodiment of the present invention, there is provided a facial feature angle measuring apparatus, which executes the aforementioned facial feature angle measuring method. The facial feature angle measuring apparatus includes a non-transitory computer-readable memory and a processor. The non-transitory computer-readable memory is used for providing the facial feature angle measurement module. The processor is in communication with the non-transitory computer-readable memory, and the processor depends on the The facial feature angle measurement method is executed according to the facial feature angle measurement module. In this way, the convenience of quantitative evaluation of facial features can be improved.

The facial feature angle measurement device according to the aforementioned embodiment, wherein in the position group identification step of the facial feature angle measurement method, at least one position group can be at least one of the eyebrow peak position group and the eyebrow tail position group, and the eyebrow peak position The apex of the group is the eyebrow, the first endpoint of the eyebrow peak position group is the horizontal reference position of the eyebrow, the second endpoint of the eyebrow peak position group is the eyebrow peak, the apex of the eyebrow tail position group is the eyebrow, and the first endpoint of the eyebrow tail position group is The horizontal reference position of the brow head, and the second endpoint of the brow tail position group is the brow tail. In the characteristic angle calculation step, the characteristic angle calculated through the eyebrow peak position group is the eyebrow peak characteristic angle, and the characteristic angle calculated through the eyebrow tail position group is the eyebrow tail characteristic angle.

According to the facial feature angle measurement device according to the aforementioned embodiment, in the position group identification step of the facial feature angle measurement method, at least one position group can be at least one of a relative nose alar position group and a relative mouth corner position group. The apex of the nose alar position group is the nose, the first end point of the relative nose alar position group is the outside of the pupil, the second end point of the relative nose alar position group is the eyebrow peak, the apex of the relative mouth corner position group is the mouth corner, and the first end of the relative mouth corner position group The point is the nose wing, and the second end point of the position group relative to the corner of the mouth is the lateral canthus. In the characteristic angle calculation step, the characteristic angle calculated through the relative nose alar position group is the relative nose alar characteristic angle, and the characteristic angle calculated through the relative mouth corner position group is the relative mouth corner characteristic angle.

According to the facial feature angle measuring apparatus according to the aforementioned embodiment, the facial feature angle measuring method may further include the step of providing the previous feature angle and the step of generating the reference index. The previous feature angle providing step is to provide the previous The feature angle, the previous feature angle is the feature angle calculated by the user using the facial feature angle measurement method before a time interval. The step of generating the reference index is to generate the reference index according to at least two of the characteristic angle, the previous characteristic angle, the age of the user, and the implementation parameters accepted by the user in the time interval.

The facial feature angle measurement device of the aforementioned embodiments is helpful to accurately evaluate the degree of aging of the patient's face and the effect of facial improvement or treatment.

100,300: Facial feature angle measurement method

101, 301: Steps for providing face images

102,302: Location group identification steps

103,303: Feature angle calculation steps

304: previous feature angle providing step

305: Reference index generation steps

600: Facial Image

621: brow

622: Meifeng

623: eyebrow tail

624: horizontal reference position of brow

645: Eyes

646: Outer canthus

657: Pupil

658: outside of pupil

679: Nose

681: corner of mouth

900: Facial feature angle measurement device

910: Processor

920: Non-transitory computer readable memory

921: Facial feature angle measurement module

930: Display unit

940: Camera Unit

d11, d21, d31, d41: the first connection

d12, d22, d32, d42: the second connection

a1: eyebrow peak characteristic angle

a2: Feature angle of eyebrow tail

a3: Relative nasal characteristic angle

a4: Characteristic angle relative to the corners of the mouth

FIG. 1A is a flowchart illustrating a method for measuring the angle of facial features according to the first embodiment of the present invention;

FIG. 1B is a schematic diagram of a characteristic angle in the first embodiment;

1C is a schematic diagram of another characteristic angle in the first embodiment;

2A is a block diagram of a facial feature angle measuring device according to a second embodiment of the present invention;

FIG. 2B is a schematic diagram of the facial feature angle measuring device according to the second embodiment; and

FIG. 3 is a flowchart illustrating a method for measuring a facial feature angle according to a third embodiment of the present invention.

Several embodiments of the present invention will be described below with reference to the drawings. For the sake of clarity, many practical details will be said together in the following narrative. Bright. It should be understood, however, that these practical details should not be used to limit the invention. That is, in some embodiments of the present invention, these practical details are unnecessary. In addition, for the purpose of simplifying the drawings, some well-known and conventional structures and elements will be shown in a simplified and schematic manner in the drawings; and repeated elements may be denoted by the same reference numerals.

FIG. 1A shows a flowchart of a method 100 for measuring the angle of facial features according to the first embodiment of the present invention. As can be seen from FIG. 1A , the facial feature angle measurement method 100 according to the first embodiment of the present invention includes a face image providing step 101 , a position group identification step 102 , and a feature angle calculation step 103 .

FIG. 1B is a schematic diagram of the characteristic angle a1 of the eyebrow peak and the characteristic angle a2 of the tail of the eyebrow in the first embodiment, and FIG. 1C is a schematic diagram of the characteristic angle a3 relative to the nose alar and the characteristic angle a4 relative to the corner of the mouth in the first embodiment. As can be seen from FIGS. 1A to 1C , the face image providing step 101 is to provide the user's face image 600 . The position group identification step 102 is to identify at least one preset position group in the face image (ie, the face image) 600 , and the position group includes a vertex, a first endpoint and a second endpoint. The characteristic angle calculation step 103 is to calculate the characteristic angle between the first connection line and the second connection line (specifically, in the first embodiment, the eyebrow peak characteristic angle a1, the eyebrow tail characteristic angle a2, the relative nose wing characteristic angle a3, the relative Mouth corner characteristic angle a4), the characteristic angle is less than or equal to 180 degrees, the first connection line is formed by connecting the vertex and the first end point, and the second connection line is formed by connecting the vertex and the second end point, that is, the first connection line passes through The vertex and the first end point, and the second connection line passes through the vertex and the second end point. Thereby, facial features can be effectively and quantitatively assessed, and can be based on facial improvement or treatment purposes or other purposes.

It can be seen from FIG. 1B and FIG. 1C that in the position group identification step 102 of the facial feature angle measurement method 100 of the first embodiment, at least one position group can specifically be the eyebrow peak position group, the eyebrow tail position group, and the relative position group. Nose alar position group and relative mouth corner position group.

As can be seen from FIG. 1B, in the position group identification step 102, a preset eyebrow peak position group in the face image 600 is identified, the vertex of the eyebrow peak position group is the eyebrow 621, and the first end point of the eyebrow peak position group is the eyebrow horizontal reference position 624. , the second end point of the eyebrow peak position group is the eyebrow peak 622 . In the feature angle calculation step 103, the first connecting line d11 of the eyebrow peak position group is formed by connecting the eyebrow head 621 and the eyebrow horizontal reference position 624, and the second connecting line d12 of the eyebrow peak position group is formed by connecting the eyebrow head 621 and the eyebrow peak 622. The characteristic angle between the first connection line d11 and the second connection line d12 of the position group is the eyebrow peak characteristic angle a1, that is, the characteristic angle calculated through the eyebrow peak position group is the eyebrow peak characteristic angle a1. Furthermore, the horizontal reference position 624 of the brow may be an unspecified position in the face image 600 , so that the first connecting line d11 is the horizontal extension line of the brow 621 . In addition, it should be understood that in the facial feature angle measurement method according to the present invention, the first end point and the second end point can be interchanged, the first connection line and the second end point can also be interchanged correspondingly, and can be as required At least one of the left position group and the right position group in the face image 600 is measured.

In the position group identification step 102, a preset brow tail position group in the face image 600 is identified, the vertex of the brow tail position group is the brow head 621, the first endpoint of the brow tail position group is the brow head horizontal reference position 624, the brow tail The second endpoint of the position group is the end of the eyebrow 623 . In the feature angle calculation step 103, the first connecting line d21 of the eyebrow tail position group is determined by the eyebrow 621 and the horizontal reference position of the eyebrow 624 is connected, the second connecting line d22 of the eyebrow tail position group is formed by connecting the eyebrow head 621 and the eyebrow tail 623, and the characteristic angle between the first connecting line d21 and the second connecting line d22 of the eyebrow tail position group is the eyebrow tail. The characteristic angle a2, that is, the characteristic angle calculated through the eyebrow tail position group is the eyebrow tail characteristic angle a2. In this way, using the simple point of view analysis principle, the effect of precise facial improvement implementation methods (such as face lift), and through digital quantitative evaluation, can make the improvement or efficacy evaluation more credible and scientifically proven.

As can be seen from FIG. 1C, in the position group identification step 102, a preset relative nose alar position group in the face image 600 is identified, the vertex of the relative nose alar position group is the nose alar 679, and the first endpoint of the relative nose alar position group is the pupil 657. In the previous position, the second end point of the relative nose alar position group is between the eyebrow peak 622 and the eyebrow tail 623 (including the eyebrow peak 622 and the eyebrow tail 623 ). In the position group identification step 102, a preset relative mouth corner position group in the face image 600 is identified, the vertex of the relative mouth corner position group is the mouth corner 681, the first endpoint of the relative mouth corner position group is the nose wing 679, and the relative mouth corner position group The second end point is between the eye head 645 and the lateral canthus (the junction of the upper eyelid and the lower eyelid) 646 (including the eye head 645 and the lateral canthus 646 ). Thereby, the development and application flexibility of the facial feature angle measurement method 100 is facilitated.

More specifically, in the position group identification step 102, a preset relative nasal alar position group in the face image 600 is identified, the vertex of the relative nasal alar position group is the nasal alar 679, and the first endpoint of the relative nasal alar position group is the outside of the pupil 658. , the second end point of the relative nasal alar position group is the eyebrow peak 622 . In the feature angle calculation step 103, the first connection line d31 relative to the alar position group is formed by connecting the nose alar 679 and the outer side of the pupil 658, and the second connection line relative to the alar position group d32 is formed by connecting the nose alar 679 and the eyebrow peak 622, and the characteristic angle between the first connecting line d31 and the second connecting line d32 of the relative nose alar position group is the relative nose alar characteristic angle a3, that is, the feature calculated through the relative nose alar position group The angle is a3 relative to the alar characteristic angle.

In the position group identification step 102, a preset relative mouth corner position group in the face image 600 is identified, the vertex of the relative mouth corner position group is the mouth corner 681, the first endpoint of the relative mouth corner position group is the nose wing 679, and the relative mouth corner position group The second endpoint is the lateral canthus 646 . In the feature angle calculation step 103, the first connecting line d41 of the relative mouth corner position group is formed by connecting the mouth corner 681 and the nose wing 679, and the second connecting line d42 of the relative mouth corner position group is connecting the mouth corner 681 and the lateral canthus 646. The characteristic angle between the first connection line d41 and the second connection line d42 of the mouth corner position group is the relative mouth corner characteristic angle a4, that is, the characteristic angle calculated through the relative mouth corner position group is the relative mouth corner characteristic angle a4. Thereby, the facial feature angle measurement method 100 uses the points (eg, eyebrow peak 622 , eyebrow tail 623 , lateral canthus 646 , mouth corner 681 ) and fixed points (eg, brow head) that will move with aging in the upper face, middle face, and lower face. 621 and alar 679), so that the characteristic angle can accurately quantify the improvement or treatment effect. Through the measurement of four characteristic angles, it can accurately evaluate the aging degree of the patient (ie the user) and the effect of facial improvement or treatment (such as face lift), which can further be used to accurately calculate the demand measurement and simulate the improvement or treatment. Effect.

Furthermore, according to other embodiments of the present invention (not shown in the figure), the position group may be at least one position group or other position groups described in the facial feature angle measurement method 100 of the first embodiment, for example, the vertex is Eye For the head 645 , the first end point is the horizontal reference position of the eye head, and the second end point is the lateral canthus 646 .

FIG. 2A is a block diagram of the facial feature angle measuring apparatus 900 according to the second embodiment of the present invention, and FIG. 2B is a schematic diagram of the facial feature angle measuring apparatus 900 according to the second embodiment. It can be seen from FIGS. 2A and 2B that the facial feature angle measuring apparatus 900 according to the second embodiment of the present invention executes the facial feature angle measuring method 100 of the first embodiment. The angle measurement device 900 includes a non-transitory computer-readable memory 920 and a processor 910 . The non-transitory computer-readable memory 920 is used for providing the facial feature angle measurement module 921 , the processor 910 is communicatively connected to the non-transitory computer-readable memory 920 , and the processor 910 measures the module 921 according to the facial feature angle. The method 100 for measuring the angle of the facial feature is executed. In this way, the convenience of quantitative evaluation of facial features can be improved. Furthermore, the facial feature angle measurement device according to the present invention may specifically be a special instrument for facial feature angle measurement, a medical beauty instrument, a notebook computer, a smart phone, etc., and is not limited thereto.

In addition, the facial feature angle measurement device 900 may further include a camera unit 940 and a display unit 930 . In the face image providing step 101 of the facial feature angle measurement method 100 , the camera unit 940 can be used to photograph the user to provide the face image 600 , or the face image 600 can be read and stored in the non-transitory computer-readable memory 920 or the face The data of other storage elements in the facial feature angle measuring device 900 are used to provide the user's face image 600 . After the feature angle calculation step 103, the facial image 600 and the eyebrow peak feature angle a1, the eyebrow tail The characteristic angle a2 , the characteristic angle a3 relative to the nose wing, and the characteristic angle a4 relative to the corner of the mouth can be displayed on the display unit 930 .

FIG. 3 is a flowchart of a method 300 for measuring a facial feature angle according to a third embodiment of the present invention. As can be seen from FIG. 3, the facial feature angle measurement method 300 includes a face image providing step 301, a position group identification step 302, a feature angle calculation step 303, a previous feature angle providing step 304, and a reference index generation step 305. The image providing step 301 , the position group identification step 302 , and the feature angle calculation step 303 may be respectively the same as the face image providing step 101 , the position group identification step 102 , and the feature angle calculation in the facial feature angle measurement method 100 of the first embodiment. Step 103 is the same and will not be described in detail here.

The previous feature angle providing step 304 is to provide the previous feature angle. The previous feature angle is the feature angle calculated by the user using the facial feature angle measurement method 300 before a time interval. In this way, through digital quantitative evaluation, the improvement or efficacy evaluation can be more credible and scientifically proven.

Specifically, the user may receive an amelioration or treatment delivery at the time interval, which has a delivery parameter, which may be oral or injectable dose, filler dose, intensity of physical therapy (eg, ultrasound) and time, without limitation. When the implementation parameters have the effect of making the user's face look younger than before accepting the implementation parameters, the eyebrow peak characteristic angle a1 will be larger than the previous eyebrow peak characteristic angle, and the eyebrow tail characteristic angle a2 will be Compared with the previous characteristic angle of the tail of the brow being large, the relative characteristic angle a4 of the corner of the mouth will be large compared to the previous characteristic angle relative to the corner of the mouth. Nose The characteristic angle a3 is based on the first connecting line d31 connecting the outer side of the pupil 658. The angle of the alar characteristic angle a3 to the inside is a negative value, and the angle to the outside is a positive value, wherein the alar characteristic angle a3 is 0 degree is the best.

The reference index generation step 305 is to generate a reference index according to at least two of the characteristic angle, the previous characteristic angle, the age of the user, and the implementation parameters accepted by the user in the time interval. In this way, the aging degree of the patient's face and the effect of face improvement or treatment (such as face lift) can be accurately evaluated, which can further be used to accurately calculate the demand measurement and simulate the improvement or treatment effect. Specifically, the reference index can be converted and displayed on the display unit 930 in the form of numerical value, color, pattern (eg, smile, thumb), etc., but not limited thereto.

Furthermore, the facial feature angle measuring apparatus (eg, the facial feature angle measuring apparatus 900 of the second embodiment) according to the present invention can perform the facial feature angle measuring method 300 of the third embodiment.

Although the present invention has been disclosed in the above embodiments, it is not intended to limit the present invention. Anyone skilled in the art can make various changes and modifications without departing from the spirit and scope of the present invention. Therefore, the protection of the present invention The scope shall be determined by the scope of the appended patent application.

100: Facial feature angle measurement method

101: Steps for providing face images

102: Location group identification steps

103: Feature angle calculation steps

Claims (5)

A face feature angle measurement method, comprising: a face image providing step, providing a face image of a user; a position group identifying step, identifying at least one preset position group in the face image, the position The group comprises a vertex, a first end point and a second end point, and the at least one position group is at least one of a brow peak position group, an eyebrow tail position group, a relative nose wing position group and a relative mouth corner position group, The vertex of the eyebrow peak position group is an eyebrow, the first end point of the eyebrow peak position group is a brow horizontal reference position, the second end point of the eyebrow peak position group is an eyebrow peak, and the vertex of the eyebrow tail position group For this eyebrow, this first end point of this eyebrow tail position group is this eyebrow head horizontal reference position, this second end point of this eyebrow tail position group is an eyebrow tail, this vertex of this relative nose wing position group is a nose wing, The first end point of the relative nasal alar position group is the outside of a pupil, the second end point of the relative nasal alar position group is the eyebrow peak, the vertex of the relative mouth corner position group is a mouth corner, the relative mouth corner position group The The first end point is the nose wing, the second end point of the relative mouth corner position group is a lateral canthus; and a feature angle calculation step, calculating a feature between a first connection line and a second connection line Angle, the first connecting line is formed by connecting the vertex and the first end point, the second connecting line is formed by connecting the vertex and the second end point, the characteristic angle calculated through the eyebrow peak position group is a brow peak characteristic angle, the characteristic angle calculated through the brow tail position group is a brow tail characteristic angle, and the characteristic angle calculated through the relative nose alar position group is a relative nose alar characteristic angle, through the relative mouth corner bit The characteristic angle calculated by the setting group is a relative mouth corner characteristic angle. The facial feature angle measurement method as claimed in claim 1, further comprising: a step of providing a previous feature angle, providing a previous feature angle, the previous feature angle being the user using the facial feature angle before a time interval The characteristic angle calculated by the measurement method. The facial feature angle measurement method as claimed in claim 2, further comprising: a reference index generating step based on the feature angle, the previous feature angle, the age of the user and the acceptance of the user in the time interval At least two of an implementation parameter of , yield a reference index. A facial feature angle measurement device, performing the facial feature angle measurement method as described in claim 1, the facial feature angle measurement device comprising: a non-transitory computer-readable memory for providing a face a feature angle measurement module; and a processor in communication with the non-transitory computer-readable memory, the processor executes the facial feature angle measurement method according to the facial feature angle measurement module. The facial feature angle measuring device according to claim 4, wherein the facial feature angle measuring method further comprises: a previous feature angle providing step of providing a previous feature angle, the previous feature angle is the user the feature angle calculated using the facial feature angle measurement method before the time interval; and A reference index generating step generates a reference index according to at least two of the characteristic angle, the previous characteristic angle, the age of the user and an implementation parameter accepted by the user in the time interval.

Images