TWI736116B - Method of facial characteristic length measurement and device thereof - Google Patents

Abstract

A method of facial characteristic length measurement includes a facial image providing step, a position identifying step, and a characteristic length calculating step. The facial image providing step is procuring a facial image of a subject. The position identifying step is identifying at least one predetermined position group. The position group includes a first end point and a second end point. The characteristic length calculating step is calculating to obtain a characteristic length between the first end point and the second end point. Accordingly, the desired facial characteristics can be effectively and quantitatively evaluated.

Description

Method and device for measuring facial feature length

The present invention relates to a method and device for measuring facial features, and more particularly to a method and device for measuring facial feature length.

With the advancement of science and technology and the popularization of media, the medical cosmetology market is also booming. However, the current medical cosmetology evaluation is only performed by professional physicians and general photography, and it is difficult to effectively and accurately evaluate the improvement of each patient or the difference before and after treatment.

Based on the above, there is an urgent need in the medical cosmetology market to develop methods and devices that can effectively and accurately evaluate improvement or treatment effects.

The present invention provides a facial feature length measurement method and device. By recognizing at least one preset position group in a facial image and calculating the corresponding feature length, facial features can be evaluated effectively and quantitatively, and further It can make facial improvement or curative effect evaluation more credible and scientifically empirical.

According to an embodiment of the present invention, a method for measuring facial feature length is provided, which includes a facial image providing step, a position group identification step, and a feature length calculation step. The facial image providing step is to provide the user's facial image. The position group recognition step is to recognize at least one preset position group in the face image, and the position group includes a first end point and a second end point. The characteristic length calculation step is to calculate the characteristic length between the first end point and the second end point. In this way, facial features can be evaluated effectively and quantitatively.

According to the facial feature length measurement method of the foregoing embodiment, in the position group identification step, at least one position group may be a position group from the lower edge of the eyebrow to the upper frame edge, the group from the upper frame edge to the upper eyelid position, and the upper eyelid to the lower eyelid position At least one group in the group, the first end of the lower edge of the eyebrow to the upper frame position group is the lower edge of the eyebrow, the second end of the eyebrow lower edge to the upper frame position group is the upper frame edge, and the upper frame edge to the upper eyelid position group The first end point is the upper frame edge, the second end point of the upper frame edge to upper eyelid position group is the upper eyelid, the first end point of the upper eyelid to lower eyelid position group is the upper eyelid, and the second end point of the upper eyelid to lower eyelid position group is the upper eyelid. The two end points are the lower eyelids. In the characteristic length calculation step, the characteristic length calculated from the lower edge of the eyebrow to the upper frame position group is the characteristic length from the lower edge of the eyebrow to the upper frame edge, and the characteristic length calculated from the upper frame edge to the upper eyelid position group is the upper frame edge. To the characteristic length of the upper eyelid, the characteristic length calculated through the upper eyelid to lower eyelid position group is the characteristic length of the upper eyelid to the lower eyelid.

According to the facial feature length measurement method of the foregoing embodiment, in the position group identification step, the position group may further include at least one halfway point. In the characteristic length calculation step, the characteristic length between the first end point and the second end point and passing through the midway point is calculated.

According to the facial feature length measurement method of the foregoing embodiment, in the position group identification step, at least one position group may be at least one of a mouth corner position group and a chin position group, and the first end point and the first end of the mouth corner position group The two end points are the left tragus and the right tragus. The number of at least one halfway point of the mouth corner position group is two. The two halfway points of the mouth corner position group are the left mouth corner and the right corner of the mouth respectively. The first end of the lower jaw position group The point and the second end point are the left tragus and the right tragus, respectively, and the halfway point of the jaw position group is the jaw. In the characteristic length calculation step, the characteristic length calculated through the mouth corner position group is the characteristic length of the mouth corner, and the characteristic length calculated through the jaw position group is the chin characteristic length.

The facial feature length measurement method according to the foregoing embodiment may further include a previous feature length providing step, which provides the previous feature length. The previous feature length is calculated by the user using the facial feature length measurement method before a time interval The characteristic length.

The facial feature length measurement method according to the foregoing embodiment may further include a reference index generation step based on at least two of the feature length, the previous feature length, the age of the user, and the implementation parameters accepted by the user in the time interval Generate a reference index.

The facial feature length measurement method of the foregoing embodiment facilitates the development and application flexibility of the facial feature length measurement method.

According to another embodiment of the present invention, a facial feature length measurement device is provided, which executes the aforementioned facial feature length measurement method. The facial feature length measurement device includes a non-transitory computer-readable memory and a processor. The non-transitory computer readable memory is used to provide a facial feature length measurement module. The processor communicates with non-transitory computer readable memory, and the processor depends on The facial feature length measurement module executes the facial feature length measurement method. This helps to improve the convenience of quantitatively evaluating facial features.

According to the facial feature length measurement device of the foregoing embodiment, in the position group identification step of the facial feature length measurement method, at least one position group may be a position group from the lower edge of the eyebrow to the upper frame edge, and the upper frame edge to the upper eyelid position At least one of the upper eyelid to lower eyelid position group, the first end of the lower eyebrow to upper frame position group is the lower edge of the eyebrow, and the second end of the eyebrow lower edge to the upper frame position group is the upper frame edge, The first end of the upper frame to upper eyelid position group is the upper frame, the second end of the upper frame to upper eyelid position group is the upper eyelid, and the first end of the upper eyelid to lower eyelid position group is the upper eyelid. The second end point of the eyelid to lower eyelid position group is the lower eyelid. In the characteristic length calculation step, the characteristic length calculated from the lower edge of the eyebrow to the upper frame position group is the characteristic length from the lower edge of the eyebrow to the upper frame edge, and the characteristic length calculated from the upper frame edge to the upper eyelid position group is the upper frame edge. To the characteristic length of the upper eyelid, the characteristic length calculated through the upper eyelid to lower eyelid position group is the characteristic length of the upper eyelid to the lower eyelid.

According to the facial feature length measurement device of the foregoing embodiment, in the position group identification step of the facial feature length measurement method, the position group may further include at least one halfway point, and the at least one position group is the mouth corner position group and the jaw At least one group in the position group, the first end point and the second end point of the mouth corner position group are the left tragus and the right tragus respectively, the number of at least one halfway point of the mouth corner position group is two, and the second halfway point of the mouth corner position group The points are the left and right corners of the mouth, the first and second endpoints of the jaw position group are the left tragus and the right tragus, respectively, and the halfway point of the jaw position group is the jaw. Steps in the feature length calculation In the calculation, the characteristic length between the first end point and the second end point and passing through the midway point is calculated, the characteristic length calculated through the mouth corner position group is the characteristic length of the mouth corner, and the characteristic length calculated through the jaw position group Is the characteristic length of the jaw.

According to the facial feature length measurement device of the foregoing embodiment, the facial feature length measurement method may further include the previous feature length providing step and the reference index generating step. The previous feature length providing step is to provide the previous feature length, and the previous feature length is the feature length calculated by the user using the facial feature length measurement method before a time interval. The reference index generation step is to generate the reference index according to at least two of the feature length, the previous feature length, the age of the user, and the implementation parameters accepted by the user in the time interval.

With the facial feature length measuring device of the aforementioned embodiment, it is helpful to accurately assess the patient's facial aging degree and facial improvement or treatment effectiveness.

100,300: Measuring method of facial feature length

101, 301: Steps to provide facial images

102,302: Position group identification steps

103,303: Feature length calculation steps

304: Steps to provide previous feature length

305: Reference index generation step

600: Face image

603: chin

625: The lower edge of the eyebrows

647: upper frame edge

648: upper eyelid

649: lower eyelid

681: Left mouth corner

682: right corner of mouth

691: left ear

692: right ear

693: Left Tragus

694: right tragus

900: facial feature length measurement device

910: processor

920: Non-transitory computer readable memory

921: facial feature length measurement module

930: display unit

940: camera unit

d1: Characteristic length from the lower edge of the eyebrow to the upper frame edge

d2: The characteristic length of the upper frame edge to the upper eyelid

d3: characteristic length from upper eyelid to lower eyelid

d4: characteristic length of the corner of the mouth

d5: Characteristic length of jaw

Figure 1A shows a flowchart of a method for measuring facial feature length according to a first embodiment of the present invention;

Figure 1B is a schematic diagram of the characteristic length in the first embodiment;

FIG. 1C is a schematic diagram of another characteristic length in the first embodiment;

Figure 1D is a schematic diagram of the left tragus in the first embodiment;

Figure 2A is a block diagram of a facial feature length measuring device according to a second embodiment of the present invention;

Figure 2B is a schematic diagram of the facial feature length measuring device of the second embodiment; and

FIG. 3 is a flowchart of a method for measuring facial feature length according to a third embodiment of the present invention.

Hereinafter, a plurality of embodiments of the present invention will be described with reference to the drawings. For the sake of clarity, many practical details will be explained in the following description. However, it should be understood that these practical details should not be used to limit the present invention. That is to say, in some embodiments of the present invention, these practical details are unnecessary. In addition, for the sake of simplifying the drawings, some conventionally used structures and elements will be drawn in a simple schematic manner in the drawings; and repeated elements may be represented by the same numbers.

FIG. 1A is a flowchart of a method 100 for measuring facial feature length according to a first embodiment of the present invention. It can be seen from FIG. 1A that the facial feature length measurement method 100 according to the first embodiment of an embodiment of the present invention includes a facial image providing step 101, a position group identification step 102, and a feature length calculation step 103.

Figure 1B shows a schematic diagram of the characteristic length d1 from the lower edge of the eyebrow to the upper frame edge, the characteristic length d2 from the upper frame edge to the upper eyelid, and the characteristic length d3 from the upper eyelid to the lower eyelid in the first embodiment. The characteristic length d4 of the corner of the mouth and the characteristic length d5 of the chin, FIG. 1D is a schematic diagram of the left tragus 693 in the first embodiment. It can be seen from FIGS. 1A to 1D that the facial image providing step 101 is to provide the user's facial image 600. Location group The recognition step 102 is to recognize at least one preset position group in the facial image (ie, facial image) 600, and the position group includes a first end point and a second end point. The characteristic length calculation step 103 is to calculate the characteristic length between the first end point and the second end point (in the first embodiment, specifically, the characteristic length d1 from the lower edge of the eyebrow to the upper frame edge, and the characteristic length d2 from the upper frame edge to the upper eyelid). , Upper eyelid to lower eyelid characteristic length d3, mouth corner characteristic length d4, lower jaw characteristic length d5). In this way, facial features can be evaluated effectively and quantitatively, and can be based on facial improvement or treatment purposes or other purposes.

It can be seen from Fig. 1B to Fig. 1D that in the position group identification step 102 of the facial feature length measurement method 100 of the first embodiment, at least one position group can specifically be the position group from the lower edge of the eyebrow to the upper frame edge, and the upper Frame to upper eyelid position group, upper eyelid to lower eyelid position group, mouth corner position group and jaw position group.

It can be seen from Figure 1B that in the position group identification step 102, the preset eyebrow lower edge to upper frame edge position group in the facial image 600 is identified, and the first end point of the eyebrow lower edge to upper frame edge position group is the lower eyebrow edge 625 The second end point of the position group from the lower edge of the eyebrows to the upper frame edge is the upper frame edge 647, wherein the lower edge 625 of the eyebrows can be located at a position vertically extending above the upper frame edge 647. In the characteristic length calculation step 103, the characteristic length between the lower edge of the eyebrow 625 and the upper frame edge 647 is the characteristic length d1 from the lower edge of the eyebrow to the upper frame edge, that is, the characteristic length calculated through the position group of the lower edge of the eyebrow to the upper frame edge is The characteristic length d1 from the lower edge of the eyebrow to the upper frame edge. In addition, it should be understood that in the facial feature length measurement method according to the present invention, the first end point and the second end point are interchangeable, and the left position group and the right position group in the facial image 600 can be measured as required. At least one group.

In the position group recognition step 102, recognize the preset upper frame edge to upper eyelid position group in the facial image 600, the first end point of the upper frame edge to upper eyelid position group is the upper frame edge 647, and the upper frame edge to the upper eyelid position group The second end point of is the upper eyelid 648, where the upper eyelid 648 can be located at a position extending vertically below the upper frame edge 647. In the characteristic length calculation step 103, the characteristic length between the upper frame edge 647 and the upper eyelid 648 is the upper frame edge to the upper eyelid characteristic length d2, that is, the characteristic length calculated through the upper frame edge to the upper eyelid position group is the upper frame edge To the characteristic length of the upper eyelid d2.

In the position group identification step 102, the first end point of the preset upper eyelid to lower eyelid position group in the facial image 600, the upper eyelid to lower eyelid position group is the upper eyelid 648, and the upper eyelid to lower eyelid position group The second end point is the lower eyelid 649, where the upper eyelid 648 and the lower eyelid 649 can be located at a position extending vertically below the upper frame edge 647. In the characteristic length calculation step 103, the characteristic length between the upper eyelid 648 and the lower eyelid 649 is the upper eyelid to lower eyelid characteristic length d3, that is, the characteristic length calculated through the upper eyelid to lower eyelid position group is upper eyelid to lower eyelid The characteristic eyelid length d3. In this way, using the principle of simple length analysis, the effect of precise facial improvement implementation methods (such as facial lift), through digital quantitative evaluation, can make the improvement or curative effect evaluation more credible and scientifically empirical.

It can be seen from Fig. 1C and Fig. 1D that in the position group identification step 102, the position group may further include at least one halfway point. In the characteristic length calculation step 103, the characteristic length (that is, the path length) between the first end point and the second end point and passing through the midway point is calculated. In this way, the development and application flexibility of the facial feature length measurement method 100 is facilitated.

More specifically, in the position group recognition step 102, the preset mouth corner position group in the facial image 600 is recognized. The first end point and the second end point of the mouth corner position group are the left tragus of the left ear 691. , Namely Tg point) 693 and right tragus 694 of right ear 692, the number of at least one halfway point of the mouth corner position group is two, and the two halfway points of the mouth corner position group are the left mouth corner 681 and the right mouth corner 682, respectively. In the characteristic length calculation step 103, the characteristic length between the left tragus 693 and the right tragus 694 and passing through the left mouth corner 681 and the right mouth corner 682 in sequence is the mouth corner characteristic length d4, which is the characteristic length calculated through the mouth corner position group It is the characteristic length d4 of the corner of the mouth.

In the position group identification step 102, the preset jaw position group in the facial image 600 is identified. The first end point and the second end point of the jaw position group are the left tragus 693 and the right tragus 694, respectively. The halfway point of the position group is the lower jaw 603. In the characteristic length calculation step 103, the characteristic length between the left tragus 693 and the right tragus 694 and passing through the jaw 603 is the jaw characteristic length d5, that is, the characteristic length calculated through the jaw position group is the jaw characteristic Length d5. In this way, the facial feature length measurement method 100 uses the feature lengths in the upper face, middle face, and lower face, so that the feature length can accurately quantify the improvement or treatment effect. Through five characteristic length measurements, it can accurately assess the patient's (ie user) facial aging and the effectiveness of facial improvement or treatment (such as facial lift), which can be further used to accurately calculate demand measurement and simulate improvement or treatment Effect.

Furthermore, according to other embodiments of the present invention (not shown in the figure), the position group may be at least one position group or other position groups described in the facial feature length measurement method 100 of the first embodiment.

FIG. 2A is a block diagram of the facial feature length measuring device 900 according to the second embodiment of the present invention, and FIG. 2B is a schematic diagram of the facial feature length measuring device 900 according to the second embodiment. It can be seen from FIG. 2A and FIG. 2B that the facial feature length measurement apparatus 900 according to the second embodiment of another embodiment of the present invention executes the facial feature length measurement method 100 of the first embodiment, and the facial features The length measuring device 900 includes a non-transitory computer readable memory 920 and a processor 910. The non-transitory computer-readable memory 920 is used to provide a facial feature length measurement module 921, the processor 910 is communicatively connected to the non-transitory computer-readable memory 920, and the processor 910 is based on the facial feature length measurement module 921 To perform the facial feature length measurement method 100. This helps to improve the convenience of quantitatively evaluating facial features. Furthermore, the facial feature length measuring device according to the present invention can specifically be a special facial feature length measuring instrument, a medical beauty instrument, a notebook computer, a smart phone, etc., and is not limited thereto.

In addition, the facial feature length measuring device 900 may further include a camera unit 940 and a display unit 930. In the facial image providing step 101 of the facial feature length measurement method 100, the camera unit 940 can be used to photograph the user to provide the facial image 600, or read and store in the non-transitory computer-readable memory 920 or the face The data of other storage elements in the feature length measuring device 900 is used to provide the facial image 600 of the user. After the feature length calculation step 103, the facial image 600 and the feature length from the lower edge of the eyebrows to the upper frame edge d1, the upper frame edge to the upper eyelid feature length d2, the upper eyelid to the lower eyelid feature length d3, the mouth corner feature length d4, and the lower jaw feature The length d5 can be displayed on the display unit 930.

FIG. 3 is a flowchart of a method 300 for measuring facial feature length according to a third embodiment of the present invention. It can be seen from Figure 3 that the facial feature length measurement method 300 includes a facial image providing step 301, a position group identification step 302, a feature length calculation step 303, a previous feature length providing step 304, and a reference index generation step 305, where the face The image providing step 301, the position group identification step 302, and the feature length calculation step 303 can be respectively the same as the facial image providing step 101, the position group identification step 102, and the feature length calculation of the facial feature length measurement method 100 of the first embodiment. Step 103 is the same and will not be described in detail here.

The previous feature length providing step 304 is to provide the previous feature length, which is the feature length calculated by the user using the facial feature length measurement method 300 before a time interval. In this way, through digital quantitative evaluation, improvement or curative effect evaluation can be made more credible and scientifically empirical.

Specifically, the user can receive an improvement or treatment implementation method in the time interval, which has an implementation parameter, and the implementation parameter can be oral or injection dose, filler dose, physical therapy (such as ultrasound) intensity And time, and not limited by this. When the implementation parameters have the effect of making the user's face look younger than before receiving the implementation parameters, the feature length d1 from the lower edge of the eyebrows to the upper frame edge will be compared with the previous feature of the lower edge to the upper frame edge of the eyebrows The length is large, the characteristic length of the upper frame to the upper eyelid d2 will be smaller than the previous characteristic length of the upper frame to the upper eyelid, and the characteristic length of the upper eyelid to the lower eyelid d3 will be compared to the previous characteristic length of the upper eyelid to the lower eyelid by Large, the characteristic length of the mouth corner d4 will be smaller than the previous characteristic length of the mouth corner, and the characteristic length d5 of the jaw will be smaller than the characteristic length of the previous jaw.

The reference index generation step 305 generates a reference index according to at least two of the feature length, the previous feature length, the age of the user, and the implementation parameters accepted by the user in the time interval. In this way, it is possible to accurately assess the patient's facial aging degree and the effect of facial improvement or treatment (such as facial lift), and further can be used to accurately calculate the demand measurement and simulate the improvement or treatment effect. Specifically, the reference index can be converted and displayed on the display unit 930 in the form of a numerical value, a color, a pattern (for example, a smiling face, a thumb), etc., and is not limited thereto.

Furthermore, the facial feature length measurement device according to the present invention (for example, the facial feature length measurement device 900 of the second embodiment) can execute the facial feature length measurement method 300 of the third embodiment.

Although the present invention has been disclosed in the above embodiments, it is not intended to limit the present invention. Anyone familiar with the art can make various changes and modifications without departing from the spirit and scope of the present invention. Therefore, the protection of the present invention The scope shall be subject to the scope of the attached patent application.

100: Measuring method of facial feature length

101: Steps to provide facial images

102: Position group identification steps

103: Feature length calculation steps

Claims (5)

A method for measuring the length of facial features includes: a facial image providing step to provide a facial image of a user; a position group recognition step to recognize at least one preset position group in the facial image, the position The group includes a first end point and a second end point. The at least one position group is a position group from the lower edge of the eyebrow to the upper frame edge, an upper frame edge to the upper eyelid position group, an upper eyelid to the lower eyelid position group, and a mouth corner At least one of the position group and the lower jaw position group, the first end point and the second end point of the position group from the lower edge of the eyebrow to the upper frame edge are a lower edge of the eyebrow and an upper frame edge, and the upper frame edge to the upper frame edge The first end point and the second end point of the eyelid position group are the upper frame edge and an upper eyelid, respectively, and the first end point and the second end point of the upper eyelid to lower eyelid position group are the upper Eyelid and lower eyelid, the first end point, the second midway point and the second end point of the mouth corner position group are a left tragus, a left mouth corner, a right mouth corner, and a right tragus, respectively. The lower jaw position group The first end point, a halfway point and the second end point are the left tragus, the lower jaw, and the right tragus, respectively; and a feature length calculation step to calculate the first end point and the second end point A characteristic length between the end points, calculated from the lower edge of the eyebrow to the upper frame edge position group, the characteristic length is a characteristic length from the lower edge of the eyebrow to the upper frame edge, calculated through the upper frame edge to the upper eyelid position group The characteristic length is a characteristic length from the upper frame edge to the upper eyelid, and the characteristic length calculated through the upper eyelid to lower eyelid position group is a characteristic length from the upper eyelid to the lower eyelid, which is calculated through the mouth corner position group The length is the characteristic length of the corner of the mouth, which is calculated through the jaw position group The degree is the characteristic length of the lower jaw. The facial feature length measurement method according to claim 1, further comprising: a previous feature length providing step, providing a previous feature length, the previous feature length being that the user uses the facial feature length before a time interval The characteristic length calculated by the measurement method. The facial feature length measurement method according to claim 2, further comprising: a reference index generation step based on the feature length, the previous feature length, the age of the user, and the user’s acceptance in the time interval At least two of the implementation parameters produce a reference index. A facial feature length measurement device, which executes the facial feature length measurement method as described in claim 1. The facial feature length measurement device includes: a non-transitory computer-readable memory for providing a face A feature length measurement module; and a processor communicatively connected to the non-transitory computer readable memory, the processor executes the facial feature length measurement method according to the facial feature length measurement module. The facial feature length measuring device according to claim 4, wherein the facial feature length measuring method further comprises: a previous feature length providing step, providing a previous feature length, the previous feature length being the user’s The feature length calculated using the facial feature length measurement method before the time interval; and A reference index generating step generates a reference index according to at least two of the characteristic length, the previous characteristic length, the age of the user, and an implementation parameter accepted by the user in the time interval.

Images