WO2020115922A1 - Beauty promotion device, beauty promotion system, beauty promotion method, and beauty promotion program - Google Patents

Abstract

This beauty promotion device is provided with: a vertex recognition unit that recognizes, from imaging data in which the face of a user is captured, the respective positions of at least one fixed point which is identified depending on the facial skeletal structure and at least one movable point which is identified depending on the muscle and fat of the face; a geometric shape definition unit that defines a geometric shape having a periphery that includes the vertexes, the positions thereof having been recognized by the vertex recognition unit; a feature amount calculation unit that calculates a feature amount indicating the length or surface area of the geometric shape; and a feature amount comparison unit that compares the feature amount calculated by the feature amount calculation unit and an existing reference value serving as a value corresponding to the geometric shape.

Description

Beauty promotion device, beauty promotion system, beauty promotion method, and beauty promotion program

The present invention relates to a beauty promotion device, a beauty promotion system, a beauty promotion method, and a beauty promotion program.

2. Description of the Related Art Conventionally, a system that uses image processing technology to promote beauty to a user is known.
For example, Patent Document 1 discloses a beauty promotion system that evaluates the condition of the user's skin or scalp from the imaged data of the user.

Japanese Patent Laid-Open No. 2018-97899

However, the conventional beauty promotion system evaluates the local condition as the condition of the user's skin or scalp, and does not evaluate the change in the proportion of the face due to deterioration over time. Therefore, there is room for improvement in quantitatively evaluating the proportions of the face and contributing to promoting beauty.

Therefore, an object of the present invention is to provide a beauty promotion device that can quantitatively evaluate changes in facial proportions due to aging deterioration and improvement measures, and contribute to beauty promotion.

In order to solve the above problems, the beauty promotion device according to the present invention determines at least one fixed point, which is specified depending on the skeleton of the face, and facial muscles and fat from the imaged data of the face of the user. A vertex recognition unit that recognizes the position of each of the at least one movable point that is specified in a dependent manner; a geometric shape definition unit that defines a geometric shape that includes the vertices whose positions are recognized by the vertex recognition unit in the peripheral portion; A feature amount calculation unit that calculates a feature amount indicating the length or area of the shape, a feature amount calculated by the feature amount calculation unit, and a reference value known as a value corresponding to the geometric shape. And are equipped with.

In addition, the beauty promotion device according to the present invention specifies two fixed points that are specified depending on the skeleton of the face and the muscles and fat of the face, which are specified from the imaged data of the user's face. The apex recognition unit that recognizes the position of each of the two movable points, and the area demarcation unit that demarcates a demarcated area in a triangular shape by the line that connects the vertices whose positions are recognized by the apex recognition unit An area calculation unit that calculates the area, and an area comparison unit that compares the area of the demarcated region calculated by the area calculation unit with a reference area known as the area of the region corresponding to the demarcated region.

Further, the area comparison unit may include a display processing unit that outputs information indicating a comparison result obtained by comparing the area of the demarcated region and the reference area.

Also, the area demarcation unit may demarcate a pair of left and right demarcation areas based on the midline of the face.

Also, the vertex recognition unit may recognize each vertex specified by the deep nose point and the temple vertex as two fixed points, and may recognize the vertex on the cheek as one movable point.

Further, the vertex recognition unit evaluates the imaged data three-dimensionally, recognizes the most recessed part of the nose root of the face as a deep nose point, and the most recessed part of the temple part of the face. May be recognized as the top of the cheek of the face, and the highest part of the upper part of the cheek of the face near the vertical line outside the pupil may be recognized as the top of the cheek.

The area demarcation unit may demarcate two types of demarcated areas at intervals in the vertical direction of the face.

Further, the vertex recognition unit may recognize each vertex specified by the nose point and the ear point as two fixed points, and the cheek point as one movable point.

In addition, the vertex recognition unit three-dimensionally evaluates the imaged data, recognizes the most recessed part of the lower nose of the face as the subnasal point, and selects the part of the face located below the ear. , The most recessed part is recognized as the inferior ear point, and in the lower part of the cheek of the face, near the vertical line outside the pupil, in the lateral bulge of the corner of the mouth, the most raised part is recognized as the apex of the lower cheek. Good.

Also, the area comparison unit may use, as the reference area, the area of the demarcated region in the user at a time point before a certain period from the time when the imaging data was captured.

Also, the area comparison unit may use the area of the demarcated area in the ideal model as the face desired by the user as the reference area.

In order to solve the above-mentioned problem, a beauty promotion system according to the present invention provides a beauty promotion device according to any one of the above-described beauty promotion devices, an imaging unit that captures a user's face, and imaging data captured by the imaging unit. The imaging device further includes a transmitting unit that transmits the image capturing data, and the beauty promotion device further includes a receiving unit that receives the image capturing data.

In addition, the beauty promotion system includes the device-side display unit in which the image pickup unit is built-in and the display surface is mirror-finished, and the device-side display unit images the face of the user facing the display surface. It may be a smart mirror capable of displaying image pickup data on the display surface.

Further, in order to solve the above-mentioned problems, the beauty promotion method according to the present invention provides two fixed points, which are specified depending on the skeleton of the face, from the imaging data of the user's face, and muscles and fat of the face. Area defining a triangular demarcated area by a vertex recognition step for recognizing the position of each one of the movable points specified depending on the above, and a straight line connecting the vertices whose positions are recognized by the vertex recognition step. A demarcation step, an area calculation step of calculating the area of the demarcation area, an area comparison step of comparing the area of the demarcation area calculated by the area calculation step, and a reference area known as the area of the area corresponding to the demarcation area. , Are provided.

Further, in order to solve the above-mentioned problems, a beauty promotion program according to the present invention causes a computer to detect two fixed points, which are specified depending on the skeleton of the face, from the imaged data of the face of the user and the face. A triangular delimited area is defined by a vertex recognition function that recognizes the position of each movable point that is specified depending on muscle and fat, and a straight line that connects the vertices whose positions are recognized by the vertex recognition function. An area that compares the demarcating area demarcation function, the area calculating function that calculates the area of the demarcating area, the area of the demarcating area calculated by the area calculating function, and a reference area known as the area of the area corresponding to the demarcating area. And the comparison function.

In the beauty promotion device of the present invention, the apex recognition unit is specified from the image pickup data of the face of the user, two fixed points that are specified depending on the skeleton of the face, and the muscles and fat of the face. The position of each movable point is recognized.
Next, the area demarcation unit demarcates the demarcated area having a triangular shape by the straight line connecting the specified vertices, and the area calculation unit calculates the area of the demarcated area. Then, the area comparison unit compares the area of the demarcated region with the reference area. This makes it possible to quantitatively evaluate changes in the proportions of the face due to aging deterioration and improvement measures, and contribute to promoting beauty.

It is a schematic diagram which shows the structural example of the beauty promotion system which concerns on 1st Embodiment of this invention. It is a block diagram which shows the structural example of the beauty promotion apparatus shown in FIG. FIG. 3 is a diagram showing an example of each vertex recognized by the vertex recognition unit shown in FIG. 2, and is a (a) front view and (b) side view of imaging data. It is a block diagram which shows the structural example of the portable terminal shown in FIG. It is a figure which shows the processing flow in a beauty promotion apparatus. It is a schematic diagram in the process which the vertex recognition part recognizes the vertex on the cheek. It is a figure which shows an example of the display content by a display processing part. It is a figure which shows the other example of the display content by the display processing part. It is a block diagram which shows the structural example of the beauty promotion apparatus which concerns on a modification. In modification 1, it is a figure which shows an example of each vertex recognized by the vertex recognition part, and is a (a) front view and (b) side view of imaging data. It is a figure which shows the processing flow in the beauty promotion apparatus which concerns on a modification. In modification 2, it is a figure which shows an example of each vertex recognized by the vertex recognition part, and is a (a) front view and (b) side view of imaging data. In modification 3, it is a figure which shows an example of each vertex recognized by the vertex recognition part, and is a (a) front view and (b) side view of imaging data. It is a figure explaining the use condition of the beauty promotion system concerning a 2nd embodiment of the present invention. It is a block diagram which shows the structural example of the beauty promotion apparatus which concerns on 2nd Embodiment.

(First embodiment)
The beauty promotion system 1 according to the first embodiment of the present invention will be described with reference to FIGS. 1 to 8.
FIG. 1 is a schematic diagram showing a configuration example of a beauty promotion system 1 according to an embodiment of the present invention. In order to contribute to the beauty promotion of the user 50, the beauty promotion system 1 performs data processing on the imaging data of the face of the user 50 and quantitatively evaluates the state of the face of the user 50 (for aging management). This is a beauty promotion system for deterioration management and countermeasures.

As shown in FIG. 1, the beauty promotion system 1 includes an imaging device 10 and a beauty promotion device 30 that are connected to each other via a network 20. In the illustrated example, the mobile terminal 40 of the user 50 is connected to the network 20. The mobile terminal 40 of the user 50 does not have to be connected to the network 20.

Here, the beauty promotion system 1 of the present invention shows the results of quantitatively evaluating the face of the user 50 by imaging the face of the user 50 in a store that provides beauty-related services such as a beauty salon. It is used to propose measures to be taken in the future to maintain and improve the condition.
In use, as shown in FIG. 1, the operation may be performed under the operation of the operator 60 of the store, or may be performed by the user 50 itself.

The image capturing device 10 is not particularly limited as long as it is a device that can capture the captured data by capturing the face of the user 50. The image pickup device 10 includes an image pickup unit having an image pickup element such as a CMOS or a CCD. The imaging device 10 also includes a transmission unit that transmits the imaging data captured by the imaging unit to the beauty promotion device.

The imaging data acquired by the imaging device 10 may be 2D data or 3D data. In the present embodiment, a configuration in which the image capturing unit acquires image capturing data as 3D data will be described.
That is, although the image pickup apparatus 10 is illustrated in a simplified manner in FIG. 1, it may be, for example, a 3D camera in which a plurality of image pickup units are arranged at intervals, or one image pickup unit and a distance sensor are provided. The configuration may be changed.

The network 20 is a network for mutually connecting the imaging device 10, the beauty promotion device 30, and the mobile terminal 40, and is, for example, a wireless network or a wired network.
Specifically, the network 20 includes a wireless LAN (WLAN), a wide area network (WAN), ISDNs (integrated service digital networks), wireless LANs, LTE (long term evolution, LED), and LTE (long term evolution-Led-ed). The fourth generation (4G), fifth generation (5G), CDMA (code division multiple access), WCDMA (registered trademark), Ethernet (registered trademark), and the like.

Further, the network 20 is not limited to these examples. For example, the public switched telephone network (Public Switched Telephone network: PSTN), Bluetooth (registered trademark), Bluetooth Low Energy, optical line, ADSL. It may be (Asymmetric Digital Subscriber Line) line, satellite communication network, or the like, and may be any network.

Also, the network 20 may be, for example, NB-IoT (Narrow Band IoT) or eMTC (enhanced Machine Type Communication). Note that NB-IoT and eMTC are wireless communication systems for IoT, and are networks capable of long-distance communication with low cost and low power consumption.

Also, the network 20 may be a combination of these. Further, the network 20 may include a plurality of different networks combining these examples. For example, the network 20 may include an LTE wireless network and a wired network such as an intranet that is a closed network.

Next, the configuration of the beauty promotion device 30 will be described with reference to FIG. FIG. 2 is a block diagram showing a configuration example of the beauty promotion device 30.
The beauty promotion device 30 includes a device-side communication unit 31, a data storage unit 32, a device processing unit 33, and a device-side display unit 34. The beauty promotion device 30 is an information processing device that analyzes the state of the face of the user 50 from the imaged data of the face of the user 50. As an example, a personal computer is used in the present embodiment.

The device-side communication unit 31 is a communication interface that transmits and receives various data via the network 20. Various types of data include image pickup data and data indicating a comparison result. That is, the device-side communication unit 31 functions as a reception unit that receives the imaging data transmitted from the transmission unit of the imaging device 10.

The data storage unit 32 has a function of storing various control programs necessary for the device processing unit 33 to operate and various data received by the device-side communication unit 31 from the outside. The data storage unit 32 also stores at least one or more reference area data.
The data storage unit 32 is realized by various storage media such as HDD, SSD, and flash memory.

By executing the control program stored in the data storage unit 32, the device processing unit 33 realizes each function to be realized as the beauty promotion system 1. The functions referred to here include a vertex recognition function, a region demarcation function, an area calculation function, an area comparison function, and a result display function.
The device-side display unit 34 is a monitor device that displays the content of the operation of the beauty promotion device 30 and the result of the processing.

The device processing unit 33 is a computer that controls each unit of the beauty promotion device 30, and may be, for example, a central processing unit (CPU), a microprocessor, an ASIC, an FPGA, or the like.
The device processing unit 33 is not limited to these examples, and may be any device as long as it is a computer that controls each unit of the beauty promotion device 30.

The device processing unit 33 includes a vertex recognition unit 33A, a region demarcation unit 33B, an area calculation unit 33C, an area comparison unit 33D, and a display processing unit 33E.
The vertex recognition unit 33A recognizes the positions of the two fixed points Pf and the one movable point Pm from the imaged data of the face of the user 50.

Here, the fixed point Pf is a vertex specified depending on the skeleton of the face. Since the fixed point Pf is specified depending on the skeleton of the face, the change in position over time is slight.
Note that the meaning of "fixed" here does not mean that the position does not change at all, but means that the amount of change is extremely small as compared with the movable point Pm described later.

On the other hand, the movable point Pm is an apex that is specified depending on the muscles and fat of the face. For example, the muscles of the face become weaker with age or fat is attached to the face. Position changes.
Further, the position of the movable point Pm is changed to the upper side by stimulating the muscles of the face to strengthen the muscles of the face or reduce the amount of fat on the face. Due to such a change in the position of the movable point Pm, the proportion of the face changes, which greatly affects the impression the face gives to the opponent.

Here, each vertex recognized by the vertex recognition unit 33A in the present embodiment will be described with reference to FIG.
3A and 3B are diagrams showing the respective vertices recognized by the vertex recognition unit 33A, and are a front view and a side view of the imaged data. Note that this content is merely an example, and each vertex recognized by the vertex recognition unit 33A can be arbitrarily changed. That is, in consideration of the structure of the skeleton of the user 50, how to attach muscles, and the like, the vertex of the face that is easy to recognize can be used for evaluation.

As shown in FIG. 3, the vertex recognition unit 33A recognizes two fixed points Pf and one movable point Pm for one demarcated area. As the two fixed points Pf, the vertices identified by the deep nose point P1 and the temple apex P2 are recognized, and the vertex P3 on the cheek is recognized as one movable point Pm. The deep nose point P1 is shared by the pair of left and right demarcated regions. A specific method of identifying each vertex will be described later.
In the present embodiment, the positions of the deep nose point P1 and the temple apex P2 in the vertical direction are equal to each other. The apex P3 on the cheek is located below the deep nose P1 and the apex P2 of the temple.

In addition, the vertex recognition unit 33A recognizes each vertex specified by the inferior nose point P4 and the inferior ear point P5 as the two fixed points Pf, and recognizes the inferior cheek vertex P6 as one movable point Pm. .. The nose point P4 is shared by a pair of left and right demarcated areas. A specific method for discriminating each vertex will be described later.
In the present embodiment, the vertical position of the inferior point P4 and the inferior point P5 are equal to each other. The lower cheek apex P6 is located below the lower nose P4 and the lower ear P5.

As the means for recognizing each vertex in the vertex recognition unit 33A, a method of specifying absolute coordinates with respect to the spatial coordinates provided for the imaged data may be used, or any one of the three vertices defining the demarcated area may be used. Alternatively, a method of specifying relative coordinates based on the above may be used.
In the present embodiment, since the image pickup data is 3D data, the coordinate values are also three-dimensionally expressed.

The area demarcation unit 33B demarcates a demarcation area having a triangular shape by a straight line connecting the vertices whose positions are recognized by the vertex recognition unit 33A. Further, the area demarcation unit 33B demarcates a pair of left and right demarcation areas with the midline O1 of the face as a reference.
The demarcated area defined by the area demarcation unit 33B may be a two-dimensional area or a three-dimensional area. In this embodiment, the defined area is a three-dimensional area.

In the present embodiment, the area demarcation unit 33B demarcates two types of demarcated areas at intervals in the vertical direction of the face. Here, the demarcation region located on the upper side is referred to as the upper demarcation region A1, and the demarcation region located on the lower side is referred to as the lower demarcation region A2.
That is, the area defining portion 33B defines a pair of left and right upper defining areas A1 and lower defining areas A2.

Note that the upper demarcating area A1 and the lower demarcating area A2 are vertically spaced to mean that the accuracy of evaluation is increased by the upper demarcating area A1 and the lower demarcating area A2 over the entire face in the up and down direction. Is. Therefore, there is no problem even if a part of the upper demarcation area A1 and the lower demarcation area A2 overlap each other.

The area calculator 33C calculates the area of the demarcated region. When calculating the area of the demarcated region, the area within the demarcated region is calculated using the coordinate data of each vertex specified by the region demarcating unit 33B.
The area comparison unit 33D compares the area of the defined area calculated by the area calculation unit 33C with a reference area known as the area of the area corresponding to the defined area.

The area comparison unit 33D can use, for example, as the reference area, the area of the demarcated region defined from the imaged data of the user 50 imaged a certain period before the imaged data is captured, that is, in the past.
Further, the area comparison unit 33D can use the area of the demarcated region in the ideal model as the face desired by the user 50 as the reference area. As described above, the reference area can be arbitrarily set as long as it can be compared with the area of the demarcated region at the present time.

Here, an example of a method of creating an ideal model as a face desired by the user 50 will be described.
The ideal model is created using past imaging data. About 100 pieces of original data in which an ideal demarcated area is visually specified are prepared with respect to past imaging data. An ideal model can be created by performing a deep learning process using this original data.

Next, a guideline for comparing the areas will be described with reference to the case where the previously measured area is used as a reference area. In the upper demarcation area A1 of the present embodiment, the apex P3 on the cheek, which is the movable point Pm, is located below the deep nose point P1 and the apex P2 of the temple, which are the fixed points Pf.
Also in the lower demarcation area A2, the lower cheek apex P6, which is the movable point Pm, is located below the lower nose P4 and the lower ear P5.

Therefore, when the apex P3 on the cheek and the apex P6 under the cheek, which are the movable points Pm, move downward, the area of the upper demarcation area A1 and the area of the lower demarcation area A2 increase.
On the other hand, when the apex P3 on the cheek and the apex P6 under the cheek, which are the movable points Pm, move to the upper side, the areas of the upper demarcation area A1 and the lower demarcation area A2 become smaller.

That is, in the configuration in which the position of the movable point Pm is arranged below the position of the fixed point Pf as in the present embodiment, the area of the demarcated region is smaller than the reference area which is the area measured last time. If it is, the movable point Pm has moved upward.
That is, it means that the proportion of the face is improved due to the strengthening of the muscles of the face or the decrease in the fat of the face.

On the other hand, when the area of the demarcated region is larger than the reference area which is the area measured last time, the movable point Pm has moved to the lower side.
That is, it means that the proportion of the face is deteriorated because the muscles of the face are weakened or the fat of the face is increased.
In this way, the user 50 can quantitatively grasp whether the proportion of the face is improving or deteriorating by confirming the amount of change in the demarcated area.

Note that, in the present embodiment, the configuration in which the position of the movable point Pm is arranged below the position of the fixed point Pf in each of the upper demarcated area A1 and the lower demarcated area A2 has been described. It is not limited to the mode. The position of the movable point Pm may be located above the position of the fixed point Pf.

In this case, the result of comparing the area of the demarcated area with the reference area is the opposite of the above description. In other words, when the area of the demarcated region becomes larger than the reference area, the proportion of the face is heading for improvement, and when the area of the demarcated region becomes smaller than the reference area, the proportion of the face becomes worse. You're heading.

In addition, when the area of the demarcated region in the ideal model as the face desired by the user 50 is set as the reference area, it is possible to know whether the proportion of the face is improved by checking how close the reference area is. can do.

The display processing unit 33E causes the area comparison unit 33D to display the comparison result obtained by comparing the area of the demarcated region with the reference area on the device-side display unit 34 and the terminal-side display unit 45 of the mobile terminal 40, which will be described later. A specific example of the display content displayed by the display processing unit 33E will be described later.

Next, the configuration of the mobile terminal 40 will be described with reference to FIG. FIG. 4 is a block diagram showing a configuration example of the mobile terminal 40.
The mobile terminal 40 includes a terminal side communication unit 41, a terminal storage unit 42, a terminal processing unit 43, a camera 44, and a terminal side display unit 45. The mobile terminal 40 is a terminal device that a user carries and uses, such as a so-called smartphone or tablet.

The terminal-side communication unit 41 is a communication interface that transmits and receives various data via the network 20. Various types of data include image pickup data and data indicating a comparison result. That is, the terminal-side communication unit 41 receives various types of information from the beauty promotion device 30.

The terminal storage unit 42 has a function of storing various control programs and various data necessary for the terminal processing unit 43 to operate. The terminal storage unit 42 is realized by various storage media such as HDD, SSD, and flash memory.
By executing the control program stored in the terminal storage unit 42, the terminal processing unit 43 may realize at least a part of each function to be realized as the beauty promotion system 1.

The terminal processing unit 43 is a computer that controls each unit of the mobile terminal 40, and may be, for example, a central processing unit (CPU), a microprocessor, an ASIC, an FPGA, or the like. The terminal processing unit 43 is not limited to these examples, and may be any computer as long as it controls each unit of the mobile terminal 40.

The terminal processing unit 43 includes a reception unit 43A. The reception unit 43A receives the imaging data and the comparison result transmitted from the beauty promotion device 30, and displays them on the terminal side display unit 45.
The camera 44 can take an image by the operation of the user 50. Instead of the imaging device 10 according to the present embodiment, the imaging data may be acquired by the camera 44 of the mobile terminal 40 and transmitted to the beauty promotion device 30.
The terminal-side display unit 45 is a monitor device that displays information indicating the comparison result processed by the beauty promotion device 30. The terminal side display unit 45 can display the imaging data together with the comparison result.

Next, the control flow of the beauty promotion system 1 and the content of processing in the beauty promotion system 1 will be described with reference to FIGS. 5 to 6.
FIG. 5 is a diagram showing a processing flow in the beauty promotion system 1, and FIG. 6 is a schematic diagram in processing in which the vertex recognition unit 33A recognizes the vertex P3 on the cheek.

As shown in FIG. 5, in the beauty promotion method according to the present embodiment, first, the imaging device 10 performs an imaging step (S501) of imaging the face of the user 50. In the imaging step, in order to suppress a change due to the facial expression of the user 50, it is desirable that the back teeth are lightly engaged, for example, so that the facial expression is always the same.
In the present embodiment, the imaging device 10 acquires 3D data. 3D data can be acquired by capturing an image with a 3D camera.

Next, 33 A of vertex recognition parts perform the vertex recognition step (S502) which recognizes each vertex using the imaging data transmitted from the imaging device 10.
In the vertex recognition step, the positions of the two fixed points Pf and the one movable point Pm are recognized as three vertices forming one demarcated area. Here, one aspect of a specific method of discriminating each vertex will be described. Note that this description is merely an example, and each vertex may be discriminated by another method.

As shown in FIG. 3, the vertex recognition unit 33A three-dimensionally evaluates the imaged data and recognizes each vertex. First, with respect to the deep nose point P1 that forms one fixed point Pf among the three vertices that form the upper demarcation area A1, the most recessed part of the nose root of the face is specified and recognized as the deep nose point P1. To do.
Next, regarding the apex P2 of the temple that forms the other fixed point Pf, the most depressed part of the temple part of the face is recognized as the apex P2 of the temple. The apex P2 of the temple may be a portion through which a straight line connecting the deep nose point P1 and the center of the pupil or the inner canthus of the outer end portion of the face in the left-right direction in front view passes.

Further, of the three vertices, with respect to the apex P3 on the cheek which forms the movable point Pm, the highest portion of the upper cheek of the face near the vertical line outside the pupil is recognized as the apex P3 on the cheek. .. At this time, as shown in FIG. 6, by projecting the contour lines on the imaged data, the most raised portion may be recognized as the apex P3 on the cheek.
By performing this processing on both the left and right sides, the vertices that form the pair of left and right upper demarcating areas A1 are recognized.

Next, as shown in FIG. 3, of the three vertices forming the lower demarcation area A2, for the deep nose point P1 that forms one fixed point Pf, the deepest part of the nose of the face is It is recognized as the point P4 below the nose.
Next, regarding the inferior ear point P5 that forms the other fixed point Pf, the most recessed portion of the portion of the face located under the ear is recognized as the inferior ear point P5.

Further, of the three vertices, the lower cheek apex P6 forming the movable point Pm is the lowermost portion of the cheek of the face, which is the most raised portion in the lateral bulge of the corner of the mouth near the vertical line outside the pupil. It is recognized as the apex P6 under the cheek. When recognizing the apex P6 under the cheek, the contour line may be projected on the imaging data to recognize the most raised portion as the apex P6 under the cheek.
By performing this process on both the left and right sides, the respective vertices forming the pair of left and right lower demarcation areas A2 are recognized.

It should be noted that, without adopting the above-described method for recognizing each vertex, for example, by comparing the position of each vertex in the face data of a plurality of people registered in advance with the captured image data, each defined region Image processing may be performed so as to identify each vertex forming the.
Further, the position of each vertex may be specified by superimposing the latest image pickup data on the past image pickup data. Further, the operator 60 may specify the position of each vertex by selecting an appropriate location as each vertex on the imaged data.

Next, the area demarcating unit 33B performs an area demarcating step (S503) of demarcating a demarcated area by using each vertex data identified by the vertex recognition step.
In the area defining step, a triangle defining area is defined by a straight line connecting the respective vertices.

Next, the area calculation unit 33C performs an area calculation step (S504) of calculating the area of the demarcated area demarcated in the area demarcation step.
In the area calculation step, the area of the demarcated region is calculated using the coordinate data of each vertex.

Next, the area comparison unit 33D performs an area comparison step (S505) of comparing the area of the demarcated region calculated in the area calculation step with the reference area.
In the area comparison step, the area of the demarcated area is compared with a reference area known as the area of the area corresponding to the demarcated area. In this description, the area of the demarcated region obtained from the past measurement results is set as the reference area.

Finally, the display processing unit 33E performs a display processing step (S506) of outputting information indicating the comparison result.
In the display processing step, the comparison result between the area of the demarcated region compared by the area comparison unit 33D and the reference area is displayed on the device-side display unit 34 and the terminal-side display unit 45. In addition, the comparison result may include information about the result of this time and information that suggests a measure (a facial massage or the like) that the user 50 will work on in the future. The comparison result may not be displayed on the terminal side display unit 45.

Next, the result of the evaluation by the beauty promotion system 1 and the effect thereof will be described with reference to FIGS. 7 and 8.
FIG. 7 is a diagram showing an example of display contents by the display processing unit 33E, which is (a) imaging data two months ago, and (b) imaging data at the time of evaluation. Further, FIG. 8 is a diagram showing another example of the display content by the display processing unit 33E, which is (a) imaging data two months ago, and (b) imaging data at the time of evaluation.

In the example of the comparison result shown in FIG. 7, the area of the upper demarcation area A1 is reduced by about 23% and the area of the lower demarcation area A2 is reduced by about 33% as compared with two months ago. As a result, youthful and plump feeling appears, and it is recognized that the appearance impression is improved.

In another example of the comparison result shown in FIG. 8, the area of the upper demarcated area A1 is reduced by about 21.5% and the area of the lower demarcated area A2 is reduced by about 25% compared to two months ago. It is recognized that this gives a youthful and plump feeling and improves the visual impression. As a result, it has a well-balanced and gentle look, and it is recognized that the appearance impression is improved.

As described above, according to the beauty promotion system 1 according to the present embodiment, the vertex recognition unit 33A determines two fixed points that are specified depending on the skeleton of the face from the imaged data of the face of the user 50. The position of each of the one movable point Pm specified depending on Pf and the muscle and fat of the face is recognized.

Next, the area demarcation unit 33B demarcates a demarcated area having a triangular shape by the straight line connecting the specified vertices, and the area calculation unit 33C calculates the area of the demarcated area. Then, the area comparison unit 33D compares the area of the demarcated region with the reference area. This makes it possible to quantitatively evaluate changes in the proportions of the face due to aging deterioration and improvement measures, and contribute to promoting beauty.

Further, in this case, since the demarcated area is demarcated by the two fixed points Pf and the one movable point Pm, for example, the recognition is performed in comparison with the configuration in which the demarcated area is demarcated by the two or three movable points Pm. It is possible to suppress a specific variation in the position of the difficult movable point Pm and perform accurate evaluation.

Then, by evaluating the area of the demarcated region, the amount of change can be increased by increasing the numerical value to be handled, compared with the case where the position of the movable point Pm is evaluated by the distance from the fixed point Pf.
As a result, even if the change in the proportion of the face has a difference that is difficult to understand even if it is confirmed by the imaging data before and after the elapse of a certain period, the user 50 determines the degree of the change in the face. It becomes easier to recognize and can be motivated to promote beauty.

Moreover, in the existing proportion analysis of the face, most of them depended on the skeleton (so-called golden ratio of the face, etc.), and it was impossible to do so due to congenital factors, and it was difficult to increase motivation for cosmetics other than orthopedics. .. On the other hand, the beauty promotion system 1 evaluates changes in muscles and fats due to aging deterioration that are likely to be improved by self-care without depending only on the skeleton, so that the user's motivation for beauty can be increased. ..

In addition, the beauty promotion system 1 includes the display processing unit 33E that outputs information indicating a comparison result obtained by comparing the area of the demarcated region with the reference area. Therefore, the result of the quantitative evaluation is, for example, carried by the user 50. By displaying the result on the terminal 40, the evaluation result can be easily confirmed.

Further, since the area demarcation unit 33B demarcates a pair of demarcated areas on the left and right with reference to the median line O1 of the face, it is possible to promote beauty for the realization of a proportion of the face that is proportionate to the left and right.

Further, the area demarcation unit 33B demarcates the demarcation area by the two fixed points Pf specified by the deep nose point P1 and the apex P2 of the temple, and the one movable point Pm specified by the apex P3 on the cheek. ..
Therefore, the proportions around the upper part of the cheek of the face are quantitatively evaluated, and for example, sagging of the upper part of the cheek that tends to be a concern with aging (for example, the Golgo line formed between the roche line and the cheekbone). You can check the change of.

Further, the vertex recognition unit 33A three-dimensionally evaluates the imaging data, and recognizes the deep nose point P1, the temple vertex P2, and the cheek vertex P3. Therefore, each vertex can be easily recognized regardless of the modeling of the face of the user 50.

Further, since the area demarcation unit 33B demarcates two types of demarcated areas at intervals in the vertical direction of the face, the proportions of the entire face can be quantitatively evaluated by evaluating the upper side and the lower side of the face, respectively. It is possible to evaluate, and it is possible to more effectively promote beauty.

Further, the area demarcation unit 33B demarcates the demarcation area by the two fixed points Pf specified by the inferior nose point P4 and the inferior ear point P5, and the one movable point Pm specified by the apex P6 of the inferior cheek. Therefore, it is possible to quantitatively evaluate the proportions around the lower part of the cheek of the face, and for example, to confirm the change in the sagging of the lower part of the cheek, which tends to be a concern with aging.

Further, since the vertex recognition unit 33A three-dimensionally evaluates the imaging data and recognizes the nose point P4, the ear point P5, and the cheek vertex P6, regardless of the facial shaping of the user 50, Each vertex can be easily recognized.

When the area comparison unit 33D uses, as the reference area, the area of the demarcated region of the user 50 at a time point before a certain period from the time when the image data is captured, the proportion of the face changes with the passage of time. Can be quantitatively evaluated. Thereby, the beauty effect can be accurately grasped.

Further, when the area comparison unit 33D uses the area of the demarcated region in the ideal model as the face desired by the user 50 as the reference area, it is possible to quantitatively confirm how close the target is. .. As a result, the motivation of the user 50 for beauty can be maintained and effective beauty promotion can be performed.

Further, the beauty promotion system 1 includes the beauty promotion device 30 and the image pickup device 10 for picking up an image of the face. Therefore, the image pickup data of the face of the user 50 can be easily acquired and the image is picked up by the beauty promotion device 30. Data can be evaluated.

(Modification)
Next, various modifications of the beauty promotion system 1 according to the first embodiment will be described with reference to FIGS. 9 to 13. In the plurality of modified examples described here, the number of vertices recognized by the vertex recognition unit and the defined area (geometric shape) used for evaluation are different from those in the first embodiment.
In the description of each modification, only the differences from the first embodiment will be described, and description of common configurations and common effects will be omitted.

(Modification 1)
FIG. 9: is a block diagram which shows the structural example of the beauty promotion apparatus 30 which concerns on a modification. FIG. 10 is a diagram showing an example of each apex recognized by the apex recognizing unit 33F in Modification Example 1. FIG. 10(a) is a front view of imaging data, and FIG. 10(b) is a drawing of imaging data. It is a side view.
In the first modification, the number of vertices recognized by the vertex recognition unit 33F and the geometric shape recognized based on the number are different from those in the first embodiment.
As shown in FIG. 9 and FIG. 10, in the first modification, the vertex recognition unit 33F detects the left and right sides of the face in the upper half of the face, centering on the midline, from the imaged data of the face of the user. Each recognizes the position of one fixed point (P1) and one movable point (P3).

Then, the geometric shape defining unit 33G defines a geometric shape including the respective vertices whose positions are recognized by the vertex recognizing unit 33F in the peripheral portion.
In the illustrated example, a straight line L1 is defined as a geometric shape that is included in the peripheral portion in the upper half of the face, centered on the midline, and on the left side and the right side of the face, respectively. The geometric shape defining portion 33G exhibits the same function as the area defining portion 33B in the first embodiment.
Then, the geometric shape defining portion 33G defines a pair of left and right geometric shapes based on the midline of the face. That is, the geometric shape defining portion 33G defines a pair of left and right straight lines L1.

In addition, the vertex recognition unit 33F determines one fixed point (P4) and one fixed point (P4) on the left half and the right half of the face in the lower half of the face from the imaged data of the face of the user. The position of each movable point (P6) is recognized.
Then, the geometric shape defining portion 33G defines two types of geometric shapes at intervals in the vertical direction of the face. That is, the geometric shape defining portion 33G defines the straight line L2 as the geometric shape included in the peripheral portion in the lower half of the face, centering on the midline and on the left side and the right side of the face, respectively. The geometric shape defining portion 33G defines a pair of left and right straight lines L2.

Then, in the modified example 1, the feature amount calculation unit 33H calculates the feature amount indicating the length of the geometric shape. Here, the feature amount calculation unit 33H exhibits the same function as the area calculation unit 33C in the first embodiment.
That is, the feature amount calculation unit 33H calculates the length of the straight line when the geometric shape is a straight line, and calculates the area of the straight line when the geometric shape is a figure. In the illustrated example, since the geometric shapes are the straight lines L1 and L2, the respective lengths are calculated.

Then, the feature amount comparison unit 33I compares the feature amount calculated by the feature amount calculation unit 33H with a reference value known as a value corresponding to the geometric shape. That is, the feature amount comparison unit 33I exhibits the same function as the area comparison unit 33D in the first embodiment.
Here, the data storage unit 32 stores a reference value instead of the reference area stored in the first embodiment. The reference value is a concept obtained by expanding the concept of the reference area in the first embodiment to a straight line, and indicates the length of the straight line or the area of the region.

That is, as in the first embodiment, the feature amount comparison unit 33I uses the feature amount of the user at a time point before a fixed period from the time of capturing the imaged data as a known reference value or an ideal face as the user desires. The feature amount in the model can be used as a known reference value.
The display processing unit 33E displays the result on the device-side display unit 34 and the terminal-side display unit 45.

Next, a processing flow of the beauty promotion system 1 according to Modification 1 will be described with reference to FIG. FIG. 11 is a diagram showing a processing flow in the beauty promotion device 30 according to the modification.
As shown in FIG. 11, first, the imaging device 10 performs an imaging step (S601) of imaging the face of the user 50.
Next, the vertex recognition unit 33F performs a vertex recognition step (S602) of recognizing each vertex by using the imaging data transmitted from the imaging device 10.

Next, the geometric shape defining unit 33G performs a geometric shape defining step (S603) of defining a geometric shape using each vertex data identified in the vertex recognizing step.
In the geometric shape defining step in this modified example, as described above, the geometric shape defining portion 33G defines the straight lines L1 and L2 in left and right pairs.

Next, the feature amount calculation unit 33H performs a feature amount calculation step (S604) of calculating the length of the geometric shape defined by the geometric shape definition step.
In the feature amount calculation step in the first modification, the lengths of the straight lines L1 and L2, which are geometric shapes, are calculated using the coordinate data of each vertex.

Next, the feature amount comparison unit 33I performs a feature amount comparison step (S605) of comparing the feature amount of the geometric shape calculated by the feature amount calculation step with a known reference value.
In the feature quantity comparison step, the value of the feature quantity is compared with a known reference value. In this description, the lengths of the straight lines L1 and L2 obtained from the past measurement results are set as the reference value.

Finally, the display processing unit 33E performs a display processing step (S606) of outputting information indicating the comparison result.
In the display processing step, the comparison result between the feature amount of the geometrical shape compared by the feature amount comparing unit 33I and the reference value is displayed on the device side display unit 34 and the terminal side display unit 45. In addition, the comparison result may include information about the result of this time and information that suggests a measure (a facial massage or the like) that the user 50 will work on in the future. The comparison result may not be displayed on the terminal side display unit 45.
Then, by making such a comparison, it is possible to quantitatively evaluate the change in the proportion of the face due to aging deterioration and improvement measures, and to contribute to the promotion of beauty, as in the first embodiment described above.

(Modification 2)
Next, the beauty promotion system 1 according to the second modification will be described with reference to FIG. FIG. 12 is a diagram showing an example of each apex recognized by the apex recognizing unit 33F in Modification Example 2. FIG. 12(a) is a front view of imaging data, and FIG. 12(b) is a drawing of imaging data. It is a side view.

As shown in FIG. 12, in the second modification, the vertex recognition unit 33F extracts four fixed points (P1, P2, P4, P5) and one movable point (P6) from the imaged data of the user's face. Recognize the position of.
Then, the geometric shape defining unit 33G defines a geometric shape including the respective vertices whose positions are recognized by the vertex recognizing unit 33F in the peripheral portion. Here, in the illustrated example, the area of a pentagon A1 connecting the vertices is defined as the geometric shape. In this modification, a pair of left and right pentagons A1 are defined from the entire face.

Then, the feature amount calculation unit 33H calculates the area of the pentagon A1 as a geometric shape as the calculation of the feature amount. That is, the feature amount calculation unit 33H calculates the length as the feature amount when the geometric shape is a straight line and the area as the feature amount when the geometric shape is a figure.
Then, the feature amount comparison unit 33I compares the feature amount calculated by the feature amount calculation unit 33H with a reference value known as a value corresponding to the geometric shape.
In the above description, the configuration has one movable point, but the vertex recognition unit 33F may recognize two or more movable points when defining the pentagon A1. The geometric shape defining portion 33G may define different pentagons in the upper half and the lower half of the face.

(Modification 3)
Next, the beauty promotion device 30 according to the third modification will be described with reference to FIG. 13A and 13B are diagrams showing an example of each vertex recognized by the vertex recognition unit 33F in Modification 3, where FIG. 13A is a front view of the captured data and FIG. 13B is a diagram of the captured data. It is a side view.

As shown in FIG. 13, in Modification 3, the vertex recognition unit 33F determines the positions of two fixed points (P2, P5) and one movable point (P6) from the imaged data of the user's face. recognize.
Then, the geometric shape defining portion 33G defines the area of the circle C1 as a geometric shape including the respective vertices whose positions are recognized by the vertex recognizing portion 33F in the peripheral portion. The geometric shape defining portion 33G defines a pair of left and right circles C1 from the entire face.

Then, the feature amount calculation unit 33H calculates the area of the circle, and the feature amount comparison unit 33I compares the feature amount calculated by the feature amount calculation unit 33H with a reference value known as a value corresponding to the geometric shape. To do.
In the above description, the configuration in which there is one movable point is shown, but the vertex recognition unit 33F may recognize two movable points when defining the circle C1. Further, the geometric shape defining portion 33G may define different circles for the upper half and the lower half of the face.
As described above, the geometric shape to be evaluated may be a straight line, a circle, or a polygon.

(Second embodiment)
Next, a beauty promotion system according to the second embodiment will be described with reference to FIGS. 14 and 15. FIG. 14: is a figure explaining the use condition of the beauty promotion system 1B which concerns on 2nd Embodiment of this invention. FIG. 15 is a block diagram showing a configuration example of the beauty promotion device 30B according to the second embodiment.

In the second embodiment, the overall configuration of the device is different from that of the first embodiment. In the description of the second embodiment, only the differences from the first embodiment will be described, and description of common configurations and common effects will be omitted.

As shown in FIG. 13, the beauty promotion system 1B according to the second embodiment is a smart mirror that has both a mirror function and a display function by displaying the captured content on a mirror-finished display surface. The imaging device 10 having an imaging unit is built in the beauty promotion device 30B that constitutes the beauty promotion system 1B.
The image capturing section of the image capturing apparatus 10 captures an image of the front surface on which the user is located, from the upper portion of the display surface of the apparatus side display section 34.
The display surface of the device-side display unit 34 of the beauty promotion device 30B is mirror-finished.

Therefore, when nothing is displayed on the display surface, the device-side display unit 34 can be used as a mirror.
The device-side display unit 34 has a function of displaying on the display surface the imaged data of the face of the user facing the display surface. Therefore, the user can confirm the imaged data of the user's face imaged by the imaging device 10 and the evaluation result of the change in the proportion performed by the device processing unit 33 using the imaged data by looking at the mirror. ..
As a result, it is possible to confirm the change in the proportions of the face at the timing when the user adjusts his appearance, and it is possible to ensure the convenience of the user.

As a usage mode of the beauty promotion device 30B, one side of the left and right half of the face may be used as a mirror and the image data may be displayed on the other side, or the front side may be used as a mirror while the display surface is being displayed. The evaluation result may be overwritten. Further, the data processed into the ideal face proportions may be displayed in an overlapping manner.

Needless to say, the beauty promotion system 1 is not limited to the above embodiment and may be realized by another method. Various modifications will be described below.
For example, the control program of the above embodiment may be provided in a state of being stored in a computer-readable storage medium. The storage medium can store the control program in a “non-transitory tangible medium”. Storage media may include any suitable storage media such as HDD or SDD, or any suitable combination of two or more thereof. The storage medium may be volatile, non-volatile, or a combination of volatile and non-volatile. The storage medium is not limited to these examples, and may be any device or medium as long as it can store the control program.

In addition, the beauty promotion system 1 can realize each function shown in the embodiment by, for example, reading a control program stored in a storage medium and executing the read control program.
Further, the control program may be an application program installed in the beauty promotion system 1 via an arbitrary transmission medium (communication network, broadcast wave, etc.). The beauty promotion system 1 realizes the functions of the plurality of functional units shown in the respective embodiments by executing a control program downloaded via the Internet or the like, for example.

The control program is implemented by using a script language such as ActionScript or JavaScript (registered trademark), an object-oriented programming language such as Objective-C or Java (registered trademark), or a markup language such as HTML5. Good.

At least a part of the processing in the beauty promotion system 1 may be realized by cloud computing configured by one or more computers. Further, each functional unit of the beauty promotion system 1 may be realized by one or a plurality of circuits that realize the functions shown in the above embodiments, and one circuit may realize the functions of a plurality of functional units. Good.

Although the embodiments of the present disclosure have been described based on the drawings and the examples, it should be noted that those skilled in the art can easily make various variations and modifications based on the present disclosure. Therefore, it should be noted that these variations and modifications are included in the scope of the present disclosure. For example, the functions and the like included in each means and each step can be rearranged so as not to logically contradict, and a plurality of means and steps can be combined or divided into one. .. Further, the configurations shown in the respective embodiments may be combined appropriately.

(Appendix)
In the beauty promotion method of the present invention, the computer determines, from the imaged data of the user's face, at least one fixed point that is specified depending on the skeleton of the face and the muscle and fat of the face. A step of recognizing the position of each of the one movable point, a step of defining a geometrical shape including the vertices whose positions are recognized in the step of recognizing the vertexes in a peripheral portion, and a length of the geometrical shape. Feature amount calculating step of calculating a feature amount indicating a size or area, a feature amount comparing step of comparing the feature amount calculated in the feature amount calculating step with a feature amount known as a value corresponding to the geometric shape. And execute.

Further, the vertex recognition step recognizes two fixed points and one movable point, and the geometric shape defining step uses a straight line connecting the respective vertices whose positions are recognized by the vertex recognition step. , A region defining step of defining a demarcated region having a triangular shape, the feature amount calculating step is an area calculating step of calculating an area of the defined region, and the feature amount comparing step is calculated by the area calculating step. The area comparison step of comparing the area of the defined area with a reference area known as the area of the area corresponding to the defined area may be performed.

The beauty promotion program of the present invention causes a computer to specify, from image data obtained by imaging a user's face, at least one fixed point that is specified depending on the skeleton of the face and the muscle and fat of the face. A vertex recognition function for recognizing the position of each one of the movable points, a geometric shape defining function for determining a geometric shape including the vertices whose positions are recognized by the vertex recognition function in a peripheral portion, and a length of the geometric shape. Feature amount calculating function for calculating a feature amount indicating a size or area, a feature amount comparing function for comparing the feature amount calculated by the feature amount calculating function, and a feature amount known as a value corresponding to the geometric shape. And realize.

Further, the vertex recognition function recognizes two fixed points and one movable point, and the geometric shape defining function uses a straight line connecting the vertices whose positions are recognized by the vertex recognition function. , A region demarcation function for demarcating a demarcated region having a triangular shape, the feature amount calculation function is an area calculation function for calculating the area of the demarcated region, and the feature amount comparison function is calculated by the area calculation function. The area comparison function of comparing the area of the defined area with a reference area known as the area of the area corresponding to the defined area may be used.

1 Beauty Promotion System 10 Imaging Device 20 Network 30 Beauty Promotion Device 40 Mobile Terminal 50 User 60 Operator

Claims (17)

1. The positions of at least one fixed point that is specified depending on the skeleton of the face and at least one movable point that is specified depending on the muscles and fat of the face are determined from the imaged data of the user's face. A vertex recognition unit for recognition,
   A geometric shape defining portion that defines a geometric shape including the respective vertices whose positions are recognized by the vertex recognizing portion in a peripheral portion,
   A feature amount calculation unit that calculates a feature amount indicating the length or area of the geometric shape,
   A beauty promotion device comprising: a feature amount comparison unit that compares the feature amount calculated by the feature amount calculation unit with a reference value known as a value corresponding to the geometric shape.
2. The vertex recognition unit recognizes two fixed points and one movable point,
   The geometric shape demarcating unit is a region demarcating unit that demarcates a demarcating region having a triangular shape by a straight line connecting the respective vertices whose positions are recognized by the vertex recognizing unit,
   The feature amount calculation unit is an area calculation unit that calculates the area of the demarcated region as the feature amount,
   The feature amount comparison unit compares the feature amount with the known reference value, and the area of the demarcated region calculated by the area calculation unit, and a reference area known as the area of the region corresponding to the demarcated region. The beauty promotion device according to claim 1, wherein the beauty promotion device is an area comparison unit for comparing
3. The beauty promotion according to claim 1 or 2, further comprising: a display processing unit that outputs information indicating a comparison result obtained by comparing the feature amount with the reference value by the feature amount comparing unit. apparatus.
4. The beauty promotion device according to any one of claims 1 to 3, wherein the geometric shape defining portion defines a pair of left and right geometric shapes based on a midline of the face.
5. The vertex recognition unit,
   As the two fixed points, each vertex identified by the deep nose point and the temple vertex is recognized,
   The beauty promotion device according to claim 2, wherein a vertex on the cheek is recognized as one of the movable points.
6. The vertex recognition unit evaluates the imaged data three-dimensionally,
   Of the nose root of the face, recognize the most depressed part as the deep nose point,
   Among the temples of the face, recognize the most depressed part as the apex of the temple,
   The beauty promotion device according to claim 5, wherein a part of the upper part of the cheek of the face, which is most raised in the vicinity of a vertical line outside the pupil, is recognized as a vertex on the cheek.
7. The beauty promotion device according to any one of claims 1 to 6, wherein the geometric shape defining portion defines two types of the geometric shapes at intervals in the vertical direction of the face.
8. The vertex recognition unit,
   As each of the two fixed points, each vertex identified by a subnasal point and a parotid point is recognized,
   The beauty promoting device according to claim 2, wherein a lower cheek is recognized as one of the movable points.
9. The vertex recognition unit evaluates the imaged data three-dimensionally,
   Of the lower part of the nose of the face, recognize the most depressed part as the lower nose,
   Of the part located below the ears of the face, the most recessed part is recognized as the parietal point,
   9. The beauty according to claim 8, wherein, of the lower part of the cheek of the face, in the bulge lateral to the corner of the mouth in the vicinity of the vertical line outside the pupil, the most raised part is recognized as the apex of the lower cheek. Promotion device.
10. 10. The feature quantity comparing unit uses, as the reference value, the feature quantity of the user at a time point a certain period before the time when the image data was imaged, according to any one of claims 1 to 9. The described beauty promotion device.
11. 10. The beauty promotion device according to claim 1, wherein the feature amount comparison unit uses the feature amount in an ideal model as a face desired by the user as the reference value.
12. The beauty promotion device according to any one of claims 1 to 11,
    An imaging device that captures the face of the user; and an imaging device that includes a transmission unit that transmits the imaging data captured by the imaging unit to the beauty promotion device,
    The beauty promotion device further includes a receiving unit that receives the imaging data.
13. The image pickup section is built in the inside, and a device-side display section whose display surface is mirror-finished is provided,
    13. The beauty promotion system according to claim 12, wherein the device-side display unit is a smart mirror capable of displaying image pickup data of the face of the user facing the display surface on the display surface.
14. Computer
    Recognizing the positions of at least one fixed point that is specified depending on the skeleton of the face and one movable point that is specified depending on the muscles and fat of the face from the imaged data of the user's face. A vertex recognition step
    A geometrical shape defining step of defining a geometrical shape including the respective vertices whose positions are recognized by the apex recognizing step in a peripheral portion;
    A feature amount calculation step of calculating a feature amount indicating the length or area of the geometric shape,
    A beauty promotion method, comprising: a feature quantity comparing step of comparing the feature quantity calculated by the feature quantity calculating step with a feature quantity known as a value corresponding to the geometric shape.
15. In the apex recognition step, two fixed points and one movable point are recognized,
    The geometric shape defining step is an area defining step of defining a defining area having a triangular shape by a straight line connecting the vertices whose positions are recognized by the vertex recognizing step,
    The feature amount calculating step is an area calculating step of calculating an area of the demarcated region,
    The feature amount comparing step is an area comparing step of comparing the area of the demarcated area calculated by the area calculating step with a reference area known as the area of the area corresponding to the demarcated area. The beauty promotion method according to claim 14.
16. On the computer,
    Recognizing the positions of at least one fixed point that is specified depending on the skeleton of the face and one movable point that is specified depending on the muscles and fat of the face from the imaged data of the user's face. Vertex recognition function
    A geometric shape defining function for establishing a geometric shape including the respective vertices whose positions are recognized by the vertex recognition function in a peripheral portion,
    A feature amount calculation function for calculating a feature amount indicating the length or area of the geometric shape,
    A beauty promotion program that realizes a feature quantity comparison function of comparing the feature quantity calculated by the feature quantity calculation function with a feature quantity known as a value corresponding to the geometric shape.
17. The vertex recognition function recognizes two fixed points and one movable point,
    The geometric shape defining function is an area defining function that defines a triangular defining area by a straight line connecting the vertices whose positions are recognized by the vertex recognizing function,
    The feature amount calculation function is an area calculation function for calculating the area of the demarcated region,
    The feature amount comparison function is an area comparison function of comparing the area of the demarcated region calculated by the area calculation function with a reference area known as the area of the region corresponding to the demarcated region. The beauty promotion program according to claim 16.

Images