JP2001104050A - Makeup support method using image processing, dressing table, and recording medium having makeup support processing program using image processing recorded - Google Patents

Abstract

PROBLEM TO BE SOLVED: To solve the problem of the prior art that, when it is desirable to change cosmetics to be used according to the condition of the skin, a trouble to decide which cosmetics is to be used occurs frequently, according to the skin condition at that time. SOLUTION: This dressing table 1 integrally incorporates a knowledge data base 51 for storing data on each of plural cosmetics, a camera 3 for taking a face image of a person 2 to wear makeup, an image processing part 4 for extracting the face image from the image obtained by the camera 3, analyzing the face image and outputting the information showing the condition of the skin, a makeup support information generating part 5 for generating the contents of advice related to the makeup for the person to wear makeup with reference to the knowledge data base 51, and a user interface part 6 presenting the information output form the makeup support information generating part 5 to the person 2 to wear makeup.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image processing for analyzing a face image of a person (make-up person) who wants to make-up, and generating advice contents such that appropriate makeup can be performed based on the analysis result. The present invention relates to a makeup support method used, a makeup table, and a recording medium storing a makeup support processing program using image processing.

[0002]

2. Description of the Related Art At present, a very wide range of cosmetics are sold, but it is very difficult for ordinary people to determine what kind of cosmetics are suitable for themselves. Recently, with the deregulation, cosmetics can be freely purchased not only in pharmacies and the like but also in supermarkets and convenience stores. At the same time, the number of opportunities for personalized advisors to learn how to use cosmetics and which cosmetics are suitable has been drastically reduced, and consumers themselves have to decide whether or not to use appropriate cosmetics.

[0003] In particular, recently, the types and uses of cosmetics are diverse and wide-ranging. Makeup varies greatly depending on individual differences, weather, physical condition of the day, and situations. But,
Information attached to fashion magazines and cosmetics alone is not enough and does not provide satisfactory information for each consumer.

[0004] Therefore, even though the availability of cosmetics per se has become easier, it is likely that the cosmetics will be increasingly troubled by their proper use in the future. Therefore, there has been proposed a method of taking in a face image of a make-up person and performing image processing on the face image to give an optimal makeup advice to the user.

[0005] For example, Japanese Patent Application Laid-Open No. 8-202754 (title "lip color advice system and method"):
(Hereinafter referred to as a first conventional technique) discloses a technique of imaging a lipstick application method and simulating a method suitable for the person.

Further, as disclosed in Japanese Patent Application Laid-Open No. 11-169358 (title of the invention, "face determination method and face determination support device", hereinafter referred to as a second conventional technique), an impression or a face image of a makeup subject is obtained. A method for diagnosing the condition of the skin and giving advice on skin care and the like and giving advice on how to make up is disclosed.

[0007] According to the first and second prior arts, it is considered that appropriate makeup can be performed without any specialized knowledge of makeup. Since these techniques determine the condition of the skin, for example, when the physical condition is poor and the skin is rough, it is also possible to propose a measure such as recommending a basic makeup with less noticeable rough skin.

[0008]

However, all of these techniques are auxiliary methods for professional makeup, and have the following problems for use by ordinary consumers. .

First, since these devices are large-scale and require a large-sized camera and a special computer, they are not developed on the assumption that they can be easily used in ordinary households.

[0010] A small-scale system is disclosed in Japanese Patent Application Laid-Open No. 9-215520 (title "Compact":
There is a third prior art). In this technique, a portion which cannot be seen with a normal compact is covered by attaching a small camera. However, in order to obtain a face image of constant quality, instability of the position poses a problem.

As described above, some systems and methods for giving advice on makeup have been proposed.
Every user has problems with using it. In addition, in these techniques, it is not clear how the cosmetics correspond to information such as how the face should be applied and how to apply makeup. In other words, there is no problem assuming that the advice is based on the assumption that professionals have considerable specialized knowledge, but general consumers who do not have knowledge of makeup need more specific advice. For example, if the skin is severe, specific and easy-to-understand advice on which cosmetics to use and how to use them is necessary.

Therefore, the present invention takes in a face image and processes the data, judges the condition of the skin of the subject at that time, and further uses personal data and weather data of the subject. It is an object of the present invention to provide appropriate and easy-to-understand advice on makeup to a makeup recipient so that appropriate makeup can be performed without having specialized knowledge of makeup.

[0013]

In order to achieve the above-mentioned object, a makeup supporting method using image processing according to the present invention accumulates data on a plurality of cosmetics as a knowledge database and stores the data on the respective cosmetics as a knowledge database. By taking out the face image of the makeup person, analyzing the face image, obtaining information indicating the condition of the skin from the analysis result, and referring to data on each cosmetic in the knowledge database based on the information indicating the condition of the skin, The content of advice regarding makeup is generated and output to the makeup recipient.

[0014] Further, the dressing table of the present invention comprises a knowledge database in which data on a plurality of cosmetics is stored for each cosmetic, a camera for capturing a face image of the subject, and a face from among the images captured by the camera. An image processing unit that extracts an image, analyzes the face image, and outputs information indicating the condition of the skin from the analysis result, based on the information indicating the condition of the skin output from the image processing unit, A makeup support information generation unit that generates advice content regarding makeup for the makeup subject with reference to the data on each cosmetic product, and presents the advice content generated by the makeup support information generation unit to the makeup subject, And a user interface unit that enables input of an instruction given by the makeup subject.

The recording medium storing the makeup assisting processing program using the image processing of the present invention extracts a face image of the makeup subject, analyzes the face image, and outputs information indicating the condition of the skin from the analysis result. Procedure, and based on the information indicating the condition of the skin obtained thereby, referring to the data on each cosmetic in the knowledge database in which the data on each cosmetic for a plurality of cosmetics is stored, and And a procedure for generating and outputting advice contents regarding makeup.

In each of these inventions, the data on cosmetics stored in the knowledge database includes the product name, efficacy, adaptability, and method of use of each cosmetic.

Further, as data used when outputting makeup-related advice to the makeup subject, in addition to the information indicating the condition of the skin obtained by analyzing the face image, the age, gender, and allergy of the makeup subject. At least one of a plurality of elements such as personal data such as presence / absence, weather data such as temperature and humidity, date and time data, and data indicating illuminance at a place where makeup is performed is used.

The information indicating the condition of the skin obtained by analyzing the face image is at least one of data indicating the skin color of the face and data indicating the smoothness of the skin.

Further, the advice on makeup output to the makeup subject is information indicating which makeup product is best used by the makeup subject, and also includes a method of using the makeup. Presentable.

[0020] If a cosmetics possession list of cosmetics owned by the makeup subject is provided, and the cosmetics optimized for the makeup subject are not in the cosmetics list, the makeup is determined to be optimal for the makeup makeup. Cosmetics that are similar to cosmetics.

Further, data on cosmetics and data such as weather data stored in the knowledge database can be obtained via a network, and further, cosmetics desired by the makeup subject can be purchased via the network.

In the dressing table of the present invention, the camera for capturing the face image of the makeup subject is installed on the back side of the mirror provided on the dressing table, and the mirror provided on the dressing table is attached to the mirror. A magic mirror part is provided in a part, and the camera captures a frontal face image of the makeup person through the magic mirror part when the makeup person is positioned to face the mirror. .

Further, when the mirror provided on the dressing table is a three-sided mirror, a camera is installed on each of the mirrors provided on the left and right sides, and images from the respective cameras are combined to make up the makeup subject. To obtain a frontal face image.

When the mirror provided on the dressing table is a three-sided mirror, a camera is installed on each of the left and right mirrors, and a camera is also installed on the front mirror. A camera provided in each mirror may be used for capturing an image of a specific part of the face.

As described above, according to the present invention, a face image of a makeup subject is captured, the face image is analyzed, information indicating the condition of the skin is obtained from the analysis result, and based on the information indicating the condition of the skin, With reference to the data on each cosmetic in the knowledge database, the contents of the advice regarding the makeup are generated and output to the makeup subject. by this,
Even if the makeup person does not have specialized knowledge about makeup,
Appropriate makeup can be performed according to the skin condition at that time.

By the way, the data on cosmetics stored in the knowledge database includes a cosmetic name,
Efficacy, adaptability and how to use it. Specifically, information about the age of the cosmetic product, information about the color,
The information includes information on whether the skin is effective for rough skin, information on how to treat allergies, and information on how to use the skin effectively.

Since the makeup subject is presented with specific advice on makeup by referring to the knowledge database in which such information is stored, the makeup subject does not have specialized knowledge. Even so, it is possible to perform appropriate makeup according to the occasion. The information indicating the skin condition obtained from the analysis result of the analysis of the face image is at least one of data indicating the skin color of the face and data indicating the smoothness of the skin. Therefore, it is possible to determine what kind of makeup should be performed based on the condition, so that the most suitable makeup can be performed according to the skin condition at that time.

Further, in addition to the information indicating the condition of the skin obtained by analyzing the face image, personal data such as the age, sex, presence or absence of allergies, weather data such as temperature and humidity, date and time, etc. Multiple factors, such as time data and data indicating the illuminance of the place where makeup is to be performed, are used to determine what kind of makeup should be done, so more detailed advice suitable for the makeup person It can be performed.

The content of advice on makeup output to the makeup subject is information (name of the makeup product) indicating which makeup product is best used by the makeup subject. Since the method of using the cosmetics can be presented, the advice content is specific and easy to understand for the makeup recipient, and can be easily understood without any specialized knowledge.

In addition to the knowledge database, there is a cosmetics possession list of cosmetics owned by the make-up person, and if the cosmetics optimized for the make-up person are not in the cosmetics possession list, The cosmetics similar to the cosmetics optimized for the makeup subject are presented. It is originally desirable that the cosmetics stored in the knowledge database match the cosmetics held by the makeup subject, but ordinary users do not have a large number of cosmetics. To address this,
When the cosmetics advised by the system are not owned by the makeup subject, cosmetics similar to the cosmetics are presented. As a result, it is possible to use the most suitable one among the cosmetics currently owned.

Further, the data on the cosmetics and the weather data stored in the knowledge database can be obtained via a network, and the cosmetics required by the makeup subject can be purchased via the network. This can be easily realized by connecting the system of the present invention to a network such as the Internet. In particular, in the case of data on cosmetics, when a new product is released, the latest data can always be obtained. In addition, it is not necessary to provide a measurement unit on the system side for weather data and the like.

Further, the dressing table of the present invention comprises the above-mentioned knowledge database, a camera for capturing a face image of the makeup subject, an image processing unit for performing image processing, and makeup support information for generating makeup-related advice for the makeup subject. An output unit and a component such as an information display unit (user interface unit) for presenting information output from the makeup support information output unit to the user are integrated and incorporated, and its external configuration and size Since there is no significant difference from ordinary dressing tables used at home, installation places are not limited, and there is no need to specially prepare an environment for use.

In such a dressing table, a camera for capturing a face image of the makeup subject is installed behind a mirror provided on the dressing table, and the mirror provided on the dressing table is one of them. A magic mirror section is provided in the section, and when the makeup subject is positioned to face the mirror, the camera captures the front face image of the makeup subject through the magic mirror section. In addition, the makeup recipient can go to the dressing table without being conscious of the camera. Also,
Since the camera can take in the face image of the makeup subject without performing the position adjustment each time, it is not necessary to make the makeup subject perform an extra operation in use.

In addition, the mirror provided on the dressing table may be a three-sided mirror. In this case, cameras are installed on two mirrors provided on both the left and right sides of which the opening angle can be adjusted. Can be combined to obtain a frontal face image of the subject. In this way, when cameras are installed in both the left and right mirrors, it is possible to make a small hole in the mirror for camera shooting and capture images through the holes (the left and right mirrors are the same as the front mirror). Is unlikely to be noticeable, so it would not matter if you make a hole.) This method can be less expensive than the method using a magic mirror. In this case, it is also possible to provide a camera on the front mirror. In this case, it is not preferable to make a hole in the front mirror. It is desirable to take in.

As described above, the left and right mirrors are provided with cameras, and the front mirrors are also provided with cameras, so that the front camera captures the front face image of the subject. Can also be used exclusively for capturing specific parts of Shikano such as cheeks and nose, so that it is possible to obtain enlarged images of specific parts,
More detailed advice content can be generated.

[0036]

Embodiments of the present invention will be described below. The contents described in this embodiment are as follows.
This is a description of a makeup support method and a makeup table using the image processing of the present invention, and a specific processing procedure of the makeup support processing program on a recording medium that stores the makeup support processing program using the image processing of the present invention. Is also included.

FIG. 1 is a diagram showing the configuration of the present invention. The configuration can be roughly divided so that a face image of a subject 2 sitting in front of a mirror 11 provided on a dressing table 1 can be captured. The camera 3 installed on the back of the mirror 11 and a face image taken out of the image captured by the camera 3 are analyzed, and the face image is analyzed. Image processing unit 4 that outputs information indicating the condition of the face (skin information) obtained from the image processing unit 4 (referred to as face information), and what kind of makeup should be performed. A makeup support information generation unit 5 that generates advice contents (for example, contents such as what kind of cosmetics should be used) and the advice contents generated by the makeup support information generation unit 5 are presented to the makeup subject. With the make-up It has a configuration having a user interface unit 6 to enable the input of such data relating to their personal data and cosmetics which you own.

These configurations will be described in more detail. In this embodiment, the camera 3 is provided on the back surface of the dressing table 1. This is because a part of the mirror 11 provided on the dressing table 1 is a magic mirror (when viewed from one surface, the other surface is transparent. Mirror that looks like it and reflects from the other side) 12
It can be realized by:

The mounting position (such as the height) of the camera 3 can be set arbitrarily. However, it is possible to set the camera 3 at a predetermined position in advance and not to set the height or the like each time. desirable. This is because, when the makeup subject 2 sits on the provided exclusive chair 12 and faces the mirror 11, it is considered that the position of the face of the makeup subject 2 does not greatly differ from person to person.

Therefore, if the angle of view of the camera 3 is made slightly larger, the position of the camera 3 is not set each time except in special cases. Of course, it is possible to arbitrarily set the height of the chair 12 or the like according to each user. In addition, the camera 3 is installed so that the makeup person 2 is not conscious of it as much as possible.

The image processing unit 4 extracts a face image of the subject 2 from the image captured by the camera 3. The face image extracting unit 41 analyzes the face image. And a smoothness extracting unit 43 for extracting the smoothness of the skin as information indicating the condition of the facial skin.

The image processing performed by the image processing section 41 can be realized by using a method generally used conventionally, instead of a special processing. For example, as a method of extracting a face portion from a captured image, since a face has many skin color components, the extraction of the skin color component enables relatively easy and reliable extraction regardless of the background. This technique is described, for example, in "Extraction of Facial Region and Facial Parts by Estimating Skin Color in Moving Region. Hitoshi Hongo, Kazuhiko Yamamoto, Journal of the Institute of Image Information and Television Engineers, Vol. 52, No. 12, pp. 1840-1847 (1998) "
It is described in. In addition, by using this technique, facial parts such as lips, eyes, nose, and cheeks can be extracted.

In this manner, a face image is extracted from the image, and information indicating the skin color and information indicating the smoothness of the skin are extracted. It should be noted that the smoothness of the skin can be used as an index indicating the condition of rough skin, and this is achieved by picking up (strongly enlarging) a part of the cheek or the like (the cheek is estimated from the position of the face part. Can be estimated by examining the density histogram of that part. For example, the determination can be made based on a small density difference in a smooth state, and a large density difference in a rough state.
In order to express these quantitatively, entropy and power spectrum may be taken.

Since the skin color and the smoothness of the skin obtained in this way differ depending on the physical condition at that time, they are also important factors when applying makeup.

The makeup support information generating unit 5 includes a knowledge database 51 in which data on various types of cosmetics (effects, adaptability, usage methods, and the like for each cosmetic) are stored in a database. The cosmetics possession list 52 in which information on what kind of cosmetics are stored, the above-mentioned skin color information, information indicating skin smoothness, weather data such as temperature and humidity, and furthermore, Based on personal data (such as age, gender, allergic information, etc.) that you have entered, you can determine which cosmetics are best for you.
Based on the determination result, referring to the contents of the knowledge database 51 and the cosmetics possession list 52, the optimal cosmetics information output unit 53 that outputs information indicating which cosmetic is optimal for the makeup subject 2 is provided. Have.

The information output from the optimum cosmetic information output section 53 is output to the user interface section 6.
The user interface unit 6 includes an information display unit and a keyboard and a barcode reading unit as a data input unit (the information display unit, the keyboard, the barcode reading unit, and the like are not shown). Is displayed on the information display unit, and the makeup subject 2 performs makeup with reference to the display content. In addition, it is possible to input information indicating what kind of cosmetics the makeup subject 2 has to the above-mentioned cosmetics possession list 52 from an operation panel such as a keyboard. A barcode or the like can be input by the barcode reading unit.

By the way, among the constituent elements described so far, the user interface unit 6 is installed in a place where the makeup subject 2 of the dressing table 1 is easy to see and operate. It is built into the housing part. Therefore, this dressing table 1 is not much different from the ordinary dressing table used at home in the appearance configuration, size and the like. Therefore, there is no need to limit the installation place or specially prepare the use environment, and the device can be used normally in ordinary households.

Next, a specific operation of such a configuration will be described with reference to the flowchart of FIG. First, the subject 2 sits on the chair 13 so as to face the mirror 11 of the dressing table 1.

When the subject 2 sits on the chair 13, the camera 3 operates automatically or by manual operation of the subject 2 to start capturing an image, and performs an image capturing operation until the image can be captured reliably (step). s1, s2). In this image capture, a face image is extracted from the image including the background captured by the camera 3 by the above-described technique, and further, facial components such as eyes, nose, and lips are extracted.

Next, the skin color and the smoothness of the skin are examined from the extracted face image (step s3). Subsequently, the temperature and humidity as weather data at that time, and further, the makeup of the subject 2 Acquire personal data (step s4).
Based on the obtained data such as skin color, skin smoothness, temperature, humidity, and the like, and further based on personal data (age, gender, presence / absence of allergies, etc.) inputted by the subject 2, the knowledge is obtained. Matching with various data for each cosmetic stored in the database 51 is performed (step s5).

FIG. 3 shows an example of cosmetic data stored in the knowledge database 51. As cosmetics, there are various kinds of cosmetics such as lotion, milky lotion, foundation, and lipstick. Cosmetics A,
Cosmetics B, cosmetics C, cosmetics D,... Then, for each of these cosmetics, data for various items such as the adaptation age, the color, the possibility of rough skin, the availability of allergy, and the like of the cosmetic are written. Here, W and B indicating the color indicate the color depth, and the combination of W and B indicates the color of the cosmetic.

The data (skin color, skin smoothness) indicating the skin condition of the subject 2 obtained from the contents of the knowledge database 51 and the face image, weather data such as temperature and humidity, and furthermore, Then, matching is performed based on age, gender, presence / absence of allergies, and the like as personal data of the makeup recipient 2, and a score for the matching result is calculated to select the cosmetic having the highest score (step s).
6). Although there are various ways to take this matching, it is possible to take measures such as weighting each item and increasing the weight for a specific item.

Then, it is checked whether or not the presented cosmetic is present in the cosmetics possession list 52 for the subject 2 (step s7). If the corresponding cosmetics is present in the cosmetics possession list 52, the cosmetic is deleted. It is presented (step s8). On the other hand, if the corresponding cosmetic does not exist in the cosmetics possession list 52, some cosmetics with high scores by matching are presented as candidates as similar cosmetics (step s9).

When presenting a cosmetic product suitable for the makeup subject, it is possible to display not only the name of the cosmetic product but also the reason and usage method. For example, when it is determined that there is rough skin, the user is informed of the degree of rough skin, the specific situation such as which cosmetic is suitable for the user, and information such as which cosmetic is suitable for the skin. Can be presented as advice if it is effective. The method of using such cosmetics can be obtained from data described in each cosmetic.

As described above, since the face image of the subject 2 is captured by the camera 3 on the back surface of the mirror 11, the subject 2 sits in front of the dressing table 1 and faces the mirror 11. A face image can be captured simply by doing so. Then, the skin color and the degree of roughness are determined from the captured face image, and the most suitable cosmetic is determined based on the temperature and humidity at that time, as well as personal data such as the age, gender, presence or absence of allergy, etc. of the subject 2. It is determined whether or not the makeup subject 2 is considered to be the most suitable and the method of using the makeup.

Thus, the makeup subject 2 can make up with reference to the presented contents, and the makeup subject has to worry about what kind of cosmetics should be used and how to use it at each time. You can do makeup without having.

In the above description, an example in which an optimum cosmetic is determined by referring to skin color, skin smoothness and personal data obtained from a face image, as well as weather data such as temperature and humidity. did. This weather data
It can be used as a factor to recommend more appropriate cosmetics, such as recommending cosmetics that provide moisture when dry or recommending cosmetics with a soft texture when temperature is high and humid. . Further, in addition to the weather data, it is also possible to consider the current season from the current date information and the current time information. For example, the types of cosmetics to be applied differ between the cold winter season and the hot summer season, and UV protection is also required during the day during the day. It is also possible to choose.

Further, the illuminance in the room where the dressing table 1 is installed is measured, and the gain and gamma of the camera 3 are adjusted according to the illuminance. This is because the image captured in the dark is
This is because color determination is difficult and there is a possibility that an appropriate face image may not be extracted, and even if a face image is extracted, the skin color or the smoothness of the skin may not be properly extracted. Therefore, when the illuminance is measured and the illuminance exceeds the illuminance range in which the camera 3 can normally perform the color determination, it is possible to take measures such as not performing the color determination or performing a process of performing correction.

These temperature, humidity, illuminance, etc.
Each information can be acquired by attaching each sensor to.

The above-mentioned weather data and data on cosmetics can also be obtained from a network such as the Internet. Since the information sources and display formats of these pieces of information are substantially determined, necessary information can be obtained by designating a predetermined URL on the system. For example, in the case of weather data, data such as weather, temperature, and humidity that change every moment is acquired from a site that provides weather data.

Data on cosmetics is basically obtained from the homepage of a cosmetics manufacturer. For example, a cosmetic maker puts basic data of cosmetics in the format described above (see FIG. 3) on a homepage, and periodically downloads and updates the data. In this way, the latest information can be obtained at all times, such as when a new product is released, and information on a discontinued product can be automatically obtained. Need not be set in the knowledge base 51.

Further, it is possible to place an order for cosmetics by using the Internet. For example, according to the present invention, the use of the lotion A is recommended, but when the lotion has just ended, it is possible to place an order for the cosmetics on the homepage of the cosmetics maker from the system of the mirror stand. Become. At this time, since the system contains a product number for each cosmetic, the user can place an order simply by specifying the product number of the desired cosmetic.

FIG. 4 shows a configuration in which a function of acquiring weather data and cosmetics data from a cosmetics manufacturer using the Internet is added to the configuration shown in FIG. In addition, a web connection unit 7 and an information extraction unit 8 are provided, and the weather data obtained from the Internet
b The information is input to and extracted from the information extraction unit 8 via the connection unit 7, and then input to the optimum cosmetics information output unit 53.
Each piece of cosmetics data obtained from the Internet is input to and extracted from the information extracting unit 8 via the web connecting unit 7, and then is input to the knowledge database 51. Similarly, data on cosmetics purchased through the Internet is input to and extracted from the information extraction unit 8 via the web connection unit 7, and then is input to the cosmetics possession list 52. Since other configurations are the same as those in FIG. 1, the same portions are denoted by the same reference numerals.

In the above description, the mirror 11 of the dressing table 1
Is a single-sided mirror, but may be a three-sided mirror. In the case of three-sided teaching, cameras are mounted on the back side of each of the left and right mirrors whose opening angle is adjustable, and images obtained from each camera are synthesized by image synthesis.
It is also possible to obtain a face image. In this case, holes for camera photography may be formed in the left and right mirrors without using the magic mirror. This is because it is considered that the mirror is not so much annoying even if a hole is made in the mirror because it is not a front mirror. Thus, it can be manufactured at a lower cost than a magic mirror.

When combining images, the positions of the left and right mirror surfaces are calculated from the opening angle of the hinge. Further, a camera is installed on the rear side of the mirror surface in front of the three-sided mirror similarly to FIG.
It is also possible to use a combination of two cameras. In this case, the front camera captures an image of the entire face, and the cameras provided on the left and right mirrors can be said to be dedicated to specific applications such as detecting the smoothness of the skin.

In the case where one dressing table 1 is shared by a plurality of persons, personal data is registered for each person who uses the table, and when individual persons receive advice at the mirror stand,
You can also use it by switching settings.

Although the present invention has been mainly developed to be installed in a home or the like for general individual users, it goes without saying that the present invention can also be installed in a beauty salon or the like.

The makeup support processing program for performing the processing of the present invention described above can be recorded on a recording medium such as a floppy disk, an optical disk, or a hard disk, and the present invention includes the recording medium. Further, the processing program may be obtained from a network.

[0069]

As described above, according to the present invention, a face image of a makeup subject is captured and analyzed, and based on the information indicating the condition of the skin obtained by the analysis, a knowledge database is created. Data on each cosmetic (such as product name, age indication, color information, information on whether it is effective for rough skin, information on how to treat allergies, and information on how to use it effectively) With reference to the makeup subject, advice regarding makeup is output. As a result, the makeup person can perform appropriate makeup according to the occasion without having specialized knowledge about makeup.

The information indicating the condition of the skin obtained by analyzing the face image includes data indicating the color of the skin of the face and the smoothness of the skin. Based on the data indicating the condition of the skin,
Because the makeup user is presented with the best cosmetics to use, and the method of using the cosmetics is also presented, the advice is very specific for the makeup person. The contents are easy to understand, and can be easily understood without specialized knowledge.

Further, in addition to the information indicating the condition of the skin obtained by analyzing the face image, personal data such as the age, gender, presence or absence of allergy, weather data such as temperature and humidity, date and time, etc. At least one element of the time data and the data indicating the illuminance of the place where the makeup is performed is used to determine what makeup should be performed, so that the personal characteristics, the season, the temperature, and the air at that time are determined. Considering how dry it is, you can give me detailed advice.

Further, the data on the cosmetics and the weather data stored in the knowledge database can be obtained via a network, and the cosmetics required by the makeup subject can be purchased via the network. This can be easily realized by connecting the system of the present invention to a network such as the Internet. In particular, in the case of data relating to cosmetics, it is possible to always obtain the latest data even when a new product is released. Can, and
There is no need to provide measurement means on the system side for weather data and the like.

Further, according to the present invention, a knowledge database, a camera for capturing a face image of the make-up person, a make-up support information output section for outputting make-up advice to the make-up person, and information output from this make-up support information output section It is a dressing table that integrally incorporates components such as an information display unit that presents to the user.
There is no significant difference from ordinary dressing tables used at home, and there is no need to limit the installation location or specially prepare the use environment. Therefore, it can be used normally in ordinary households.

The camera for taking in the face image of the makeup subject is installed behind a mirror provided on the dressing table, and when the makeup subject is positioned to face the mirror, Since the camera captures the frontal face image of the makeup subject through the magic mirror portion, the makeup subject can go to the dressing table without being conscious of the camera. In addition, since the camera can capture the face image of the makeup subject without performing the position adjustment each time, it is not necessary to make the makeup subject perform extra operations when using the camera.

[Brief description of the drawings]

FIG. 1 is a configuration diagram illustrating an embodiment of a dressing table according to the present invention.

FIG. 2 is a flowchart illustrating a processing procedure according to the embodiment of the present invention.

FIG. 3 is a diagram showing an example of the contents of a knowledge database in which data on cosmetics is stored.

FIG. 4 is a configuration diagram in a case where a function of acquiring weather data and cosmetics data from a cosmetics manufacturer using the Internet is added to the configuration shown in FIG. 1;

[Explanation of symbols]

 REFERENCE SIGNS LIST 1 dressing table 2 makeup person 3 camera 4 image processing unit 5 makeup support information generation unit 6 user interface unit 7 web connection unit 8 information extraction unit 11 mirror 12 chair 51 knowledge database 52 cosmetics ownership list 53 optimal cosmetics information output unit

Claims (23)

[Claims] 1. A data base for a plurality of cosmetics, in which data on each cosmetic is stored as a knowledge database, a face image of the makeup subject is taken out, the face image is analyzed, and information indicating the condition of the skin is obtained from the analysis result. Using image processing characterized in that, based on information indicating the condition of the skin, data on each cosmetic in the knowledge database is referred to, and the content of advice on makeup is generated and output to the makeup subject. Makeup support method. 2. The image processing apparatus according to claim 1, wherein the data on the cosmetics stored in the knowledge database includes a product name, an effect, an adaptability, and a use method of each cosmetic. Makeup support method using 3. The data used when outputting advice regarding makeup to the makeup subject, in addition to information indicating a skin condition obtained by analyzing a face image, the age, sex, and the like of the makeup subject. At least one of a plurality of elements such as personal data such as presence or absence of allergies, weather data such as temperature and humidity, date and time data, and data indicating illuminance of a place where makeup is performed is used. Item 3. A makeup support method using the image processing according to item 1 or 2. 4. The information indicating a skin condition obtained by analyzing the face image is at least one of data indicating a skin color of the face and data indicating a smoothness of the skin. A makeup support method using the image processing according to any one of claims 1 to 3. 5. The advice regarding makeup output to the makeup subject is information indicating which makeup product is best used by the makeup subject, and the method of using the makeup is described together with the makeup advice. The makeup support method using the image processing according to any one of claims 1 to 4, wherein the makeup support method is also capable of presenting. 6. A cosmetics possession list of cosmetics owned by the make-up person, and when the cosmetics optimized for the make-up person are not in the cosmetics list, the cosmetics are made optimal for the make-up person. 6. A makeup assisting method using image processing according to claim 5, wherein a makeup similar to the makeup is presented. 7. Data such as data on cosmetics and weather data stored in the knowledge database can be obtained via a network, and further, cosmetics desired by the makeup subject can be purchased via the network. A makeup support method using image processing according to any one of claims 1 to 6. 8. A knowledge database that stores data on each of a plurality of cosmetics, a camera that captures a face image of the subject, a face image extracted from an image captured by the camera, and the face is extracted. An image processing unit that analyzes the image and outputs information indicating the condition of the skin from the analysis result; and, based on the information indicating the condition of the skin output from the image processing unit, refers to data on each cosmetic in the knowledge database. A makeup support information generation unit that generates advice content regarding makeup for the makeup subject; and presents the advice content generated by the makeup support information generation unit to the makeup subject, and outputs an instruction given by the makeup makeup subject. A dressing table, comprising: a user interface unit that enables input. 9. A camera for capturing the face image of the makeup subject is installed behind a mirror provided on the dressing table, and the mirror provided on the dressing table has a magic mirror part as a part thereof. The camera according to claim 8, wherein the camera captures a frontal face image of the subject through a magic mirror section when the subject is positioned to face the mirror. Dressing table. 10. When the mirror provided on the dressing table is a three-sided mirror, a camera is installed on each of the left and right mirrors, and images from the respective cameras are combined to make up the subject. 9. The dressing table according to claim 8, wherein a frontal face image is obtained. 11. When the mirror provided on the dressing table is a three-sided mirror, a camera is installed on each of the left and right mirrors, and a camera is also installed on the front mirror.
9. The dressing table according to claim 8, wherein the cameras provided on the left and right mirrors are used for capturing an image of a specific part of the face. 12. The data relating to cosmetics stored in the knowledge database includes the product name, efficacy, adaptability, and method of use of each cosmetic, and the like. The dressing table according to claim 1. 13. In addition to information indicating the condition of the skin obtained by analyzing the face image, the age, sex, At least one of a plurality of elements such as personal data such as presence or absence of allergies, weather data such as temperature and humidity, date and time data, and data indicating illuminance of a place where makeup is performed is used. Item 8
13. The dressing table according to any one of items 1 to 12. 14. The information indicating a skin condition obtained by analyzing the face image is at least one of data indicating a skin color of the face and data indicating a smoothness of the skin. Item 14. The dressing table according to any one of Items 8 to 13. 15. The advice regarding makeup output to the makeup subject is information indicating which makeup product is best used by the makeup subject, and the method of using the makeup is also described. The dressing table according to any one of claims 8 to 14, wherein the dressing table can also be presented. 16. A cosmetics possession list of cosmetics owned by a make-up person is provided, and when a cosmetics made optimal for the make-up person is not in the cosmetics list, the cosmetics are made optimal for the make-up person. 16. A dressing table according to claim 15, wherein a cosmetic product similar to said cosmetic product is presented. 17. Data such as data on cosmetics and weather data accumulated in the knowledge database can be obtained via a network, and further, cosmetics desired by the makeup subject can be purchased via the network. A dressing table according to any one of claims 8 to 16, characterized in that: 18. A recording medium on which a makeup support processing program using image processing is recorded, wherein the makeup support processing program retrieves a face image of a make-up person, analyzes the face image, and obtains a skin image from the analysis result. A procedure for outputting information indicating the situation, and based on the information indicating the condition of the skin obtained thereby, referring to data on each cosmetic in a knowledge database in which data on each cosmetic is accumulated for a plurality of cosmetics, A recording medium storing a makeup support processing program using image processing, comprising: generating and outputting a content of advice regarding makeup to the makeup subject; 19. The image processing apparatus according to claim 18, wherein the data on the cosmetics stored in the knowledge database includes a product name, an effect, an adaptability, and a use method of each cosmetic. A recording medium on which a makeup support processing program using a computer is recorded. 20. In addition to information indicating the condition of the skin obtained by analyzing a face image, the age, gender, At least one of a plurality of elements such as personal data such as presence or absence of allergies, weather data such as temperature and humidity, date and time data, and data indicating illuminance of a place where makeup is performed is used. Item 1
A recording medium on which a makeup support processing program using the image processing according to 8 or 19 is recorded. 21. The information indicating the condition of the skin obtained by analyzing the face image is at least one of data indicating the skin color of the face and data indicating the smoothness of the skin. A recording medium on which a makeup support processing program using the image processing according to claim 18 is recorded. 22. The makeup-related advice output to the makeup subject is information indicating which makeup product is best used by the makeup subject, and the method of using the makeup product is also described. 22. A recording medium on which a makeup support processing program using image processing according to claim 18 is recorded. 23. Separately from the knowledge database, there is a cosmetics list of cosmetics held by the make-up person, and if the cosmetics output to the make-up person are not in the cosmetics list, 23. A recording medium storing a makeup support processing program using image processing according to claim 22, wherein the makeup cosmetics similar to the cosmetics output to the user are presented.