KR20030091419A - Makeup Simulation System Based On Facial Affection Type - Google Patents

Abstract

PURPOSE: A system for simulating makeup based on a face sensitivity style is provided to offer the makeup information most suitable to the face sensitivity style and the information related to the desired makeup of a customer by managing the face sensitivity style, the makeup information, and the product information in a database. CONSTITUTION: An input device(11) receives the customer information and various simulation control signal. A face camera(12) pictures a face image of the customer on a standard environment. A face style analysis/textures forming part(13) generates a 3-dimensional face model of the customer, analyzes the face style of the customer based on the face sensitivity style by using a coordinates value of face characteristic points, and forms a basic makeup texture by fixing a makeup area and using a color makeup program. A makeup processor(14) offers the makeup information and the product information to the customer after deciding the makeup texture desired by the customer. An output device(15) outputs the 3D face model, the makeup information, and the product information. A simulation information storing part(16) stores various information in the databases.

Description

Makeup Simulation System Based On Facial Affection Type

The present invention relates to a makeup simulation, and in particular, based on a facial emotion type to provide the best makeup-related information to each customer according to the facial emotion type that establishes a relationship between the emotions of the face and the physical values of the face. It is about a makeup simulation system.

In general, makeup is applied to the face according to the individual's experience or perception, and when applying makeup to others, it is necessary to consider the unique characteristics of each face that is the subject of makeup and to meet the needs of each individual. Applying it requires a lot of experience and a special sense, so you will get expert help.

Modern people want to form the image they want by applying makeup to each person's face. For this purpose, the modeling theory that recognizes what image is desired is applied to makeup, but each person's face has its own characteristics. On the other hand, modeling theory can only be applied when it is based on one characteristic, resulting in the application of unbalanced makeup to each face.

On the other hand, makeup cosmetics such as foundation, powder, eyebrow, eye shadow, lipstick, ball touch, eyeliner, mascara, etc. are often used to form an image in the style desired by each individual while concealing the defects of the face and taking advantage of the benefits. Has been.

However, it was difficult to find a make-up suitable for one's face type according to a uniform fashion and a uniform product selection, and did not fit a face type according to a uniform fashion without knowing one's face type and make-up suitable for oneself. It was often awkward makeup.

Therefore, the users of makeup cosmetics have a strong desire to find out their face types and to find the right makeup for their face types, and the makeup cosmetics manufacturers have tried to systematically classify various face types. The classification of skin conditions such as dryness, oily, and complex, or simple classification by facial color, or a few simple figures on the face, is a collection of similar groups.

Recently, a makeup method using a computer has been introduced. Even though makeup is applied using a product having the same color, the makeup is made due to various complicated conditions such as shadows and reflections caused by ambient lighting and the shape characteristics of each individual face. It is almost impossible to adequately express, and it does not show an effect naturally applied to the face image.

Also, the first time we see a person's face, we get different feelings about that person, which are almost instantaneous and sometimes simply do not end up in one's own feelings about the person's facial appearance, It can even be used to define personality traits. In other words, having a feeling for people's first-looking faces can cause each facial feature to cause some mental state in their minds. It is also related to the physical details of the face and can be expressed in the form desired by makeup.

However, in the related art, only the face types classified based on the skin condition or the color of the face or some simple figures of the face are reflected in the makeup decision, and the emotional elements that people actually feel about the face are not reflected in the makeup decision at all.

SUMMARY OF THE INVENTION The present invention has been made to solve the above-mentioned problems, and an object thereof is to classify and classify the relationship between the emotions felt for the face and the physical values of the face, and make-up information and product information suitable for the facial emotion type. By managing the database as a database, it is possible to provide information related to makeup that is most suitable for an individual customer's facial emotion type or an image desired by a customer.

Another object of the present invention, by providing a make-up-related information according to the type of facial emotion of the individual customer to determine whether or not to purchase a makeup product, so that the customer's makeup simulation history information and purchased product information, etc. By managing each person and updating the purchased product information at the same time, it is possible to develop product design and production strategy based on customer demand.

1 is a block diagram schematically showing a makeup simulation system based on a facial emotion type according to the present invention.

Figure 2 is a flow chart of the operation of the makeup simulation system based on the type of facial emotion according to the present invention.

FIG. 3 is a diagram illustrating a face photographing unit in FIG. 1. FIG.

Figure 4 is a schematic block diagram showing a makeup simulation system based on the type of facial emotion when the customer is located remotely in the present invention.

Explanation of symbols on the main parts of the drawings

11, 11-1, 11-2: input device unit 12: face photographing unit

13: face type analysis / texture component 14: makeup processing unit

15, 15-1, 15-2: output device unit 16: simulation information storage unit

16-1: Facial emotion type DB 16-2: Makeup DB

16-3: Product Information DB 16-4: Customer Information DB

31: mirror 32-1, 32-2: lighting fixture

33: digital camera 41: control and communication unit

42: communication unit

Features of the present invention for solving the above object, the input device unit for receiving customer information and various simulation control signals required for makeup simulation from the customer or expert; A face photographing unit which receives and inputs a face image of a customer who wants to find a makeup suitable for his or her face emotion type in a standardized environment; The customer's three-dimensional face model is generated by matching the face image of the customer photographed by the face photographing unit with the standard shape model, and based on the face emotion type by using the coordinate values of the facial feature points obtained when matching the standard shape model. A face type analysis / texture unit configured to perform a face type analysis and to construct a basic makeup texture using a makeup area setting and a basic and tonal cosmetic program; The overall makeup simulation process is controlled according to the simulation control signal input through the input device unit, but the makeup recommendation and searching function through the emotional interface is performed using the customer face type analysis of the face type analysis / texture component and the basic makeup texture composition result. A makeup processing unit which provides the corresponding makeup information and product information to the customer when the makeup texture desired by the customer is determined after performing; An output device that outputs a face image of a customer photographed by the face photographing unit, a three-dimensional face model generated by the face type analyzing / texturing unit, and makeup information and product information under the control of the makeup processing unit. Wealth; To provide a makeup simulation service based on the facial emotion type, a makeup simulation system based on the facial emotion type includes a simulation information storage unit which stores database of facial emotion type information, makeup information, product information, and customer information. To implement.

Here, the face photographing unit is provided with a mirror so that the customer can photograph themselves while looking directly at the face, and install lighting fixtures on both sides around the mirror to provide illumination of a predetermined image brightness on the face of the customer, the mirror The central back of the installation of a digital camera is characterized in that to capture the customer's face image at a certain shooting distance and shooting angle and resolution.

The coordinate values of the facial feature points may be coordinate values obtained by matching feature points with respect to the contours of the face, eyes, eyebrows, nose, and mouth to analyze physical values of the face, which are used to determine the type of facial emotion. It is characterized by.

In addition, the makeup recommendation function finds an ideal face emotion type closest to the customer's face type from the face emotion type information of the simulation information storage unit, and automatically synthesizes a makeup texture according to the makeup information suitable for the face emotion type to the customer. The makeup search function is a function of presenting to the customer by automatically composing the corresponding makeup texture by finding the makeup information suitable for the image in the simulation information storage unit after receiving the desired image. If the customer wants, it is possible to modify the automatically synthesized makeup texture by presenting a chromaticity palette.

Furthermore, the simulation information storage unit may include: a face emotion type DB for storing a plurality of face emotion type information that establishes and classifies a relationship between a feeling to a face and physical values of a face; A makeup DB that stores makeup information such as makeup methods and recommended colors suitable for each facial emotion type by supplementing facial defects and features according to the makeup texture determined through the emotional interface; A product information DB for storing product information for performing a corresponding makeup according to the makeup information stored in the makeup DB; And a customer information DB that stores a series of customer information such as personal information, makeup simulation history information, and used product information.

On the other hand, the makeup simulation system based on the above-described face emotion type, the customer input device unit and face photographing unit and output device unit on the client side when the customer is located in a remote location, the professional input on the server side After having a device unit, an output device unit, a face type analysis / texture composition unit, a makeup processing unit, and a simulation information storage unit, a control and communication device unit is further configured on the client side, and a communication device unit is further configured on the server side through a communication network. It is characterized in that it provides a corresponding makeup simulation service to the customer by receiving the face image of the customer while interworking between the client and the server.

At this time, the control and communication unit of the client side, while interlocking with the server side through the communication network to control the face photographing unit in accordance with a control signal input from the customer through the input device unit to take the image of the customer's face, and transmits to the server side, Receive the recommendation and search makeup results and make-up information and product information output from the server side is characterized in that to output to the customer through the output device.

In addition, the communication device unit of the server side receives the customer's face image while interworking with the client side through a communication network, delivers the face image to the face type analysis / texture unit, and recommends and searches makeup results for the corresponding face emotion type of the customer. The makeup information and product information is characterized in that to output to the client.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.

Makeup simulation system based on the type of facial emotion according to the present invention, as shown in the accompanying drawings, Figure 1, the input device 11, the face photographing unit 12, the face type analysis / texture configuration unit ( 13), a makeup processing unit 14, an output device unit 15 and a simulation information storage unit 16 is provided.

The input device unit 11 allows a customer or a professional to input customer information and various simulation control signals necessary for make-up simulation. The input device unit 11 is implemented by using a keyboard, a mouse, a touch screen, a joystick, and the like. It can be implemented separately.

The face photographing unit 12 is for receiving and inputting a face image of a customer in a standardized environment (constant image brightness, shooting distance, shooting angle, resolution, etc.), and is implemented using a mirror, a lighting device, and a digital camera.

The face type analysis / texture construction unit 13 matches the face image of the customer photographed by the face photographing unit 12 with the standard shape model to generate a three-dimensional face model of the customer, and the facial feature points obtained when the standard shape model is matched. The customer's face type analysis is performed based on the facial emotion type using coordinate values, and the basic makeup texture is composed by using makeup area setting and basic and tonal cosmetic programs.

The makeup processor 14 controls the overall makeup simulation process according to the simulation control signal input through the input device unit 11, but analyzes the customer face type of the face type analysis / texture component 13 and the basic makeup texture configuration result. After performing the makeup recommendation and search function through the emotional interface, and when the makeup texture desired by the customer is determined by the makeup recommendation and search, the corresponding makeup information and product information are provided to the customer.

The output device 15 may include a face image of the customer captured by the face photographing unit 12 under the control of the makeup processing unit 14, a three-dimensional face model generated by the face type analysis / texture configuration unit 13, and In order to output makeup information and product information, it is implemented using a monitor, printer, etc. according to the output contents, and can be implemented by dividing into customer use and professional use.

The simulation information storage unit 16 is a database that stores facial emotion type information, makeup information, product information, and customer information for providing a makeup simulation service based on facial emotion types. The face emotion type DB (16-2), which stores a plurality of face emotion type information that is established by classifying the relationship between the numerical values, and the face defects and features according to the makeup texture determined through the emotion interface, are supplemented to each face emotion type. Makeup DB (16-2) that stores makeup information, such as suitable makeup methods and recommended colors, and products that store product information for performing makeup according to makeup information stored in makeup DB (16-2) Information DB (16-3), personal information by each customer, history of makeup simulation, and use Including customer information DB (16-4) for storing a set of customer information such as product information.

The operation of the makeup simulation system based on the type of facial emotion according to the present invention configured as described above will be described with reference to FIG. 2.

First, in order to provide a makeup simulation service based on facial emotion types, various facial emotion types and makeup-related information (ie, makeup information and product information) according to the facial emotion types must be stored in a database (step S21). To do this, it is necessary to establish a relationship between the emotion that most people feel about the face and the physical figures of the face, and then classify it into several types of face emotions and store them in the face emotion type DB 16-1. The makeup suitable for the type is determined and the corresponding makeup information should be stored in the makeup DB 16-2, and the product information for performing the makeup should be stored in the product information DB 16-3.

In this state, the customer who wants to find a makeup suitable for his or her face emotion type photographs his face image through the face photographing unit 12 and inputs it to the makeup simulation system (step S22). In the environment, that is, lighting is performed at a constant image brightness, a constant shooting distance, a shooting angle, and a resolution.

In this case, in order to capture the customer's face image in a standardized environment, the face photographing unit 12 is provided with a mirror 31 so that the customer can take a picture while looking directly at his face as shown in FIG. In addition, by installing the lighting fixtures (32-1, 32-2) at about 30 to 60 degrees on both sides of the mirror (31) as a center to provide illumination of a predetermined image brightness to the face of the customer. In addition, a digital camera 33 is installed on the central back of the mirror to photograph the face of the customer. When classifying the facial emotion type, the distance and the shooting angle of the facial image are fixed because the relationship between the facial sensitivity and the physical numerical value is established. It is preferable to take a photographing booth and photograph the booth, and to display a reference point (or reference line) such as an arrow in the horizontal and vertical directions of the mirror 31, so that the eyes of the face are positioned at the reference points in the horizontal and vertical directions. (Or eyebrows) and noses, respectively, by operating the 'shooting' button of the input device unit 11 to take a picture of the customer's face at a certain shooting distance and shooting angle.

Thereafter, when the face image of the customer photographed by the digital camera of the face photographing unit 12 is input to the face type analysis / texture composition unit 13, the face type analysis / texture unit 13 is input to the face of the customer. The image is matched with the standard shape model to generate a three-dimensional face model, where feature points such as contours of the face, eyes, eyebrows, nose, mouth, etc. are analyzed to analyze physical values of the face, which is a standard for determining the facial emotion type. After matching, using the coordinates of the corresponding feature points to perform a customer face type analysis that finds the face emotion type closest to the customer's face emotion type among the face emotion types stored in the face emotion type DB ( Step S23), and at the same time, basic makeup textures for the type of facial emotions of the client using makeup area setting and basic and tonal cosmetic programs. It is constructed (step S24).

Thereafter, the makeup processing unit 14 performs a makeup recommendation and search function through the emotional interface by using the customer face type analysis result and the basic makeup texture composition result processed by the face type analysis / texture configuration unit 13 ( Step S25), by providing makeup information and product information finally determined through makeup recommendation and search to the corresponding customer (step S26), the customer can use the makeup product that is most suitable for himself and the most to himself. Make sure you have the right makeup.

That is, the makeup processing unit 14 finds an ideal facial emotion type closest to the customer's face type in the facial emotion type DB according to the makeup recommendation function, and then obtains makeup information suitable for the facial emotion type from the makeup DB 16-2. By automatically synthesizing the corresponding makeup texture by searching, the output device unit (15) is an ideal makeup method that is not only most suitable for the type of customer's facial emotion but also complements the defects and features of the face as the recommended makeup result along with the face type analysis result. Will be presented to the customer.

Subsequently, after selecting a desired image (cute, urban, intelligent, natural, soft, sexy, classic, elegant, etc.) according to the makeup search function, the makeup information suitable for the image is searched in the makeup DB 16-2. By automatically synthesizing the corresponding makeup texture, the makeup method corresponding to the image desired by the customer is presented to the customer through the output device unit 15 as a makeup result. In this case, the color palette is presented to the customer to automatically synthesize the makeup method. Make partial modifications to the make-up texture.

After presenting the recommended makeup and search makeup results to the customer in this way, the makeup processing unit 14, if any one of the makeup results are selected by the customer, and the makeup DB (16-2) and product information DB (16-3) By interlocking, the makeup information and the product information corresponding to the makeup result selected above are output to the customer through the output device unit 15.

In addition, when the product information is output to the customer, it is possible to determine whether or not to purchase the product, and the makeup simulation history information and the purchased product that provided the makeup information to the corresponding customer together with the personal information in the customer information DB 16-4 It is possible to store and manage information for each individual, and at the same time to update the contents of the product information DB (16-3) can be used as a basis for the development of product design and production strategy based on customer demand.

On the other hand, according to another embodiment of the present invention, the makeup simulation system based on the above-described face emotion type, when a customer who wants to find a makeup suitable for his or her face emotion type is located at a remote location, the face image of the customer is transmitted through a communication network. The makeup simulation service can be provided to the customer by receiving the input. For this, the makeup simulation system has a structure of a client (customer side) -server (expert side) based on a communication network as shown in FIG. Comparing with the system configuration shown in Figure 1, the client side that will be used by the remote customer, the control and communication device unit 41, the server side used by the expert includes a communication device unit 42, respectively You have a configuration.

Here, the client side control and communication device unit 41 controls the face photographing unit 12 according to a control signal input from the customer through the input device unit 11-1 while interworking with the server side through the communication network. After photographing the facial image of the transfer to the server side, and receives the recommendation and search makeup results and makeup information and product information output from the server side and outputs to the customer through the output device unit (15-1).

In addition, the communication device unit 42 of the server side receives the customer's face image while interworking with the client side through a communication network and transmits the received face image to the face type analysis / texture configuration unit 13, and the corresponding emotion type of the customer's face emotion. Recommendation and search It outputs makeup results, makeup information, and product information to the client.

In addition, the operation of the makeup simulation system based on the facial emotion type having the client-server structure described above is similar to the operation of the system of FIG. 2 described above, except that the client side controls to provide the makeup simulation service to a remote customer. And the communication device unit 41 and the server-side communication device unit 42 interoperate with each other through a communication network to transmit information (customer information, control signals, makeup information, product information, etc.) input / output between a customer and an expert. Will perform more actions.

In addition, the embodiment according to the present invention is not limited to the above-described embodiments, and various alternatives, modifications, and changes can be made within the scope apparent to those skilled in the art.

As described above, the present invention provides a database of facial emotion types that establish and classify the relationship between feelings to the face and physical values of the face, and makeup information and product information suitable for the facial emotion types, thereby managing individual customers. It will be able to provide information related to the makeup that best suits the type of facial sensibility or the makeup that suits the customer's desired image.

In addition, the present invention enables to determine whether to purchase a makeup product corresponding to the case of providing makeup-related information according to the type of facial emotion of the individual customer, the customer's makeup simulation history information and purchased product information for each individual At the same time, by updating purchased product information, it can be used as a basis for developing product design and production strategies based on customer demand.

Claims (9)

An input device unit for receiving customer information necessary for makeup simulation and various simulation control signals from a customer or an expert; A face photographing unit which receives and inputs a face image of a customer who wants to find a makeup suitable for his or her face emotion type in a standardized environment; The customer's three-dimensional face model is generated by matching the face image of the customer photographed by the face photographing unit with the standard shape model, and based on the face emotion type by using the coordinate values of the facial feature points obtained when matching the standard shape model. A face type analysis / texture unit configured to perform a face type analysis and to construct a basic makeup texture using a makeup area setting and a basic and tonal cosmetic program; The overall makeup simulation process is controlled according to the simulation control signal input through the input device unit, but the makeup recommendation and searching function through the emotional interface is performed using the customer face type analysis of the face type analysis / texture component and the basic makeup texture composition result. A makeup processing unit which provides the corresponding makeup information and product information to the customer when the makeup texture desired by the customer is determined after performing; An output device that outputs a face image of a customer photographed by the face photographing unit, a three-dimensional face model generated by the face type analyzing / texturing unit, and makeup information and product information under the control of the makeup processing unit. Wealth; Face emotion type based on the facial emotion type, characterized in that it comprises a simulation information storage for storing a database of facial emotion type information, makeup information, product information, customer information to provide a makeup simulation service based on the facial emotion type Makeup simulation system. The method of claim 1, The face photographing unit includes a mirror to allow the customer to photograph themselves while looking directly at the face, and installs lighting fixtures on both sides of the mirror to provide illumination of a predetermined image brightness to the face of the customer, Make-up simulation system based on the type of facial emotion, characterized in that by installing a digital camera on the back to capture the customer's face image at a certain shooting distance, shooting angle and resolution. The method of claim 1, The coordinate values of the facial feature points are coordinate values obtained by matching the feature points with respect to the contours of the face, eyes, eyebrows, nose, and mouth to analyze physical values of the face as a reference for determining the type of facial emotion. Makeup simulation system based on the type of facial emotion. The method of claim 1, The makeup recommendation function finds an ideal face emotion type closest to the customer's face type from the face emotion type information of the simulation information storage unit and automatically synthesizes a makeup texture based on the makeup information suitable for the face emotion type and presents it to the customer. Makeup simulation system based on the facial emotion type, characterized in that the ability to. The method of claim 1, The makeup search function is a function of finding the makeup information suitable for the image in the simulation information storage unit after receiving the image selected by the customer and automatically synthesizing the corresponding makeup texture and presenting it to the customer. Makeup simulation system based on facial sensibility, characterized by presenting a palette to modify the automatically synthesized makeup texture. The method of claim 1, The simulation information storage unit may include: a face emotion type DB configured to store a plurality of face emotion type information obtained by establishing and classifying a relationship between a feeling to a face and physical values of a face; A makeup DB that stores makeup information such as makeup methods and recommended colors suitable for each facial emotion type by supplementing facial defects and features according to the makeup texture determined through the emotional interface; A product information DB for storing product information for performing a corresponding makeup according to the makeup information stored in the makeup DB; A makeup simulation system based on facial emotion types, comprising a customer information DB that stores a series of customer information such as personal information, makeup simulation history information, and product information. The method of claim 1, When the customer is located in a remote location, the client input device, face photographing unit and output device unit are provided on the client side, and the professional input device unit and output device unit and face type analysis / texture composition unit and makeup processing unit on the server side. After the simulation information storage unit, the control and the communication device unit on the client side, and the communication unit further configured on the server side by interlocking between the client and the server via the communication network while receiving the face image of the customer corresponding to the makeup simulation Makeup simulation system based on facial sensibility, characterized by providing services to customers. The method of claim 7, wherein The control and communication device unit on the client side controls the face photographing unit according to a control signal input from the customer through the input device unit while interworking with the server side through a communication network, photographs the face image of the customer, and transmits it to the server side. Makeup simulation system based on the type of facial emotion characterized in that it receives the recommendation and search makeup results and make-up information and product information output from the side to output to the customer through the output device unit. The method of claim 7, wherein The communication device unit of the server side receives the customer's face image while interworking with the client side through a communication network and transmits the received face image to the face type analysis / texture component, and recommends and searches for the corresponding facial emotion type of the client. And a make-up simulation system based on facial emotion types, which outputs product information to the client.