KR101959253B1 - Apparatus and Method for makeup simulation reflecting real behavior patterns of makeup - Google Patents

Abstract

The present invention relates to an apparatus and method for making a makeup simulation that reflects an actual makeup behavior pattern, comprising: acquiring a first image including a face; receiving a first command for selecting a makeup region; And displaying an image obtained by applying a gradation effect according to the second instruction to the makeup area selected by the first one of the faces.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a makeup simulation apparatus and a makeup simulation method,

The present invention relates to a virtual makeup simulation apparatus and method, and more particularly, to an apparatus and method for makeup simulation that reflects people's actual makeup behavior patterns.

The present invention is directed to a makeup simulation apparatus and method that provides natural virtual makeup simulations by implementing various behavioral styles of makeup, such as effects or gradient effects resulting from multiple color selection and use.

Recently, interest in cosmetics and make-up methods of people is increasing. A wide variety of cosmetics are on the market, and cosmetics with similar functions are available in a wide variety.

People choose cosmetics and makeup methods depending on whether their skin is oily, neutral, or dry, and use different cosmetics depending on whether they have a lot of trouble, sebum or skin color.

People also change their cosmetics and makeup methods depending on their age, trends, and places of outing.

However, since so many different cosmetics are sold, new products come out every day and new make-up methods are presented, it is difficult for people to obtain information about products that are suitable for them.

People try to make make-up on their own face by going through many trial and error in order to know the make-up method suitable for them. However, such a method causes too much time and expense, and causes skin troubles.

Thus, there is a need for a method or apparatus that allows people to more easily understand the makeup method they want and the cosmetic used for makeup.

In recent years, there have been devices that can make makeup virtually on their own photographs. However, there is an unnatural problem that unlike actual makeup, the way a color is picked up in a photo is selected.

SUMMARY OF THE INVENTION It is an object of the present invention to provide a virtual make-up method and apparatus for providing a variety of behaviors of actual makeup, such as applying a cosmetic product of a plurality of colors, or giving a gradation effect

A virtual makeup simulation method for achieving the above object is a method for simulating makeup virtually, comprising the steps of: acquiring an image of a face; A color information receiving step of receiving color information; A gradation information receiving step of receiving gradation information; And an image applying step of applying the acquired face information to the photographed image using the received color information and the received gradation information.

Preferably, the virtual makeup simulation method further comprises a makeup applying step of selecting a makeup area using the captured image of the obtained face.

Preferably, the color information is at least one of a monochromatic color, at least two colors, at least two colors to be mixed, or at least two colors to be superimposed.

Preferably, the gradient information is at least one of linear, radial, quadrangular, or path type.

Preferably, the virtual makeup simulation method further includes a setting method storing step of storing information on the received color information, the received gradation information, and an image applied in the image applying step.

According to another aspect of the present invention, there is provided an apparatus for simulating makeup, the apparatus comprising: an image acquiring unit for acquiring an image of a face; A color information receiver for receiving color information; A gradation information receiving unit for receiving gradation information; And an image application unit for applying the acquired face information to the photographed image using the received color information and the received gradation information.

Preferably, the virtual make-up simulation apparatus further includes a makeup application unit for selecting a makeup area using the captured image of the obtained face.

Preferably, the color information is at least one of a monochromatic color, at least two colors, at least two colors to be mixed, or at least two colors to be superimposed.

Preferably, the gradient information is at least one of linear, radial, quadrangular, or path type.

Preferably, the image processing apparatus further includes a setting method storing unit that stores the received color information, the received gradation information, and information on an image applied by the image applying unit.

The present invention allows a user to make-up a makeup method suitable for his / her face by trial and error by making a makeup in a natural and various manner to a photograph of his / her face.

1 is a block diagram of a virtual makeup simulation apparatus according to a preferred embodiment of the present invention.
FIG. 2 is a flowchart of a virtual makeup simulation method according to a preferred embodiment of the present invention.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the drawings. In the following description and the accompanying drawings, substantially the same components are denoted by the same reference numerals, respectively, and redundant description will be omitted. In the following description of the present invention, a detailed description of known functions and configurations incorporated herein will be omitted when it may make the subject matter of the present invention rather unclear.

It is to be understood that when an element is referred to as being "connected" or "connected" to another element, it may be directly connected or connected to the other element, . On the other hand, when an element is referred to as being "directly connected" or "directly connected" to another element, it should be understood that there are no other elements in between.

1 is a block diagram of a virtual makeup simulation apparatus according to a preferred embodiment of the present invention.

1, an image obtaining unit 110, an image analyzing unit 120, a makeup method selecting unit 130, a makeup applying unit 150, a makeup applying unit 150, and a setting method storing unit 160 .

The image obtaining unit 110 obtains an image of a face. An image in which a face is photographed can include not only a photograph but also a moving image.

The image analyzer 120 analyzes the face of the image obtained by the image acquiring unit 110 and divides each region in the face portion of the image. Information on the divided area can be used in the makeup area selection unit 140. [

The division of each region is intended to distinguish the eyes, eyebrows, lips, balls or nose which have many differences in the make-up method.

The image analyzer 120 may analyze the face by extracting the feature points from the acquired image to determine the eyes, nose, and mouth.

In addition, the image analysis unit 120 grasps the outline of a face in an image obtained by using a depth map, chromaticity change, boundary line grasp, or the like.

The makeup method selection unit 130 receives an input from a user and selects a makeup method.

Specifically, the make-up method selecting unit 130 may include a setting method selecting unit 132 and a manual method selecting unit 134.

The setting method selecting unit 132 selects the makeup method by using the information stored in the setting method storing unit 160 or by selecting the setting created in the setting method storing unit 160. [ More specifically, the setting method storage unit 160 will be described.

The manual method selection unit 134 receives an input from a user and selects a color selection, a gradation effect selection, and the like. That is, when the user's input is transmitted to the manual method selection unit 134, the manual method selection unit 134 transmits a signal to the makeup application unit 150 so that the user can select a makeup area.

The makeup area selection unit 140 receives a user's input and designates a makeup area.

The method of receiving the user's input by the makeup area selection unit 140 may be performed by sensing various types of input such as voice input, touch input, keyboard input, or mouse input.

Specifically, it is preferable that the makeup area selection unit 140 receives the input using the touch input or the mouse input on the obtained image so as to accurately specify the makeup area according to the user's intention.

When the makeup area selection unit 140 specifies an area for simulating makeup, the makeup application unit 150 receives information on color selection and gradation selection and applies the information to the image.

The makeup application unit 150 receives a user's input, selects a color, and determines a gradation effect.

The method by which the makeup application unit 150 receives the input of the user can receive and receive various types of input such as voice input, touch input, keyboard input, or mouse input.

Specifically, the makeup application unit 150 visually presents various kinds of colors and gradation effects to the user, and when the user inputs the presentation using the touch pad or the mouse, the user receives the input, Accordingly, the color and gradation effects are determined and applied to the image acquired by the image acquisition unit 110.

More specifically, the makeup application unit 150 includes a user selection receiving unit 152, a color application unit 154, and a gradient application unit 156.

The user selection receiver 152 receives the user's input for color and gradation effects, as described above. The user's input on the color can be received by the color information receiving unit, and the user's input on the gradation effect can be received by the gradation information receiving unit.

For example, when the user selects one of the color or gradation effects visually presented through the display by the user selection receiving unit 152 using the touch or the mouse, the user selection receiving unit 152 receives the color or gradation effect, Gain information about the gradient effect.

More specifically, for example, the color presented by the user selection receiving unit 152 may be at least one of a single color, at least two colors, at least two colors to be mixed, or at least two colors to be overwritten . If the user selects at least two colors, he or she can mix the two or more selected colors or use them in different areas. When the user selection receiving unit 152 selects two or more colors, the user selection receiving unit 152 may also receive information on whether or not to mix.

For example, the gradation effect received by the user selection receiving unit 152 may be displayed on a display such that the user can select one of the none, linear, radial, square, or path types. If the user selects any one of linear, radial, square, and path types, the degree of gradation application can be selected from more than 0 to less than 100. When the user selects the gradation effect and degree, the user selection receiving unit 152 receives the selection and transmits the selection information to the gradation application unit 156. [

The information received by the user selection receiving unit 152 is transmitted to the image application unit.

The image application unit includes a color application unit 154 and a gradient application unit 156. If the information received by the user selection receiving unit 152 is information related to color selection, the color application unit 154 performs virtual makeup simulation. If the received information is information on the gradation effect, the gradation application unit 156 applies the virtual make- Simulation is performed.

The color application unit 154 applies the received single color to the image acquired by the image acquisition unit 110 when the color information received from the user selection receiving unit 152 is monochrome. It is preferable that the color application unit 154 applies only to the area selected by the makeup area selection unit 140 when color is applied to the image.

The color application unit 154 applies the information received from the user selection and reception unit 152 to the image in the color application unit 154 when there is no selection of the gradation effect in the information received from the user selection and reception unit 152 Thereby simulating the virtual makeup.

If the color application unit 154 receives information from the user selection and reception unit 152 for at least two or more colors, the color application unit 154 may mix two or more colors to apply to the image, It is determined whether to apply the color to the image, add another color, or divide the area within the area selected by the makeup area selection unit 140 to apply each color. The color application unit 154 receives the information received from the user by the user selection receiving unit 152 and determines the determination.

And applies it to the image obtained by the image obtaining unit 110 based on the preset bar according to the judgment. Preferably, the predetermined bar is set to blend two or more colors and then apply them to the image, and to apply a single color to the image and then add different colors.

When there is a selection of the gradation effect among the user inputs received by the user selection receiving unit 152, the gradation applying unit 156 generates a gradation effect when color is applied to the image.

The gradation application unit 156 receives information on the type and degree of the gradation effect in the user selection receiving unit 152 and applies a gradation effect to the image acquired by the image obtaining unit 110 based on the received information.

The gradation application unit 156 may apply a gradation to the image after applying the color to the image, and may indicate the state of the virtual makeup applied to the image. When the color application unit 154 applies color to the image, Effects can be applied together.

Applying the gradient after applying the color to provide the state of the virtual makeup to the user may be desirable because it can visually recognize the effect of the gradient.

The setting method storage unit 160 collects and stores an image to which a color or gradation is applied based on the selection information of the user and the selection.

The setting method storage unit 160 collects and stores information on the color and gradation information received from the user's makeup area selection unit 140 and the user selection and reception unit 152. [ In addition, the setting method storage unit 160 collects and stores images applied by the color application unit 154 and the gradient application unit 156.

The setting method storage unit 160 may generate settings using information collected and stored. For example, when the user selects the entire face in the makeup region selection unit 140, selects the eighth and twelfth colors as the colors, applies the twelfth color first by applying the color, and adds the eighth color The radial type is selected by the gradation effect, and the degree of application of the gradation effect is applied in two steps to perform the virtual makeup, the setting method storage unit 160 can generate the selection of the user in one setting have. In addition, the setting method storage unit 160 may map the generated setting and the result of the virtual makeup applying the selection of the user.

When the user selects a setting generated by the setting method selecting unit 132 of the makeup method selecting unit 130, the user performs a virtual makeup operation in which a result of the virtual makeup mapped to the selected selection is provided, Results.

Using the setting method storage unit 160, the user can save his / her favorite results and receive the desired results whenever necessary.

The virtual makeup simulation apparatus 100 according to the present invention can make a makeup method suitable for the face of the user by trial and error by making the makeup in a natural and various manner to the photograph of the user's face.

FIG. 2 is a flowchart of a virtual makeup simulation method according to a preferred embodiment of the present invention.

Referring to FIG. 2, the image obtaining unit 110 obtains a photographed image of the face (S210).

The image analysis unit 120 analyzes the image acquired by the image acquisition unit 110 to divide the face region (step S220).

The makeup method selection unit 130 receives information on whether to manually or manually select a makeup method from the user (step S230).

If the user selects to be set according to the set bar, the setting method selecting unit 132 receives the mapped result with the setting selected by the user from the setting method storing unit 160 and provides the received result to the user (step S240).

When the user manually selects the manual method selection unit 134, the manual method selection unit 134 transmits a signal to the makeup area selection unit 140, and the makeup area selection unit 140 presents the makeup area to the user to receive the user's input (Step S250).

After the make-up area is selected, the user selection receiving unit 152 receives information on the color and the gradation effect from the user (step S260).

The color application unit 154 simulates the virtual makeup on the image acquired by the image acquisition unit 110 using the color information received by the user selection receiving unit 152 and the information received from the makeup region selection unit 140 (Step S270). The gradation applying unit 156 applies a virtual makeup to the image acquired by the image obtaining unit 110 using the information on the gradation effect received by the user selecting and receiving unit 152 and the information received by the makeup area selecting unit 140 (Step S270). That is, the color application unit 154 applies the color selected by the user to the region selected by the user, and the gradient applying unit 156 applies the gradation effect selected by the user to the region selected by the user.

The setting method storage unit 160 stores the user selection information and the result, and generates the setting using the stored result (step S280). That is, the setting method storage unit 160 stores the image obtained by the image obtaining unit 110, the information received by the makeup area selecting unit 140, the information received by the user selecting and receiving unit 152, and the virtual makeup simulated image . In addition, the information received by the makeup region selection unit 140 and the information received by the user selection receiving unit 152 are generated in a single setting, and the makeup method selection unit 130 selects an image acquisition unit 110) and a virtual makeup simulated image.

   The virtual makeup simulation method according to the present invention allows a user to make up a makeup method suitable for his or her face by trial and error by performing makeup in a natural and various manner on a photograph of his / her face.

It should be understood that the block diagram of the virtual makeup simulation apparatus 100 according to the preferred embodiment of the present invention represents exemplary conceptual aspects embodying the principles of the invention. Similarly, all of the flowcharts should be understood to represent various processes that may be substantially represented on a computer-readable medium and executed by a computer or processor, whether the computer or processor is explicitly shown.

The functions of the various elements shown in the figures, including the functional blocks depicted in the processor or similar concept, may be provided by use of dedicated hardware as well as hardware capable of executing software in connection with appropriate software. When provided by a processor, the functions may be provided by a single dedicated processor, a single shared processor, or a plurality of individual processors, some of which may be shared.

Also, the explicit use of terms such as processor, control, or similar concepts should not be interpreted exclusively as hardware capable of running software, and may be used without limitation as a digital signal processor (DSP) (ROM), random access memory (RAM), and non-volatile memory. Other hardware may also be included.

It will be apparent to those skilled in the art that various modifications, substitutions and substitutions are possible, without departing from the scope and spirit of the invention as disclosed in the accompanying claims. will be. Therefore, the embodiments disclosed in the present invention and the accompanying drawings are intended to illustrate and not to limit the technical spirit of the present invention, and the scope of the technical idea of the present invention is not limited by these embodiments and the accompanying drawings . The scope of protection of the present invention should be construed according to the following claims, and all technical ideas within the scope of equivalents should be construed as falling within the scope of the present invention.

Claims (20)

Obtaining a first image including a face;
Receiving a first instruction to select a makeup area;
Receiving a second command to select a color and a gradient effect; And
Displaying an image obtained by applying a color and gradation effect according to the second instruction to a makeup area selected by the first instruction of the face,
The step of receiving the second instruction
Displaying a color and a plurality of gradation effects,
Receiving an instruction to select the color,
Receiving an instruction to select any one of the plurality of gradation effects,
Wherein each of the plurality of gradation effects has a different color type and color distribution shape,
The step of receiving an instruction to select the color
Receiving information about whether a color is blended if more than one color is selected,
Further comprising determining whether to apply two or more hues to the first image or to apply one hue to the first image and then to apply another hue based on the information on whether or not to mix the colors,
An image when the two or more colors are mixed and applied to the first image and an image when the one color is applied to the first image and the other color is further applied are different
Makeup simulation method.
delete The method according to claim 1,
Receiving a third command to select a degree of application of the gradient effect selected in accordance with the second command; And
And displaying an image in which a gradation effect of the gradation effect is adjusted according to the third instruction.
Makeup simulation method.
The method according to claim 1,
The step of receiving the second instruction
Receiving a command to select a color number or color type;
Makeup simulation method.
The method according to claim 1,
The step of receiving the second instruction
And receiving an instruction to select a gradient shape to be applied to the makeup area selected by the first instruction.
Makeup simulation method.
The method according to claim 1,
Further comprising the step of extracting feature points of the face in the first image to distinguish the eyes, nose, or mouth.
Makeup simulation method.
The method according to claim 1,
Storing the makeup information according to the first and second instructions upon receiving the save command,
The makeup information
And a makeup method for applying a color and gradation effect selected through the second instruction to the makeup area selected through the first instruction,
Makeup simulation method.
8. The method of claim 7,
Further comprising creating a makeup style corresponding to the stored makeup information in accordance with the save command.
Makeup simulation method.
9. The method of claim 8,
Obtaining a second image including a face; And
Displaying an image reflecting the makeup information on a face included in the second image upon receiving the instruction to select the makeup style,
Makeup simulation method.
The method according to claim 1,
Further comprising the step of storing an image to which a color and gradation effect according to the second instruction is applied to the makeup area selected by the first instruction upon receiving the save instruction,
Makeup simulation method.
An image obtaining unit obtaining a first image including a face;
A make-up area selecting unit for receiving a first command for selecting a make-up area;
A make-up method selecting unit receiving a second command for selecting a color and a gradation effect; And
A makeup application unit applying a color and gradation effect according to the second instruction to a makeup area selected by the first instruction among the faces; And
And a display unit for displaying an image obtained by applying the color and gradation effect to the face by the makeup application unit,
The display
Color and multiple gradation effects,
The makeup method selection unit
Receiving the second instruction through a command for selecting the color and a command for selecting any one of the plurality of gradation effects,
Wherein each of the plurality of gradation effects has a different color type and color distribution shape,
The makeup application unit
A user selection receiving unit for receiving information on color and color blending and an input for a gradation effect,
A color application unit for applying a color selected through the user selection receiving unit to the first image;
And a gradation applying unit applying the gradation effect selected in the first image when the gradation effect is selected,
The color application unit
When two or more colors are selected, it is determined whether the two or more selected colors are mixed and applied to the first image or one color is applied to the first image,
The display
An image when the two or more colors are mixed and applied to the first image and an image when the one color is applied to the first image and the other color is further applied are displayed differently
Device.
delete 12. The method of claim 11,
The makeup method selection unit
A third command for selecting a degree of application of the gradation effect selected in accordance with the second command,
The makeup application unit
And adjusting a gradation of the gradation effect according to the third instruction,
Device.
12. The method of claim 11,
The makeup method selection unit
Receiving a command to select a number of colors or a color type,
Device.
12. The method of claim 11,
The makeup method selection unit
And a command to select a gradient shape to be applied to the makeup area selected by the first instruction,
Device.
12. The method of claim 11,
Further comprising an image analyzer for extracting feature points of the face included in the first image to distinguish the eyes,
Device.
12. The method of claim 11,
Further comprising a storage unit for storing makeup information according to the first and second instructions upon receipt of a save command,
The makeup information
And a makeup method for applying a color and gradation effect selected through the second instruction to the makeup area selected through the first instruction,
Device.
18. The method of claim 17,
The storage unit
Creating a makeup style corresponding to the stored makeup information,
Device.
19. The method of claim 18,
The image obtaining unit
Acquiring a second image including a face,
The makeup application unit
And when it receives the instruction to select the makeup style, reflects the makeup information on the face included in the second image,
Device.
12. The method of claim 11,
And a storage unit for storing an image obtained by applying the color and gradation effects to the face by the makeup application unit.
Device.

Images